Oct 18 11:36:43 user nova-compute[74190]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=74190) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 18 11:36:43 user nova-compute[74190]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=74190) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 18 11:36:43 user nova-compute[74190]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=74190) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 18 11:36:43 user nova-compute[74190]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.019s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:36:44 user nova-compute[74190]: INFO nova.virt.driver [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] Loading compute driver 'libvirt.LibvirtDriver'
Oct 18 11:36:44 user nova-compute[74190]: INFO nova.compute.provider_config [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] Acquiring lock "singleton_lock" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] Acquired lock "singleton_lock" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] Releasing lock "singleton_lock" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] Full set of CONF: {{(pid=74190) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] ******************************************************************************** {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] Configuration options gathered from: {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] ================================================================================ {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] allow_resize_to_same_host      = True {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] arq_binding_timeout            = 300 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] backdoor_port                  = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] backdoor_socket                = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] block_device_allocate_retries  = 300 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] block_device_allocate_retries_interval = 5 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] cert                           = self.pem {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] compute_monitors               = [] {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] config_dir                     = [] {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] config_drive_format            = iso9660 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] config_source                  = [] {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] console_host                   = user {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] control_exchange               = nova {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] cpu_allocation_ratio           = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] daemon                         = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] debug                          = True {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] default_access_ip_network_name = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] default_availability_zone      = nova {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] default_ephemeral_format       = ext4 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] default_green_pool_size        = 1000 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] default_schedule_zone          = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] disk_allocation_ratio          = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] enable_new_services            = True {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] enabled_apis                   = ['osapi_compute'] {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] enabled_ssl_apis               = [] {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] flat_injected                  = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] force_config_drive             = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] force_raw_images               = True {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] graceful_shutdown_timeout      = 5 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] heal_instance_info_cache_interval = 60 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] host                           = user {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] initial_disk_allocation_ratio  = 1.0 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] initial_ram_allocation_ratio   = 1.0 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] instance_build_timeout         = 0 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] instance_delete_interval       = 300 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] instance_format                = [instance: %(uuid)s]  {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] instance_name_template         = instance-%08x {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] instance_usage_audit           = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] instance_usage_audit_period    = month {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] internal_service_availability_zone = internal {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] key                            = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] live_migration_retry_count     = 30 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] log_config_append              = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] log_dir                        = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] log_file                       = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] log_options                    = True {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] log_rotate_interval            = 1 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] log_rotate_interval_type       = days {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] log_rotation_type              = none {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] long_rpc_timeout               = 1800 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] max_concurrent_builds          = 10 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] max_concurrent_live_migrations = 1 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] max_concurrent_snapshots       = 5 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] max_local_block_devices        = 3 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] max_logfile_count              = 30 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] max_logfile_size_mb            = 200 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] maximum_instance_delete_attempts = 5 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] metadata_listen                = 0.0.0.0 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] metadata_listen_port           = 8775 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] metadata_workers               = 3 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] migrate_max_retries            = -1 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] mkisofs_cmd                    = genisoimage {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] my_block_storage_ip            = 10.0.0.210 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] my_ip                          = 10.0.0.210 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] network_allocate_retries       = 0 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] osapi_compute_listen           = 0.0.0.0 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] osapi_compute_listen_port      = 8774 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] osapi_compute_unique_server_name_scope =  {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] osapi_compute_workers          = 3 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] password_length                = 12 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] periodic_enable                = True {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] periodic_fuzzy_delay           = 60 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] pointer_model                  = ps2mouse {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] preallocate_images             = none {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] publish_errors                 = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] pybasedir                      = /opt/stack/nova {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] ram_allocation_ratio           = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] rate_limit_burst               = 0 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] rate_limit_except_level        = CRITICAL {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] rate_limit_interval            = 0 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] reboot_timeout                 = 0 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] reclaim_instance_interval      = 0 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] record                         = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] reimage_timeout_per_gb         = 60 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] report_interval                = 120 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] rescue_timeout                 = 0 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] reserved_host_cpus             = 0 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] reserved_host_disk_mb          = 0 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] reserved_host_memory_mb        = 512 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] reserved_huge_pages            = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] resize_confirm_window          = 0 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] resize_fs_using_block_device   = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] resume_guests_state_on_host_boot = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] rpc_response_timeout           = 60 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] run_external_periodic_tasks    = True {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] running_deleted_instance_action = reap {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] running_deleted_instance_poll_interval = 1800 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] running_deleted_instance_timeout = 0 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] scheduler_instance_sync_interval = 120 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] service_down_time              = 720 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] servicegroup_driver            = db {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] shelved_offload_time           = 0 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] shelved_poll_interval          = 3600 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] shutdown_timeout               = 0 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] source_is_ipv6                 = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] ssl_only                       = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] state_path                     = /opt/stack/data/nova {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] sync_power_state_interval      = 600 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] sync_power_state_pool_size     = 1000 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] syslog_log_facility            = LOG_USER {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] tempdir                        = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] timeout_nbd                    = 10 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] transport_url                  = **** {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] update_resources_interval      = 0 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] use_cow_images                 = True {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] use_eventlog                   = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] use_journal                    = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] use_json                       = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] use_rootwrap_daemon            = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] use_stderr                     = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] use_syslog                     = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] vcpu_pin_set                   = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] vif_plugging_is_fatal          = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] vif_plugging_timeout           = 0 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] virt_mkfs                      = [] {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] volume_usage_poll_interval     = 0 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] watch_log_file                 = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] web                            = /usr/share/spice-html5 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] oslo_concurrency.disable_process_locking = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] api.auth_strategy              = keystone {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] api.compute_link_prefix        = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] api.dhcp_domain                = novalocal {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] api.enable_instance_password   = True {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] api.glance_link_prefix         = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] api.instance_list_cells_batch_strategy = distributed {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] api.instance_list_per_project_cells = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] api.list_records_by_skipping_down_cells = True {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] api.local_metadata_per_cell    = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] api.max_limit                  = 1000 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] api.metadata_cache_expiration  = 15 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] api.neutron_default_tenant_id  = default {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] api.use_forwarded_for          = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] api.use_neutron_default_nets   = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] api.vendordata_dynamic_failure_fatal = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] api.vendordata_dynamic_targets = [] {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] api.vendordata_jsonfile_path   = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] cache.backend                  = dogpile.cache.memcached {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] cache.backend_argument         = **** {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] cache.config_prefix            = cache.oslo {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] cache.dead_timeout             = 60.0 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] cache.debug_cache_backend      = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] cache.enable_retry_client      = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] cache.enable_socket_keepalive  = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] cache.enabled                  = True {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] cache.expiration_time          = 600 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] cache.hashclient_retry_attempts = 2 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] cache.hashclient_retry_delay   = 1.0 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] cache.memcache_dead_retry      = 300 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] cache.memcache_password        =  {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] cache.memcache_pool_maxsize    = 10 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] cache.memcache_pool_unused_timeout = 60 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] cache.memcache_sasl_enabled    = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] cache.memcache_socket_timeout  = 1.0 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] cache.memcache_username        =  {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] cache.proxies                  = [] {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] cache.retry_attempts           = 2 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] cache.retry_delay              = 0.0 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] cache.socket_keepalive_count   = 1 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] cache.socket_keepalive_idle    = 1 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] cache.socket_keepalive_interval = 1 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] cache.tls_allowed_ciphers      = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] cache.tls_cafile               = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] cache.tls_certfile             = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] cache.tls_enabled              = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] cache.tls_keyfile              = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] cinder.auth_section            = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] cinder.auth_type               = password {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] cinder.cafile                  = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] cinder.catalog_info            = volumev3::publicURL {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] cinder.certfile                = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] cinder.collect_timing          = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] cinder.cross_az_attach         = True {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] cinder.debug                   = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] cinder.endpoint_template       = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] cinder.http_retries            = 3 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] cinder.insecure                = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] cinder.keyfile                 = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] cinder.os_region_name          = RegionOne {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] cinder.split_loggers           = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] cinder.timeout                 = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] compute.cpu_dedicated_set      = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] compute.cpu_shared_set         = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] compute.image_type_exclude_list = [] {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] compute.live_migration_wait_for_vif_plug = True {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] compute.max_concurrent_disk_ops = 0 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] compute.max_disk_devices_to_attach = -1 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] compute.resource_provider_association_refresh = 300 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] compute.shutdown_retry_interval = 10 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] conductor.workers              = 3 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] console.allowed_origins        = [] {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] console.ssl_ciphers            = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] console.ssl_minimum_version    = default {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] consoleauth.token_ttl          = 600 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] cyborg.cafile                  = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] cyborg.certfile                = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] cyborg.collect_timing          = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] cyborg.connect_retries         = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] cyborg.connect_retry_delay     = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] cyborg.endpoint_override       = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] cyborg.insecure                = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] cyborg.keyfile                 = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] cyborg.max_version             = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] cyborg.min_version             = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] cyborg.region_name             = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] cyborg.service_name            = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] cyborg.service_type            = accelerator {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] cyborg.split_loggers           = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] cyborg.status_code_retries     = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] cyborg.status_code_retry_delay = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] cyborg.timeout                 = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] cyborg.version                 = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] database.backend               = sqlalchemy {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] database.connection            = **** {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] database.connection_debug      = 0 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] database.connection_parameters =  {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] database.connection_recycle_time = 3600 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] database.connection_trace      = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] database.db_inc_retry_interval = True {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] database.db_max_retries        = 20 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] database.db_max_retry_interval = 10 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] database.db_retry_interval     = 1 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] database.max_overflow          = 50 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] database.max_pool_size         = 5 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] database.max_retries           = 10 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] database.mysql_wsrep_sync_wait = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] database.pool_timeout          = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] database.retry_interval        = 10 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] database.slave_connection      = **** {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] database.sqlite_synchronous    = True {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] api_database.backend           = sqlalchemy {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] api_database.connection        = **** {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] api_database.connection_debug  = 0 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] api_database.connection_parameters =  {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] api_database.connection_recycle_time = 3600 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] api_database.connection_trace  = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] api_database.db_inc_retry_interval = True {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] api_database.db_max_retries    = 20 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] api_database.db_max_retry_interval = 10 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] api_database.db_retry_interval = 1 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] api_database.max_overflow      = 50 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] api_database.max_pool_size     = 5 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] api_database.max_retries       = 10 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] api_database.mysql_wsrep_sync_wait = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] api_database.pool_timeout      = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] api_database.retry_interval    = 10 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] api_database.slave_connection  = **** {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] api_database.sqlite_synchronous = True {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] devices.enabled_mdev_types     = [] {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] ephemeral_storage_encryption.enabled = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] ephemeral_storage_encryption.key_size = 512 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] glance.api_servers             = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] glance.cafile                  = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] glance.certfile                = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] glance.collect_timing          = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] glance.connect_retries         = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] glance.connect_retry_delay     = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] glance.debug                   = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] glance.default_trusted_certificate_ids = [] {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] glance.enable_certificate_validation = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] glance.enable_rbd_download     = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] glance.endpoint_override       = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] glance.insecure                = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] glance.keyfile                 = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] glance.max_version             = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] glance.min_version             = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] glance.num_retries             = 3 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] glance.rbd_ceph_conf           =  {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] glance.rbd_connect_timeout     = 5 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] glance.rbd_pool                =  {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] glance.rbd_user                =  {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] glance.region_name             = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] glance.service_name            = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] glance.service_type            = image {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] glance.split_loggers           = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] glance.status_code_retries     = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] glance.status_code_retry_delay = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] glance.timeout                 = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] glance.verify_glance_signatures = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] glance.version                 = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] guestfs.debug                  = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] hyperv.config_drive_cdrom      = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] hyperv.config_drive_inject_password = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] hyperv.enable_instance_metrics_collection = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] hyperv.enable_remotefx         = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] hyperv.instances_path_share    =  {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] hyperv.iscsi_initiator_list    = [] {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] hyperv.limit_cpu_features      = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] hyperv.power_state_check_timeframe = 60 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] hyperv.power_state_event_polling_interval = 2 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] hyperv.use_multipath_io        = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] hyperv.volume_attach_retry_count = 10 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] hyperv.volume_attach_retry_interval = 5 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] hyperv.vswitch_name            = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] mks.enabled                    = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] image_cache.manager_interval   = 2400 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] image_cache.precache_concurrency = 1 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] image_cache.remove_unused_base_images = True {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] image_cache.subdirectory_name  = _base {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] ironic.api_max_retries         = 60 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] ironic.api_retry_interval      = 2 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] ironic.auth_section            = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] ironic.auth_type               = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] ironic.cafile                  = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] ironic.certfile                = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] ironic.collect_timing          = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] ironic.conductor_group         = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] ironic.connect_retries         = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] ironic.connect_retry_delay     = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] ironic.endpoint_override       = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] ironic.insecure                = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] ironic.keyfile                 = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] ironic.max_version             = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] ironic.min_version             = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] ironic.peer_list               = [] {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] ironic.region_name             = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] ironic.serial_console_state_timeout = 10 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] ironic.service_name            = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] ironic.service_type            = baremetal {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] ironic.split_loggers           = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] ironic.status_code_retries     = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] ironic.status_code_retry_delay = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] ironic.timeout                 = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] ironic.version                 = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] key_manager.fixed_key          = **** {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] barbican.barbican_api_version  = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] barbican.barbican_endpoint     = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] barbican.barbican_endpoint_type = public {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] barbican.barbican_region_name  = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] barbican.cafile                = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] barbican.certfile              = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] barbican.collect_timing        = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] barbican.insecure              = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] barbican.keyfile               = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] barbican.number_of_retries     = 60 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] barbican.retry_delay           = 1 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] barbican.send_service_user_token = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] barbican.split_loggers         = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] barbican.timeout               = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] barbican.verify_ssl            = True {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] barbican.verify_ssl_path       = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] barbican_service_user.auth_section = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] barbican_service_user.auth_type = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] barbican_service_user.cafile   = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] barbican_service_user.certfile = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] barbican_service_user.collect_timing = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] barbican_service_user.insecure = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] barbican_service_user.keyfile  = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] barbican_service_user.split_loggers = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] barbican_service_user.timeout  = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] vault.approle_role_id          = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] vault.approle_secret_id        = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] vault.cafile                   = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] vault.certfile                 = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] vault.collect_timing           = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] vault.insecure                 = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] vault.keyfile                  = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] vault.kv_mountpoint            = secret {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] vault.kv_path                  = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] vault.kv_version               = 2 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] vault.namespace                = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] vault.root_token_id            = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] vault.split_loggers            = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] vault.ssl_ca_crt_file          = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] vault.timeout                  = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] vault.use_ssl                  = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] keystone.auth_section          = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] keystone.auth_type             = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] keystone.cafile                = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] keystone.certfile              = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] keystone.collect_timing        = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] keystone.connect_retries       = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] keystone.connect_retry_delay   = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] keystone.endpoint_override     = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] keystone.insecure              = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] keystone.keyfile               = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] keystone.max_version           = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] keystone.min_version           = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] keystone.region_name           = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] keystone.service_name          = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] keystone.service_type          = identity {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] keystone.split_loggers         = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] keystone.status_code_retries   = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] keystone.status_code_retry_delay = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] keystone.timeout               = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] keystone.version               = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] libvirt.connection_uri         =  {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] libvirt.cpu_mode               = custom {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] libvirt.cpu_model_extra_flags  = [] {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: WARNING oslo_config.cfg [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] libvirt.cpu_power_governor_high = performance {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] libvirt.cpu_power_governor_low = powersave {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] libvirt.cpu_power_management   = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] libvirt.device_detach_attempts = 8 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] libvirt.device_detach_timeout  = 20 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] libvirt.disk_cachemodes        = [] {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] libvirt.disk_prefix            = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] libvirt.enabled_perf_events    = [] {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] libvirt.file_backed_memory     = 0 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] libvirt.gid_maps               = [] {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] libvirt.hw_disk_discard        = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] libvirt.hw_machine_type        = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] libvirt.images_rbd_ceph_conf   =  {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] libvirt.images_rbd_glance_store_name =  {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] libvirt.images_rbd_pool        = rbd {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] libvirt.images_type            = default {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] libvirt.images_volume_group    = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] libvirt.inject_key             = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] libvirt.inject_partition       = -2 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] libvirt.inject_password        = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] libvirt.iscsi_iface            = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] libvirt.iser_use_multipath     = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] libvirt.live_migration_bandwidth = 0 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] libvirt.live_migration_completion_timeout = 800 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] libvirt.live_migration_downtime = 500 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] libvirt.live_migration_downtime_delay = 75 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] libvirt.live_migration_downtime_steps = 10 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] libvirt.live_migration_inbound_addr = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] libvirt.live_migration_permit_auto_converge = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] libvirt.live_migration_permit_post_copy = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] libvirt.live_migration_scheme  = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] libvirt.live_migration_timeout_action = abort {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] libvirt.live_migration_tunnelled = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: WARNING oslo_config.cfg [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Oct 18 11:36:44 user nova-compute[74190]: live_migration_uri is deprecated for removal in favor of two other options that
Oct 18 11:36:44 user nova-compute[74190]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Oct 18 11:36:44 user nova-compute[74190]: and ``live_migration_inbound_addr`` respectively.
Oct 18 11:36:44 user nova-compute[74190]: ).  Its value may be silently ignored in the future.
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] libvirt.live_migration_with_native_tls = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] libvirt.max_queues             = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] libvirt.mem_stats_period_seconds = 10 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] libvirt.nfs_mount_options      = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] libvirt.num_aoe_discover_tries = 3 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] libvirt.num_iser_scan_tries    = 5 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] libvirt.num_memory_encrypted_guests = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] libvirt.num_nvme_discover_tries = 5 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] libvirt.num_pcie_ports         = 0 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] libvirt.num_volume_scan_tries  = 5 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] libvirt.pmem_namespaces        = [] {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] libvirt.quobyte_client_cfg     = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] libvirt.rbd_connect_timeout    = 5 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] libvirt.rbd_secret_uuid        = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] libvirt.rbd_user               = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] libvirt.realtime_scheduler_priority = 1 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] libvirt.remote_filesystem_transport = ssh {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] libvirt.rescue_image_id        = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] libvirt.rescue_kernel_id       = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] libvirt.rescue_ramdisk_id      = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] libvirt.rx_queue_size          = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] libvirt.smbfs_mount_options    =  {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] libvirt.snapshot_compression   = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] libvirt.snapshot_image_format  = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] libvirt.sparse_logical_volumes = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] libvirt.swtpm_enabled          = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] libvirt.swtpm_group            = tss {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] libvirt.swtpm_user             = tss {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] libvirt.sysinfo_serial         = unique {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] libvirt.tb_cache_size          = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] libvirt.tx_queue_size          = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] libvirt.uid_maps               = [] {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] libvirt.use_virtio_for_bridges = True {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] libvirt.virt_type              = kvm {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] libvirt.volume_clear           = zero {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] libvirt.volume_clear_size      = 0 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] libvirt.volume_use_multipath   = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] libvirt.vzstorage_cache_path   = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] libvirt.vzstorage_mount_group  = qemu {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] libvirt.vzstorage_mount_opts   = [] {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] libvirt.vzstorage_mount_user   = stack {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] neutron.auth_section           = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] neutron.auth_type              = password {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] neutron.cafile                 = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] neutron.certfile               = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] neutron.collect_timing         = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] neutron.connect_retries        = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] neutron.connect_retry_delay    = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] neutron.default_floating_pool  = public {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] neutron.endpoint_override      = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] neutron.extension_sync_interval = 600 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] neutron.http_retries           = 3 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] neutron.insecure               = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] neutron.keyfile                = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] neutron.max_version            = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] neutron.metadata_proxy_shared_secret = **** {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] neutron.min_version            = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] neutron.ovs_bridge             = br-int {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] neutron.physnets               = [] {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] neutron.region_name            = RegionOne {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] neutron.service_metadata_proxy = True {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] neutron.service_name           = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] neutron.service_type           = network {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] neutron.split_loggers          = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] neutron.status_code_retries    = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] neutron.status_code_retry_delay = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] neutron.timeout                = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] neutron.version                = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] notifications.bdms_in_notifications = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] notifications.default_level    = INFO {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] notifications.notification_format = unversioned {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] notifications.notify_on_state_change = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] pci.alias                      = [] {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] pci.device_spec                = [] {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] pci.report_in_placement        = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] placement.auth_section         = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] placement.auth_type            = password {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] placement.cafile               = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] placement.certfile             = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] placement.collect_timing       = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] placement.connect_retries      = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] placement.connect_retry_delay  = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] placement.default_domain_id    = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] placement.default_domain_name  = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] placement.domain_id            = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] placement.domain_name          = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] placement.endpoint_override    = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] placement.insecure             = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] placement.keyfile              = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] placement.max_version          = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] placement.min_version          = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] placement.password             = **** {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] placement.project_domain_id    = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] placement.project_domain_name  = Default {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] placement.project_id           = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] placement.project_name         = service {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] placement.region_name          = RegionOne {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] placement.service_name         = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] placement.service_type         = placement {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] placement.split_loggers        = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] placement.status_code_retries  = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] placement.status_code_retry_delay = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] placement.system_scope         = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] placement.timeout              = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] placement.trust_id             = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] placement.user_domain_id       = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] placement.user_domain_name     = Default {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] placement.user_id              = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] placement.username             = placement {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] placement.version              = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] quota.cores                    = 20 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] quota.count_usage_from_placement = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] quota.injected_file_content_bytes = 10240 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] quota.injected_file_path_length = 255 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] quota.injected_files           = 5 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] quota.instances                = 10 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] quota.key_pairs                = 100 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] quota.metadata_items           = 128 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] quota.ram                      = 51200 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] quota.recheck_quota            = True {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] quota.server_group_members     = 10 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] quota.server_groups            = 10 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] rdp.enabled                    = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] scheduler.image_metadata_prefilter = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] scheduler.max_attempts         = 3 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] scheduler.max_placement_results = 1000 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] scheduler.query_placement_for_image_type_support = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] scheduler.workers              = 3 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] filter_scheduler.host_subset_size = 1 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] filter_scheduler.image_properties_default_architecture = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] filter_scheduler.isolated_hosts = [] {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] filter_scheduler.isolated_images = [] {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] filter_scheduler.max_instances_per_host = 50 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] filter_scheduler.pci_in_placement = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] filter_scheduler.track_instance_changes = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] metrics.required               = True {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] metrics.weight_multiplier      = 1.0 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] metrics.weight_setting         = [] {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] serial_console.enabled         = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] serial_console.port_range      = 10000:20000 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] serial_console.serialproxy_port = 6083 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] service_user.auth_section      = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] service_user.auth_type         = password {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] service_user.cafile            = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] service_user.certfile          = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] service_user.collect_timing    = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] service_user.insecure          = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] service_user.keyfile           = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] service_user.send_service_user_token = True {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] service_user.split_loggers     = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] service_user.timeout           = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] spice.agent_enabled            = True {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] spice.enabled                  = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] spice.html5proxy_port          = 6082 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] spice.image_compression        = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] spice.jpeg_compression         = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] spice.playback_compression     = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] spice.server_listen            = 127.0.0.1 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] spice.streaming_mode           = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] spice.zlib_compression         = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] upgrade_levels.baseapi         = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] upgrade_levels.cert            = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] upgrade_levels.compute         = auto {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] upgrade_levels.conductor       = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] upgrade_levels.scheduler       = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] vendordata_dynamic_auth.auth_section = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] vendordata_dynamic_auth.auth_type = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] vendordata_dynamic_auth.cafile = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] vendordata_dynamic_auth.certfile = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] vendordata_dynamic_auth.collect_timing = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] vendordata_dynamic_auth.insecure = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] vendordata_dynamic_auth.keyfile = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] vendordata_dynamic_auth.split_loggers = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] vendordata_dynamic_auth.timeout = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] vmware.api_retry_count         = 10 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] vmware.ca_file                 = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] vmware.cache_prefix            = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] vmware.cluster_name            = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] vmware.connection_pool_size    = 10 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] vmware.console_delay_seconds   = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] vmware.datastore_regex         = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] vmware.host_ip                 = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] vmware.host_password           = **** {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] vmware.host_port               = 443 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] vmware.host_username           = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] vmware.insecure                = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] vmware.integration_bridge      = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] vmware.maximum_objects         = 100 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] vmware.pbm_default_policy      = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] vmware.pbm_enabled             = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] vmware.pbm_wsdl_location       = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] vmware.serial_port_proxy_uri   = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] vmware.serial_port_service_uri = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] vmware.task_poll_interval      = 0.5 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] vmware.use_linked_clone        = True {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] vmware.vnc_keymap              = en-us {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] vmware.vnc_port                = 5900 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] vmware.vnc_port_total          = 10000 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] vnc.auth_schemes               = ['none'] {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] vnc.enabled                    = True {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] vnc.novncproxy_port            = 6080 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] vnc.server_listen              = 0.0.0.0 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] vnc.vencrypt_ca_certs          = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] vnc.vencrypt_client_cert       = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] vnc.vencrypt_client_key        = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] workarounds.disable_fallback_pcpu_query = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] workarounds.disable_group_policy_check_upcall = True {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] workarounds.disable_rootwrap   = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] workarounds.enable_numa_live_migration = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] workarounds.handle_virt_lifecycle_events = True {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] workarounds.libvirt_disable_apic = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] workarounds.never_download_image_if_on_rbd = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] wsgi.client_socket_timeout     = 900 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] wsgi.default_pool_size         = 1000 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] wsgi.keep_alive                = True {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] wsgi.max_header_line           = 16384 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] wsgi.secure_proxy_ssl_header   = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] wsgi.ssl_ca_file               = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] wsgi.ssl_cert_file             = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] wsgi.ssl_key_file              = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] wsgi.tcp_keepidle              = 600 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] zvm.ca_file                    = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] zvm.cloud_connector_url        = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] zvm.reachable_timeout          = 300 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] oslo_policy.enforce_new_defaults = True {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] oslo_policy.enforce_scope      = True {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] oslo_policy.policy_default_rule = default {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] oslo_policy.policy_file        = policy.yaml {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] profiler.connection_string     = messaging:// {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] profiler.enabled               = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] profiler.es_doc_type           = notification {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] profiler.es_scroll_size        = 10000 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] profiler.es_scroll_time        = 2m {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] profiler.filter_error_trace    = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] profiler.hmac_keys             = **** {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] profiler.sentinel_service_name = mymaster {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] profiler.socket_timeout        = 0.1 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] profiler.trace_requests        = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] profiler.trace_sqlalchemy      = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] profiler_jaeger.process_tags   = {} {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] profiler_jaeger.service_name_prefix = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] profiler_otlp.service_name_prefix = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] remote_debug.host              = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] remote_debug.port              = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] oslo_messaging_rabbit.ssl      = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] oslo_messaging_rabbit.ssl_version =  {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] oslo_messaging_notifications.retry = -1 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] oslo_messaging_notifications.transport_url = **** {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] oslo_limit.auth_section        = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] oslo_limit.auth_type           = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] oslo_limit.cafile              = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] oslo_limit.certfile            = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] oslo_limit.collect_timing      = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] oslo_limit.connect_retries     = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] oslo_limit.connect_retry_delay = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] oslo_limit.endpoint_id         = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] oslo_limit.endpoint_override   = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] oslo_limit.insecure            = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] oslo_limit.keyfile             = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] oslo_limit.max_version         = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] oslo_limit.min_version         = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] oslo_limit.region_name         = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] oslo_limit.service_name        = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] oslo_limit.service_type        = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] oslo_limit.split_loggers       = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] oslo_limit.status_code_retries = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] oslo_limit.status_code_retry_delay = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] oslo_limit.timeout             = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] oslo_limit.valid_interfaces    = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] oslo_limit.version             = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] oslo_reports.file_event_handler = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] oslo_reports.file_event_handler_interval = 1 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] oslo_reports.log_dir           = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] vif_plug_linux_bridge_privileged.group = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] vif_plug_linux_bridge_privileged.user = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] vif_plug_ovs_privileged.group  = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] vif_plug_ovs_privileged.helper_command = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] vif_plug_ovs_privileged.user   = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] os_vif_linux_bridge.flat_interface = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] os_vif_linux_bridge.vlan_interface = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] os_vif_ovs.isolate_vif         = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] os_vif_ovs.ovsdb_interface     = native {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] os_vif_ovs.per_port_bridge     = False {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] os_brick.lock_path             = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] privsep_osbrick.capabilities   = [21] {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] privsep_osbrick.group          = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] privsep_osbrick.helper_command = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] privsep_osbrick.thread_pool_size = 12 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] privsep_osbrick.user           = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] nova_sys_admin.group           = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] nova_sys_admin.helper_command  = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] nova_sys_admin.thread_pool_size = 12 {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] nova_sys_admin.user            = None {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG oslo_service.service [None req-8e5c480b-20e9-4105-a332-f19cdc5ba03e None None] ******************************************************************************** {{(pid=74190) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Oct 18 11:36:44 user nova-compute[74190]: INFO nova.service [-] Starting compute node (version 0.0.0)
Oct 18 11:36:44 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Connecting to libvirt: qemu:///system {{(pid=74190) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f1f55d9d2a0> {{(pid=74190) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Oct 18 11:36:44 user nova-compute[74190]: libvirt:  error : internal error: could not initialize domain event timer
Oct 18 11:36:44 user nova-compute[74190]: WARNING nova.virt.libvirt.host [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Oct 18 11:36:44 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f1f55d9d2a0> {{(pid=74190) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Starting native event thread {{(pid=74190) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Starting green dispatch thread {{(pid=74190) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Oct 18 11:36:44 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Starting connection event dispatch thread {{(pid=74190) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Oct 18 11:36:44 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Connection event '1' reason 'None'
Oct 18 11:36:44 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Oct 18 11:36:44 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.mount [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Initialising _HostMountState generation 0 {{(pid=74190) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Oct 18 11:36:52 user nova-compute[74190]: INFO nova.virt.libvirt.host [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Libvirt host capabilities <capabilities>
Oct 18 11:36:52 user nova-compute[74190]:   <host>
Oct 18 11:36:52 user nova-compute[74190]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Oct 18 11:36:52 user nova-compute[74190]:     <cpu>
Oct 18 11:36:52 user nova-compute[74190]:       <arch>x86_64</arch>
Oct 18 11:36:52 user nova-compute[74190]:       <model>IvyBridge-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <vendor>Intel</vendor>
Oct 18 11:36:52 user nova-compute[74190]:       <microcode version='1070'/>
Oct 18 11:36:52 user nova-compute[74190]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Oct 18 11:36:52 user nova-compute[74190]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature name='ss'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature name='vmx'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature name='pcid'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature name='osxsave'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature name='hypervisor'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature name='arat'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature name='tsc_adjust'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature name='md-clear'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature name='stibp'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature name='arch-capabilities'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature name='ssbd'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature name='invtsc'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature name='rsba'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature name='skip-l1dfl-vmentry'/>
Oct 18 11:36:52 user nova-compute[74190]:       <pages unit='KiB' size='4'/>
Oct 18 11:36:52 user nova-compute[74190]:       <pages unit='KiB' size='2048'/>
Oct 18 11:36:52 user nova-compute[74190]:     </cpu>
Oct 18 11:36:52 user nova-compute[74190]:     <power_management>
Oct 18 11:36:52 user nova-compute[74190]:       <suspend_mem/>
Oct 18 11:36:52 user nova-compute[74190]:       <suspend_disk/>
Oct 18 11:36:52 user nova-compute[74190]:       <suspend_hybrid/>
Oct 18 11:36:52 user nova-compute[74190]:     </power_management>
Oct 18 11:36:52 user nova-compute[74190]:     <iommu support='no'/>
Oct 18 11:36:52 user nova-compute[74190]:     <migration_features>
Oct 18 11:36:52 user nova-compute[74190]:       <live/>
Oct 18 11:36:52 user nova-compute[74190]:       <uri_transports>
Oct 18 11:36:52 user nova-compute[74190]:         <uri_transport>tcp</uri_transport>
Oct 18 11:36:52 user nova-compute[74190]:         <uri_transport>rdma</uri_transport>
Oct 18 11:36:52 user nova-compute[74190]:       </uri_transports>
Oct 18 11:36:52 user nova-compute[74190]:     </migration_features>
Oct 18 11:36:52 user nova-compute[74190]:     <topology>
Oct 18 11:36:52 user nova-compute[74190]:       <cells num='2'>
Oct 18 11:36:52 user nova-compute[74190]:         <cell id='0'>
Oct 18 11:36:52 user nova-compute[74190]:           <memory unit='KiB'>8189224</memory>
Oct 18 11:36:52 user nova-compute[74190]:           <pages unit='KiB' size='4'>2047306</pages>
Oct 18 11:36:52 user nova-compute[74190]:           <pages unit='KiB' size='2048'>0</pages>
Oct 18 11:36:52 user nova-compute[74190]:           <distances>
Oct 18 11:36:52 user nova-compute[74190]:             <sibling id='0' value='10'/>
Oct 18 11:36:52 user nova-compute[74190]:             <sibling id='1' value='20'/>
Oct 18 11:36:52 user nova-compute[74190]:           </distances>
Oct 18 11:36:52 user nova-compute[74190]:           <cpus num='6'>
Oct 18 11:36:52 user nova-compute[74190]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Oct 18 11:36:52 user nova-compute[74190]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Oct 18 11:36:52 user nova-compute[74190]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Oct 18 11:36:52 user nova-compute[74190]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Oct 18 11:36:52 user nova-compute[74190]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Oct 18 11:36:52 user nova-compute[74190]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Oct 18 11:36:52 user nova-compute[74190]:           </cpus>
Oct 18 11:36:52 user nova-compute[74190]:         </cell>
Oct 18 11:36:52 user nova-compute[74190]:         <cell id='1'>
Oct 18 11:36:52 user nova-compute[74190]:           <memory unit='KiB'>8206460</memory>
Oct 18 11:36:52 user nova-compute[74190]:           <pages unit='KiB' size='4'>2051615</pages>
Oct 18 11:36:52 user nova-compute[74190]:           <pages unit='KiB' size='2048'>0</pages>
Oct 18 11:36:52 user nova-compute[74190]:           <distances>
Oct 18 11:36:52 user nova-compute[74190]:             <sibling id='0' value='20'/>
Oct 18 11:36:52 user nova-compute[74190]:             <sibling id='1' value='10'/>
Oct 18 11:36:52 user nova-compute[74190]:           </distances>
Oct 18 11:36:52 user nova-compute[74190]:           <cpus num='6'>
Oct 18 11:36:52 user nova-compute[74190]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Oct 18 11:36:52 user nova-compute[74190]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Oct 18 11:36:52 user nova-compute[74190]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Oct 18 11:36:52 user nova-compute[74190]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Oct 18 11:36:52 user nova-compute[74190]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Oct 18 11:36:52 user nova-compute[74190]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Oct 18 11:36:52 user nova-compute[74190]:           </cpus>
Oct 18 11:36:52 user nova-compute[74190]:         </cell>
Oct 18 11:36:52 user nova-compute[74190]:       </cells>
Oct 18 11:36:52 user nova-compute[74190]:     </topology>
Oct 18 11:36:52 user nova-compute[74190]:     <cache>
Oct 18 11:36:52 user nova-compute[74190]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Oct 18 11:36:52 user nova-compute[74190]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Oct 18 11:36:52 user nova-compute[74190]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Oct 18 11:36:52 user nova-compute[74190]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Oct 18 11:36:52 user nova-compute[74190]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Oct 18 11:36:52 user nova-compute[74190]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Oct 18 11:36:52 user nova-compute[74190]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Oct 18 11:36:52 user nova-compute[74190]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Oct 18 11:36:52 user nova-compute[74190]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Oct 18 11:36:52 user nova-compute[74190]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Oct 18 11:36:52 user nova-compute[74190]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Oct 18 11:36:52 user nova-compute[74190]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Oct 18 11:36:52 user nova-compute[74190]:     </cache>
Oct 18 11:36:52 user nova-compute[74190]:     <secmodel>
Oct 18 11:36:52 user nova-compute[74190]:       <model>apparmor</model>
Oct 18 11:36:52 user nova-compute[74190]:       <doi>0</doi>
Oct 18 11:36:52 user nova-compute[74190]:     </secmodel>
Oct 18 11:36:52 user nova-compute[74190]:     <secmodel>
Oct 18 11:36:52 user nova-compute[74190]:       <model>dac</model>
Oct 18 11:36:52 user nova-compute[74190]:       <doi>0</doi>
Oct 18 11:36:52 user nova-compute[74190]:       <baselabel type='kvm'>+64055:+108</baselabel>
Oct 18 11:36:52 user nova-compute[74190]:       <baselabel type='qemu'>+64055:+108</baselabel>
Oct 18 11:36:52 user nova-compute[74190]:     </secmodel>
Oct 18 11:36:52 user nova-compute[74190]:   </host>
Oct 18 11:36:52 user nova-compute[74190]:   <guest>
Oct 18 11:36:52 user nova-compute[74190]:     <os_type>hvm</os_type>
Oct 18 11:36:52 user nova-compute[74190]:     <arch name='alpha'>
Oct 18 11:36:52 user nova-compute[74190]:       <wordsize>64</wordsize>
Oct 18 11:36:52 user nova-compute[74190]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='4'>clipper</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <domain type='qemu'/>
Oct 18 11:36:52 user nova-compute[74190]:     </arch>
Oct 18 11:36:52 user nova-compute[74190]:     <features>
Oct 18 11:36:52 user nova-compute[74190]:       <cpuselection/>
Oct 18 11:36:52 user nova-compute[74190]:       <deviceboot/>
Oct 18 11:36:52 user nova-compute[74190]:       <disksnapshot default='on' toggle='no'/>
Oct 18 11:36:52 user nova-compute[74190]:     </features>
Oct 18 11:36:52 user nova-compute[74190]:   </guest>
Oct 18 11:36:52 user nova-compute[74190]:   <guest>
Oct 18 11:36:52 user nova-compute[74190]:     <os_type>hvm</os_type>
Oct 18 11:36:52 user nova-compute[74190]:     <arch name='armv6l'>
Oct 18 11:36:52 user nova-compute[74190]:       <wordsize>32</wordsize>
Oct 18 11:36:52 user nova-compute[74190]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>integratorcp</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>borzoi</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>spitz</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2'>nuri</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2'>musca-b1</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>versatileab</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>kzm</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2'>musca-a</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2'>smdkc210</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>sx1</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>z2</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>tosa</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='4'>sabrelite</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>realview-eb</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>n810</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>n800</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>versatilepb</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>terrier</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>mainstone</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='4'>midway</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>musicpal</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>microbit</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>cubieboard</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>verdex</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>netduino2</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='4'>raspi2b</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>cheetah</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='4'>highbank</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>akita</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>connex</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>collie</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>raspi0</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <domain type='qemu'/>
Oct 18 11:36:52 user nova-compute[74190]:     </arch>
Oct 18 11:36:52 user nova-compute[74190]:     <features>
Oct 18 11:36:52 user nova-compute[74190]:       <cpuselection/>
Oct 18 11:36:52 user nova-compute[74190]:       <deviceboot/>
Oct 18 11:36:52 user nova-compute[74190]:       <disksnapshot default='on' toggle='no'/>
Oct 18 11:36:52 user nova-compute[74190]:     </features>
Oct 18 11:36:52 user nova-compute[74190]:   </guest>
Oct 18 11:36:52 user nova-compute[74190]:   <guest>
Oct 18 11:36:52 user nova-compute[74190]:     <os_type>hvm</os_type>
Oct 18 11:36:52 user nova-compute[74190]:     <arch name='armv7l'>
Oct 18 11:36:52 user nova-compute[74190]:       <wordsize>32</wordsize>
Oct 18 11:36:52 user nova-compute[74190]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>integratorcp</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>borzoi</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>spitz</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2'>nuri</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2'>musca-b1</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>versatileab</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>kzm</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2'>musca-a</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2'>smdkc210</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>sx1</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>z2</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>tosa</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='4'>sabrelite</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>realview-eb</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>n810</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>n800</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>versatilepb</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>terrier</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>mainstone</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='4'>midway</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>musicpal</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>microbit</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>cubieboard</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>verdex</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>netduino2</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='4'>raspi2b</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>cheetah</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='4'>highbank</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>akita</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>connex</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>collie</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>raspi0</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <domain type='qemu'/>
Oct 18 11:36:52 user nova-compute[74190]:     </arch>
Oct 18 11:36:52 user nova-compute[74190]:     <features>
Oct 18 11:36:52 user nova-compute[74190]:       <cpuselection/>
Oct 18 11:36:52 user nova-compute[74190]:       <deviceboot/>
Oct 18 11:36:52 user nova-compute[74190]:       <disksnapshot default='on' toggle='no'/>
Oct 18 11:36:52 user nova-compute[74190]:     </features>
Oct 18 11:36:52 user nova-compute[74190]:   </guest>
Oct 18 11:36:52 user nova-compute[74190]:   <guest>
Oct 18 11:36:52 user nova-compute[74190]:     <os_type>hvm</os_type>
Oct 18 11:36:52 user nova-compute[74190]:     <arch name='aarch64'>
Oct 18 11:36:52 user nova-compute[74190]:       <wordsize>64</wordsize>
Oct 18 11:36:52 user nova-compute[74190]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>integratorcp</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>borzoi</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>spitz</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2'>nuri</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2'>musca-b1</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>versatileab</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>kzm</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2'>musca-a</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2'>smdkc210</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>sx1</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>z2</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>tosa</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='4'>sabrelite</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>realview-eb</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='512'>sbsa-ref</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>n810</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>n800</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>versatilepb</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>terrier</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>mainstone</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='4'>midway</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>musicpal</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>microbit</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='4'>raspi3ap</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>cubieboard</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>verdex</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>netduino2</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='4'>raspi3b</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='4'>raspi2b</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>cheetah</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='4'>highbank</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>akita</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>connex</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>collie</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>raspi0</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <domain type='qemu'/>
Oct 18 11:36:52 user nova-compute[74190]:     </arch>
Oct 18 11:36:52 user nova-compute[74190]:     <features>
Oct 18 11:36:52 user nova-compute[74190]:       <acpi default='on' toggle='yes'/>
Oct 18 11:36:52 user nova-compute[74190]:       <cpuselection/>
Oct 18 11:36:52 user nova-compute[74190]:       <deviceboot/>
Oct 18 11:36:52 user nova-compute[74190]:       <disksnapshot default='on' toggle='no'/>
Oct 18 11:36:52 user nova-compute[74190]:     </features>
Oct 18 11:36:52 user nova-compute[74190]:   </guest>
Oct 18 11:36:52 user nova-compute[74190]:   <guest>
Oct 18 11:36:52 user nova-compute[74190]:     <os_type>hvm</os_type>
Oct 18 11:36:52 user nova-compute[74190]:     <arch name='cris'>
Oct 18 11:36:52 user nova-compute[74190]:       <wordsize>32</wordsize>
Oct 18 11:36:52 user nova-compute[74190]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>axis-dev88</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <domain type='qemu'/>
Oct 18 11:36:52 user nova-compute[74190]:     </arch>
Oct 18 11:36:52 user nova-compute[74190]:     <features>
Oct 18 11:36:52 user nova-compute[74190]:       <cpuselection/>
Oct 18 11:36:52 user nova-compute[74190]:       <deviceboot/>
Oct 18 11:36:52 user nova-compute[74190]:       <disksnapshot default='on' toggle='no'/>
Oct 18 11:36:52 user nova-compute[74190]:     </features>
Oct 18 11:36:52 user nova-compute[74190]:   </guest>
Oct 18 11:36:52 user nova-compute[74190]:   <guest>
Oct 18 11:36:52 user nova-compute[74190]:     <os_type>hvm</os_type>
Oct 18 11:36:52 user nova-compute[74190]:     <arch name='i686'>
Oct 18 11:36:52 user nova-compute[74190]:       <wordsize>32</wordsize>
Oct 18 11:36:52 user nova-compute[74190]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='288'>pc-q35-artful</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>x-remote</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>isapc</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='288'>pc-q35-disco</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='288'>pc-q35-impish</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='288'>pc-q35-focal</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='288'>microvm</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <domain type='qemu'/>
Oct 18 11:36:52 user nova-compute[74190]:       <domain type='kvm'/>
Oct 18 11:36:52 user nova-compute[74190]:     </arch>
Oct 18 11:36:52 user nova-compute[74190]:     <features>
Oct 18 11:36:52 user nova-compute[74190]:       <pae/>
Oct 18 11:36:52 user nova-compute[74190]:       <nonpae/>
Oct 18 11:36:52 user nova-compute[74190]:       <acpi default='on' toggle='yes'/>
Oct 18 11:36:52 user nova-compute[74190]:       <apic default='on' toggle='no'/>
Oct 18 11:36:52 user nova-compute[74190]:       <cpuselection/>
Oct 18 11:36:52 user nova-compute[74190]:       <deviceboot/>
Oct 18 11:36:52 user nova-compute[74190]:       <disksnapshot default='on' toggle='no'/>
Oct 18 11:36:52 user nova-compute[74190]:     </features>
Oct 18 11:36:52 user nova-compute[74190]:   </guest>
Oct 18 11:36:52 user nova-compute[74190]:   <guest>
Oct 18 11:36:52 user nova-compute[74190]:     <os_type>hvm</os_type>
Oct 18 11:36:52 user nova-compute[74190]:     <arch name='m68k'>
Oct 18 11:36:52 user nova-compute[74190]:       <wordsize>32</wordsize>
Oct 18 11:36:52 user nova-compute[74190]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>mcf5208evb</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>an5206</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>virt-6.0</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>q800</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>virt-6.2</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>next-cube</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>virt-6.1</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <domain type='qemu'/>
Oct 18 11:36:52 user nova-compute[74190]:     </arch>
Oct 18 11:36:52 user nova-compute[74190]:     <features>
Oct 18 11:36:52 user nova-compute[74190]:       <cpuselection/>
Oct 18 11:36:52 user nova-compute[74190]:       <deviceboot/>
Oct 18 11:36:52 user nova-compute[74190]:       <disksnapshot default='on' toggle='no'/>
Oct 18 11:36:52 user nova-compute[74190]:     </features>
Oct 18 11:36:52 user nova-compute[74190]:   </guest>
Oct 18 11:36:52 user nova-compute[74190]:   <guest>
Oct 18 11:36:52 user nova-compute[74190]:     <os_type>hvm</os_type>
Oct 18 11:36:52 user nova-compute[74190]:     <arch name='microblaze'>
Oct 18 11:36:52 user nova-compute[74190]:       <wordsize>32</wordsize>
Oct 18 11:36:52 user nova-compute[74190]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>petalogix-ml605</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <domain type='qemu'/>
Oct 18 11:36:52 user nova-compute[74190]:     </arch>
Oct 18 11:36:52 user nova-compute[74190]:     <features>
Oct 18 11:36:52 user nova-compute[74190]:       <cpuselection/>
Oct 18 11:36:52 user nova-compute[74190]:       <deviceboot/>
Oct 18 11:36:52 user nova-compute[74190]:       <disksnapshot default='on' toggle='no'/>
Oct 18 11:36:52 user nova-compute[74190]:     </features>
Oct 18 11:36:52 user nova-compute[74190]:   </guest>
Oct 18 11:36:52 user nova-compute[74190]:   <guest>
Oct 18 11:36:52 user nova-compute[74190]:     <os_type>hvm</os_type>
Oct 18 11:36:52 user nova-compute[74190]:     <arch name='microblazeel'>
Oct 18 11:36:52 user nova-compute[74190]:       <wordsize>32</wordsize>
Oct 18 11:36:52 user nova-compute[74190]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>petalogix-ml605</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <domain type='qemu'/>
Oct 18 11:36:52 user nova-compute[74190]:     </arch>
Oct 18 11:36:52 user nova-compute[74190]:     <features>
Oct 18 11:36:52 user nova-compute[74190]:       <cpuselection/>
Oct 18 11:36:52 user nova-compute[74190]:       <deviceboot/>
Oct 18 11:36:52 user nova-compute[74190]:       <disksnapshot default='on' toggle='no'/>
Oct 18 11:36:52 user nova-compute[74190]:     </features>
Oct 18 11:36:52 user nova-compute[74190]:   </guest>
Oct 18 11:36:52 user nova-compute[74190]:   <guest>
Oct 18 11:36:52 user nova-compute[74190]:     <os_type>hvm</os_type>
Oct 18 11:36:52 user nova-compute[74190]:     <arch name='mips'>
Oct 18 11:36:52 user nova-compute[74190]:       <wordsize>32</wordsize>
Oct 18 11:36:52 user nova-compute[74190]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='16'>malta</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>mipssim</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <domain type='qemu'/>
Oct 18 11:36:52 user nova-compute[74190]:     </arch>
Oct 18 11:36:52 user nova-compute[74190]:     <features>
Oct 18 11:36:52 user nova-compute[74190]:       <cpuselection/>
Oct 18 11:36:52 user nova-compute[74190]:       <deviceboot/>
Oct 18 11:36:52 user nova-compute[74190]:       <disksnapshot default='on' toggle='no'/>
Oct 18 11:36:52 user nova-compute[74190]:     </features>
Oct 18 11:36:52 user nova-compute[74190]:   </guest>
Oct 18 11:36:52 user nova-compute[74190]:   <guest>
Oct 18 11:36:52 user nova-compute[74190]:     <os_type>hvm</os_type>
Oct 18 11:36:52 user nova-compute[74190]:     <arch name='mipsel'>
Oct 18 11:36:52 user nova-compute[74190]:       <wordsize>32</wordsize>
Oct 18 11:36:52 user nova-compute[74190]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='16'>malta</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>mipssim</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <domain type='qemu'/>
Oct 18 11:36:52 user nova-compute[74190]:     </arch>
Oct 18 11:36:52 user nova-compute[74190]:     <features>
Oct 18 11:36:52 user nova-compute[74190]:       <cpuselection/>
Oct 18 11:36:52 user nova-compute[74190]:       <deviceboot/>
Oct 18 11:36:52 user nova-compute[74190]:       <disksnapshot default='on' toggle='no'/>
Oct 18 11:36:52 user nova-compute[74190]:     </features>
Oct 18 11:36:52 user nova-compute[74190]:   </guest>
Oct 18 11:36:52 user nova-compute[74190]:   <guest>
Oct 18 11:36:52 user nova-compute[74190]:     <os_type>hvm</os_type>
Oct 18 11:36:52 user nova-compute[74190]:     <arch name='mips64'>
Oct 18 11:36:52 user nova-compute[74190]:       <wordsize>64</wordsize>
Oct 18 11:36:52 user nova-compute[74190]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='16'>malta</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>mipssim</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>pica61</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>magnum</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <domain type='qemu'/>
Oct 18 11:36:52 user nova-compute[74190]:     </arch>
Oct 18 11:36:52 user nova-compute[74190]:     <features>
Oct 18 11:36:52 user nova-compute[74190]:       <cpuselection/>
Oct 18 11:36:52 user nova-compute[74190]:       <deviceboot/>
Oct 18 11:36:52 user nova-compute[74190]:       <disksnapshot default='on' toggle='no'/>
Oct 18 11:36:52 user nova-compute[74190]:     </features>
Oct 18 11:36:52 user nova-compute[74190]:   </guest>
Oct 18 11:36:52 user nova-compute[74190]:   <guest>
Oct 18 11:36:52 user nova-compute[74190]:     <os_type>hvm</os_type>
Oct 18 11:36:52 user nova-compute[74190]:     <arch name='mips64el'>
Oct 18 11:36:52 user nova-compute[74190]:       <wordsize>64</wordsize>
Oct 18 11:36:52 user nova-compute[74190]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='16'>malta</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='16'>loongson3-virt</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>mipssim</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>pica61</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>magnum</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='16'>boston</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>fuloong2e</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <domain type='qemu'/>
Oct 18 11:36:52 user nova-compute[74190]:     </arch>
Oct 18 11:36:52 user nova-compute[74190]:     <features>
Oct 18 11:36:52 user nova-compute[74190]:       <cpuselection/>
Oct 18 11:36:52 user nova-compute[74190]:       <deviceboot/>
Oct 18 11:36:52 user nova-compute[74190]:       <disksnapshot default='on' toggle='no'/>
Oct 18 11:36:52 user nova-compute[74190]:     </features>
Oct 18 11:36:52 user nova-compute[74190]:   </guest>
Oct 18 11:36:52 user nova-compute[74190]:   <guest>
Oct 18 11:36:52 user nova-compute[74190]:     <os_type>hvm</os_type>
Oct 18 11:36:52 user nova-compute[74190]:     <arch name='ppc'>
Oct 18 11:36:52 user nova-compute[74190]:       <wordsize>32</wordsize>
Oct 18 11:36:52 user nova-compute[74190]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>g3beige</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>mac99</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='32'>ppce500</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>pegasos2</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>sam460ex</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>bamboo</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>40p</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>ref405ep</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>taihu</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <domain type='qemu'/>
Oct 18 11:36:52 user nova-compute[74190]:     </arch>
Oct 18 11:36:52 user nova-compute[74190]:     <features>
Oct 18 11:36:52 user nova-compute[74190]:       <cpuselection/>
Oct 18 11:36:52 user nova-compute[74190]:       <deviceboot/>
Oct 18 11:36:52 user nova-compute[74190]:       <disksnapshot default='on' toggle='no'/>
Oct 18 11:36:52 user nova-compute[74190]:     </features>
Oct 18 11:36:52 user nova-compute[74190]:   </guest>
Oct 18 11:36:52 user nova-compute[74190]:   <guest>
Oct 18 11:36:52 user nova-compute[74190]:     <os_type>hvm</os_type>
Oct 18 11:36:52 user nova-compute[74190]:     <arch name='ppc64'>
Oct 18 11:36:52 user nova-compute[74190]:       <wordsize>64</wordsize>
Oct 18 11:36:52 user nova-compute[74190]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2048'>powernv9</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>taihu</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2048'>powernv10</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='32'>ppce500</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>40p</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>pegasos2</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>bamboo</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>g3beige</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>mac99</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>sam460ex</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>ref405ep</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2048'>powernv8</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <domain type='qemu'/>
Oct 18 11:36:52 user nova-compute[74190]:     </arch>
Oct 18 11:36:52 user nova-compute[74190]:     <features>
Oct 18 11:36:52 user nova-compute[74190]:       <cpuselection/>
Oct 18 11:36:52 user nova-compute[74190]:       <deviceboot/>
Oct 18 11:36:52 user nova-compute[74190]:       <disksnapshot default='on' toggle='no'/>
Oct 18 11:36:52 user nova-compute[74190]:     </features>
Oct 18 11:36:52 user nova-compute[74190]:   </guest>
Oct 18 11:36:52 user nova-compute[74190]:   <guest>
Oct 18 11:36:52 user nova-compute[74190]:     <os_type>hvm</os_type>
Oct 18 11:36:52 user nova-compute[74190]:     <arch name='ppc64le'>
Oct 18 11:36:52 user nova-compute[74190]:       <wordsize>64</wordsize>
Oct 18 11:36:52 user nova-compute[74190]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2048'>powernv9</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>taihu</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2048'>powernv10</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='32'>ppce500</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>40p</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>pegasos2</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>bamboo</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>g3beige</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>mac99</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>sam460ex</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>ref405ep</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2048'>powernv8</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <domain type='qemu'/>
Oct 18 11:36:52 user nova-compute[74190]:     </arch>
Oct 18 11:36:52 user nova-compute[74190]:     <features>
Oct 18 11:36:52 user nova-compute[74190]:       <cpuselection/>
Oct 18 11:36:52 user nova-compute[74190]:       <deviceboot/>
Oct 18 11:36:52 user nova-compute[74190]:       <disksnapshot default='on' toggle='no'/>
Oct 18 11:36:52 user nova-compute[74190]:     </features>
Oct 18 11:36:52 user nova-compute[74190]:   </guest>
Oct 18 11:36:52 user nova-compute[74190]:   <guest>
Oct 18 11:36:52 user nova-compute[74190]:     <os_type>hvm</os_type>
Oct 18 11:36:52 user nova-compute[74190]:     <arch name='riscv32'>
Oct 18 11:36:52 user nova-compute[74190]:       <wordsize>32</wordsize>
Oct 18 11:36:52 user nova-compute[74190]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='8'>spike</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>opentitan</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='5'>sifive_u</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>sifive_e</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='8'>virt</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <domain type='qemu'/>
Oct 18 11:36:52 user nova-compute[74190]:     </arch>
Oct 18 11:36:52 user nova-compute[74190]:     <features>
Oct 18 11:36:52 user nova-compute[74190]:       <cpuselection/>
Oct 18 11:36:52 user nova-compute[74190]:       <deviceboot/>
Oct 18 11:36:52 user nova-compute[74190]:       <disksnapshot default='on' toggle='no'/>
Oct 18 11:36:52 user nova-compute[74190]:     </features>
Oct 18 11:36:52 user nova-compute[74190]:   </guest>
Oct 18 11:36:52 user nova-compute[74190]:   <guest>
Oct 18 11:36:52 user nova-compute[74190]:     <os_type>hvm</os_type>
Oct 18 11:36:52 user nova-compute[74190]:     <arch name='riscv64'>
Oct 18 11:36:52 user nova-compute[74190]:       <wordsize>64</wordsize>
Oct 18 11:36:52 user nova-compute[74190]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='8'>spike</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='5'>sifive_u</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>shakti_c</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>sifive_e</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='8'>virt</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <domain type='qemu'/>
Oct 18 11:36:52 user nova-compute[74190]:     </arch>
Oct 18 11:36:52 user nova-compute[74190]:     <features>
Oct 18 11:36:52 user nova-compute[74190]:       <cpuselection/>
Oct 18 11:36:52 user nova-compute[74190]:       <deviceboot/>
Oct 18 11:36:52 user nova-compute[74190]:       <disksnapshot default='on' toggle='no'/>
Oct 18 11:36:52 user nova-compute[74190]:     </features>
Oct 18 11:36:52 user nova-compute[74190]:   </guest>
Oct 18 11:36:52 user nova-compute[74190]:   <guest>
Oct 18 11:36:52 user nova-compute[74190]:     <os_type>hvm</os_type>
Oct 18 11:36:52 user nova-compute[74190]:     <arch name='s390x'>
Oct 18 11:36:52 user nova-compute[74190]:       <wordsize>64</wordsize>
Oct 18 11:36:52 user nova-compute[74190]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <domain type='qemu'/>
Oct 18 11:36:52 user nova-compute[74190]:     </arch>
Oct 18 11:36:52 user nova-compute[74190]:     <features>
Oct 18 11:36:52 user nova-compute[74190]:       <cpuselection/>
Oct 18 11:36:52 user nova-compute[74190]:       <deviceboot/>
Oct 18 11:36:52 user nova-compute[74190]:       <disksnapshot default='on' toggle='no'/>
Oct 18 11:36:52 user nova-compute[74190]:     </features>
Oct 18 11:36:52 user nova-compute[74190]:   </guest>
Oct 18 11:36:52 user nova-compute[74190]:   <guest>
Oct 18 11:36:52 user nova-compute[74190]:     <os_type>hvm</os_type>
Oct 18 11:36:52 user nova-compute[74190]:     <arch name='sh4'>
Oct 18 11:36:52 user nova-compute[74190]:       <wordsize>32</wordsize>
Oct 18 11:36:52 user nova-compute[74190]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>shix</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>r2d</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <domain type='qemu'/>
Oct 18 11:36:52 user nova-compute[74190]:     </arch>
Oct 18 11:36:52 user nova-compute[74190]:     <features>
Oct 18 11:36:52 user nova-compute[74190]:       <cpuselection/>
Oct 18 11:36:52 user nova-compute[74190]:       <deviceboot/>
Oct 18 11:36:52 user nova-compute[74190]:       <disksnapshot default='on' toggle='no'/>
Oct 18 11:36:52 user nova-compute[74190]:     </features>
Oct 18 11:36:52 user nova-compute[74190]:   </guest>
Oct 18 11:36:52 user nova-compute[74190]:   <guest>
Oct 18 11:36:52 user nova-compute[74190]:     <os_type>hvm</os_type>
Oct 18 11:36:52 user nova-compute[74190]:     <arch name='sh4eb'>
Oct 18 11:36:52 user nova-compute[74190]:       <wordsize>64</wordsize>
Oct 18 11:36:52 user nova-compute[74190]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>shix</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>r2d</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <domain type='qemu'/>
Oct 18 11:36:52 user nova-compute[74190]:     </arch>
Oct 18 11:36:52 user nova-compute[74190]:     <features>
Oct 18 11:36:52 user nova-compute[74190]:       <cpuselection/>
Oct 18 11:36:52 user nova-compute[74190]:       <deviceboot/>
Oct 18 11:36:52 user nova-compute[74190]:       <disksnapshot default='on' toggle='no'/>
Oct 18 11:36:52 user nova-compute[74190]:     </features>
Oct 18 11:36:52 user nova-compute[74190]:   </guest>
Oct 18 11:36:52 user nova-compute[74190]:   <guest>
Oct 18 11:36:52 user nova-compute[74190]:     <os_type>hvm</os_type>
Oct 18 11:36:52 user nova-compute[74190]:     <arch name='sparc'>
Oct 18 11:36:52 user nova-compute[74190]:       <wordsize>32</wordsize>
Oct 18 11:36:52 user nova-compute[74190]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>SS-5</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='4'>SS-20</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>LX</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>SPARCClassic</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>leon3_generic</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>SPARCbook</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>SS-4</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='4'>SS-600MP</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='4'>SS-10</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>Voyager</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <domain type='qemu'/>
Oct 18 11:36:52 user nova-compute[74190]:     </arch>
Oct 18 11:36:52 user nova-compute[74190]:     <features>
Oct 18 11:36:52 user nova-compute[74190]:       <cpuselection/>
Oct 18 11:36:52 user nova-compute[74190]:       <deviceboot/>
Oct 18 11:36:52 user nova-compute[74190]:       <disksnapshot default='on' toggle='no'/>
Oct 18 11:36:52 user nova-compute[74190]:     </features>
Oct 18 11:36:52 user nova-compute[74190]:   </guest>
Oct 18 11:36:52 user nova-compute[74190]:   <guest>
Oct 18 11:36:52 user nova-compute[74190]:     <os_type>hvm</os_type>
Oct 18 11:36:52 user nova-compute[74190]:     <arch name='sparc64'>
Oct 18 11:36:52 user nova-compute[74190]:       <wordsize>64</wordsize>
Oct 18 11:36:52 user nova-compute[74190]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>sun4u</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>niagara</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>sun4v</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <domain type='qemu'/>
Oct 18 11:36:52 user nova-compute[74190]:     </arch>
Oct 18 11:36:52 user nova-compute[74190]:     <features>
Oct 18 11:36:52 user nova-compute[74190]:       <cpuselection/>
Oct 18 11:36:52 user nova-compute[74190]:       <deviceboot/>
Oct 18 11:36:52 user nova-compute[74190]:       <disksnapshot default='on' toggle='no'/>
Oct 18 11:36:52 user nova-compute[74190]:     </features>
Oct 18 11:36:52 user nova-compute[74190]:   </guest>
Oct 18 11:36:52 user nova-compute[74190]:   <guest>
Oct 18 11:36:52 user nova-compute[74190]:     <os_type>hvm</os_type>
Oct 18 11:36:52 user nova-compute[74190]:     <arch name='x86_64'>
Oct 18 11:36:52 user nova-compute[74190]:       <wordsize>64</wordsize>
Oct 18 11:36:52 user nova-compute[74190]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='288'>pc-q35-artful</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>x-remote</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='1'>isapc</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='288'>pc-q35-disco</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='288'>pc-q35-impish</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='288'>pc-q35-focal</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='288'>microvm</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <domain type='qemu'/>
Oct 18 11:36:52 user nova-compute[74190]:       <domain type='kvm'/>
Oct 18 11:36:52 user nova-compute[74190]:     </arch>
Oct 18 11:36:52 user nova-compute[74190]:     <features>
Oct 18 11:36:52 user nova-compute[74190]:       <acpi default='on' toggle='yes'/>
Oct 18 11:36:52 user nova-compute[74190]:       <apic default='on' toggle='no'/>
Oct 18 11:36:52 user nova-compute[74190]:       <cpuselection/>
Oct 18 11:36:52 user nova-compute[74190]:       <deviceboot/>
Oct 18 11:36:52 user nova-compute[74190]:       <disksnapshot default='on' toggle='no'/>
Oct 18 11:36:52 user nova-compute[74190]:     </features>
Oct 18 11:36:52 user nova-compute[74190]:   </guest>
Oct 18 11:36:52 user nova-compute[74190]:   <guest>
Oct 18 11:36:52 user nova-compute[74190]:     <os_type>hvm</os_type>
Oct 18 11:36:52 user nova-compute[74190]:     <arch name='xtensa'>
Oct 18 11:36:52 user nova-compute[74190]:       <wordsize>32</wordsize>
Oct 18 11:36:52 user nova-compute[74190]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='4'>sim</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='32'>kc705</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='32'>ml605</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='32'>ml605-nommu</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='32'>virt</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='32'>lx60-nommu</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='32'>lx200</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='32'>lx200-nommu</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='32'>lx60</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='32'>kc705-nommu</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <domain type='qemu'/>
Oct 18 11:36:52 user nova-compute[74190]:     </arch>
Oct 18 11:36:52 user nova-compute[74190]:     <features>
Oct 18 11:36:52 user nova-compute[74190]:       <cpuselection/>
Oct 18 11:36:52 user nova-compute[74190]:       <deviceboot/>
Oct 18 11:36:52 user nova-compute[74190]:       <disksnapshot default='on' toggle='no'/>
Oct 18 11:36:52 user nova-compute[74190]:     </features>
Oct 18 11:36:52 user nova-compute[74190]:   </guest>
Oct 18 11:36:52 user nova-compute[74190]:   <guest>
Oct 18 11:36:52 user nova-compute[74190]:     <os_type>hvm</os_type>
Oct 18 11:36:52 user nova-compute[74190]:     <arch name='xtensaeb'>
Oct 18 11:36:52 user nova-compute[74190]:       <wordsize>32</wordsize>
Oct 18 11:36:52 user nova-compute[74190]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='4'>sim</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='32'>kc705</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='32'>ml605</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='32'>ml605-nommu</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='32'>virt</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='32'>lx60-nommu</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='32'>lx200</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='32'>lx200-nommu</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='32'>lx60</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <machine maxCpus='32'>kc705-nommu</machine>
Oct 18 11:36:52 user nova-compute[74190]:       <domain type='qemu'/>
Oct 18 11:36:52 user nova-compute[74190]:     </arch>
Oct 18 11:36:52 user nova-compute[74190]:     <features>
Oct 18 11:36:52 user nova-compute[74190]:       <cpuselection/>
Oct 18 11:36:52 user nova-compute[74190]:       <deviceboot/>
Oct 18 11:36:52 user nova-compute[74190]:       <disksnapshot default='on' toggle='no'/>
Oct 18 11:36:52 user nova-compute[74190]:     </features>
Oct 18 11:36:52 user nova-compute[74190]:   </guest>
Oct 18 11:36:52 user nova-compute[74190]: </capabilities>
Oct 18 11:36:52 user nova-compute[74190]: 
Oct 18 11:36:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=74190) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 18 11:36:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=74190) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 18 11:36:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=74190) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 18 11:36:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74190) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 18 11:36:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74190) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 18 11:36:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=74190) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 18 11:36:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74190) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 18 11:36:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=74190) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 18 11:36:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=74190) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 18 11:36:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=74190) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 18 11:36:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=74190) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 18 11:36:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Getting domain capabilities for i686 via machine types: {'ubuntu', 'pc', 'q35', 'ubuntu-q35'} {{(pid=74190) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 18 11:36:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Oct 18 11:36:52 user nova-compute[74190]: <domainCapabilities>
Oct 18 11:36:52 user nova-compute[74190]:   <path>/usr/bin/qemu-system-i386</path>
Oct 18 11:36:52 user nova-compute[74190]:   <domain>kvm</domain>
Oct 18 11:36:52 user nova-compute[74190]:   <machine>pc-i440fx-jammy</machine>
Oct 18 11:36:52 user nova-compute[74190]:   <arch>i686</arch>
Oct 18 11:36:52 user nova-compute[74190]:   <vcpu max='255'/>
Oct 18 11:36:52 user nova-compute[74190]:   <iothreads supported='yes'/>
Oct 18 11:36:52 user nova-compute[74190]:   <os supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:     <enum name='firmware'/>
Oct 18 11:36:52 user nova-compute[74190]:     <loader supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 18 11:36:52 user nova-compute[74190]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 18 11:36:52 user nova-compute[74190]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 18 11:36:52 user nova-compute[74190]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 18 11:36:52 user nova-compute[74190]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='type'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>rom</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>pflash</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='readonly'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>yes</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>no</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='secure'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>no</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:     </loader>
Oct 18 11:36:52 user nova-compute[74190]:   </os>
Oct 18 11:36:52 user nova-compute[74190]:   <cpu>
Oct 18 11:36:52 user nova-compute[74190]:     <mode name='host-passthrough' supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='hostPassthroughMigratable'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>off</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:     </mode>
Oct 18 11:36:52 user nova-compute[74190]:     <mode name='maximum' supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='maximumMigratable'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>on</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>off</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:     </mode>
Oct 18 11:36:52 user nova-compute[74190]:     <mode name='host-model' supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <vendor>Intel</vendor>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='ss'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='vmx'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='pcid'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='hypervisor'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='arat'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='tsc_adjust'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='umip'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='md-clear'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='stibp'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='arch-capabilities'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='ssbd'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='ibpb'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='ibrs'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='amd-stibp'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='amd-ssbd'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='disable' name='erms'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='disable' name='xsaveopt'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='disable' name='lm'/>
Oct 18 11:36:52 user nova-compute[74190]:     </mode>
Oct 18 11:36:52 user nova-compute[74190]:     <mode name='custom' supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>qemu64</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='yes'>qemu32</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>phenom</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='yes'>pentium3</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='yes'>pentium2</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='yes'>pentium</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>n270</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>kvm64</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='yes'>kvm32</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='yes'>coreduo</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>core2duo</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>athlon</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Westmere-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Westmere</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Snowridge</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Skylake-Server</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Skylake-Client</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>SandyBridge</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Penryn</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Opteron_G5</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Opteron_G4</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Opteron_G3</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Opteron_G2</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Opteron_G1</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Nehalem-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Nehalem</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>IvyBridge</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Icelake-Server</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Haswell-noTSX</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Haswell-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Haswell</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>EPYC-Rome</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>EPYC-Milan</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>EPYC-IBPB</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>EPYC</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Dhyana</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Cooperlake</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Conroe</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Cascadelake-Server</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Broadwell-noTSX</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Broadwell-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Broadwell</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='yes'>486</model>
Oct 18 11:36:52 user nova-compute[74190]:     </mode>
Oct 18 11:36:52 user nova-compute[74190]:   </cpu>
Oct 18 11:36:52 user nova-compute[74190]:   <memoryBacking supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:     <enum name='sourceType'>
Oct 18 11:36:52 user nova-compute[74190]:       <value>file</value>
Oct 18 11:36:52 user nova-compute[74190]:       <value>anonymous</value>
Oct 18 11:36:52 user nova-compute[74190]:       <value>memfd</value>
Oct 18 11:36:52 user nova-compute[74190]:     </enum>
Oct 18 11:36:52 user nova-compute[74190]:   </memoryBacking>
Oct 18 11:36:52 user nova-compute[74190]:   <devices>
Oct 18 11:36:52 user nova-compute[74190]:     <disk supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='diskDevice'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>disk</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>cdrom</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>floppy</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>lun</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='bus'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>ide</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>fdc</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>scsi</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>virtio</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>usb</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>sata</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='model'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>virtio</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>virtio-transitional</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>virtio-non-transitional</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:     </disk>
Oct 18 11:36:52 user nova-compute[74190]:     <graphics supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='type'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>sdl</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>vnc</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>spice</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>egl-headless</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:     </graphics>
Oct 18 11:36:52 user nova-compute[74190]:     <video supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='modelType'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>vga</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>cirrus</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>vmvga</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>qxl</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>virtio</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>none</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>bochs</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>ramfb</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:     </video>
Oct 18 11:36:52 user nova-compute[74190]:     <hostdev supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='mode'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>subsystem</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='startupPolicy'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>default</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>mandatory</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>requisite</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>optional</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='subsysType'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>usb</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>pci</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>scsi</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='capsType'/>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='pciBackend'/>
Oct 18 11:36:52 user nova-compute[74190]:     </hostdev>
Oct 18 11:36:52 user nova-compute[74190]:     <rng supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='model'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>virtio</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>virtio-transitional</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>virtio-non-transitional</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='backendModel'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>random</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>egd</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>builtin</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:     </rng>
Oct 18 11:36:52 user nova-compute[74190]:     <filesystem supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='driverType'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>path</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>handle</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>virtiofs</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:     </filesystem>
Oct 18 11:36:52 user nova-compute[74190]:     <tpm supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='model'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>tpm-tis</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>tpm-crb</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='backendModel'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>passthrough</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>emulator</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:     </tpm>
Oct 18 11:36:52 user nova-compute[74190]:   </devices>
Oct 18 11:36:52 user nova-compute[74190]:   <features>
Oct 18 11:36:52 user nova-compute[74190]:     <gic supported='no'/>
Oct 18 11:36:52 user nova-compute[74190]:     <vmcoreinfo supported='yes'/>
Oct 18 11:36:52 user nova-compute[74190]:     <genid supported='yes'/>
Oct 18 11:36:52 user nova-compute[74190]:     <backingStoreInput supported='yes'/>
Oct 18 11:36:52 user nova-compute[74190]:     <backup supported='yes'/>
Oct 18 11:36:52 user nova-compute[74190]:     <sev supported='no'/>
Oct 18 11:36:52 user nova-compute[74190]:   </features>
Oct 18 11:36:52 user nova-compute[74190]: </domainCapabilities>
Oct 18 11:36:52 user nova-compute[74190]:  {{(pid=74190) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 18 11:36:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Oct 18 11:36:52 user nova-compute[74190]: <domainCapabilities>
Oct 18 11:36:52 user nova-compute[74190]:   <path>/usr/bin/qemu-system-i386</path>
Oct 18 11:36:52 user nova-compute[74190]:   <domain>kvm</domain>
Oct 18 11:36:52 user nova-compute[74190]:   <machine>pc-i440fx-6.2</machine>
Oct 18 11:36:52 user nova-compute[74190]:   <arch>i686</arch>
Oct 18 11:36:52 user nova-compute[74190]:   <vcpu max='255'/>
Oct 18 11:36:52 user nova-compute[74190]:   <iothreads supported='yes'/>
Oct 18 11:36:52 user nova-compute[74190]:   <os supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:     <enum name='firmware'/>
Oct 18 11:36:52 user nova-compute[74190]:     <loader supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 18 11:36:52 user nova-compute[74190]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 18 11:36:52 user nova-compute[74190]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 18 11:36:52 user nova-compute[74190]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 18 11:36:52 user nova-compute[74190]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='type'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>rom</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>pflash</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='readonly'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>yes</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>no</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='secure'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>no</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:     </loader>
Oct 18 11:36:52 user nova-compute[74190]:   </os>
Oct 18 11:36:52 user nova-compute[74190]:   <cpu>
Oct 18 11:36:52 user nova-compute[74190]:     <mode name='host-passthrough' supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='hostPassthroughMigratable'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>off</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:     </mode>
Oct 18 11:36:52 user nova-compute[74190]:     <mode name='maximum' supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='maximumMigratable'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>on</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>off</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:     </mode>
Oct 18 11:36:52 user nova-compute[74190]:     <mode name='host-model' supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <vendor>Intel</vendor>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='ss'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='vmx'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='pcid'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='hypervisor'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='arat'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='tsc_adjust'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='umip'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='md-clear'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='stibp'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='arch-capabilities'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='ssbd'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='ibpb'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='ibrs'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='amd-stibp'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='amd-ssbd'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='disable' name='erms'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='disable' name='xsaveopt'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='disable' name='lm'/>
Oct 18 11:36:52 user nova-compute[74190]:     </mode>
Oct 18 11:36:52 user nova-compute[74190]:     <mode name='custom' supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>qemu64</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='yes'>qemu32</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>phenom</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='yes'>pentium3</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='yes'>pentium2</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='yes'>pentium</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>n270</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>kvm64</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='yes'>kvm32</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='yes'>coreduo</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>core2duo</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>athlon</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Westmere-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Westmere</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Snowridge</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Skylake-Server</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Skylake-Client</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>SandyBridge</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Penryn</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Opteron_G5</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Opteron_G4</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Opteron_G3</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Opteron_G2</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Opteron_G1</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Nehalem-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Nehalem</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>IvyBridge</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Icelake-Server</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Haswell-noTSX</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Haswell-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Haswell</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>EPYC-Rome</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>EPYC-Milan</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>EPYC-IBPB</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>EPYC</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Dhyana</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Cooperlake</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Conroe</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Cascadelake-Server</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Broadwell-noTSX</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Broadwell-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Broadwell</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='yes'>486</model>
Oct 18 11:36:52 user nova-compute[74190]:     </mode>
Oct 18 11:36:52 user nova-compute[74190]:   </cpu>
Oct 18 11:36:52 user nova-compute[74190]:   <memoryBacking supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:     <enum name='sourceType'>
Oct 18 11:36:52 user nova-compute[74190]:       <value>file</value>
Oct 18 11:36:52 user nova-compute[74190]:       <value>anonymous</value>
Oct 18 11:36:52 user nova-compute[74190]:       <value>memfd</value>
Oct 18 11:36:52 user nova-compute[74190]:     </enum>
Oct 18 11:36:52 user nova-compute[74190]:   </memoryBacking>
Oct 18 11:36:52 user nova-compute[74190]:   <devices>
Oct 18 11:36:52 user nova-compute[74190]:     <disk supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='diskDevice'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>disk</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>cdrom</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>floppy</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>lun</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='bus'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>ide</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>fdc</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>scsi</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>virtio</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>usb</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>sata</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='model'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>virtio</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>virtio-transitional</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>virtio-non-transitional</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:     </disk>
Oct 18 11:36:52 user nova-compute[74190]:     <graphics supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='type'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>sdl</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>vnc</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>spice</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>egl-headless</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:     </graphics>
Oct 18 11:36:52 user nova-compute[74190]:     <video supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='modelType'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>vga</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>cirrus</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>vmvga</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>qxl</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>virtio</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>none</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>bochs</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>ramfb</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:     </video>
Oct 18 11:36:52 user nova-compute[74190]:     <hostdev supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='mode'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>subsystem</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='startupPolicy'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>default</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>mandatory</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>requisite</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>optional</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='subsysType'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>usb</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>pci</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>scsi</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='capsType'/>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='pciBackend'/>
Oct 18 11:36:52 user nova-compute[74190]:     </hostdev>
Oct 18 11:36:52 user nova-compute[74190]:     <rng supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='model'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>virtio</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>virtio-transitional</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>virtio-non-transitional</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='backendModel'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>random</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>egd</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>builtin</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:     </rng>
Oct 18 11:36:52 user nova-compute[74190]:     <filesystem supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='driverType'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>path</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>handle</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>virtiofs</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:     </filesystem>
Oct 18 11:36:52 user nova-compute[74190]:     <tpm supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='model'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>tpm-tis</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>tpm-crb</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='backendModel'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>passthrough</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>emulator</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:     </tpm>
Oct 18 11:36:52 user nova-compute[74190]:   </devices>
Oct 18 11:36:52 user nova-compute[74190]:   <features>
Oct 18 11:36:52 user nova-compute[74190]:     <gic supported='no'/>
Oct 18 11:36:52 user nova-compute[74190]:     <vmcoreinfo supported='yes'/>
Oct 18 11:36:52 user nova-compute[74190]:     <genid supported='yes'/>
Oct 18 11:36:52 user nova-compute[74190]:     <backingStoreInput supported='yes'/>
Oct 18 11:36:52 user nova-compute[74190]:     <backup supported='yes'/>
Oct 18 11:36:52 user nova-compute[74190]:     <sev supported='no'/>
Oct 18 11:36:52 user nova-compute[74190]:   </features>
Oct 18 11:36:52 user nova-compute[74190]: </domainCapabilities>
Oct 18 11:36:52 user nova-compute[74190]:  {{(pid=74190) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 18 11:36:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Oct 18 11:36:52 user nova-compute[74190]: <domainCapabilities>
Oct 18 11:36:52 user nova-compute[74190]:   <path>/usr/bin/qemu-system-i386</path>
Oct 18 11:36:52 user nova-compute[74190]:   <domain>kvm</domain>
Oct 18 11:36:52 user nova-compute[74190]:   <machine>pc-q35-6.2</machine>
Oct 18 11:36:52 user nova-compute[74190]:   <arch>i686</arch>
Oct 18 11:36:52 user nova-compute[74190]:   <vcpu max='288'/>
Oct 18 11:36:52 user nova-compute[74190]:   <iothreads supported='yes'/>
Oct 18 11:36:52 user nova-compute[74190]:   <os supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:     <enum name='firmware'/>
Oct 18 11:36:52 user nova-compute[74190]:     <loader supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 18 11:36:52 user nova-compute[74190]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 18 11:36:52 user nova-compute[74190]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 18 11:36:52 user nova-compute[74190]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 18 11:36:52 user nova-compute[74190]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='type'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>rom</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>pflash</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='readonly'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>yes</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>no</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='secure'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>no</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:     </loader>
Oct 18 11:36:52 user nova-compute[74190]:   </os>
Oct 18 11:36:52 user nova-compute[74190]:   <cpu>
Oct 18 11:36:52 user nova-compute[74190]:     <mode name='host-passthrough' supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='hostPassthroughMigratable'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>off</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:     </mode>
Oct 18 11:36:52 user nova-compute[74190]:     <mode name='maximum' supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='maximumMigratable'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>on</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>off</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:     </mode>
Oct 18 11:36:52 user nova-compute[74190]:     <mode name='host-model' supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <vendor>Intel</vendor>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='ss'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='vmx'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='pcid'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='hypervisor'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='arat'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='tsc_adjust'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='umip'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='md-clear'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='stibp'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='arch-capabilities'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='ssbd'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='ibpb'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='ibrs'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='amd-stibp'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='amd-ssbd'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='disable' name='erms'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='disable' name='xsaveopt'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='disable' name='lm'/>
Oct 18 11:36:52 user nova-compute[74190]:     </mode>
Oct 18 11:36:52 user nova-compute[74190]:     <mode name='custom' supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>qemu64</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='yes'>qemu32</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>phenom</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='yes'>pentium3</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='yes'>pentium2</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='yes'>pentium</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>n270</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>kvm64</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='yes'>kvm32</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='yes'>coreduo</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>core2duo</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>athlon</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Westmere-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Westmere</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Snowridge</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Skylake-Server</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Skylake-Client</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>SandyBridge</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Penryn</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Opteron_G5</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Opteron_G4</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Opteron_G3</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Opteron_G2</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Opteron_G1</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Nehalem-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Nehalem</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>IvyBridge</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Icelake-Server</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Haswell-noTSX</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Haswell-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Haswell</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>EPYC-Rome</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>EPYC-Milan</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>EPYC-IBPB</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>EPYC</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Dhyana</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Cooperlake</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Conroe</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Cascadelake-Server</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Broadwell-noTSX</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Broadwell-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Broadwell</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='yes'>486</model>
Oct 18 11:36:52 user nova-compute[74190]:     </mode>
Oct 18 11:36:52 user nova-compute[74190]:   </cpu>
Oct 18 11:36:52 user nova-compute[74190]:   <memoryBacking supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:     <enum name='sourceType'>
Oct 18 11:36:52 user nova-compute[74190]:       <value>file</value>
Oct 18 11:36:52 user nova-compute[74190]:       <value>anonymous</value>
Oct 18 11:36:52 user nova-compute[74190]:       <value>memfd</value>
Oct 18 11:36:52 user nova-compute[74190]:     </enum>
Oct 18 11:36:52 user nova-compute[74190]:   </memoryBacking>
Oct 18 11:36:52 user nova-compute[74190]:   <devices>
Oct 18 11:36:52 user nova-compute[74190]:     <disk supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='diskDevice'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>disk</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>cdrom</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>floppy</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>lun</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='bus'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>fdc</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>scsi</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>virtio</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>usb</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>sata</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='model'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>virtio</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>virtio-transitional</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>virtio-non-transitional</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:     </disk>
Oct 18 11:36:52 user nova-compute[74190]:     <graphics supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='type'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>sdl</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>vnc</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>spice</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>egl-headless</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:     </graphics>
Oct 18 11:36:52 user nova-compute[74190]:     <video supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='modelType'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>vga</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>cirrus</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>vmvga</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>qxl</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>virtio</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>none</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>bochs</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>ramfb</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:     </video>
Oct 18 11:36:52 user nova-compute[74190]:     <hostdev supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='mode'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>subsystem</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='startupPolicy'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>default</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>mandatory</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>requisite</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>optional</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='subsysType'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>usb</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>pci</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>scsi</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='capsType'/>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='pciBackend'/>
Oct 18 11:36:52 user nova-compute[74190]:     </hostdev>
Oct 18 11:36:52 user nova-compute[74190]:     <rng supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='model'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>virtio</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>virtio-transitional</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>virtio-non-transitional</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='backendModel'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>random</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>egd</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>builtin</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:     </rng>
Oct 18 11:36:52 user nova-compute[74190]:     <filesystem supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='driverType'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>path</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>handle</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>virtiofs</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:     </filesystem>
Oct 18 11:36:52 user nova-compute[74190]:     <tpm supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='model'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>tpm-tis</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>tpm-crb</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='backendModel'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>passthrough</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>emulator</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:     </tpm>
Oct 18 11:36:52 user nova-compute[74190]:   </devices>
Oct 18 11:36:52 user nova-compute[74190]:   <features>
Oct 18 11:36:52 user nova-compute[74190]:     <gic supported='no'/>
Oct 18 11:36:52 user nova-compute[74190]:     <vmcoreinfo supported='yes'/>
Oct 18 11:36:52 user nova-compute[74190]:     <genid supported='yes'/>
Oct 18 11:36:52 user nova-compute[74190]:     <backingStoreInput supported='yes'/>
Oct 18 11:36:52 user nova-compute[74190]:     <backup supported='yes'/>
Oct 18 11:36:52 user nova-compute[74190]:     <sev supported='no'/>
Oct 18 11:36:52 user nova-compute[74190]:   </features>
Oct 18 11:36:52 user nova-compute[74190]: </domainCapabilities>
Oct 18 11:36:52 user nova-compute[74190]:  {{(pid=74190) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 18 11:36:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Oct 18 11:36:52 user nova-compute[74190]: <domainCapabilities>
Oct 18 11:36:52 user nova-compute[74190]:   <path>/usr/bin/qemu-system-i386</path>
Oct 18 11:36:52 user nova-compute[74190]:   <domain>kvm</domain>
Oct 18 11:36:52 user nova-compute[74190]:   <machine>pc-q35-jammy</machine>
Oct 18 11:36:52 user nova-compute[74190]:   <arch>i686</arch>
Oct 18 11:36:52 user nova-compute[74190]:   <vcpu max='288'/>
Oct 18 11:36:52 user nova-compute[74190]:   <iothreads supported='yes'/>
Oct 18 11:36:52 user nova-compute[74190]:   <os supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:     <enum name='firmware'/>
Oct 18 11:36:52 user nova-compute[74190]:     <loader supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 18 11:36:52 user nova-compute[74190]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 18 11:36:52 user nova-compute[74190]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 18 11:36:52 user nova-compute[74190]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 18 11:36:52 user nova-compute[74190]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='type'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>rom</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>pflash</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='readonly'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>yes</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>no</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='secure'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>no</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:     </loader>
Oct 18 11:36:52 user nova-compute[74190]:   </os>
Oct 18 11:36:52 user nova-compute[74190]:   <cpu>
Oct 18 11:36:52 user nova-compute[74190]:     <mode name='host-passthrough' supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='hostPassthroughMigratable'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>off</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:     </mode>
Oct 18 11:36:52 user nova-compute[74190]:     <mode name='maximum' supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='maximumMigratable'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>on</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>off</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:     </mode>
Oct 18 11:36:52 user nova-compute[74190]:     <mode name='host-model' supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <vendor>Intel</vendor>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='ss'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='vmx'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='pcid'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='hypervisor'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='arat'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='tsc_adjust'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='umip'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='md-clear'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='stibp'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='arch-capabilities'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='ssbd'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='ibpb'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='ibrs'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='amd-stibp'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='amd-ssbd'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='disable' name='erms'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='disable' name='xsaveopt'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='disable' name='lm'/>
Oct 18 11:36:52 user nova-compute[74190]:     </mode>
Oct 18 11:36:52 user nova-compute[74190]:     <mode name='custom' supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>qemu64</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='yes'>qemu32</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>phenom</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='yes'>pentium3</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='yes'>pentium2</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='yes'>pentium</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>n270</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>kvm64</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='yes'>kvm32</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='yes'>coreduo</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>core2duo</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>athlon</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Westmere-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Westmere</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Snowridge</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Skylake-Server</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Skylake-Client</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>SandyBridge</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Penryn</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Opteron_G5</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Opteron_G4</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Opteron_G3</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Opteron_G2</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Opteron_G1</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Nehalem-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Nehalem</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>IvyBridge</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Icelake-Server</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Haswell-noTSX</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Haswell-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Haswell</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>EPYC-Rome</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>EPYC-Milan</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>EPYC-IBPB</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>EPYC</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Dhyana</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Cooperlake</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Conroe</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Cascadelake-Server</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Broadwell-noTSX</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Broadwell-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Broadwell</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='yes'>486</model>
Oct 18 11:36:52 user nova-compute[74190]:     </mode>
Oct 18 11:36:52 user nova-compute[74190]:   </cpu>
Oct 18 11:36:52 user nova-compute[74190]:   <memoryBacking supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:     <enum name='sourceType'>
Oct 18 11:36:52 user nova-compute[74190]:       <value>file</value>
Oct 18 11:36:52 user nova-compute[74190]:       <value>anonymous</value>
Oct 18 11:36:52 user nova-compute[74190]:       <value>memfd</value>
Oct 18 11:36:52 user nova-compute[74190]:     </enum>
Oct 18 11:36:52 user nova-compute[74190]:   </memoryBacking>
Oct 18 11:36:52 user nova-compute[74190]:   <devices>
Oct 18 11:36:52 user nova-compute[74190]:     <disk supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='diskDevice'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>disk</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>cdrom</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>floppy</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>lun</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='bus'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>fdc</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>scsi</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>virtio</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>usb</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>sata</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='model'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>virtio</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>virtio-transitional</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>virtio-non-transitional</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:     </disk>
Oct 18 11:36:52 user nova-compute[74190]:     <graphics supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='type'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>sdl</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>vnc</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>spice</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>egl-headless</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:     </graphics>
Oct 18 11:36:52 user nova-compute[74190]:     <video supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='modelType'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>vga</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>cirrus</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>vmvga</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>qxl</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>virtio</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>none</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>bochs</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>ramfb</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:     </video>
Oct 18 11:36:52 user nova-compute[74190]:     <hostdev supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='mode'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>subsystem</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='startupPolicy'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>default</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>mandatory</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>requisite</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>optional</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='subsysType'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>usb</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>pci</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>scsi</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='capsType'/>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='pciBackend'/>
Oct 18 11:36:52 user nova-compute[74190]:     </hostdev>
Oct 18 11:36:52 user nova-compute[74190]:     <rng supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='model'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>virtio</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>virtio-transitional</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>virtio-non-transitional</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='backendModel'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>random</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>egd</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>builtin</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:     </rng>
Oct 18 11:36:52 user nova-compute[74190]:     <filesystem supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='driverType'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>path</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>handle</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>virtiofs</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:     </filesystem>
Oct 18 11:36:52 user nova-compute[74190]:     <tpm supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='model'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>tpm-tis</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>tpm-crb</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='backendModel'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>passthrough</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>emulator</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:     </tpm>
Oct 18 11:36:52 user nova-compute[74190]:   </devices>
Oct 18 11:36:52 user nova-compute[74190]:   <features>
Oct 18 11:36:52 user nova-compute[74190]:     <gic supported='no'/>
Oct 18 11:36:52 user nova-compute[74190]:     <vmcoreinfo supported='yes'/>
Oct 18 11:36:52 user nova-compute[74190]:     <genid supported='yes'/>
Oct 18 11:36:52 user nova-compute[74190]:     <backingStoreInput supported='yes'/>
Oct 18 11:36:52 user nova-compute[74190]:     <backup supported='yes'/>
Oct 18 11:36:52 user nova-compute[74190]:     <sev supported='no'/>
Oct 18 11:36:52 user nova-compute[74190]:   </features>
Oct 18 11:36:52 user nova-compute[74190]: </domainCapabilities>
Oct 18 11:36:52 user nova-compute[74190]:  {{(pid=74190) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 18 11:36:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=74190) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 18 11:36:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74190) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 18 11:36:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74190) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 18 11:36:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=74190) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 18 11:36:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=74190) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 18 11:36:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=74190) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 18 11:36:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=74190) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 18 11:36:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=74190) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 18 11:36:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=74190) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 18 11:36:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=74190) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 18 11:36:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=74190) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 18 11:36:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=74190) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 18 11:36:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=74190) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 18 11:36:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=74190) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 18 11:36:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=74190) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 18 11:36:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=74190) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 18 11:36:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=74190) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 18 11:36:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=74190) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 18 11:36:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74190) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 18 11:36:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74190) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 18 11:36:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74190) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 18 11:36:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=74190) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 18 11:36:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74190) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 18 11:36:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74190) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 18 11:36:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=74190) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 18 11:36:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=74190) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 18 11:36:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=74190) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 18 11:36:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=74190) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 18 11:36:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=74190) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 18 11:36:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=74190) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 18 11:36:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=74190) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 18 11:36:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=74190) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 18 11:36:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=74190) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 18 11:36:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=74190) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 18 11:36:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=74190) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 18 11:36:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=74190) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 18 11:36:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=74190) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 18 11:36:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=74190) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 18 11:36:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu', 'pc', 'q35', 'ubuntu-q35'} {{(pid=74190) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 18 11:36:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Oct 18 11:36:52 user nova-compute[74190]: <domainCapabilities>
Oct 18 11:36:52 user nova-compute[74190]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 18 11:36:52 user nova-compute[74190]:   <domain>kvm</domain>
Oct 18 11:36:52 user nova-compute[74190]:   <machine>pc-i440fx-jammy</machine>
Oct 18 11:36:52 user nova-compute[74190]:   <arch>x86_64</arch>
Oct 18 11:36:52 user nova-compute[74190]:   <vcpu max='255'/>
Oct 18 11:36:52 user nova-compute[74190]:   <iothreads supported='yes'/>
Oct 18 11:36:52 user nova-compute[74190]:   <os supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:     <enum name='firmware'>
Oct 18 11:36:52 user nova-compute[74190]:       <value>efi</value>
Oct 18 11:36:52 user nova-compute[74190]:     </enum>
Oct 18 11:36:52 user nova-compute[74190]:     <loader supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='type'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>rom</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>pflash</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='readonly'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>yes</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>no</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='secure'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>no</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:     </loader>
Oct 18 11:36:52 user nova-compute[74190]:   </os>
Oct 18 11:36:52 user nova-compute[74190]:   <cpu>
Oct 18 11:36:52 user nova-compute[74190]:     <mode name='host-passthrough' supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='hostPassthroughMigratable'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>on</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>off</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:     </mode>
Oct 18 11:36:52 user nova-compute[74190]:     <mode name='maximum' supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='maximumMigratable'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>on</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>off</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:     </mode>
Oct 18 11:36:52 user nova-compute[74190]:     <mode name='host-model' supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <vendor>Intel</vendor>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='ss'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='vmx'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='pcid'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='hypervisor'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='arat'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='tsc_adjust'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='umip'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='md-clear'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='stibp'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='arch-capabilities'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='ssbd'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='invtsc'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='ibpb'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='ibrs'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='amd-stibp'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='amd-ssbd'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='rsba'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='pschange-mc-no'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='disable' name='erms'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='disable' name='xsaveopt'/>
Oct 18 11:36:52 user nova-compute[74190]:     </mode>
Oct 18 11:36:52 user nova-compute[74190]:     <mode name='custom' supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>qemu64</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='yes'>qemu32</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>phenom</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='yes'>pentium3</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='yes'>pentium2</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='yes'>pentium</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>n270</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='yes'>kvm64</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='yes'>kvm32</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='yes'>coreduo</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='yes'>core2duo</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>athlon</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='yes'>Westmere-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='yes'>Westmere</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Snowridge</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Skylake-Server</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Skylake-Client</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>SandyBridge</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='yes'>Penryn</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Opteron_G5</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Opteron_G4</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Opteron_G3</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Opteron_G2</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='yes'>Opteron_G1</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='yes'>Nehalem</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>IvyBridge</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Icelake-Server</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Haswell-noTSX</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Haswell-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Haswell</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>EPYC-Rome</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>EPYC-Milan</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>EPYC-IBPB</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>EPYC</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Dhyana</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Cooperlake</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='yes'>Conroe</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Cascadelake-Server</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Broadwell-noTSX</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Broadwell-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Broadwell</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='yes'>486</model>
Oct 18 11:36:52 user nova-compute[74190]:     </mode>
Oct 18 11:36:52 user nova-compute[74190]:   </cpu>
Oct 18 11:36:52 user nova-compute[74190]:   <memoryBacking supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:     <enum name='sourceType'>
Oct 18 11:36:52 user nova-compute[74190]:       <value>file</value>
Oct 18 11:36:52 user nova-compute[74190]:       <value>anonymous</value>
Oct 18 11:36:52 user nova-compute[74190]:       <value>memfd</value>
Oct 18 11:36:52 user nova-compute[74190]:     </enum>
Oct 18 11:36:52 user nova-compute[74190]:   </memoryBacking>
Oct 18 11:36:52 user nova-compute[74190]:   <devices>
Oct 18 11:36:52 user nova-compute[74190]:     <disk supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='diskDevice'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>disk</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>cdrom</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>floppy</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>lun</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='bus'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>ide</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>fdc</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>scsi</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>virtio</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>usb</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>sata</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='model'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>virtio</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>virtio-transitional</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>virtio-non-transitional</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:     </disk>
Oct 18 11:36:52 user nova-compute[74190]:     <graphics supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='type'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>sdl</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>vnc</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>spice</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>egl-headless</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:     </graphics>
Oct 18 11:36:52 user nova-compute[74190]:     <video supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='modelType'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>vga</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>cirrus</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>vmvga</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>qxl</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>virtio</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>none</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>bochs</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>ramfb</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:     </video>
Oct 18 11:36:52 user nova-compute[74190]:     <hostdev supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='mode'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>subsystem</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='startupPolicy'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>default</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>mandatory</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>requisite</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>optional</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='subsysType'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>usb</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>pci</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>scsi</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='capsType'/>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='pciBackend'/>
Oct 18 11:36:52 user nova-compute[74190]:     </hostdev>
Oct 18 11:36:52 user nova-compute[74190]:     <rng supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='model'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>virtio</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>virtio-transitional</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>virtio-non-transitional</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='backendModel'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>random</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>egd</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>builtin</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:     </rng>
Oct 18 11:36:52 user nova-compute[74190]:     <filesystem supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='driverType'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>path</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>handle</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>virtiofs</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:     </filesystem>
Oct 18 11:36:52 user nova-compute[74190]:     <tpm supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='model'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>tpm-tis</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>tpm-crb</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='backendModel'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>passthrough</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>emulator</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:     </tpm>
Oct 18 11:36:52 user nova-compute[74190]:   </devices>
Oct 18 11:36:52 user nova-compute[74190]:   <features>
Oct 18 11:36:52 user nova-compute[74190]:     <gic supported='no'/>
Oct 18 11:36:52 user nova-compute[74190]:     <vmcoreinfo supported='yes'/>
Oct 18 11:36:52 user nova-compute[74190]:     <genid supported='yes'/>
Oct 18 11:36:52 user nova-compute[74190]:     <backingStoreInput supported='yes'/>
Oct 18 11:36:52 user nova-compute[74190]:     <backup supported='yes'/>
Oct 18 11:36:52 user nova-compute[74190]:     <sev supported='no'/>
Oct 18 11:36:52 user nova-compute[74190]:   </features>
Oct 18 11:36:52 user nova-compute[74190]: </domainCapabilities>
Oct 18 11:36:52 user nova-compute[74190]:  {{(pid=74190) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 18 11:36:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Oct 18 11:36:52 user nova-compute[74190]: <domainCapabilities>
Oct 18 11:36:52 user nova-compute[74190]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 18 11:36:52 user nova-compute[74190]:   <domain>kvm</domain>
Oct 18 11:36:52 user nova-compute[74190]:   <machine>pc-i440fx-6.2</machine>
Oct 18 11:36:52 user nova-compute[74190]:   <arch>x86_64</arch>
Oct 18 11:36:52 user nova-compute[74190]:   <vcpu max='255'/>
Oct 18 11:36:52 user nova-compute[74190]:   <iothreads supported='yes'/>
Oct 18 11:36:52 user nova-compute[74190]:   <os supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:     <enum name='firmware'>
Oct 18 11:36:52 user nova-compute[74190]:       <value>efi</value>
Oct 18 11:36:52 user nova-compute[74190]:     </enum>
Oct 18 11:36:52 user nova-compute[74190]:     <loader supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='type'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>rom</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>pflash</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='readonly'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>yes</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>no</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='secure'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>no</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:     </loader>
Oct 18 11:36:52 user nova-compute[74190]:   </os>
Oct 18 11:36:52 user nova-compute[74190]:   <cpu>
Oct 18 11:36:52 user nova-compute[74190]:     <mode name='host-passthrough' supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='hostPassthroughMigratable'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>on</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>off</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:     </mode>
Oct 18 11:36:52 user nova-compute[74190]:     <mode name='maximum' supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='maximumMigratable'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>on</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>off</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:     </mode>
Oct 18 11:36:52 user nova-compute[74190]:     <mode name='host-model' supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <vendor>Intel</vendor>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='ss'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='vmx'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='pcid'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='hypervisor'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='arat'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='tsc_adjust'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='umip'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='md-clear'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='stibp'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='arch-capabilities'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='ssbd'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='invtsc'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='ibpb'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='ibrs'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='amd-stibp'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='amd-ssbd'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='rsba'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='pschange-mc-no'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='disable' name='erms'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='disable' name='xsaveopt'/>
Oct 18 11:36:52 user nova-compute[74190]:     </mode>
Oct 18 11:36:52 user nova-compute[74190]:     <mode name='custom' supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>qemu64</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='yes'>qemu32</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>phenom</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='yes'>pentium3</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='yes'>pentium2</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='yes'>pentium</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>n270</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='yes'>kvm64</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='yes'>kvm32</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='yes'>coreduo</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='yes'>core2duo</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>athlon</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='yes'>Westmere-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='yes'>Westmere</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Snowridge</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Skylake-Server</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Skylake-Client</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>SandyBridge</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='yes'>Penryn</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Opteron_G5</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Opteron_G4</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Opteron_G3</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Opteron_G2</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='yes'>Opteron_G1</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='yes'>Nehalem</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>IvyBridge</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Icelake-Server</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Haswell-noTSX</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Haswell-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Haswell</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>EPYC-Rome</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>EPYC-Milan</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>EPYC-IBPB</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>EPYC</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Dhyana</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Cooperlake</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='yes'>Conroe</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Cascadelake-Server</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Broadwell-noTSX</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Broadwell-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Broadwell</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='yes'>486</model>
Oct 18 11:36:52 user nova-compute[74190]:     </mode>
Oct 18 11:36:52 user nova-compute[74190]:   </cpu>
Oct 18 11:36:52 user nova-compute[74190]:   <memoryBacking supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:     <enum name='sourceType'>
Oct 18 11:36:52 user nova-compute[74190]:       <value>file</value>
Oct 18 11:36:52 user nova-compute[74190]:       <value>anonymous</value>
Oct 18 11:36:52 user nova-compute[74190]:       <value>memfd</value>
Oct 18 11:36:52 user nova-compute[74190]:     </enum>
Oct 18 11:36:52 user nova-compute[74190]:   </memoryBacking>
Oct 18 11:36:52 user nova-compute[74190]:   <devices>
Oct 18 11:36:52 user nova-compute[74190]:     <disk supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='diskDevice'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>disk</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>cdrom</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>floppy</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>lun</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='bus'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>ide</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>fdc</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>scsi</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>virtio</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>usb</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>sata</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='model'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>virtio</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>virtio-transitional</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>virtio-non-transitional</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:     </disk>
Oct 18 11:36:52 user nova-compute[74190]:     <graphics supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='type'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>sdl</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>vnc</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>spice</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>egl-headless</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:     </graphics>
Oct 18 11:36:52 user nova-compute[74190]:     <video supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='modelType'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>vga</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>cirrus</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>vmvga</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>qxl</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>virtio</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>none</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>bochs</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>ramfb</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:     </video>
Oct 18 11:36:52 user nova-compute[74190]:     <hostdev supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='mode'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>subsystem</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='startupPolicy'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>default</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>mandatory</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>requisite</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>optional</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='subsysType'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>usb</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>pci</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>scsi</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='capsType'/>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='pciBackend'/>
Oct 18 11:36:52 user nova-compute[74190]:     </hostdev>
Oct 18 11:36:52 user nova-compute[74190]:     <rng supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='model'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>virtio</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>virtio-transitional</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>virtio-non-transitional</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='backendModel'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>random</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>egd</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>builtin</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:     </rng>
Oct 18 11:36:52 user nova-compute[74190]:     <filesystem supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='driverType'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>path</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>handle</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>virtiofs</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:     </filesystem>
Oct 18 11:36:52 user nova-compute[74190]:     <tpm supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='model'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>tpm-tis</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>tpm-crb</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='backendModel'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>passthrough</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>emulator</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:     </tpm>
Oct 18 11:36:52 user nova-compute[74190]:   </devices>
Oct 18 11:36:52 user nova-compute[74190]:   <features>
Oct 18 11:36:52 user nova-compute[74190]:     <gic supported='no'/>
Oct 18 11:36:52 user nova-compute[74190]:     <vmcoreinfo supported='yes'/>
Oct 18 11:36:52 user nova-compute[74190]:     <genid supported='yes'/>
Oct 18 11:36:52 user nova-compute[74190]:     <backingStoreInput supported='yes'/>
Oct 18 11:36:52 user nova-compute[74190]:     <backup supported='yes'/>
Oct 18 11:36:52 user nova-compute[74190]:     <sev supported='no'/>
Oct 18 11:36:52 user nova-compute[74190]:   </features>
Oct 18 11:36:52 user nova-compute[74190]: </domainCapabilities>
Oct 18 11:36:52 user nova-compute[74190]:  {{(pid=74190) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 18 11:36:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Oct 18 11:36:52 user nova-compute[74190]: <domainCapabilities>
Oct 18 11:36:52 user nova-compute[74190]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 18 11:36:52 user nova-compute[74190]:   <domain>kvm</domain>
Oct 18 11:36:52 user nova-compute[74190]:   <machine>pc-q35-6.2</machine>
Oct 18 11:36:52 user nova-compute[74190]:   <arch>x86_64</arch>
Oct 18 11:36:52 user nova-compute[74190]:   <vcpu max='288'/>
Oct 18 11:36:52 user nova-compute[74190]:   <iothreads supported='yes'/>
Oct 18 11:36:52 user nova-compute[74190]:   <os supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:     <enum name='firmware'>
Oct 18 11:36:52 user nova-compute[74190]:       <value>efi</value>
Oct 18 11:36:52 user nova-compute[74190]:     </enum>
Oct 18 11:36:52 user nova-compute[74190]:     <loader supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Oct 18 11:36:52 user nova-compute[74190]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Oct 18 11:36:52 user nova-compute[74190]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='type'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>rom</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>pflash</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='readonly'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>yes</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>no</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='secure'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>yes</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>no</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:     </loader>
Oct 18 11:36:52 user nova-compute[74190]:   </os>
Oct 18 11:36:52 user nova-compute[74190]:   <cpu>
Oct 18 11:36:52 user nova-compute[74190]:     <mode name='host-passthrough' supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='hostPassthroughMigratable'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>on</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>off</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:     </mode>
Oct 18 11:36:52 user nova-compute[74190]:     <mode name='maximum' supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='maximumMigratable'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>on</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>off</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:     </mode>
Oct 18 11:36:52 user nova-compute[74190]:     <mode name='host-model' supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <vendor>Intel</vendor>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='ss'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='vmx'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='pcid'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='hypervisor'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='arat'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='tsc_adjust'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='umip'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='md-clear'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='stibp'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='arch-capabilities'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='ssbd'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='invtsc'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='ibpb'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='ibrs'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='amd-stibp'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='amd-ssbd'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='rsba'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='pschange-mc-no'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='disable' name='erms'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='disable' name='xsaveopt'/>
Oct 18 11:36:52 user nova-compute[74190]:     </mode>
Oct 18 11:36:52 user nova-compute[74190]:     <mode name='custom' supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>qemu64</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='yes'>qemu32</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>phenom</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='yes'>pentium3</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='yes'>pentium2</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='yes'>pentium</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>n270</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='yes'>kvm64</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='yes'>kvm32</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='yes'>coreduo</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='yes'>core2duo</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>athlon</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='yes'>Westmere-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='yes'>Westmere</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Snowridge</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Skylake-Server</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Skylake-Client</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>SandyBridge</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='yes'>Penryn</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Opteron_G5</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Opteron_G4</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Opteron_G3</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Opteron_G2</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='yes'>Opteron_G1</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='yes'>Nehalem</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>IvyBridge</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Icelake-Server</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Haswell-noTSX</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Haswell-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Haswell</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>EPYC-Rome</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>EPYC-Milan</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>EPYC-IBPB</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>EPYC</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Dhyana</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Cooperlake</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='yes'>Conroe</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Cascadelake-Server</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Broadwell-noTSX</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Broadwell-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Broadwell</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='yes'>486</model>
Oct 18 11:36:52 user nova-compute[74190]:     </mode>
Oct 18 11:36:52 user nova-compute[74190]:   </cpu>
Oct 18 11:36:52 user nova-compute[74190]:   <memoryBacking supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:     <enum name='sourceType'>
Oct 18 11:36:52 user nova-compute[74190]:       <value>file</value>
Oct 18 11:36:52 user nova-compute[74190]:       <value>anonymous</value>
Oct 18 11:36:52 user nova-compute[74190]:       <value>memfd</value>
Oct 18 11:36:52 user nova-compute[74190]:     </enum>
Oct 18 11:36:52 user nova-compute[74190]:   </memoryBacking>
Oct 18 11:36:52 user nova-compute[74190]:   <devices>
Oct 18 11:36:52 user nova-compute[74190]:     <disk supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='diskDevice'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>disk</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>cdrom</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>floppy</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>lun</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='bus'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>fdc</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>scsi</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>virtio</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>usb</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>sata</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='model'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>virtio</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>virtio-transitional</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>virtio-non-transitional</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:     </disk>
Oct 18 11:36:52 user nova-compute[74190]:     <graphics supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='type'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>sdl</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>vnc</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>spice</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>egl-headless</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:     </graphics>
Oct 18 11:36:52 user nova-compute[74190]:     <video supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='modelType'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>vga</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>cirrus</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>vmvga</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>qxl</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>virtio</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>none</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>bochs</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>ramfb</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:     </video>
Oct 18 11:36:52 user nova-compute[74190]:     <hostdev supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='mode'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>subsystem</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='startupPolicy'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>default</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>mandatory</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>requisite</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>optional</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='subsysType'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>usb</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>pci</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>scsi</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='capsType'/>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='pciBackend'/>
Oct 18 11:36:52 user nova-compute[74190]:     </hostdev>
Oct 18 11:36:52 user nova-compute[74190]:     <rng supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='model'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>virtio</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>virtio-transitional</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>virtio-non-transitional</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='backendModel'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>random</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>egd</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>builtin</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:     </rng>
Oct 18 11:36:52 user nova-compute[74190]:     <filesystem supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='driverType'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>path</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>handle</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>virtiofs</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:     </filesystem>
Oct 18 11:36:52 user nova-compute[74190]:     <tpm supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='model'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>tpm-tis</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>tpm-crb</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='backendModel'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>passthrough</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>emulator</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:     </tpm>
Oct 18 11:36:52 user nova-compute[74190]:   </devices>
Oct 18 11:36:52 user nova-compute[74190]:   <features>
Oct 18 11:36:52 user nova-compute[74190]:     <gic supported='no'/>
Oct 18 11:36:52 user nova-compute[74190]:     <vmcoreinfo supported='yes'/>
Oct 18 11:36:52 user nova-compute[74190]:     <genid supported='yes'/>
Oct 18 11:36:52 user nova-compute[74190]:     <backingStoreInput supported='yes'/>
Oct 18 11:36:52 user nova-compute[74190]:     <backup supported='yes'/>
Oct 18 11:36:52 user nova-compute[74190]:     <sev supported='no'/>
Oct 18 11:36:52 user nova-compute[74190]:   </features>
Oct 18 11:36:52 user nova-compute[74190]: </domainCapabilities>
Oct 18 11:36:52 user nova-compute[74190]:  {{(pid=74190) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 18 11:36:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Oct 18 11:36:52 user nova-compute[74190]: <domainCapabilities>
Oct 18 11:36:52 user nova-compute[74190]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 18 11:36:52 user nova-compute[74190]:   <domain>kvm</domain>
Oct 18 11:36:52 user nova-compute[74190]:   <machine>pc-q35-jammy</machine>
Oct 18 11:36:52 user nova-compute[74190]:   <arch>x86_64</arch>
Oct 18 11:36:52 user nova-compute[74190]:   <vcpu max='288'/>
Oct 18 11:36:52 user nova-compute[74190]:   <iothreads supported='yes'/>
Oct 18 11:36:52 user nova-compute[74190]:   <os supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:     <enum name='firmware'>
Oct 18 11:36:52 user nova-compute[74190]:       <value>efi</value>
Oct 18 11:36:52 user nova-compute[74190]:     </enum>
Oct 18 11:36:52 user nova-compute[74190]:     <loader supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Oct 18 11:36:52 user nova-compute[74190]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Oct 18 11:36:52 user nova-compute[74190]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='type'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>rom</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>pflash</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='readonly'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>yes</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>no</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='secure'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>yes</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>no</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:     </loader>
Oct 18 11:36:52 user nova-compute[74190]:   </os>
Oct 18 11:36:52 user nova-compute[74190]:   <cpu>
Oct 18 11:36:52 user nova-compute[74190]:     <mode name='host-passthrough' supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='hostPassthroughMigratable'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>on</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>off</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:     </mode>
Oct 18 11:36:52 user nova-compute[74190]:     <mode name='maximum' supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='maximumMigratable'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>on</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>off</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:     </mode>
Oct 18 11:36:52 user nova-compute[74190]:     <mode name='host-model' supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <vendor>Intel</vendor>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='ss'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='vmx'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='pcid'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='hypervisor'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='arat'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='tsc_adjust'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='umip'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='md-clear'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='stibp'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='arch-capabilities'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='ssbd'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='invtsc'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='ibpb'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='ibrs'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='amd-stibp'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='amd-ssbd'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='rsba'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='require' name='pschange-mc-no'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='disable' name='erms'/>
Oct 18 11:36:52 user nova-compute[74190]:       <feature policy='disable' name='xsaveopt'/>
Oct 18 11:36:52 user nova-compute[74190]:     </mode>
Oct 18 11:36:52 user nova-compute[74190]:     <mode name='custom' supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>qemu64</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='yes'>qemu32</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>phenom</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='yes'>pentium3</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='yes'>pentium2</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='yes'>pentium</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>n270</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='yes'>kvm64</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='yes'>kvm32</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='yes'>coreduo</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='yes'>core2duo</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>athlon</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='yes'>Westmere-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='yes'>Westmere</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Snowridge</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Skylake-Server</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Skylake-Client</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>SandyBridge</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='yes'>Penryn</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Opteron_G5</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Opteron_G4</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Opteron_G3</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Opteron_G2</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='yes'>Opteron_G1</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='yes'>Nehalem</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>IvyBridge</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Icelake-Server</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Haswell-noTSX</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Haswell-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Haswell</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>EPYC-Rome</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>EPYC-Milan</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>EPYC-IBPB</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>EPYC</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Dhyana</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Cooperlake</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='yes'>Conroe</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Cascadelake-Server</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Broadwell-noTSX</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Broadwell-IBRS</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='no'>Broadwell</model>
Oct 18 11:36:52 user nova-compute[74190]:       <model usable='yes'>486</model>
Oct 18 11:36:52 user nova-compute[74190]:     </mode>
Oct 18 11:36:52 user nova-compute[74190]:   </cpu>
Oct 18 11:36:52 user nova-compute[74190]:   <memoryBacking supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:     <enum name='sourceType'>
Oct 18 11:36:52 user nova-compute[74190]:       <value>file</value>
Oct 18 11:36:52 user nova-compute[74190]:       <value>anonymous</value>
Oct 18 11:36:52 user nova-compute[74190]:       <value>memfd</value>
Oct 18 11:36:52 user nova-compute[74190]:     </enum>
Oct 18 11:36:52 user nova-compute[74190]:   </memoryBacking>
Oct 18 11:36:52 user nova-compute[74190]:   <devices>
Oct 18 11:36:52 user nova-compute[74190]:     <disk supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='diskDevice'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>disk</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>cdrom</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>floppy</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>lun</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='bus'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>fdc</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>scsi</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>virtio</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>usb</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>sata</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='model'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>virtio</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>virtio-transitional</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>virtio-non-transitional</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:     </disk>
Oct 18 11:36:52 user nova-compute[74190]:     <graphics supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='type'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>sdl</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>vnc</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>spice</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>egl-headless</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:     </graphics>
Oct 18 11:36:52 user nova-compute[74190]:     <video supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='modelType'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>vga</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>cirrus</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>vmvga</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>qxl</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>virtio</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>none</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>bochs</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>ramfb</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:     </video>
Oct 18 11:36:52 user nova-compute[74190]:     <hostdev supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='mode'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>subsystem</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='startupPolicy'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>default</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>mandatory</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>requisite</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>optional</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='subsysType'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>usb</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>pci</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>scsi</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='capsType'/>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='pciBackend'/>
Oct 18 11:36:52 user nova-compute[74190]:     </hostdev>
Oct 18 11:36:52 user nova-compute[74190]:     <rng supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='model'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>virtio</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>virtio-transitional</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>virtio-non-transitional</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='backendModel'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>random</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>egd</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>builtin</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:     </rng>
Oct 18 11:36:52 user nova-compute[74190]:     <filesystem supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='driverType'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>path</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>handle</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>virtiofs</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:     </filesystem>
Oct 18 11:36:52 user nova-compute[74190]:     <tpm supported='yes'>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='model'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>tpm-tis</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>tpm-crb</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:       <enum name='backendModel'>
Oct 18 11:36:52 user nova-compute[74190]:         <value>passthrough</value>
Oct 18 11:36:52 user nova-compute[74190]:         <value>emulator</value>
Oct 18 11:36:52 user nova-compute[74190]:       </enum>
Oct 18 11:36:52 user nova-compute[74190]:     </tpm>
Oct 18 11:36:52 user nova-compute[74190]:   </devices>
Oct 18 11:36:52 user nova-compute[74190]:   <features>
Oct 18 11:36:52 user nova-compute[74190]:     <gic supported='no'/>
Oct 18 11:36:52 user nova-compute[74190]:     <vmcoreinfo supported='yes'/>
Oct 18 11:36:52 user nova-compute[74190]:     <genid supported='yes'/>
Oct 18 11:36:52 user nova-compute[74190]:     <backingStoreInput supported='yes'/>
Oct 18 11:36:52 user nova-compute[74190]:     <backup supported='yes'/>
Oct 18 11:36:52 user nova-compute[74190]:     <sev supported='no'/>
Oct 18 11:36:52 user nova-compute[74190]:   </features>
Oct 18 11:36:52 user nova-compute[74190]: </domainCapabilities>
Oct 18 11:36:52 user nova-compute[74190]:  {{(pid=74190) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 18 11:36:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=74190) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 18 11:36:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=74190) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 18 11:36:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=74190) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 18 11:36:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=74190) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 18 11:36:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Checking secure boot support for host arch (x86_64) {{(pid=74190) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Oct 18 11:36:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Checking secure boot support for host arch (x86_64) {{(pid=74190) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Oct 18 11:36:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Checking secure boot support for host arch (x86_64) {{(pid=74190) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Oct 18 11:36:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Checking secure boot support for host arch (x86_64) {{(pid=74190) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Oct 18 11:36:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Checking secure boot support for host arch (x86_64) {{(pid=74190) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Oct 18 11:36:52 user nova-compute[74190]: INFO nova.virt.libvirt.host [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Secure Boot support detected
Oct 18 11:36:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] cpu compare xml: <cpu match="exact">
Oct 18 11:36:52 user nova-compute[74190]:   <model>Nehalem</model>
Oct 18 11:36:52 user nova-compute[74190]: </cpu>
Oct 18 11:36:52 user nova-compute[74190]:  {{(pid=74190) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Oct 18 11:36:52 user nova-compute[74190]: INFO nova.virt.node [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Generated node identity 11291cdf-1d1c-43a5-bad7-6a29a5f06f66
Oct 18 11:36:52 user nova-compute[74190]: INFO nova.virt.node [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Wrote node identity 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 to /opt/stack/data/nova/compute_id
Oct 18 11:36:52 user nova-compute[74190]: WARNING nova.compute.manager [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Compute nodes ['11291cdf-1d1c-43a5-bad7-6a29a5f06f66'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Oct 18 11:36:52 user nova-compute[74190]: INFO nova.compute.manager [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Oct 18 11:36:52 user nova-compute[74190]: WARNING nova.compute.manager [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Oct 18 11:36:52 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:36:52 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:36:52 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:36:52 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Auditing locally available compute resources for user (node: user) {{(pid=74190) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 11:36:52 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:36:52 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:36:52 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Hypervisor/Node resource view: name=user free_ram=10965MB free_disk=26.303672790527344GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74190) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 11:36:52 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:36:52 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:36:52 user nova-compute[74190]: WARNING nova.compute.resource_tracker [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] No compute node record for user:11291cdf-1d1c-43a5-bad7-6a29a5f06f66: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 could not be found.
Oct 18 11:36:52 user nova-compute[74190]: INFO nova.compute.resource_tracker [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Compute node record created for user:user with uuid: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66
Oct 18 11:36:52 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 11:36:52 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 11:36:52 user nova-compute[74190]: INFO nova.scheduler.client.report [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] [req-51fa129d-3fa6-4a43-bda3-0f5da329da4c] Created resource provider record via placement API for resource provider with UUID 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 and name user.
Oct 18 11:36:53 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=74190) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Oct 18 11:36:53 user nova-compute[74190]: INFO nova.virt.libvirt.host [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] kernel doesn't support AMD SEV
Oct 18 11:36:53 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Updating inventory in ProviderTree for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 18 11:36:53 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74190) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 11:36:53 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Libvirt baseline CPU <cpu>
Oct 18 11:36:53 user nova-compute[74190]:   <arch>x86_64</arch>
Oct 18 11:36:53 user nova-compute[74190]:   <model>Nehalem</model>
Oct 18 11:36:53 user nova-compute[74190]:   <vendor>Intel</vendor>
Oct 18 11:36:53 user nova-compute[74190]:   <topology sockets="6" cores="1" threads="1"/>
Oct 18 11:36:53 user nova-compute[74190]: </cpu>
Oct 18 11:36:53 user nova-compute[74190]:  {{(pid=74190) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Oct 18 11:36:53 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Updated inventory for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Oct 18 11:36:53 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Updating resource provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 generation from 0 to 1 during operation: update_inventory {{(pid=74190) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Oct 18 11:36:53 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Updating inventory in ProviderTree for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 18 11:36:53 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Updating resource provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 generation from 1 to 2 during operation: update_traits {{(pid=74190) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Oct 18 11:36:53 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Compute_service record updated for user:user {{(pid=74190) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 11:36:53 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.633s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:36:53 user nova-compute[74190]: DEBUG nova.service [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Creating RPC server for service compute {{(pid=74190) start /opt/stack/nova/nova/service.py:182}}
Oct 18 11:36:53 user nova-compute[74190]: DEBUG nova.service [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] Join ServiceGroup membership for this service compute {{(pid=74190) start /opt/stack/nova/nova/service.py:199}}
Oct 18 11:36:53 user nova-compute[74190]: DEBUG nova.servicegroup.drivers.db [None req-861c7952-4111-489d-adf8-cc2253299c08 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=74190) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Oct 18 11:36:53 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:36:53 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:37:44 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:37:44 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:37:44 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Starting heal instance info cache {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 11:37:44 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Rebuilding the list of instances to heal {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 18 11:37:44 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Didn't find any instances for network info cache update. {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 18 11:37:44 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:37:44 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:37:44 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:37:44 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:37:44 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:37:44 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:37:44 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74190) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 11:37:44 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:37:44 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:37:44 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:37:44 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:37:44 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Auditing locally available compute resources for user (node: user) {{(pid=74190) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 11:37:44 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:37:44 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:37:44 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Hypervisor/Node resource view: name=user free_ram=10398MB free_disk=26.207401275634766GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74190) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 11:37:44 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:37:44 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:37:44 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 11:37:44 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 11:37:44 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 11:37:44 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 11:37:44 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Compute_service record updated for user:user {{(pid=74190) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 11:37:44 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.166s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:38:44 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:38:44 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:38:44 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:38:44 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:38:44 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:38:44 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74190) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 11:38:44 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:38:44 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:38:44 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:38:44 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:38:44 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Auditing locally available compute resources for user (node: user) {{(pid=74190) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 11:38:44 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:38:44 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:38:44 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Hypervisor/Node resource view: name=user free_ram=10302MB free_disk=26.272064208984375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74190) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 11:38:44 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:38:44 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:38:45 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 11:38:45 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 11:38:45 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 11:38:45 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 11:38:45 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Compute_service record updated for user:user {{(pid=74190) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 11:38:45 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.141s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:38:46 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:38:46 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:38:46 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Starting heal instance info cache {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 11:38:46 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Rebuilding the list of instances to heal {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 18 11:38:46 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Didn't find any instances for network info cache update. {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 18 11:38:46 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:38:46 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:39:45 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:39:45 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:39:45 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74190) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 11:39:45 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:39:45 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:39:45 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:39:45 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:39:45 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Auditing locally available compute resources for user (node: user) {{(pid=74190) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 11:39:45 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:39:45 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:39:45 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Hypervisor/Node resource view: name=user free_ram=10309MB free_disk=26.025188446044922GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74190) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 11:39:45 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:39:45 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:39:45 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 11:39:45 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 11:39:45 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 11:39:45 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 11:39:45 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Compute_service record updated for user:user {{(pid=74190) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 11:39:45 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.130s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:39:46 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:39:46 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:39:47 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:39:47 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Starting heal instance info cache {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 11:39:47 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Rebuilding the list of instances to heal {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 18 11:39:47 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Didn't find any instances for network info cache update. {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 18 11:39:47 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:39:48 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:39:48 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:40:45 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:40:45 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:40:45 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:40:45 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:40:45 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:40:45 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:40:45 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Auditing locally available compute resources for user (node: user) {{(pid=74190) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 11:40:45 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:40:45 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:40:45 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Hypervisor/Node resource view: name=user free_ram=9603MB free_disk=26.045146942138672GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74190) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 11:40:45 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:40:45 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:40:45 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 11:40:45 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 11:40:45 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 11:40:45 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 11:40:45 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Compute_service record updated for user:user {{(pid=74190) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 11:40:45 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.182s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:40:46 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:40:46 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:40:46 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:40:46 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74190) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 11:40:48 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:40:48 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:40:49 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:40:49 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:40:49 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Starting heal instance info cache {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 11:40:49 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Rebuilding the list of instances to heal {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 18 11:40:49 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Didn't find any instances for network info cache update. {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 18 11:41:00 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Acquiring lock "c280652c-ffde-40f8-a919-adb8be618db8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:41:00 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lock "c280652c-ffde-40f8-a919-adb8be618db8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:41:00 user nova-compute[74190]: DEBUG nova.compute.manager [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Starting instance... {{(pid=74190) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 11:41:01 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:41:01 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:41:01 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74190) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 11:41:01 user nova-compute[74190]: INFO nova.compute.claims [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Claim successful on node user
Oct 18 11:41:01 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 11:41:01 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 11:41:01 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.380s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:41:01 user nova-compute[74190]: DEBUG nova.compute.manager [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Start building networks asynchronously for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 11:41:01 user nova-compute[74190]: DEBUG nova.compute.manager [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Allocating IP information in the background. {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 11:41:01 user nova-compute[74190]: DEBUG nova.network.neutron [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: c280652c-ffde-40f8-a919-adb8be618db8] allocate_for_instance() {{(pid=74190) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 11:41:01 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 11:41:01 user nova-compute[74190]: DEBUG nova.compute.manager [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Start building block device mappings for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 11:41:02 user nova-compute[74190]: DEBUG nova.compute.manager [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Start spawning the instance on the hypervisor. {{(pid=74190) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 11:41:02 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Creating instance directory {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 11:41:02 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Creating image(s)
Oct 18 11:41:02 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Acquiring lock "/opt/stack/data/nova/instances/c280652c-ffde-40f8-a919-adb8be618db8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:41:02 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lock "/opt/stack/data/nova/instances/c280652c-ffde-40f8-a919-adb8be618db8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:41:02 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lock "/opt/stack/data/nova/instances/c280652c-ffde-40f8-a919-adb8be618db8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:41:02 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Acquiring lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:41:02 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:41:02 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Acquiring lock "3c3cce66-9d7a-4f23-a92a-d10b3efd5e86" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:41:02 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Lock "3c3cce66-9d7a-4f23-a92a-d10b3efd5e86" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:41:02 user nova-compute[74190]: DEBUG nova.compute.manager [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Starting instance... {{(pid=74190) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 11:41:02 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:41:02 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:41:02 user nova-compute[74190]: DEBUG nova.policy [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '852309a19f1b4d49a4974c3be53f67cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99cf8d4d4f504e82868ed295e054644c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74190) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 11:41:02 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74190) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 11:41:02 user nova-compute[74190]: INFO nova.compute.claims [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Claim successful on node user
Oct 18 11:41:02 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f.part --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:41:02 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 11:41:02 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 11:41:02 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f.part --force-share --output=json" returned: 0 in 0.209s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:41:02 user nova-compute[74190]: DEBUG nova.virt.images [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] 6e88bbf0-6e78-49a8-b3c5-9453d22a89df was qcow2, converting to raw {{(pid=74190) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 18 11:41:02 user nova-compute[74190]: DEBUG nova.privsep.utils [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74190) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 18 11:41:02 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f.part /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f.converted {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:41:02 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.658s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:41:02 user nova-compute[74190]: DEBUG nova.compute.manager [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Start building networks asynchronously for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 11:41:03 user nova-compute[74190]: DEBUG nova.compute.manager [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Allocating IP information in the background. {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 11:41:03 user nova-compute[74190]: DEBUG nova.network.neutron [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] allocate_for_instance() {{(pid=74190) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 11:41:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f.part /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f.converted" returned: 0 in 0.150s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:41:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f.converted --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:41:03 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 11:41:03 user nova-compute[74190]: DEBUG nova.compute.manager [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Start building block device mappings for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 11:41:03 user nova-compute[74190]: DEBUG nova.policy [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '829b310c15b54dc7836d0b9d7fd757ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548640fa718f4fdfa21c1a7783519c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74190) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 11:41:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f.converted --force-share --output=json" returned: 0 in 0.184s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:41:03 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.211s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:41:03 user nova-compute[74190]: INFO oslo.privsep.daemon [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpp5_zsg2j/privsep.sock']
Oct 18 11:41:03 user sudo[83412]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpp5_zsg2j/privsep.sock
Oct 18 11:41:03 user sudo[83412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 18 11:41:03 user nova-compute[74190]: DEBUG nova.compute.manager [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Start spawning the instance on the hypervisor. {{(pid=74190) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 11:41:03 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Creating instance directory {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 11:41:03 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Creating image(s)
Oct 18 11:41:03 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Acquiring lock "/opt/stack/data/nova/instances/3c3cce66-9d7a-4f23-a92a-d10b3efd5e86/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:41:03 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Lock "/opt/stack/data/nova/instances/3c3cce66-9d7a-4f23-a92a-d10b3efd5e86/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:41:03 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Lock "/opt/stack/data/nova/instances/3c3cce66-9d7a-4f23-a92a-d10b3efd5e86/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:41:04 user nova-compute[74190]: DEBUG nova.network.neutron [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Successfully created port: 80b77e2d-aa04-4996-a0c1-713054affac4 {{(pid=74190) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 11:41:04 user sudo[83412]: pam_unix(sudo:session): session closed for user root
Oct 18 11:41:04 user nova-compute[74190]: INFO oslo.privsep.daemon [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Spawned new privsep daemon via rootwrap
Oct 18 11:41:04 user nova-compute[74190]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 18 11:41:04 user nova-compute[74190]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 18 11:41:04 user nova-compute[74190]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Oct 18 11:41:04 user nova-compute[74190]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83418
Oct 18 11:41:04 user nova-compute[74190]: WARNING oslo_privsep.priv_context [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] privsep daemon already running
Oct 18 11:41:04 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:41:04 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:41:05 user nova-compute[74190]: DEBUG nova.network.neutron [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Successfully created port: 8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9 {{(pid=74190) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 11:41:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.236s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:41:05 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Acquiring lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:41:05 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:41:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:41:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.258s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:41:05 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Acquiring lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:41:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.220s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:41:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f,backing_fmt=raw /opt/stack/data/nova/instances/c280652c-ffde-40f8-a919-adb8be618db8/disk 1073741824 {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:41:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f,backing_fmt=raw /opt/stack/data/nova/instances/c280652c-ffde-40f8-a919-adb8be618db8/disk 1073741824" returned: 0 in 0.243s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:41:05 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.468s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:41:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:41:05 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.443s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:41:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:41:05 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9f9c40eb-6dbb-4f5f-9d58-c4bfad02ec86 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Acquiring lock "0209c824-88a7-4976-83bf-8a72437f0cc2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:41:05 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9f9c40eb-6dbb-4f5f-9d58-c4bfad02ec86 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lock "0209c824-88a7-4976-83bf-8a72437f0cc2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:41:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.206s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:41:05 user nova-compute[74190]: DEBUG nova.virt.disk.api [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c280652c-ffde-40f8-a919-adb8be618db8/disk. size=1073741824 {{(pid=74190) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 18 11:41:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c280652c-ffde-40f8-a919-adb8be618db8/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:41:05 user nova-compute[74190]: DEBUG nova.compute.manager [None req-9f9c40eb-6dbb-4f5f-9d58-c4bfad02ec86 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] Starting instance... {{(pid=74190) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 11:41:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.231s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:41:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f,backing_fmt=raw /opt/stack/data/nova/instances/3c3cce66-9d7a-4f23-a92a-d10b3efd5e86/disk 1073741824 {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:41:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f,backing_fmt=raw /opt/stack/data/nova/instances/3c3cce66-9d7a-4f23-a92a-d10b3efd5e86/disk 1073741824" returned: 0 in 0.060s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:41:05 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.297s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:41:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:41:06 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9f9c40eb-6dbb-4f5f-9d58-c4bfad02ec86 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:41:06 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9f9c40eb-6dbb-4f5f-9d58-c4bfad02ec86 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:41:06 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-9f9c40eb-6dbb-4f5f-9d58-c4bfad02ec86 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74190) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 11:41:06 user nova-compute[74190]: INFO nova.compute.claims [None req-9f9c40eb-6dbb-4f5f-9d58-c4bfad02ec86 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] Claim successful on node user
Oct 18 11:41:06 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c280652c-ffde-40f8-a919-adb8be618db8/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:41:06 user nova-compute[74190]: DEBUG nova.virt.disk.api [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Cannot resize image /opt/stack/data/nova/instances/c280652c-ffde-40f8-a919-adb8be618db8/disk to a smaller size. {{(pid=74190) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 18 11:41:06 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Created local disks {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 11:41:06 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Ensure instance console log exists: /opt/stack/data/nova/instances/c280652c-ffde-40f8-a919-adb8be618db8/console.log {{(pid=74190) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 11:41:06 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:41:06 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:41:06 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:41:06 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.179s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:41:06 user nova-compute[74190]: DEBUG nova.virt.disk.api [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3c3cce66-9d7a-4f23-a92a-d10b3efd5e86/disk. size=1073741824 {{(pid=74190) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 18 11:41:06 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c3cce66-9d7a-4f23-a92a-d10b3efd5e86/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:41:06 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c3cce66-9d7a-4f23-a92a-d10b3efd5e86/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:41:06 user nova-compute[74190]: DEBUG nova.virt.disk.api [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Cannot resize image /opt/stack/data/nova/instances/3c3cce66-9d7a-4f23-a92a-d10b3efd5e86/disk to a smaller size. {{(pid=74190) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 18 11:41:06 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Created local disks {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 11:41:06 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Ensure instance console log exists: /opt/stack/data/nova/instances/3c3cce66-9d7a-4f23-a92a-d10b3efd5e86/console.log {{(pid=74190) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 11:41:06 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:41:06 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:41:06 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:41:06 user nova-compute[74190]: DEBUG nova.network.neutron [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Successfully updated port: 80b77e2d-aa04-4996-a0c1-713054affac4 {{(pid=74190) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 11:41:06 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-9f9c40eb-6dbb-4f5f-9d58-c4bfad02ec86 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 11:41:06 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Acquiring lock "refresh_cache-c280652c-ffde-40f8-a919-adb8be618db8" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:41:06 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Acquired lock "refresh_cache-c280652c-ffde-40f8-a919-adb8be618db8" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:41:06 user nova-compute[74190]: DEBUG nova.network.neutron [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Building network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 11:41:06 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-9f9c40eb-6dbb-4f5f-9d58-c4bfad02ec86 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 11:41:06 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9f9c40eb-6dbb-4f5f-9d58-c4bfad02ec86 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.408s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:41:06 user nova-compute[74190]: DEBUG nova.compute.manager [None req-9f9c40eb-6dbb-4f5f-9d58-c4bfad02ec86 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] Start building networks asynchronously for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 11:41:06 user nova-compute[74190]: DEBUG nova.network.neutron [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Instance cache missing network info. {{(pid=74190) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 11:41:06 user nova-compute[74190]: DEBUG nova.compute.manager [None req-9f9c40eb-6dbb-4f5f-9d58-c4bfad02ec86 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] Allocating IP information in the background. {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 11:41:06 user nova-compute[74190]: DEBUG nova.network.neutron [None req-9f9c40eb-6dbb-4f5f-9d58-c4bfad02ec86 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] allocate_for_instance() {{(pid=74190) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 11:41:06 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-9f9c40eb-6dbb-4f5f-9d58-c4bfad02ec86 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 11:41:06 user nova-compute[74190]: DEBUG nova.compute.manager [None req-9f9c40eb-6dbb-4f5f-9d58-c4bfad02ec86 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] Start building block device mappings for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 11:41:06 user nova-compute[74190]: DEBUG nova.compute.manager [None req-9f9c40eb-6dbb-4f5f-9d58-c4bfad02ec86 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] Start spawning the instance on the hypervisor. {{(pid=74190) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 11:41:06 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-9f9c40eb-6dbb-4f5f-9d58-c4bfad02ec86 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] Creating instance directory {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 11:41:06 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-9f9c40eb-6dbb-4f5f-9d58-c4bfad02ec86 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] Creating image(s)
Oct 18 11:41:06 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9f9c40eb-6dbb-4f5f-9d58-c4bfad02ec86 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Acquiring lock "/opt/stack/data/nova/instances/0209c824-88a7-4976-83bf-8a72437f0cc2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:41:06 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9f9c40eb-6dbb-4f5f-9d58-c4bfad02ec86 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lock "/opt/stack/data/nova/instances/0209c824-88a7-4976-83bf-8a72437f0cc2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:41:06 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9f9c40eb-6dbb-4f5f-9d58-c4bfad02ec86 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lock "/opt/stack/data/nova/instances/0209c824-88a7-4976-83bf-8a72437f0cc2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:41:06 user nova-compute[74190]: DEBUG nova.policy [None req-9f9c40eb-6dbb-4f5f-9d58-c4bfad02ec86 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b771e627a76b4540bf8de665df3d7787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cf52ce927443158aa731367f08bd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74190) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 11:41:06 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-9f9c40eb-6dbb-4f5f-9d58-c4bfad02ec86 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:41:06 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-9f9c40eb-6dbb-4f5f-9d58-c4bfad02ec86 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.165s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:41:06 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9f9c40eb-6dbb-4f5f-9d58-c4bfad02ec86 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Acquiring lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:41:06 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9f9c40eb-6dbb-4f5f-9d58-c4bfad02ec86 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:41:06 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-9f9c40eb-6dbb-4f5f-9d58-c4bfad02ec86 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:41:07 user nova-compute[74190]: DEBUG nova.compute.manager [req-f58f97fe-71d0-425c-85f6-8de5a5aa3399 req-9b69595c-4d87-4136-8da4-83e3854a8cbd service nova] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Received event network-changed-80b77e2d-aa04-4996-a0c1-713054affac4 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:41:07 user nova-compute[74190]: DEBUG nova.compute.manager [req-f58f97fe-71d0-425c-85f6-8de5a5aa3399 req-9b69595c-4d87-4136-8da4-83e3854a8cbd service nova] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Refreshing instance network info cache due to event network-changed-80b77e2d-aa04-4996-a0c1-713054affac4. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 11:41:07 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-f58f97fe-71d0-425c-85f6-8de5a5aa3399 req-9b69595c-4d87-4136-8da4-83e3854a8cbd service nova] Acquiring lock "refresh_cache-c280652c-ffde-40f8-a919-adb8be618db8" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:41:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-9f9c40eb-6dbb-4f5f-9d58-c4bfad02ec86 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.167s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:41:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-9f9c40eb-6dbb-4f5f-9d58-c4bfad02ec86 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f,backing_fmt=raw /opt/stack/data/nova/instances/0209c824-88a7-4976-83bf-8a72437f0cc2/disk 1073741824 {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:41:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-9f9c40eb-6dbb-4f5f-9d58-c4bfad02ec86 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f,backing_fmt=raw /opt/stack/data/nova/instances/0209c824-88a7-4976-83bf-8a72437f0cc2/disk 1073741824" returned: 0 in 0.042s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:41:07 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9f9c40eb-6dbb-4f5f-9d58-c4bfad02ec86 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.213s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:41:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-9f9c40eb-6dbb-4f5f-9d58-c4bfad02ec86 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:41:07 user nova-compute[74190]: DEBUG nova.network.neutron [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Updating instance_info_cache with network_info: [{"id": "80b77e2d-aa04-4996-a0c1-713054affac4", "address": "fa:16:3e:4f:00:ce", "network": {"id": "cf0a4705-3fff-4716-87ac-b0ca7700e11c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1739631852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cf8d4d4f504e82868ed295e054644c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80b77e2d-aa", "ovs_interfaceid": "80b77e2d-aa04-4996-a0c1-713054affac4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:41:07 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Releasing lock "refresh_cache-c280652c-ffde-40f8-a919-adb8be618db8" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:41:07 user nova-compute[74190]: DEBUG nova.compute.manager [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Instance network_info: |[{"id": "80b77e2d-aa04-4996-a0c1-713054affac4", "address": "fa:16:3e:4f:00:ce", "network": {"id": "cf0a4705-3fff-4716-87ac-b0ca7700e11c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1739631852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cf8d4d4f504e82868ed295e054644c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80b77e2d-aa", "ovs_interfaceid": "80b77e2d-aa04-4996-a0c1-713054affac4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 11:41:07 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-f58f97fe-71d0-425c-85f6-8de5a5aa3399 req-9b69595c-4d87-4136-8da4-83e3854a8cbd service nova] Acquired lock "refresh_cache-c280652c-ffde-40f8-a919-adb8be618db8" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:41:07 user nova-compute[74190]: DEBUG nova.network.neutron [req-f58f97fe-71d0-425c-85f6-8de5a5aa3399 req-9b69595c-4d87-4136-8da4-83e3854a8cbd service nova] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Refreshing network info cache for port 80b77e2d-aa04-4996-a0c1-713054affac4 {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 11:41:07 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Start _get_guest_xml network_info=[{"id": "80b77e2d-aa04-4996-a0c1-713054affac4", "address": "fa:16:3e:4f:00:ce", "network": {"id": "cf0a4705-3fff-4716-87ac-b0ca7700e11c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1739631852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cf8d4d4f504e82868ed295e054644c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80b77e2d-aa", "ovs_interfaceid": "80b77e2d-aa04-4996-a0c1-713054affac4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'image_id': '6e88bbf0-6e78-49a8-b3c5-9453d22a89df'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 11:41:07 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:41:07 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:41:07 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 11:41:07 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] CPU controller missing on host. {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 11:41:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-9f9c40eb-6dbb-4f5f-9d58-c4bfad02ec86 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.187s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:41:07 user nova-compute[74190]: DEBUG nova.virt.disk.api [None req-9f9c40eb-6dbb-4f5f-9d58-c4bfad02ec86 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0209c824-88a7-4976-83bf-8a72437f0cc2/disk. size=1073741824 {{(pid=74190) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 18 11:41:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-9f9c40eb-6dbb-4f5f-9d58-c4bfad02ec86 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0209c824-88a7-4976-83bf-8a72437f0cc2/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:41:07 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 11:41:07 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] CPU controller found on host. {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 11:41:07 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74190) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 11:41:07 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T11:37:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 11:41:07 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Flavor limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 11:41:07 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Image limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 11:41:07 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Flavor pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 11:41:07 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Image pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 11:41:07 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 11:41:07 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 11:41:07 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 11:41:07 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Got 1 possible topologies {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 11:41:07 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 11:41:07 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 11:41:07 user nova-compute[74190]: DEBUG nova.privsep.utils [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74190) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 18 11:41:07 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:40:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-711461105',display_name='tempest-AttachVolumeTestJSON-server-711461105',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-711461105',id=1,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPnE2mtL+LbI3yVW2kYaN2Dxz5V1+PIccsOPxNaLovIe8VN7EUmA+C39USstHm9Yifnik7GFCenLhGnFytwIhcv6ox30HzhlwfaoDrZEfYtFLQ2I1/Og7nqCIt/6qIOiKA==',key_name='tempest-keypair-355856933',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='99cf8d4d4f504e82868ed295e054644c',ramdisk_id='',reservation_id='r-zf27bcaw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-2125017306',owner_user_name='tempest-AttachVolumeTestJSON-2125017306-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:41:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='852309a19f1b4d49a4974c3be53f67cb',uuid=c280652c-ffde-40f8-a919-adb8be618db8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "80b77e2d-aa04-4996-a0c1-713054affac4", "address": "fa:16:3e:4f:00:ce", "network": {"id": "cf0a4705-3fff-4716-87ac-b0ca7700e11c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1739631852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cf8d4d4f504e82868ed295e054644c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80b77e2d-aa", "ovs_interfaceid": "80b77e2d-aa04-4996-a0c1-713054affac4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74190) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 11:41:07 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Converting VIF {"id": "80b77e2d-aa04-4996-a0c1-713054affac4", "address": "fa:16:3e:4f:00:ce", "network": {"id": "cf0a4705-3fff-4716-87ac-b0ca7700e11c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1739631852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cf8d4d4f504e82868ed295e054644c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80b77e2d-aa", "ovs_interfaceid": "80b77e2d-aa04-4996-a0c1-713054affac4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:41:07 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:00:ce,bridge_name='br-int',has_traffic_filtering=True,id=80b77e2d-aa04-4996-a0c1-713054affac4,network=Network(cf0a4705-3fff-4716-87ac-b0ca7700e11c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80b77e2d-aa') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:41:07 user nova-compute[74190]: DEBUG nova.objects.instance [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lazy-loading 'pci_devices' on Instance uuid c280652c-ffde-40f8-a919-adb8be618db8 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:41:07 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: c280652c-ffde-40f8-a919-adb8be618db8] End _get_guest_xml xml=<domain type="kvm">
Oct 18 11:41:07 user nova-compute[74190]:   <uuid>c280652c-ffde-40f8-a919-adb8be618db8</uuid>
Oct 18 11:41:07 user nova-compute[74190]:   <name>instance-00000001</name>
Oct 18 11:41:07 user nova-compute[74190]:   <memory>524288</memory>
Oct 18 11:41:07 user nova-compute[74190]:   <vcpu>1</vcpu>
Oct 18 11:41:07 user nova-compute[74190]:   <metadata>
Oct 18 11:41:07 user nova-compute[74190]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 11:41:07 user nova-compute[74190]:       <nova:package version="0.0.0"/>
Oct 18 11:41:07 user nova-compute[74190]:       <nova:name>tempest-AttachVolumeTestJSON-server-711461105</nova:name>
Oct 18 11:41:07 user nova-compute[74190]:       <nova:creationTime>2023-10-18 11:41:07</nova:creationTime>
Oct 18 11:41:07 user nova-compute[74190]:       <nova:flavor name="m1.tiny">
Oct 18 11:41:07 user nova-compute[74190]:         <nova:memory>512</nova:memory>
Oct 18 11:41:07 user nova-compute[74190]:         <nova:disk>1</nova:disk>
Oct 18 11:41:07 user nova-compute[74190]:         <nova:swap>0</nova:swap>
Oct 18 11:41:07 user nova-compute[74190]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 11:41:07 user nova-compute[74190]:         <nova:vcpus>1</nova:vcpus>
Oct 18 11:41:07 user nova-compute[74190]:       </nova:flavor>
Oct 18 11:41:07 user nova-compute[74190]:       <nova:owner>
Oct 18 11:41:07 user nova-compute[74190]:         <nova:user uuid="852309a19f1b4d49a4974c3be53f67cb">tempest-AttachVolumeTestJSON-2125017306-project-member</nova:user>
Oct 18 11:41:07 user nova-compute[74190]:         <nova:project uuid="99cf8d4d4f504e82868ed295e054644c">tempest-AttachVolumeTestJSON-2125017306</nova:project>
Oct 18 11:41:07 user nova-compute[74190]:       </nova:owner>
Oct 18 11:41:07 user nova-compute[74190]:       <nova:root type="image" uuid="6e88bbf0-6e78-49a8-b3c5-9453d22a89df"/>
Oct 18 11:41:07 user nova-compute[74190]:       <nova:ports>
Oct 18 11:41:07 user nova-compute[74190]:         <nova:port uuid="80b77e2d-aa04-4996-a0c1-713054affac4">
Oct 18 11:41:07 user nova-compute[74190]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 18 11:41:07 user nova-compute[74190]:         </nova:port>
Oct 18 11:41:07 user nova-compute[74190]:       </nova:ports>
Oct 18 11:41:07 user nova-compute[74190]:     </nova:instance>
Oct 18 11:41:07 user nova-compute[74190]:   </metadata>
Oct 18 11:41:07 user nova-compute[74190]:   <sysinfo type="smbios">
Oct 18 11:41:07 user nova-compute[74190]:     <system>
Oct 18 11:41:07 user nova-compute[74190]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 11:41:07 user nova-compute[74190]:       <entry name="product">OpenStack Nova</entry>
Oct 18 11:41:07 user nova-compute[74190]:       <entry name="version">0.0.0</entry>
Oct 18 11:41:07 user nova-compute[74190]:       <entry name="serial">c280652c-ffde-40f8-a919-adb8be618db8</entry>
Oct 18 11:41:07 user nova-compute[74190]:       <entry name="uuid">c280652c-ffde-40f8-a919-adb8be618db8</entry>
Oct 18 11:41:07 user nova-compute[74190]:       <entry name="family">Virtual Machine</entry>
Oct 18 11:41:07 user nova-compute[74190]:     </system>
Oct 18 11:41:07 user nova-compute[74190]:   </sysinfo>
Oct 18 11:41:07 user nova-compute[74190]:   <os>
Oct 18 11:41:07 user nova-compute[74190]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 11:41:07 user nova-compute[74190]:     <boot dev="hd"/>
Oct 18 11:41:07 user nova-compute[74190]:     <smbios mode="sysinfo"/>
Oct 18 11:41:07 user nova-compute[74190]:   </os>
Oct 18 11:41:07 user nova-compute[74190]:   <features>
Oct 18 11:41:07 user nova-compute[74190]:     <acpi/>
Oct 18 11:41:07 user nova-compute[74190]:     <apic/>
Oct 18 11:41:07 user nova-compute[74190]:     <vmcoreinfo/>
Oct 18 11:41:07 user nova-compute[74190]:   </features>
Oct 18 11:41:07 user nova-compute[74190]:   <clock offset="utc">
Oct 18 11:41:07 user nova-compute[74190]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 11:41:07 user nova-compute[74190]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 11:41:07 user nova-compute[74190]:     <timer name="hpet" present="no"/>
Oct 18 11:41:07 user nova-compute[74190]:   </clock>
Oct 18 11:41:07 user nova-compute[74190]:   <cpu mode="custom" match="exact">
Oct 18 11:41:07 user nova-compute[74190]:     <model>Nehalem</model>
Oct 18 11:41:07 user nova-compute[74190]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 11:41:07 user nova-compute[74190]:   </cpu>
Oct 18 11:41:07 user nova-compute[74190]:   <devices>
Oct 18 11:41:07 user nova-compute[74190]:     <disk type="file" device="disk">
Oct 18 11:41:07 user nova-compute[74190]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 11:41:07 user nova-compute[74190]:       <source file="/opt/stack/data/nova/instances/c280652c-ffde-40f8-a919-adb8be618db8/disk"/>
Oct 18 11:41:07 user nova-compute[74190]:       <target dev="vda" bus="virtio"/>
Oct 18 11:41:07 user nova-compute[74190]:     </disk>
Oct 18 11:41:07 user nova-compute[74190]:     <interface type="ethernet">
Oct 18 11:41:07 user nova-compute[74190]:       <mac address="fa:16:3e:4f:00:ce"/>
Oct 18 11:41:07 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:41:07 user nova-compute[74190]:       <mtu size="1442"/>
Oct 18 11:41:07 user nova-compute[74190]:       <target dev="tap80b77e2d-aa"/>
Oct 18 11:41:07 user nova-compute[74190]:     </interface>
Oct 18 11:41:07 user nova-compute[74190]:     <serial type="pty">
Oct 18 11:41:07 user nova-compute[74190]:       <log file="/opt/stack/data/nova/instances/c280652c-ffde-40f8-a919-adb8be618db8/console.log" append="off"/>
Oct 18 11:41:07 user nova-compute[74190]:     </serial>
Oct 18 11:41:07 user nova-compute[74190]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 11:41:07 user nova-compute[74190]:     <video>
Oct 18 11:41:07 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:41:07 user nova-compute[74190]:     </video>
Oct 18 11:41:07 user nova-compute[74190]:     <rng model="virtio">
Oct 18 11:41:07 user nova-compute[74190]:       <backend model="random">/dev/urandom</backend>
Oct 18 11:41:07 user nova-compute[74190]:     </rng>
Oct 18 11:41:07 user nova-compute[74190]:     <controller type="usb" index="0" model="none"/>
Oct 18 11:41:07 user nova-compute[74190]:     <memballoon model="virtio">
Oct 18 11:41:07 user nova-compute[74190]:       <stats period="10"/>
Oct 18 11:41:07 user nova-compute[74190]:     </memballoon>
Oct 18 11:41:07 user nova-compute[74190]:   </devices>
Oct 18 11:41:07 user nova-compute[74190]: </domain>
Oct 18 11:41:07 user nova-compute[74190]:  {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 11:41:07 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:40:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-711461105',display_name='tempest-AttachVolumeTestJSON-server-711461105',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-711461105',id=1,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPnE2mtL+LbI3yVW2kYaN2Dxz5V1+PIccsOPxNaLovIe8VN7EUmA+C39USstHm9Yifnik7GFCenLhGnFytwIhcv6ox30HzhlwfaoDrZEfYtFLQ2I1/Og7nqCIt/6qIOiKA==',key_name='tempest-keypair-355856933',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='99cf8d4d4f504e82868ed295e054644c',ramdisk_id='',reservation_id='r-zf27bcaw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-2125017306',owner_user_name='tempest-AttachVolumeTestJSON-2125017306-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:41:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='852309a19f1b4d49a4974c3be53f67cb',uuid=c280652c-ffde-40f8-a919-adb8be618db8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "80b77e2d-aa04-4996-a0c1-713054affac4", "address": "fa:16:3e:4f:00:ce", "network": {"id": "cf0a4705-3fff-4716-87ac-b0ca7700e11c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1739631852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cf8d4d4f504e82868ed295e054644c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80b77e2d-aa", "ovs_interfaceid": "80b77e2d-aa04-4996-a0c1-713054affac4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 11:41:07 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Converting VIF {"id": "80b77e2d-aa04-4996-a0c1-713054affac4", "address": "fa:16:3e:4f:00:ce", "network": {"id": "cf0a4705-3fff-4716-87ac-b0ca7700e11c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1739631852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cf8d4d4f504e82868ed295e054644c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80b77e2d-aa", "ovs_interfaceid": "80b77e2d-aa04-4996-a0c1-713054affac4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:41:07 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:00:ce,bridge_name='br-int',has_traffic_filtering=True,id=80b77e2d-aa04-4996-a0c1-713054affac4,network=Network(cf0a4705-3fff-4716-87ac-b0ca7700e11c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80b77e2d-aa') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:41:07 user nova-compute[74190]: DEBUG os_vif [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:00:ce,bridge_name='br-int',has_traffic_filtering=True,id=80b77e2d-aa04-4996-a0c1-713054affac4,network=Network(cf0a4705-3fff-4716-87ac-b0ca7700e11c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80b77e2d-aa') {{(pid=74190) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 11:41:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-9f9c40eb-6dbb-4f5f-9d58-c4bfad02ec86 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0209c824-88a7-4976-83bf-8a72437f0cc2/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:41:07 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Created schema index Interface.name {{(pid=74190) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 18 11:41:07 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Created schema index Port.name {{(pid=74190) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 18 11:41:07 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Created schema index Bridge.name {{(pid=74190) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 18 11:41:07 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 11:41:07 user nova-compute[74190]: DEBUG nova.virt.disk.api [None req-9f9c40eb-6dbb-4f5f-9d58-c4bfad02ec86 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Cannot resize image /opt/stack/data/nova/instances/0209c824-88a7-4976-83bf-8a72437f0cc2/disk to a smaller size. {{(pid=74190) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 18 11:41:07 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-9f9c40eb-6dbb-4f5f-9d58-c4bfad02ec86 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] Created local disks {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 11:41:07 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-9f9c40eb-6dbb-4f5f-9d58-c4bfad02ec86 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] Ensure instance console log exists: /opt/stack/data/nova/instances/0209c824-88a7-4976-83bf-8a72437f0cc2/console.log {{(pid=74190) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 11:41:07 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9f9c40eb-6dbb-4f5f-9d58-c4bfad02ec86 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:41:07 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9f9c40eb-6dbb-4f5f-9d58-c4bfad02ec86 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:41:07 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9f9c40eb-6dbb-4f5f-9d58-c4bfad02ec86 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:41:07 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [POLLOUT] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:07 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 11:41:07 user nova-compute[74190]: DEBUG nova.network.neutron [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Successfully updated port: 8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9 {{(pid=74190) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 11:41:07 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:07 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:07 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:07 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Acquiring lock "refresh_cache-3c3cce66-9d7a-4f23-a92a-d10b3efd5e86" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:41:07 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Acquired lock "refresh_cache-3c3cce66-9d7a-4f23-a92a-d10b3efd5e86" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:41:07 user nova-compute[74190]: DEBUG nova.network.neutron [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Building network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 11:41:07 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:07 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:41:07 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 11:41:07 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:07 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2576e2aa-e5b5-5773-b422-eed291832674', '_type': 'linux-noop'}}, row=False) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:41:07 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:07 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:41:07 user nova-compute[74190]: INFO oslo.privsep.daemon [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpcqbc7b42/privsep.sock']
Oct 18 11:41:07 user sudo[83503]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpcqbc7b42/privsep.sock
Oct 18 11:41:07 user sudo[83503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 18 11:41:08 user nova-compute[74190]: DEBUG nova.network.neutron [None req-9f9c40eb-6dbb-4f5f-9d58-c4bfad02ec86 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] Successfully created port: 5e4eb783-7e7c-4501-bf99-33472454f4ac {{(pid=74190) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 11:41:08 user nova-compute[74190]: DEBUG nova.compute.manager [req-74d4fd73-8e1b-4b68-847b-173f29ee66cb req-df583fdc-61c9-4113-bc88-a659a7bd2f80 service nova] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Received event network-changed-8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:41:08 user nova-compute[74190]: DEBUG nova.compute.manager [req-74d4fd73-8e1b-4b68-847b-173f29ee66cb req-df583fdc-61c9-4113-bc88-a659a7bd2f80 service nova] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Refreshing instance network info cache due to event network-changed-8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 11:41:08 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-74d4fd73-8e1b-4b68-847b-173f29ee66cb req-df583fdc-61c9-4113-bc88-a659a7bd2f80 service nova] Acquiring lock "refresh_cache-3c3cce66-9d7a-4f23-a92a-d10b3efd5e86" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:41:08 user nova-compute[74190]: DEBUG nova.network.neutron [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Instance cache missing network info. {{(pid=74190) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 11:41:08 user nova-compute[74190]: DEBUG nova.network.neutron [req-f58f97fe-71d0-425c-85f6-8de5a5aa3399 req-9b69595c-4d87-4136-8da4-83e3854a8cbd service nova] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Updated VIF entry in instance network info cache for port 80b77e2d-aa04-4996-a0c1-713054affac4. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 11:41:08 user nova-compute[74190]: DEBUG nova.network.neutron [req-f58f97fe-71d0-425c-85f6-8de5a5aa3399 req-9b69595c-4d87-4136-8da4-83e3854a8cbd service nova] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Updating instance_info_cache with network_info: [{"id": "80b77e2d-aa04-4996-a0c1-713054affac4", "address": "fa:16:3e:4f:00:ce", "network": {"id": "cf0a4705-3fff-4716-87ac-b0ca7700e11c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1739631852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cf8d4d4f504e82868ed295e054644c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80b77e2d-aa", "ovs_interfaceid": "80b77e2d-aa04-4996-a0c1-713054affac4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:41:08 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-f58f97fe-71d0-425c-85f6-8de5a5aa3399 req-9b69595c-4d87-4136-8da4-83e3854a8cbd service nova] Releasing lock "refresh_cache-c280652c-ffde-40f8-a919-adb8be618db8" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:41:08 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:09 user nova-compute[74190]: DEBUG nova.network.neutron [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Updating instance_info_cache with network_info: [{"id": "8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9", "address": "fa:16:3e:93:46:f1", "network": {"id": "e6ae8edc-7014-4341-91b2-4c82d72c9bb9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-15434410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548640fa718f4fdfa21c1a7783519c9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d891e1d-9d", "ovs_interfaceid": "8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:41:09 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Releasing lock "refresh_cache-3c3cce66-9d7a-4f23-a92a-d10b3efd5e86" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:41:09 user nova-compute[74190]: DEBUG nova.compute.manager [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Instance network_info: |[{"id": "8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9", "address": "fa:16:3e:93:46:f1", "network": {"id": "e6ae8edc-7014-4341-91b2-4c82d72c9bb9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-15434410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548640fa718f4fdfa21c1a7783519c9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d891e1d-9d", "ovs_interfaceid": "8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 11:41:09 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-74d4fd73-8e1b-4b68-847b-173f29ee66cb req-df583fdc-61c9-4113-bc88-a659a7bd2f80 service nova] Acquired lock "refresh_cache-3c3cce66-9d7a-4f23-a92a-d10b3efd5e86" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:41:09 user nova-compute[74190]: DEBUG nova.network.neutron [req-74d4fd73-8e1b-4b68-847b-173f29ee66cb req-df583fdc-61c9-4113-bc88-a659a7bd2f80 service nova] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Refreshing network info cache for port 8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9 {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 11:41:09 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Start _get_guest_xml network_info=[{"id": "8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9", "address": "fa:16:3e:93:46:f1", "network": {"id": "e6ae8edc-7014-4341-91b2-4c82d72c9bb9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-15434410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548640fa718f4fdfa21c1a7783519c9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d891e1d-9d", "ovs_interfaceid": "8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'image_id': '6e88bbf0-6e78-49a8-b3c5-9453d22a89df'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 11:41:09 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:41:09 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:41:09 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 11:41:09 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] CPU controller missing on host. {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 11:41:09 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 11:41:09 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] CPU controller found on host. {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 11:41:09 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74190) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 11:41:09 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T11:37:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 11:41:09 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Flavor limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 11:41:09 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Image limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 11:41:09 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Flavor pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 11:41:09 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Image pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 11:41:09 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 11:41:09 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 11:41:09 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 11:41:09 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Got 1 possible topologies {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 11:41:09 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 11:41:09 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 11:41:09 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:41:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-483118733',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-483118733',id=2,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC3fbJwjpJcODvmNEbH6DkfTuq/vNmpKXMAj6M+n75XoLrJlu4RmlMCvM6O8dl0GccAxqeju8gdcGNftn2/SOycIsQwxsxoRPc57gtaDIUNq6QqcMtgCrFnzcW3Mp4Vp6A==',key_name='tempest-keypair-576336985',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='548640fa718f4fdfa21c1a7783519c9f',ramdisk_id='',reservation_id='r-2fa6tit7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-83921126',owner_user_name='tempest-AttachVolumeShelveTestJSON-83921126-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:41:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='829b310c15b54dc7836d0b9d7fd757ed',uuid=3c3cce66-9d7a-4f23-a92a-d10b3efd5e86,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9", "address": "fa:16:3e:93:46:f1", "network": {"id": "e6ae8edc-7014-4341-91b2-4c82d72c9bb9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-15434410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548640fa718f4fdfa21c1a7783519c9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d891e1d-9d", "ovs_interfaceid": "8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74190) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 11:41:09 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Converting VIF {"id": "8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9", "address": "fa:16:3e:93:46:f1", "network": {"id": "e6ae8edc-7014-4341-91b2-4c82d72c9bb9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-15434410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548640fa718f4fdfa21c1a7783519c9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d891e1d-9d", "ovs_interfaceid": "8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:41:09 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:46:f1,bridge_name='br-int',has_traffic_filtering=True,id=8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9,network=Network(e6ae8edc-7014-4341-91b2-4c82d72c9bb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d891e1d-9d') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:41:09 user nova-compute[74190]: DEBUG nova.objects.instance [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Lazy-loading 'pci_devices' on Instance uuid 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:41:09 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] End _get_guest_xml xml=<domain type="kvm">
Oct 18 11:41:09 user nova-compute[74190]:   <uuid>3c3cce66-9d7a-4f23-a92a-d10b3efd5e86</uuid>
Oct 18 11:41:09 user nova-compute[74190]:   <name>instance-00000002</name>
Oct 18 11:41:09 user nova-compute[74190]:   <memory>524288</memory>
Oct 18 11:41:09 user nova-compute[74190]:   <vcpu>1</vcpu>
Oct 18 11:41:09 user nova-compute[74190]:   <metadata>
Oct 18 11:41:09 user nova-compute[74190]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 11:41:09 user nova-compute[74190]:       <nova:package version="0.0.0"/>
Oct 18 11:41:09 user nova-compute[74190]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-483118733</nova:name>
Oct 18 11:41:09 user nova-compute[74190]:       <nova:creationTime>2023-10-18 11:41:09</nova:creationTime>
Oct 18 11:41:09 user nova-compute[74190]:       <nova:flavor name="m1.tiny">
Oct 18 11:41:09 user nova-compute[74190]:         <nova:memory>512</nova:memory>
Oct 18 11:41:09 user nova-compute[74190]:         <nova:disk>1</nova:disk>
Oct 18 11:41:09 user nova-compute[74190]:         <nova:swap>0</nova:swap>
Oct 18 11:41:09 user nova-compute[74190]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 11:41:09 user nova-compute[74190]:         <nova:vcpus>1</nova:vcpus>
Oct 18 11:41:09 user nova-compute[74190]:       </nova:flavor>
Oct 18 11:41:09 user nova-compute[74190]:       <nova:owner>
Oct 18 11:41:09 user nova-compute[74190]:         <nova:user uuid="829b310c15b54dc7836d0b9d7fd757ed">tempest-AttachVolumeShelveTestJSON-83921126-project-member</nova:user>
Oct 18 11:41:09 user nova-compute[74190]:         <nova:project uuid="548640fa718f4fdfa21c1a7783519c9f">tempest-AttachVolumeShelveTestJSON-83921126</nova:project>
Oct 18 11:41:09 user nova-compute[74190]:       </nova:owner>
Oct 18 11:41:09 user nova-compute[74190]:       <nova:root type="image" uuid="6e88bbf0-6e78-49a8-b3c5-9453d22a89df"/>
Oct 18 11:41:09 user nova-compute[74190]:       <nova:ports>
Oct 18 11:41:09 user nova-compute[74190]:         <nova:port uuid="8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9">
Oct 18 11:41:09 user nova-compute[74190]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 18 11:41:09 user nova-compute[74190]:         </nova:port>
Oct 18 11:41:09 user nova-compute[74190]:       </nova:ports>
Oct 18 11:41:09 user nova-compute[74190]:     </nova:instance>
Oct 18 11:41:09 user nova-compute[74190]:   </metadata>
Oct 18 11:41:09 user nova-compute[74190]:   <sysinfo type="smbios">
Oct 18 11:41:09 user nova-compute[74190]:     <system>
Oct 18 11:41:09 user nova-compute[74190]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 11:41:09 user nova-compute[74190]:       <entry name="product">OpenStack Nova</entry>
Oct 18 11:41:09 user nova-compute[74190]:       <entry name="version">0.0.0</entry>
Oct 18 11:41:09 user nova-compute[74190]:       <entry name="serial">3c3cce66-9d7a-4f23-a92a-d10b3efd5e86</entry>
Oct 18 11:41:09 user nova-compute[74190]:       <entry name="uuid">3c3cce66-9d7a-4f23-a92a-d10b3efd5e86</entry>
Oct 18 11:41:09 user nova-compute[74190]:       <entry name="family">Virtual Machine</entry>
Oct 18 11:41:09 user nova-compute[74190]:     </system>
Oct 18 11:41:09 user nova-compute[74190]:   </sysinfo>
Oct 18 11:41:09 user nova-compute[74190]:   <os>
Oct 18 11:41:09 user nova-compute[74190]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 11:41:09 user nova-compute[74190]:     <boot dev="hd"/>
Oct 18 11:41:09 user nova-compute[74190]:     <smbios mode="sysinfo"/>
Oct 18 11:41:09 user nova-compute[74190]:   </os>
Oct 18 11:41:09 user nova-compute[74190]:   <features>
Oct 18 11:41:09 user nova-compute[74190]:     <acpi/>
Oct 18 11:41:09 user nova-compute[74190]:     <apic/>
Oct 18 11:41:09 user nova-compute[74190]:     <vmcoreinfo/>
Oct 18 11:41:09 user nova-compute[74190]:   </features>
Oct 18 11:41:09 user nova-compute[74190]:   <clock offset="utc">
Oct 18 11:41:09 user nova-compute[74190]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 11:41:09 user nova-compute[74190]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 11:41:09 user nova-compute[74190]:     <timer name="hpet" present="no"/>
Oct 18 11:41:09 user nova-compute[74190]:   </clock>
Oct 18 11:41:09 user nova-compute[74190]:   <cpu mode="custom" match="exact">
Oct 18 11:41:09 user nova-compute[74190]:     <model>Nehalem</model>
Oct 18 11:41:09 user nova-compute[74190]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 11:41:09 user nova-compute[74190]:   </cpu>
Oct 18 11:41:09 user nova-compute[74190]:   <devices>
Oct 18 11:41:09 user nova-compute[74190]:     <disk type="file" device="disk">
Oct 18 11:41:09 user nova-compute[74190]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 11:41:09 user nova-compute[74190]:       <source file="/opt/stack/data/nova/instances/3c3cce66-9d7a-4f23-a92a-d10b3efd5e86/disk"/>
Oct 18 11:41:09 user nova-compute[74190]:       <target dev="vda" bus="virtio"/>
Oct 18 11:41:09 user nova-compute[74190]:     </disk>
Oct 18 11:41:09 user nova-compute[74190]:     <interface type="ethernet">
Oct 18 11:41:09 user nova-compute[74190]:       <mac address="fa:16:3e:93:46:f1"/>
Oct 18 11:41:09 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:41:09 user nova-compute[74190]:       <mtu size="1442"/>
Oct 18 11:41:09 user nova-compute[74190]:       <target dev="tap8d891e1d-9d"/>
Oct 18 11:41:09 user nova-compute[74190]:     </interface>
Oct 18 11:41:09 user nova-compute[74190]:     <serial type="pty">
Oct 18 11:41:09 user nova-compute[74190]:       <log file="/opt/stack/data/nova/instances/3c3cce66-9d7a-4f23-a92a-d10b3efd5e86/console.log" append="off"/>
Oct 18 11:41:09 user nova-compute[74190]:     </serial>
Oct 18 11:41:09 user nova-compute[74190]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 11:41:09 user nova-compute[74190]:     <video>
Oct 18 11:41:09 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:41:09 user nova-compute[74190]:     </video>
Oct 18 11:41:09 user nova-compute[74190]:     <rng model="virtio">
Oct 18 11:41:09 user nova-compute[74190]:       <backend model="random">/dev/urandom</backend>
Oct 18 11:41:09 user nova-compute[74190]:     </rng>
Oct 18 11:41:09 user nova-compute[74190]:     <controller type="usb" index="0" model="none"/>
Oct 18 11:41:09 user nova-compute[74190]:     <memballoon model="virtio">
Oct 18 11:41:09 user nova-compute[74190]:       <stats period="10"/>
Oct 18 11:41:09 user nova-compute[74190]:     </memballoon>
Oct 18 11:41:09 user nova-compute[74190]:   </devices>
Oct 18 11:41:09 user nova-compute[74190]: </domain>
Oct 18 11:41:09 user nova-compute[74190]:  {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 11:41:09 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:41:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-483118733',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-483118733',id=2,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC3fbJwjpJcODvmNEbH6DkfTuq/vNmpKXMAj6M+n75XoLrJlu4RmlMCvM6O8dl0GccAxqeju8gdcGNftn2/SOycIsQwxsxoRPc57gtaDIUNq6QqcMtgCrFnzcW3Mp4Vp6A==',key_name='tempest-keypair-576336985',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='548640fa718f4fdfa21c1a7783519c9f',ramdisk_id='',reservation_id='r-2fa6tit7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-83921126',owner_user_name='tempest-AttachVolumeShelveTestJSON-83921126-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:41:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='829b310c15b54dc7836d0b9d7fd757ed',uuid=3c3cce66-9d7a-4f23-a92a-d10b3efd5e86,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9", "address": "fa:16:3e:93:46:f1", "network": {"id": "e6ae8edc-7014-4341-91b2-4c82d72c9bb9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-15434410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548640fa718f4fdfa21c1a7783519c9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d891e1d-9d", "ovs_interfaceid": "8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 11:41:09 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Converting VIF {"id": "8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9", "address": "fa:16:3e:93:46:f1", "network": {"id": "e6ae8edc-7014-4341-91b2-4c82d72c9bb9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-15434410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548640fa718f4fdfa21c1a7783519c9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d891e1d-9d", "ovs_interfaceid": "8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:41:09 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:46:f1,bridge_name='br-int',has_traffic_filtering=True,id=8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9,network=Network(e6ae8edc-7014-4341-91b2-4c82d72c9bb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d891e1d-9d') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:41:09 user nova-compute[74190]: DEBUG os_vif [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:46:f1,bridge_name='br-int',has_traffic_filtering=True,id=8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9,network=Network(e6ae8edc-7014-4341-91b2-4c82d72c9bb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d891e1d-9d') {{(pid=74190) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 11:41:09 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:09 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:41:09 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 11:41:09 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:09 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '044b497e-8b10-5994-866b-86a33ec58905', '_type': 'linux-noop'}}, row=False) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:41:09 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:09 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:41:09 user sudo[83503]: pam_unix(sudo:session): session closed for user root
Oct 18 11:41:09 user nova-compute[74190]: INFO oslo.privsep.daemon [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Spawned new privsep daemon via rootwrap
Oct 18 11:41:09 user nova-compute[74190]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 18 11:41:09 user nova-compute[74190]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 18 11:41:09 user nova-compute[74190]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Oct 18 11:41:09 user nova-compute[74190]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83506
Oct 18 11:41:09 user nova-compute[74190]: WARNING oslo_privsep.priv_context [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] privsep daemon already running
Oct 18 11:41:09 user nova-compute[74190]: DEBUG nova.network.neutron [None req-9f9c40eb-6dbb-4f5f-9d58-c4bfad02ec86 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] Successfully updated port: 5e4eb783-7e7c-4501-bf99-33472454f4ac {{(pid=74190) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 11:41:09 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9f9c40eb-6dbb-4f5f-9d58-c4bfad02ec86 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Acquiring lock "refresh_cache-0209c824-88a7-4976-83bf-8a72437f0cc2" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:41:09 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9f9c40eb-6dbb-4f5f-9d58-c4bfad02ec86 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Acquired lock "refresh_cache-0209c824-88a7-4976-83bf-8a72437f0cc2" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:41:09 user nova-compute[74190]: DEBUG nova.network.neutron [None req-9f9c40eb-6dbb-4f5f-9d58-c4bfad02ec86 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] Building network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 11:41:09 user nova-compute[74190]: DEBUG nova.network.neutron [req-74d4fd73-8e1b-4b68-847b-173f29ee66cb req-df583fdc-61c9-4113-bc88-a659a7bd2f80 service nova] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Updated VIF entry in instance network info cache for port 8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 11:41:09 user nova-compute[74190]: DEBUG nova.network.neutron [req-74d4fd73-8e1b-4b68-847b-173f29ee66cb req-df583fdc-61c9-4113-bc88-a659a7bd2f80 service nova] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Updating instance_info_cache with network_info: [{"id": "8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9", "address": "fa:16:3e:93:46:f1", "network": {"id": "e6ae8edc-7014-4341-91b2-4c82d72c9bb9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-15434410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548640fa718f4fdfa21c1a7783519c9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d891e1d-9d", "ovs_interfaceid": "8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:41:09 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-74d4fd73-8e1b-4b68-847b-173f29ee66cb req-df583fdc-61c9-4113-bc88-a659a7bd2f80 service nova] Releasing lock "refresh_cache-3c3cce66-9d7a-4f23-a92a-d10b3efd5e86" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:41:10 user nova-compute[74190]: DEBUG nova.network.neutron [None req-9f9c40eb-6dbb-4f5f-9d58-c4bfad02ec86 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] Instance cache missing network info. {{(pid=74190) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 11:41:10 user nova-compute[74190]: DEBUG nova.compute.manager [req-51f2849f-971e-432d-8cdd-3dba21d15e03 req-063c1a56-dca5-419e-aaf0-7752f8e320ba service nova] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] Received event network-changed-5e4eb783-7e7c-4501-bf99-33472454f4ac {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:41:10 user nova-compute[74190]: DEBUG nova.compute.manager [req-51f2849f-971e-432d-8cdd-3dba21d15e03 req-063c1a56-dca5-419e-aaf0-7752f8e320ba service nova] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] Refreshing instance network info cache due to event network-changed-5e4eb783-7e7c-4501-bf99-33472454f4ac. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 11:41:10 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-51f2849f-971e-432d-8cdd-3dba21d15e03 req-063c1a56-dca5-419e-aaf0-7752f8e320ba service nova] Acquiring lock "refresh_cache-0209c824-88a7-4976-83bf-8a72437f0cc2" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:41:10 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:10 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap80b77e2d-aa, may_exist=True, interface_attrs={}) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:41:10 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap80b77e2d-aa, col_values=(('qos', UUID('5712a6ad-0364-40b8-89a5-f16b60d146fb')),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:41:10 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap80b77e2d-aa, col_values=(('external_ids', {'iface-id': '80b77e2d-aa04-4996-a0c1-713054affac4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:00:ce', 'vm-uuid': 'c280652c-ffde-40f8-a919-adb8be618db8'}),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:41:10 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:10 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:41:10 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:10 user nova-compute[74190]: INFO os_vif [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:00:ce,bridge_name='br-int',has_traffic_filtering=True,id=80b77e2d-aa04-4996-a0c1-713054affac4,network=Network(cf0a4705-3fff-4716-87ac-b0ca7700e11c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80b77e2d-aa')
Oct 18 11:41:10 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:10 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8d891e1d-9d, may_exist=True, interface_attrs={}) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:41:10 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8d891e1d-9d, col_values=(('qos', UUID('d6f4c2b3-d125-4eb3-9fe4-e221881093c4')),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:41:10 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8d891e1d-9d, col_values=(('external_ids', {'iface-id': '8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:93:46:f1', 'vm-uuid': '3c3cce66-9d7a-4f23-a92a-d10b3efd5e86'}),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:41:10 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:10 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:41:10 user nova-compute[74190]: INFO os_vif [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:46:f1,bridge_name='br-int',has_traffic_filtering=True,id=8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9,network=Network(e6ae8edc-7014-4341-91b2-4c82d72c9bb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d891e1d-9d')
Oct 18 11:41:10 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] No BDM found with device name vda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 11:41:10 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] No VIF found with MAC fa:16:3e:4f:00:ce, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 11:41:10 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] No BDM found with device name vda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 11:41:10 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] No VIF found with MAC fa:16:3e:93:46:f1, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 11:41:10 user nova-compute[74190]: DEBUG nova.network.neutron [None req-9f9c40eb-6dbb-4f5f-9d58-c4bfad02ec86 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] Updating instance_info_cache with network_info: [{"id": "5e4eb783-7e7c-4501-bf99-33472454f4ac", "address": "fa:16:3e:7e:d2:03", "network": {"id": "f5ab7da4-2b07-4465-9a89-a07eb053ba91", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1315695374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08cf52ce927443158aa731367f08bd57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e4eb783-7e", "ovs_interfaceid": "5e4eb783-7e7c-4501-bf99-33472454f4ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:41:10 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9f9c40eb-6dbb-4f5f-9d58-c4bfad02ec86 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Releasing lock "refresh_cache-0209c824-88a7-4976-83bf-8a72437f0cc2" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:41:10 user nova-compute[74190]: DEBUG nova.compute.manager [None req-9f9c40eb-6dbb-4f5f-9d58-c4bfad02ec86 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] Instance network_info: |[{"id": "5e4eb783-7e7c-4501-bf99-33472454f4ac", "address": "fa:16:3e:7e:d2:03", "network": {"id": "f5ab7da4-2b07-4465-9a89-a07eb053ba91", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1315695374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08cf52ce927443158aa731367f08bd57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e4eb783-7e", "ovs_interfaceid": "5e4eb783-7e7c-4501-bf99-33472454f4ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 11:41:10 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-51f2849f-971e-432d-8cdd-3dba21d15e03 req-063c1a56-dca5-419e-aaf0-7752f8e320ba service nova] Acquired lock "refresh_cache-0209c824-88a7-4976-83bf-8a72437f0cc2" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:41:10 user nova-compute[74190]: DEBUG nova.network.neutron [req-51f2849f-971e-432d-8cdd-3dba21d15e03 req-063c1a56-dca5-419e-aaf0-7752f8e320ba service nova] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] Refreshing network info cache for port 5e4eb783-7e7c-4501-bf99-33472454f4ac {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 11:41:10 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-9f9c40eb-6dbb-4f5f-9d58-c4bfad02ec86 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] Start _get_guest_xml network_info=[{"id": "5e4eb783-7e7c-4501-bf99-33472454f4ac", "address": "fa:16:3e:7e:d2:03", "network": {"id": "f5ab7da4-2b07-4465-9a89-a07eb053ba91", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1315695374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08cf52ce927443158aa731367f08bd57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e4eb783-7e", "ovs_interfaceid": "5e4eb783-7e7c-4501-bf99-33472454f4ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'image_id': '6e88bbf0-6e78-49a8-b3c5-9453d22a89df'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 11:41:10 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-9f9c40eb-6dbb-4f5f-9d58-c4bfad02ec86 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:41:10 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-9f9c40eb-6dbb-4f5f-9d58-c4bfad02ec86 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:41:10 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-9f9c40eb-6dbb-4f5f-9d58-c4bfad02ec86 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 11:41:10 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-9f9c40eb-6dbb-4f5f-9d58-c4bfad02ec86 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] CPU controller missing on host. {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 11:41:10 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-9f9c40eb-6dbb-4f5f-9d58-c4bfad02ec86 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 11:41:10 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-9f9c40eb-6dbb-4f5f-9d58-c4bfad02ec86 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] CPU controller found on host. {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 11:41:10 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-9f9c40eb-6dbb-4f5f-9d58-c4bfad02ec86 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74190) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 11:41:10 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-9f9c40eb-6dbb-4f5f-9d58-c4bfad02ec86 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T11:37:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 11:41:10 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-9f9c40eb-6dbb-4f5f-9d58-c4bfad02ec86 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Flavor limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 11:41:10 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-9f9c40eb-6dbb-4f5f-9d58-c4bfad02ec86 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Image limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 11:41:10 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-9f9c40eb-6dbb-4f5f-9d58-c4bfad02ec86 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Flavor pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 11:41:10 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-9f9c40eb-6dbb-4f5f-9d58-c4bfad02ec86 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Image pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 11:41:10 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-9f9c40eb-6dbb-4f5f-9d58-c4bfad02ec86 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 11:41:10 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-9f9c40eb-6dbb-4f5f-9d58-c4bfad02ec86 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 11:41:10 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-9f9c40eb-6dbb-4f5f-9d58-c4bfad02ec86 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 11:41:10 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-9f9c40eb-6dbb-4f5f-9d58-c4bfad02ec86 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Got 1 possible topologies {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 11:41:10 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-9f9c40eb-6dbb-4f5f-9d58-c4bfad02ec86 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 11:41:10 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-9f9c40eb-6dbb-4f5f-9d58-c4bfad02ec86 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 11:41:10 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-9f9c40eb-6dbb-4f5f-9d58-c4bfad02ec86 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:41:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1277453661',display_name='tempest-ServerActionsTestOtherA-server-1277453661',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1277453661',id=3,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOQBzNTv9LZg0yq/3lf4kmMEAFSSxHvdpQtvKWiUtvrhz9NgEirvm+N8Tqx31x38AF1/g3O4be21YeguWgKCS7N36Oy8ZZWxYYR46ATEkZPMIr3HhNKcU83cECzcDD++0g==',key_name='tempest-keypair-1511789347',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='08cf52ce927443158aa731367f08bd57',ramdisk_id='',reservation_id='r-4v08wavi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1288544694',owner_user_name='tempest-ServerActionsTestOtherA-1288544694-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:41:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b771e627a76b4540bf8de665df3d7787',uuid=0209c824-88a7-4976-83bf-8a72437f0cc2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5e4eb783-7e7c-4501-bf99-33472454f4ac", "address": "fa:16:3e:7e:d2:03", "network": {"id": "f5ab7da4-2b07-4465-9a89-a07eb053ba91", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1315695374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08cf52ce927443158aa731367f08bd57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e4eb783-7e", "ovs_interfaceid": "5e4eb783-7e7c-4501-bf99-33472454f4ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74190) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 11:41:10 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-9f9c40eb-6dbb-4f5f-9d58-c4bfad02ec86 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Converting VIF {"id": "5e4eb783-7e7c-4501-bf99-33472454f4ac", "address": "fa:16:3e:7e:d2:03", "network": {"id": "f5ab7da4-2b07-4465-9a89-a07eb053ba91", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1315695374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08cf52ce927443158aa731367f08bd57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e4eb783-7e", "ovs_interfaceid": "5e4eb783-7e7c-4501-bf99-33472454f4ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:41:10 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-9f9c40eb-6dbb-4f5f-9d58-c4bfad02ec86 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:d2:03,bridge_name='br-int',has_traffic_filtering=True,id=5e4eb783-7e7c-4501-bf99-33472454f4ac,network=Network(f5ab7da4-2b07-4465-9a89-a07eb053ba91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e4eb783-7e') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:41:10 user nova-compute[74190]: DEBUG nova.objects.instance [None req-9f9c40eb-6dbb-4f5f-9d58-c4bfad02ec86 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lazy-loading 'pci_devices' on Instance uuid 0209c824-88a7-4976-83bf-8a72437f0cc2 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:41:10 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-9f9c40eb-6dbb-4f5f-9d58-c4bfad02ec86 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] End _get_guest_xml xml=<domain type="kvm">
Oct 18 11:41:10 user nova-compute[74190]:   <uuid>0209c824-88a7-4976-83bf-8a72437f0cc2</uuid>
Oct 18 11:41:10 user nova-compute[74190]:   <name>instance-00000003</name>
Oct 18 11:41:10 user nova-compute[74190]:   <memory>524288</memory>
Oct 18 11:41:10 user nova-compute[74190]:   <vcpu>1</vcpu>
Oct 18 11:41:10 user nova-compute[74190]:   <metadata>
Oct 18 11:41:10 user nova-compute[74190]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 11:41:10 user nova-compute[74190]:       <nova:package version="0.0.0"/>
Oct 18 11:41:10 user nova-compute[74190]:       <nova:name>tempest-ServerActionsTestOtherA-server-1277453661</nova:name>
Oct 18 11:41:10 user nova-compute[74190]:       <nova:creationTime>2023-10-18 11:41:10</nova:creationTime>
Oct 18 11:41:10 user nova-compute[74190]:       <nova:flavor name="m1.tiny">
Oct 18 11:41:10 user nova-compute[74190]:         <nova:memory>512</nova:memory>
Oct 18 11:41:10 user nova-compute[74190]:         <nova:disk>1</nova:disk>
Oct 18 11:41:10 user nova-compute[74190]:         <nova:swap>0</nova:swap>
Oct 18 11:41:10 user nova-compute[74190]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 11:41:10 user nova-compute[74190]:         <nova:vcpus>1</nova:vcpus>
Oct 18 11:41:10 user nova-compute[74190]:       </nova:flavor>
Oct 18 11:41:10 user nova-compute[74190]:       <nova:owner>
Oct 18 11:41:10 user nova-compute[74190]:         <nova:user uuid="b771e627a76b4540bf8de665df3d7787">tempest-ServerActionsTestOtherA-1288544694-project-member</nova:user>
Oct 18 11:41:10 user nova-compute[74190]:         <nova:project uuid="08cf52ce927443158aa731367f08bd57">tempest-ServerActionsTestOtherA-1288544694</nova:project>
Oct 18 11:41:10 user nova-compute[74190]:       </nova:owner>
Oct 18 11:41:10 user nova-compute[74190]:       <nova:root type="image" uuid="6e88bbf0-6e78-49a8-b3c5-9453d22a89df"/>
Oct 18 11:41:10 user nova-compute[74190]:       <nova:ports>
Oct 18 11:41:10 user nova-compute[74190]:         <nova:port uuid="5e4eb783-7e7c-4501-bf99-33472454f4ac">
Oct 18 11:41:10 user nova-compute[74190]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 18 11:41:10 user nova-compute[74190]:         </nova:port>
Oct 18 11:41:10 user nova-compute[74190]:       </nova:ports>
Oct 18 11:41:10 user nova-compute[74190]:     </nova:instance>
Oct 18 11:41:10 user nova-compute[74190]:   </metadata>
Oct 18 11:41:10 user nova-compute[74190]:   <sysinfo type="smbios">
Oct 18 11:41:10 user nova-compute[74190]:     <system>
Oct 18 11:41:10 user nova-compute[74190]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 11:41:10 user nova-compute[74190]:       <entry name="product">OpenStack Nova</entry>
Oct 18 11:41:10 user nova-compute[74190]:       <entry name="version">0.0.0</entry>
Oct 18 11:41:10 user nova-compute[74190]:       <entry name="serial">0209c824-88a7-4976-83bf-8a72437f0cc2</entry>
Oct 18 11:41:10 user nova-compute[74190]:       <entry name="uuid">0209c824-88a7-4976-83bf-8a72437f0cc2</entry>
Oct 18 11:41:10 user nova-compute[74190]:       <entry name="family">Virtual Machine</entry>
Oct 18 11:41:10 user nova-compute[74190]:     </system>
Oct 18 11:41:10 user nova-compute[74190]:   </sysinfo>
Oct 18 11:41:10 user nova-compute[74190]:   <os>
Oct 18 11:41:10 user nova-compute[74190]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 11:41:10 user nova-compute[74190]:     <boot dev="hd"/>
Oct 18 11:41:10 user nova-compute[74190]:     <smbios mode="sysinfo"/>
Oct 18 11:41:10 user nova-compute[74190]:   </os>
Oct 18 11:41:10 user nova-compute[74190]:   <features>
Oct 18 11:41:10 user nova-compute[74190]:     <acpi/>
Oct 18 11:41:10 user nova-compute[74190]:     <apic/>
Oct 18 11:41:10 user nova-compute[74190]:     <vmcoreinfo/>
Oct 18 11:41:10 user nova-compute[74190]:   </features>
Oct 18 11:41:10 user nova-compute[74190]:   <clock offset="utc">
Oct 18 11:41:10 user nova-compute[74190]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 11:41:10 user nova-compute[74190]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 11:41:10 user nova-compute[74190]:     <timer name="hpet" present="no"/>
Oct 18 11:41:10 user nova-compute[74190]:   </clock>
Oct 18 11:41:10 user nova-compute[74190]:   <cpu mode="custom" match="exact">
Oct 18 11:41:10 user nova-compute[74190]:     <model>Nehalem</model>
Oct 18 11:41:10 user nova-compute[74190]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 11:41:10 user nova-compute[74190]:   </cpu>
Oct 18 11:41:10 user nova-compute[74190]:   <devices>
Oct 18 11:41:10 user nova-compute[74190]:     <disk type="file" device="disk">
Oct 18 11:41:10 user nova-compute[74190]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 11:41:10 user nova-compute[74190]:       <source file="/opt/stack/data/nova/instances/0209c824-88a7-4976-83bf-8a72437f0cc2/disk"/>
Oct 18 11:41:10 user nova-compute[74190]:       <target dev="vda" bus="virtio"/>
Oct 18 11:41:10 user nova-compute[74190]:     </disk>
Oct 18 11:41:10 user nova-compute[74190]:     <interface type="ethernet">
Oct 18 11:41:10 user nova-compute[74190]:       <mac address="fa:16:3e:7e:d2:03"/>
Oct 18 11:41:10 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:41:10 user nova-compute[74190]:       <mtu size="1442"/>
Oct 18 11:41:10 user nova-compute[74190]:       <target dev="tap5e4eb783-7e"/>
Oct 18 11:41:10 user nova-compute[74190]:     </interface>
Oct 18 11:41:10 user nova-compute[74190]:     <serial type="pty">
Oct 18 11:41:10 user nova-compute[74190]:       <log file="/opt/stack/data/nova/instances/0209c824-88a7-4976-83bf-8a72437f0cc2/console.log" append="off"/>
Oct 18 11:41:10 user nova-compute[74190]:     </serial>
Oct 18 11:41:10 user nova-compute[74190]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 11:41:10 user nova-compute[74190]:     <video>
Oct 18 11:41:10 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:41:10 user nova-compute[74190]:     </video>
Oct 18 11:41:10 user nova-compute[74190]:     <rng model="virtio">
Oct 18 11:41:10 user nova-compute[74190]:       <backend model="random">/dev/urandom</backend>
Oct 18 11:41:10 user nova-compute[74190]:     </rng>
Oct 18 11:41:10 user nova-compute[74190]:     <controller type="usb" index="0" model="none"/>
Oct 18 11:41:10 user nova-compute[74190]:     <memballoon model="virtio">
Oct 18 11:41:10 user nova-compute[74190]:       <stats period="10"/>
Oct 18 11:41:10 user nova-compute[74190]:     </memballoon>
Oct 18 11:41:10 user nova-compute[74190]:   </devices>
Oct 18 11:41:10 user nova-compute[74190]: </domain>
Oct 18 11:41:10 user nova-compute[74190]:  {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 11:41:10 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-9f9c40eb-6dbb-4f5f-9d58-c4bfad02ec86 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:41:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1277453661',display_name='tempest-ServerActionsTestOtherA-server-1277453661',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1277453661',id=3,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOQBzNTv9LZg0yq/3lf4kmMEAFSSxHvdpQtvKWiUtvrhz9NgEirvm+N8Tqx31x38AF1/g3O4be21YeguWgKCS7N36Oy8ZZWxYYR46ATEkZPMIr3HhNKcU83cECzcDD++0g==',key_name='tempest-keypair-1511789347',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='08cf52ce927443158aa731367f08bd57',ramdisk_id='',reservation_id='r-4v08wavi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1288544694',owner_user_name='tempest-ServerActionsTestOtherA-1288544694-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:41:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b771e627a76b4540bf8de665df3d7787',uuid=0209c824-88a7-4976-83bf-8a72437f0cc2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5e4eb783-7e7c-4501-bf99-33472454f4ac", "address": "fa:16:3e:7e:d2:03", "network": {"id": "f5ab7da4-2b07-4465-9a89-a07eb053ba91", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1315695374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08cf52ce927443158aa731367f08bd57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e4eb783-7e", "ovs_interfaceid": "5e4eb783-7e7c-4501-bf99-33472454f4ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 11:41:10 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-9f9c40eb-6dbb-4f5f-9d58-c4bfad02ec86 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Converting VIF {"id": "5e4eb783-7e7c-4501-bf99-33472454f4ac", "address": "fa:16:3e:7e:d2:03", "network": {"id": "f5ab7da4-2b07-4465-9a89-a07eb053ba91", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1315695374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08cf52ce927443158aa731367f08bd57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e4eb783-7e", "ovs_interfaceid": "5e4eb783-7e7c-4501-bf99-33472454f4ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:41:10 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-9f9c40eb-6dbb-4f5f-9d58-c4bfad02ec86 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:d2:03,bridge_name='br-int',has_traffic_filtering=True,id=5e4eb783-7e7c-4501-bf99-33472454f4ac,network=Network(f5ab7da4-2b07-4465-9a89-a07eb053ba91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e4eb783-7e') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:41:10 user nova-compute[74190]: DEBUG os_vif [None req-9f9c40eb-6dbb-4f5f-9d58-c4bfad02ec86 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:d2:03,bridge_name='br-int',has_traffic_filtering=True,id=5e4eb783-7e7c-4501-bf99-33472454f4ac,network=Network(f5ab7da4-2b07-4465-9a89-a07eb053ba91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e4eb783-7e') {{(pid=74190) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 11:41:10 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:10 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:41:10 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 11:41:10 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:10 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e3df2d56-1dd6-5928-967f-85f06b3110ef', '_type': 'linux-noop'}}, row=False) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:41:10 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:41:10 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:10 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:10 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5e4eb783-7e, may_exist=True, interface_attrs={}) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:41:10 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5e4eb783-7e, col_values=(('qos', UUID('eb536aea-f82d-4116-a481-c593038bc647')),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:41:10 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5e4eb783-7e, col_values=(('external_ids', {'iface-id': '5e4eb783-7e7c-4501-bf99-33472454f4ac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:d2:03', 'vm-uuid': '0209c824-88a7-4976-83bf-8a72437f0cc2'}),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:41:10 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:10 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:41:10 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:10 user nova-compute[74190]: INFO os_vif [None req-9f9c40eb-6dbb-4f5f-9d58-c4bfad02ec86 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:d2:03,bridge_name='br-int',has_traffic_filtering=True,id=5e4eb783-7e7c-4501-bf99-33472454f4ac,network=Network(f5ab7da4-2b07-4465-9a89-a07eb053ba91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e4eb783-7e')
Oct 18 11:41:10 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-9f9c40eb-6dbb-4f5f-9d58-c4bfad02ec86 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] No BDM found with device name vda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 11:41:10 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-9f9c40eb-6dbb-4f5f-9d58-c4bfad02ec86 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] No VIF found with MAC fa:16:3e:7e:d2:03, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 11:41:11 user nova-compute[74190]: DEBUG nova.network.neutron [req-51f2849f-971e-432d-8cdd-3dba21d15e03 req-063c1a56-dca5-419e-aaf0-7752f8e320ba service nova] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] Updated VIF entry in instance network info cache for port 5e4eb783-7e7c-4501-bf99-33472454f4ac. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 11:41:11 user nova-compute[74190]: DEBUG nova.network.neutron [req-51f2849f-971e-432d-8cdd-3dba21d15e03 req-063c1a56-dca5-419e-aaf0-7752f8e320ba service nova] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] Updating instance_info_cache with network_info: [{"id": "5e4eb783-7e7c-4501-bf99-33472454f4ac", "address": "fa:16:3e:7e:d2:03", "network": {"id": "f5ab7da4-2b07-4465-9a89-a07eb053ba91", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1315695374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08cf52ce927443158aa731367f08bd57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e4eb783-7e", "ovs_interfaceid": "5e4eb783-7e7c-4501-bf99-33472454f4ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:41:11 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-51f2849f-971e-432d-8cdd-3dba21d15e03 req-063c1a56-dca5-419e-aaf0-7752f8e320ba service nova] Releasing lock "refresh_cache-0209c824-88a7-4976-83bf-8a72437f0cc2" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:41:12 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:13 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:13 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:13 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:13 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:13 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:13 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:14 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:14 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:14 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:14 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:15 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:16 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:16 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:16 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:16 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:16 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-7d118461-bf7c-401b-9e5d-9e4841aa043c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Acquiring lock "c6130edd-eb98-491e-a0ba-6bd59199d9e1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:41:16 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-7d118461-bf7c-401b-9e5d-9e4841aa043c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Lock "c6130edd-eb98-491e-a0ba-6bd59199d9e1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:41:16 user nova-compute[74190]: DEBUG nova.compute.manager [None req-7d118461-bf7c-401b-9e5d-9e4841aa043c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] [instance: c6130edd-eb98-491e-a0ba-6bd59199d9e1] Starting instance... {{(pid=74190) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 11:41:16 user nova-compute[74190]: DEBUG nova.compute.manager [req-21379645-1255-44ae-bd67-7e3746b6f0f1 req-da07a1ab-9fd3-46ab-8f82-f70f8e7c52ac service nova] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Received event network-vif-plugged-80b77e2d-aa04-4996-a0c1-713054affac4 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:41:16 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-21379645-1255-44ae-bd67-7e3746b6f0f1 req-da07a1ab-9fd3-46ab-8f82-f70f8e7c52ac service nova] Acquiring lock "c280652c-ffde-40f8-a919-adb8be618db8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:41:16 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-21379645-1255-44ae-bd67-7e3746b6f0f1 req-da07a1ab-9fd3-46ab-8f82-f70f8e7c52ac service nova] Lock "c280652c-ffde-40f8-a919-adb8be618db8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:41:16 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-21379645-1255-44ae-bd67-7e3746b6f0f1 req-da07a1ab-9fd3-46ab-8f82-f70f8e7c52ac service nova] Lock "c280652c-ffde-40f8-a919-adb8be618db8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:41:16 user nova-compute[74190]: DEBUG nova.compute.manager [req-21379645-1255-44ae-bd67-7e3746b6f0f1 req-da07a1ab-9fd3-46ab-8f82-f70f8e7c52ac service nova] [instance: c280652c-ffde-40f8-a919-adb8be618db8] No waiting events found dispatching network-vif-plugged-80b77e2d-aa04-4996-a0c1-713054affac4 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:41:16 user nova-compute[74190]: WARNING nova.compute.manager [req-21379645-1255-44ae-bd67-7e3746b6f0f1 req-da07a1ab-9fd3-46ab-8f82-f70f8e7c52ac service nova] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Received unexpected event network-vif-plugged-80b77e2d-aa04-4996-a0c1-713054affac4 for instance with vm_state building and task_state spawning.
Oct 18 11:41:16 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-7d118461-bf7c-401b-9e5d-9e4841aa043c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:41:16 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-7d118461-bf7c-401b-9e5d-9e4841aa043c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:41:16 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-7d118461-bf7c-401b-9e5d-9e4841aa043c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74190) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 11:41:16 user nova-compute[74190]: INFO nova.compute.claims [None req-7d118461-bf7c-401b-9e5d-9e4841aa043c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] [instance: c6130edd-eb98-491e-a0ba-6bd59199d9e1] Claim successful on node user
Oct 18 11:41:17 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-7d118461-bf7c-401b-9e5d-9e4841aa043c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 11:41:17 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-7d118461-bf7c-401b-9e5d-9e4841aa043c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 11:41:17 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-7d118461-bf7c-401b-9e5d-9e4841aa043c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.491s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:41:17 user nova-compute[74190]: DEBUG nova.compute.manager [None req-7d118461-bf7c-401b-9e5d-9e4841aa043c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] [instance: c6130edd-eb98-491e-a0ba-6bd59199d9e1] Start building networks asynchronously for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 11:41:17 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Acquiring lock "6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:41:17 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Lock "6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:41:17 user nova-compute[74190]: DEBUG nova.compute.manager [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] Starting instance... {{(pid=74190) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 11:41:17 user nova-compute[74190]: DEBUG nova.compute.manager [None req-7d118461-bf7c-401b-9e5d-9e4841aa043c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] [instance: c6130edd-eb98-491e-a0ba-6bd59199d9e1] Allocating IP information in the background. {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 11:41:17 user nova-compute[74190]: DEBUG nova.network.neutron [None req-7d118461-bf7c-401b-9e5d-9e4841aa043c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] [instance: c6130edd-eb98-491e-a0ba-6bd59199d9e1] allocate_for_instance() {{(pid=74190) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 11:41:17 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-7d118461-bf7c-401b-9e5d-9e4841aa043c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] [instance: c6130edd-eb98-491e-a0ba-6bd59199d9e1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 11:41:17 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:17 user nova-compute[74190]: DEBUG nova.compute.manager [None req-7d118461-bf7c-401b-9e5d-9e4841aa043c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] [instance: c6130edd-eb98-491e-a0ba-6bd59199d9e1] Start building block device mappings for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 11:41:17 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:41:17 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:41:17 user nova-compute[74190]: DEBUG nova.policy [None req-7d118461-bf7c-401b-9e5d-9e4841aa043c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4c68a9cb13814419a38413f9513d5a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d83064382624b4d895b0d7bff463f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74190) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 11:41:17 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74190) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 11:41:17 user nova-compute[74190]: INFO nova.compute.claims [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] Claim successful on node user
Oct 18 11:41:17 user nova-compute[74190]: DEBUG nova.compute.manager [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Instance event wait completed in 0 seconds for  {{(pid=74190) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 11:41:17 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Guest created on hypervisor {{(pid=74190) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 11:41:17 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Instance spawned successfully.
Oct 18 11:41:17 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 11:41:17 user nova-compute[74190]: DEBUG nova.compute.manager [None req-7d118461-bf7c-401b-9e5d-9e4841aa043c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] [instance: c6130edd-eb98-491e-a0ba-6bd59199d9e1] Start spawning the instance on the hypervisor. {{(pid=74190) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 11:41:17 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-7d118461-bf7c-401b-9e5d-9e4841aa043c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] [instance: c6130edd-eb98-491e-a0ba-6bd59199d9e1] Creating instance directory {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 11:41:17 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-7d118461-bf7c-401b-9e5d-9e4841aa043c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] [instance: c6130edd-eb98-491e-a0ba-6bd59199d9e1] Creating image(s)
Oct 18 11:41:17 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-7d118461-bf7c-401b-9e5d-9e4841aa043c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Acquiring lock "/opt/stack/data/nova/instances/c6130edd-eb98-491e-a0ba-6bd59199d9e1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:41:17 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-7d118461-bf7c-401b-9e5d-9e4841aa043c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Lock "/opt/stack/data/nova/instances/c6130edd-eb98-491e-a0ba-6bd59199d9e1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:41:17 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-7d118461-bf7c-401b-9e5d-9e4841aa043c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Lock "/opt/stack/data/nova/instances/c6130edd-eb98-491e-a0ba-6bd59199d9e1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:41:17 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-7d118461-bf7c-401b-9e5d-9e4841aa043c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:41:17 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Found default for hw_cdrom_bus of ide {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:41:17 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Found default for hw_disk_bus of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:41:17 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Found default for hw_input_bus of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:41:17 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Found default for hw_pointer_model of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:41:17 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Found default for hw_video_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:41:17 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Found default for hw_vif_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:41:17 user nova-compute[74190]: INFO nova.compute.manager [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Took 15.92 seconds to spawn the instance on the hypervisor.
Oct 18 11:41:17 user nova-compute[74190]: DEBUG nova.compute.manager [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Checking state {{(pid=74190) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 11:41:17 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-7d118461-bf7c-401b-9e5d-9e4841aa043c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.282s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:41:17 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-7d118461-bf7c-401b-9e5d-9e4841aa043c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Acquiring lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:41:17 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-7d118461-bf7c-401b-9e5d-9e4841aa043c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:41:17 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-7d118461-bf7c-401b-9e5d-9e4841aa043c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:41:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-7d118461-bf7c-401b-9e5d-9e4841aa043c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.360s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:41:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-7d118461-bf7c-401b-9e5d-9e4841aa043c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f,backing_fmt=raw /opt/stack/data/nova/instances/c6130edd-eb98-491e-a0ba-6bd59199d9e1/disk 1073741824 {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:41:18 user nova-compute[74190]: INFO nova.compute.manager [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Took 17.28 seconds to build instance.
Oct 18 11:41:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-7d118461-bf7c-401b-9e5d-9e4841aa043c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f,backing_fmt=raw /opt/stack/data/nova/instances/c6130edd-eb98-491e-a0ba-6bd59199d9e1/disk 1073741824" returned: 0 in 0.088s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:41:18 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-7d118461-bf7c-401b-9e5d-9e4841aa043c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.457s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:41:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-7d118461-bf7c-401b-9e5d-9e4841aa043c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:41:18 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 11:41:18 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-7e7f2761-a7fa-4b92-b208-4e31b71c1c3b tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lock "c280652c-ffde-40f8-a919-adb8be618db8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.774s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:41:18 user nova-compute[74190]: DEBUG nova.compute.manager [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Instance event wait completed in 0 seconds for  {{(pid=74190) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 11:41:18 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Guest created on hypervisor {{(pid=74190) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 11:41:18 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 11:41:18 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Instance spawned successfully.
Oct 18 11:41:18 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 11:41:18 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Found default for hw_cdrom_bus of ide {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:41:18 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Found default for hw_disk_bus of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:41:18 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Found default for hw_input_bus of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:41:18 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Found default for hw_pointer_model of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:41:18 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Found default for hw_video_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:41:18 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Found default for hw_vif_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:41:18 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.122s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:41:18 user nova-compute[74190]: DEBUG nova.compute.manager [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] Start building networks asynchronously for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 11:41:18 user nova-compute[74190]: DEBUG nova.compute.manager [None req-9f9c40eb-6dbb-4f5f-9d58-c4bfad02ec86 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] Instance event wait completed in 0 seconds for  {{(pid=74190) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 11:41:18 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-9f9c40eb-6dbb-4f5f-9d58-c4bfad02ec86 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] Guest created on hypervisor {{(pid=74190) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 11:41:18 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] Instance spawned successfully.
Oct 18 11:41:18 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-9f9c40eb-6dbb-4f5f-9d58-c4bfad02ec86 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 11:41:18 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-9f9c40eb-6dbb-4f5f-9d58-c4bfad02ec86 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] Found default for hw_cdrom_bus of ide {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:41:18 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-9f9c40eb-6dbb-4f5f-9d58-c4bfad02ec86 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] Found default for hw_disk_bus of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:41:18 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-9f9c40eb-6dbb-4f5f-9d58-c4bfad02ec86 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] Found default for hw_input_bus of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:41:18 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-9f9c40eb-6dbb-4f5f-9d58-c4bfad02ec86 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] Found default for hw_pointer_model of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:41:18 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-9f9c40eb-6dbb-4f5f-9d58-c4bfad02ec86 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] Found default for hw_video_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:41:18 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-9f9c40eb-6dbb-4f5f-9d58-c4bfad02ec86 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] Found default for hw_vif_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:41:18 user nova-compute[74190]: DEBUG nova.network.neutron [None req-7d118461-bf7c-401b-9e5d-9e4841aa043c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] [instance: c6130edd-eb98-491e-a0ba-6bd59199d9e1] Successfully created port: bd84fceb-8a04-45a0-8f05-7bc856ed1a36 {{(pid=74190) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 11:41:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-7d118461-bf7c-401b-9e5d-9e4841aa043c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.279s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:41:18 user nova-compute[74190]: DEBUG nova.virt.disk.api [None req-7d118461-bf7c-401b-9e5d-9e4841aa043c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c6130edd-eb98-491e-a0ba-6bd59199d9e1/disk. size=1073741824 {{(pid=74190) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 18 11:41:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-7d118461-bf7c-401b-9e5d-9e4841aa043c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6130edd-eb98-491e-a0ba-6bd59199d9e1/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:41:18 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:18 user nova-compute[74190]: DEBUG nova.compute.manager [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] Allocating IP information in the background. {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 11:41:18 user nova-compute[74190]: DEBUG nova.network.neutron [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] allocate_for_instance() {{(pid=74190) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 11:41:18 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 11:41:18 user nova-compute[74190]: DEBUG nova.compute.manager [req-41bb7215-e0e9-4ba6-9c99-e5759d0929db req-99e9da0b-47f6-4dc3-8860-96bc81c60171 service nova] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Received event network-vif-plugged-80b77e2d-aa04-4996-a0c1-713054affac4 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:41:18 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-41bb7215-e0e9-4ba6-9c99-e5759d0929db req-99e9da0b-47f6-4dc3-8860-96bc81c60171 service nova] Acquiring lock "c280652c-ffde-40f8-a919-adb8be618db8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:41:18 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-41bb7215-e0e9-4ba6-9c99-e5759d0929db req-99e9da0b-47f6-4dc3-8860-96bc81c60171 service nova] Lock "c280652c-ffde-40f8-a919-adb8be618db8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:41:18 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-41bb7215-e0e9-4ba6-9c99-e5759d0929db req-99e9da0b-47f6-4dc3-8860-96bc81c60171 service nova] Lock "c280652c-ffde-40f8-a919-adb8be618db8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:41:18 user nova-compute[74190]: DEBUG nova.compute.manager [req-41bb7215-e0e9-4ba6-9c99-e5759d0929db req-99e9da0b-47f6-4dc3-8860-96bc81c60171 service nova] [instance: c280652c-ffde-40f8-a919-adb8be618db8] No waiting events found dispatching network-vif-plugged-80b77e2d-aa04-4996-a0c1-713054affac4 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:41:18 user nova-compute[74190]: WARNING nova.compute.manager [req-41bb7215-e0e9-4ba6-9c99-e5759d0929db req-99e9da0b-47f6-4dc3-8860-96bc81c60171 service nova] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Received unexpected event network-vif-plugged-80b77e2d-aa04-4996-a0c1-713054affac4 for instance with vm_state active and task_state None.
Oct 18 11:41:18 user nova-compute[74190]: INFO nova.compute.manager [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Took 15.49 seconds to spawn the instance on the hypervisor.
Oct 18 11:41:18 user nova-compute[74190]: DEBUG nova.compute.manager [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Checking state {{(pid=74190) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 11:41:18 user nova-compute[74190]: DEBUG nova.compute.manager [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] Start building block device mappings for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 11:41:18 user nova-compute[74190]: INFO nova.compute.manager [None req-9f9c40eb-6dbb-4f5f-9d58-c4bfad02ec86 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] Took 12.13 seconds to spawn the instance on the hypervisor.
Oct 18 11:41:18 user nova-compute[74190]: DEBUG nova.compute.manager [None req-9f9c40eb-6dbb-4f5f-9d58-c4bfad02ec86 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] Checking state {{(pid=74190) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 11:41:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-7d118461-bf7c-401b-9e5d-9e4841aa043c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6130edd-eb98-491e-a0ba-6bd59199d9e1/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:41:18 user nova-compute[74190]: DEBUG nova.virt.disk.api [None req-7d118461-bf7c-401b-9e5d-9e4841aa043c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Cannot resize image /opt/stack/data/nova/instances/c6130edd-eb98-491e-a0ba-6bd59199d9e1/disk to a smaller size. {{(pid=74190) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 18 11:41:18 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-7d118461-bf7c-401b-9e5d-9e4841aa043c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] [instance: c6130edd-eb98-491e-a0ba-6bd59199d9e1] Created local disks {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 11:41:18 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-7d118461-bf7c-401b-9e5d-9e4841aa043c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] [instance: c6130edd-eb98-491e-a0ba-6bd59199d9e1] Ensure instance console log exists: /opt/stack/data/nova/instances/c6130edd-eb98-491e-a0ba-6bd59199d9e1/console.log {{(pid=74190) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 11:41:18 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-7d118461-bf7c-401b-9e5d-9e4841aa043c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:41:18 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-7d118461-bf7c-401b-9e5d-9e4841aa043c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:41:18 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-7d118461-bf7c-401b-9e5d-9e4841aa043c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:41:19 user nova-compute[74190]: DEBUG nova.policy [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a587bc7358fe4d289926428f94766374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72f55b03dea844739b3e36d4f73b23e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74190) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 11:41:19 user nova-compute[74190]: INFO nova.compute.manager [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Took 16.79 seconds to build instance.
Oct 18 11:41:19 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-6a39ba79-cb21-4f85-9f22-6c6051c3782b tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Lock "3c3cce66-9d7a-4f23-a92a-d10b3efd5e86" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.959s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:41:19 user nova-compute[74190]: INFO nova.compute.manager [None req-9f9c40eb-6dbb-4f5f-9d58-c4bfad02ec86 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] Took 13.09 seconds to build instance.
Oct 18 11:41:19 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9f9c40eb-6dbb-4f5f-9d58-c4bfad02ec86 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lock "0209c824-88a7-4976-83bf-8a72437f0cc2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.347s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:41:19 user nova-compute[74190]: DEBUG nova.compute.manager [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] Start spawning the instance on the hypervisor. {{(pid=74190) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 11:41:19 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] Creating instance directory {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 11:41:19 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] Creating image(s)
Oct 18 11:41:19 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Acquiring lock "/opt/stack/data/nova/instances/6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:41:19 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Lock "/opt/stack/data/nova/instances/6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:41:19 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Lock "/opt/stack/data/nova/instances/6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:41:19 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:41:19 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.303s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:41:19 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Acquiring lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:41:19 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:41:19 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:41:19 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.331s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:41:19 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f,backing_fmt=raw /opt/stack/data/nova/instances/6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef/disk 1073741824 {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:41:19 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f,backing_fmt=raw /opt/stack/data/nova/instances/6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef/disk 1073741824" returned: 0 in 0.106s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:41:19 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.456s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:41:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:41:20 user nova-compute[74190]: DEBUG nova.network.neutron [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] Successfully created port: 2f3b8cfe-f9f2-4dc5-b368-f67ef363266c {{(pid=74190) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 11:41:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.238s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:41:20 user nova-compute[74190]: DEBUG nova.virt.disk.api [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef/disk. size=1073741824 {{(pid=74190) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 18 11:41:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:41:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:41:20 user nova-compute[74190]: DEBUG nova.virt.disk.api [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Cannot resize image /opt/stack/data/nova/instances/6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef/disk to a smaller size. {{(pid=74190) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 18 11:41:20 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] Created local disks {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 11:41:20 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] Ensure instance console log exists: /opt/stack/data/nova/instances/6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef/console.log {{(pid=74190) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 11:41:20 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:41:20 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:41:20 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:41:20 user nova-compute[74190]: DEBUG nova.network.neutron [None req-7d118461-bf7c-401b-9e5d-9e4841aa043c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] [instance: c6130edd-eb98-491e-a0ba-6bd59199d9e1] Successfully updated port: bd84fceb-8a04-45a0-8f05-7bc856ed1a36 {{(pid=74190) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 11:41:20 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-7d118461-bf7c-401b-9e5d-9e4841aa043c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Acquiring lock "refresh_cache-c6130edd-eb98-491e-a0ba-6bd59199d9e1" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:41:20 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-7d118461-bf7c-401b-9e5d-9e4841aa043c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Acquired lock "refresh_cache-c6130edd-eb98-491e-a0ba-6bd59199d9e1" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:41:20 user nova-compute[74190]: DEBUG nova.network.neutron [None req-7d118461-bf7c-401b-9e5d-9e4841aa043c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] [instance: c6130edd-eb98-491e-a0ba-6bd59199d9e1] Building network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 11:41:20 user nova-compute[74190]: DEBUG nova.compute.manager [req-b88dab97-1df3-4284-b8d0-4f8afa3ccfe6 req-2e435fac-7612-472f-a740-917f1c677c14 service nova] [instance: c6130edd-eb98-491e-a0ba-6bd59199d9e1] Received event network-changed-bd84fceb-8a04-45a0-8f05-7bc856ed1a36 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:41:20 user nova-compute[74190]: DEBUG nova.compute.manager [req-b88dab97-1df3-4284-b8d0-4f8afa3ccfe6 req-2e435fac-7612-472f-a740-917f1c677c14 service nova] [instance: c6130edd-eb98-491e-a0ba-6bd59199d9e1] Refreshing instance network info cache due to event network-changed-bd84fceb-8a04-45a0-8f05-7bc856ed1a36. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 11:41:20 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-b88dab97-1df3-4284-b8d0-4f8afa3ccfe6 req-2e435fac-7612-472f-a740-917f1c677c14 service nova] Acquiring lock "refresh_cache-c6130edd-eb98-491e-a0ba-6bd59199d9e1" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:41:20 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:21 user nova-compute[74190]: DEBUG nova.network.neutron [None req-7d118461-bf7c-401b-9e5d-9e4841aa043c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] [instance: c6130edd-eb98-491e-a0ba-6bd59199d9e1] Instance cache missing network info. {{(pid=74190) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 11:41:21 user nova-compute[74190]: DEBUG nova.network.neutron [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] Successfully updated port: 2f3b8cfe-f9f2-4dc5-b368-f67ef363266c {{(pid=74190) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 11:41:21 user nova-compute[74190]: DEBUG nova.compute.manager [req-1e0c245c-a6aa-440a-8ed9-f1c5c5c5d0cd req-1fa726f7-755f-4834-9afe-b82362c30680 service nova] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] Received event network-changed-2f3b8cfe-f9f2-4dc5-b368-f67ef363266c {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:41:21 user nova-compute[74190]: DEBUG nova.compute.manager [req-1e0c245c-a6aa-440a-8ed9-f1c5c5c5d0cd req-1fa726f7-755f-4834-9afe-b82362c30680 service nova] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] Refreshing instance network info cache due to event network-changed-2f3b8cfe-f9f2-4dc5-b368-f67ef363266c. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 11:41:21 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-1e0c245c-a6aa-440a-8ed9-f1c5c5c5d0cd req-1fa726f7-755f-4834-9afe-b82362c30680 service nova] Acquiring lock "refresh_cache-6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:41:21 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-1e0c245c-a6aa-440a-8ed9-f1c5c5c5d0cd req-1fa726f7-755f-4834-9afe-b82362c30680 service nova] Acquired lock "refresh_cache-6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:41:21 user nova-compute[74190]: DEBUG nova.network.neutron [req-1e0c245c-a6aa-440a-8ed9-f1c5c5c5d0cd req-1fa726f7-755f-4834-9afe-b82362c30680 service nova] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] Refreshing network info cache for port 2f3b8cfe-f9f2-4dc5-b368-f67ef363266c {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 11:41:21 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Acquiring lock "refresh_cache-6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:41:21 user nova-compute[74190]: DEBUG nova.network.neutron [None req-7d118461-bf7c-401b-9e5d-9e4841aa043c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] [instance: c6130edd-eb98-491e-a0ba-6bd59199d9e1] Updating instance_info_cache with network_info: [{"id": "bd84fceb-8a04-45a0-8f05-7bc856ed1a36", "address": "fa:16:3e:ee:96:5d", "network": {"id": "c174814d-6217-4201-9af1-1575a8dcf751", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-981245321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d83064382624b4d895b0d7bff463f4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd84fceb-8a", "ovs_interfaceid": "bd84fceb-8a04-45a0-8f05-7bc856ed1a36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:41:21 user nova-compute[74190]: DEBUG nova.network.neutron [req-1e0c245c-a6aa-440a-8ed9-f1c5c5c5d0cd req-1fa726f7-755f-4834-9afe-b82362c30680 service nova] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] Instance cache missing network info. {{(pid=74190) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 11:41:21 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-7d118461-bf7c-401b-9e5d-9e4841aa043c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Releasing lock "refresh_cache-c6130edd-eb98-491e-a0ba-6bd59199d9e1" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:41:21 user nova-compute[74190]: DEBUG nova.compute.manager [None req-7d118461-bf7c-401b-9e5d-9e4841aa043c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] [instance: c6130edd-eb98-491e-a0ba-6bd59199d9e1] Instance network_info: |[{"id": "bd84fceb-8a04-45a0-8f05-7bc856ed1a36", "address": "fa:16:3e:ee:96:5d", "network": {"id": "c174814d-6217-4201-9af1-1575a8dcf751", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-981245321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d83064382624b4d895b0d7bff463f4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd84fceb-8a", "ovs_interfaceid": "bd84fceb-8a04-45a0-8f05-7bc856ed1a36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 11:41:21 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-b88dab97-1df3-4284-b8d0-4f8afa3ccfe6 req-2e435fac-7612-472f-a740-917f1c677c14 service nova] Acquired lock "refresh_cache-c6130edd-eb98-491e-a0ba-6bd59199d9e1" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:41:21 user nova-compute[74190]: DEBUG nova.network.neutron [req-b88dab97-1df3-4284-b8d0-4f8afa3ccfe6 req-2e435fac-7612-472f-a740-917f1c677c14 service nova] [instance: c6130edd-eb98-491e-a0ba-6bd59199d9e1] Refreshing network info cache for port bd84fceb-8a04-45a0-8f05-7bc856ed1a36 {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 11:41:21 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-7d118461-bf7c-401b-9e5d-9e4841aa043c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] [instance: c6130edd-eb98-491e-a0ba-6bd59199d9e1] Start _get_guest_xml network_info=[{"id": "bd84fceb-8a04-45a0-8f05-7bc856ed1a36", "address": "fa:16:3e:ee:96:5d", "network": {"id": "c174814d-6217-4201-9af1-1575a8dcf751", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-981245321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d83064382624b4d895b0d7bff463f4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd84fceb-8a", "ovs_interfaceid": "bd84fceb-8a04-45a0-8f05-7bc856ed1a36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'image_id': '6e88bbf0-6e78-49a8-b3c5-9453d22a89df'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 11:41:21 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-7d118461-bf7c-401b-9e5d-9e4841aa043c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:41:21 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-7d118461-bf7c-401b-9e5d-9e4841aa043c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:41:21 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-7d118461-bf7c-401b-9e5d-9e4841aa043c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 11:41:21 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-7d118461-bf7c-401b-9e5d-9e4841aa043c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] CPU controller missing on host. {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 11:41:21 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-7d118461-bf7c-401b-9e5d-9e4841aa043c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 11:41:21 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-7d118461-bf7c-401b-9e5d-9e4841aa043c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] CPU controller found on host. {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 11:41:21 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-7d118461-bf7c-401b-9e5d-9e4841aa043c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74190) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 11:41:21 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-7d118461-bf7c-401b-9e5d-9e4841aa043c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T11:37:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 11:41:21 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-7d118461-bf7c-401b-9e5d-9e4841aa043c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Flavor limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 11:41:21 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-7d118461-bf7c-401b-9e5d-9e4841aa043c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Image limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 11:41:21 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-7d118461-bf7c-401b-9e5d-9e4841aa043c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Flavor pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 11:41:21 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-7d118461-bf7c-401b-9e5d-9e4841aa043c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Image pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 11:41:21 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-7d118461-bf7c-401b-9e5d-9e4841aa043c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 11:41:21 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-7d118461-bf7c-401b-9e5d-9e4841aa043c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 11:41:21 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-7d118461-bf7c-401b-9e5d-9e4841aa043c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 11:41:21 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-7d118461-bf7c-401b-9e5d-9e4841aa043c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Got 1 possible topologies {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 11:41:21 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-7d118461-bf7c-401b-9e5d-9e4841aa043c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 11:41:21 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-7d118461-bf7c-401b-9e5d-9e4841aa043c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 11:41:21 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-7d118461-bf7c-401b-9e5d-9e4841aa043c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:41:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2004469902',display_name='tempest-VolumesAdminNegativeTest-server-2004469902',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2004469902',id=4,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHSK4yZJ9nvU8rHQ1gwT+VM8d6Vhd755AOGrYLvTCGOs3cERsYjXJirr8z9QBzq5SLgzv50feVjknIasSnvucp7cLhZ4vJwgB+R1ic6JFgTICtrO0wwd+zbXWTuu7x+IoA==',key_name='tempest-keypair-1017531913',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d83064382624b4d895b0d7bff463f4f',ramdisk_id='',reservation_id='r-9mdzy0a8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1125052526',owner_user_name='tempest-VolumesAdminNegativeTest-1125052526-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:41:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c68a9cb13814419a38413f9513d5a80',uuid=c6130edd-eb98-491e-a0ba-6bd59199d9e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd84fceb-8a04-45a0-8f05-7bc856ed1a36", "address": "fa:16:3e:ee:96:5d", "network": {"id": "c174814d-6217-4201-9af1-1575a8dcf751", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-981245321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d83064382624b4d895b0d7bff463f4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd84fceb-8a", "ovs_interfaceid": "bd84fceb-8a04-45a0-8f05-7bc856ed1a36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74190) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 11:41:21 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-7d118461-bf7c-401b-9e5d-9e4841aa043c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Converting VIF {"id": "bd84fceb-8a04-45a0-8f05-7bc856ed1a36", "address": "fa:16:3e:ee:96:5d", "network": {"id": "c174814d-6217-4201-9af1-1575a8dcf751", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-981245321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d83064382624b4d895b0d7bff463f4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd84fceb-8a", "ovs_interfaceid": "bd84fceb-8a04-45a0-8f05-7bc856ed1a36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:41:21 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-7d118461-bf7c-401b-9e5d-9e4841aa043c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:96:5d,bridge_name='br-int',has_traffic_filtering=True,id=bd84fceb-8a04-45a0-8f05-7bc856ed1a36,network=Network(c174814d-6217-4201-9af1-1575a8dcf751),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd84fceb-8a') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:41:21 user nova-compute[74190]: DEBUG nova.objects.instance [None req-7d118461-bf7c-401b-9e5d-9e4841aa043c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Lazy-loading 'pci_devices' on Instance uuid c6130edd-eb98-491e-a0ba-6bd59199d9e1 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:41:21 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:21 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-7d118461-bf7c-401b-9e5d-9e4841aa043c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] [instance: c6130edd-eb98-491e-a0ba-6bd59199d9e1] End _get_guest_xml xml=<domain type="kvm">
Oct 18 11:41:21 user nova-compute[74190]:   <uuid>c6130edd-eb98-491e-a0ba-6bd59199d9e1</uuid>
Oct 18 11:41:21 user nova-compute[74190]:   <name>instance-00000004</name>
Oct 18 11:41:21 user nova-compute[74190]:   <memory>524288</memory>
Oct 18 11:41:21 user nova-compute[74190]:   <vcpu>1</vcpu>
Oct 18 11:41:21 user nova-compute[74190]:   <metadata>
Oct 18 11:41:21 user nova-compute[74190]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 11:41:21 user nova-compute[74190]:       <nova:package version="0.0.0"/>
Oct 18 11:41:21 user nova-compute[74190]:       <nova:name>tempest-VolumesAdminNegativeTest-server-2004469902</nova:name>
Oct 18 11:41:21 user nova-compute[74190]:       <nova:creationTime>2023-10-18 11:41:21</nova:creationTime>
Oct 18 11:41:21 user nova-compute[74190]:       <nova:flavor name="m1.tiny">
Oct 18 11:41:21 user nova-compute[74190]:         <nova:memory>512</nova:memory>
Oct 18 11:41:21 user nova-compute[74190]:         <nova:disk>1</nova:disk>
Oct 18 11:41:21 user nova-compute[74190]:         <nova:swap>0</nova:swap>
Oct 18 11:41:21 user nova-compute[74190]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 11:41:21 user nova-compute[74190]:         <nova:vcpus>1</nova:vcpus>
Oct 18 11:41:21 user nova-compute[74190]:       </nova:flavor>
Oct 18 11:41:21 user nova-compute[74190]:       <nova:owner>
Oct 18 11:41:21 user nova-compute[74190]:         <nova:user uuid="4c68a9cb13814419a38413f9513d5a80">tempest-VolumesAdminNegativeTest-1125052526-project-member</nova:user>
Oct 18 11:41:21 user nova-compute[74190]:         <nova:project uuid="6d83064382624b4d895b0d7bff463f4f">tempest-VolumesAdminNegativeTest-1125052526</nova:project>
Oct 18 11:41:21 user nova-compute[74190]:       </nova:owner>
Oct 18 11:41:21 user nova-compute[74190]:       <nova:root type="image" uuid="6e88bbf0-6e78-49a8-b3c5-9453d22a89df"/>
Oct 18 11:41:21 user nova-compute[74190]:       <nova:ports>
Oct 18 11:41:21 user nova-compute[74190]:         <nova:port uuid="bd84fceb-8a04-45a0-8f05-7bc856ed1a36">
Oct 18 11:41:21 user nova-compute[74190]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 18 11:41:21 user nova-compute[74190]:         </nova:port>
Oct 18 11:41:21 user nova-compute[74190]:       </nova:ports>
Oct 18 11:41:21 user nova-compute[74190]:     </nova:instance>
Oct 18 11:41:21 user nova-compute[74190]:   </metadata>
Oct 18 11:41:21 user nova-compute[74190]:   <sysinfo type="smbios">
Oct 18 11:41:21 user nova-compute[74190]:     <system>
Oct 18 11:41:21 user nova-compute[74190]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 11:41:21 user nova-compute[74190]:       <entry name="product">OpenStack Nova</entry>
Oct 18 11:41:21 user nova-compute[74190]:       <entry name="version">0.0.0</entry>
Oct 18 11:41:21 user nova-compute[74190]:       <entry name="serial">c6130edd-eb98-491e-a0ba-6bd59199d9e1</entry>
Oct 18 11:41:21 user nova-compute[74190]:       <entry name="uuid">c6130edd-eb98-491e-a0ba-6bd59199d9e1</entry>
Oct 18 11:41:21 user nova-compute[74190]:       <entry name="family">Virtual Machine</entry>
Oct 18 11:41:21 user nova-compute[74190]:     </system>
Oct 18 11:41:21 user nova-compute[74190]:   </sysinfo>
Oct 18 11:41:21 user nova-compute[74190]:   <os>
Oct 18 11:41:21 user nova-compute[74190]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 11:41:21 user nova-compute[74190]:     <boot dev="hd"/>
Oct 18 11:41:21 user nova-compute[74190]:     <smbios mode="sysinfo"/>
Oct 18 11:41:21 user nova-compute[74190]:   </os>
Oct 18 11:41:21 user nova-compute[74190]:   <features>
Oct 18 11:41:21 user nova-compute[74190]:     <acpi/>
Oct 18 11:41:21 user nova-compute[74190]:     <apic/>
Oct 18 11:41:21 user nova-compute[74190]:     <vmcoreinfo/>
Oct 18 11:41:21 user nova-compute[74190]:   </features>
Oct 18 11:41:21 user nova-compute[74190]:   <clock offset="utc">
Oct 18 11:41:21 user nova-compute[74190]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 11:41:21 user nova-compute[74190]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 11:41:21 user nova-compute[74190]:     <timer name="hpet" present="no"/>
Oct 18 11:41:21 user nova-compute[74190]:   </clock>
Oct 18 11:41:21 user nova-compute[74190]:   <cpu mode="custom" match="exact">
Oct 18 11:41:21 user nova-compute[74190]:     <model>Nehalem</model>
Oct 18 11:41:21 user nova-compute[74190]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 11:41:21 user nova-compute[74190]:   </cpu>
Oct 18 11:41:21 user nova-compute[74190]:   <devices>
Oct 18 11:41:21 user nova-compute[74190]:     <disk type="file" device="disk">
Oct 18 11:41:21 user nova-compute[74190]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 11:41:21 user nova-compute[74190]:       <source file="/opt/stack/data/nova/instances/c6130edd-eb98-491e-a0ba-6bd59199d9e1/disk"/>
Oct 18 11:41:21 user nova-compute[74190]:       <target dev="vda" bus="virtio"/>
Oct 18 11:41:21 user nova-compute[74190]:     </disk>
Oct 18 11:41:21 user nova-compute[74190]:     <interface type="ethernet">
Oct 18 11:41:21 user nova-compute[74190]:       <mac address="fa:16:3e:ee:96:5d"/>
Oct 18 11:41:21 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:41:21 user nova-compute[74190]:       <mtu size="1442"/>
Oct 18 11:41:21 user nova-compute[74190]:       <target dev="tapbd84fceb-8a"/>
Oct 18 11:41:21 user nova-compute[74190]:     </interface>
Oct 18 11:41:21 user nova-compute[74190]:     <serial type="pty">
Oct 18 11:41:21 user nova-compute[74190]:       <log file="/opt/stack/data/nova/instances/c6130edd-eb98-491e-a0ba-6bd59199d9e1/console.log" append="off"/>
Oct 18 11:41:21 user nova-compute[74190]:     </serial>
Oct 18 11:41:21 user nova-compute[74190]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 11:41:21 user nova-compute[74190]:     <video>
Oct 18 11:41:21 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:41:21 user nova-compute[74190]:     </video>
Oct 18 11:41:21 user nova-compute[74190]:     <rng model="virtio">
Oct 18 11:41:21 user nova-compute[74190]:       <backend model="random">/dev/urandom</backend>
Oct 18 11:41:21 user nova-compute[74190]:     </rng>
Oct 18 11:41:21 user nova-compute[74190]:     <controller type="usb" index="0" model="none"/>
Oct 18 11:41:21 user nova-compute[74190]:     <memballoon model="virtio">
Oct 18 11:41:21 user nova-compute[74190]:       <stats period="10"/>
Oct 18 11:41:21 user nova-compute[74190]:     </memballoon>
Oct 18 11:41:21 user nova-compute[74190]:   </devices>
Oct 18 11:41:21 user nova-compute[74190]: </domain>
Oct 18 11:41:21 user nova-compute[74190]:  {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 11:41:21 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-7d118461-bf7c-401b-9e5d-9e4841aa043c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:41:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2004469902',display_name='tempest-VolumesAdminNegativeTest-server-2004469902',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2004469902',id=4,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHSK4yZJ9nvU8rHQ1gwT+VM8d6Vhd755AOGrYLvTCGOs3cERsYjXJirr8z9QBzq5SLgzv50feVjknIasSnvucp7cLhZ4vJwgB+R1ic6JFgTICtrO0wwd+zbXWTuu7x+IoA==',key_name='tempest-keypair-1017531913',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d83064382624b4d895b0d7bff463f4f',ramdisk_id='',reservation_id='r-9mdzy0a8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1125052526',owner_user_name='tempest-VolumesAdminNegativeTest-1125052526-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:41:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c68a9cb13814419a38413f9513d5a80',uuid=c6130edd-eb98-491e-a0ba-6bd59199d9e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd84fceb-8a04-45a0-8f05-7bc856ed1a36", "address": "fa:16:3e:ee:96:5d", "network": {"id": "c174814d-6217-4201-9af1-1575a8dcf751", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-981245321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d83064382624b4d895b0d7bff463f4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd84fceb-8a", "ovs_interfaceid": "bd84fceb-8a04-45a0-8f05-7bc856ed1a36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 11:41:21 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-7d118461-bf7c-401b-9e5d-9e4841aa043c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Converting VIF {"id": "bd84fceb-8a04-45a0-8f05-7bc856ed1a36", "address": "fa:16:3e:ee:96:5d", "network": {"id": "c174814d-6217-4201-9af1-1575a8dcf751", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-981245321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d83064382624b4d895b0d7bff463f4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd84fceb-8a", "ovs_interfaceid": "bd84fceb-8a04-45a0-8f05-7bc856ed1a36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:41:21 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-7d118461-bf7c-401b-9e5d-9e4841aa043c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:96:5d,bridge_name='br-int',has_traffic_filtering=True,id=bd84fceb-8a04-45a0-8f05-7bc856ed1a36,network=Network(c174814d-6217-4201-9af1-1575a8dcf751),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd84fceb-8a') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:41:21 user nova-compute[74190]: DEBUG os_vif [None req-7d118461-bf7c-401b-9e5d-9e4841aa043c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:96:5d,bridge_name='br-int',has_traffic_filtering=True,id=bd84fceb-8a04-45a0-8f05-7bc856ed1a36,network=Network(c174814d-6217-4201-9af1-1575a8dcf751),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd84fceb-8a') {{(pid=74190) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 11:41:21 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:21 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:41:21 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 11:41:21 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:21 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4bfd2844-62b7-546e-8d63-c3bea1717131', '_type': 'linux-noop'}}, row=False) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:41:21 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:21 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:41:21 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:21 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbd84fceb-8a, may_exist=True, interface_attrs={}) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:41:21 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbd84fceb-8a, col_values=(('qos', UUID('4afeb585-7a10-4077-86c1-143b17f59afb')),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:41:21 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbd84fceb-8a, col_values=(('external_ids', {'iface-id': 'bd84fceb-8a04-45a0-8f05-7bc856ed1a36', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ee:96:5d', 'vm-uuid': 'c6130edd-eb98-491e-a0ba-6bd59199d9e1'}),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:41:21 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:21 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:41:21 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:21 user nova-compute[74190]: INFO os_vif [None req-7d118461-bf7c-401b-9e5d-9e4841aa043c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:96:5d,bridge_name='br-int',has_traffic_filtering=True,id=bd84fceb-8a04-45a0-8f05-7bc856ed1a36,network=Network(c174814d-6217-4201-9af1-1575a8dcf751),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd84fceb-8a')
Oct 18 11:41:22 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-7d118461-bf7c-401b-9e5d-9e4841aa043c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] No BDM found with device name vda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 11:41:22 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-7d118461-bf7c-401b-9e5d-9e4841aa043c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] No VIF found with MAC fa:16:3e:ee:96:5d, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 11:41:22 user nova-compute[74190]: DEBUG nova.network.neutron [req-1e0c245c-a6aa-440a-8ed9-f1c5c5c5d0cd req-1fa726f7-755f-4834-9afe-b82362c30680 service nova] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] Updating instance_info_cache with network_info: [] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:41:22 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-1e0c245c-a6aa-440a-8ed9-f1c5c5c5d0cd req-1fa726f7-755f-4834-9afe-b82362c30680 service nova] Releasing lock "refresh_cache-6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:41:22 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Acquired lock "refresh_cache-6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:41:22 user nova-compute[74190]: DEBUG nova.network.neutron [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] Building network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 11:41:22 user nova-compute[74190]: DEBUG nova.network.neutron [req-b88dab97-1df3-4284-b8d0-4f8afa3ccfe6 req-2e435fac-7612-472f-a740-917f1c677c14 service nova] [instance: c6130edd-eb98-491e-a0ba-6bd59199d9e1] Updated VIF entry in instance network info cache for port bd84fceb-8a04-45a0-8f05-7bc856ed1a36. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 11:41:22 user nova-compute[74190]: DEBUG nova.network.neutron [req-b88dab97-1df3-4284-b8d0-4f8afa3ccfe6 req-2e435fac-7612-472f-a740-917f1c677c14 service nova] [instance: c6130edd-eb98-491e-a0ba-6bd59199d9e1] Updating instance_info_cache with network_info: [{"id": "bd84fceb-8a04-45a0-8f05-7bc856ed1a36", "address": "fa:16:3e:ee:96:5d", "network": {"id": "c174814d-6217-4201-9af1-1575a8dcf751", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-981245321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d83064382624b4d895b0d7bff463f4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd84fceb-8a", "ovs_interfaceid": "bd84fceb-8a04-45a0-8f05-7bc856ed1a36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:41:22 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-b88dab97-1df3-4284-b8d0-4f8afa3ccfe6 req-2e435fac-7612-472f-a740-917f1c677c14 service nova] Releasing lock "refresh_cache-c6130edd-eb98-491e-a0ba-6bd59199d9e1" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:41:22 user nova-compute[74190]: DEBUG nova.network.neutron [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] Instance cache missing network info. {{(pid=74190) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 11:41:22 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Acquiring lock "d56b243d-fbf2-4ae6-8399-80df46b33b82" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:41:22 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Lock "d56b243d-fbf2-4ae6-8399-80df46b33b82" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:41:22 user nova-compute[74190]: DEBUG nova.compute.manager [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] [instance: d56b243d-fbf2-4ae6-8399-80df46b33b82] Starting instance... {{(pid=74190) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 11:41:22 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:41:22 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:41:22 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74190) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 11:41:22 user nova-compute[74190]: INFO nova.compute.claims [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] [instance: d56b243d-fbf2-4ae6-8399-80df46b33b82] Claim successful on node user
Oct 18 11:41:23 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 11:41:23 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 11:41:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:23 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.824s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:41:23 user nova-compute[74190]: DEBUG nova.compute.manager [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] [instance: d56b243d-fbf2-4ae6-8399-80df46b33b82] Start building networks asynchronously for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 11:41:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:23 user nova-compute[74190]: DEBUG nova.compute.manager [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] [instance: d56b243d-fbf2-4ae6-8399-80df46b33b82] Allocating IP information in the background. {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 11:41:23 user nova-compute[74190]: DEBUG nova.network.neutron [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] [instance: d56b243d-fbf2-4ae6-8399-80df46b33b82] allocate_for_instance() {{(pid=74190) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 11:41:23 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] [instance: d56b243d-fbf2-4ae6-8399-80df46b33b82] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Oct 18 11:41:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:23 user nova-compute[74190]: DEBUG nova.network.neutron [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] Updating instance_info_cache with network_info: [{"id": "2f3b8cfe-f9f2-4dc5-b368-f67ef363266c", "address": "fa:16:3e:22:e2:3f", "network": {"id": "c9482f29-6e29-48c6-beb9-64721a29b3d9", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1092346276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72f55b03dea844739b3e36d4f73b23e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f3b8cfe-f9", "ovs_interfaceid": "2f3b8cfe-f9f2-4dc5-b368-f67ef363266c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:41:23 user nova-compute[74190]: DEBUG nova.compute.manager [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] [instance: d56b243d-fbf2-4ae6-8399-80df46b33b82] Start building block device mappings for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 11:41:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Releasing lock "refresh_cache-6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:41:24 user nova-compute[74190]: DEBUG nova.compute.manager [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] Instance network_info: |[{"id": "2f3b8cfe-f9f2-4dc5-b368-f67ef363266c", "address": "fa:16:3e:22:e2:3f", "network": {"id": "c9482f29-6e29-48c6-beb9-64721a29b3d9", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1092346276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72f55b03dea844739b3e36d4f73b23e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f3b8cfe-f9", "ovs_interfaceid": "2f3b8cfe-f9f2-4dc5-b368-f67ef363266c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 11:41:24 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] Start _get_guest_xml network_info=[{"id": "2f3b8cfe-f9f2-4dc5-b368-f67ef363266c", "address": "fa:16:3e:22:e2:3f", "network": {"id": "c9482f29-6e29-48c6-beb9-64721a29b3d9", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1092346276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72f55b03dea844739b3e36d4f73b23e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f3b8cfe-f9", "ovs_interfaceid": "2f3b8cfe-f9f2-4dc5-b368-f67ef363266c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'image_id': '6e88bbf0-6e78-49a8-b3c5-9453d22a89df'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 11:41:24 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:41:24 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:41:24 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 11:41:24 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] CPU controller missing on host. {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 11:41:24 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 11:41:24 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] CPU controller found on host. {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 11:41:24 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74190) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 11:41:24 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T11:37:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 11:41:24 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Flavor limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 11:41:24 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Image limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 11:41:24 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Flavor pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 11:41:24 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Image pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 11:41:24 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 11:41:24 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 11:41:24 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 11:41:24 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Got 1 possible topologies {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 11:41:24 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 11:41:24 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 11:41:24 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T11:41:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-239478616',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-239478616',id=5,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDiL4Y3YjaIYG9f48clgmLYvNf1xzm1drxLs+YLjigprz2IgSEssC/H3MORsYOE3v5yg6mGeg/8ep19TIA+gnsVGZGVVookzYwja4uGKlJS/z4feKfCDiLYrj74IwuE8uQ==',key_name='tempest-keypair-654404793',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72f55b03dea844739b3e36d4f73b23e0',ramdisk_id='',reservation_id='r-iliez3d9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1663776612',owner_user_name='tempest-TaggedAttachmentsTest-1663776612-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:41:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a587bc7358fe4d289926428f94766374',uuid=6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f3b8cfe-f9f2-4dc5-b368-f67ef363266c", "address": "fa:16:3e:22:e2:3f", "network": {"id": "c9482f29-6e29-48c6-beb9-64721a29b3d9", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1092346276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72f55b03dea844739b3e36d4f73b23e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f3b8cfe-f9", "ovs_interfaceid": "2f3b8cfe-f9f2-4dc5-b368-f67ef363266c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74190) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 11:41:24 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Converting VIF {"id": "2f3b8cfe-f9f2-4dc5-b368-f67ef363266c", "address": "fa:16:3e:22:e2:3f", "network": {"id": "c9482f29-6e29-48c6-beb9-64721a29b3d9", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1092346276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72f55b03dea844739b3e36d4f73b23e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f3b8cfe-f9", "ovs_interfaceid": "2f3b8cfe-f9f2-4dc5-b368-f67ef363266c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:41:24 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:e2:3f,bridge_name='br-int',has_traffic_filtering=True,id=2f3b8cfe-f9f2-4dc5-b368-f67ef363266c,network=Network(c9482f29-6e29-48c6-beb9-64721a29b3d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f3b8cfe-f9') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:41:24 user nova-compute[74190]: DEBUG nova.objects.instance [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Lazy-loading 'pci_devices' on Instance uuid 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:41:24 user nova-compute[74190]: DEBUG nova.policy [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b56705ee715145aa93daf157d9c1571b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc2f7422d534064967a7bf458650f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74190) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 11:41:24 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] End _get_guest_xml xml=<domain type="kvm">
Oct 18 11:41:24 user nova-compute[74190]:   <uuid>6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef</uuid>
Oct 18 11:41:24 user nova-compute[74190]:   <name>instance-00000005</name>
Oct 18 11:41:24 user nova-compute[74190]:   <memory>524288</memory>
Oct 18 11:41:24 user nova-compute[74190]:   <vcpu>1</vcpu>
Oct 18 11:41:24 user nova-compute[74190]:   <metadata>
Oct 18 11:41:24 user nova-compute[74190]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 11:41:24 user nova-compute[74190]:       <nova:package version="0.0.0"/>
Oct 18 11:41:24 user nova-compute[74190]:       <nova:name>tempest-device-tagging-server-239478616</nova:name>
Oct 18 11:41:24 user nova-compute[74190]:       <nova:creationTime>2023-10-18 11:41:24</nova:creationTime>
Oct 18 11:41:24 user nova-compute[74190]:       <nova:flavor name="m1.tiny">
Oct 18 11:41:24 user nova-compute[74190]:         <nova:memory>512</nova:memory>
Oct 18 11:41:24 user nova-compute[74190]:         <nova:disk>1</nova:disk>
Oct 18 11:41:24 user nova-compute[74190]:         <nova:swap>0</nova:swap>
Oct 18 11:41:24 user nova-compute[74190]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 11:41:24 user nova-compute[74190]:         <nova:vcpus>1</nova:vcpus>
Oct 18 11:41:24 user nova-compute[74190]:       </nova:flavor>
Oct 18 11:41:24 user nova-compute[74190]:       <nova:owner>
Oct 18 11:41:24 user nova-compute[74190]:         <nova:user uuid="a587bc7358fe4d289926428f94766374">tempest-TaggedAttachmentsTest-1663776612-project-member</nova:user>
Oct 18 11:41:24 user nova-compute[74190]:         <nova:project uuid="72f55b03dea844739b3e36d4f73b23e0">tempest-TaggedAttachmentsTest-1663776612</nova:project>
Oct 18 11:41:24 user nova-compute[74190]:       </nova:owner>
Oct 18 11:41:24 user nova-compute[74190]:       <nova:root type="image" uuid="6e88bbf0-6e78-49a8-b3c5-9453d22a89df"/>
Oct 18 11:41:24 user nova-compute[74190]:       <nova:ports>
Oct 18 11:41:24 user nova-compute[74190]:         <nova:port uuid="2f3b8cfe-f9f2-4dc5-b368-f67ef363266c">
Oct 18 11:41:24 user nova-compute[74190]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 18 11:41:24 user nova-compute[74190]:         </nova:port>
Oct 18 11:41:24 user nova-compute[74190]:       </nova:ports>
Oct 18 11:41:24 user nova-compute[74190]:     </nova:instance>
Oct 18 11:41:24 user nova-compute[74190]:   </metadata>
Oct 18 11:41:24 user nova-compute[74190]:   <sysinfo type="smbios">
Oct 18 11:41:24 user nova-compute[74190]:     <system>
Oct 18 11:41:24 user nova-compute[74190]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 11:41:24 user nova-compute[74190]:       <entry name="product">OpenStack Nova</entry>
Oct 18 11:41:24 user nova-compute[74190]:       <entry name="version">0.0.0</entry>
Oct 18 11:41:24 user nova-compute[74190]:       <entry name="serial">6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef</entry>
Oct 18 11:41:24 user nova-compute[74190]:       <entry name="uuid">6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef</entry>
Oct 18 11:41:24 user nova-compute[74190]:       <entry name="family">Virtual Machine</entry>
Oct 18 11:41:24 user nova-compute[74190]:     </system>
Oct 18 11:41:24 user nova-compute[74190]:   </sysinfo>
Oct 18 11:41:24 user nova-compute[74190]:   <os>
Oct 18 11:41:24 user nova-compute[74190]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 11:41:24 user nova-compute[74190]:     <boot dev="hd"/>
Oct 18 11:41:24 user nova-compute[74190]:     <smbios mode="sysinfo"/>
Oct 18 11:41:24 user nova-compute[74190]:   </os>
Oct 18 11:41:24 user nova-compute[74190]:   <features>
Oct 18 11:41:24 user nova-compute[74190]:     <acpi/>
Oct 18 11:41:24 user nova-compute[74190]:     <apic/>
Oct 18 11:41:24 user nova-compute[74190]:     <vmcoreinfo/>
Oct 18 11:41:24 user nova-compute[74190]:   </features>
Oct 18 11:41:24 user nova-compute[74190]:   <clock offset="utc">
Oct 18 11:41:24 user nova-compute[74190]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 11:41:24 user nova-compute[74190]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 11:41:24 user nova-compute[74190]:     <timer name="hpet" present="no"/>
Oct 18 11:41:24 user nova-compute[74190]:   </clock>
Oct 18 11:41:24 user nova-compute[74190]:   <cpu mode="custom" match="exact">
Oct 18 11:41:24 user nova-compute[74190]:     <model>Nehalem</model>
Oct 18 11:41:24 user nova-compute[74190]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 11:41:24 user nova-compute[74190]:   </cpu>
Oct 18 11:41:24 user nova-compute[74190]:   <devices>
Oct 18 11:41:24 user nova-compute[74190]:     <disk type="file" device="disk">
Oct 18 11:41:24 user nova-compute[74190]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 11:41:24 user nova-compute[74190]:       <source file="/opt/stack/data/nova/instances/6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef/disk"/>
Oct 18 11:41:24 user nova-compute[74190]:       <target dev="vda" bus="virtio"/>
Oct 18 11:41:24 user nova-compute[74190]:     </disk>
Oct 18 11:41:24 user nova-compute[74190]:     <disk type="file" device="cdrom">
Oct 18 11:41:24 user nova-compute[74190]:       <driver name="qemu" type="raw" cache="none"/>
Oct 18 11:41:24 user nova-compute[74190]:       <source file="/opt/stack/data/nova/instances/6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef/disk.config"/>
Oct 18 11:41:24 user nova-compute[74190]:       <target dev="hda" bus="ide"/>
Oct 18 11:41:24 user nova-compute[74190]:     </disk>
Oct 18 11:41:24 user nova-compute[74190]:     <interface type="ethernet">
Oct 18 11:41:24 user nova-compute[74190]:       <mac address="fa:16:3e:22:e2:3f"/>
Oct 18 11:41:24 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:41:24 user nova-compute[74190]:       <mtu size="1442"/>
Oct 18 11:41:24 user nova-compute[74190]:       <target dev="tap2f3b8cfe-f9"/>
Oct 18 11:41:24 user nova-compute[74190]:     </interface>
Oct 18 11:41:24 user nova-compute[74190]:     <serial type="pty">
Oct 18 11:41:24 user nova-compute[74190]:       <log file="/opt/stack/data/nova/instances/6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef/console.log" append="off"/>
Oct 18 11:41:24 user nova-compute[74190]:     </serial>
Oct 18 11:41:24 user nova-compute[74190]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 11:41:24 user nova-compute[74190]:     <video>
Oct 18 11:41:24 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:41:24 user nova-compute[74190]:     </video>
Oct 18 11:41:24 user nova-compute[74190]:     <rng model="virtio">
Oct 18 11:41:24 user nova-compute[74190]:       <backend model="random">/dev/urandom</backend>
Oct 18 11:41:24 user nova-compute[74190]:     </rng>
Oct 18 11:41:24 user nova-compute[74190]:     <controller type="usb" index="0" model="none"/>
Oct 18 11:41:24 user nova-compute[74190]:     <memballoon model="virtio">
Oct 18 11:41:24 user nova-compute[74190]:       <stats period="10"/>
Oct 18 11:41:24 user nova-compute[74190]:     </memballoon>
Oct 18 11:41:24 user nova-compute[74190]:   </devices>
Oct 18 11:41:24 user nova-compute[74190]: </domain>
Oct 18 11:41:24 user nova-compute[74190]:  {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 11:41:24 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T11:41:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-239478616',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-239478616',id=5,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDiL4Y3YjaIYG9f48clgmLYvNf1xzm1drxLs+YLjigprz2IgSEssC/H3MORsYOE3v5yg6mGeg/8ep19TIA+gnsVGZGVVookzYwja4uGKlJS/z4feKfCDiLYrj74IwuE8uQ==',key_name='tempest-keypair-654404793',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72f55b03dea844739b3e36d4f73b23e0',ramdisk_id='',reservation_id='r-iliez3d9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1663776612',owner_user_name='tempest-TaggedAttachmentsTest-1663776612-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:41:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a587bc7358fe4d289926428f94766374',uuid=6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f3b8cfe-f9f2-4dc5-b368-f67ef363266c", "address": "fa:16:3e:22:e2:3f", "network": {"id": "c9482f29-6e29-48c6-beb9-64721a29b3d9", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1092346276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72f55b03dea844739b3e36d4f73b23e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f3b8cfe-f9", "ovs_interfaceid": "2f3b8cfe-f9f2-4dc5-b368-f67ef363266c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 11:41:24 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Converting VIF {"id": "2f3b8cfe-f9f2-4dc5-b368-f67ef363266c", "address": "fa:16:3e:22:e2:3f", "network": {"id": "c9482f29-6e29-48c6-beb9-64721a29b3d9", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1092346276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72f55b03dea844739b3e36d4f73b23e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f3b8cfe-f9", "ovs_interfaceid": "2f3b8cfe-f9f2-4dc5-b368-f67ef363266c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:41:24 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:e2:3f,bridge_name='br-int',has_traffic_filtering=True,id=2f3b8cfe-f9f2-4dc5-b368-f67ef363266c,network=Network(c9482f29-6e29-48c6-beb9-64721a29b3d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f3b8cfe-f9') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:41:24 user nova-compute[74190]: DEBUG os_vif [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:e2:3f,bridge_name='br-int',has_traffic_filtering=True,id=2f3b8cfe-f9f2-4dc5-b368-f67ef363266c,network=Network(c9482f29-6e29-48c6-beb9-64721a29b3d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f3b8cfe-f9') {{(pid=74190) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 11:41:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:41:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 11:41:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3a6cb124-481e-56c8-889d-2c413e0f008a', '_type': 'linux-noop'}}, row=False) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:41:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:41:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2f3b8cfe-f9, may_exist=True, interface_attrs={}) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:41:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2f3b8cfe-f9, col_values=(('qos', UUID('b28d4d89-d667-47b1-b728-a8dad1c89c40')),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:41:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2f3b8cfe-f9, col_values=(('external_ids', {'iface-id': '2f3b8cfe-f9f2-4dc5-b368-f67ef363266c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:e2:3f', 'vm-uuid': '6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef'}),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:41:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:41:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:24 user nova-compute[74190]: INFO os_vif [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:e2:3f,bridge_name='br-int',has_traffic_filtering=True,id=2f3b8cfe-f9f2-4dc5-b368-f67ef363266c,network=Network(c9482f29-6e29-48c6-beb9-64721a29b3d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f3b8cfe-f9')
Oct 18 11:41:24 user nova-compute[74190]: DEBUG nova.compute.manager [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] [instance: d56b243d-fbf2-4ae6-8399-80df46b33b82] Start spawning the instance on the hypervisor. {{(pid=74190) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 11:41:24 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] [instance: d56b243d-fbf2-4ae6-8399-80df46b33b82] Creating instance directory {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 11:41:24 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] [instance: d56b243d-fbf2-4ae6-8399-80df46b33b82] Creating image(s)
Oct 18 11:41:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Acquiring lock "/opt/stack/data/nova/instances/d56b243d-fbf2-4ae6-8399-80df46b33b82/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:41:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Lock "/opt/stack/data/nova/instances/d56b243d-fbf2-4ae6-8399-80df46b33b82/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:41:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Lock "/opt/stack/data/nova/instances/d56b243d-fbf2-4ae6-8399-80df46b33b82/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:41:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Acquiring lock "859c6b5109633be0afdd51cf534f3d71508ce763" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:41:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Lock "859c6b5109633be0afdd51cf534f3d71508ce763" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:41:24 user nova-compute[74190]: DEBUG nova.compute.manager [req-61d341ce-ae19-45be-b756-2ec277061d9f req-11d6a226-17fb-4f92-9859-67d25fe4dfc0 service nova] [instance: c6130edd-eb98-491e-a0ba-6bd59199d9e1] Received event network-vif-plugged-bd84fceb-8a04-45a0-8f05-7bc856ed1a36 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:41:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-61d341ce-ae19-45be-b756-2ec277061d9f req-11d6a226-17fb-4f92-9859-67d25fe4dfc0 service nova] Acquiring lock "c6130edd-eb98-491e-a0ba-6bd59199d9e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:41:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-61d341ce-ae19-45be-b756-2ec277061d9f req-11d6a226-17fb-4f92-9859-67d25fe4dfc0 service nova] Lock "c6130edd-eb98-491e-a0ba-6bd59199d9e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:41:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-61d341ce-ae19-45be-b756-2ec277061d9f req-11d6a226-17fb-4f92-9859-67d25fe4dfc0 service nova] Lock "c6130edd-eb98-491e-a0ba-6bd59199d9e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:41:24 user nova-compute[74190]: DEBUG nova.compute.manager [req-61d341ce-ae19-45be-b756-2ec277061d9f req-11d6a226-17fb-4f92-9859-67d25fe4dfc0 service nova] [instance: c6130edd-eb98-491e-a0ba-6bd59199d9e1] No waiting events found dispatching network-vif-plugged-bd84fceb-8a04-45a0-8f05-7bc856ed1a36 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:41:24 user nova-compute[74190]: WARNING nova.compute.manager [req-61d341ce-ae19-45be-b756-2ec277061d9f req-11d6a226-17fb-4f92-9859-67d25fe4dfc0 service nova] [instance: c6130edd-eb98-491e-a0ba-6bd59199d9e1] Received unexpected event network-vif-plugged-bd84fceb-8a04-45a0-8f05-7bc856ed1a36 for instance with vm_state building and task_state spawning.
Oct 18 11:41:24 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] No BDM found with device name vda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 11:41:24 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] No BDM found with device name hda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 11:41:24 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] No VIF found with MAC fa:16:3e:22:e2:3f, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 11:41:24 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] Using config drive
Oct 18 11:41:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/859c6b5109633be0afdd51cf534f3d71508ce763.part --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:41:25 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] Creating config drive at /opt/stack/data/nova/instances/6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef/disk.config
Oct 18 11:41:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpirewtcxf {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:41:25 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpirewtcxf" returned: 0 in 0.109s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:41:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/859c6b5109633be0afdd51cf534f3d71508ce763.part --force-share --output=json" returned: 0 in 0.404s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:41:26 user nova-compute[74190]: DEBUG nova.virt.images [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] 77266ca3-fb2b-4f8a-82e1-da6951fc684a was qcow2, converting to raw {{(pid=74190) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 18 11:41:26 user nova-compute[74190]: DEBUG nova.privsep.utils [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74190) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 18 11:41:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/859c6b5109633be0afdd51cf534f3d71508ce763.part /opt/stack/data/nova/instances/_base/859c6b5109633be0afdd51cf534f3d71508ce763.converted {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:41:26 user nova-compute[74190]: DEBUG nova.network.neutron [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] [instance: d56b243d-fbf2-4ae6-8399-80df46b33b82] Successfully created port: a4d61a40-a5fd-4bca-899e-5569a7bc1e1b {{(pid=74190) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 11:41:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/859c6b5109633be0afdd51cf534f3d71508ce763.part /opt/stack/data/nova/instances/_base/859c6b5109633be0afdd51cf534f3d71508ce763.converted" returned: 0 in 0.294s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:41:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/859c6b5109633be0afdd51cf534f3d71508ce763.converted --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:41:26 user nova-compute[74190]: DEBUG nova.compute.manager [req-6da5c0bb-5745-46e5-a30d-734cc956e733 req-dc859ac9-211f-40ee-9c89-433f150eb1e8 service nova] [instance: c6130edd-eb98-491e-a0ba-6bd59199d9e1] Received event network-vif-plugged-bd84fceb-8a04-45a0-8f05-7bc856ed1a36 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:41:26 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-6da5c0bb-5745-46e5-a30d-734cc956e733 req-dc859ac9-211f-40ee-9c89-433f150eb1e8 service nova] Acquiring lock "c6130edd-eb98-491e-a0ba-6bd59199d9e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:41:26 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-6da5c0bb-5745-46e5-a30d-734cc956e733 req-dc859ac9-211f-40ee-9c89-433f150eb1e8 service nova] Lock "c6130edd-eb98-491e-a0ba-6bd59199d9e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:41:26 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-6da5c0bb-5745-46e5-a30d-734cc956e733 req-dc859ac9-211f-40ee-9c89-433f150eb1e8 service nova] Lock "c6130edd-eb98-491e-a0ba-6bd59199d9e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:41:26 user nova-compute[74190]: DEBUG nova.compute.manager [req-6da5c0bb-5745-46e5-a30d-734cc956e733 req-dc859ac9-211f-40ee-9c89-433f150eb1e8 service nova] [instance: c6130edd-eb98-491e-a0ba-6bd59199d9e1] No waiting events found dispatching network-vif-plugged-bd84fceb-8a04-45a0-8f05-7bc856ed1a36 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:41:26 user nova-compute[74190]: WARNING nova.compute.manager [req-6da5c0bb-5745-46e5-a30d-734cc956e733 req-dc859ac9-211f-40ee-9c89-433f150eb1e8 service nova] [instance: c6130edd-eb98-491e-a0ba-6bd59199d9e1] Received unexpected event network-vif-plugged-bd84fceb-8a04-45a0-8f05-7bc856ed1a36 for instance with vm_state building and task_state spawning.
Oct 18 11:41:26 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:26 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:26 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/859c6b5109633be0afdd51cf534f3d71508ce763.converted --force-share --output=json" returned: 0 in 0.237s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:41:26 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Lock "859c6b5109633be0afdd51cf534f3d71508ce763" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.455s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:41:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/859c6b5109633be0afdd51cf534f3d71508ce763 --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:41:26 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:27 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/859c6b5109633be0afdd51cf534f3d71508ce763 --force-share --output=json" returned: 0 in 0.231s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:41:27 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Acquiring lock "859c6b5109633be0afdd51cf534f3d71508ce763" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:41:27 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Lock "859c6b5109633be0afdd51cf534f3d71508ce763" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:41:27 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/859c6b5109633be0afdd51cf534f3d71508ce763 --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:41:27 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/859c6b5109633be0afdd51cf534f3d71508ce763 --force-share --output=json" returned: 0 in 0.240s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:41:27 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/859c6b5109633be0afdd51cf534f3d71508ce763,backing_fmt=raw /opt/stack/data/nova/instances/d56b243d-fbf2-4ae6-8399-80df46b33b82/disk 1073741824 {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:41:27 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/859c6b5109633be0afdd51cf534f3d71508ce763,backing_fmt=raw /opt/stack/data/nova/instances/d56b243d-fbf2-4ae6-8399-80df46b33b82/disk 1073741824" returned: 0 in 0.112s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:41:27 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Lock "859c6b5109633be0afdd51cf534f3d71508ce763" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.365s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:41:27 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/859c6b5109633be0afdd51cf534f3d71508ce763 --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:41:27 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/859c6b5109633be0afdd51cf534f3d71508ce763 --force-share --output=json" returned: 0 in 0.325s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:41:27 user nova-compute[74190]: DEBUG nova.virt.disk.api [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d56b243d-fbf2-4ae6-8399-80df46b33b82/disk. size=1073741824 {{(pid=74190) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 18 11:41:27 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d56b243d-fbf2-4ae6-8399-80df46b33b82/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:41:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:27 user nova-compute[74190]: DEBUG nova.compute.manager [None req-7d118461-bf7c-401b-9e5d-9e4841aa043c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] [instance: c6130edd-eb98-491e-a0ba-6bd59199d9e1] Instance event wait completed in 0 seconds for  {{(pid=74190) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 11:41:27 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-7d118461-bf7c-401b-9e5d-9e4841aa043c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] [instance: c6130edd-eb98-491e-a0ba-6bd59199d9e1] Guest created on hypervisor {{(pid=74190) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 11:41:28 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: c6130edd-eb98-491e-a0ba-6bd59199d9e1] Instance spawned successfully.
Oct 18 11:41:28 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-7d118461-bf7c-401b-9e5d-9e4841aa043c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] [instance: c6130edd-eb98-491e-a0ba-6bd59199d9e1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 11:41:28 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d56b243d-fbf2-4ae6-8399-80df46b33b82/disk --force-share --output=json" returned: 0 in 0.314s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:41:28 user nova-compute[74190]: DEBUG nova.virt.disk.api [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Cannot resize image /opt/stack/data/nova/instances/d56b243d-fbf2-4ae6-8399-80df46b33b82/disk to a smaller size. {{(pid=74190) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 18 11:41:28 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] [instance: d56b243d-fbf2-4ae6-8399-80df46b33b82] Created local disks {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 11:41:28 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] [instance: d56b243d-fbf2-4ae6-8399-80df46b33b82] Ensure instance console log exists: /opt/stack/data/nova/instances/d56b243d-fbf2-4ae6-8399-80df46b33b82/console.log {{(pid=74190) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 11:41:28 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:41:28 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:41:28 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:41:28 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-7d118461-bf7c-401b-9e5d-9e4841aa043c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] [instance: c6130edd-eb98-491e-a0ba-6bd59199d9e1] Found default for hw_cdrom_bus of ide {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:41:28 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-7d118461-bf7c-401b-9e5d-9e4841aa043c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] [instance: c6130edd-eb98-491e-a0ba-6bd59199d9e1] Found default for hw_disk_bus of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:41:28 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-7d118461-bf7c-401b-9e5d-9e4841aa043c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] [instance: c6130edd-eb98-491e-a0ba-6bd59199d9e1] Found default for hw_input_bus of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:41:28 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-7d118461-bf7c-401b-9e5d-9e4841aa043c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] [instance: c6130edd-eb98-491e-a0ba-6bd59199d9e1] Found default for hw_pointer_model of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:41:28 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-7d118461-bf7c-401b-9e5d-9e4841aa043c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] [instance: c6130edd-eb98-491e-a0ba-6bd59199d9e1] Found default for hw_video_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:41:28 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-7d118461-bf7c-401b-9e5d-9e4841aa043c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] [instance: c6130edd-eb98-491e-a0ba-6bd59199d9e1] Found default for hw_vif_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:41:28 user nova-compute[74190]: INFO nova.compute.manager [None req-7d118461-bf7c-401b-9e5d-9e4841aa043c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] [instance: c6130edd-eb98-491e-a0ba-6bd59199d9e1] Took 10.67 seconds to spawn the instance on the hypervisor.
Oct 18 11:41:28 user nova-compute[74190]: DEBUG nova.compute.manager [None req-7d118461-bf7c-401b-9e5d-9e4841aa043c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] [instance: c6130edd-eb98-491e-a0ba-6bd59199d9e1] Checking state {{(pid=74190) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 11:41:28 user nova-compute[74190]: INFO nova.compute.manager [None req-7d118461-bf7c-401b-9e5d-9e4841aa043c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] [instance: c6130edd-eb98-491e-a0ba-6bd59199d9e1] Took 11.80 seconds to build instance.
Oct 18 11:41:28 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-7d118461-bf7c-401b-9e5d-9e4841aa043c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Lock "c6130edd-eb98-491e-a0ba-6bd59199d9e1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.036s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:41:28 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-47cc5745-cdb2-4584-8d6b-c8396fb7c05c tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Acquiring lock "034398e8-e8c4-4e03-a608-440e447c6041" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:41:28 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-47cc5745-cdb2-4584-8d6b-c8396fb7c05c tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Lock "034398e8-e8c4-4e03-a608-440e447c6041" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:41:28 user nova-compute[74190]: DEBUG nova.compute.manager [None req-47cc5745-cdb2-4584-8d6b-c8396fb7c05c tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] [instance: 034398e8-e8c4-4e03-a608-440e447c6041] Starting instance... {{(pid=74190) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 11:41:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:28 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-47cc5745-cdb2-4584-8d6b-c8396fb7c05c tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:41:28 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-47cc5745-cdb2-4584-8d6b-c8396fb7c05c tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:41:28 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-47cc5745-cdb2-4584-8d6b-c8396fb7c05c tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74190) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 11:41:28 user nova-compute[74190]: INFO nova.compute.claims [None req-47cc5745-cdb2-4584-8d6b-c8396fb7c05c tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] [instance: 034398e8-e8c4-4e03-a608-440e447c6041] Claim successful on node user
Oct 18 11:41:28 user nova-compute[74190]: DEBUG nova.network.neutron [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] [instance: d56b243d-fbf2-4ae6-8399-80df46b33b82] Successfully updated port: a4d61a40-a5fd-4bca-899e-5569a7bc1e1b {{(pid=74190) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 11:41:28 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Acquiring lock "refresh_cache-d56b243d-fbf2-4ae6-8399-80df46b33b82" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:41:28 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Acquired lock "refresh_cache-d56b243d-fbf2-4ae6-8399-80df46b33b82" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:41:28 user nova-compute[74190]: DEBUG nova.network.neutron [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] [instance: d56b243d-fbf2-4ae6-8399-80df46b33b82] Building network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 11:41:29 user nova-compute[74190]: DEBUG nova.compute.manager [req-3775b96b-2c81-4aab-8818-bd3aa5ff98c9 req-ed78b9a2-cc86-4309-99b3-e3ff79412e31 service nova] [instance: d56b243d-fbf2-4ae6-8399-80df46b33b82] Received event network-changed-a4d61a40-a5fd-4bca-899e-5569a7bc1e1b {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:41:29 user nova-compute[74190]: DEBUG nova.compute.manager [req-3775b96b-2c81-4aab-8818-bd3aa5ff98c9 req-ed78b9a2-cc86-4309-99b3-e3ff79412e31 service nova] [instance: d56b243d-fbf2-4ae6-8399-80df46b33b82] Refreshing instance network info cache due to event network-changed-a4d61a40-a5fd-4bca-899e-5569a7bc1e1b. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 11:41:29 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-3775b96b-2c81-4aab-8818-bd3aa5ff98c9 req-ed78b9a2-cc86-4309-99b3-e3ff79412e31 service nova] Acquiring lock "refresh_cache-d56b243d-fbf2-4ae6-8399-80df46b33b82" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:41:29 user nova-compute[74190]: DEBUG nova.network.neutron [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] [instance: d56b243d-fbf2-4ae6-8399-80df46b33b82] Instance cache missing network info. {{(pid=74190) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 11:41:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:29 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-47cc5745-cdb2-4584-8d6b-c8396fb7c05c tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 11:41:29 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-47cc5745-cdb2-4584-8d6b-c8396fb7c05c tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 11:41:29 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-47cc5745-cdb2-4584-8d6b-c8396fb7c05c tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.805s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:41:29 user nova-compute[74190]: DEBUG nova.compute.manager [None req-47cc5745-cdb2-4584-8d6b-c8396fb7c05c tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] [instance: 034398e8-e8c4-4e03-a608-440e447c6041] Start building networks asynchronously for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 11:41:29 user nova-compute[74190]: DEBUG nova.compute.manager [None req-47cc5745-cdb2-4584-8d6b-c8396fb7c05c tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] [instance: 034398e8-e8c4-4e03-a608-440e447c6041] Allocating IP information in the background. {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 11:41:29 user nova-compute[74190]: DEBUG nova.network.neutron [None req-47cc5745-cdb2-4584-8d6b-c8396fb7c05c tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] [instance: 034398e8-e8c4-4e03-a608-440e447c6041] allocate_for_instance() {{(pid=74190) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 11:41:29 user nova-compute[74190]: DEBUG nova.network.neutron [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] [instance: d56b243d-fbf2-4ae6-8399-80df46b33b82] Updating instance_info_cache with network_info: [{"id": "a4d61a40-a5fd-4bca-899e-5569a7bc1e1b", "address": "fa:16:3e:39:a4:ae", "network": {"id": "5b2a9095-d135-4b4a-9aee-82ddbd43faca", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1054223283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc2f7422d534064967a7bf458650f0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4d61a40-a5", "ovs_interfaceid": "a4d61a40-a5fd-4bca-899e-5569a7bc1e1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:41:29 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-47cc5745-cdb2-4584-8d6b-c8396fb7c05c tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] [instance: 034398e8-e8c4-4e03-a608-440e447c6041] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 11:41:29 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Releasing lock "refresh_cache-d56b243d-fbf2-4ae6-8399-80df46b33b82" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:41:29 user nova-compute[74190]: DEBUG nova.compute.manager [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] [instance: d56b243d-fbf2-4ae6-8399-80df46b33b82] Instance network_info: |[{"id": "a4d61a40-a5fd-4bca-899e-5569a7bc1e1b", "address": "fa:16:3e:39:a4:ae", "network": {"id": "5b2a9095-d135-4b4a-9aee-82ddbd43faca", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1054223283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc2f7422d534064967a7bf458650f0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4d61a40-a5", "ovs_interfaceid": "a4d61a40-a5fd-4bca-899e-5569a7bc1e1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 11:41:29 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-3775b96b-2c81-4aab-8818-bd3aa5ff98c9 req-ed78b9a2-cc86-4309-99b3-e3ff79412e31 service nova] Acquired lock "refresh_cache-d56b243d-fbf2-4ae6-8399-80df46b33b82" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:41:29 user nova-compute[74190]: DEBUG nova.network.neutron [req-3775b96b-2c81-4aab-8818-bd3aa5ff98c9 req-ed78b9a2-cc86-4309-99b3-e3ff79412e31 service nova] [instance: d56b243d-fbf2-4ae6-8399-80df46b33b82] Refreshing network info cache for port a4d61a40-a5fd-4bca-899e-5569a7bc1e1b {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 11:41:29 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] [instance: d56b243d-fbf2-4ae6-8399-80df46b33b82] Start _get_guest_xml network_info=[{"id": "a4d61a40-a5fd-4bca-899e-5569a7bc1e1b", "address": "fa:16:3e:39:a4:ae", "network": {"id": "5b2a9095-d135-4b4a-9aee-82ddbd43faca", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1054223283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc2f7422d534064967a7bf458650f0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4d61a40-a5", "ovs_interfaceid": "a4d61a40-a5fd-4bca-899e-5569a7bc1e1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:41:14Z,direct_url=<?>,disk_format='qcow2',id=77266ca3-fb2b-4f8a-82e1-da6951fc684a,min_disk=0,min_ram=0,name='',owner='a70c82643c384222aea49c680177d552',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:41:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'disk_bus': 'scsi', 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/sda', 'image_id': '77266ca3-fb2b-4f8a-82e1-da6951fc684a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 11:41:29 user nova-compute[74190]: DEBUG nova.compute.manager [None req-47cc5745-cdb2-4584-8d6b-c8396fb7c05c tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] [instance: 034398e8-e8c4-4e03-a608-440e447c6041] Start building block device mappings for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 11:41:29 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:41:29 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:41:29 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 11:41:29 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] CPU controller missing on host. {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 11:41:29 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 11:41:29 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] CPU controller found on host. {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 11:41:29 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74190) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 11:41:29 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T11:37:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:41:14Z,direct_url=<?>,disk_format='qcow2',id=77266ca3-fb2b-4f8a-82e1-da6951fc684a,min_disk=0,min_ram=0,name='',owner='a70c82643c384222aea49c680177d552',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:41:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 11:41:29 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Flavor limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 11:41:29 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Image limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 11:41:29 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Flavor pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 11:41:29 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Image pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 11:41:29 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 11:41:29 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 11:41:29 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 11:41:29 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Got 1 possible topologies {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 11:41:29 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 11:41:29 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 11:41:29 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T11:41:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-261747563',display_name='tempest-AttachSCSIVolumeTestJSON-server-261747563',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-261747563',id=6,image_ref='77266ca3-fb2b-4f8a-82e1-da6951fc684a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEGT361osT4JUlVvS7ROETsggH9sfRlsoM8ZLlBohdnwhZ8nz59PSJx4jzhky4mFFJFF50iZAB15da8PvVqtd+qk9kz2pB3xH+ym+6ACMcETAdxU2byMCWVYTXpKZzQFBg==',key_name='tempest-keypair-1035152576',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dbc2f7422d534064967a7bf458650f0e',ramdisk_id='',reservation_id='r-3s8gq5ja',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77266ca3-fb2b-4f8a-82e1-da6951fc684a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-463001897',owner_user_name='tempest-AttachSCSIVolumeTestJSON-463001897-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:41:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b56705ee715145aa93daf157d9c1571b',uuid=d56b243d-fbf2-4ae6-8399-80df46b33b82,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a4d61a40-a5fd-4bca-899e-5569a7bc1e1b", "address": "fa:16:3e:39:a4:ae", "network": {"id": "5b2a9095-d135-4b4a-9aee-82ddbd43faca", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1054223283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc2f7422d534064967a7bf458650f0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4d61a40-a5", "ovs_interfaceid": "a4d61a40-a5fd-4bca-899e-5569a7bc1e1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74190) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 11:41:29 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Converting VIF {"id": "a4d61a40-a5fd-4bca-899e-5569a7bc1e1b", "address": "fa:16:3e:39:a4:ae", "network": {"id": "5b2a9095-d135-4b4a-9aee-82ddbd43faca", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1054223283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc2f7422d534064967a7bf458650f0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4d61a40-a5", "ovs_interfaceid": "a4d61a40-a5fd-4bca-899e-5569a7bc1e1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:41:29 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:a4:ae,bridge_name='br-int',has_traffic_filtering=True,id=a4d61a40-a5fd-4bca-899e-5569a7bc1e1b,network=Network(5b2a9095-d135-4b4a-9aee-82ddbd43faca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4d61a40-a5') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:41:29 user nova-compute[74190]: DEBUG nova.objects.instance [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Lazy-loading 'pci_devices' on Instance uuid d56b243d-fbf2-4ae6-8399-80df46b33b82 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:41:29 user nova-compute[74190]: DEBUG nova.policy [None req-47cc5745-cdb2-4584-8d6b-c8396fb7c05c tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dfa9681837ca44ca933fd55bf453a182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f627e5a9344c9bad9923c2b0cbec3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74190) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 11:41:29 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] [instance: d56b243d-fbf2-4ae6-8399-80df46b33b82] End _get_guest_xml xml=<domain type="kvm">
Oct 18 11:41:29 user nova-compute[74190]:   <uuid>d56b243d-fbf2-4ae6-8399-80df46b33b82</uuid>
Oct 18 11:41:29 user nova-compute[74190]:   <name>instance-00000006</name>
Oct 18 11:41:29 user nova-compute[74190]:   <memory>524288</memory>
Oct 18 11:41:29 user nova-compute[74190]:   <vcpu>1</vcpu>
Oct 18 11:41:29 user nova-compute[74190]:   <metadata>
Oct 18 11:41:29 user nova-compute[74190]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 11:41:29 user nova-compute[74190]:       <nova:package version="0.0.0"/>
Oct 18 11:41:29 user nova-compute[74190]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-261747563</nova:name>
Oct 18 11:41:29 user nova-compute[74190]:       <nova:creationTime>2023-10-18 11:41:29</nova:creationTime>
Oct 18 11:41:29 user nova-compute[74190]:       <nova:flavor name="m1.tiny">
Oct 18 11:41:29 user nova-compute[74190]:         <nova:memory>512</nova:memory>
Oct 18 11:41:29 user nova-compute[74190]:         <nova:disk>1</nova:disk>
Oct 18 11:41:29 user nova-compute[74190]:         <nova:swap>0</nova:swap>
Oct 18 11:41:29 user nova-compute[74190]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 11:41:29 user nova-compute[74190]:         <nova:vcpus>1</nova:vcpus>
Oct 18 11:41:29 user nova-compute[74190]:       </nova:flavor>
Oct 18 11:41:29 user nova-compute[74190]:       <nova:owner>
Oct 18 11:41:29 user nova-compute[74190]:         <nova:user uuid="b56705ee715145aa93daf157d9c1571b">tempest-AttachSCSIVolumeTestJSON-463001897-project-member</nova:user>
Oct 18 11:41:29 user nova-compute[74190]:         <nova:project uuid="dbc2f7422d534064967a7bf458650f0e">tempest-AttachSCSIVolumeTestJSON-463001897</nova:project>
Oct 18 11:41:29 user nova-compute[74190]:       </nova:owner>
Oct 18 11:41:29 user nova-compute[74190]:       <nova:root type="image" uuid="77266ca3-fb2b-4f8a-82e1-da6951fc684a"/>
Oct 18 11:41:29 user nova-compute[74190]:       <nova:ports>
Oct 18 11:41:29 user nova-compute[74190]:         <nova:port uuid="a4d61a40-a5fd-4bca-899e-5569a7bc1e1b">
Oct 18 11:41:29 user nova-compute[74190]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 18 11:41:29 user nova-compute[74190]:         </nova:port>
Oct 18 11:41:29 user nova-compute[74190]:       </nova:ports>
Oct 18 11:41:29 user nova-compute[74190]:     </nova:instance>
Oct 18 11:41:29 user nova-compute[74190]:   </metadata>
Oct 18 11:41:29 user nova-compute[74190]:   <sysinfo type="smbios">
Oct 18 11:41:29 user nova-compute[74190]:     <system>
Oct 18 11:41:29 user nova-compute[74190]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 11:41:29 user nova-compute[74190]:       <entry name="product">OpenStack Nova</entry>
Oct 18 11:41:29 user nova-compute[74190]:       <entry name="version">0.0.0</entry>
Oct 18 11:41:29 user nova-compute[74190]:       <entry name="serial">d56b243d-fbf2-4ae6-8399-80df46b33b82</entry>
Oct 18 11:41:29 user nova-compute[74190]:       <entry name="uuid">d56b243d-fbf2-4ae6-8399-80df46b33b82</entry>
Oct 18 11:41:29 user nova-compute[74190]:       <entry name="family">Virtual Machine</entry>
Oct 18 11:41:29 user nova-compute[74190]:     </system>
Oct 18 11:41:29 user nova-compute[74190]:   </sysinfo>
Oct 18 11:41:29 user nova-compute[74190]:   <os>
Oct 18 11:41:29 user nova-compute[74190]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 11:41:29 user nova-compute[74190]:     <boot dev="hd"/>
Oct 18 11:41:29 user nova-compute[74190]:     <smbios mode="sysinfo"/>
Oct 18 11:41:29 user nova-compute[74190]:   </os>
Oct 18 11:41:29 user nova-compute[74190]:   <features>
Oct 18 11:41:29 user nova-compute[74190]:     <acpi/>
Oct 18 11:41:29 user nova-compute[74190]:     <apic/>
Oct 18 11:41:29 user nova-compute[74190]:     <vmcoreinfo/>
Oct 18 11:41:29 user nova-compute[74190]:   </features>
Oct 18 11:41:29 user nova-compute[74190]:   <clock offset="utc">
Oct 18 11:41:29 user nova-compute[74190]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 11:41:29 user nova-compute[74190]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 11:41:29 user nova-compute[74190]:     <timer name="hpet" present="no"/>
Oct 18 11:41:29 user nova-compute[74190]:   </clock>
Oct 18 11:41:29 user nova-compute[74190]:   <cpu mode="custom" match="exact">
Oct 18 11:41:29 user nova-compute[74190]:     <model>Nehalem</model>
Oct 18 11:41:29 user nova-compute[74190]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 11:41:29 user nova-compute[74190]:   </cpu>
Oct 18 11:41:29 user nova-compute[74190]:   <devices>
Oct 18 11:41:29 user nova-compute[74190]:     <disk type="file" device="disk">
Oct 18 11:41:29 user nova-compute[74190]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 11:41:29 user nova-compute[74190]:       <source file="/opt/stack/data/nova/instances/d56b243d-fbf2-4ae6-8399-80df46b33b82/disk"/>
Oct 18 11:41:29 user nova-compute[74190]:       <target dev="sda" bus="scsi"/>
Oct 18 11:41:29 user nova-compute[74190]:       <address type="drive" controller="0" unit="0"/>
Oct 18 11:41:29 user nova-compute[74190]:     </disk>
Oct 18 11:41:29 user nova-compute[74190]:     <disk type="file" device="cdrom">
Oct 18 11:41:29 user nova-compute[74190]:       <driver name="qemu" type="raw" cache="none"/>
Oct 18 11:41:29 user nova-compute[74190]:       <source file="/opt/stack/data/nova/instances/d56b243d-fbf2-4ae6-8399-80df46b33b82/disk.config"/>
Oct 18 11:41:29 user nova-compute[74190]:       <target dev="sdb" bus="scsi"/>
Oct 18 11:41:29 user nova-compute[74190]:       <address type="drive" controller="0" unit="1"/>
Oct 18 11:41:29 user nova-compute[74190]:     </disk>
Oct 18 11:41:29 user nova-compute[74190]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Oct 18 11:41:29 user nova-compute[74190]:     <interface type="ethernet">
Oct 18 11:41:29 user nova-compute[74190]:       <mac address="fa:16:3e:39:a4:ae"/>
Oct 18 11:41:29 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:41:29 user nova-compute[74190]:       <mtu size="1442"/>
Oct 18 11:41:29 user nova-compute[74190]:       <target dev="tapa4d61a40-a5"/>
Oct 18 11:41:29 user nova-compute[74190]:     </interface>
Oct 18 11:41:29 user nova-compute[74190]:     <serial type="pty">
Oct 18 11:41:29 user nova-compute[74190]:       <log file="/opt/stack/data/nova/instances/d56b243d-fbf2-4ae6-8399-80df46b33b82/console.log" append="off"/>
Oct 18 11:41:29 user nova-compute[74190]:     </serial>
Oct 18 11:41:29 user nova-compute[74190]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 11:41:29 user nova-compute[74190]:     <video>
Oct 18 11:41:29 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:41:29 user nova-compute[74190]:     </video>
Oct 18 11:41:29 user nova-compute[74190]:     <rng model="virtio">
Oct 18 11:41:29 user nova-compute[74190]:       <backend model="random">/dev/urandom</backend>
Oct 18 11:41:29 user nova-compute[74190]:     </rng>
Oct 18 11:41:29 user nova-compute[74190]:     <controller type="usb" index="0" model="none"/>
Oct 18 11:41:29 user nova-compute[74190]:     <memballoon model="virtio">
Oct 18 11:41:29 user nova-compute[74190]:       <stats period="10"/>
Oct 18 11:41:29 user nova-compute[74190]:     </memballoon>
Oct 18 11:41:29 user nova-compute[74190]:   </devices>
Oct 18 11:41:29 user nova-compute[74190]: </domain>
Oct 18 11:41:29 user nova-compute[74190]:  {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 11:41:29 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T11:41:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-261747563',display_name='tempest-AttachSCSIVolumeTestJSON-server-261747563',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-261747563',id=6,image_ref='77266ca3-fb2b-4f8a-82e1-da6951fc684a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEGT361osT4JUlVvS7ROETsggH9sfRlsoM8ZLlBohdnwhZ8nz59PSJx4jzhky4mFFJFF50iZAB15da8PvVqtd+qk9kz2pB3xH+ym+6ACMcETAdxU2byMCWVYTXpKZzQFBg==',key_name='tempest-keypair-1035152576',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dbc2f7422d534064967a7bf458650f0e',ramdisk_id='',reservation_id='r-3s8gq5ja',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77266ca3-fb2b-4f8a-82e1-da6951fc684a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-463001897',owner_user_name='tempest-AttachSCSIVolumeTestJSON-463001897-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:41:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b56705ee715145aa93daf157d9c1571b',uuid=d56b243d-fbf2-4ae6-8399-80df46b33b82,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a4d61a40-a5fd-4bca-899e-5569a7bc1e1b", "address": "fa:16:3e:39:a4:ae", "network": {"id": "5b2a9095-d135-4b4a-9aee-82ddbd43faca", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1054223283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc2f7422d534064967a7bf458650f0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4d61a40-a5", "ovs_interfaceid": "a4d61a40-a5fd-4bca-899e-5569a7bc1e1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 11:41:29 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Converting VIF {"id": "a4d61a40-a5fd-4bca-899e-5569a7bc1e1b", "address": "fa:16:3e:39:a4:ae", "network": {"id": "5b2a9095-d135-4b4a-9aee-82ddbd43faca", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1054223283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc2f7422d534064967a7bf458650f0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4d61a40-a5", "ovs_interfaceid": "a4d61a40-a5fd-4bca-899e-5569a7bc1e1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:41:29 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:a4:ae,bridge_name='br-int',has_traffic_filtering=True,id=a4d61a40-a5fd-4bca-899e-5569a7bc1e1b,network=Network(5b2a9095-d135-4b4a-9aee-82ddbd43faca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4d61a40-a5') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:41:29 user nova-compute[74190]: DEBUG os_vif [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:a4:ae,bridge_name='br-int',has_traffic_filtering=True,id=a4d61a40-a5fd-4bca-899e-5569a7bc1e1b,network=Network(5b2a9095-d135-4b4a-9aee-82ddbd43faca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4d61a40-a5') {{(pid=74190) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 11:41:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:41:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 11:41:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e3d13bb7-6e02-5535-9e38-b686fc768077', '_type': 'linux-noop'}}, row=False) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:41:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:41:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa4d61a40-a5, may_exist=True, interface_attrs={}) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:41:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa4d61a40-a5, col_values=(('qos', UUID('cef52e55-af40-4e15-9104-c7d2a3114e03')),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:41:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa4d61a40-a5, col_values=(('external_ids', {'iface-id': 'a4d61a40-a5fd-4bca-899e-5569a7bc1e1b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:39:a4:ae', 'vm-uuid': 'd56b243d-fbf2-4ae6-8399-80df46b33b82'}),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:41:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:41:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:30 user nova-compute[74190]: INFO os_vif [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:a4:ae,bridge_name='br-int',has_traffic_filtering=True,id=a4d61a40-a5fd-4bca-899e-5569a7bc1e1b,network=Network(5b2a9095-d135-4b4a-9aee-82ddbd43faca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4d61a40-a5')
Oct 18 11:41:30 user nova-compute[74190]: DEBUG nova.compute.manager [None req-47cc5745-cdb2-4584-8d6b-c8396fb7c05c tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] [instance: 034398e8-e8c4-4e03-a608-440e447c6041] Start spawning the instance on the hypervisor. {{(pid=74190) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 11:41:30 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-47cc5745-cdb2-4584-8d6b-c8396fb7c05c tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] [instance: 034398e8-e8c4-4e03-a608-440e447c6041] Creating instance directory {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 11:41:30 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-47cc5745-cdb2-4584-8d6b-c8396fb7c05c tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] [instance: 034398e8-e8c4-4e03-a608-440e447c6041] Creating image(s)
Oct 18 11:41:30 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-47cc5745-cdb2-4584-8d6b-c8396fb7c05c tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Acquiring lock "/opt/stack/data/nova/instances/034398e8-e8c4-4e03-a608-440e447c6041/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:41:30 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-47cc5745-cdb2-4584-8d6b-c8396fb7c05c tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Lock "/opt/stack/data/nova/instances/034398e8-e8c4-4e03-a608-440e447c6041/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:41:30 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-47cc5745-cdb2-4584-8d6b-c8396fb7c05c tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Lock "/opt/stack/data/nova/instances/034398e8-e8c4-4e03-a608-440e447c6041/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:41:30 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-47cc5745-cdb2-4584-8d6b-c8396fb7c05c tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:41:30 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] No BDM found with device name sda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 11:41:30 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 11:41:30 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] No VIF found with MAC fa:16:3e:39:a4:ae, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 11:41:30 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] [instance: d56b243d-fbf2-4ae6-8399-80df46b33b82] Using config drive
Oct 18 11:41:30 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-47cc5745-cdb2-4584-8d6b-c8396fb7c05c tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.188s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:41:30 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-47cc5745-cdb2-4584-8d6b-c8396fb7c05c tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Acquiring lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:41:30 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-47cc5745-cdb2-4584-8d6b-c8396fb7c05c tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:41:30 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-47cc5745-cdb2-4584-8d6b-c8396fb7c05c tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:41:30 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] [instance: d56b243d-fbf2-4ae6-8399-80df46b33b82] Creating config drive at /opt/stack/data/nova/instances/d56b243d-fbf2-4ae6-8399-80df46b33b82/disk.config
Oct 18 11:41:30 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d56b243d-fbf2-4ae6-8399-80df46b33b82/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp71r3j8pz {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:41:30 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-47cc5745-cdb2-4584-8d6b-c8396fb7c05c tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.271s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:41:30 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-47cc5745-cdb2-4584-8d6b-c8396fb7c05c tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f,backing_fmt=raw /opt/stack/data/nova/instances/034398e8-e8c4-4e03-a608-440e447c6041/disk 1073741824 {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:41:30 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d56b243d-fbf2-4ae6-8399-80df46b33b82/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp71r3j8pz" returned: 0 in 0.108s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:41:30 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-47cc5745-cdb2-4584-8d6b-c8396fb7c05c tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f,backing_fmt=raw /opt/stack/data/nova/instances/034398e8-e8c4-4e03-a608-440e447c6041/disk 1073741824" returned: 0 in 0.067s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:41:30 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-47cc5745-cdb2-4584-8d6b-c8396fb7c05c tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.347s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:41:30 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-47cc5745-cdb2-4584-8d6b-c8396fb7c05c tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:41:30 user nova-compute[74190]: DEBUG nova.compute.manager [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] Instance event wait completed in 0 seconds for  {{(pid=74190) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 11:41:30 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] Guest created on hypervisor {{(pid=74190) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 11:41:30 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] Instance spawned successfully.
Oct 18 11:41:30 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 11:41:30 user nova-compute[74190]: DEBUG nova.network.neutron [req-3775b96b-2c81-4aab-8818-bd3aa5ff98c9 req-ed78b9a2-cc86-4309-99b3-e3ff79412e31 service nova] [instance: d56b243d-fbf2-4ae6-8399-80df46b33b82] Updated VIF entry in instance network info cache for port a4d61a40-a5fd-4bca-899e-5569a7bc1e1b. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 11:41:30 user nova-compute[74190]: DEBUG nova.network.neutron [req-3775b96b-2c81-4aab-8818-bd3aa5ff98c9 req-ed78b9a2-cc86-4309-99b3-e3ff79412e31 service nova] [instance: d56b243d-fbf2-4ae6-8399-80df46b33b82] Updating instance_info_cache with network_info: [{"id": "a4d61a40-a5fd-4bca-899e-5569a7bc1e1b", "address": "fa:16:3e:39:a4:ae", "network": {"id": "5b2a9095-d135-4b4a-9aee-82ddbd43faca", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1054223283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc2f7422d534064967a7bf458650f0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4d61a40-a5", "ovs_interfaceid": "a4d61a40-a5fd-4bca-899e-5569a7bc1e1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:41:30 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-3775b96b-2c81-4aab-8818-bd3aa5ff98c9 req-ed78b9a2-cc86-4309-99b3-e3ff79412e31 service nova] Releasing lock "refresh_cache-d56b243d-fbf2-4ae6-8399-80df46b33b82" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:41:30 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] Found default for hw_cdrom_bus of ide {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:41:30 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] Found default for hw_disk_bus of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:41:30 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] Found default for hw_input_bus of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:41:30 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] Found default for hw_pointer_model of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:41:30 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] Found default for hw_video_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:41:30 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] Found default for hw_vif_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:41:30 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-47cc5745-cdb2-4584-8d6b-c8396fb7c05c tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.269s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:41:30 user nova-compute[74190]: DEBUG nova.virt.disk.api [None req-47cc5745-cdb2-4584-8d6b-c8396fb7c05c tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Checking if we can resize image /opt/stack/data/nova/instances/034398e8-e8c4-4e03-a608-440e447c6041/disk. size=1073741824 {{(pid=74190) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 18 11:41:30 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-47cc5745-cdb2-4584-8d6b-c8396fb7c05c tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034398e8-e8c4-4e03-a608-440e447c6041/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:41:31 user nova-compute[74190]: INFO nova.compute.manager [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] Took 11.86 seconds to spawn the instance on the hypervisor.
Oct 18 11:41:31 user nova-compute[74190]: DEBUG nova.compute.manager [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] Checking state {{(pid=74190) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 11:41:31 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-47cc5745-cdb2-4584-8d6b-c8396fb7c05c tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034398e8-e8c4-4e03-a608-440e447c6041/disk --force-share --output=json" returned: 0 in 0.438s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:41:31 user nova-compute[74190]: DEBUG nova.virt.disk.api [None req-47cc5745-cdb2-4584-8d6b-c8396fb7c05c tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Cannot resize image /opt/stack/data/nova/instances/034398e8-e8c4-4e03-a608-440e447c6041/disk to a smaller size. {{(pid=74190) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 18 11:41:31 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-47cc5745-cdb2-4584-8d6b-c8396fb7c05c tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] [instance: 034398e8-e8c4-4e03-a608-440e447c6041] Created local disks {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 11:41:31 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-47cc5745-cdb2-4584-8d6b-c8396fb7c05c tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] [instance: 034398e8-e8c4-4e03-a608-440e447c6041] Ensure instance console log exists: /opt/stack/data/nova/instances/034398e8-e8c4-4e03-a608-440e447c6041/console.log {{(pid=74190) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 11:41:31 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-47cc5745-cdb2-4584-8d6b-c8396fb7c05c tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:41:31 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-47cc5745-cdb2-4584-8d6b-c8396fb7c05c tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:41:31 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-47cc5745-cdb2-4584-8d6b-c8396fb7c05c tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:41:31 user nova-compute[74190]: INFO nova.compute.manager [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] Took 13.94 seconds to build instance.
Oct 18 11:41:31 user nova-compute[74190]: DEBUG nova.network.neutron [None req-47cc5745-cdb2-4584-8d6b-c8396fb7c05c tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] [instance: 034398e8-e8c4-4e03-a608-440e447c6041] Successfully created port: abefd824-cd1a-4947-996f-85553155dd8b {{(pid=74190) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 11:41:31 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-d0b081a5-5d63-43ae-b3da-4d7e317c0bad tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Lock "6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.137s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:41:32 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:32 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:32 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:32 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-80379c19-dfec-45b9-9364-200a23840bef tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] Acquiring lock "697d3123-bd6b-42b9-b278-c33c0c00da6f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:41:32 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-80379c19-dfec-45b9-9364-200a23840bef tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] Lock "697d3123-bd6b-42b9-b278-c33c0c00da6f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:41:32 user nova-compute[74190]: DEBUG nova.compute.manager [None req-80379c19-dfec-45b9-9364-200a23840bef tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f] Starting instance... {{(pid=74190) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 11:41:32 user nova-compute[74190]: DEBUG nova.network.neutron [None req-47cc5745-cdb2-4584-8d6b-c8396fb7c05c tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] [instance: 034398e8-e8c4-4e03-a608-440e447c6041] Successfully updated port: abefd824-cd1a-4947-996f-85553155dd8b {{(pid=74190) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 11:41:32 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-47cc5745-cdb2-4584-8d6b-c8396fb7c05c tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Acquiring lock "refresh_cache-034398e8-e8c4-4e03-a608-440e447c6041" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:41:32 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-47cc5745-cdb2-4584-8d6b-c8396fb7c05c tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Acquired lock "refresh_cache-034398e8-e8c4-4e03-a608-440e447c6041" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:41:32 user nova-compute[74190]: DEBUG nova.network.neutron [None req-47cc5745-cdb2-4584-8d6b-c8396fb7c05c tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] [instance: 034398e8-e8c4-4e03-a608-440e447c6041] Building network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 11:41:32 user nova-compute[74190]: DEBUG nova.compute.manager [req-7b820925-2a4e-4c85-bfd3-120392303274 req-ece97b55-aa07-4ed6-833e-eb9aba5d74c9 service nova] [instance: 034398e8-e8c4-4e03-a608-440e447c6041] Received event network-changed-abefd824-cd1a-4947-996f-85553155dd8b {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:41:32 user nova-compute[74190]: DEBUG nova.compute.manager [req-7b820925-2a4e-4c85-bfd3-120392303274 req-ece97b55-aa07-4ed6-833e-eb9aba5d74c9 service nova] [instance: 034398e8-e8c4-4e03-a608-440e447c6041] Refreshing instance network info cache due to event network-changed-abefd824-cd1a-4947-996f-85553155dd8b. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 11:41:32 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-7b820925-2a4e-4c85-bfd3-120392303274 req-ece97b55-aa07-4ed6-833e-eb9aba5d74c9 service nova] Acquiring lock "refresh_cache-034398e8-e8c4-4e03-a608-440e447c6041" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:41:32 user nova-compute[74190]: DEBUG nova.network.neutron [None req-47cc5745-cdb2-4584-8d6b-c8396fb7c05c tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] [instance: 034398e8-e8c4-4e03-a608-440e447c6041] Instance cache missing network info. {{(pid=74190) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 11:41:32 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-80379c19-dfec-45b9-9364-200a23840bef tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:41:32 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-80379c19-dfec-45b9-9364-200a23840bef tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:41:32 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-80379c19-dfec-45b9-9364-200a23840bef tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74190) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 11:41:32 user nova-compute[74190]: INFO nova.compute.claims [None req-80379c19-dfec-45b9-9364-200a23840bef tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f] Claim successful on node user
Oct 18 11:41:33 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:33 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:33 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:33 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:33 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-80379c19-dfec-45b9-9364-200a23840bef tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 11:41:33 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-80379c19-dfec-45b9-9364-200a23840bef tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 11:41:33 user nova-compute[74190]: DEBUG nova.network.neutron [None req-47cc5745-cdb2-4584-8d6b-c8396fb7c05c tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] [instance: 034398e8-e8c4-4e03-a608-440e447c6041] Updating instance_info_cache with network_info: [{"id": "abefd824-cd1a-4947-996f-85553155dd8b", "address": "fa:16:3e:42:84:1e", "network": {"id": "1424584d-abb9-4d38-bcdc-3c0969e1bf01", "bridge": "br-int", "label": "tempest-TestVolumeSwap-127887868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21f627e5a9344c9bad9923c2b0cbec3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabefd824-cd", "ovs_interfaceid": "abefd824-cd1a-4947-996f-85553155dd8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:41:33 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-47cc5745-cdb2-4584-8d6b-c8396fb7c05c tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Releasing lock "refresh_cache-034398e8-e8c4-4e03-a608-440e447c6041" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:41:33 user nova-compute[74190]: DEBUG nova.compute.manager [None req-47cc5745-cdb2-4584-8d6b-c8396fb7c05c tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] [instance: 034398e8-e8c4-4e03-a608-440e447c6041] Instance network_info: |[{"id": "abefd824-cd1a-4947-996f-85553155dd8b", "address": "fa:16:3e:42:84:1e", "network": {"id": "1424584d-abb9-4d38-bcdc-3c0969e1bf01", "bridge": "br-int", "label": "tempest-TestVolumeSwap-127887868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21f627e5a9344c9bad9923c2b0cbec3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabefd824-cd", "ovs_interfaceid": "abefd824-cd1a-4947-996f-85553155dd8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 11:41:33 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-80379c19-dfec-45b9-9364-200a23840bef tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.743s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:41:33 user nova-compute[74190]: DEBUG nova.compute.manager [None req-80379c19-dfec-45b9-9364-200a23840bef tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f] Start building networks asynchronously for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 11:41:33 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-7b820925-2a4e-4c85-bfd3-120392303274 req-ece97b55-aa07-4ed6-833e-eb9aba5d74c9 service nova] Acquired lock "refresh_cache-034398e8-e8c4-4e03-a608-440e447c6041" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:41:33 user nova-compute[74190]: DEBUG nova.network.neutron [req-7b820925-2a4e-4c85-bfd3-120392303274 req-ece97b55-aa07-4ed6-833e-eb9aba5d74c9 service nova] [instance: 034398e8-e8c4-4e03-a608-440e447c6041] Refreshing network info cache for port abefd824-cd1a-4947-996f-85553155dd8b {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 11:41:33 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-47cc5745-cdb2-4584-8d6b-c8396fb7c05c tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] [instance: 034398e8-e8c4-4e03-a608-440e447c6041] Start _get_guest_xml network_info=[{"id": "abefd824-cd1a-4947-996f-85553155dd8b", "address": "fa:16:3e:42:84:1e", "network": {"id": "1424584d-abb9-4d38-bcdc-3c0969e1bf01", "bridge": "br-int", "label": "tempest-TestVolumeSwap-127887868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21f627e5a9344c9bad9923c2b0cbec3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabefd824-cd", "ovs_interfaceid": "abefd824-cd1a-4947-996f-85553155dd8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'image_id': '6e88bbf0-6e78-49a8-b3c5-9453d22a89df'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 11:41:33 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-47cc5745-cdb2-4584-8d6b-c8396fb7c05c tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:41:33 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-47cc5745-cdb2-4584-8d6b-c8396fb7c05c tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:41:33 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-47cc5745-cdb2-4584-8d6b-c8396fb7c05c tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 11:41:33 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-47cc5745-cdb2-4584-8d6b-c8396fb7c05c tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] CPU controller missing on host. {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 11:41:33 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-47cc5745-cdb2-4584-8d6b-c8396fb7c05c tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 11:41:33 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-47cc5745-cdb2-4584-8d6b-c8396fb7c05c tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] CPU controller found on host. {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 11:41:33 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-47cc5745-cdb2-4584-8d6b-c8396fb7c05c tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74190) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 11:41:33 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-47cc5745-cdb2-4584-8d6b-c8396fb7c05c tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T11:37:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 11:41:33 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-47cc5745-cdb2-4584-8d6b-c8396fb7c05c tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Flavor limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 11:41:33 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-47cc5745-cdb2-4584-8d6b-c8396fb7c05c tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Image limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 11:41:33 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-47cc5745-cdb2-4584-8d6b-c8396fb7c05c tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Flavor pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 11:41:33 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-47cc5745-cdb2-4584-8d6b-c8396fb7c05c tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Image pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 11:41:33 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-47cc5745-cdb2-4584-8d6b-c8396fb7c05c tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 11:41:33 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-47cc5745-cdb2-4584-8d6b-c8396fb7c05c tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 11:41:33 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-47cc5745-cdb2-4584-8d6b-c8396fb7c05c tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 11:41:33 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-47cc5745-cdb2-4584-8d6b-c8396fb7c05c tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Got 1 possible topologies {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 11:41:33 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-47cc5745-cdb2-4584-8d6b-c8396fb7c05c tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 11:41:33 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-47cc5745-cdb2-4584-8d6b-c8396fb7c05c tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 11:41:33 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-47cc5745-cdb2-4584-8d6b-c8396fb7c05c tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:41:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1784183391',display_name='tempest-TestVolumeSwap-server-1784183391',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1784183391',id=7,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJWN+onDAlmnEVCYcz/0ARd9rVyKVLT5sVo/ztAOW+tHwQVRoLQRXLpJ4tjJ9+2d4yIDw3vBhx3lpVM69nyC2kABxoaIXrV2usOW6AAD9qfsN/NYQGSY7RnCwvCIGxVraA==',key_name='tempest-keypair-1866958635',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21f627e5a9344c9bad9923c2b0cbec3b',ramdisk_id='',reservation_id='r-rcmji229',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1982013856',owner_user_name='tempest-TestVolumeSwap-1982013856-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:41:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dfa9681837ca44ca933fd55bf453a182',uuid=034398e8-e8c4-4e03-a608-440e447c6041,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "abefd824-cd1a-4947-996f-85553155dd8b", "address": "fa:16:3e:42:84:1e", "network": {"id": "1424584d-abb9-4d38-bcdc-3c0969e1bf01", "bridge": "br-int", "label": "tempest-TestVolumeSwap-127887868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21f627e5a9344c9bad9923c2b0cbec3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabefd824-cd", "ovs_interfaceid": "abefd824-cd1a-4947-996f-85553155dd8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74190) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 11:41:33 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-47cc5745-cdb2-4584-8d6b-c8396fb7c05c tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Converting VIF {"id": "abefd824-cd1a-4947-996f-85553155dd8b", "address": "fa:16:3e:42:84:1e", "network": {"id": "1424584d-abb9-4d38-bcdc-3c0969e1bf01", "bridge": "br-int", "label": "tempest-TestVolumeSwap-127887868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21f627e5a9344c9bad9923c2b0cbec3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabefd824-cd", "ovs_interfaceid": "abefd824-cd1a-4947-996f-85553155dd8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:41:33 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-47cc5745-cdb2-4584-8d6b-c8396fb7c05c tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:84:1e,bridge_name='br-int',has_traffic_filtering=True,id=abefd824-cd1a-4947-996f-85553155dd8b,network=Network(1424584d-abb9-4d38-bcdc-3c0969e1bf01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabefd824-cd') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:41:33 user nova-compute[74190]: DEBUG nova.objects.instance [None req-47cc5745-cdb2-4584-8d6b-c8396fb7c05c tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Lazy-loading 'pci_devices' on Instance uuid 034398e8-e8c4-4e03-a608-440e447c6041 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:41:33 user nova-compute[74190]: DEBUG nova.compute.manager [None req-80379c19-dfec-45b9-9364-200a23840bef tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f] Allocating IP information in the background. {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 11:41:33 user nova-compute[74190]: DEBUG nova.network.neutron [None req-80379c19-dfec-45b9-9364-200a23840bef tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f] allocate_for_instance() {{(pid=74190) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 11:41:33 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-47cc5745-cdb2-4584-8d6b-c8396fb7c05c tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] [instance: 034398e8-e8c4-4e03-a608-440e447c6041] End _get_guest_xml xml=<domain type="kvm">
Oct 18 11:41:33 user nova-compute[74190]:   <uuid>034398e8-e8c4-4e03-a608-440e447c6041</uuid>
Oct 18 11:41:33 user nova-compute[74190]:   <name>instance-00000007</name>
Oct 18 11:41:33 user nova-compute[74190]:   <memory>524288</memory>
Oct 18 11:41:33 user nova-compute[74190]:   <vcpu>1</vcpu>
Oct 18 11:41:33 user nova-compute[74190]:   <metadata>
Oct 18 11:41:33 user nova-compute[74190]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 11:41:33 user nova-compute[74190]:       <nova:package version="0.0.0"/>
Oct 18 11:41:33 user nova-compute[74190]:       <nova:name>tempest-TestVolumeSwap-server-1784183391</nova:name>
Oct 18 11:41:33 user nova-compute[74190]:       <nova:creationTime>2023-10-18 11:41:33</nova:creationTime>
Oct 18 11:41:33 user nova-compute[74190]:       <nova:flavor name="m1.tiny">
Oct 18 11:41:33 user nova-compute[74190]:         <nova:memory>512</nova:memory>
Oct 18 11:41:33 user nova-compute[74190]:         <nova:disk>1</nova:disk>
Oct 18 11:41:33 user nova-compute[74190]:         <nova:swap>0</nova:swap>
Oct 18 11:41:33 user nova-compute[74190]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 11:41:33 user nova-compute[74190]:         <nova:vcpus>1</nova:vcpus>
Oct 18 11:41:33 user nova-compute[74190]:       </nova:flavor>
Oct 18 11:41:33 user nova-compute[74190]:       <nova:owner>
Oct 18 11:41:33 user nova-compute[74190]:         <nova:user uuid="dfa9681837ca44ca933fd55bf453a182">tempest-TestVolumeSwap-1982013856-project-member</nova:user>
Oct 18 11:41:33 user nova-compute[74190]:         <nova:project uuid="21f627e5a9344c9bad9923c2b0cbec3b">tempest-TestVolumeSwap-1982013856</nova:project>
Oct 18 11:41:33 user nova-compute[74190]:       </nova:owner>
Oct 18 11:41:33 user nova-compute[74190]:       <nova:root type="image" uuid="6e88bbf0-6e78-49a8-b3c5-9453d22a89df"/>
Oct 18 11:41:33 user nova-compute[74190]:       <nova:ports>
Oct 18 11:41:33 user nova-compute[74190]:         <nova:port uuid="abefd824-cd1a-4947-996f-85553155dd8b">
Oct 18 11:41:33 user nova-compute[74190]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 18 11:41:33 user nova-compute[74190]:         </nova:port>
Oct 18 11:41:33 user nova-compute[74190]:       </nova:ports>
Oct 18 11:41:33 user nova-compute[74190]:     </nova:instance>
Oct 18 11:41:33 user nova-compute[74190]:   </metadata>
Oct 18 11:41:33 user nova-compute[74190]:   <sysinfo type="smbios">
Oct 18 11:41:33 user nova-compute[74190]:     <system>
Oct 18 11:41:33 user nova-compute[74190]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 11:41:33 user nova-compute[74190]:       <entry name="product">OpenStack Nova</entry>
Oct 18 11:41:33 user nova-compute[74190]:       <entry name="version">0.0.0</entry>
Oct 18 11:41:33 user nova-compute[74190]:       <entry name="serial">034398e8-e8c4-4e03-a608-440e447c6041</entry>
Oct 18 11:41:33 user nova-compute[74190]:       <entry name="uuid">034398e8-e8c4-4e03-a608-440e447c6041</entry>
Oct 18 11:41:33 user nova-compute[74190]:       <entry name="family">Virtual Machine</entry>
Oct 18 11:41:33 user nova-compute[74190]:     </system>
Oct 18 11:41:33 user nova-compute[74190]:   </sysinfo>
Oct 18 11:41:33 user nova-compute[74190]:   <os>
Oct 18 11:41:33 user nova-compute[74190]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 11:41:33 user nova-compute[74190]:     <boot dev="hd"/>
Oct 18 11:41:33 user nova-compute[74190]:     <smbios mode="sysinfo"/>
Oct 18 11:41:33 user nova-compute[74190]:   </os>
Oct 18 11:41:33 user nova-compute[74190]:   <features>
Oct 18 11:41:33 user nova-compute[74190]:     <acpi/>
Oct 18 11:41:33 user nova-compute[74190]:     <apic/>
Oct 18 11:41:33 user nova-compute[74190]:     <vmcoreinfo/>
Oct 18 11:41:33 user nova-compute[74190]:   </features>
Oct 18 11:41:33 user nova-compute[74190]:   <clock offset="utc">
Oct 18 11:41:33 user nova-compute[74190]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 11:41:33 user nova-compute[74190]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 11:41:33 user nova-compute[74190]:     <timer name="hpet" present="no"/>
Oct 18 11:41:33 user nova-compute[74190]:   </clock>
Oct 18 11:41:33 user nova-compute[74190]:   <cpu mode="custom" match="exact">
Oct 18 11:41:33 user nova-compute[74190]:     <model>Nehalem</model>
Oct 18 11:41:33 user nova-compute[74190]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 11:41:33 user nova-compute[74190]:   </cpu>
Oct 18 11:41:33 user nova-compute[74190]:   <devices>
Oct 18 11:41:33 user nova-compute[74190]:     <disk type="file" device="disk">
Oct 18 11:41:33 user nova-compute[74190]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 11:41:33 user nova-compute[74190]:       <source file="/opt/stack/data/nova/instances/034398e8-e8c4-4e03-a608-440e447c6041/disk"/>
Oct 18 11:41:33 user nova-compute[74190]:       <target dev="vda" bus="virtio"/>
Oct 18 11:41:33 user nova-compute[74190]:     </disk>
Oct 18 11:41:33 user nova-compute[74190]:     <interface type="ethernet">
Oct 18 11:41:33 user nova-compute[74190]:       <mac address="fa:16:3e:42:84:1e"/>
Oct 18 11:41:33 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:41:33 user nova-compute[74190]:       <mtu size="1442"/>
Oct 18 11:41:33 user nova-compute[74190]:       <target dev="tapabefd824-cd"/>
Oct 18 11:41:33 user nova-compute[74190]:     </interface>
Oct 18 11:41:33 user nova-compute[74190]:     <serial type="pty">
Oct 18 11:41:33 user nova-compute[74190]:       <log file="/opt/stack/data/nova/instances/034398e8-e8c4-4e03-a608-440e447c6041/console.log" append="off"/>
Oct 18 11:41:33 user nova-compute[74190]:     </serial>
Oct 18 11:41:33 user nova-compute[74190]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 11:41:33 user nova-compute[74190]:     <video>
Oct 18 11:41:33 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:41:33 user nova-compute[74190]:     </video>
Oct 18 11:41:33 user nova-compute[74190]:     <rng model="virtio">
Oct 18 11:41:33 user nova-compute[74190]:       <backend model="random">/dev/urandom</backend>
Oct 18 11:41:33 user nova-compute[74190]:     </rng>
Oct 18 11:41:33 user nova-compute[74190]:     <controller type="usb" index="0" model="none"/>
Oct 18 11:41:33 user nova-compute[74190]:     <memballoon model="virtio">
Oct 18 11:41:33 user nova-compute[74190]:       <stats period="10"/>
Oct 18 11:41:33 user nova-compute[74190]:     </memballoon>
Oct 18 11:41:33 user nova-compute[74190]:   </devices>
Oct 18 11:41:33 user nova-compute[74190]: </domain>
Oct 18 11:41:33 user nova-compute[74190]:  {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 11:41:33 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-47cc5745-cdb2-4584-8d6b-c8396fb7c05c tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:41:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1784183391',display_name='tempest-TestVolumeSwap-server-1784183391',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1784183391',id=7,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJWN+onDAlmnEVCYcz/0ARd9rVyKVLT5sVo/ztAOW+tHwQVRoLQRXLpJ4tjJ9+2d4yIDw3vBhx3lpVM69nyC2kABxoaIXrV2usOW6AAD9qfsN/NYQGSY7RnCwvCIGxVraA==',key_name='tempest-keypair-1866958635',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21f627e5a9344c9bad9923c2b0cbec3b',ramdisk_id='',reservation_id='r-rcmji229',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1982013856',owner_user_name='tempest-TestVolumeSwap-1982013856-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:41:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dfa9681837ca44ca933fd55bf453a182',uuid=034398e8-e8c4-4e03-a608-440e447c6041,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "abefd824-cd1a-4947-996f-85553155dd8b", "address": "fa:16:3e:42:84:1e", "network": {"id": "1424584d-abb9-4d38-bcdc-3c0969e1bf01", "bridge": "br-int", "label": "tempest-TestVolumeSwap-127887868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21f627e5a9344c9bad9923c2b0cbec3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabefd824-cd", "ovs_interfaceid": "abefd824-cd1a-4947-996f-85553155dd8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 11:41:33 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-47cc5745-cdb2-4584-8d6b-c8396fb7c05c tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Converting VIF {"id": "abefd824-cd1a-4947-996f-85553155dd8b", "address": "fa:16:3e:42:84:1e", "network": {"id": "1424584d-abb9-4d38-bcdc-3c0969e1bf01", "bridge": "br-int", "label": "tempest-TestVolumeSwap-127887868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21f627e5a9344c9bad9923c2b0cbec3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabefd824-cd", "ovs_interfaceid": "abefd824-cd1a-4947-996f-85553155dd8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:41:33 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-47cc5745-cdb2-4584-8d6b-c8396fb7c05c tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:84:1e,bridge_name='br-int',has_traffic_filtering=True,id=abefd824-cd1a-4947-996f-85553155dd8b,network=Network(1424584d-abb9-4d38-bcdc-3c0969e1bf01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabefd824-cd') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:41:33 user nova-compute[74190]: DEBUG os_vif [None req-47cc5745-cdb2-4584-8d6b-c8396fb7c05c tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:84:1e,bridge_name='br-int',has_traffic_filtering=True,id=abefd824-cd1a-4947-996f-85553155dd8b,network=Network(1424584d-abb9-4d38-bcdc-3c0969e1bf01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabefd824-cd') {{(pid=74190) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 11:41:33 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:33 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:41:33 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 11:41:33 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:33 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '467f184a-c355-501b-961c-e4f14873ffde', '_type': 'linux-noop'}}, row=False) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:41:33 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:33 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:41:33 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-80379c19-dfec-45b9-9364-200a23840bef tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 11:41:33 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:33 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapabefd824-cd, may_exist=True, interface_attrs={}) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:41:33 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapabefd824-cd, col_values=(('qos', UUID('9a77450c-67a4-4895-972c-4e1acb5334a9')),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:41:33 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapabefd824-cd, col_values=(('external_ids', {'iface-id': 'abefd824-cd1a-4947-996f-85553155dd8b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:42:84:1e', 'vm-uuid': '034398e8-e8c4-4e03-a608-440e447c6041'}),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:41:33 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:33 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:41:33 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:33 user nova-compute[74190]: INFO os_vif [None req-47cc5745-cdb2-4584-8d6b-c8396fb7c05c tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:84:1e,bridge_name='br-int',has_traffic_filtering=True,id=abefd824-cd1a-4947-996f-85553155dd8b,network=Network(1424584d-abb9-4d38-bcdc-3c0969e1bf01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabefd824-cd')
Oct 18 11:41:33 user nova-compute[74190]: DEBUG nova.compute.manager [None req-80379c19-dfec-45b9-9364-200a23840bef tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f] Start building block device mappings for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 11:41:33 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:33 user nova-compute[74190]: DEBUG nova.policy [None req-80379c19-dfec-45b9-9364-200a23840bef tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2bbf67b2fa0149c19a86fa723f662569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5cced34b384eb79833c41a1c607ef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74190) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 11:41:33 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-47cc5745-cdb2-4584-8d6b-c8396fb7c05c tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] No BDM found with device name vda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 11:41:33 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-47cc5745-cdb2-4584-8d6b-c8396fb7c05c tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] No VIF found with MAC fa:16:3e:42:84:1e, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 11:41:34 user nova-compute[74190]: DEBUG nova.compute.manager [None req-80379c19-dfec-45b9-9364-200a23840bef tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f] Start spawning the instance on the hypervisor. {{(pid=74190) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 11:41:34 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-80379c19-dfec-45b9-9364-200a23840bef tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f] Creating instance directory {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 11:41:34 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-80379c19-dfec-45b9-9364-200a23840bef tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f] Creating image(s)
Oct 18 11:41:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-80379c19-dfec-45b9-9364-200a23840bef tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] Acquiring lock "/opt/stack/data/nova/instances/697d3123-bd6b-42b9-b278-c33c0c00da6f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:41:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-80379c19-dfec-45b9-9364-200a23840bef tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] Lock "/opt/stack/data/nova/instances/697d3123-bd6b-42b9-b278-c33c0c00da6f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:41:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-80379c19-dfec-45b9-9364-200a23840bef tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] Lock "/opt/stack/data/nova/instances/697d3123-bd6b-42b9-b278-c33c0c00da6f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:41:34 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-80379c19-dfec-45b9-9364-200a23840bef tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:41:34 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-80379c19-dfec-45b9-9364-200a23840bef tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.261s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:41:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-80379c19-dfec-45b9-9364-200a23840bef tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] Acquiring lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:41:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-80379c19-dfec-45b9-9364-200a23840bef tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] Lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:41:34 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-80379c19-dfec-45b9-9364-200a23840bef tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:41:34 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-80379c19-dfec-45b9-9364-200a23840bef tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.330s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:41:34 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-80379c19-dfec-45b9-9364-200a23840bef tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f,backing_fmt=raw /opt/stack/data/nova/instances/697d3123-bd6b-42b9-b278-c33c0c00da6f/disk 1073741824 {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:41:34 user nova-compute[74190]: DEBUG nova.compute.manager [req-6793bdc4-f557-436a-93cc-e6021e657fa3 req-26e7338a-01bd-4600-a3bf-2f5a93e8438e service nova] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Received event network-vif-plugged-8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:41:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-6793bdc4-f557-436a-93cc-e6021e657fa3 req-26e7338a-01bd-4600-a3bf-2f5a93e8438e service nova] Acquiring lock "3c3cce66-9d7a-4f23-a92a-d10b3efd5e86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:41:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-6793bdc4-f557-436a-93cc-e6021e657fa3 req-26e7338a-01bd-4600-a3bf-2f5a93e8438e service nova] Lock "3c3cce66-9d7a-4f23-a92a-d10b3efd5e86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:41:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-6793bdc4-f557-436a-93cc-e6021e657fa3 req-26e7338a-01bd-4600-a3bf-2f5a93e8438e service nova] Lock "3c3cce66-9d7a-4f23-a92a-d10b3efd5e86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:41:34 user nova-compute[74190]: DEBUG nova.compute.manager [req-6793bdc4-f557-436a-93cc-e6021e657fa3 req-26e7338a-01bd-4600-a3bf-2f5a93e8438e service nova] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] No waiting events found dispatching network-vif-plugged-8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:41:34 user nova-compute[74190]: WARNING nova.compute.manager [req-6793bdc4-f557-436a-93cc-e6021e657fa3 req-26e7338a-01bd-4600-a3bf-2f5a93e8438e service nova] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Received unexpected event network-vif-plugged-8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9 for instance with vm_state active and task_state None.
Oct 18 11:41:34 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-80379c19-dfec-45b9-9364-200a23840bef tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f,backing_fmt=raw /opt/stack/data/nova/instances/697d3123-bd6b-42b9-b278-c33c0c00da6f/disk 1073741824" returned: 0 in 0.173s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:41:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-80379c19-dfec-45b9-9364-200a23840bef tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] Lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.510s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:41:34 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-80379c19-dfec-45b9-9364-200a23840bef tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:41:35 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-80379c19-dfec-45b9-9364-200a23840bef tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.348s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:41:35 user nova-compute[74190]: DEBUG nova.virt.disk.api [None req-80379c19-dfec-45b9-9364-200a23840bef tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] Checking if we can resize image /opt/stack/data/nova/instances/697d3123-bd6b-42b9-b278-c33c0c00da6f/disk. size=1073741824 {{(pid=74190) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 18 11:41:35 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-80379c19-dfec-45b9-9364-200a23840bef tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/697d3123-bd6b-42b9-b278-c33c0c00da6f/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:41:35 user nova-compute[74190]: DEBUG nova.network.neutron [req-7b820925-2a4e-4c85-bfd3-120392303274 req-ece97b55-aa07-4ed6-833e-eb9aba5d74c9 service nova] [instance: 034398e8-e8c4-4e03-a608-440e447c6041] Updated VIF entry in instance network info cache for port abefd824-cd1a-4947-996f-85553155dd8b. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 11:41:35 user nova-compute[74190]: DEBUG nova.network.neutron [req-7b820925-2a4e-4c85-bfd3-120392303274 req-ece97b55-aa07-4ed6-833e-eb9aba5d74c9 service nova] [instance: 034398e8-e8c4-4e03-a608-440e447c6041] Updating instance_info_cache with network_info: [{"id": "abefd824-cd1a-4947-996f-85553155dd8b", "address": "fa:16:3e:42:84:1e", "network": {"id": "1424584d-abb9-4d38-bcdc-3c0969e1bf01", "bridge": "br-int", "label": "tempest-TestVolumeSwap-127887868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21f627e5a9344c9bad9923c2b0cbec3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabefd824-cd", "ovs_interfaceid": "abefd824-cd1a-4947-996f-85553155dd8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:41:35 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-7b820925-2a4e-4c85-bfd3-120392303274 req-ece97b55-aa07-4ed6-833e-eb9aba5d74c9 service nova] Releasing lock "refresh_cache-034398e8-e8c4-4e03-a608-440e447c6041" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:41:35 user nova-compute[74190]: DEBUG nova.compute.manager [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] [instance: d56b243d-fbf2-4ae6-8399-80df46b33b82] Instance event wait completed in 0 seconds for  {{(pid=74190) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 11:41:35 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] [instance: d56b243d-fbf2-4ae6-8399-80df46b33b82] Guest created on hypervisor {{(pid=74190) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 11:41:35 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: d56b243d-fbf2-4ae6-8399-80df46b33b82] Instance spawned successfully.
Oct 18 11:41:35 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] [instance: d56b243d-fbf2-4ae6-8399-80df46b33b82] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 11:41:35 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] [instance: d56b243d-fbf2-4ae6-8399-80df46b33b82] Found default for hw_input_bus of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:41:35 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] [instance: d56b243d-fbf2-4ae6-8399-80df46b33b82] Found default for hw_pointer_model of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:41:35 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] [instance: d56b243d-fbf2-4ae6-8399-80df46b33b82] Found default for hw_video_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:41:35 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] [instance: d56b243d-fbf2-4ae6-8399-80df46b33b82] Found default for hw_vif_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:41:35 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:35 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-80379c19-dfec-45b9-9364-200a23840bef tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/697d3123-bd6b-42b9-b278-c33c0c00da6f/disk --force-share --output=json" returned: 0 in 0.397s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:41:35 user nova-compute[74190]: DEBUG nova.virt.disk.api [None req-80379c19-dfec-45b9-9364-200a23840bef tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] Cannot resize image /opt/stack/data/nova/instances/697d3123-bd6b-42b9-b278-c33c0c00da6f/disk to a smaller size. {{(pid=74190) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 18 11:41:35 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-80379c19-dfec-45b9-9364-200a23840bef tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f] Created local disks {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 11:41:35 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-80379c19-dfec-45b9-9364-200a23840bef tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f] Ensure instance console log exists: /opt/stack/data/nova/instances/697d3123-bd6b-42b9-b278-c33c0c00da6f/console.log {{(pid=74190) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 11:41:35 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-80379c19-dfec-45b9-9364-200a23840bef tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:41:35 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-80379c19-dfec-45b9-9364-200a23840bef tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:41:35 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-80379c19-dfec-45b9-9364-200a23840bef tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:41:35 user nova-compute[74190]: INFO nova.compute.manager [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] [instance: d56b243d-fbf2-4ae6-8399-80df46b33b82] Took 11.35 seconds to spawn the instance on the hypervisor.
Oct 18 11:41:35 user nova-compute[74190]: DEBUG nova.compute.manager [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] [instance: d56b243d-fbf2-4ae6-8399-80df46b33b82] Checking state {{(pid=74190) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 11:41:35 user nova-compute[74190]: DEBUG nova.network.neutron [None req-80379c19-dfec-45b9-9364-200a23840bef tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f] Successfully created port: 9087f286-715a-4bb2-a211-27119477ac6b {{(pid=74190) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 11:41:35 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:35 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:35 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:35 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:35 user nova-compute[74190]: INFO nova.compute.manager [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] [instance: d56b243d-fbf2-4ae6-8399-80df46b33b82] Took 13.10 seconds to build instance.
Oct 18 11:41:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-e763815c-915e-45d4-9050-5704b953d84a tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Lock "d56b243d-fbf2-4ae6-8399-80df46b33b82" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.383s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:41:36 user nova-compute[74190]: DEBUG nova.compute.manager [req-c61aecbb-1030-4f2e-afe7-c9ed1748b999 req-3472740c-7a2a-4aa7-97dd-094714a58b0c service nova] [instance: 034398e8-e8c4-4e03-a608-440e447c6041] Received event network-vif-plugged-abefd824-cd1a-4947-996f-85553155dd8b {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:41:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-c61aecbb-1030-4f2e-afe7-c9ed1748b999 req-3472740c-7a2a-4aa7-97dd-094714a58b0c service nova] Acquiring lock "034398e8-e8c4-4e03-a608-440e447c6041-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:41:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-c61aecbb-1030-4f2e-afe7-c9ed1748b999 req-3472740c-7a2a-4aa7-97dd-094714a58b0c service nova] Lock "034398e8-e8c4-4e03-a608-440e447c6041-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:41:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-c61aecbb-1030-4f2e-afe7-c9ed1748b999 req-3472740c-7a2a-4aa7-97dd-094714a58b0c service nova] Lock "034398e8-e8c4-4e03-a608-440e447c6041-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:41:36 user nova-compute[74190]: DEBUG nova.compute.manager [req-c61aecbb-1030-4f2e-afe7-c9ed1748b999 req-3472740c-7a2a-4aa7-97dd-094714a58b0c service nova] [instance: 034398e8-e8c4-4e03-a608-440e447c6041] No waiting events found dispatching network-vif-plugged-abefd824-cd1a-4947-996f-85553155dd8b {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:41:36 user nova-compute[74190]: WARNING nova.compute.manager [req-c61aecbb-1030-4f2e-afe7-c9ed1748b999 req-3472740c-7a2a-4aa7-97dd-094714a58b0c service nova] [instance: 034398e8-e8c4-4e03-a608-440e447c6041] Received unexpected event network-vif-plugged-abefd824-cd1a-4947-996f-85553155dd8b for instance with vm_state building and task_state spawning.
Oct 18 11:41:36 user nova-compute[74190]: DEBUG nova.compute.manager [req-01f7a618-7252-4435-8ae3-f46febb15b08 req-77b42e2f-8846-405b-9a96-4ff964d95466 service nova] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Received event network-vif-plugged-8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:41:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-01f7a618-7252-4435-8ae3-f46febb15b08 req-77b42e2f-8846-405b-9a96-4ff964d95466 service nova] Acquiring lock "3c3cce66-9d7a-4f23-a92a-d10b3efd5e86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:41:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-01f7a618-7252-4435-8ae3-f46febb15b08 req-77b42e2f-8846-405b-9a96-4ff964d95466 service nova] Lock "3c3cce66-9d7a-4f23-a92a-d10b3efd5e86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:41:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-01f7a618-7252-4435-8ae3-f46febb15b08 req-77b42e2f-8846-405b-9a96-4ff964d95466 service nova] Lock "3c3cce66-9d7a-4f23-a92a-d10b3efd5e86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:41:36 user nova-compute[74190]: DEBUG nova.compute.manager [req-01f7a618-7252-4435-8ae3-f46febb15b08 req-77b42e2f-8846-405b-9a96-4ff964d95466 service nova] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] No waiting events found dispatching network-vif-plugged-8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:41:36 user nova-compute[74190]: WARNING nova.compute.manager [req-01f7a618-7252-4435-8ae3-f46febb15b08 req-77b42e2f-8846-405b-9a96-4ff964d95466 service nova] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Received unexpected event network-vif-plugged-8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9 for instance with vm_state active and task_state None.
Oct 18 11:41:36 user nova-compute[74190]: DEBUG nova.compute.manager [req-01f7a618-7252-4435-8ae3-f46febb15b08 req-77b42e2f-8846-405b-9a96-4ff964d95466 service nova] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] Received event network-vif-plugged-5e4eb783-7e7c-4501-bf99-33472454f4ac {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:41:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-01f7a618-7252-4435-8ae3-f46febb15b08 req-77b42e2f-8846-405b-9a96-4ff964d95466 service nova] Acquiring lock "0209c824-88a7-4976-83bf-8a72437f0cc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:41:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-01f7a618-7252-4435-8ae3-f46febb15b08 req-77b42e2f-8846-405b-9a96-4ff964d95466 service nova] Lock "0209c824-88a7-4976-83bf-8a72437f0cc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:41:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-01f7a618-7252-4435-8ae3-f46febb15b08 req-77b42e2f-8846-405b-9a96-4ff964d95466 service nova] Lock "0209c824-88a7-4976-83bf-8a72437f0cc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:41:36 user nova-compute[74190]: DEBUG nova.compute.manager [req-01f7a618-7252-4435-8ae3-f46febb15b08 req-77b42e2f-8846-405b-9a96-4ff964d95466 service nova] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] No waiting events found dispatching network-vif-plugged-5e4eb783-7e7c-4501-bf99-33472454f4ac {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:41:36 user nova-compute[74190]: WARNING nova.compute.manager [req-01f7a618-7252-4435-8ae3-f46febb15b08 req-77b42e2f-8846-405b-9a96-4ff964d95466 service nova] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] Received unexpected event network-vif-plugged-5e4eb783-7e7c-4501-bf99-33472454f4ac for instance with vm_state active and task_state None.
Oct 18 11:41:36 user nova-compute[74190]: DEBUG nova.compute.manager [req-01f7a618-7252-4435-8ae3-f46febb15b08 req-77b42e2f-8846-405b-9a96-4ff964d95466 service nova] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] Received event network-vif-plugged-5e4eb783-7e7c-4501-bf99-33472454f4ac {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:41:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-01f7a618-7252-4435-8ae3-f46febb15b08 req-77b42e2f-8846-405b-9a96-4ff964d95466 service nova] Acquiring lock "0209c824-88a7-4976-83bf-8a72437f0cc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:41:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-01f7a618-7252-4435-8ae3-f46febb15b08 req-77b42e2f-8846-405b-9a96-4ff964d95466 service nova] Lock "0209c824-88a7-4976-83bf-8a72437f0cc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:41:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-01f7a618-7252-4435-8ae3-f46febb15b08 req-77b42e2f-8846-405b-9a96-4ff964d95466 service nova] Lock "0209c824-88a7-4976-83bf-8a72437f0cc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:41:36 user nova-compute[74190]: DEBUG nova.compute.manager [req-01f7a618-7252-4435-8ae3-f46febb15b08 req-77b42e2f-8846-405b-9a96-4ff964d95466 service nova] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] No waiting events found dispatching network-vif-plugged-5e4eb783-7e7c-4501-bf99-33472454f4ac {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:41:36 user nova-compute[74190]: WARNING nova.compute.manager [req-01f7a618-7252-4435-8ae3-f46febb15b08 req-77b42e2f-8846-405b-9a96-4ff964d95466 service nova] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] Received unexpected event network-vif-plugged-5e4eb783-7e7c-4501-bf99-33472454f4ac for instance with vm_state active and task_state None.
Oct 18 11:41:36 user nova-compute[74190]: DEBUG nova.compute.manager [req-01f7a618-7252-4435-8ae3-f46febb15b08 req-77b42e2f-8846-405b-9a96-4ff964d95466 service nova] [instance: d56b243d-fbf2-4ae6-8399-80df46b33b82] Received event network-vif-plugged-a4d61a40-a5fd-4bca-899e-5569a7bc1e1b {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:41:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-01f7a618-7252-4435-8ae3-f46febb15b08 req-77b42e2f-8846-405b-9a96-4ff964d95466 service nova] Acquiring lock "d56b243d-fbf2-4ae6-8399-80df46b33b82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:41:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-01f7a618-7252-4435-8ae3-f46febb15b08 req-77b42e2f-8846-405b-9a96-4ff964d95466 service nova] Lock "d56b243d-fbf2-4ae6-8399-80df46b33b82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:41:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-01f7a618-7252-4435-8ae3-f46febb15b08 req-77b42e2f-8846-405b-9a96-4ff964d95466 service nova] Lock "d56b243d-fbf2-4ae6-8399-80df46b33b82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:41:36 user nova-compute[74190]: DEBUG nova.compute.manager [req-01f7a618-7252-4435-8ae3-f46febb15b08 req-77b42e2f-8846-405b-9a96-4ff964d95466 service nova] [instance: d56b243d-fbf2-4ae6-8399-80df46b33b82] No waiting events found dispatching network-vif-plugged-a4d61a40-a5fd-4bca-899e-5569a7bc1e1b {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:41:36 user nova-compute[74190]: WARNING nova.compute.manager [req-01f7a618-7252-4435-8ae3-f46febb15b08 req-77b42e2f-8846-405b-9a96-4ff964d95466 service nova] [instance: d56b243d-fbf2-4ae6-8399-80df46b33b82] Received unexpected event network-vif-plugged-a4d61a40-a5fd-4bca-899e-5569a7bc1e1b for instance with vm_state active and task_state None.
Oct 18 11:41:36 user nova-compute[74190]: DEBUG nova.compute.manager [req-01f7a618-7252-4435-8ae3-f46febb15b08 req-77b42e2f-8846-405b-9a96-4ff964d95466 service nova] [instance: d56b243d-fbf2-4ae6-8399-80df46b33b82] Received event network-vif-plugged-a4d61a40-a5fd-4bca-899e-5569a7bc1e1b {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:41:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-01f7a618-7252-4435-8ae3-f46febb15b08 req-77b42e2f-8846-405b-9a96-4ff964d95466 service nova] Acquiring lock "d56b243d-fbf2-4ae6-8399-80df46b33b82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:41:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-01f7a618-7252-4435-8ae3-f46febb15b08 req-77b42e2f-8846-405b-9a96-4ff964d95466 service nova] Lock "d56b243d-fbf2-4ae6-8399-80df46b33b82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:41:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-01f7a618-7252-4435-8ae3-f46febb15b08 req-77b42e2f-8846-405b-9a96-4ff964d95466 service nova] Lock "d56b243d-fbf2-4ae6-8399-80df46b33b82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:41:36 user nova-compute[74190]: DEBUG nova.compute.manager [req-01f7a618-7252-4435-8ae3-f46febb15b08 req-77b42e2f-8846-405b-9a96-4ff964d95466 service nova] [instance: d56b243d-fbf2-4ae6-8399-80df46b33b82] No waiting events found dispatching network-vif-plugged-a4d61a40-a5fd-4bca-899e-5569a7bc1e1b {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:41:36 user nova-compute[74190]: WARNING nova.compute.manager [req-01f7a618-7252-4435-8ae3-f46febb15b08 req-77b42e2f-8846-405b-9a96-4ff964d95466 service nova] [instance: d56b243d-fbf2-4ae6-8399-80df46b33b82] Received unexpected event network-vif-plugged-a4d61a40-a5fd-4bca-899e-5569a7bc1e1b for instance with vm_state active and task_state None.
Oct 18 11:41:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:38 user nova-compute[74190]: DEBUG nova.network.neutron [None req-80379c19-dfec-45b9-9364-200a23840bef tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f] Successfully updated port: 9087f286-715a-4bb2-a211-27119477ac6b {{(pid=74190) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 11:41:38 user nova-compute[74190]: DEBUG nova.compute.manager [req-9d57f35b-d48f-45d6-8b40-a38cf6c90789 req-95843640-cf49-4c92-aa78-848f48315161 service nova] [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f] Received event network-changed-9087f286-715a-4bb2-a211-27119477ac6b {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:41:38 user nova-compute[74190]: DEBUG nova.compute.manager [req-9d57f35b-d48f-45d6-8b40-a38cf6c90789 req-95843640-cf49-4c92-aa78-848f48315161 service nova] [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f] Refreshing instance network info cache due to event network-changed-9087f286-715a-4bb2-a211-27119477ac6b. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 11:41:38 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-9d57f35b-d48f-45d6-8b40-a38cf6c90789 req-95843640-cf49-4c92-aa78-848f48315161 service nova] Acquiring lock "refresh_cache-697d3123-bd6b-42b9-b278-c33c0c00da6f" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:41:38 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-9d57f35b-d48f-45d6-8b40-a38cf6c90789 req-95843640-cf49-4c92-aa78-848f48315161 service nova] Acquired lock "refresh_cache-697d3123-bd6b-42b9-b278-c33c0c00da6f" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:41:38 user nova-compute[74190]: DEBUG nova.network.neutron [req-9d57f35b-d48f-45d6-8b40-a38cf6c90789 req-95843640-cf49-4c92-aa78-848f48315161 service nova] [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f] Refreshing network info cache for port 9087f286-715a-4bb2-a211-27119477ac6b {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 11:41:38 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-80379c19-dfec-45b9-9364-200a23840bef tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] Acquiring lock "refresh_cache-697d3123-bd6b-42b9-b278-c33c0c00da6f" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:41:38 user nova-compute[74190]: DEBUG nova.compute.manager [req-8aa09a51-fc9b-405a-8145-3b969c959777 req-26d2cae5-5fb0-4950-8389-bd2326874877 service nova] [instance: 034398e8-e8c4-4e03-a608-440e447c6041] Received event network-vif-plugged-abefd824-cd1a-4947-996f-85553155dd8b {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:41:38 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-8aa09a51-fc9b-405a-8145-3b969c959777 req-26d2cae5-5fb0-4950-8389-bd2326874877 service nova] Acquiring lock "034398e8-e8c4-4e03-a608-440e447c6041-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:41:38 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-8aa09a51-fc9b-405a-8145-3b969c959777 req-26d2cae5-5fb0-4950-8389-bd2326874877 service nova] Lock "034398e8-e8c4-4e03-a608-440e447c6041-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:41:38 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-8aa09a51-fc9b-405a-8145-3b969c959777 req-26d2cae5-5fb0-4950-8389-bd2326874877 service nova] Lock "034398e8-e8c4-4e03-a608-440e447c6041-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:41:38 user nova-compute[74190]: DEBUG nova.compute.manager [req-8aa09a51-fc9b-405a-8145-3b969c959777 req-26d2cae5-5fb0-4950-8389-bd2326874877 service nova] [instance: 034398e8-e8c4-4e03-a608-440e447c6041] No waiting events found dispatching network-vif-plugged-abefd824-cd1a-4947-996f-85553155dd8b {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:41:38 user nova-compute[74190]: WARNING nova.compute.manager [req-8aa09a51-fc9b-405a-8145-3b969c959777 req-26d2cae5-5fb0-4950-8389-bd2326874877 service nova] [instance: 034398e8-e8c4-4e03-a608-440e447c6041] Received unexpected event network-vif-plugged-abefd824-cd1a-4947-996f-85553155dd8b for instance with vm_state building and task_state spawning.
Oct 18 11:41:38 user nova-compute[74190]: DEBUG nova.network.neutron [req-9d57f35b-d48f-45d6-8b40-a38cf6c90789 req-95843640-cf49-4c92-aa78-848f48315161 service nova] [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f] Instance cache missing network info. {{(pid=74190) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 11:41:38 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:38 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:38 user nova-compute[74190]: DEBUG nova.network.neutron [req-9d57f35b-d48f-45d6-8b40-a38cf6c90789 req-95843640-cf49-4c92-aa78-848f48315161 service nova] [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f] Updating instance_info_cache with network_info: [] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:41:39 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-9d57f35b-d48f-45d6-8b40-a38cf6c90789 req-95843640-cf49-4c92-aa78-848f48315161 service nova] Releasing lock "refresh_cache-697d3123-bd6b-42b9-b278-c33c0c00da6f" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:41:39 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-80379c19-dfec-45b9-9364-200a23840bef tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] Acquired lock "refresh_cache-697d3123-bd6b-42b9-b278-c33c0c00da6f" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:41:39 user nova-compute[74190]: DEBUG nova.network.neutron [None req-80379c19-dfec-45b9-9364-200a23840bef tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f] Building network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 11:41:39 user nova-compute[74190]: DEBUG nova.network.neutron [None req-80379c19-dfec-45b9-9364-200a23840bef tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f] Instance cache missing network info. {{(pid=74190) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 11:41:39 user nova-compute[74190]: DEBUG nova.compute.manager [None req-47cc5745-cdb2-4584-8d6b-c8396fb7c05c tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] [instance: 034398e8-e8c4-4e03-a608-440e447c6041] Instance event wait completed in 0 seconds for  {{(pid=74190) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 11:41:39 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-47cc5745-cdb2-4584-8d6b-c8396fb7c05c tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] [instance: 034398e8-e8c4-4e03-a608-440e447c6041] Guest created on hypervisor {{(pid=74190) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 11:41:39 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 034398e8-e8c4-4e03-a608-440e447c6041] Instance spawned successfully.
Oct 18 11:41:39 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-47cc5745-cdb2-4584-8d6b-c8396fb7c05c tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] [instance: 034398e8-e8c4-4e03-a608-440e447c6041] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 11:41:39 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-47cc5745-cdb2-4584-8d6b-c8396fb7c05c tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] [instance: 034398e8-e8c4-4e03-a608-440e447c6041] Found default for hw_cdrom_bus of ide {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:41:39 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-47cc5745-cdb2-4584-8d6b-c8396fb7c05c tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] [instance: 034398e8-e8c4-4e03-a608-440e447c6041] Found default for hw_disk_bus of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:41:39 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-47cc5745-cdb2-4584-8d6b-c8396fb7c05c tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] [instance: 034398e8-e8c4-4e03-a608-440e447c6041] Found default for hw_input_bus of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:41:39 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-47cc5745-cdb2-4584-8d6b-c8396fb7c05c tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] [instance: 034398e8-e8c4-4e03-a608-440e447c6041] Found default for hw_pointer_model of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:41:39 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-47cc5745-cdb2-4584-8d6b-c8396fb7c05c tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] [instance: 034398e8-e8c4-4e03-a608-440e447c6041] Found default for hw_video_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:41:39 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-47cc5745-cdb2-4584-8d6b-c8396fb7c05c tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] [instance: 034398e8-e8c4-4e03-a608-440e447c6041] Found default for hw_vif_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:41:39 user nova-compute[74190]: DEBUG nova.network.neutron [None req-80379c19-dfec-45b9-9364-200a23840bef tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f] Updating instance_info_cache with network_info: [{"id": "9087f286-715a-4bb2-a211-27119477ac6b", "address": "fa:16:3e:f7:93:c2", "network": {"id": "ad63fd35-616c-40f8-9849-e84a2c75ad29", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2145418188-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d5cced34b384eb79833c41a1c607ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9087f286-71", "ovs_interfaceid": "9087f286-715a-4bb2-a211-27119477ac6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:41:39 user nova-compute[74190]: INFO nova.compute.manager [None req-47cc5745-cdb2-4584-8d6b-c8396fb7c05c tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] [instance: 034398e8-e8c4-4e03-a608-440e447c6041] Took 9.42 seconds to spawn the instance on the hypervisor.
Oct 18 11:41:39 user nova-compute[74190]: DEBUG nova.compute.manager [None req-47cc5745-cdb2-4584-8d6b-c8396fb7c05c tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] [instance: 034398e8-e8c4-4e03-a608-440e447c6041] Checking state {{(pid=74190) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 11:41:39 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-80379c19-dfec-45b9-9364-200a23840bef tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] Releasing lock "refresh_cache-697d3123-bd6b-42b9-b278-c33c0c00da6f" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:41:39 user nova-compute[74190]: DEBUG nova.compute.manager [None req-80379c19-dfec-45b9-9364-200a23840bef tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f] Instance network_info: |[{"id": "9087f286-715a-4bb2-a211-27119477ac6b", "address": "fa:16:3e:f7:93:c2", "network": {"id": "ad63fd35-616c-40f8-9849-e84a2c75ad29", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2145418188-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d5cced34b384eb79833c41a1c607ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9087f286-71", "ovs_interfaceid": "9087f286-715a-4bb2-a211-27119477ac6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 11:41:39 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-80379c19-dfec-45b9-9364-200a23840bef tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f] Start _get_guest_xml network_info=[{"id": "9087f286-715a-4bb2-a211-27119477ac6b", "address": "fa:16:3e:f7:93:c2", "network": {"id": "ad63fd35-616c-40f8-9849-e84a2c75ad29", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2145418188-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d5cced34b384eb79833c41a1c607ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9087f286-71", "ovs_interfaceid": "9087f286-715a-4bb2-a211-27119477ac6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'image_id': '6e88bbf0-6e78-49a8-b3c5-9453d22a89df'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 11:41:39 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-80379c19-dfec-45b9-9364-200a23840bef tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:41:39 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-80379c19-dfec-45b9-9364-200a23840bef tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:41:39 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-80379c19-dfec-45b9-9364-200a23840bef tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 11:41:39 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-80379c19-dfec-45b9-9364-200a23840bef tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] CPU controller missing on host. {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 11:41:39 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-80379c19-dfec-45b9-9364-200a23840bef tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 11:41:39 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-80379c19-dfec-45b9-9364-200a23840bef tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] CPU controller found on host. {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 11:41:39 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-80379c19-dfec-45b9-9364-200a23840bef tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74190) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 11:41:39 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-80379c19-dfec-45b9-9364-200a23840bef tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T11:37:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 11:41:39 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-80379c19-dfec-45b9-9364-200a23840bef tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] Flavor limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 11:41:39 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-80379c19-dfec-45b9-9364-200a23840bef tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] Image limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 11:41:39 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-80379c19-dfec-45b9-9364-200a23840bef tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] Flavor pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 11:41:39 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-80379c19-dfec-45b9-9364-200a23840bef tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] Image pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 11:41:39 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-80379c19-dfec-45b9-9364-200a23840bef tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 11:41:39 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-80379c19-dfec-45b9-9364-200a23840bef tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 11:41:39 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-80379c19-dfec-45b9-9364-200a23840bef tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 11:41:39 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-80379c19-dfec-45b9-9364-200a23840bef tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] Got 1 possible topologies {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 11:41:39 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-80379c19-dfec-45b9-9364-200a23840bef tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 11:41:39 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-80379c19-dfec-45b9-9364-200a23840bef tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 11:41:39 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-80379c19-dfec-45b9-9364-200a23840bef tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:41:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1737404817',display_name='tempest-VolumesAssistedSnapshotsTest-server-1737404817',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1737404817',id=8,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFxSnU+o1nJa1IER2JPisxhrwZNjvPpqfPD8HQuhMyx42JmEIhWSBVKBL42HljjIk2atU8eX3EIwbIy9rY34YXOQTDFMPmY9NErlQUGAxNzV8HYQpixshmwzt/WRBKHQnw==',key_name='tempest-keypair-613465599',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0d5cced34b384eb79833c41a1c607ef3',ramdisk_id='',reservation_id='r-45rvwoyu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1301090683',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1301090683-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:41:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2bbf67b2fa0149c19a86fa723f662569',uuid=697d3123-bd6b-42b9-b278-c33c0c00da6f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9087f286-715a-4bb2-a211-27119477ac6b", "address": "fa:16:3e:f7:93:c2", "network": {"id": "ad63fd35-616c-40f8-9849-e84a2c75ad29", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2145418188-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d5cced34b384eb79833c41a1c607ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9087f286-71", "ovs_interfaceid": "9087f286-715a-4bb2-a211-27119477ac6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74190) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 11:41:39 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-80379c19-dfec-45b9-9364-200a23840bef tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] Converting VIF {"id": "9087f286-715a-4bb2-a211-27119477ac6b", "address": "fa:16:3e:f7:93:c2", "network": {"id": "ad63fd35-616c-40f8-9849-e84a2c75ad29", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2145418188-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d5cced34b384eb79833c41a1c607ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9087f286-71", "ovs_interfaceid": "9087f286-715a-4bb2-a211-27119477ac6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:41:39 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-80379c19-dfec-45b9-9364-200a23840bef tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:93:c2,bridge_name='br-int',has_traffic_filtering=True,id=9087f286-715a-4bb2-a211-27119477ac6b,network=Network(ad63fd35-616c-40f8-9849-e84a2c75ad29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9087f286-71') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:41:39 user nova-compute[74190]: DEBUG nova.objects.instance [None req-80379c19-dfec-45b9-9364-200a23840bef tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] Lazy-loading 'pci_devices' on Instance uuid 697d3123-bd6b-42b9-b278-c33c0c00da6f {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:41:39 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-80379c19-dfec-45b9-9364-200a23840bef tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f] End _get_guest_xml xml=<domain type="kvm">
Oct 18 11:41:39 user nova-compute[74190]:   <uuid>697d3123-bd6b-42b9-b278-c33c0c00da6f</uuid>
Oct 18 11:41:39 user nova-compute[74190]:   <name>instance-00000008</name>
Oct 18 11:41:39 user nova-compute[74190]:   <memory>524288</memory>
Oct 18 11:41:39 user nova-compute[74190]:   <vcpu>1</vcpu>
Oct 18 11:41:39 user nova-compute[74190]:   <metadata>
Oct 18 11:41:39 user nova-compute[74190]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 11:41:39 user nova-compute[74190]:       <nova:package version="0.0.0"/>
Oct 18 11:41:39 user nova-compute[74190]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1737404817</nova:name>
Oct 18 11:41:39 user nova-compute[74190]:       <nova:creationTime>2023-10-18 11:41:39</nova:creationTime>
Oct 18 11:41:39 user nova-compute[74190]:       <nova:flavor name="m1.tiny">
Oct 18 11:41:39 user nova-compute[74190]:         <nova:memory>512</nova:memory>
Oct 18 11:41:39 user nova-compute[74190]:         <nova:disk>1</nova:disk>
Oct 18 11:41:39 user nova-compute[74190]:         <nova:swap>0</nova:swap>
Oct 18 11:41:39 user nova-compute[74190]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 11:41:39 user nova-compute[74190]:         <nova:vcpus>1</nova:vcpus>
Oct 18 11:41:39 user nova-compute[74190]:       </nova:flavor>
Oct 18 11:41:39 user nova-compute[74190]:       <nova:owner>
Oct 18 11:41:39 user nova-compute[74190]:         <nova:user uuid="2bbf67b2fa0149c19a86fa723f662569">tempest-VolumesAssistedSnapshotsTest-1301090683-project-member</nova:user>
Oct 18 11:41:39 user nova-compute[74190]:         <nova:project uuid="0d5cced34b384eb79833c41a1c607ef3">tempest-VolumesAssistedSnapshotsTest-1301090683</nova:project>
Oct 18 11:41:39 user nova-compute[74190]:       </nova:owner>
Oct 18 11:41:39 user nova-compute[74190]:       <nova:root type="image" uuid="6e88bbf0-6e78-49a8-b3c5-9453d22a89df"/>
Oct 18 11:41:39 user nova-compute[74190]:       <nova:ports>
Oct 18 11:41:39 user nova-compute[74190]:         <nova:port uuid="9087f286-715a-4bb2-a211-27119477ac6b">
Oct 18 11:41:39 user nova-compute[74190]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 18 11:41:39 user nova-compute[74190]:         </nova:port>
Oct 18 11:41:39 user nova-compute[74190]:       </nova:ports>
Oct 18 11:41:39 user nova-compute[74190]:     </nova:instance>
Oct 18 11:41:39 user nova-compute[74190]:   </metadata>
Oct 18 11:41:39 user nova-compute[74190]:   <sysinfo type="smbios">
Oct 18 11:41:39 user nova-compute[74190]:     <system>
Oct 18 11:41:39 user nova-compute[74190]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 11:41:39 user nova-compute[74190]:       <entry name="product">OpenStack Nova</entry>
Oct 18 11:41:39 user nova-compute[74190]:       <entry name="version">0.0.0</entry>
Oct 18 11:41:39 user nova-compute[74190]:       <entry name="serial">697d3123-bd6b-42b9-b278-c33c0c00da6f</entry>
Oct 18 11:41:39 user nova-compute[74190]:       <entry name="uuid">697d3123-bd6b-42b9-b278-c33c0c00da6f</entry>
Oct 18 11:41:39 user nova-compute[74190]:       <entry name="family">Virtual Machine</entry>
Oct 18 11:41:39 user nova-compute[74190]:     </system>
Oct 18 11:41:39 user nova-compute[74190]:   </sysinfo>
Oct 18 11:41:39 user nova-compute[74190]:   <os>
Oct 18 11:41:39 user nova-compute[74190]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 11:41:39 user nova-compute[74190]:     <boot dev="hd"/>
Oct 18 11:41:39 user nova-compute[74190]:     <smbios mode="sysinfo"/>
Oct 18 11:41:39 user nova-compute[74190]:   </os>
Oct 18 11:41:39 user nova-compute[74190]:   <features>
Oct 18 11:41:39 user nova-compute[74190]:     <acpi/>
Oct 18 11:41:39 user nova-compute[74190]:     <apic/>
Oct 18 11:41:39 user nova-compute[74190]:     <vmcoreinfo/>
Oct 18 11:41:39 user nova-compute[74190]:   </features>
Oct 18 11:41:39 user nova-compute[74190]:   <clock offset="utc">
Oct 18 11:41:39 user nova-compute[74190]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 11:41:39 user nova-compute[74190]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 11:41:39 user nova-compute[74190]:     <timer name="hpet" present="no"/>
Oct 18 11:41:39 user nova-compute[74190]:   </clock>
Oct 18 11:41:39 user nova-compute[74190]:   <cpu mode="custom" match="exact">
Oct 18 11:41:39 user nova-compute[74190]:     <model>Nehalem</model>
Oct 18 11:41:39 user nova-compute[74190]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 11:41:39 user nova-compute[74190]:   </cpu>
Oct 18 11:41:39 user nova-compute[74190]:   <devices>
Oct 18 11:41:39 user nova-compute[74190]:     <disk type="file" device="disk">
Oct 18 11:41:39 user nova-compute[74190]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 11:41:39 user nova-compute[74190]:       <source file="/opt/stack/data/nova/instances/697d3123-bd6b-42b9-b278-c33c0c00da6f/disk"/>
Oct 18 11:41:39 user nova-compute[74190]:       <target dev="vda" bus="virtio"/>
Oct 18 11:41:39 user nova-compute[74190]:     </disk>
Oct 18 11:41:39 user nova-compute[74190]:     <interface type="ethernet">
Oct 18 11:41:39 user nova-compute[74190]:       <mac address="fa:16:3e:f7:93:c2"/>
Oct 18 11:41:39 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:41:39 user nova-compute[74190]:       <mtu size="1442"/>
Oct 18 11:41:39 user nova-compute[74190]:       <target dev="tap9087f286-71"/>
Oct 18 11:41:39 user nova-compute[74190]:     </interface>
Oct 18 11:41:39 user nova-compute[74190]:     <serial type="pty">
Oct 18 11:41:39 user nova-compute[74190]:       <log file="/opt/stack/data/nova/instances/697d3123-bd6b-42b9-b278-c33c0c00da6f/console.log" append="off"/>
Oct 18 11:41:39 user nova-compute[74190]:     </serial>
Oct 18 11:41:39 user nova-compute[74190]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 11:41:39 user nova-compute[74190]:     <video>
Oct 18 11:41:39 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:41:39 user nova-compute[74190]:     </video>
Oct 18 11:41:39 user nova-compute[74190]:     <rng model="virtio">
Oct 18 11:41:39 user nova-compute[74190]:       <backend model="random">/dev/urandom</backend>
Oct 18 11:41:39 user nova-compute[74190]:     </rng>
Oct 18 11:41:39 user nova-compute[74190]:     <controller type="usb" index="0" model="none"/>
Oct 18 11:41:39 user nova-compute[74190]:     <memballoon model="virtio">
Oct 18 11:41:39 user nova-compute[74190]:       <stats period="10"/>
Oct 18 11:41:39 user nova-compute[74190]:     </memballoon>
Oct 18 11:41:39 user nova-compute[74190]:   </devices>
Oct 18 11:41:39 user nova-compute[74190]: </domain>
Oct 18 11:41:39 user nova-compute[74190]:  {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 11:41:39 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-80379c19-dfec-45b9-9364-200a23840bef tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:41:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1737404817',display_name='tempest-VolumesAssistedSnapshotsTest-server-1737404817',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1737404817',id=8,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFxSnU+o1nJa1IER2JPisxhrwZNjvPpqfPD8HQuhMyx42JmEIhWSBVKBL42HljjIk2atU8eX3EIwbIy9rY34YXOQTDFMPmY9NErlQUGAxNzV8HYQpixshmwzt/WRBKHQnw==',key_name='tempest-keypair-613465599',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0d5cced34b384eb79833c41a1c607ef3',ramdisk_id='',reservation_id='r-45rvwoyu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1301090683',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1301090683-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:41:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2bbf67b2fa0149c19a86fa723f662569',uuid=697d3123-bd6b-42b9-b278-c33c0c00da6f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9087f286-715a-4bb2-a211-27119477ac6b", "address": "fa:16:3e:f7:93:c2", "network": {"id": "ad63fd35-616c-40f8-9849-e84a2c75ad29", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2145418188-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d5cced34b384eb79833c41a1c607ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9087f286-71", "ovs_interfaceid": "9087f286-715a-4bb2-a211-27119477ac6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 11:41:39 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-80379c19-dfec-45b9-9364-200a23840bef tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] Converting VIF {"id": "9087f286-715a-4bb2-a211-27119477ac6b", "address": "fa:16:3e:f7:93:c2", "network": {"id": "ad63fd35-616c-40f8-9849-e84a2c75ad29", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2145418188-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d5cced34b384eb79833c41a1c607ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9087f286-71", "ovs_interfaceid": "9087f286-715a-4bb2-a211-27119477ac6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:41:39 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-80379c19-dfec-45b9-9364-200a23840bef tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:93:c2,bridge_name='br-int',has_traffic_filtering=True,id=9087f286-715a-4bb2-a211-27119477ac6b,network=Network(ad63fd35-616c-40f8-9849-e84a2c75ad29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9087f286-71') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:41:39 user nova-compute[74190]: DEBUG os_vif [None req-80379c19-dfec-45b9-9364-200a23840bef tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:93:c2,bridge_name='br-int',has_traffic_filtering=True,id=9087f286-715a-4bb2-a211-27119477ac6b,network=Network(ad63fd35-616c-40f8-9849-e84a2c75ad29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9087f286-71') {{(pid=74190) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 11:41:39 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:39 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:41:39 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 11:41:39 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:39 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9330fcc8-9a65-5fbe-9445-60a07e7562ea', '_type': 'linux-noop'}}, row=False) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:41:39 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:39 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:41:39 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:39 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9087f286-71, may_exist=True, interface_attrs={}) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:41:39 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9087f286-71, col_values=(('qos', UUID('89a4cc7c-541a-4a02-b8d4-f418fac7313c')),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:41:39 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9087f286-71, col_values=(('external_ids', {'iface-id': '9087f286-715a-4bb2-a211-27119477ac6b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f7:93:c2', 'vm-uuid': '697d3123-bd6b-42b9-b278-c33c0c00da6f'}),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:41:39 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:39 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:41:39 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:39 user nova-compute[74190]: INFO os_vif [None req-80379c19-dfec-45b9-9364-200a23840bef tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:93:c2,bridge_name='br-int',has_traffic_filtering=True,id=9087f286-715a-4bb2-a211-27119477ac6b,network=Network(ad63fd35-616c-40f8-9849-e84a2c75ad29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9087f286-71')
Oct 18 11:41:39 user nova-compute[74190]: INFO nova.compute.manager [None req-47cc5745-cdb2-4584-8d6b-c8396fb7c05c tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] [instance: 034398e8-e8c4-4e03-a608-440e447c6041] Took 10.86 seconds to build instance.
Oct 18 11:41:39 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-47cc5745-cdb2-4584-8d6b-c8396fb7c05c tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Lock "034398e8-e8c4-4e03-a608-440e447c6041" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.101s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:41:39 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-80379c19-dfec-45b9-9364-200a23840bef tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] No BDM found with device name vda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 11:41:39 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-80379c19-dfec-45b9-9364-200a23840bef tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] No VIF found with MAC fa:16:3e:f7:93:c2, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 11:41:41 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:41 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:41 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:42 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:42 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:42 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:43 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:44 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:41:44 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Cleaning up deleted instances {{(pid=74190) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 18 11:41:44 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] There are 0 instances to clean {{(pid=74190) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 18 11:41:44 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:41:44 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74190) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 18 11:41:44 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:41:44 user nova-compute[74190]: DEBUG nova.compute.manager [None req-80379c19-dfec-45b9-9364-200a23840bef tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f] Instance event wait completed in 0 seconds for  {{(pid=74190) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 11:41:44 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-80379c19-dfec-45b9-9364-200a23840bef tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f] Guest created on hypervisor {{(pid=74190) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 11:41:44 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f] Instance spawned successfully.
Oct 18 11:41:44 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-80379c19-dfec-45b9-9364-200a23840bef tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 11:41:44 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:44 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-80379c19-dfec-45b9-9364-200a23840bef tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f] Found default for hw_cdrom_bus of ide {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:41:44 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-80379c19-dfec-45b9-9364-200a23840bef tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f] Found default for hw_disk_bus of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:41:44 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-80379c19-dfec-45b9-9364-200a23840bef tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f] Found default for hw_input_bus of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:41:44 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-80379c19-dfec-45b9-9364-200a23840bef tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f] Found default for hw_pointer_model of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:41:44 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-80379c19-dfec-45b9-9364-200a23840bef tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f] Found default for hw_video_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:41:44 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-80379c19-dfec-45b9-9364-200a23840bef tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f] Found default for hw_vif_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:41:44 user nova-compute[74190]: INFO nova.compute.manager [None req-80379c19-dfec-45b9-9364-200a23840bef tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f] Took 10.77 seconds to spawn the instance on the hypervisor.
Oct 18 11:41:44 user nova-compute[74190]: DEBUG nova.compute.manager [None req-80379c19-dfec-45b9-9364-200a23840bef tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f] Checking state {{(pid=74190) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 11:41:45 user nova-compute[74190]: INFO nova.compute.manager [None req-80379c19-dfec-45b9-9364-200a23840bef tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f] Took 12.50 seconds to build instance.
Oct 18 11:41:45 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-80379c19-dfec-45b9-9364-200a23840bef tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] Lock "697d3123-bd6b-42b9-b278-c33c0c00da6f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.710s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:41:46 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:41:46 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:41:46 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:41:46 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:41:46 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:41:46 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Auditing locally available compute resources for user (node: user) {{(pid=74190) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 11:41:46 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c3cce66-9d7a-4f23-a92a-d10b3efd5e86/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:41:46 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c3cce66-9d7a-4f23-a92a-d10b3efd5e86/disk --force-share --output=json" returned: 0 in 0.393s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:41:46 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c3cce66-9d7a-4f23-a92a-d10b3efd5e86/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:41:47 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c3cce66-9d7a-4f23-a92a-d10b3efd5e86/disk --force-share --output=json" returned: 0 in 0.402s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:41:47 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034398e8-e8c4-4e03-a608-440e447c6041/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:41:47 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034398e8-e8c4-4e03-a608-440e447c6041/disk --force-share --output=json" returned: 0 in 0.403s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:41:47 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034398e8-e8c4-4e03-a608-440e447c6041/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:41:48 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034398e8-e8c4-4e03-a608-440e447c6041/disk --force-share --output=json" returned: 0 in 0.411s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:41:48 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/697d3123-bd6b-42b9-b278-c33c0c00da6f/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:41:48 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/697d3123-bd6b-42b9-b278-c33c0c00da6f/disk --force-share --output=json" returned: 0 in 0.298s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:41:48 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/697d3123-bd6b-42b9-b278-c33c0c00da6f/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:41:48 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/697d3123-bd6b-42b9-b278-c33c0c00da6f/disk --force-share --output=json" returned: 0 in 0.282s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:41:48 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0209c824-88a7-4976-83bf-8a72437f0cc2/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:41:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:49 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0209c824-88a7-4976-83bf-8a72437f0cc2/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:41:49 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0209c824-88a7-4976-83bf-8a72437f0cc2/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:41:49 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0209c824-88a7-4976-83bf-8a72437f0cc2/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:41:49 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d56b243d-fbf2-4ae6-8399-80df46b33b82/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:41:49 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d56b243d-fbf2-4ae6-8399-80df46b33b82/disk --force-share --output=json" returned: 0 in 0.282s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:41:49 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d56b243d-fbf2-4ae6-8399-80df46b33b82/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:41:49 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:49 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d56b243d-fbf2-4ae6-8399-80df46b33b82/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:41:49 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6130edd-eb98-491e-a0ba-6bd59199d9e1/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:41:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6130edd-eb98-491e-a0ba-6bd59199d9e1/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:41:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6130edd-eb98-491e-a0ba-6bd59199d9e1/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:41:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6130edd-eb98-491e-a0ba-6bd59199d9e1/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:41:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c280652c-ffde-40f8-a919-adb8be618db8/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:41:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c280652c-ffde-40f8-a919-adb8be618db8/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:41:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c280652c-ffde-40f8-a919-adb8be618db8/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:41:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c280652c-ffde-40f8-a919-adb8be618db8/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:41:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:41:51 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:41:51 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:41:51 user nova-compute[74190]: DEBUG nova.compute.manager [req-b0bd1449-4b46-4ec4-bc3a-3c8866451ab7 req-0e3a2060-6cc4-4de3-8c79-07bd1c360449 service nova] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] Received event network-vif-plugged-2f3b8cfe-f9f2-4dc5-b368-f67ef363266c {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:41:51 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-b0bd1449-4b46-4ec4-bc3a-3c8866451ab7 req-0e3a2060-6cc4-4de3-8c79-07bd1c360449 service nova] Acquiring lock "6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:41:51 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-b0bd1449-4b46-4ec4-bc3a-3c8866451ab7 req-0e3a2060-6cc4-4de3-8c79-07bd1c360449 service nova] Lock "6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:41:51 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-b0bd1449-4b46-4ec4-bc3a-3c8866451ab7 req-0e3a2060-6cc4-4de3-8c79-07bd1c360449 service nova] Lock "6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:41:51 user nova-compute[74190]: DEBUG nova.compute.manager [req-b0bd1449-4b46-4ec4-bc3a-3c8866451ab7 req-0e3a2060-6cc4-4de3-8c79-07bd1c360449 service nova] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] No waiting events found dispatching network-vif-plugged-2f3b8cfe-f9f2-4dc5-b368-f67ef363266c {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:41:51 user nova-compute[74190]: WARNING nova.compute.manager [req-b0bd1449-4b46-4ec4-bc3a-3c8866451ab7 req-0e3a2060-6cc4-4de3-8c79-07bd1c360449 service nova] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] Received unexpected event network-vif-plugged-2f3b8cfe-f9f2-4dc5-b368-f67ef363266c for instance with vm_state active and task_state None.
Oct 18 11:41:51 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:41:51 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:41:51 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:41:51 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Hypervisor/Node resource view: name=user free_ram=7767MB free_disk=25.80986785888672GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74190) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 11:41:51 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:41:51 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:41:52 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance c280652c-ffde-40f8-a919-adb8be618db8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:41:52 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:41:52 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 0209c824-88a7-4976-83bf-8a72437f0cc2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:41:52 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance c6130edd-eb98-491e-a0ba-6bd59199d9e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:41:52 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:41:52 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance d56b243d-fbf2-4ae6-8399-80df46b33b82 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:41:52 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 034398e8-e8c4-4e03-a608-440e447c6041 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:41:52 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 697d3123-bd6b-42b9-b278-c33c0c00da6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:41:52 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 11:41:52 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 11:41:52 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 11:41:52 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 11:41:52 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Compute_service record updated for user:user {{(pid=74190) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 11:41:52 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.637s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:41:53 user nova-compute[74190]: DEBUG nova.compute.manager [req-df24b3b7-220e-4883-b8e5-6c293f92f371 req-42c5ed2f-382b-4587-b26b-e333cbb91918 service nova] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] Received event network-vif-plugged-2f3b8cfe-f9f2-4dc5-b368-f67ef363266c {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:41:53 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-df24b3b7-220e-4883-b8e5-6c293f92f371 req-42c5ed2f-382b-4587-b26b-e333cbb91918 service nova] Acquiring lock "6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:41:53 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-df24b3b7-220e-4883-b8e5-6c293f92f371 req-42c5ed2f-382b-4587-b26b-e333cbb91918 service nova] Lock "6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:41:53 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-df24b3b7-220e-4883-b8e5-6c293f92f371 req-42c5ed2f-382b-4587-b26b-e333cbb91918 service nova] Lock "6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:41:53 user nova-compute[74190]: DEBUG nova.compute.manager [req-df24b3b7-220e-4883-b8e5-6c293f92f371 req-42c5ed2f-382b-4587-b26b-e333cbb91918 service nova] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] No waiting events found dispatching network-vif-plugged-2f3b8cfe-f9f2-4dc5-b368-f67ef363266c {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:41:53 user nova-compute[74190]: WARNING nova.compute.manager [req-df24b3b7-220e-4883-b8e5-6c293f92f371 req-42c5ed2f-382b-4587-b26b-e333cbb91918 service nova] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] Received unexpected event network-vif-plugged-2f3b8cfe-f9f2-4dc5-b368-f67ef363266c for instance with vm_state active and task_state None.
Oct 18 11:41:53 user nova-compute[74190]: DEBUG nova.compute.manager [req-df24b3b7-220e-4883-b8e5-6c293f92f371 req-42c5ed2f-382b-4587-b26b-e333cbb91918 service nova] [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f] Received event network-vif-plugged-9087f286-715a-4bb2-a211-27119477ac6b {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:41:53 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-df24b3b7-220e-4883-b8e5-6c293f92f371 req-42c5ed2f-382b-4587-b26b-e333cbb91918 service nova] Acquiring lock "697d3123-bd6b-42b9-b278-c33c0c00da6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:41:53 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-df24b3b7-220e-4883-b8e5-6c293f92f371 req-42c5ed2f-382b-4587-b26b-e333cbb91918 service nova] Lock "697d3123-bd6b-42b9-b278-c33c0c00da6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:41:53 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-df24b3b7-220e-4883-b8e5-6c293f92f371 req-42c5ed2f-382b-4587-b26b-e333cbb91918 service nova] Lock "697d3123-bd6b-42b9-b278-c33c0c00da6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:41:53 user nova-compute[74190]: DEBUG nova.compute.manager [req-df24b3b7-220e-4883-b8e5-6c293f92f371 req-42c5ed2f-382b-4587-b26b-e333cbb91918 service nova] [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f] No waiting events found dispatching network-vif-plugged-9087f286-715a-4bb2-a211-27119477ac6b {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:41:53 user nova-compute[74190]: WARNING nova.compute.manager [req-df24b3b7-220e-4883-b8e5-6c293f92f371 req-42c5ed2f-382b-4587-b26b-e333cbb91918 service nova] [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f] Received unexpected event network-vif-plugged-9087f286-715a-4bb2-a211-27119477ac6b for instance with vm_state active and task_state None.
Oct 18 11:41:53 user nova-compute[74190]: DEBUG nova.compute.manager [req-df24b3b7-220e-4883-b8e5-6c293f92f371 req-42c5ed2f-382b-4587-b26b-e333cbb91918 service nova] [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f] Received event network-vif-plugged-9087f286-715a-4bb2-a211-27119477ac6b {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:41:53 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-df24b3b7-220e-4883-b8e5-6c293f92f371 req-42c5ed2f-382b-4587-b26b-e333cbb91918 service nova] Acquiring lock "697d3123-bd6b-42b9-b278-c33c0c00da6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:41:53 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-df24b3b7-220e-4883-b8e5-6c293f92f371 req-42c5ed2f-382b-4587-b26b-e333cbb91918 service nova] Lock "697d3123-bd6b-42b9-b278-c33c0c00da6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:41:53 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-df24b3b7-220e-4883-b8e5-6c293f92f371 req-42c5ed2f-382b-4587-b26b-e333cbb91918 service nova] Lock "697d3123-bd6b-42b9-b278-c33c0c00da6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:41:53 user nova-compute[74190]: DEBUG nova.compute.manager [req-df24b3b7-220e-4883-b8e5-6c293f92f371 req-42c5ed2f-382b-4587-b26b-e333cbb91918 service nova] [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f] No waiting events found dispatching network-vif-plugged-9087f286-715a-4bb2-a211-27119477ac6b {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:41:53 user nova-compute[74190]: WARNING nova.compute.manager [req-df24b3b7-220e-4883-b8e5-6c293f92f371 req-42c5ed2f-382b-4587-b26b-e333cbb91918 service nova] [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f] Received unexpected event network-vif-plugged-9087f286-715a-4bb2-a211-27119477ac6b for instance with vm_state active and task_state None.
Oct 18 11:41:53 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:41:53 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:41:53 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Starting heal instance info cache {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 11:41:53 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Rebuilding the list of instances to heal {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 18 11:41:53 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "refresh_cache-c280652c-ffde-40f8-a919-adb8be618db8" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:41:53 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquired lock "refresh_cache-c280652c-ffde-40f8-a919-adb8be618db8" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:41:53 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Forcefully refreshing network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 18 11:41:53 user nova-compute[74190]: DEBUG nova.objects.instance [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lazy-loading 'info_cache' on Instance uuid c280652c-ffde-40f8-a919-adb8be618db8 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:41:53 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:54 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Updating instance_info_cache with network_info: [{"id": "80b77e2d-aa04-4996-a0c1-713054affac4", "address": "fa:16:3e:4f:00:ce", "network": {"id": "cf0a4705-3fff-4716-87ac-b0ca7700e11c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1739631852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cf8d4d4f504e82868ed295e054644c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80b77e2d-aa", "ovs_interfaceid": "80b77e2d-aa04-4996-a0c1-713054affac4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:41:54 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Releasing lock "refresh_cache-c280652c-ffde-40f8-a919-adb8be618db8" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:41:54 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Updated the network info_cache for instance {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 18 11:41:54 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:41:54 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:41:54 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:41:54 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:41:54 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:41:54 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74190) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 11:41:54 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:58 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:41:59 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:42:03 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:42:04 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:42:05 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:42:07 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:42:08 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:42:09 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:42:11 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:42:13 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:42:13 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:42:14 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:42:18 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:42:19 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:42:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:42:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:42:26 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Acquiring lock "aabb5eea-8366-482a-8d16-bf271c0fe8d7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:42:26 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Lock "aabb5eea-8366-482a-8d16-bf271c0fe8d7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:42:26 user nova-compute[74190]: DEBUG nova.compute.manager [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Starting instance... {{(pid=74190) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 11:42:27 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:42:27 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:42:27 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74190) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 11:42:27 user nova-compute[74190]: INFO nova.compute.claims [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Claim successful on node user
Oct 18 11:42:27 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Refreshing inventories for resource provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 18 11:42:27 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Updating ProviderTree inventory for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 18 11:42:27 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Updating inventory in ProviderTree for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 18 11:42:27 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Refreshing aggregate associations for resource provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66, aggregates: None {{(pid=74190) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 18 11:42:27 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Refreshing trait associations for resource provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66, traits: COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE42,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_ACCELERATORS,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=74190) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 18 11:42:27 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 11:42:27 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 11:42:27 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.582s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:42:27 user nova-compute[74190]: DEBUG nova.compute.manager [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Start building networks asynchronously for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 11:42:27 user nova-compute[74190]: DEBUG nova.compute.manager [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Allocating IP information in the background. {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 11:42:27 user nova-compute[74190]: DEBUG nova.network.neutron [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] allocate_for_instance() {{(pid=74190) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 11:42:27 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 11:42:27 user nova-compute[74190]: DEBUG nova.compute.manager [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Start building block device mappings for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 11:42:27 user nova-compute[74190]: DEBUG nova.policy [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '58fb2050865044f9a0d621a9ca328ece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5028593e4e4805aaa839c6759be293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74190) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 11:42:27 user nova-compute[74190]: INFO nova.virt.block_device [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Booting with volume 5c87f389-42e2-4d78-8bdb-4d5bda76216c at /dev/vda
Oct 18 11:42:27 user nova-compute[74190]: DEBUG os_brick.utils [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:42:27 user nova-compute[74190]: INFO oslo.privsep.daemon [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpjo9_6paa/privsep.sock']
Oct 18 11:42:27 user sudo[85214]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpjo9_6paa/privsep.sock
Oct 18 11:42:27 user sudo[85214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 18 11:42:28 user nova-compute[74190]: DEBUG nova.network.neutron [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Successfully created port: 21163c28-d799-420c-96b5-6ea0e829dc93 {{(pid=74190) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 11:42:28 user nova-compute[74190]: DEBUG nova.network.neutron [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Successfully updated port: 21163c28-d799-420c-96b5-6ea0e829dc93 {{(pid=74190) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 11:42:28 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Acquiring lock "refresh_cache-aabb5eea-8366-482a-8d16-bf271c0fe8d7" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:42:28 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Acquired lock "refresh_cache-aabb5eea-8366-482a-8d16-bf271c0fe8d7" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:42:28 user nova-compute[74190]: DEBUG nova.network.neutron [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Building network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 11:42:28 user nova-compute[74190]: DEBUG nova.compute.manager [req-0178b972-7072-4299-b7aa-93dce65b02b2 req-c48e784d-3af1-4874-a0a9-2130ad6b83f4 service nova] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Received event network-changed-21163c28-d799-420c-96b5-6ea0e829dc93 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:42:28 user nova-compute[74190]: DEBUG nova.compute.manager [req-0178b972-7072-4299-b7aa-93dce65b02b2 req-c48e784d-3af1-4874-a0a9-2130ad6b83f4 service nova] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Refreshing instance network info cache due to event network-changed-21163c28-d799-420c-96b5-6ea0e829dc93. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 11:42:28 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-0178b972-7072-4299-b7aa-93dce65b02b2 req-c48e784d-3af1-4874-a0a9-2130ad6b83f4 service nova] Acquiring lock "refresh_cache-aabb5eea-8366-482a-8d16-bf271c0fe8d7" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:42:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:42:28 user nova-compute[74190]: DEBUG nova.network.neutron [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Instance cache missing network info. {{(pid=74190) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 11:42:29 user nova-compute[74190]: DEBUG nova.network.neutron [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Updating instance_info_cache with network_info: [{"id": "21163c28-d799-420c-96b5-6ea0e829dc93", "address": "fa:16:3e:d8:31:38", "network": {"id": "40790864-a5db-4f62-adde-28ee0dc256cc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-682684827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f5028593e4e4805aaa839c6759be293", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21163c28-d7", "ovs_interfaceid": "21163c28-d799-420c-96b5-6ea0e829dc93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:42:29 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Releasing lock "refresh_cache-aabb5eea-8366-482a-8d16-bf271c0fe8d7" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:42:29 user nova-compute[74190]: DEBUG nova.compute.manager [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Instance network_info: |[{"id": "21163c28-d799-420c-96b5-6ea0e829dc93", "address": "fa:16:3e:d8:31:38", "network": {"id": "40790864-a5db-4f62-adde-28ee0dc256cc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-682684827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f5028593e4e4805aaa839c6759be293", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21163c28-d7", "ovs_interfaceid": "21163c28-d799-420c-96b5-6ea0e829dc93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 11:42:29 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-0178b972-7072-4299-b7aa-93dce65b02b2 req-c48e784d-3af1-4874-a0a9-2130ad6b83f4 service nova] Acquired lock "refresh_cache-aabb5eea-8366-482a-8d16-bf271c0fe8d7" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:42:29 user nova-compute[74190]: DEBUG nova.network.neutron [req-0178b972-7072-4299-b7aa-93dce65b02b2 req-c48e784d-3af1-4874-a0a9-2130ad6b83f4 service nova] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Refreshing network info cache for port 21163c28-d799-420c-96b5-6ea0e829dc93 {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 11:42:29 user sudo[85214]: pam_unix(sudo:session): session closed for user root
Oct 18 11:42:29 user nova-compute[74190]: INFO oslo.privsep.daemon [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Spawned new privsep daemon via rootwrap
Oct 18 11:42:29 user nova-compute[74190]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 18 11:42:29 user nova-compute[74190]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 18 11:42:29 user nova-compute[74190]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Oct 18 11:42:29 user nova-compute[74190]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85217
Oct 18 11:42:29 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc344aa-39cc-4f8f-9b8b-1ccf74782f7d]: (2,) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:42:29 user nova-compute[74190]: DEBUG nova.network.neutron [req-0178b972-7072-4299-b7aa-93dce65b02b2 req-c48e784d-3af1-4874-a0a9-2130ad6b83f4 service nova] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Updated VIF entry in instance network info cache for port 21163c28-d799-420c-96b5-6ea0e829dc93. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 11:42:29 user nova-compute[74190]: DEBUG nova.network.neutron [req-0178b972-7072-4299-b7aa-93dce65b02b2 req-c48e784d-3af1-4874-a0a9-2130ad6b83f4 service nova] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Updating instance_info_cache with network_info: [{"id": "21163c28-d799-420c-96b5-6ea0e829dc93", "address": "fa:16:3e:d8:31:38", "network": {"id": "40790864-a5db-4f62-adde-28ee0dc256cc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-682684827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f5028593e4e4805aaa839c6759be293", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21163c28-d7", "ovs_interfaceid": "21163c28-d799-420c-96b5-6ea0e829dc93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:42:29 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-0178b972-7072-4299-b7aa-93dce65b02b2 req-c48e784d-3af1-4874-a0a9-2130ad6b83f4 service nova] Releasing lock "refresh_cache-aabb5eea-8366-482a-8d16-bf271c0fe8d7" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:42:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:42:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:42:29 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[191e0b99-121f-46ae-9568-72fa117ade09]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cff158e257e1\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:42:29 user nova-compute[74190]: WARNING os_brick.initiator.connectors.nvmeof [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Oct 18 11:42:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:42:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:42:29 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c082f61-af08-4db8-ab95-7879010b1cad]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:42:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:42:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:42:29 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ccda64-98ea-4325-8542-4ae0a3959940]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:42:29 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6c0e7a1-80b8-4d99-bc99-6530444589d9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:42:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Running cmd (subprocess): nvme version {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:42:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] 'nvme version' failed. Not Retrying. {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 11:42:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:42:29 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.nvmeof [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] nvme not present on system {{(pid=74190) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 11:42:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:42:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 11:42:29 user nova-compute[74190]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 11:42:29 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc0de68-c7c4-4d5e-b17a-0c2a11039b72]: (4, '') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:42:29 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74190) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 11:42:29 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 11:42:29 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] LIGHTOS: no hostnqn found. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 11:42:29 user nova-compute[74190]: DEBUG os_brick.utils [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] <== get_connector_properties: return (1895ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cff158e257e1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:42:29 user nova-compute[74190]: DEBUG nova.virt.block_device [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Updating existing volume attachment record: cc368488-dd9d-44ee-a5fa-8d001b45f289 {{(pid=74190) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 11:42:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:42:38 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:42:39 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:42:43 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:42:44 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:42:45 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:42:46 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:42:46 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:42:46 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:42:46 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:42:46 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:42:46 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Auditing locally available compute resources for user (node: user) {{(pid=74190) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 11:42:46 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c3cce66-9d7a-4f23-a92a-d10b3efd5e86/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:42:46 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c3cce66-9d7a-4f23-a92a-d10b3efd5e86/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:42:46 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c3cce66-9d7a-4f23-a92a-d10b3efd5e86/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:42:46 user nova-compute[74190]: DEBUG nova.compute.manager [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Start spawning the instance on the hypervisor. {{(pid=74190) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 11:42:46 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Creating instance directory {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 11:42:46 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Creating image(s)
Oct 18 11:42:46 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Did not create local disks {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 18 11:42:46 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Ensure instance console log exists: /opt/stack/data/nova/instances/aabb5eea-8366-482a-8d16-bf271c0fe8d7/console.log {{(pid=74190) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 11:42:46 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:42:46 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:42:46 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:42:46 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Start _get_guest_xml network_info=[{"id": "21163c28-d799-420c-96b5-6ea0e829dc93", "address": "fa:16:3e:d8:31:38", "network": {"id": "40790864-a5db-4f62-adde-28ee0dc256cc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-682684827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f5028593e4e4805aaa839c6759be293", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21163c28-d7", "ovs_interfaceid": "21163c28-d799-420c-96b5-6ea0e829dc93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ahIObAot', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'aabb5eea-8366-482a-8d16-bf271c0fe8d7', 'attached_at': '', 'detached_at': '', 'volume_id': '5c87f389-42e2-4d78-8bdb-4d5bda76216c', 'serial': '5c87f389-42e2-4d78-8bdb-4d5bda76216c'}, 'delete_on_termination': True, 'guest_format': None, 'attachment_id': 'cc368488-dd9d-44ee-a5fa-8d001b45f289', 'volume_type': None} {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 11:42:46 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:42:46 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:42:46 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 11:42:46 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] CPU controller missing on host. {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 11:42:46 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 11:42:46 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] CPU controller found on host. {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 11:42:46 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74190) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 11:42:46 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T11:37:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 11:42:46 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Flavor limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 11:42:46 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Image limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 11:42:46 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Flavor pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 11:42:46 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Image pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 11:42:46 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 11:42:46 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 11:42:46 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 11:42:46 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Got 1 possible topologies {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 11:42:46 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 11:42:46 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 11:42:46 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:42:46 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:42:46 user nova-compute[74190]: DEBUG os_brick.initiator.connector [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Factory for ISCSI on None {{(pid=74190) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Oct 18 11:42:46 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:42:46 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Calling os-brick to attach iSCSI Volume {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 11:42:46 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ahIObAot', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:42:46 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:42:46 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:42:46 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:42:46 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:42:46 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:42:46 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:42:46 user nova-compute[74190]: INFO os_brick.initiator.connectors.iscsi [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 11:42:46 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c -p 172.16.0.220:3260 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:42:46 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:42:46 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d1ee90a-e72f-403f-9ae9-ef93511c5147]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:42:46 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 11:42:46 user nova-compute[74190]:  {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:42:46 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c -p 172.16.0.220:3260 --interface default --op new {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:42:46 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:42:46 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[f619f623-7639-4cc7-8e83-df01d00d6e75]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c] added\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:42:46 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c] added
Oct 18 11:42:46 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:42:46 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:42:46 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c3cce66-9d7a-4f23-a92a-d10b3efd5e86/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:42:46 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034398e8-e8c4-4e03-a608-440e447c6041/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:42:46 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:42:46 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[c08e683d-efc9-4899-a7fa-2f6881532220]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:42:46 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:42:46 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:42:46 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:42:46 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[57306324-e9b7-4d94-ac7c-ebcdea1f321b]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:42:46 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:42:46 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ahIObAot {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:42:46 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ahIObAot" returned: 0 in 0.022s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:42:46 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0f3408e-3e56-4ca9-a0cf-97a8426b231f]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:42:46 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ahIObAot'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:42:46 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:42:46 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:42:46 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[57471507-1bf3-4ac1-bad9-2486cbe2bc3b]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:42:46 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:42:46 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:42:46 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.014s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:42:46 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e5cbcdc-6d29-4dac-8e88-461b74de31e9]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:42:46 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 18 11:42:46 user nova-compute[74190]:  {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:42:46 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 18 11:42:46 user nova-compute[74190]:  {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:42:46 user nova-compute[74190]: WARNING os_brick.initiator.connectors.iscsi [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 18 11:42:46 user nova-compute[74190]: 
Oct 18 11:42:46 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c -p 172.16.0.220:3260 --login {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:42:46 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034398e8-e8c4-4e03-a608-440e447c6041/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:42:46 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034398e8-e8c4-4e03-a608-440e447c6041/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:42:46 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:42:46 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a6be47-3f1a-4113-bba7-433375bb1c5c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:42:46 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c, portal: 172.16.0.220,3260]
Oct 18 11:42:46 user nova-compute[74190]: Login to [iface: default, target: iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c, portal: 172.16.0.220,3260] successful.
Oct 18 11:42:46 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:42:46 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:42:46 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:42:46 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d7cf7ef-5cab-4734-81a0-413f5e39e316]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:42:46 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:42:46 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:42:46 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:42:46 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[6def2cf5-435c-40d7-bfdf-32cb4561eadf]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:42:46 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)
Oct 18 11:42:46 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:42:46 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)
Oct 18 11:42:46 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:42:46 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:42:46 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Connected to 172.16.0.220:3260 {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 11:42:46 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=74190) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 11:42:46 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74190) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 11:42:46 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:42:46 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:42:46 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[af4b03b2-3628-43d0-b296-a95f32505991]: (4, ('- - 0', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:42:46 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74190) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 11:42:46 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ahIObAot', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 11:42:47 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034398e8-e8c4-4e03-a608-440e447c6041/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:42:47 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/697d3123-bd6b-42b9-b278-c33c0c00da6f/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:42:47 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/697d3123-bd6b-42b9-b278-c33c0c00da6f/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:42:47 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/697d3123-bd6b-42b9-b278-c33c0c00da6f/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:42:47 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/697d3123-bd6b-42b9-b278-c33c0c00da6f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:42:47 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0209c824-88a7-4976-83bf-8a72437f0cc2/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:42:47 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0209c824-88a7-4976-83bf-8a72437f0cc2/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:42:47 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0209c824-88a7-4976-83bf-8a72437f0cc2/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:42:47 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0209c824-88a7-4976-83bf-8a72437f0cc2/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:42:47 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d56b243d-fbf2-4ae6-8399-80df46b33b82/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:42:47 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:42:47 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] <== connect_volume: return (1362ms) {'type': 'block', 'scsi_wwn': '23338373835663364', 'path': '/dev/sdb'} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:42:47 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23338373835663364', 'path': '/dev/sdb'} {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 11:42:47 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d56b243d-fbf2-4ae6-8399-80df46b33b82/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:42:47 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d56b243d-fbf2-4ae6-8399-80df46b33b82/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:42:48 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:42:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1751107250',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1751107250',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCGAytsGwKIkIlWHJHinPWL79JZWbDLUxBsDePH5prj/RtI6Z3qHCyazEDqxn5098+uhRVuFwPPlZKB1iRU99f3IUwmSBv9DCo1T4Kl+DbCeNTfJ+46eAnqPOhZREa0v/Q==',key_name='tempest-keypair-458715235',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f5028593e4e4805aaa839c6759be293',ramdisk_id='',reservation_id='r-6je5vmge',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1161132701',owner_user_name='tempest-ServerActionsV293TestJSON-1161132701-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:42:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='58fb2050865044f9a0d621a9ca328ece',uuid=aabb5eea-8366-482a-8d16-bf271c0fe8d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "21163c28-d799-420c-96b5-6ea0e829dc93", "address": "fa:16:3e:d8:31:38", "network": {"id": "40790864-a5db-4f62-adde-28ee0dc256cc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-682684827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f5028593e4e4805aaa839c6759be293", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21163c28-d7", "ovs_interfaceid": "21163c28-d799-420c-96b5-6ea0e829dc93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74190) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 11:42:48 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Converting VIF {"id": "21163c28-d799-420c-96b5-6ea0e829dc93", "address": "fa:16:3e:d8:31:38", "network": {"id": "40790864-a5db-4f62-adde-28ee0dc256cc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-682684827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f5028593e4e4805aaa839c6759be293", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21163c28-d7", "ovs_interfaceid": "21163c28-d799-420c-96b5-6ea0e829dc93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:42:48 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:31:38,bridge_name='br-int',has_traffic_filtering=True,id=21163c28-d799-420c-96b5-6ea0e829dc93,network=Network(40790864-a5db-4f62-adde-28ee0dc256cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21163c28-d7') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:42:48 user nova-compute[74190]: DEBUG nova.objects.instance [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Lazy-loading 'pci_devices' on Instance uuid aabb5eea-8366-482a-8d16-bf271c0fe8d7 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:42:48 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] End _get_guest_xml xml=<domain type="kvm">
Oct 18 11:42:48 user nova-compute[74190]:   <uuid>aabb5eea-8366-482a-8d16-bf271c0fe8d7</uuid>
Oct 18 11:42:48 user nova-compute[74190]:   <name>instance-00000009</name>
Oct 18 11:42:48 user nova-compute[74190]:   <memory>524288</memory>
Oct 18 11:42:48 user nova-compute[74190]:   <vcpu>1</vcpu>
Oct 18 11:42:48 user nova-compute[74190]:   <metadata>
Oct 18 11:42:48 user nova-compute[74190]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 11:42:48 user nova-compute[74190]:       <nova:package version="0.0.0"/>
Oct 18 11:42:48 user nova-compute[74190]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1751107250</nova:name>
Oct 18 11:42:48 user nova-compute[74190]:       <nova:creationTime>2023-10-18 11:42:46</nova:creationTime>
Oct 18 11:42:48 user nova-compute[74190]:       <nova:flavor name="m1.tiny">
Oct 18 11:42:48 user nova-compute[74190]:         <nova:memory>512</nova:memory>
Oct 18 11:42:48 user nova-compute[74190]:         <nova:disk>1</nova:disk>
Oct 18 11:42:48 user nova-compute[74190]:         <nova:swap>0</nova:swap>
Oct 18 11:42:48 user nova-compute[74190]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 11:42:48 user nova-compute[74190]:         <nova:vcpus>1</nova:vcpus>
Oct 18 11:42:48 user nova-compute[74190]:       </nova:flavor>
Oct 18 11:42:48 user nova-compute[74190]:       <nova:owner>
Oct 18 11:42:48 user nova-compute[74190]:         <nova:user uuid="58fb2050865044f9a0d621a9ca328ece">tempest-ServerActionsV293TestJSON-1161132701-project-member</nova:user>
Oct 18 11:42:48 user nova-compute[74190]:         <nova:project uuid="5f5028593e4e4805aaa839c6759be293">tempest-ServerActionsV293TestJSON-1161132701</nova:project>
Oct 18 11:42:48 user nova-compute[74190]:       </nova:owner>
Oct 18 11:42:48 user nova-compute[74190]:       <nova:ports>
Oct 18 11:42:48 user nova-compute[74190]:         <nova:port uuid="21163c28-d799-420c-96b5-6ea0e829dc93">
Oct 18 11:42:48 user nova-compute[74190]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 18 11:42:48 user nova-compute[74190]:         </nova:port>
Oct 18 11:42:48 user nova-compute[74190]:       </nova:ports>
Oct 18 11:42:48 user nova-compute[74190]:     </nova:instance>
Oct 18 11:42:48 user nova-compute[74190]:   </metadata>
Oct 18 11:42:48 user nova-compute[74190]:   <sysinfo type="smbios">
Oct 18 11:42:48 user nova-compute[74190]:     <system>
Oct 18 11:42:48 user nova-compute[74190]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 11:42:48 user nova-compute[74190]:       <entry name="product">OpenStack Nova</entry>
Oct 18 11:42:48 user nova-compute[74190]:       <entry name="version">0.0.0</entry>
Oct 18 11:42:48 user nova-compute[74190]:       <entry name="serial">aabb5eea-8366-482a-8d16-bf271c0fe8d7</entry>
Oct 18 11:42:48 user nova-compute[74190]:       <entry name="uuid">aabb5eea-8366-482a-8d16-bf271c0fe8d7</entry>
Oct 18 11:42:48 user nova-compute[74190]:       <entry name="family">Virtual Machine</entry>
Oct 18 11:42:48 user nova-compute[74190]:     </system>
Oct 18 11:42:48 user nova-compute[74190]:   </sysinfo>
Oct 18 11:42:48 user nova-compute[74190]:   <os>
Oct 18 11:42:48 user nova-compute[74190]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 11:42:48 user nova-compute[74190]:     <boot dev="hd"/>
Oct 18 11:42:48 user nova-compute[74190]:     <smbios mode="sysinfo"/>
Oct 18 11:42:48 user nova-compute[74190]:   </os>
Oct 18 11:42:48 user nova-compute[74190]:   <features>
Oct 18 11:42:48 user nova-compute[74190]:     <acpi/>
Oct 18 11:42:48 user nova-compute[74190]:     <apic/>
Oct 18 11:42:48 user nova-compute[74190]:     <vmcoreinfo/>
Oct 18 11:42:48 user nova-compute[74190]:   </features>
Oct 18 11:42:48 user nova-compute[74190]:   <clock offset="utc">
Oct 18 11:42:48 user nova-compute[74190]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 11:42:48 user nova-compute[74190]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 11:42:48 user nova-compute[74190]:     <timer name="hpet" present="no"/>
Oct 18 11:42:48 user nova-compute[74190]:   </clock>
Oct 18 11:42:48 user nova-compute[74190]:   <cpu mode="custom" match="exact">
Oct 18 11:42:48 user nova-compute[74190]:     <model>Nehalem</model>
Oct 18 11:42:48 user nova-compute[74190]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 11:42:48 user nova-compute[74190]:   </cpu>
Oct 18 11:42:48 user nova-compute[74190]:   <devices>
Oct 18 11:42:48 user nova-compute[74190]:     <disk type="block" device="disk">
Oct 18 11:42:48 user nova-compute[74190]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 11:42:48 user nova-compute[74190]:       <source dev="/dev/sdb"/>
Oct 18 11:42:48 user nova-compute[74190]:       <target dev="vda" bus="virtio"/>
Oct 18 11:42:48 user nova-compute[74190]:       <serial>5c87f389-42e2-4d78-8bdb-4d5bda76216c</serial>
Oct 18 11:42:48 user nova-compute[74190]:     </disk>
Oct 18 11:42:48 user nova-compute[74190]:     <interface type="ethernet">
Oct 18 11:42:48 user nova-compute[74190]:       <mac address="fa:16:3e:d8:31:38"/>
Oct 18 11:42:48 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:42:48 user nova-compute[74190]:       <mtu size="1442"/>
Oct 18 11:42:48 user nova-compute[74190]:       <target dev="tap21163c28-d7"/>
Oct 18 11:42:48 user nova-compute[74190]:     </interface>
Oct 18 11:42:48 user nova-compute[74190]:     <serial type="pty">
Oct 18 11:42:48 user nova-compute[74190]:       <log file="/opt/stack/data/nova/instances/aabb5eea-8366-482a-8d16-bf271c0fe8d7/console.log" append="off"/>
Oct 18 11:42:48 user nova-compute[74190]:     </serial>
Oct 18 11:42:48 user nova-compute[74190]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 11:42:48 user nova-compute[74190]:     <video>
Oct 18 11:42:48 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:42:48 user nova-compute[74190]:     </video>
Oct 18 11:42:48 user nova-compute[74190]:     <rng model="virtio">
Oct 18 11:42:48 user nova-compute[74190]:       <backend model="random">/dev/urandom</backend>
Oct 18 11:42:48 user nova-compute[74190]:     </rng>
Oct 18 11:42:48 user nova-compute[74190]:     <controller type="usb" index="0" model="none"/>
Oct 18 11:42:48 user nova-compute[74190]:     <memballoon model="virtio">
Oct 18 11:42:48 user nova-compute[74190]:       <stats period="10"/>
Oct 18 11:42:48 user nova-compute[74190]:     </memballoon>
Oct 18 11:42:48 user nova-compute[74190]:   </devices>
Oct 18 11:42:48 user nova-compute[74190]: </domain>
Oct 18 11:42:48 user nova-compute[74190]:  {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 11:42:48 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:42:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1751107250',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1751107250',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCGAytsGwKIkIlWHJHinPWL79JZWbDLUxBsDePH5prj/RtI6Z3qHCyazEDqxn5098+uhRVuFwPPlZKB1iRU99f3IUwmSBv9DCo1T4Kl+DbCeNTfJ+46eAnqPOhZREa0v/Q==',key_name='tempest-keypair-458715235',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f5028593e4e4805aaa839c6759be293',ramdisk_id='',reservation_id='r-6je5vmge',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1161132701',owner_user_name='tempest-ServerActionsV293TestJSON-1161132701-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:42:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='58fb2050865044f9a0d621a9ca328ece',uuid=aabb5eea-8366-482a-8d16-bf271c0fe8d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "21163c28-d799-420c-96b5-6ea0e829dc93", "address": "fa:16:3e:d8:31:38", "network": {"id": "40790864-a5db-4f62-adde-28ee0dc256cc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-682684827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f5028593e4e4805aaa839c6759be293", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21163c28-d7", "ovs_interfaceid": "21163c28-d799-420c-96b5-6ea0e829dc93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 11:42:48 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Converting VIF {"id": "21163c28-d799-420c-96b5-6ea0e829dc93", "address": "fa:16:3e:d8:31:38", "network": {"id": "40790864-a5db-4f62-adde-28ee0dc256cc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-682684827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f5028593e4e4805aaa839c6759be293", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21163c28-d7", "ovs_interfaceid": "21163c28-d799-420c-96b5-6ea0e829dc93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:42:48 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:31:38,bridge_name='br-int',has_traffic_filtering=True,id=21163c28-d799-420c-96b5-6ea0e829dc93,network=Network(40790864-a5db-4f62-adde-28ee0dc256cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21163c28-d7') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:42:48 user nova-compute[74190]: DEBUG os_vif [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:31:38,bridge_name='br-int',has_traffic_filtering=True,id=21163c28-d799-420c-96b5-6ea0e829dc93,network=Network(40790864-a5db-4f62-adde-28ee0dc256cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21163c28-d7') {{(pid=74190) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 11:42:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:42:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:42:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 11:42:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:42:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4bb5c835-874f-5a51-b9d7-776327462e61', '_type': 'linux-noop'}}, row=False) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:42:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:42:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:42:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:42:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap21163c28-d7, may_exist=True, interface_attrs={}) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:42:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap21163c28-d7, col_values=(('qos', UUID('cb742216-8166-4a1d-b4a5-62fb5837d8e5')),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:42:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap21163c28-d7, col_values=(('external_ids', {'iface-id': '21163c28-d799-420c-96b5-6ea0e829dc93', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d8:31:38', 'vm-uuid': 'aabb5eea-8366-482a-8d16-bf271c0fe8d7'}),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:42:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:42:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:42:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:42:48 user nova-compute[74190]: INFO os_vif [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:31:38,bridge_name='br-int',has_traffic_filtering=True,id=21163c28-d799-420c-96b5-6ea0e829dc93,network=Network(40790864-a5db-4f62-adde-28ee0dc256cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21163c28-d7')
Oct 18 11:42:48 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] No BDM found with device name vda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 11:42:48 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] No VIF found with MAC fa:16:3e:d8:31:38, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 11:42:48 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d56b243d-fbf2-4ae6-8399-80df46b33b82/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:42:48 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6130edd-eb98-491e-a0ba-6bd59199d9e1/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:42:48 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6130edd-eb98-491e-a0ba-6bd59199d9e1/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:42:48 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6130edd-eb98-491e-a0ba-6bd59199d9e1/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:42:48 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6130edd-eb98-491e-a0ba-6bd59199d9e1/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:42:48 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c280652c-ffde-40f8-a919-adb8be618db8/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:42:48 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c280652c-ffde-40f8-a919-adb8be618db8/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:42:48 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c280652c-ffde-40f8-a919-adb8be618db8/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:42:48 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c280652c-ffde-40f8-a919-adb8be618db8/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:42:48 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:42:49 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Acquiring lock "3bd2f6d6-9c07-42a0-869e-566d685cb025" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:42:49 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Lock "3bd2f6d6-9c07-42a0-869e-566d685cb025" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:42:49 user nova-compute[74190]: DEBUG nova.compute.manager [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Starting instance... {{(pid=74190) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 11:42:49 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:42:49 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:42:49 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:42:49 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:42:49 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74190) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 11:42:49 user nova-compute[74190]: INFO nova.compute.claims [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Claim successful on node user
Oct 18 11:42:49 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:42:49 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:42:51 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:42:51 user nova-compute[74190]: DEBUG nova.compute.manager [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Instance event wait completed in 0 seconds for  {{(pid=74190) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 11:42:51 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Guest created on hypervisor {{(pid=74190) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 11:42:51 user nova-compute[74190]: DEBUG nova.compute.manager [req-30597b7d-46d8-4504-81dd-6ad7034202b6 req-00eb6631-508c-41a9-960a-78dfe0cd176a service nova] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Received event network-vif-plugged-21163c28-d799-420c-96b5-6ea0e829dc93 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:42:51 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-30597b7d-46d8-4504-81dd-6ad7034202b6 req-00eb6631-508c-41a9-960a-78dfe0cd176a service nova] Acquiring lock "aabb5eea-8366-482a-8d16-bf271c0fe8d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:42:51 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-30597b7d-46d8-4504-81dd-6ad7034202b6 req-00eb6631-508c-41a9-960a-78dfe0cd176a service nova] Lock "aabb5eea-8366-482a-8d16-bf271c0fe8d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:42:51 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-30597b7d-46d8-4504-81dd-6ad7034202b6 req-00eb6631-508c-41a9-960a-78dfe0cd176a service nova] Lock "aabb5eea-8366-482a-8d16-bf271c0fe8d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:42:51 user nova-compute[74190]: DEBUG nova.compute.manager [req-30597b7d-46d8-4504-81dd-6ad7034202b6 req-00eb6631-508c-41a9-960a-78dfe0cd176a service nova] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] No waiting events found dispatching network-vif-plugged-21163c28-d799-420c-96b5-6ea0e829dc93 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:42:51 user nova-compute[74190]: WARNING nova.compute.manager [req-30597b7d-46d8-4504-81dd-6ad7034202b6 req-00eb6631-508c-41a9-960a-78dfe0cd176a service nova] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Received unexpected event network-vif-plugged-21163c28-d799-420c-96b5-6ea0e829dc93 for instance with vm_state building and task_state spawning.
Oct 18 11:42:51 user nova-compute[74190]: DEBUG nova.compute.manager [req-fad633da-2ba3-4a2a-92e3-b0583643b859 req-370ffbd8-5398-4767-be7b-76da80ce5212 service nova] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Received event network-vif-plugged-21163c28-d799-420c-96b5-6ea0e829dc93 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:42:51 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-fad633da-2ba3-4a2a-92e3-b0583643b859 req-370ffbd8-5398-4767-be7b-76da80ce5212 service nova] Acquiring lock "aabb5eea-8366-482a-8d16-bf271c0fe8d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:42:51 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-fad633da-2ba3-4a2a-92e3-b0583643b859 req-370ffbd8-5398-4767-be7b-76da80ce5212 service nova] Lock "aabb5eea-8366-482a-8d16-bf271c0fe8d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:42:51 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-fad633da-2ba3-4a2a-92e3-b0583643b859 req-370ffbd8-5398-4767-be7b-76da80ce5212 service nova] Lock "aabb5eea-8366-482a-8d16-bf271c0fe8d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:42:51 user nova-compute[74190]: DEBUG nova.compute.manager [req-fad633da-2ba3-4a2a-92e3-b0583643b859 req-370ffbd8-5398-4767-be7b-76da80ce5212 service nova] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] No waiting events found dispatching network-vif-plugged-21163c28-d799-420c-96b5-6ea0e829dc93 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:42:51 user nova-compute[74190]: WARNING nova.compute.manager [req-fad633da-2ba3-4a2a-92e3-b0583643b859 req-370ffbd8-5398-4767-be7b-76da80ce5212 service nova] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Received unexpected event network-vif-plugged-21163c28-d799-420c-96b5-6ea0e829dc93 for instance with vm_state building and task_state spawning.
Oct 18 11:42:51 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:42:51 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:42:51 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Hypervisor/Node resource view: name=user free_ram=7383MB free_disk=25.68209457397461GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74190) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 11:42:51 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:42:51 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Instance spawned successfully.
Oct 18 11:42:51 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 11:42:51 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Found default for hw_cdrom_bus of ide {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:42:51 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Found default for hw_disk_bus of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:42:51 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Found default for hw_input_bus of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:42:51 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Found default for hw_pointer_model of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:42:51 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Found default for hw_video_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:42:51 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Found default for hw_vif_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:42:51 user nova-compute[74190]: INFO nova.compute.manager [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Took 5.47 seconds to spawn the instance on the hypervisor.
Oct 18 11:42:51 user nova-compute[74190]: DEBUG nova.compute.manager [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Checking state {{(pid=74190) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 11:42:52 user nova-compute[74190]: INFO nova.compute.manager [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Took 25.14 seconds to build instance.
Oct 18 11:42:52 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-07a262de-b72d-4e10-8d82-4ba4f70763d5 tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Lock "aabb5eea-8366-482a-8d16-bf271c0fe8d7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.258s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:42:52 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 11:42:52 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 11:42:52 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:42:52 user nova-compute[74190]: DEBUG nova.compute.manager [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Start building networks asynchronously for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 11:42:52 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.374s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:42:52 user nova-compute[74190]: DEBUG nova.compute.manager [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Allocating IP information in the background. {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 11:42:52 user nova-compute[74190]: DEBUG nova.network.neutron [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] allocate_for_instance() {{(pid=74190) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 11:42:52 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 11:42:52 user nova-compute[74190]: DEBUG nova.compute.manager [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Start building block device mappings for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 11:42:52 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance c280652c-ffde-40f8-a919-adb8be618db8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:42:52 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:42:52 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 0209c824-88a7-4976-83bf-8a72437f0cc2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:42:52 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance c6130edd-eb98-491e-a0ba-6bd59199d9e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:42:52 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:42:52 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance d56b243d-fbf2-4ae6-8399-80df46b33b82 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:42:52 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 034398e8-e8c4-4e03-a608-440e447c6041 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:42:52 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 697d3123-bd6b-42b9-b278-c33c0c00da6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:42:52 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance aabb5eea-8366-482a-8d16-bf271c0fe8d7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:42:52 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 3bd2f6d6-9c07-42a0-869e-566d685cb025 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:42:52 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 11:42:52 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 11:42:52 user nova-compute[74190]: INFO nova.virt.block_device [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Booting with volume 2d829820-7b5f-42f9-81ab-8efc923f288a at /dev/vda
Oct 18 11:42:52 user nova-compute[74190]: DEBUG nova.policy [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '06661e802ad947d2a4e07e3d60a94d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3e15d2b7944cba9ed86eb5c01ec98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74190) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 11:42:52 user nova-compute[74190]: DEBUG os_brick.utils [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:42:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:42:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:42:52 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[50533d03-4087-41d9-b454-9bd195d47cfc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cff158e257e1\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:42:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:42:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:42:52 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e2c866-8c80-4bfa-94c1-5d0a9b264cb8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:42:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:42:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:42:52 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[db7fdc76-d2fc-43d6-a39b-9008946f0417]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:42:52 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ae7880d-35d5-45f9-a5dc-0e6bfa690fff]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:42:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Running cmd (subprocess): nvme version {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:42:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] 'nvme version' failed. Not Retrying. {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 11:42:52 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] nvme not present on system {{(pid=74190) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 11:42:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:42:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 11:42:52 user nova-compute[74190]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 11:42:52 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb95442d-84a1-4e7d-ba61-069ea210f15a]: (4, '') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:42:52 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74190) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 11:42:52 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 11:42:52 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] LIGHTOS: no hostnqn found. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 11:42:52 user nova-compute[74190]: DEBUG os_brick.utils [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cff158e257e1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:42:52 user nova-compute[74190]: DEBUG nova.virt.block_device [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Updating existing volume attachment record: 91ac3c25-0db6-47d0-aa90-c95df77e45ca {{(pid=74190) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 11:42:52 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 11:42:52 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 11:42:52 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Compute_service record updated for user:user {{(pid=74190) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 11:42:52 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.674s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:42:53 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:42:53 user nova-compute[74190]: DEBUG nova.network.neutron [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Successfully created port: 9eca4d9a-28f0-4818-beef-e65c22f351dd {{(pid=74190) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 11:42:53 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:42:53 user nova-compute[74190]: DEBUG nova.compute.manager [req-dfc95d9e-2a64-46ae-8b1e-ad43010e65df req-f5f94eab-2175-4beb-9d1d-6f1f53d6e4f7 service nova] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Received event network-changed-80b77e2d-aa04-4996-a0c1-713054affac4 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:42:53 user nova-compute[74190]: DEBUG nova.compute.manager [req-dfc95d9e-2a64-46ae-8b1e-ad43010e65df req-f5f94eab-2175-4beb-9d1d-6f1f53d6e4f7 service nova] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Refreshing instance network info cache due to event network-changed-80b77e2d-aa04-4996-a0c1-713054affac4. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 11:42:53 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-dfc95d9e-2a64-46ae-8b1e-ad43010e65df req-f5f94eab-2175-4beb-9d1d-6f1f53d6e4f7 service nova] Acquiring lock "refresh_cache-c280652c-ffde-40f8-a919-adb8be618db8" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:42:53 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-dfc95d9e-2a64-46ae-8b1e-ad43010e65df req-f5f94eab-2175-4beb-9d1d-6f1f53d6e4f7 service nova] Acquired lock "refresh_cache-c280652c-ffde-40f8-a919-adb8be618db8" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:42:53 user nova-compute[74190]: DEBUG nova.network.neutron [req-dfc95d9e-2a64-46ae-8b1e-ad43010e65df req-f5f94eab-2175-4beb-9d1d-6f1f53d6e4f7 service nova] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Refreshing network info cache for port 80b77e2d-aa04-4996-a0c1-713054affac4 {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 11:42:54 user nova-compute[74190]: DEBUG nova.compute.manager [req-d0bf12da-f0ce-4178-a0cd-0b7e2e52991e req-70adf256-9702-449a-af98-0a619eb96c12 service nova] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Received event network-changed-8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:42:54 user nova-compute[74190]: DEBUG nova.compute.manager [req-d0bf12da-f0ce-4178-a0cd-0b7e2e52991e req-70adf256-9702-449a-af98-0a619eb96c12 service nova] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Refreshing instance network info cache due to event network-changed-8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 11:42:54 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d0bf12da-f0ce-4178-a0cd-0b7e2e52991e req-70adf256-9702-449a-af98-0a619eb96c12 service nova] Acquiring lock "refresh_cache-3c3cce66-9d7a-4f23-a92a-d10b3efd5e86" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:42:54 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d0bf12da-f0ce-4178-a0cd-0b7e2e52991e req-70adf256-9702-449a-af98-0a619eb96c12 service nova] Acquired lock "refresh_cache-3c3cce66-9d7a-4f23-a92a-d10b3efd5e86" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:42:54 user nova-compute[74190]: DEBUG nova.network.neutron [req-d0bf12da-f0ce-4178-a0cd-0b7e2e52991e req-70adf256-9702-449a-af98-0a619eb96c12 service nova] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Refreshing network info cache for port 8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9 {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 11:42:54 user nova-compute[74190]: DEBUG nova.network.neutron [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Successfully updated port: 9eca4d9a-28f0-4818-beef-e65c22f351dd {{(pid=74190) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 11:42:54 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Acquiring lock "refresh_cache-3bd2f6d6-9c07-42a0-869e-566d685cb025" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:42:54 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Acquired lock "refresh_cache-3bd2f6d6-9c07-42a0-869e-566d685cb025" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:42:54 user nova-compute[74190]: DEBUG nova.network.neutron [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Building network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 11:42:54 user nova-compute[74190]: DEBUG nova.network.neutron [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Instance cache missing network info. {{(pid=74190) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 11:42:55 user nova-compute[74190]: DEBUG nova.network.neutron [req-dfc95d9e-2a64-46ae-8b1e-ad43010e65df req-f5f94eab-2175-4beb-9d1d-6f1f53d6e4f7 service nova] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Updated VIF entry in instance network info cache for port 80b77e2d-aa04-4996-a0c1-713054affac4. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 11:42:55 user nova-compute[74190]: DEBUG nova.network.neutron [req-dfc95d9e-2a64-46ae-8b1e-ad43010e65df req-f5f94eab-2175-4beb-9d1d-6f1f53d6e4f7 service nova] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Updating instance_info_cache with network_info: [{"id": "80b77e2d-aa04-4996-a0c1-713054affac4", "address": "fa:16:3e:4f:00:ce", "network": {"id": "cf0a4705-3fff-4716-87ac-b0ca7700e11c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1739631852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cf8d4d4f504e82868ed295e054644c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80b77e2d-aa", "ovs_interfaceid": "80b77e2d-aa04-4996-a0c1-713054affac4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:42:55 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-dfc95d9e-2a64-46ae-8b1e-ad43010e65df req-f5f94eab-2175-4beb-9d1d-6f1f53d6e4f7 service nova] Releasing lock "refresh_cache-c280652c-ffde-40f8-a919-adb8be618db8" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:42:55 user nova-compute[74190]: DEBUG nova.network.neutron [req-d0bf12da-f0ce-4178-a0cd-0b7e2e52991e req-70adf256-9702-449a-af98-0a619eb96c12 service nova] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Updated VIF entry in instance network info cache for port 8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 11:42:55 user nova-compute[74190]: DEBUG nova.network.neutron [req-d0bf12da-f0ce-4178-a0cd-0b7e2e52991e req-70adf256-9702-449a-af98-0a619eb96c12 service nova] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Updating instance_info_cache with network_info: [{"id": "8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9", "address": "fa:16:3e:93:46:f1", "network": {"id": "e6ae8edc-7014-4341-91b2-4c82d72c9bb9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-15434410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548640fa718f4fdfa21c1a7783519c9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d891e1d-9d", "ovs_interfaceid": "8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:42:55 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d0bf12da-f0ce-4178-a0cd-0b7e2e52991e req-70adf256-9702-449a-af98-0a619eb96c12 service nova] Releasing lock "refresh_cache-3c3cce66-9d7a-4f23-a92a-d10b3efd5e86" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:42:55 user nova-compute[74190]: DEBUG nova.network.neutron [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Updating instance_info_cache with network_info: [{"id": "9eca4d9a-28f0-4818-beef-e65c22f351dd", "address": "fa:16:3e:f6:77:76", "network": {"id": "0c5cbb41-ba77-494a-904b-4c37e3205eb9", "bridge": "br-int", "label": "tempest-TestShelveInstance-1626181921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d3e15d2b7944cba9ed86eb5c01ec98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9eca4d9a-28", "ovs_interfaceid": "9eca4d9a-28f0-4818-beef-e65c22f351dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:42:55 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Releasing lock "refresh_cache-3bd2f6d6-9c07-42a0-869e-566d685cb025" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:42:55 user nova-compute[74190]: DEBUG nova.compute.manager [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Instance network_info: |[{"id": "9eca4d9a-28f0-4818-beef-e65c22f351dd", "address": "fa:16:3e:f6:77:76", "network": {"id": "0c5cbb41-ba77-494a-904b-4c37e3205eb9", "bridge": "br-int", "label": "tempest-TestShelveInstance-1626181921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d3e15d2b7944cba9ed86eb5c01ec98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9eca4d9a-28", "ovs_interfaceid": "9eca4d9a-28f0-4818-beef-e65c22f351dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 11:42:55 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:42:55 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:42:55 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Starting heal instance info cache {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 11:42:56 user nova-compute[74190]: DEBUG nova.compute.manager [req-f68a10b2-cb0f-4941-a509-680312d91c46 req-4d620b07-e8a4-4494-96f3-944be6b291ab service nova] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Received event network-changed-9eca4d9a-28f0-4818-beef-e65c22f351dd {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:42:56 user nova-compute[74190]: DEBUG nova.compute.manager [req-f68a10b2-cb0f-4941-a509-680312d91c46 req-4d620b07-e8a4-4494-96f3-944be6b291ab service nova] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Refreshing instance network info cache due to event network-changed-9eca4d9a-28f0-4818-beef-e65c22f351dd. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 11:42:56 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-f68a10b2-cb0f-4941-a509-680312d91c46 req-4d620b07-e8a4-4494-96f3-944be6b291ab service nova] Acquiring lock "refresh_cache-3bd2f6d6-9c07-42a0-869e-566d685cb025" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:42:56 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-f68a10b2-cb0f-4941-a509-680312d91c46 req-4d620b07-e8a4-4494-96f3-944be6b291ab service nova] Acquired lock "refresh_cache-3bd2f6d6-9c07-42a0-869e-566d685cb025" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:42:56 user nova-compute[74190]: DEBUG nova.network.neutron [req-f68a10b2-cb0f-4941-a509-680312d91c46 req-4d620b07-e8a4-4494-96f3-944be6b291ab service nova] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Refreshing network info cache for port 9eca4d9a-28f0-4818-beef-e65c22f351dd {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 11:42:56 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "refresh_cache-3c3cce66-9d7a-4f23-a92a-d10b3efd5e86" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:42:56 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquired lock "refresh_cache-3c3cce66-9d7a-4f23-a92a-d10b3efd5e86" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:42:56 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Forcefully refreshing network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 18 11:42:56 user nova-compute[74190]: DEBUG nova.network.neutron [req-f68a10b2-cb0f-4941-a509-680312d91c46 req-4d620b07-e8a4-4494-96f3-944be6b291ab service nova] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Updated VIF entry in instance network info cache for port 9eca4d9a-28f0-4818-beef-e65c22f351dd. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 11:42:56 user nova-compute[74190]: DEBUG nova.network.neutron [req-f68a10b2-cb0f-4941-a509-680312d91c46 req-4d620b07-e8a4-4494-96f3-944be6b291ab service nova] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Updating instance_info_cache with network_info: [{"id": "9eca4d9a-28f0-4818-beef-e65c22f351dd", "address": "fa:16:3e:f6:77:76", "network": {"id": "0c5cbb41-ba77-494a-904b-4c37e3205eb9", "bridge": "br-int", "label": "tempest-TestShelveInstance-1626181921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d3e15d2b7944cba9ed86eb5c01ec98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9eca4d9a-28", "ovs_interfaceid": "9eca4d9a-28f0-4818-beef-e65c22f351dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:42:56 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-f68a10b2-cb0f-4941-a509-680312d91c46 req-4d620b07-e8a4-4494-96f3-944be6b291ab service nova] Releasing lock "refresh_cache-3bd2f6d6-9c07-42a0-869e-566d685cb025" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:42:57 user nova-compute[74190]: DEBUG nova.compute.manager [req-2c74a7ad-191f-4a0d-bf46-58677bd9b49e req-7c26fe81-5d30-4824-bd0c-721c2c0a3d3d service nova] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] Received event network-changed-5e4eb783-7e7c-4501-bf99-33472454f4ac {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:42:57 user nova-compute[74190]: DEBUG nova.compute.manager [req-2c74a7ad-191f-4a0d-bf46-58677bd9b49e req-7c26fe81-5d30-4824-bd0c-721c2c0a3d3d service nova] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] Refreshing instance network info cache due to event network-changed-5e4eb783-7e7c-4501-bf99-33472454f4ac. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 11:42:57 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-2c74a7ad-191f-4a0d-bf46-58677bd9b49e req-7c26fe81-5d30-4824-bd0c-721c2c0a3d3d service nova] Acquiring lock "refresh_cache-0209c824-88a7-4976-83bf-8a72437f0cc2" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:42:57 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-2c74a7ad-191f-4a0d-bf46-58677bd9b49e req-7c26fe81-5d30-4824-bd0c-721c2c0a3d3d service nova] Acquired lock "refresh_cache-0209c824-88a7-4976-83bf-8a72437f0cc2" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:42:57 user nova-compute[74190]: DEBUG nova.network.neutron [req-2c74a7ad-191f-4a0d-bf46-58677bd9b49e req-7c26fe81-5d30-4824-bd0c-721c2c0a3d3d service nova] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] Refreshing network info cache for port 5e4eb783-7e7c-4501-bf99-33472454f4ac {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 11:42:57 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Updating instance_info_cache with network_info: [{"id": "8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9", "address": "fa:16:3e:93:46:f1", "network": {"id": "e6ae8edc-7014-4341-91b2-4c82d72c9bb9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-15434410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548640fa718f4fdfa21c1a7783519c9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d891e1d-9d", "ovs_interfaceid": "8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:42:57 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Releasing lock "refresh_cache-3c3cce66-9d7a-4f23-a92a-d10b3efd5e86" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:42:57 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Updated the network info_cache for instance {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 18 11:42:57 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:42:57 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:42:57 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:42:57 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:42:57 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:42:57 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74190) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 11:42:58 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:42:58 user nova-compute[74190]: DEBUG nova.network.neutron [req-2c74a7ad-191f-4a0d-bf46-58677bd9b49e req-7c26fe81-5d30-4824-bd0c-721c2c0a3d3d service nova] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] Updated VIF entry in instance network info cache for port 5e4eb783-7e7c-4501-bf99-33472454f4ac. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 11:42:58 user nova-compute[74190]: DEBUG nova.network.neutron [req-2c74a7ad-191f-4a0d-bf46-58677bd9b49e req-7c26fe81-5d30-4824-bd0c-721c2c0a3d3d service nova] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] Updating instance_info_cache with network_info: [{"id": "5e4eb783-7e7c-4501-bf99-33472454f4ac", "address": "fa:16:3e:7e:d2:03", "network": {"id": "f5ab7da4-2b07-4465-9a89-a07eb053ba91", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1315695374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08cf52ce927443158aa731367f08bd57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e4eb783-7e", "ovs_interfaceid": "5e4eb783-7e7c-4501-bf99-33472454f4ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:42:58 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-2c74a7ad-191f-4a0d-bf46-58677bd9b49e req-7c26fe81-5d30-4824-bd0c-721c2c0a3d3d service nova] Releasing lock "refresh_cache-0209c824-88a7-4976-83bf-8a72437f0cc2" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:42:58 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:42:59 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-57693029-5a4c-46bc-8ad7-92bb6fbe16d5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Acquiring lock "c280652c-ffde-40f8-a919-adb8be618db8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:42:59 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-57693029-5a4c-46bc-8ad7-92bb6fbe16d5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lock "c280652c-ffde-40f8-a919-adb8be618db8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:42:59 user nova-compute[74190]: DEBUG nova.objects.instance [None req-57693029-5a4c-46bc-8ad7-92bb6fbe16d5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lazy-loading 'flavor' on Instance uuid c280652c-ffde-40f8-a919-adb8be618db8 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:42:59 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-57693029-5a4c-46bc-8ad7-92bb6fbe16d5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lock "c280652c-ffde-40f8-a919-adb8be618db8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.105s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:43:00 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-57693029-5a4c-46bc-8ad7-92bb6fbe16d5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Acquiring lock "c280652c-ffde-40f8-a919-adb8be618db8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:43:00 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-57693029-5a4c-46bc-8ad7-92bb6fbe16d5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lock "c280652c-ffde-40f8-a919-adb8be618db8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:43:00 user nova-compute[74190]: INFO nova.compute.manager [None req-57693029-5a4c-46bc-8ad7-92bb6fbe16d5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Attaching volume 04ab732f-c6a7-459c-b856-68eeee8c77cb to /dev/vdb
Oct 18 11:43:00 user nova-compute[74190]: DEBUG os_brick.utils [None req-57693029-5a4c-46bc-8ad7-92bb6fbe16d5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:43:00 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:00 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:00 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[2044990b-66d5-4a71-afee-021e6674e52c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cff158e257e1\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:00 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:00 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:00 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[676b4123-d5ba-4513-a04c-b81923b7e75e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:00 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:00 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:00 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b9678a8-e22c-46a1-9536-76e02cb55187]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:00 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc25d2e-3835-4f5c-b58f-4f2447388f09]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:00 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-57693029-5a4c-46bc-8ad7-92bb6fbe16d5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Running cmd (subprocess): nvme version {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:00 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-57693029-5a4c-46bc-8ad7-92bb6fbe16d5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] 'nvme version' failed. Not Retrying. {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 11:43:00 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.nvmeof [None req-57693029-5a4c-46bc-8ad7-92bb6fbe16d5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] nvme not present on system {{(pid=74190) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 11:43:00 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:00 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 11:43:00 user nova-compute[74190]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 11:43:00 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c5281d5-0762-4255-9353-5f098be11bac]: (4, '') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:00 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-57693029-5a4c-46bc-8ad7-92bb6fbe16d5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74190) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 11:43:00 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-57693029-5a4c-46bc-8ad7-92bb6fbe16d5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 11:43:00 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-57693029-5a4c-46bc-8ad7-92bb6fbe16d5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] LIGHTOS: no hostnqn found. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 11:43:00 user nova-compute[74190]: DEBUG os_brick.utils [None req-57693029-5a4c-46bc-8ad7-92bb6fbe16d5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cff158e257e1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:43:00 user nova-compute[74190]: DEBUG nova.virt.block_device [None req-57693029-5a4c-46bc-8ad7-92bb6fbe16d5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Updating existing volume attachment record: 1fc455ad-834a-4d42-87b3-f96bab6de7a9 {{(pid=74190) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 11:43:01 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-55ff31a1-4e4d-4814-bb8a-b1391abf39b7 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Acquiring lock "3c3cce66-9d7a-4f23-a92a-d10b3efd5e86" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:43:01 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-55ff31a1-4e4d-4814-bb8a-b1391abf39b7 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Lock "3c3cce66-9d7a-4f23-a92a-d10b3efd5e86" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:43:01 user nova-compute[74190]: INFO nova.compute.manager [None req-55ff31a1-4e4d-4814-bb8a-b1391abf39b7 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Shelving
Oct 18 11:43:01 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:43:01 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:43:01 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:43:02 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:43:02 user nova-compute[74190]: DEBUG nova.compute.manager [req-95763acf-6c04-4fc2-97be-d05f5ab2d01e req-af386634-5ed6-42e2-99f1-1ef3ce3252f2 service nova] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Received event network-vif-unplugged-8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:43:02 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-95763acf-6c04-4fc2-97be-d05f5ab2d01e req-af386634-5ed6-42e2-99f1-1ef3ce3252f2 service nova] Acquiring lock "3c3cce66-9d7a-4f23-a92a-d10b3efd5e86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:43:02 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-95763acf-6c04-4fc2-97be-d05f5ab2d01e req-af386634-5ed6-42e2-99f1-1ef3ce3252f2 service nova] Lock "3c3cce66-9d7a-4f23-a92a-d10b3efd5e86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:43:02 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-95763acf-6c04-4fc2-97be-d05f5ab2d01e req-af386634-5ed6-42e2-99f1-1ef3ce3252f2 service nova] Lock "3c3cce66-9d7a-4f23-a92a-d10b3efd5e86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:43:02 user nova-compute[74190]: DEBUG nova.compute.manager [req-95763acf-6c04-4fc2-97be-d05f5ab2d01e req-af386634-5ed6-42e2-99f1-1ef3ce3252f2 service nova] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] No waiting events found dispatching network-vif-unplugged-8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:43:02 user nova-compute[74190]: WARNING nova.compute.manager [req-95763acf-6c04-4fc2-97be-d05f5ab2d01e req-af386634-5ed6-42e2-99f1-1ef3ce3252f2 service nova] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Received unexpected event network-vif-unplugged-8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9 for instance with vm_state active and task_state shelving.
Oct 18 11:43:02 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Instance destroyed successfully.
Oct 18 11:43:02 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-55ff31a1-4e4d-4814-bb8a-b1391abf39b7 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Beginning cold snapshot process
Oct 18 11:43:02 user nova-compute[74190]: DEBUG nova.privsep.utils [None req-55ff31a1-4e4d-4814-bb8a-b1391abf39b7 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74190) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 18 11:43:02 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-55ff31a1-4e4d-4814-bb8a-b1391abf39b7 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/3c3cce66-9d7a-4f23-a92a-d10b3efd5e86/disk /opt/stack/data/nova/instances/snapshots/tmpaod37g61/b1a18b5079974e43ac0d41f1594eb66b {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:03 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:43:03 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:43:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-55ff31a1-4e4d-4814-bb8a-b1391abf39b7 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/3c3cce66-9d7a-4f23-a92a-d10b3efd5e86/disk /opt/stack/data/nova/instances/snapshots/tmpaod37g61/b1a18b5079974e43ac0d41f1594eb66b" returned: 0 in 1.190s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:03 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-55ff31a1-4e4d-4814-bb8a-b1391abf39b7 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Snapshot extracted, beginning image upload
Oct 18 11:43:04 user nova-compute[74190]: DEBUG nova.compute.manager [req-cb0fa434-7ef6-47f2-9b4f-28ee9e0294e8 req-4390dd6b-adfa-411c-aa7b-c222e2035af3 service nova] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Received event network-vif-plugged-8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:43:04 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-cb0fa434-7ef6-47f2-9b4f-28ee9e0294e8 req-4390dd6b-adfa-411c-aa7b-c222e2035af3 service nova] Acquiring lock "3c3cce66-9d7a-4f23-a92a-d10b3efd5e86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:43:04 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-cb0fa434-7ef6-47f2-9b4f-28ee9e0294e8 req-4390dd6b-adfa-411c-aa7b-c222e2035af3 service nova] Lock "3c3cce66-9d7a-4f23-a92a-d10b3efd5e86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:43:04 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-cb0fa434-7ef6-47f2-9b4f-28ee9e0294e8 req-4390dd6b-adfa-411c-aa7b-c222e2035af3 service nova] Lock "3c3cce66-9d7a-4f23-a92a-d10b3efd5e86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:43:04 user nova-compute[74190]: DEBUG nova.compute.manager [req-cb0fa434-7ef6-47f2-9b4f-28ee9e0294e8 req-4390dd6b-adfa-411c-aa7b-c222e2035af3 service nova] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] No waiting events found dispatching network-vif-plugged-8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:43:04 user nova-compute[74190]: WARNING nova.compute.manager [req-cb0fa434-7ef6-47f2-9b4f-28ee9e0294e8 req-4390dd6b-adfa-411c-aa7b-c222e2035af3 service nova] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Received unexpected event network-vif-plugged-8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9 for instance with vm_state active and task_state shelving_image_uploading.
Oct 18 11:43:06 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-55ff31a1-4e4d-4814-bb8a-b1391abf39b7 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Snapshot image upload complete
Oct 18 11:43:06 user nova-compute[74190]: DEBUG nova.compute.manager [None req-55ff31a1-4e4d-4814-bb8a-b1391abf39b7 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Checking state {{(pid=74190) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 11:43:06 user nova-compute[74190]: INFO nova.compute.manager [None req-55ff31a1-4e4d-4814-bb8a-b1391abf39b7 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Shelve offloading
Oct 18 11:43:06 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Instance destroyed successfully.
Oct 18 11:43:06 user nova-compute[74190]: DEBUG nova.compute.manager [None req-55ff31a1-4e4d-4814-bb8a-b1391abf39b7 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Checking state {{(pid=74190) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 11:43:06 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-55ff31a1-4e4d-4814-bb8a-b1391abf39b7 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Acquiring lock "refresh_cache-3c3cce66-9d7a-4f23-a92a-d10b3efd5e86" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:43:06 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-55ff31a1-4e4d-4814-bb8a-b1391abf39b7 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Acquired lock "refresh_cache-3c3cce66-9d7a-4f23-a92a-d10b3efd5e86" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:43:06 user nova-compute[74190]: DEBUG nova.network.neutron [None req-55ff31a1-4e4d-4814-bb8a-b1391abf39b7 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Building network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 11:43:07 user nova-compute[74190]: DEBUG nova.compute.manager [req-4f9b107f-cdf1-4f07-9afc-1af9ae9f7be8 req-a4b47f36-1324-4e05-a2b6-64d1a71fa0f3 service nova] [instance: c6130edd-eb98-491e-a0ba-6bd59199d9e1] Received event network-changed-bd84fceb-8a04-45a0-8f05-7bc856ed1a36 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:43:07 user nova-compute[74190]: DEBUG nova.compute.manager [req-4f9b107f-cdf1-4f07-9afc-1af9ae9f7be8 req-a4b47f36-1324-4e05-a2b6-64d1a71fa0f3 service nova] [instance: c6130edd-eb98-491e-a0ba-6bd59199d9e1] Refreshing instance network info cache due to event network-changed-bd84fceb-8a04-45a0-8f05-7bc856ed1a36. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 11:43:07 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-4f9b107f-cdf1-4f07-9afc-1af9ae9f7be8 req-a4b47f36-1324-4e05-a2b6-64d1a71fa0f3 service nova] Acquiring lock "refresh_cache-c6130edd-eb98-491e-a0ba-6bd59199d9e1" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:43:07 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-4f9b107f-cdf1-4f07-9afc-1af9ae9f7be8 req-a4b47f36-1324-4e05-a2b6-64d1a71fa0f3 service nova] Acquired lock "refresh_cache-c6130edd-eb98-491e-a0ba-6bd59199d9e1" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:43:07 user nova-compute[74190]: DEBUG nova.network.neutron [req-4f9b107f-cdf1-4f07-9afc-1af9ae9f7be8 req-a4b47f36-1324-4e05-a2b6-64d1a71fa0f3 service nova] [instance: c6130edd-eb98-491e-a0ba-6bd59199d9e1] Refreshing network info cache for port bd84fceb-8a04-45a0-8f05-7bc856ed1a36 {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 11:43:07 user nova-compute[74190]: DEBUG nova.network.neutron [None req-55ff31a1-4e4d-4814-bb8a-b1391abf39b7 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Updating instance_info_cache with network_info: [{"id": "8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9", "address": "fa:16:3e:93:46:f1", "network": {"id": "e6ae8edc-7014-4341-91b2-4c82d72c9bb9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-15434410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548640fa718f4fdfa21c1a7783519c9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d891e1d-9d", "ovs_interfaceid": "8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:43:07 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-55ff31a1-4e4d-4814-bb8a-b1391abf39b7 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Releasing lock "refresh_cache-3c3cce66-9d7a-4f23-a92a-d10b3efd5e86" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:43:07 user nova-compute[74190]: DEBUG nova.network.neutron [req-4f9b107f-cdf1-4f07-9afc-1af9ae9f7be8 req-a4b47f36-1324-4e05-a2b6-64d1a71fa0f3 service nova] [instance: c6130edd-eb98-491e-a0ba-6bd59199d9e1] Updated VIF entry in instance network info cache for port bd84fceb-8a04-45a0-8f05-7bc856ed1a36. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 11:43:07 user nova-compute[74190]: DEBUG nova.network.neutron [req-4f9b107f-cdf1-4f07-9afc-1af9ae9f7be8 req-a4b47f36-1324-4e05-a2b6-64d1a71fa0f3 service nova] [instance: c6130edd-eb98-491e-a0ba-6bd59199d9e1] Updating instance_info_cache with network_info: [{"id": "bd84fceb-8a04-45a0-8f05-7bc856ed1a36", "address": "fa:16:3e:ee:96:5d", "network": {"id": "c174814d-6217-4201-9af1-1575a8dcf751", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-981245321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d83064382624b4d895b0d7bff463f4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd84fceb-8a", "ovs_interfaceid": "bd84fceb-8a04-45a0-8f05-7bc856ed1a36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:43:07 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-4f9b107f-cdf1-4f07-9afc-1af9ae9f7be8 req-a4b47f36-1324-4e05-a2b6-64d1a71fa0f3 service nova] Releasing lock "refresh_cache-c6130edd-eb98-491e-a0ba-6bd59199d9e1" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:43:08 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:43:08 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Instance destroyed successfully.
Oct 18 11:43:08 user nova-compute[74190]: DEBUG nova.objects.instance [None req-55ff31a1-4e4d-4814-bb8a-b1391abf39b7 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Lazy-loading 'resources' on Instance uuid 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:43:08 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-55ff31a1-4e4d-4814-bb8a-b1391abf39b7 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:41:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-483118733',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-483118733',id=2,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC3fbJwjpJcODvmNEbH6DkfTuq/vNmpKXMAj6M+n75XoLrJlu4RmlMCvM6O8dl0GccAxqeju8gdcGNftn2/SOycIsQwxsxoRPc57gtaDIUNq6QqcMtgCrFnzcW3Mp4Vp6A==',key_name='tempest-keypair-576336985',keypairs=<?>,launch_index=0,launched_at=2023-10-18T11:41:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='548640fa718f4fdfa21c1a7783519c9f',ramdisk_id='',reservation_id='r-2fa6tit7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-83921126',owner_user_name='tempest-AttachVolumeShelveTestJSON-83921126-project-member',shelved_at='2023-10-18T11:43:06.799122',shelved_host='user',shelved_image_id='549de22b-33ca-4291-a665-7a3504b7d6a1'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T11:43:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='829b310c15b54dc7836d0b9d7fd757ed',uuid=3c3cce66-9d7a-4f23-a92a-d10b3efd5e86,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9", "address": "fa:16:3e:93:46:f1", "network": {"id": "e6ae8edc-7014-4341-91b2-4c82d72c9bb9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-15434410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548640fa718f4fdfa21c1a7783519c9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d891e1d-9d", "ovs_interfaceid": "8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 11:43:08 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-55ff31a1-4e4d-4814-bb8a-b1391abf39b7 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Converting VIF {"id": "8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9", "address": "fa:16:3e:93:46:f1", "network": {"id": "e6ae8edc-7014-4341-91b2-4c82d72c9bb9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-15434410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548640fa718f4fdfa21c1a7783519c9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d891e1d-9d", "ovs_interfaceid": "8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:43:08 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-55ff31a1-4e4d-4814-bb8a-b1391abf39b7 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:46:f1,bridge_name='br-int',has_traffic_filtering=True,id=8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9,network=Network(e6ae8edc-7014-4341-91b2-4c82d72c9bb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d891e1d-9d') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:43:08 user nova-compute[74190]: DEBUG os_vif [None req-55ff31a1-4e4d-4814-bb8a-b1391abf39b7 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:46:f1,bridge_name='br-int',has_traffic_filtering=True,id=8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9,network=Network(e6ae8edc-7014-4341-91b2-4c82d72c9bb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d891e1d-9d') {{(pid=74190) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 11:43:08 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:43:08 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8d891e1d-9d, bridge=br-int, if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:43:08 user nova-compute[74190]: DEBUG nova.compute.manager [req-9e92f0a2-ddcd-406e-bbc6-59deda667a88 req-f0c2bf49-91ac-4a52-a467-9c8ece8d0305 service nova] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Received event network-changed-8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:43:08 user nova-compute[74190]: DEBUG nova.compute.manager [req-9e92f0a2-ddcd-406e-bbc6-59deda667a88 req-f0c2bf49-91ac-4a52-a467-9c8ece8d0305 service nova] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Refreshing instance network info cache due to event network-changed-8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 11:43:08 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-9e92f0a2-ddcd-406e-bbc6-59deda667a88 req-f0c2bf49-91ac-4a52-a467-9c8ece8d0305 service nova] Acquiring lock "refresh_cache-3c3cce66-9d7a-4f23-a92a-d10b3efd5e86" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:43:08 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-9e92f0a2-ddcd-406e-bbc6-59deda667a88 req-f0c2bf49-91ac-4a52-a467-9c8ece8d0305 service nova] Acquired lock "refresh_cache-3c3cce66-9d7a-4f23-a92a-d10b3efd5e86" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:43:08 user nova-compute[74190]: DEBUG nova.network.neutron [req-9e92f0a2-ddcd-406e-bbc6-59deda667a88 req-f0c2bf49-91ac-4a52-a467-9c8ece8d0305 service nova] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Refreshing network info cache for port 8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9 {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 11:43:08 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:43:08 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:43:08 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:43:08 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d6f4c2b3-d125-4eb3-9fe4-e221881093c4) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:43:08 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:43:08 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:43:08 user nova-compute[74190]: INFO os_vif [None req-55ff31a1-4e4d-4814-bb8a-b1391abf39b7 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:46:f1,bridge_name='br-int',has_traffic_filtering=True,id=8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9,network=Network(e6ae8edc-7014-4341-91b2-4c82d72c9bb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d891e1d-9d')
Oct 18 11:43:08 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-55ff31a1-4e4d-4814-bb8a-b1391abf39b7 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Deleting instance files /opt/stack/data/nova/instances/3c3cce66-9d7a-4f23-a92a-d10b3efd5e86_del
Oct 18 11:43:08 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-55ff31a1-4e4d-4814-bb8a-b1391abf39b7 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Deletion of /opt/stack/data/nova/instances/3c3cce66-9d7a-4f23-a92a-d10b3efd5e86_del complete
Oct 18 11:43:08 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-55ff31a1-4e4d-4814-bb8a-b1391abf39b7 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Checking UEFI support for host arch (x86_64) {{(pid=74190) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Oct 18 11:43:08 user nova-compute[74190]: INFO nova.virt.libvirt.host [None req-55ff31a1-4e4d-4814-bb8a-b1391abf39b7 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] UEFI support detected
Oct 18 11:43:08 user nova-compute[74190]: INFO nova.scheduler.client.report [None req-55ff31a1-4e4d-4814-bb8a-b1391abf39b7 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Deleted allocations for instance 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86
Oct 18 11:43:08 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-55ff31a1-4e4d-4814-bb8a-b1391abf39b7 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:43:08 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-55ff31a1-4e4d-4814-bb8a-b1391abf39b7 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:43:08 user nova-compute[74190]: DEBUG nova.objects.instance [None req-55ff31a1-4e4d-4814-bb8a-b1391abf39b7 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Lazy-loading 'numa_topology' on Instance uuid 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:43:08 user nova-compute[74190]: DEBUG nova.objects.base [None req-55ff31a1-4e4d-4814-bb8a-b1391abf39b7 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Object Instance<3c3cce66-9d7a-4f23-a92a-d10b3efd5e86> lazy-loaded attributes: resources,numa_topology {{(pid=74190) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 11:43:08 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-55ff31a1-4e4d-4814-bb8a-b1391abf39b7 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 11:43:08 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-55ff31a1-4e4d-4814-bb8a-b1391abf39b7 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 11:43:08 user nova-compute[74190]: DEBUG nova.network.neutron [req-9e92f0a2-ddcd-406e-bbc6-59deda667a88 req-f0c2bf49-91ac-4a52-a467-9c8ece8d0305 service nova] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Updated VIF entry in instance network info cache for port 8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 11:43:08 user nova-compute[74190]: DEBUG nova.network.neutron [req-9e92f0a2-ddcd-406e-bbc6-59deda667a88 req-f0c2bf49-91ac-4a52-a467-9c8ece8d0305 service nova] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Updating instance_info_cache with network_info: [{"id": "8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9", "address": "fa:16:3e:93:46:f1", "network": {"id": "e6ae8edc-7014-4341-91b2-4c82d72c9bb9", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-15434410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548640fa718f4fdfa21c1a7783519c9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap8d891e1d-9d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:43:08 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-9e92f0a2-ddcd-406e-bbc6-59deda667a88 req-f0c2bf49-91ac-4a52-a467-9c8ece8d0305 service nova] Releasing lock "refresh_cache-3c3cce66-9d7a-4f23-a92a-d10b3efd5e86" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:43:08 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-55ff31a1-4e4d-4814-bb8a-b1391abf39b7 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.385s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:43:08 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-55ff31a1-4e4d-4814-bb8a-b1391abf39b7 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Lock "3c3cce66-9d7a-4f23-a92a-d10b3efd5e86" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.051s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:43:08 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:43:09 user nova-compute[74190]: DEBUG nova.compute.manager [req-abfbb45f-71b2-4c98-a347-2ee0ec4a85d2 req-2d71007b-5846-4a77-958c-8de3cfdff866 service nova] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] Received event network-changed-2f3b8cfe-f9f2-4dc5-b368-f67ef363266c {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:43:09 user nova-compute[74190]: DEBUG nova.compute.manager [req-abfbb45f-71b2-4c98-a347-2ee0ec4a85d2 req-2d71007b-5846-4a77-958c-8de3cfdff866 service nova] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] Refreshing instance network info cache due to event network-changed-2f3b8cfe-f9f2-4dc5-b368-f67ef363266c. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 11:43:09 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-abfbb45f-71b2-4c98-a347-2ee0ec4a85d2 req-2d71007b-5846-4a77-958c-8de3cfdff866 service nova] Acquiring lock "refresh_cache-6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:43:09 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-abfbb45f-71b2-4c98-a347-2ee0ec4a85d2 req-2d71007b-5846-4a77-958c-8de3cfdff866 service nova] Acquired lock "refresh_cache-6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:43:09 user nova-compute[74190]: DEBUG nova.network.neutron [req-abfbb45f-71b2-4c98-a347-2ee0ec4a85d2 req-2d71007b-5846-4a77-958c-8de3cfdff866 service nova] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] Refreshing network info cache for port 2f3b8cfe-f9f2-4dc5-b368-f67ef363266c {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 11:43:09 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-c716f76d-e7c1-4699-87d1-822e9bdea588 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Acquiring lock "interface-6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:43:09 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-c716f76d-e7c1-4699-87d1-822e9bdea588 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Lock "interface-6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:43:09 user nova-compute[74190]: DEBUG nova.objects.instance [None req-c716f76d-e7c1-4699-87d1-822e9bdea588 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Lazy-loading 'flavor' on Instance uuid 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:43:09 user nova-compute[74190]: DEBUG nova.objects.instance [None req-c716f76d-e7c1-4699-87d1-822e9bdea588 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Lazy-loading 'pci_requests' on Instance uuid 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:43:09 user nova-compute[74190]: DEBUG nova.objects.base [None req-c716f76d-e7c1-4699-87d1-822e9bdea588 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Object Instance<6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef> lazy-loaded attributes: flavor,pci_requests {{(pid=74190) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 11:43:09 user nova-compute[74190]: DEBUG nova.network.neutron [None req-c716f76d-e7c1-4699-87d1-822e9bdea588 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] allocate_for_instance() {{(pid=74190) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 11:43:09 user nova-compute[74190]: DEBUG nova.policy [None req-c716f76d-e7c1-4699-87d1-822e9bdea588 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a587bc7358fe4d289926428f94766374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72f55b03dea844739b3e36d4f73b23e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74190) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 11:43:09 user nova-compute[74190]: DEBUG nova.network.neutron [req-abfbb45f-71b2-4c98-a347-2ee0ec4a85d2 req-2d71007b-5846-4a77-958c-8de3cfdff866 service nova] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] Updated VIF entry in instance network info cache for port 2f3b8cfe-f9f2-4dc5-b368-f67ef363266c. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 11:43:09 user nova-compute[74190]: DEBUG nova.network.neutron [req-abfbb45f-71b2-4c98-a347-2ee0ec4a85d2 req-2d71007b-5846-4a77-958c-8de3cfdff866 service nova] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] Updating instance_info_cache with network_info: [{"id": "2f3b8cfe-f9f2-4dc5-b368-f67ef363266c", "address": "fa:16:3e:22:e2:3f", "network": {"id": "c9482f29-6e29-48c6-beb9-64721a29b3d9", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1092346276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72f55b03dea844739b3e36d4f73b23e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f3b8cfe-f9", "ovs_interfaceid": "2f3b8cfe-f9f2-4dc5-b368-f67ef363266c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:43:09 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-abfbb45f-71b2-4c98-a347-2ee0ec4a85d2 req-2d71007b-5846-4a77-958c-8de3cfdff866 service nova] Releasing lock "refresh_cache-6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:43:10 user nova-compute[74190]: DEBUG nova.network.neutron [None req-c716f76d-e7c1-4699-87d1-822e9bdea588 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] Successfully created port: b5f712f6-6733-4725-b563-2218a4a58813 {{(pid=74190) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 11:43:11 user nova-compute[74190]: DEBUG nova.network.neutron [None req-c716f76d-e7c1-4699-87d1-822e9bdea588 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] Successfully updated port: b5f712f6-6733-4725-b563-2218a4a58813 {{(pid=74190) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 11:43:11 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-c716f76d-e7c1-4699-87d1-822e9bdea588 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Acquiring lock "refresh_cache-6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:43:11 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-c716f76d-e7c1-4699-87d1-822e9bdea588 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Acquired lock "refresh_cache-6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:43:11 user nova-compute[74190]: DEBUG nova.network.neutron [None req-c716f76d-e7c1-4699-87d1-822e9bdea588 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] Building network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 11:43:11 user nova-compute[74190]: DEBUG nova.compute.manager [req-3dbb4bfc-94d2-4aa7-83b2-9fc3f69e1398 req-7358d641-23c2-42f0-93b7-49d1b69c4fdd service nova] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] Received event network-changed-b5f712f6-6733-4725-b563-2218a4a58813 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:43:11 user nova-compute[74190]: DEBUG nova.compute.manager [req-3dbb4bfc-94d2-4aa7-83b2-9fc3f69e1398 req-7358d641-23c2-42f0-93b7-49d1b69c4fdd service nova] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] Refreshing instance network info cache due to event network-changed-b5f712f6-6733-4725-b563-2218a4a58813. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 11:43:11 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-3dbb4bfc-94d2-4aa7-83b2-9fc3f69e1398 req-7358d641-23c2-42f0-93b7-49d1b69c4fdd service nova] Acquiring lock "refresh_cache-6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:43:11 user nova-compute[74190]: DEBUG nova.network.neutron [None req-c716f76d-e7c1-4699-87d1-822e9bdea588 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] Updating instance_info_cache with network_info: [{"id": "2f3b8cfe-f9f2-4dc5-b368-f67ef363266c", "address": "fa:16:3e:22:e2:3f", "network": {"id": "c9482f29-6e29-48c6-beb9-64721a29b3d9", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1092346276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72f55b03dea844739b3e36d4f73b23e0", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f3b8cfe-f9", "ovs_interfaceid": "2f3b8cfe-f9f2-4dc5-b368-f67ef363266c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b5f712f6-6733-4725-b563-2218a4a58813", "address": "fa:16:3e:ab:58:86", "network": {"id": "a814b9ab-3007-49af-aa0f-13a6d655952a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1870963685", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "72f55b03dea844739b3e36d4f73b23e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f712f6-67", "ovs_interfaceid": "b5f712f6-6733-4725-b563-2218a4a58813", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:43:11 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-c716f76d-e7c1-4699-87d1-822e9bdea588 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Releasing lock "refresh_cache-6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:43:11 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-3dbb4bfc-94d2-4aa7-83b2-9fc3f69e1398 req-7358d641-23c2-42f0-93b7-49d1b69c4fdd service nova] Acquired lock "refresh_cache-6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:43:11 user nova-compute[74190]: DEBUG nova.network.neutron [req-3dbb4bfc-94d2-4aa7-83b2-9fc3f69e1398 req-7358d641-23c2-42f0-93b7-49d1b69c4fdd service nova] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] Refreshing network info cache for port b5f712f6-6733-4725-b563-2218a4a58813 {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 11:43:11 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-c716f76d-e7c1-4699-87d1-822e9bdea588 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T11:41:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-239478616',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-239478616',id=5,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDiL4Y3YjaIYG9f48clgmLYvNf1xzm1drxLs+YLjigprz2IgSEssC/H3MORsYOE3v5yg6mGeg/8ep19TIA+gnsVGZGVVookzYwja4uGKlJS/z4feKfCDiLYrj74IwuE8uQ==',key_name='tempest-keypair-654404793',keypairs=<?>,launch_index=0,launched_at=2023-10-18T11:41:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='72f55b03dea844739b3e36d4f73b23e0',ramdisk_id='',reservation_id='r-iliez3d9',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1663776612',owner_user_name='tempest-TaggedAttachmentsTest-1663776612-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T11:41:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a587bc7358fe4d289926428f94766374',uuid=6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b5f712f6-6733-4725-b563-2218a4a58813", "address": "fa:16:3e:ab:58:86", "network": {"id": "a814b9ab-3007-49af-aa0f-13a6d655952a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1870963685", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "72f55b03dea844739b3e36d4f73b23e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f712f6-67", "ovs_interfaceid": "b5f712f6-6733-4725-b563-2218a4a58813", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 11:43:11 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-c716f76d-e7c1-4699-87d1-822e9bdea588 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Converting VIF {"id": "b5f712f6-6733-4725-b563-2218a4a58813", "address": "fa:16:3e:ab:58:86", "network": {"id": "a814b9ab-3007-49af-aa0f-13a6d655952a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1870963685", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "72f55b03dea844739b3e36d4f73b23e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f712f6-67", "ovs_interfaceid": "b5f712f6-6733-4725-b563-2218a4a58813", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:43:11 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-c716f76d-e7c1-4699-87d1-822e9bdea588 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:58:86,bridge_name='br-int',has_traffic_filtering=True,id=b5f712f6-6733-4725-b563-2218a4a58813,network=Network(a814b9ab-3007-49af-aa0f-13a6d655952a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5f712f6-67') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:43:11 user nova-compute[74190]: DEBUG os_vif [None req-c716f76d-e7c1-4699-87d1-822e9bdea588 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:58:86,bridge_name='br-int',has_traffic_filtering=True,id=b5f712f6-6733-4725-b563-2218a4a58813,network=Network(a814b9ab-3007-49af-aa0f-13a6d655952a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5f712f6-67') {{(pid=74190) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 11:43:11 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:43:11 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:43:11 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 11:43:11 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:43:11 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '43180364-c7d2-597f-bca8-1c651c89af42', '_type': 'linux-noop'}}, row=False) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:43:11 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:43:11 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:43:11 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:43:11 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb5f712f6-67, may_exist=True, interface_attrs={}) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:43:11 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb5f712f6-67, col_values=(('qos', UUID('a57ebc37-b8da-4051-af2f-977823a191f1')),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:43:11 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb5f712f6-67, col_values=(('external_ids', {'iface-id': 'b5f712f6-6733-4725-b563-2218a4a58813', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ab:58:86', 'vm-uuid': '6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef'}),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:43:11 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:43:11 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:43:11 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:43:11 user nova-compute[74190]: INFO os_vif [None req-c716f76d-e7c1-4699-87d1-822e9bdea588 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:58:86,bridge_name='br-int',has_traffic_filtering=True,id=b5f712f6-6733-4725-b563-2218a4a58813,network=Network(a814b9ab-3007-49af-aa0f-13a6d655952a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5f712f6-67')
Oct 18 11:43:11 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-c716f76d-e7c1-4699-87d1-822e9bdea588 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T11:41:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-239478616',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-239478616',id=5,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDiL4Y3YjaIYG9f48clgmLYvNf1xzm1drxLs+YLjigprz2IgSEssC/H3MORsYOE3v5yg6mGeg/8ep19TIA+gnsVGZGVVookzYwja4uGKlJS/z4feKfCDiLYrj74IwuE8uQ==',key_name='tempest-keypair-654404793',keypairs=<?>,launch_index=0,launched_at=2023-10-18T11:41:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='72f55b03dea844739b3e36d4f73b23e0',ramdisk_id='',reservation_id='r-iliez3d9',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1663776612',owner_user_name='tempest-TaggedAttachmentsTest-1663776612-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T11:41:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a587bc7358fe4d289926428f94766374',uuid=6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b5f712f6-6733-4725-b563-2218a4a58813", "address": "fa:16:3e:ab:58:86", "network": {"id": "a814b9ab-3007-49af-aa0f-13a6d655952a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1870963685", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "72f55b03dea844739b3e36d4f73b23e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f712f6-67", "ovs_interfaceid": "b5f712f6-6733-4725-b563-2218a4a58813", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74190) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 11:43:11 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-c716f76d-e7c1-4699-87d1-822e9bdea588 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Converting VIF {"id": "b5f712f6-6733-4725-b563-2218a4a58813", "address": "fa:16:3e:ab:58:86", "network": {"id": "a814b9ab-3007-49af-aa0f-13a6d655952a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1870963685", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "72f55b03dea844739b3e36d4f73b23e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f712f6-67", "ovs_interfaceid": "b5f712f6-6733-4725-b563-2218a4a58813", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:43:11 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-c716f76d-e7c1-4699-87d1-822e9bdea588 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:58:86,bridge_name='br-int',has_traffic_filtering=True,id=b5f712f6-6733-4725-b563-2218a4a58813,network=Network(a814b9ab-3007-49af-aa0f-13a6d655952a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5f712f6-67') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:43:11 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-c716f76d-e7c1-4699-87d1-822e9bdea588 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] attach device xml: <interface type="ethernet">
Oct 18 11:43:11 user nova-compute[74190]:   <mac address="fa:16:3e:ab:58:86"/>
Oct 18 11:43:11 user nova-compute[74190]:   <model type="virtio"/>
Oct 18 11:43:11 user nova-compute[74190]:   <mtu size="1442"/>
Oct 18 11:43:11 user nova-compute[74190]:   <target dev="tapb5f712f6-67"/>
Oct 18 11:43:11 user nova-compute[74190]: </interface>
Oct 18 11:43:11 user nova-compute[74190]:  {{(pid=74190) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 18 11:43:11 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:43:12 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:43:12 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:43:12 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-c716f76d-e7c1-4699-87d1-822e9bdea588 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] No BDM found with device name vda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 11:43:12 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-c716f76d-e7c1-4699-87d1-822e9bdea588 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] No BDM found with device name hda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 11:43:12 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-c716f76d-e7c1-4699-87d1-822e9bdea588 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] No VIF found with MAC fa:16:3e:22:e2:3f, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 11:43:12 user nova-compute[74190]: DEBUG nova.compute.manager [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Start spawning the instance on the hypervisor. {{(pid=74190) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 11:43:12 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Creating instance directory {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 11:43:12 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Creating image(s)
Oct 18 11:43:12 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Did not create local disks {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 18 11:43:12 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Ensure instance console log exists: /opt/stack/data/nova/instances/3bd2f6d6-9c07-42a0-869e-566d685cb025/console.log {{(pid=74190) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 11:43:12 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:43:12 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:43:12 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:43:12 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Start _get_guest_xml network_info=[{"id": "9eca4d9a-28f0-4818-beef-e65c22f351dd", "address": "fa:16:3e:f6:77:76", "network": {"id": "0c5cbb41-ba77-494a-904b-4c37e3205eb9", "bridge": "br-int", "label": "tempest-TestShelveInstance-1626181921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d3e15d2b7944cba9ed86eb5c01ec98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9eca4d9a-28", "ovs_interfaceid": "9eca4d9a-28f0-4818-beef-e65c22f351dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bnWydGUY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3bd2f6d6-9c07-42a0-869e-566d685cb025', 'attached_at': '', 'detached_at': '', 'volume_id': '2d829820-7b5f-42f9-81ab-8efc923f288a', 'serial': '2d829820-7b5f-42f9-81ab-8efc923f288a'}, 'delete_on_termination': True, 'guest_format': None, 'attachment_id': '91ac3c25-0db6-47d0-aa90-c95df77e45ca', 'volume_type': None} {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 11:43:12 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-c716f76d-e7c1-4699-87d1-822e9bdea588 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 11:43:12 user nova-compute[74190]:   <nova:package version="0.0.0"/>
Oct 18 11:43:12 user nova-compute[74190]:   <nova:name>tempest-device-tagging-server-239478616</nova:name>
Oct 18 11:43:12 user nova-compute[74190]:   <nova:creationTime>2023-10-18 11:43:12</nova:creationTime>
Oct 18 11:43:12 user nova-compute[74190]:   <nova:flavor name="m1.tiny">
Oct 18 11:43:12 user nova-compute[74190]:     <nova:memory>512</nova:memory>
Oct 18 11:43:12 user nova-compute[74190]:     <nova:disk>1</nova:disk>
Oct 18 11:43:12 user nova-compute[74190]:     <nova:swap>0</nova:swap>
Oct 18 11:43:12 user nova-compute[74190]:     <nova:ephemeral>0</nova:ephemeral>
Oct 18 11:43:12 user nova-compute[74190]:     <nova:vcpus>1</nova:vcpus>
Oct 18 11:43:12 user nova-compute[74190]:   </nova:flavor>
Oct 18 11:43:12 user nova-compute[74190]:   <nova:owner>
Oct 18 11:43:12 user nova-compute[74190]:     <nova:user uuid="a587bc7358fe4d289926428f94766374">tempest-TaggedAttachmentsTest-1663776612-project-member</nova:user>
Oct 18 11:43:12 user nova-compute[74190]:     <nova:project uuid="72f55b03dea844739b3e36d4f73b23e0">tempest-TaggedAttachmentsTest-1663776612</nova:project>
Oct 18 11:43:12 user nova-compute[74190]:   </nova:owner>
Oct 18 11:43:12 user nova-compute[74190]:   <nova:root type="image" uuid="6e88bbf0-6e78-49a8-b3c5-9453d22a89df"/>
Oct 18 11:43:12 user nova-compute[74190]:   <nova:ports>
Oct 18 11:43:12 user nova-compute[74190]:     <nova:port uuid="2f3b8cfe-f9f2-4dc5-b368-f67ef363266c">
Oct 18 11:43:12 user nova-compute[74190]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 18 11:43:12 user nova-compute[74190]:     </nova:port>
Oct 18 11:43:12 user nova-compute[74190]:     <nova:port uuid="b5f712f6-6733-4725-b563-2218a4a58813">
Oct 18 11:43:12 user nova-compute[74190]:       <nova:ip type="fixed" address="10.10.10.149" ipVersion="4"/>
Oct 18 11:43:12 user nova-compute[74190]:     </nova:port>
Oct 18 11:43:12 user nova-compute[74190]:   </nova:ports>
Oct 18 11:43:12 user nova-compute[74190]: </nova:instance>
Oct 18 11:43:12 user nova-compute[74190]:  {{(pid=74190) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 18 11:43:12 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:43:12 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:43:12 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 11:43:12 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] CPU controller missing on host. {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 11:43:12 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 11:43:12 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] CPU controller found on host. {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 11:43:12 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74190) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 11:43:12 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T11:37:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 11:43:12 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Flavor limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 11:43:12 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Image limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 11:43:12 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Flavor pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 11:43:12 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Image pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 11:43:12 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 11:43:12 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 11:43:12 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 11:43:12 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Got 1 possible topologies {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 11:43:12 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 11:43:12 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 11:43:12 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Calling os-brick to attach iSCSI Volume {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 11:43:12 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bnWydGUY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:43:12 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:43:12 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:43:12 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:43:12 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:43:12 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:43:12 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:43:12 user nova-compute[74190]: INFO os_brick.initiator.connectors.iscsi [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 11:43:12 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-c716f76d-e7c1-4699-87d1-822e9bdea588 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Lock "interface-6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.478s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:43:12 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a -p 172.16.0.220:3260 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:12 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:12 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc2c91c7-69ac-4d03-b501-ed4fe6401c71]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:12 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 11:43:12 user nova-compute[74190]:  {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:43:12 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a -p 172.16.0.220:3260 --interface default --op new {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:12 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:12 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e18509f-d8b2-462b-a12d-fd90fba0c4f9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a] added\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:12 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a] added
Oct 18 11:43:12 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:43:12 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:12 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:12 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[de6ab592-443b-4739-8674-c8480fbc190b]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:12 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:43:12 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:12 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:12 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c272a96-2d28-4432-a26e-8894a8fc1130]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:12 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:43:12 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bnWydGUY {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:12 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:43:12 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bnWydGUY" returned: 0 in 0.028s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:12 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:43:12 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9e877d7-3465-4a68-bf92-c339dea64065]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:12 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bnWydGUY'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:43:12 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:12 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:43:12 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:12 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[d36c30e3-3728-4480-ab2a-1dccaf6c0eb9]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:12 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:43:12 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:12 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:43:12 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:43:12 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:12 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[457044a7-005c-45ab-9c6f-771ff32f4268]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:12 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)
Oct 18 11:43:12 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:43:12 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)
Oct 18 11:43:12 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:43:12 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a -p 172.16.0.220:3260 --login {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:12 user nova-compute[74190]: DEBUG nova.network.neutron [req-3dbb4bfc-94d2-4aa7-83b2-9fc3f69e1398 req-7358d641-23c2-42f0-93b7-49d1b69c4fdd service nova] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] Updated VIF entry in instance network info cache for port b5f712f6-6733-4725-b563-2218a4a58813. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 11:43:12 user nova-compute[74190]: DEBUG nova.network.neutron [req-3dbb4bfc-94d2-4aa7-83b2-9fc3f69e1398 req-7358d641-23c2-42f0-93b7-49d1b69c4fdd service nova] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] Updating instance_info_cache with network_info: [{"id": "2f3b8cfe-f9f2-4dc5-b368-f67ef363266c", "address": "fa:16:3e:22:e2:3f", "network": {"id": "c9482f29-6e29-48c6-beb9-64721a29b3d9", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1092346276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72f55b03dea844739b3e36d4f73b23e0", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f3b8cfe-f9", "ovs_interfaceid": "2f3b8cfe-f9f2-4dc5-b368-f67ef363266c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b5f712f6-6733-4725-b563-2218a4a58813", "address": "fa:16:3e:ab:58:86", "network": {"id": "a814b9ab-3007-49af-aa0f-13a6d655952a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1870963685", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "72f55b03dea844739b3e36d4f73b23e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f712f6-67", "ovs_interfaceid": "b5f712f6-6733-4725-b563-2218a4a58813", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:43:12 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:12 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ff3c3d-663a-492d-89da-c2cc2dce7d95]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:12 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a, portal: 172.16.0.220,3260]
Oct 18 11:43:12 user nova-compute[74190]: Login to [iface: default, target: iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a, portal: 172.16.0.220,3260] successful.
Oct 18 11:43:12 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:43:12 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-3dbb4bfc-94d2-4aa7-83b2-9fc3f69e1398 req-7358d641-23c2-42f0-93b7-49d1b69c4fdd service nova] Releasing lock "refresh_cache-6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:43:12 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:12 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:12 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[93764470-b379-40eb-ae54-ef2e509efa52]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:12 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:43:13 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:13 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:13 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1a63c4b-7d2d-4cd2-aba8-345dd7ecfaa4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:13 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)
Oct 18 11:43:13 user nova-compute[74190]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)
Oct 18 11:43:13 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:43:13 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)
Oct 18 11:43:13 user nova-compute[74190]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)
Oct 18 11:43:13 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:43:13 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.370s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:43:13 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Connected to 172.16.0.220:3260 {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 11:43:13 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=74190) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 11:43:13 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74190) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 11:43:13 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:13 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.024s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:13 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[b456aff0-fcc6-42ca-beaa-e061c0504514]: (4, ('- - 0', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:13 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74190) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 11:43:13 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bnWydGUY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 11:43:13 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-3896622c-a938-4973-b7c9-4b0d24ee4c3c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Acquiring lock "c6130edd-eb98-491e-a0ba-6bd59199d9e1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:43:13 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-3896622c-a938-4973-b7c9-4b0d24ee4c3c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Lock "c6130edd-eb98-491e-a0ba-6bd59199d9e1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:43:13 user nova-compute[74190]: DEBUG nova.objects.instance [None req-3896622c-a938-4973-b7c9-4b0d24ee4c3c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Lazy-loading 'flavor' on Instance uuid c6130edd-eb98-491e-a0ba-6bd59199d9e1 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:43:13 user nova-compute[74190]: DEBUG nova.compute.manager [req-def71d65-72ce-439b-a502-7bab0125c175 req-5866d162-b30a-4f67-be5b-8806eec90a9e service nova] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] Received event network-vif-plugged-b5f712f6-6733-4725-b563-2218a4a58813 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:43:13 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-def71d65-72ce-439b-a502-7bab0125c175 req-5866d162-b30a-4f67-be5b-8806eec90a9e service nova] Acquiring lock "6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:43:13 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-def71d65-72ce-439b-a502-7bab0125c175 req-5866d162-b30a-4f67-be5b-8806eec90a9e service nova] Lock "6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:43:13 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-def71d65-72ce-439b-a502-7bab0125c175 req-5866d162-b30a-4f67-be5b-8806eec90a9e service nova] Lock "6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:43:13 user nova-compute[74190]: DEBUG nova.compute.manager [req-def71d65-72ce-439b-a502-7bab0125c175 req-5866d162-b30a-4f67-be5b-8806eec90a9e service nova] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] No waiting events found dispatching network-vif-plugged-b5f712f6-6733-4725-b563-2218a4a58813 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:43:13 user nova-compute[74190]: WARNING nova.compute.manager [req-def71d65-72ce-439b-a502-7bab0125c175 req-5866d162-b30a-4f67-be5b-8806eec90a9e service nova] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] Received unexpected event network-vif-plugged-b5f712f6-6733-4725-b563-2218a4a58813 for instance with vm_state active and task_state None.
Oct 18 11:43:13 user nova-compute[74190]: DEBUG nova.compute.manager [req-def71d65-72ce-439b-a502-7bab0125c175 req-5866d162-b30a-4f67-be5b-8806eec90a9e service nova] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] Received event network-vif-plugged-b5f712f6-6733-4725-b563-2218a4a58813 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:43:13 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-def71d65-72ce-439b-a502-7bab0125c175 req-5866d162-b30a-4f67-be5b-8806eec90a9e service nova] Acquiring lock "6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:43:13 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-def71d65-72ce-439b-a502-7bab0125c175 req-5866d162-b30a-4f67-be5b-8806eec90a9e service nova] Lock "6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:43:13 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-def71d65-72ce-439b-a502-7bab0125c175 req-5866d162-b30a-4f67-be5b-8806eec90a9e service nova] Lock "6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:43:13 user nova-compute[74190]: DEBUG nova.compute.manager [req-def71d65-72ce-439b-a502-7bab0125c175 req-5866d162-b30a-4f67-be5b-8806eec90a9e service nova] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] No waiting events found dispatching network-vif-plugged-b5f712f6-6733-4725-b563-2218a4a58813 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:43:13 user nova-compute[74190]: WARNING nova.compute.manager [req-def71d65-72ce-439b-a502-7bab0125c175 req-5866d162-b30a-4f67-be5b-8806eec90a9e service nova] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] Received unexpected event network-vif-plugged-b5f712f6-6733-4725-b563-2218a4a58813 for instance with vm_state active and task_state None.
Oct 18 11:43:13 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-f5210f97-2b7b-437c-843d-648847baaf22 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Acquiring lock "6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:43:13 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-f5210f97-2b7b-437c-843d-648847baaf22 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Lock "6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:43:13 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-3896622c-a938-4973-b7c9-4b0d24ee4c3c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Lock "c6130edd-eb98-491e-a0ba-6bd59199d9e1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.141s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:43:13 user nova-compute[74190]: DEBUG nova.objects.instance [None req-f5210f97-2b7b-437c-843d-648847baaf22 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Lazy-loading 'flavor' on Instance uuid 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:43:13 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-f5210f97-2b7b-437c-843d-648847baaf22 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Lock "6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.078s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:43:13 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-3896622c-a938-4973-b7c9-4b0d24ee4c3c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Acquiring lock "c6130edd-eb98-491e-a0ba-6bd59199d9e1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:43:13 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-3896622c-a938-4973-b7c9-4b0d24ee4c3c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Lock "c6130edd-eb98-491e-a0ba-6bd59199d9e1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:43:13 user nova-compute[74190]: INFO nova.compute.manager [None req-3896622c-a938-4973-b7c9-4b0d24ee4c3c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] [instance: c6130edd-eb98-491e-a0ba-6bd59199d9e1] Attaching volume 99028d44-32f8-4fc1-97fe-595cdcc4f0b5 to /dev/vdb
Oct 18 11:43:13 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-f5210f97-2b7b-437c-843d-648847baaf22 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Acquiring lock "6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:43:13 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-f5210f97-2b7b-437c-843d-648847baaf22 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Lock "6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:43:13 user nova-compute[74190]: INFO nova.compute.manager [None req-f5210f97-2b7b-437c-843d-648847baaf22 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] Attaching volume 6243f09d-1778-4f76-beae-8baceac3112f to /dev/vdb
Oct 18 11:43:13 user nova-compute[74190]: DEBUG os_brick.utils [None req-3896622c-a938-4973-b7c9-4b0d24ee4c3c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:43:13 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:13 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:13 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da99825-77f9-4a79-b8a9-4cc573d50b78]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cff158e257e1\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:13 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:13 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:13 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[58edc532-40fa-414b-ab83-9f03c870c268]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:13 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:13 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:13 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d17dcb3-734f-45e2-95cc-d2022a5114f0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:13 user nova-compute[74190]: DEBUG os_brick.utils [None req-f5210f97-2b7b-437c-843d-648847baaf22 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:43:13 user nova-compute[74190]: DEBUG nova.compute.manager [req-ea8e7815-ddd7-4c71-8508-30ead48c7313 req-da853216-90e8-44d2-bad8-d1a021eb01e6 service nova] [instance: d56b243d-fbf2-4ae6-8399-80df46b33b82] Received event network-changed-a4d61a40-a5fd-4bca-899e-5569a7bc1e1b {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:43:13 user nova-compute[74190]: DEBUG nova.compute.manager [req-ea8e7815-ddd7-4c71-8508-30ead48c7313 req-da853216-90e8-44d2-bad8-d1a021eb01e6 service nova] [instance: d56b243d-fbf2-4ae6-8399-80df46b33b82] Refreshing instance network info cache due to event network-changed-a4d61a40-a5fd-4bca-899e-5569a7bc1e1b. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 11:43:13 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-ea8e7815-ddd7-4c71-8508-30ead48c7313 req-da853216-90e8-44d2-bad8-d1a021eb01e6 service nova] Acquiring lock "refresh_cache-d56b243d-fbf2-4ae6-8399-80df46b33b82" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:43:13 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-ea8e7815-ddd7-4c71-8508-30ead48c7313 req-da853216-90e8-44d2-bad8-d1a021eb01e6 service nova] Acquired lock "refresh_cache-d56b243d-fbf2-4ae6-8399-80df46b33b82" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:43:13 user nova-compute[74190]: DEBUG nova.network.neutron [req-ea8e7815-ddd7-4c71-8508-30ead48c7313 req-da853216-90e8-44d2-bad8-d1a021eb01e6 service nova] [instance: d56b243d-fbf2-4ae6-8399-80df46b33b82] Refreshing network info cache for port a4d61a40-a5fd-4bca-899e-5569a7bc1e1b {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 11:43:13 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:13 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[741a9ae7-e0da-4383-96de-3361c068fd6a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:13 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-3896622c-a938-4973-b7c9-4b0d24ee4c3c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Running cmd (subprocess): nvme version {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:13 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-3896622c-a938-4973-b7c9-4b0d24ee4c3c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] 'nvme version' failed. Not Retrying. {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 11:43:13 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:13 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb07af6-14ef-449b-b3ca-32e6f5c0bc62]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cff158e257e1\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:13 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3896622c-a938-4973-b7c9-4b0d24ee4c3c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] nvme not present on system {{(pid=74190) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 11:43:13 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:43:13 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:13 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:13 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 11:43:13 user nova-compute[74190]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 11:43:13 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[04354af5-551a-40b7-b7f5-603b222d9861]: (4, '') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:13 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-3896622c-a938-4973-b7c9-4b0d24ee4c3c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74190) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 11:43:13 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-3896622c-a938-4973-b7c9-4b0d24ee4c3c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 11:43:13 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-3896622c-a938-4973-b7c9-4b0d24ee4c3c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] LIGHTOS: no hostnqn found. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 11:43:13 user nova-compute[74190]: DEBUG os_brick.utils [None req-3896622c-a938-4973-b7c9-4b0d24ee4c3c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] <== get_connector_properties: return (253ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cff158e257e1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:43:13 user nova-compute[74190]: DEBUG nova.virt.block_device [None req-3896622c-a938-4973-b7c9-4b0d24ee4c3c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] [instance: c6130edd-eb98-491e-a0ba-6bd59199d9e1] Updating existing volume attachment record: 7aebc35a-1646-4c49-95b5-5318e87183fd {{(pid=74190) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 11:43:14 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.048s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:14 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[cabf8f2c-ac1c-4c3c-8fde-acd346a17693]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:14 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:14 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:14 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[d83593a8-625e-4f2d-abba-e0865cd783e5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:14 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f8148f-5c69-4484-a34b-00c296e2eac5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:14 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-f5210f97-2b7b-437c-843d-648847baaf22 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Running cmd (subprocess): nvme version {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:14 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-f5210f97-2b7b-437c-843d-648847baaf22 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] 'nvme version' failed. Not Retrying. {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 11:43:14 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.423s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:43:14 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] <== connect_volume: return (1425ms) {'type': 'block', 'scsi_wwn': '23537653530323334', 'path': '/dev/sdc'} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:43:14 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23537653530323334', 'path': '/dev/sdc'} {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 11:43:14 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f5210f97-2b7b-437c-843d-648847baaf22 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] nvme not present on system {{(pid=74190) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 11:43:14 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:14 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 11:43:14 user nova-compute[74190]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 11:43:14 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a614501-917c-42e4-a95f-0a0ef4671b83]: (4, '') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:14 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-f5210f97-2b7b-437c-843d-648847baaf22 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74190) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 11:43:14 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-f5210f97-2b7b-437c-843d-648847baaf22 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 11:43:14 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-f5210f97-2b7b-437c-843d-648847baaf22 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] LIGHTOS: no hostnqn found. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 11:43:14 user nova-compute[74190]: DEBUG os_brick.utils [None req-f5210f97-2b7b-437c-843d-648847baaf22 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] <== get_connector_properties: return (296ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cff158e257e1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:43:14 user nova-compute[74190]: DEBUG nova.virt.block_device [None req-f5210f97-2b7b-437c-843d-648847baaf22 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] Updating existing volume attachment record: 4b7e5024-4868-47ef-9a0c-b2bb18574413 {{(pid=74190) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 11:43:14 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:42:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-750462458',display_name='tempest-TestShelveInstance-server-750462458',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-750462458',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNt8SmvdArTyzkvCUI1kam2NbMC+rHv9iOWZki8JEEHP7fMgDgi8kkk7jXIMVKa+sVcv9nkOeL15Uby8ToS2uWym1iteM771YGpKWzDAM0HogCtKby6MGktNG2smezvdMg==',key_name='tempest-TestShelveInstance-1292603838',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d3e15d2b7944cba9ed86eb5c01ec98a',ramdisk_id='',reservation_id='r-n4ye783u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1202197307',owner_user_name='tempest-TestShelveInstance-1202197307-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:42:52Z,user_data=None,user_id='06661e802ad947d2a4e07e3d60a94d14',uuid=3bd2f6d6-9c07-42a0-869e-566d685cb025,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9eca4d9a-28f0-4818-beef-e65c22f351dd", "address": "fa:16:3e:f6:77:76", "network": {"id": "0c5cbb41-ba77-494a-904b-4c37e3205eb9", "bridge": "br-int", "label": "tempest-TestShelveInstance-1626181921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d3e15d2b7944cba9ed86eb5c01ec98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9eca4d9a-28", "ovs_interfaceid": "9eca4d9a-28f0-4818-beef-e65c22f351dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74190) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 11:43:14 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Converting VIF {"id": "9eca4d9a-28f0-4818-beef-e65c22f351dd", "address": "fa:16:3e:f6:77:76", "network": {"id": "0c5cbb41-ba77-494a-904b-4c37e3205eb9", "bridge": "br-int", "label": "tempest-TestShelveInstance-1626181921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d3e15d2b7944cba9ed86eb5c01ec98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9eca4d9a-28", "ovs_interfaceid": "9eca4d9a-28f0-4818-beef-e65c22f351dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:43:14 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:77:76,bridge_name='br-int',has_traffic_filtering=True,id=9eca4d9a-28f0-4818-beef-e65c22f351dd,network=Network(0c5cbb41-ba77-494a-904b-4c37e3205eb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9eca4d9a-28') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:43:14 user nova-compute[74190]: DEBUG nova.objects.instance [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Lazy-loading 'pci_devices' on Instance uuid 3bd2f6d6-9c07-42a0-869e-566d685cb025 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:43:14 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] End _get_guest_xml xml=<domain type="kvm">
Oct 18 11:43:14 user nova-compute[74190]:   <uuid>3bd2f6d6-9c07-42a0-869e-566d685cb025</uuid>
Oct 18 11:43:14 user nova-compute[74190]:   <name>instance-0000000a</name>
Oct 18 11:43:14 user nova-compute[74190]:   <memory>524288</memory>
Oct 18 11:43:14 user nova-compute[74190]:   <vcpu>1</vcpu>
Oct 18 11:43:14 user nova-compute[74190]:   <metadata>
Oct 18 11:43:14 user nova-compute[74190]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 11:43:14 user nova-compute[74190]:       <nova:package version="0.0.0"/>
Oct 18 11:43:14 user nova-compute[74190]:       <nova:name>tempest-TestShelveInstance-server-750462458</nova:name>
Oct 18 11:43:14 user nova-compute[74190]:       <nova:creationTime>2023-10-18 11:43:12</nova:creationTime>
Oct 18 11:43:14 user nova-compute[74190]:       <nova:flavor name="m1.tiny">
Oct 18 11:43:14 user nova-compute[74190]:         <nova:memory>512</nova:memory>
Oct 18 11:43:14 user nova-compute[74190]:         <nova:disk>1</nova:disk>
Oct 18 11:43:14 user nova-compute[74190]:         <nova:swap>0</nova:swap>
Oct 18 11:43:14 user nova-compute[74190]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 11:43:14 user nova-compute[74190]:         <nova:vcpus>1</nova:vcpus>
Oct 18 11:43:14 user nova-compute[74190]:       </nova:flavor>
Oct 18 11:43:14 user nova-compute[74190]:       <nova:owner>
Oct 18 11:43:14 user nova-compute[74190]:         <nova:user uuid="06661e802ad947d2a4e07e3d60a94d14">tempest-TestShelveInstance-1202197307-project-member</nova:user>
Oct 18 11:43:14 user nova-compute[74190]:         <nova:project uuid="1d3e15d2b7944cba9ed86eb5c01ec98a">tempest-TestShelveInstance-1202197307</nova:project>
Oct 18 11:43:14 user nova-compute[74190]:       </nova:owner>
Oct 18 11:43:14 user nova-compute[74190]:       <nova:ports>
Oct 18 11:43:14 user nova-compute[74190]:         <nova:port uuid="9eca4d9a-28f0-4818-beef-e65c22f351dd">
Oct 18 11:43:14 user nova-compute[74190]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 18 11:43:14 user nova-compute[74190]:         </nova:port>
Oct 18 11:43:14 user nova-compute[74190]:       </nova:ports>
Oct 18 11:43:14 user nova-compute[74190]:     </nova:instance>
Oct 18 11:43:14 user nova-compute[74190]:   </metadata>
Oct 18 11:43:14 user nova-compute[74190]:   <sysinfo type="smbios">
Oct 18 11:43:14 user nova-compute[74190]:     <system>
Oct 18 11:43:14 user nova-compute[74190]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 11:43:14 user nova-compute[74190]:       <entry name="product">OpenStack Nova</entry>
Oct 18 11:43:14 user nova-compute[74190]:       <entry name="version">0.0.0</entry>
Oct 18 11:43:14 user nova-compute[74190]:       <entry name="serial">3bd2f6d6-9c07-42a0-869e-566d685cb025</entry>
Oct 18 11:43:14 user nova-compute[74190]:       <entry name="uuid">3bd2f6d6-9c07-42a0-869e-566d685cb025</entry>
Oct 18 11:43:14 user nova-compute[74190]:       <entry name="family">Virtual Machine</entry>
Oct 18 11:43:14 user nova-compute[74190]:     </system>
Oct 18 11:43:14 user nova-compute[74190]:   </sysinfo>
Oct 18 11:43:14 user nova-compute[74190]:   <os>
Oct 18 11:43:14 user nova-compute[74190]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 11:43:14 user nova-compute[74190]:     <boot dev="hd"/>
Oct 18 11:43:14 user nova-compute[74190]:     <smbios mode="sysinfo"/>
Oct 18 11:43:14 user nova-compute[74190]:   </os>
Oct 18 11:43:14 user nova-compute[74190]:   <features>
Oct 18 11:43:14 user nova-compute[74190]:     <acpi/>
Oct 18 11:43:14 user nova-compute[74190]:     <apic/>
Oct 18 11:43:14 user nova-compute[74190]:     <vmcoreinfo/>
Oct 18 11:43:14 user nova-compute[74190]:   </features>
Oct 18 11:43:14 user nova-compute[74190]:   <clock offset="utc">
Oct 18 11:43:14 user nova-compute[74190]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 11:43:14 user nova-compute[74190]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 11:43:14 user nova-compute[74190]:     <timer name="hpet" present="no"/>
Oct 18 11:43:14 user nova-compute[74190]:   </clock>
Oct 18 11:43:14 user nova-compute[74190]:   <cpu mode="custom" match="exact">
Oct 18 11:43:14 user nova-compute[74190]:     <model>Nehalem</model>
Oct 18 11:43:14 user nova-compute[74190]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 11:43:14 user nova-compute[74190]:   </cpu>
Oct 18 11:43:14 user nova-compute[74190]:   <devices>
Oct 18 11:43:14 user nova-compute[74190]:     <disk type="block" device="disk">
Oct 18 11:43:14 user nova-compute[74190]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 11:43:14 user nova-compute[74190]:       <source dev="/dev/sdc"/>
Oct 18 11:43:14 user nova-compute[74190]:       <target dev="vda" bus="virtio"/>
Oct 18 11:43:14 user nova-compute[74190]:       <serial>2d829820-7b5f-42f9-81ab-8efc923f288a</serial>
Oct 18 11:43:14 user nova-compute[74190]:     </disk>
Oct 18 11:43:14 user nova-compute[74190]:     <interface type="ethernet">
Oct 18 11:43:14 user nova-compute[74190]:       <mac address="fa:16:3e:f6:77:76"/>
Oct 18 11:43:14 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:43:14 user nova-compute[74190]:       <mtu size="1442"/>
Oct 18 11:43:14 user nova-compute[74190]:       <target dev="tap9eca4d9a-28"/>
Oct 18 11:43:14 user nova-compute[74190]:     </interface>
Oct 18 11:43:14 user nova-compute[74190]:     <serial type="pty">
Oct 18 11:43:14 user nova-compute[74190]:       <log file="/opt/stack/data/nova/instances/3bd2f6d6-9c07-42a0-869e-566d685cb025/console.log" append="off"/>
Oct 18 11:43:14 user nova-compute[74190]:     </serial>
Oct 18 11:43:14 user nova-compute[74190]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 11:43:14 user nova-compute[74190]:     <video>
Oct 18 11:43:14 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:43:14 user nova-compute[74190]:     </video>
Oct 18 11:43:14 user nova-compute[74190]:     <rng model="virtio">
Oct 18 11:43:14 user nova-compute[74190]:       <backend model="random">/dev/urandom</backend>
Oct 18 11:43:14 user nova-compute[74190]:     </rng>
Oct 18 11:43:14 user nova-compute[74190]:     <controller type="usb" index="0" model="none"/>
Oct 18 11:43:14 user nova-compute[74190]:     <memballoon model="virtio">
Oct 18 11:43:14 user nova-compute[74190]:       <stats period="10"/>
Oct 18 11:43:14 user nova-compute[74190]:     </memballoon>
Oct 18 11:43:14 user nova-compute[74190]:   </devices>
Oct 18 11:43:14 user nova-compute[74190]: </domain>
Oct 18 11:43:14 user nova-compute[74190]:  {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 11:43:14 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:42:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-750462458',display_name='tempest-TestShelveInstance-server-750462458',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-750462458',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNt8SmvdArTyzkvCUI1kam2NbMC+rHv9iOWZki8JEEHP7fMgDgi8kkk7jXIMVKa+sVcv9nkOeL15Uby8ToS2uWym1iteM771YGpKWzDAM0HogCtKby6MGktNG2smezvdMg==',key_name='tempest-TestShelveInstance-1292603838',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d3e15d2b7944cba9ed86eb5c01ec98a',ramdisk_id='',reservation_id='r-n4ye783u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1202197307',owner_user_name='tempest-TestShelveInstance-1202197307-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:42:52Z,user_data=None,user_id='06661e802ad947d2a4e07e3d60a94d14',uuid=3bd2f6d6-9c07-42a0-869e-566d685cb025,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9eca4d9a-28f0-4818-beef-e65c22f351dd", "address": "fa:16:3e:f6:77:76", "network": {"id": "0c5cbb41-ba77-494a-904b-4c37e3205eb9", "bridge": "br-int", "label": "tempest-TestShelveInstance-1626181921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d3e15d2b7944cba9ed86eb5c01ec98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9eca4d9a-28", "ovs_interfaceid": "9eca4d9a-28f0-4818-beef-e65c22f351dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 11:43:14 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Converting VIF {"id": "9eca4d9a-28f0-4818-beef-e65c22f351dd", "address": "fa:16:3e:f6:77:76", "network": {"id": "0c5cbb41-ba77-494a-904b-4c37e3205eb9", "bridge": "br-int", "label": "tempest-TestShelveInstance-1626181921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d3e15d2b7944cba9ed86eb5c01ec98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9eca4d9a-28", "ovs_interfaceid": "9eca4d9a-28f0-4818-beef-e65c22f351dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:43:14 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:77:76,bridge_name='br-int',has_traffic_filtering=True,id=9eca4d9a-28f0-4818-beef-e65c22f351dd,network=Network(0c5cbb41-ba77-494a-904b-4c37e3205eb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9eca4d9a-28') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:43:14 user nova-compute[74190]: DEBUG os_vif [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:77:76,bridge_name='br-int',has_traffic_filtering=True,id=9eca4d9a-28f0-4818-beef-e65c22f351dd,network=Network(0c5cbb41-ba77-494a-904b-4c37e3205eb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9eca4d9a-28') {{(pid=74190) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 11:43:14 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:43:14 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:43:14 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 11:43:14 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:43:14 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd6d01370-9ca1-5d09-b3b8-9fa4a606e8bf', '_type': 'linux-noop'}}, row=False) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:43:14 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:43:14 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:43:14 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:43:14 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9eca4d9a-28, may_exist=True, interface_attrs={}) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:43:14 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9eca4d9a-28, col_values=(('qos', UUID('fae87706-fbab-4a17-a3e6-3c41602e4a19')),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:43:14 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9eca4d9a-28, col_values=(('external_ids', {'iface-id': '9eca4d9a-28f0-4818-beef-e65c22f351dd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:77:76', 'vm-uuid': '3bd2f6d6-9c07-42a0-869e-566d685cb025'}),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:43:14 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:43:14 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:43:14 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:43:14 user nova-compute[74190]: INFO os_vif [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:77:76,bridge_name='br-int',has_traffic_filtering=True,id=9eca4d9a-28f0-4818-beef-e65c22f351dd,network=Network(0c5cbb41-ba77-494a-904b-4c37e3205eb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9eca4d9a-28')
Oct 18 11:43:14 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] No BDM found with device name vda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 11:43:14 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] No VIF found with MAC fa:16:3e:f6:77:76, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 11:43:15 user nova-compute[74190]: DEBUG nova.network.neutron [req-ea8e7815-ddd7-4c71-8508-30ead48c7313 req-da853216-90e8-44d2-bad8-d1a021eb01e6 service nova] [instance: d56b243d-fbf2-4ae6-8399-80df46b33b82] Updated VIF entry in instance network info cache for port a4d61a40-a5fd-4bca-899e-5569a7bc1e1b. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 11:43:15 user nova-compute[74190]: DEBUG nova.network.neutron [req-ea8e7815-ddd7-4c71-8508-30ead48c7313 req-da853216-90e8-44d2-bad8-d1a021eb01e6 service nova] [instance: d56b243d-fbf2-4ae6-8399-80df46b33b82] Updating instance_info_cache with network_info: [{"id": "a4d61a40-a5fd-4bca-899e-5569a7bc1e1b", "address": "fa:16:3e:39:a4:ae", "network": {"id": "5b2a9095-d135-4b4a-9aee-82ddbd43faca", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1054223283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc2f7422d534064967a7bf458650f0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4d61a40-a5", "ovs_interfaceid": "a4d61a40-a5fd-4bca-899e-5569a7bc1e1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:43:15 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-ea8e7815-ddd7-4c71-8508-30ead48c7313 req-da853216-90e8-44d2-bad8-d1a021eb01e6 service nova] Releasing lock "refresh_cache-d56b243d-fbf2-4ae6-8399-80df46b33b82" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:43:15 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:43:15 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:43:15 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:43:15 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:43:16 user nova-compute[74190]: DEBUG nova.compute.manager [req-8779de43-e5b0-47b9-8f25-3b9ba16a53bf req-be90c4ef-0ba6-4c40-aafa-92a0a118f47c service nova] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Received event network-vif-plugged-9eca4d9a-28f0-4818-beef-e65c22f351dd {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:43:16 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-8779de43-e5b0-47b9-8f25-3b9ba16a53bf req-be90c4ef-0ba6-4c40-aafa-92a0a118f47c service nova] Acquiring lock "3bd2f6d6-9c07-42a0-869e-566d685cb025-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:43:16 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-8779de43-e5b0-47b9-8f25-3b9ba16a53bf req-be90c4ef-0ba6-4c40-aafa-92a0a118f47c service nova] Lock "3bd2f6d6-9c07-42a0-869e-566d685cb025-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:43:16 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-8779de43-e5b0-47b9-8f25-3b9ba16a53bf req-be90c4ef-0ba6-4c40-aafa-92a0a118f47c service nova] Lock "3bd2f6d6-9c07-42a0-869e-566d685cb025-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:43:16 user nova-compute[74190]: DEBUG nova.compute.manager [req-8779de43-e5b0-47b9-8f25-3b9ba16a53bf req-be90c4ef-0ba6-4c40-aafa-92a0a118f47c service nova] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] No waiting events found dispatching network-vif-plugged-9eca4d9a-28f0-4818-beef-e65c22f351dd {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:43:16 user nova-compute[74190]: WARNING nova.compute.manager [req-8779de43-e5b0-47b9-8f25-3b9ba16a53bf req-be90c4ef-0ba6-4c40-aafa-92a0a118f47c service nova] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Received unexpected event network-vif-plugged-9eca4d9a-28f0-4818-beef-e65c22f351dd for instance with vm_state building and task_state spawning.
Oct 18 11:43:16 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:43:16 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:43:18 user nova-compute[74190]: DEBUG nova.compute.manager [req-e719e45c-801b-4e44-8253-cd18fc498d92 req-ae2e84ec-4bb4-4cd2-ba61-096258949ef3 service nova] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Received event network-vif-plugged-9eca4d9a-28f0-4818-beef-e65c22f351dd {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:43:18 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-e719e45c-801b-4e44-8253-cd18fc498d92 req-ae2e84ec-4bb4-4cd2-ba61-096258949ef3 service nova] Acquiring lock "3bd2f6d6-9c07-42a0-869e-566d685cb025-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:43:18 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-e719e45c-801b-4e44-8253-cd18fc498d92 req-ae2e84ec-4bb4-4cd2-ba61-096258949ef3 service nova] Lock "3bd2f6d6-9c07-42a0-869e-566d685cb025-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:43:18 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-e719e45c-801b-4e44-8253-cd18fc498d92 req-ae2e84ec-4bb4-4cd2-ba61-096258949ef3 service nova] Lock "3bd2f6d6-9c07-42a0-869e-566d685cb025-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:43:18 user nova-compute[74190]: DEBUG nova.compute.manager [req-e719e45c-801b-4e44-8253-cd18fc498d92 req-ae2e84ec-4bb4-4cd2-ba61-096258949ef3 service nova] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] No waiting events found dispatching network-vif-plugged-9eca4d9a-28f0-4818-beef-e65c22f351dd {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:43:18 user nova-compute[74190]: WARNING nova.compute.manager [req-e719e45c-801b-4e44-8253-cd18fc498d92 req-ae2e84ec-4bb4-4cd2-ba61-096258949ef3 service nova] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Received unexpected event network-vif-plugged-9eca4d9a-28f0-4818-beef-e65c22f351dd for instance with vm_state building and task_state spawning.
Oct 18 11:43:18 user nova-compute[74190]: DEBUG nova.compute.manager [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Instance event wait completed in 0 seconds for  {{(pid=74190) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 11:43:18 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Guest created on hypervisor {{(pid=74190) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 11:43:18 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Instance spawned successfully.
Oct 18 11:43:18 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 11:43:18 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Found default for hw_cdrom_bus of ide {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:43:18 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Found default for hw_disk_bus of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:43:18 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Found default for hw_input_bus of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:43:18 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Found default for hw_pointer_model of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:43:18 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Found default for hw_video_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:43:18 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Found default for hw_vif_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:43:18 user nova-compute[74190]: INFO nova.compute.manager [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Took 5.94 seconds to spawn the instance on the hypervisor.
Oct 18 11:43:18 user nova-compute[74190]: DEBUG nova.compute.manager [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Checking state {{(pid=74190) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 11:43:18 user nova-compute[74190]: INFO nova.compute.manager [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Took 29.45 seconds to build instance.
Oct 18 11:43:18 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9ff458e0-19c0-48a1-8755-7ed1e8dfd92d tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Lock "3bd2f6d6-9c07-42a0-869e-566d685cb025" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 29.601s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:43:18 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:43:19 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:43:20 user nova-compute[74190]: DEBUG nova.compute.manager [req-7d908c71-2c6b-4357-ae1e-ea57ccda50dc req-e516d2da-679e-4d15-9258-e7a18ac5b039 service nova] [instance: 034398e8-e8c4-4e03-a608-440e447c6041] Received event network-changed-abefd824-cd1a-4947-996f-85553155dd8b {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:43:20 user nova-compute[74190]: DEBUG nova.compute.manager [req-7d908c71-2c6b-4357-ae1e-ea57ccda50dc req-e516d2da-679e-4d15-9258-e7a18ac5b039 service nova] [instance: 034398e8-e8c4-4e03-a608-440e447c6041] Refreshing instance network info cache due to event network-changed-abefd824-cd1a-4947-996f-85553155dd8b. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 11:43:20 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-7d908c71-2c6b-4357-ae1e-ea57ccda50dc req-e516d2da-679e-4d15-9258-e7a18ac5b039 service nova] Acquiring lock "refresh_cache-034398e8-e8c4-4e03-a608-440e447c6041" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:43:20 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-7d908c71-2c6b-4357-ae1e-ea57ccda50dc req-e516d2da-679e-4d15-9258-e7a18ac5b039 service nova] Acquired lock "refresh_cache-034398e8-e8c4-4e03-a608-440e447c6041" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:43:20 user nova-compute[74190]: DEBUG nova.network.neutron [req-7d908c71-2c6b-4357-ae1e-ea57ccda50dc req-e516d2da-679e-4d15-9258-e7a18ac5b039 service nova] [instance: 034398e8-e8c4-4e03-a608-440e447c6041] Refreshing network info cache for port abefd824-cd1a-4947-996f-85553155dd8b {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 11:43:20 user nova-compute[74190]: DEBUG nova.network.neutron [req-7d908c71-2c6b-4357-ae1e-ea57ccda50dc req-e516d2da-679e-4d15-9258-e7a18ac5b039 service nova] [instance: 034398e8-e8c4-4e03-a608-440e447c6041] Updated VIF entry in instance network info cache for port abefd824-cd1a-4947-996f-85553155dd8b. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 11:43:20 user nova-compute[74190]: DEBUG nova.network.neutron [req-7d908c71-2c6b-4357-ae1e-ea57ccda50dc req-e516d2da-679e-4d15-9258-e7a18ac5b039 service nova] [instance: 034398e8-e8c4-4e03-a608-440e447c6041] Updating instance_info_cache with network_info: [{"id": "abefd824-cd1a-4947-996f-85553155dd8b", "address": "fa:16:3e:42:84:1e", "network": {"id": "1424584d-abb9-4d38-bcdc-3c0969e1bf01", "bridge": "br-int", "label": "tempest-TestVolumeSwap-127887868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21f627e5a9344c9bad9923c2b0cbec3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabefd824-cd", "ovs_interfaceid": "abefd824-cd1a-4947-996f-85553155dd8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:43:20 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57693029-5a4c-46bc-8ad7-92bb6fbe16d5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Calling os-brick to attach iSCSI Volume {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 11:43:20 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-57693029-5a4c-46bc-8ad7-92bb6fbe16d5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tNhfvoBT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:43:20 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-57693029-5a4c-46bc-8ad7-92bb6fbe16d5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:43:20 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-57693029-5a4c-46bc-8ad7-92bb6fbe16d5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:43:20 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-57693029-5a4c-46bc-8ad7-92bb6fbe16d5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:43:20 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-57693029-5a4c-46bc-8ad7-92bb6fbe16d5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:43:20 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-57693029-5a4c-46bc-8ad7-92bb6fbe16d5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:43:20 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-57693029-5a4c-46bc-8ad7-92bb6fbe16d5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:43:20 user nova-compute[74190]: INFO os_brick.initiator.connectors.iscsi [None req-57693029-5a4c-46bc-8ad7-92bb6fbe16d5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 11:43:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb -p 172.16.0.220:3260 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:20 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-7d908c71-2c6b-4357-ae1e-ea57ccda50dc req-e516d2da-679e-4d15-9258-e7a18ac5b039 service nova] Releasing lock "refresh_cache-034398e8-e8c4-4e03-a608-440e447c6041" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:43:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:20 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e7a3f8-5070-4664-abcf-6ca4bc9fbdd0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:20 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-57693029-5a4c-46bc-8ad7-92bb6fbe16d5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 11:43:20 user nova-compute[74190]:  {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:43:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb -p 172.16.0.220:3260 --interface default --op new {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:20 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[a73e880d-e59d-451e-9379-86941e22f638]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb] added\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:20 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-57693029-5a4c-46bc-8ad7-92bb6fbe16d5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb] added
Oct 18 11:43:20 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:43:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:20 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[03302918-48c6-46c4-8ddd-a6c70c6a2042]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:20 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-57693029-5a4c-46bc-8ad7-92bb6fbe16d5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:43:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:20 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ea3387-debf-4d65-a7b8-03eabdd2d5c5]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:20 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-57693029-5a4c-46bc-8ad7-92bb6fbe16d5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:43:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tNhfvoBT {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tNhfvoBT" returned: 0 in 0.022s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:20 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f24736-3b1f-4f46-a4cb-964fcdcd4433]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:20 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-57693029-5a4c-46bc-8ad7-92bb6fbe16d5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tNhfvoBT'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:43:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:20 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[6219f439-1610-4a07-b65c-6bcc36b6adf7]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:20 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-57693029-5a4c-46bc-8ad7-92bb6fbe16d5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:43:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:20 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a51e6a3-88f8-4503-803a-97f5da33e0b8]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:20 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-57693029-5a4c-46bc-8ad7-92bb6fbe16d5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)
Oct 18 11:43:20 user nova-compute[74190]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)
Oct 18 11:43:20 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:43:20 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-57693029-5a4c-46bc-8ad7-92bb6fbe16d5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)
Oct 18 11:43:20 user nova-compute[74190]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)
Oct 18 11:43:20 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:43:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb -p 172.16.0.220:3260 --login {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:21 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[404adeee-d59e-4ce0-8217-094367410d16]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:21 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-57693029-5a4c-46bc-8ad7-92bb6fbe16d5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb, portal: 172.16.0.220,3260]
Oct 18 11:43:21 user nova-compute[74190]: Login to [iface: default, target: iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb, portal: 172.16.0.220,3260] successful.
Oct 18 11:43:21 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:43:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:21 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[1958e985-de6d-4246-afab-fae88162f08b]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:21 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-57693029-5a4c-46bc-8ad7-92bb6fbe16d5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:43:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:21 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b1f786-72eb-4377-979f-4b5560d0745f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:21 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-57693029-5a4c-46bc-8ad7-92bb6fbe16d5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)
Oct 18 11:43:21 user nova-compute[74190]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)
Oct 18 11:43:21 user nova-compute[74190]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)
Oct 18 11:43:21 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:43:21 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-57693029-5a4c-46bc-8ad7-92bb6fbe16d5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)
Oct 18 11:43:21 user nova-compute[74190]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)
Oct 18 11:43:21 user nova-compute[74190]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)
Oct 18 11:43:21 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:43:21 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-57693029-5a4c-46bc-8ad7-92bb6fbe16d5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.332s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:43:21 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-57693029-5a4c-46bc-8ad7-92bb6fbe16d5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Connected to 172.16.0.220:3260 {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 11:43:21 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-57693029-5a4c-46bc-8ad7-92bb6fbe16d5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=74190) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 11:43:21 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-57693029-5a4c-46bc-8ad7-92bb6fbe16d5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74190) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 11:43:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:21 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-5b542329-cdd9-4435-a10e-2a36e5cf03e7 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Acquiring lock "034398e8-e8c4-4e03-a608-440e447c6041" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:43:21 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-5b542329-cdd9-4435-a10e-2a36e5cf03e7 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Lock "034398e8-e8c4-4e03-a608-440e447c6041" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:43:21 user nova-compute[74190]: DEBUG nova.objects.instance [None req-5b542329-cdd9-4435-a10e-2a36e5cf03e7 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Lazy-loading 'flavor' on Instance uuid 034398e8-e8c4-4e03-a608-440e447c6041 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:43:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:21 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4156634-460a-4979-b558-6707483896f7]: (4, ('- - 0', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:21 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-57693029-5a4c-46bc-8ad7-92bb6fbe16d5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74190) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 11:43:21 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-57693029-5a4c-46bc-8ad7-92bb6fbe16d5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tNhfvoBT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 11:43:21 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-5b542329-cdd9-4435-a10e-2a36e5cf03e7 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Lock "034398e8-e8c4-4e03-a608-440e447c6041" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.111s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:43:21 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-0edda291-7d8e-4665-b207-ac0ad80eec69 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Acquiring lock "d56b243d-fbf2-4ae6-8399-80df46b33b82" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:43:21 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-0edda291-7d8e-4665-b207-ac0ad80eec69 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Lock "d56b243d-fbf2-4ae6-8399-80df46b33b82" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:43:21 user nova-compute[74190]: DEBUG nova.objects.instance [None req-0edda291-7d8e-4665-b207-ac0ad80eec69 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Lazy-loading 'flavor' on Instance uuid d56b243d-fbf2-4ae6-8399-80df46b33b82 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:43:21 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-0edda291-7d8e-4665-b207-ac0ad80eec69 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Lock "d56b243d-fbf2-4ae6-8399-80df46b33b82" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.078s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:43:21 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-5b542329-cdd9-4435-a10e-2a36e5cf03e7 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Acquiring lock "034398e8-e8c4-4e03-a608-440e447c6041" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:43:21 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-5b542329-cdd9-4435-a10e-2a36e5cf03e7 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Lock "034398e8-e8c4-4e03-a608-440e447c6041" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:43:21 user nova-compute[74190]: INFO nova.compute.manager [None req-5b542329-cdd9-4435-a10e-2a36e5cf03e7 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] [instance: 034398e8-e8c4-4e03-a608-440e447c6041] Attaching volume 8c585296-c9a9-4c7f-8757-618a59bd01d8 to /dev/vdb
Oct 18 11:43:21 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-0edda291-7d8e-4665-b207-ac0ad80eec69 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Acquiring lock "d56b243d-fbf2-4ae6-8399-80df46b33b82" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:43:21 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-0edda291-7d8e-4665-b207-ac0ad80eec69 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Lock "d56b243d-fbf2-4ae6-8399-80df46b33b82" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:43:21 user nova-compute[74190]: INFO nova.compute.manager [None req-0edda291-7d8e-4665-b207-ac0ad80eec69 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] [instance: d56b243d-fbf2-4ae6-8399-80df46b33b82] Attaching volume e8097d82-d1b3-459d-8331-682cbe592d49 to /dev/sdc
Oct 18 11:43:22 user nova-compute[74190]: DEBUG os_brick.utils [None req-5b542329-cdd9-4435-a10e-2a36e5cf03e7 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:43:22 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:22 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-57693029-5a4c-46bc-8ad7-92bb6fbe16d5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.385s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:43:22 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-57693029-5a4c-46bc-8ad7-92bb6fbe16d5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] <== connect_volume: return (1387ms) {'type': 'block', 'scsi_wwn': '26262666635396430', 'path': '/dev/sdd'} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:43:22 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57693029-5a4c-46bc-8ad7-92bb6fbe16d5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26262666635396430', 'path': '/dev/sdd'} {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 11:43:22 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:22 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[3006a5e3-004f-4241-b5a7-ada6f9f4e463]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cff158e257e1\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:22 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:22 user nova-compute[74190]: DEBUG nova.objects.instance [None req-57693029-5a4c-46bc-8ad7-92bb6fbe16d5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lazy-loading 'flavor' on Instance uuid c280652c-ffde-40f8-a919-adb8be618db8 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:43:22 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:22 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[63694d33-b83a-406d-993c-f7ce6104411d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:22 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:22 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.027s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:22 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f08edd0-8ceb-45e2-bc46-aec3ebace67d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:22 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe304b9-7c13-4614-9ef3-ff67bb6eaa8b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:22 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-5b542329-cdd9-4435-a10e-2a36e5cf03e7 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Running cmd (subprocess): nvme version {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:22 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-5b542329-cdd9-4435-a10e-2a36e5cf03e7 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] 'nvme version' failed. Not Retrying. {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 11:43:22 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5b542329-cdd9-4435-a10e-2a36e5cf03e7 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] nvme not present on system {{(pid=74190) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 11:43:22 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:22 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-57693029-5a4c-46bc-8ad7-92bb6fbe16d5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] attach device xml: <disk type="block" device="disk">
Oct 18 11:43:22 user nova-compute[74190]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 11:43:22 user nova-compute[74190]:   <source dev="/dev/sdd"/>
Oct 18 11:43:22 user nova-compute[74190]:   <target dev="vdb" bus="virtio"/>
Oct 18 11:43:22 user nova-compute[74190]:   <serial>04ab732f-c6a7-459c-b856-68eeee8c77cb</serial>
Oct 18 11:43:22 user nova-compute[74190]: </disk>
Oct 18 11:43:22 user nova-compute[74190]:  {{(pid=74190) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 18 11:43:22 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 11:43:22 user nova-compute[74190]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 11:43:22 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[5194c804-2a24-42d7-a9a9-2b7a2c05d0a9]: (4, '') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:22 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-5b542329-cdd9-4435-a10e-2a36e5cf03e7 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74190) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 11:43:22 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-5b542329-cdd9-4435-a10e-2a36e5cf03e7 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 11:43:22 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-5b542329-cdd9-4435-a10e-2a36e5cf03e7 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] LIGHTOS: no hostnqn found. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 11:43:22 user nova-compute[74190]: DEBUG os_brick.utils [None req-5b542329-cdd9-4435-a10e-2a36e5cf03e7 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] <== get_connector_properties: return (170ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cff158e257e1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:43:22 user nova-compute[74190]: DEBUG nova.virt.block_device [None req-5b542329-cdd9-4435-a10e-2a36e5cf03e7 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] [instance: 034398e8-e8c4-4e03-a608-440e447c6041] Updating existing volume attachment record: cce45d71-70fa-4a94-a090-aeb3223ffcc4 {{(pid=74190) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 11:43:22 user nova-compute[74190]: DEBUG os_brick.utils [None req-0edda291-7d8e-4665-b207-ac0ad80eec69 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:43:22 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:22 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:22 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec4384e-7c6e-4bec-bf30-7457bd826e03]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cff158e257e1\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:22 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:22 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:22 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[66db84bf-3ee0-436c-8ab5-89632efaddf8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:22 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:22 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:22 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[c90d04b1-8a80-4908-b929-555a3b365e30]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:22 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[3692a526-e2e1-4a58-ae02-d5e8b06ca817]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:22 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-0edda291-7d8e-4665-b207-ac0ad80eec69 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Running cmd (subprocess): nvme version {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:22 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-0edda291-7d8e-4665-b207-ac0ad80eec69 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] 'nvme version' failed. Not Retrying. {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 11:43:22 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0edda291-7d8e-4665-b207-ac0ad80eec69 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] nvme not present on system {{(pid=74190) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 11:43:22 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:22 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 11:43:22 user nova-compute[74190]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 11:43:22 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff7f86b8-699a-4fcc-8e3a-87fb71021f73]: (4, '') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:22 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-0edda291-7d8e-4665-b207-ac0ad80eec69 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74190) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 11:43:22 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-0edda291-7d8e-4665-b207-ac0ad80eec69 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 11:43:22 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-0edda291-7d8e-4665-b207-ac0ad80eec69 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] LIGHTOS: no hostnqn found. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 11:43:22 user nova-compute[74190]: DEBUG os_brick.utils [None req-0edda291-7d8e-4665-b207-ac0ad80eec69 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cff158e257e1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:43:22 user nova-compute[74190]: DEBUG nova.virt.block_device [None req-0edda291-7d8e-4665-b207-ac0ad80eec69 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] [instance: d56b243d-fbf2-4ae6-8399-80df46b33b82] Updating existing volume attachment record: 9ed96b0d-1421-4cdb-879b-ef75047efa90 {{(pid=74190) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 11:43:22 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-57693029-5a4c-46bc-8ad7-92bb6fbe16d5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] No BDM found with device name vda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 11:43:22 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-57693029-5a4c-46bc-8ad7-92bb6fbe16d5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 11:43:22 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-57693029-5a4c-46bc-8ad7-92bb6fbe16d5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] No VIF found with MAC fa:16:3e:4f:00:ce, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 11:43:23 user nova-compute[74190]: DEBUG nova.compute.manager [req-9ac8b878-49af-4fba-b50b-6c9050d297b1 req-0520b7bc-3b6c-4215-ba3f-ad2d3ba22bcc service nova] [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f] Received event network-changed-9087f286-715a-4bb2-a211-27119477ac6b {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:43:23 user nova-compute[74190]: DEBUG nova.compute.manager [req-9ac8b878-49af-4fba-b50b-6c9050d297b1 req-0520b7bc-3b6c-4215-ba3f-ad2d3ba22bcc service nova] [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f] Refreshing instance network info cache due to event network-changed-9087f286-715a-4bb2-a211-27119477ac6b. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 11:43:23 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-9ac8b878-49af-4fba-b50b-6c9050d297b1 req-0520b7bc-3b6c-4215-ba3f-ad2d3ba22bcc service nova] Acquiring lock "refresh_cache-697d3123-bd6b-42b9-b278-c33c0c00da6f" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:43:23 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-9ac8b878-49af-4fba-b50b-6c9050d297b1 req-0520b7bc-3b6c-4215-ba3f-ad2d3ba22bcc service nova] Acquired lock "refresh_cache-697d3123-bd6b-42b9-b278-c33c0c00da6f" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:43:23 user nova-compute[74190]: DEBUG nova.network.neutron [req-9ac8b878-49af-4fba-b50b-6c9050d297b1 req-0520b7bc-3b6c-4215-ba3f-ad2d3ba22bcc service nova] [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f] Refreshing network info cache for port 9087f286-715a-4bb2-a211-27119477ac6b {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 11:43:23 user nova-compute[74190]: DEBUG nova.network.neutron [req-9ac8b878-49af-4fba-b50b-6c9050d297b1 req-0520b7bc-3b6c-4215-ba3f-ad2d3ba22bcc service nova] [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f] Updated VIF entry in instance network info cache for port 9087f286-715a-4bb2-a211-27119477ac6b. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 11:43:23 user nova-compute[74190]: DEBUG nova.network.neutron [req-9ac8b878-49af-4fba-b50b-6c9050d297b1 req-0520b7bc-3b6c-4215-ba3f-ad2d3ba22bcc service nova] [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f] Updating instance_info_cache with network_info: [{"id": "9087f286-715a-4bb2-a211-27119477ac6b", "address": "fa:16:3e:f7:93:c2", "network": {"id": "ad63fd35-616c-40f8-9849-e84a2c75ad29", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2145418188-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d5cced34b384eb79833c41a1c607ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9087f286-71", "ovs_interfaceid": "9087f286-715a-4bb2-a211-27119477ac6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:43:23 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-9ac8b878-49af-4fba-b50b-6c9050d297b1 req-0520b7bc-3b6c-4215-ba3f-ad2d3ba22bcc service nova] Releasing lock "refresh_cache-697d3123-bd6b-42b9-b278-c33c0c00da6f" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:43:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:43:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:43:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:43:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:43:33 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3896622c-a938-4973-b7c9-4b0d24ee4c3c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] [instance: c6130edd-eb98-491e-a0ba-6bd59199d9e1] Calling os-brick to attach iSCSI Volume {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 11:43:33 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3896622c-a938-4973-b7c9-4b0d24ee4c3c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:99028d44-32f8-4fc1-97fe-595cdcc4f0b5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NWdlnvgU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:43:33 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-3896622c-a938-4973-b7c9-4b0d24ee4c3c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:43:33 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-3896622c-a938-4973-b7c9-4b0d24ee4c3c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:43:33 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-3896622c-a938-4973-b7c9-4b0d24ee4c3c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:43:33 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-3896622c-a938-4973-b7c9-4b0d24ee4c3c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:43:33 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-3896622c-a938-4973-b7c9-4b0d24ee4c3c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99028d44-32f8-4fc1-97fe-595cdcc4f0b5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:43:33 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-3896622c-a938-4973-b7c9-4b0d24ee4c3c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99028d44-32f8-4fc1-97fe-595cdcc4f0b5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:43:33 user nova-compute[74190]: INFO os_brick.initiator.connectors.iscsi [None req-3896622c-a938-4973-b7c9-4b0d24ee4c3c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 11:43:33 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99028d44-32f8-4fc1-97fe-595cdcc4f0b5 -p 172.16.0.220:3260 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:33 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99028d44-32f8-4fc1-97fe-595cdcc4f0b5 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:33 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[05bd226d-5ac9-495e-badd-1d028bbbd237]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:33 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3896622c-a938-4973-b7c9-4b0d24ee4c3c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 11:43:33 user nova-compute[74190]:  {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:43:33 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99028d44-32f8-4fc1-97fe-595cdcc4f0b5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:33 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99028d44-32f8-4fc1-97fe-595cdcc4f0b5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:33 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d1bcbd-76f4-4d9f-9337-f195c5db750e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:99028d44-32f8-4fc1-97fe-595cdcc4f0b5] added\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:33 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3896622c-a938-4973-b7c9-4b0d24ee4c3c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:99028d44-32f8-4fc1-97fe-595cdcc4f0b5] added
Oct 18 11:43:33 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:43:33 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99028d44-32f8-4fc1-97fe-595cdcc4f0b5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:33 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99028d44-32f8-4fc1-97fe-595cdcc4f0b5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:33 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca41254-8c33-4fdc-a469-425d1e6d4d3f]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:33 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3896622c-a938-4973-b7c9-4b0d24ee4c3c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:43:33 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99028d44-32f8-4fc1-97fe-595cdcc4f0b5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:33 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99028d44-32f8-4fc1-97fe-595cdcc4f0b5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:33 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f5c5e99-3c7e-4372-a5d8-18227581cc4c]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:33 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3896622c-a938-4973-b7c9-4b0d24ee4c3c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:43:33 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99028d44-32f8-4fc1-97fe-595cdcc4f0b5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NWdlnvgU {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:33 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99028d44-32f8-4fc1-97fe-595cdcc4f0b5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NWdlnvgU" returned: 0 in 0.022s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:33 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[adac142a-9f27-4256-92d5-704dbb29226b]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:33 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3896622c-a938-4973-b7c9-4b0d24ee4c3c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NWdlnvgU'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:43:33 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99028d44-32f8-4fc1-97fe-595cdcc4f0b5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:33 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99028d44-32f8-4fc1-97fe-595cdcc4f0b5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:33 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf31020-e0e1-4561-baa2-16419bc172e4]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:33 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3896622c-a938-4973-b7c9-4b0d24ee4c3c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:43:33 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:33 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:33 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ab99b5-7ff3-4591-851f-51dc2226a07d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:33 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3896622c-a938-4973-b7c9-4b0d24ee4c3c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)
Oct 18 11:43:33 user nova-compute[74190]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)
Oct 18 11:43:33 user nova-compute[74190]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)
Oct 18 11:43:33 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:43:33 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3896622c-a938-4973-b7c9-4b0d24ee4c3c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)
Oct 18 11:43:33 user nova-compute[74190]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)
Oct 18 11:43:33 user nova-compute[74190]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)
Oct 18 11:43:33 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:43:33 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99028d44-32f8-4fc1-97fe-595cdcc4f0b5 -p 172.16.0.220:3260 --login {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:33 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99028d44-32f8-4fc1-97fe-595cdcc4f0b5 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:33 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd92f710-fe7e-493b-b6ba-752776a62800]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:99028d44-32f8-4fc1-97fe-595cdcc4f0b5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:99028d44-32f8-4fc1-97fe-595cdcc4f0b5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:33 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3896622c-a938-4973-b7c9-4b0d24ee4c3c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:99028d44-32f8-4fc1-97fe-595cdcc4f0b5, portal: 172.16.0.220,3260]
Oct 18 11:43:33 user nova-compute[74190]: Login to [iface: default, target: iqn.2010-10.org.openstack:99028d44-32f8-4fc1-97fe-595cdcc4f0b5, portal: 172.16.0.220,3260] successful.
Oct 18 11:43:33 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:43:33 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99028d44-32f8-4fc1-97fe-595cdcc4f0b5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:33 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99028d44-32f8-4fc1-97fe-595cdcc4f0b5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:33 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f9aaccb-b1ea-4452-9ccb-b9ef9f104129]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:33 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3896622c-a938-4973-b7c9-4b0d24ee4c3c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:43:33 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:33 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:33 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d5e5a4-664b-487b-976f-7b4ebee4563d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99028d44-32f8-4fc1-97fe-595cdcc4f0b5 (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:33 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3896622c-a938-4973-b7c9-4b0d24ee4c3c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)
Oct 18 11:43:33 user nova-compute[74190]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)
Oct 18 11:43:33 user nova-compute[74190]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)
Oct 18 11:43:33 user nova-compute[74190]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99028d44-32f8-4fc1-97fe-595cdcc4f0b5 (non-flash)
Oct 18 11:43:33 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:43:33 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3896622c-a938-4973-b7c9-4b0d24ee4c3c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)
Oct 18 11:43:33 user nova-compute[74190]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)
Oct 18 11:43:33 user nova-compute[74190]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)
Oct 18 11:43:33 user nova-compute[74190]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99028d44-32f8-4fc1-97fe-595cdcc4f0b5 (non-flash)
Oct 18 11:43:33 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:43:33 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-3896622c-a938-4973-b7c9-4b0d24ee4c3c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99028d44-32f8-4fc1-97fe-595cdcc4f0b5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:43:33 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3896622c-a938-4973-b7c9-4b0d24ee4c3c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Connected to 172.16.0.220:3260 {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 11:43:33 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-3896622c-a938-4973-b7c9-4b0d24ee4c3c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=74190) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 11:43:33 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-3896622c-a938-4973-b7c9-4b0d24ee4c3c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74190) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 11:43:33 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:33 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:33 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[208a730d-a48a-4014-95d8-7590be86460b]: (4, ('- - 0', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:33 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-3896622c-a938-4973-b7c9-4b0d24ee4c3c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: None {{(pid=74190) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 11:43:33 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5210f97-2b7b-437c-843d-648847baaf22 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] Calling os-brick to attach iSCSI Volume {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 11:43:33 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5210f97-2b7b-437c-843d-648847baaf22 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6243f09d-1778-4f76-beae-8baceac3112f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BqnhLFQv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:43:33 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-f5210f97-2b7b-437c-843d-648847baaf22 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:43:33 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-f5210f97-2b7b-437c-843d-648847baaf22 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:43:33 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-57693029-5a4c-46bc-8ad7-92bb6fbe16d5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lock "c280652c-ffde-40f8-a919-adb8be618db8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 33.663s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:43:33 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-1dfdff28-9089-4596-a417-7a1baa9b18f4 tempest-VolumesAssistedSnapshotsTest-63445179 tempest-VolumesAssistedSnapshotsTest-63445179-project-admin] Acquiring lock "697d3123-bd6b-42b9-b278-c33c0c00da6f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:43:33 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-1dfdff28-9089-4596-a417-7a1baa9b18f4 tempest-VolumesAssistedSnapshotsTest-63445179 tempest-VolumesAssistedSnapshotsTest-63445179-project-admin] Lock "697d3123-bd6b-42b9-b278-c33c0c00da6f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:43:33 user nova-compute[74190]: DEBUG nova.objects.instance [None req-1dfdff28-9089-4596-a417-7a1baa9b18f4 tempest-VolumesAssistedSnapshotsTest-63445179 tempest-VolumesAssistedSnapshotsTest-63445179-project-admin] Lazy-loading 'flavor' on Instance uuid 697d3123-bd6b-42b9-b278-c33c0c00da6f {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:43:33 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:43:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-1dfdff28-9089-4596-a417-7a1baa9b18f4 tempest-VolumesAssistedSnapshotsTest-63445179 tempest-VolumesAssistedSnapshotsTest-63445179-project-admin] Lock "697d3123-bd6b-42b9-b278-c33c0c00da6f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.084s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:43:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b97c3c78-b259-4b9d-afb3-9ad8c31a518e tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Acquiring lock "c280652c-ffde-40f8-a919-adb8be618db8" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:43:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b97c3c78-b259-4b9d-afb3-9ad8c31a518e tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lock "c280652c-ffde-40f8-a919-adb8be618db8" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:43:34 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b97c3c78-b259-4b9d-afb3-9ad8c31a518e tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Checking state {{(pid=74190) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 11:43:34 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b97c3c78-b259-4b9d-afb3-9ad8c31a518e tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74190) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Oct 18 11:43:34 user nova-compute[74190]: DEBUG nova.objects.instance [None req-b97c3c78-b259-4b9d-afb3-9ad8c31a518e tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lazy-loading 'flavor' on Instance uuid c280652c-ffde-40f8-a919-adb8be618db8 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:43:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-1dfdff28-9089-4596-a417-7a1baa9b18f4 tempest-VolumesAssistedSnapshotsTest-63445179 tempest-VolumesAssistedSnapshotsTest-63445179-project-admin] Acquiring lock "697d3123-bd6b-42b9-b278-c33c0c00da6f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:43:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-1dfdff28-9089-4596-a417-7a1baa9b18f4 tempest-VolumesAssistedSnapshotsTest-63445179 tempest-VolumesAssistedSnapshotsTest-63445179-project-admin] Lock "697d3123-bd6b-42b9-b278-c33c0c00da6f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:43:34 user nova-compute[74190]: INFO nova.compute.manager [None req-1dfdff28-9089-4596-a417-7a1baa9b18f4 tempest-VolumesAssistedSnapshotsTest-63445179 tempest-VolumesAssistedSnapshotsTest-63445179-project-admin] [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f] Attaching volume 3e1907e5-89a1-4792-a656-59422463e8a1 to /dev/vdb
Oct 18 11:43:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:43:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:43:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:43:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:43:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:43:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:43:34 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-3896622c-a938-4973-b7c9-4b0d24ee4c3c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74190) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 11:43:34 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3896622c-a938-4973-b7c9-4b0d24ee4c3c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:99028d44-32f8-4fc1-97fe-595cdcc4f0b5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NWdlnvgU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 11:43:34 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-3896622c-a938-4973-b7c9-4b0d24ee4c3c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:43:34 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3896622c-a938-4973-b7c9-4b0d24ee4c3c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '23163313931663361', 'path': '/dev/sde'} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:43:34 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3896622c-a938-4973-b7c9-4b0d24ee4c3c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] [instance: c6130edd-eb98-491e-a0ba-6bd59199d9e1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23163313931663361', 'path': '/dev/sde'} {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 11:43:34 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-f5210f97-2b7b-437c-843d-648847baaf22 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.877s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:43:34 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-f5210f97-2b7b-437c-843d-648847baaf22 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:43:34 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-f5210f97-2b7b-437c-843d-648847baaf22 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6243f09d-1778-4f76-beae-8baceac3112f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:43:34 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-f5210f97-2b7b-437c-843d-648847baaf22 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6243f09d-1778-4f76-beae-8baceac3112f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:43:34 user nova-compute[74190]: INFO os_brick.initiator.connectors.iscsi [None req-f5210f97-2b7b-437c-843d-648847baaf22 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 11:43:34 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6243f09d-1778-4f76-beae-8baceac3112f -p 172.16.0.220:3260 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:34 user nova-compute[74190]: DEBUG nova.objects.instance [None req-3896622c-a938-4973-b7c9-4b0d24ee4c3c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Lazy-loading 'flavor' on Instance uuid c6130edd-eb98-491e-a0ba-6bd59199d9e1 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:43:34 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6243f09d-1778-4f76-beae-8baceac3112f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:34 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db4dab3-4cad-4b95-b405-9bcf6af94f99]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:34 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5210f97-2b7b-437c-843d-648847baaf22 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 11:43:34 user nova-compute[74190]:  {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:43:34 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6243f09d-1778-4f76-beae-8baceac3112f -p 172.16.0.220:3260 --interface default --op new {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:34 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-3896622c-a938-4973-b7c9-4b0d24ee4c3c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] attach device xml: <disk type="block" device="disk">
Oct 18 11:43:34 user nova-compute[74190]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 11:43:34 user nova-compute[74190]:   <source dev="/dev/sde"/>
Oct 18 11:43:34 user nova-compute[74190]:   <target dev="vdb" bus="virtio"/>
Oct 18 11:43:34 user nova-compute[74190]:   <serial>99028d44-32f8-4fc1-97fe-595cdcc4f0b5</serial>
Oct 18 11:43:34 user nova-compute[74190]: </disk>
Oct 18 11:43:34 user nova-compute[74190]:  {{(pid=74190) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 18 11:43:34 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6243f09d-1778-4f76-beae-8baceac3112f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:34 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cdab235-9939-4b13-b70c-ade5ffdde235]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6243f09d-1778-4f76-beae-8baceac3112f] added\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:34 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5210f97-2b7b-437c-843d-648847baaf22 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6243f09d-1778-4f76-beae-8baceac3112f] added
Oct 18 11:43:34 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:43:34 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6243f09d-1778-4f76-beae-8baceac3112f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:34 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6243f09d-1778-4f76-beae-8baceac3112f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:34 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[443364e7-79d0-46ce-8859-155ca6ccb19b]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:34 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5210f97-2b7b-437c-843d-648847baaf22 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:43:34 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6243f09d-1778-4f76-beae-8baceac3112f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:34 user nova-compute[74190]: DEBUG os_brick.utils [None req-1dfdff28-9089-4596-a417-7a1baa9b18f4 tempest-VolumesAssistedSnapshotsTest-63445179 tempest-VolumesAssistedSnapshotsTest-63445179-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:43:34 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:34 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6243f09d-1778-4f76-beae-8baceac3112f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:34 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[0763d8df-a2e9-401d-b673-8332c3367514]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:34 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5210f97-2b7b-437c-843d-648847baaf22 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:43:34 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6243f09d-1778-4f76-beae-8baceac3112f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BqnhLFQv {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:34 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:34 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[a72f3226-c1dd-43b3-85fd-6849496570e8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cff158e257e1\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:34 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:34 user nova-compute[74190]: DEBUG nova.compute.manager [req-1d1cb739-f958-4008-bc35-0d4c0ff847fd req-20727e91-ee73-401b-a6fd-2ae6526f06bb service nova] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Received event network-vif-unplugged-80b77e2d-aa04-4996-a0c1-713054affac4 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:43:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-1d1cb739-f958-4008-bc35-0d4c0ff847fd req-20727e91-ee73-401b-a6fd-2ae6526f06bb service nova] Acquiring lock "c280652c-ffde-40f8-a919-adb8be618db8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:43:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-1d1cb739-f958-4008-bc35-0d4c0ff847fd req-20727e91-ee73-401b-a6fd-2ae6526f06bb service nova] Lock "c280652c-ffde-40f8-a919-adb8be618db8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:43:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-1d1cb739-f958-4008-bc35-0d4c0ff847fd req-20727e91-ee73-401b-a6fd-2ae6526f06bb service nova] Lock "c280652c-ffde-40f8-a919-adb8be618db8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:43:34 user nova-compute[74190]: DEBUG nova.compute.manager [req-1d1cb739-f958-4008-bc35-0d4c0ff847fd req-20727e91-ee73-401b-a6fd-2ae6526f06bb service nova] [instance: c280652c-ffde-40f8-a919-adb8be618db8] No waiting events found dispatching network-vif-unplugged-80b77e2d-aa04-4996-a0c1-713054affac4 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:43:34 user nova-compute[74190]: WARNING nova.compute.manager [req-1d1cb739-f958-4008-bc35-0d4c0ff847fd req-20727e91-ee73-401b-a6fd-2ae6526f06bb service nova] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Received unexpected event network-vif-unplugged-80b77e2d-aa04-4996-a0c1-713054affac4 for instance with vm_state active and task_state powering-off.
Oct 18 11:43:34 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6243f09d-1778-4f76-beae-8baceac3112f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BqnhLFQv" returned: 0 in 0.023s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:34 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[32fe8827-b15c-4591-b6ed-50215c03e510]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:34 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5210f97-2b7b-437c-843d-648847baaf22 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BqnhLFQv'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:43:34 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6243f09d-1778-4f76-beae-8baceac3112f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:34 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.028s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:34 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[349f6e0f-2731-43c3-aec8-246ef7b8690e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:34 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:34 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:34 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[73e39aef-524c-4b41-890f-f8e0dc8e0d9c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:34 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6243f09d-1778-4f76-beae-8baceac3112f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.037s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:34 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[595148a5-826e-4058-8afb-8e42322e4c12]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:34 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5210f97-2b7b-437c-843d-648847baaf22 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:43:34 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[84687272-f903-4d06-a40f-2d54ee7f95b8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:34 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-1dfdff28-9089-4596-a417-7a1baa9b18f4 tempest-VolumesAssistedSnapshotsTest-63445179 tempest-VolumesAssistedSnapshotsTest-63445179-project-admin] Running cmd (subprocess): nvme version {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:34 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-1dfdff28-9089-4596-a417-7a1baa9b18f4 tempest-VolumesAssistedSnapshotsTest-63445179 tempest-VolumesAssistedSnapshotsTest-63445179-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 11:43:34 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:34 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:34 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca72b55f-80bc-40a4-a7c5-d68b6f150df9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99028d44-32f8-4fc1-97fe-595cdcc4f0b5 (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:34 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1dfdff28-9089-4596-a417-7a1baa9b18f4 tempest-VolumesAssistedSnapshotsTest-63445179 tempest-VolumesAssistedSnapshotsTest-63445179-project-admin] nvme not present on system {{(pid=74190) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 11:43:34 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5210f97-2b7b-437c-843d-648847baaf22 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)
Oct 18 11:43:34 user nova-compute[74190]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)
Oct 18 11:43:34 user nova-compute[74190]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)
Oct 18 11:43:34 user nova-compute[74190]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99028d44-32f8-4fc1-97fe-595cdcc4f0b5 (non-flash)
Oct 18 11:43:34 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:43:34 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5210f97-2b7b-437c-843d-648847baaf22 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)
Oct 18 11:43:34 user nova-compute[74190]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)
Oct 18 11:43:34 user nova-compute[74190]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)
Oct 18 11:43:34 user nova-compute[74190]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99028d44-32f8-4fc1-97fe-595cdcc4f0b5 (non-flash)
Oct 18 11:43:34 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:43:34 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:34 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6243f09d-1778-4f76-beae-8baceac3112f -p 172.16.0.220:3260 --login {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:34 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 11:43:34 user nova-compute[74190]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 11:43:34 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd27123-a417-4047-abb9-17fccdf59af9]: (4, '') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:34 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-1dfdff28-9089-4596-a417-7a1baa9b18f4 tempest-VolumesAssistedSnapshotsTest-63445179 tempest-VolumesAssistedSnapshotsTest-63445179-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74190) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 11:43:34 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-1dfdff28-9089-4596-a417-7a1baa9b18f4 tempest-VolumesAssistedSnapshotsTest-63445179 tempest-VolumesAssistedSnapshotsTest-63445179-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 11:43:34 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-1dfdff28-9089-4596-a417-7a1baa9b18f4 tempest-VolumesAssistedSnapshotsTest-63445179 tempest-VolumesAssistedSnapshotsTest-63445179-project-admin] LIGHTOS: no hostnqn found. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 11:43:34 user nova-compute[74190]: DEBUG os_brick.utils [None req-1dfdff28-9089-4596-a417-7a1baa9b18f4 tempest-VolumesAssistedSnapshotsTest-63445179 tempest-VolumesAssistedSnapshotsTest-63445179-project-admin] <== get_connector_properties: return (173ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cff158e257e1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:43:34 user nova-compute[74190]: DEBUG nova.virt.block_device [None req-1dfdff28-9089-4596-a417-7a1baa9b18f4 tempest-VolumesAssistedSnapshotsTest-63445179 tempest-VolumesAssistedSnapshotsTest-63445179-project-admin] [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f] Updating existing volume attachment record: 2fc252da-4b1d-40a4-8b49-773e2116e430 {{(pid=74190) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 11:43:34 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6243f09d-1778-4f76-beae-8baceac3112f -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:34 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[1253009f-fff8-434a-9e81-47770a3a7b15]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6243f09d-1778-4f76-beae-8baceac3112f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6243f09d-1778-4f76-beae-8baceac3112f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:34 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5210f97-2b7b-437c-843d-648847baaf22 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6243f09d-1778-4f76-beae-8baceac3112f, portal: 172.16.0.220,3260]
Oct 18 11:43:34 user nova-compute[74190]: Login to [iface: default, target: iqn.2010-10.org.openstack:6243f09d-1778-4f76-beae-8baceac3112f, portal: 172.16.0.220,3260] successful.
Oct 18 11:43:34 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:43:34 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6243f09d-1778-4f76-beae-8baceac3112f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:34 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6243f09d-1778-4f76-beae-8baceac3112f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:34 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[be93e922-fea4-415f-ba72-c73e43985fbb]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:34 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5210f97-2b7b-437c-843d-648847baaf22 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:43:34 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:34 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:34 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[de832c12-6e00-4501-88a5-acdc1193dd68]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99028d44-32f8-4fc1-97fe-595cdcc4f0b5 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6243f09d-1778-4f76-beae-8baceac3112f (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:34 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5210f97-2b7b-437c-843d-648847baaf22 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)
Oct 18 11:43:34 user nova-compute[74190]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)
Oct 18 11:43:34 user nova-compute[74190]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)
Oct 18 11:43:34 user nova-compute[74190]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99028d44-32f8-4fc1-97fe-595cdcc4f0b5 (non-flash)
Oct 18 11:43:34 user nova-compute[74190]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6243f09d-1778-4f76-beae-8baceac3112f (non-flash)
Oct 18 11:43:34 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:43:34 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5210f97-2b7b-437c-843d-648847baaf22 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)
Oct 18 11:43:34 user nova-compute[74190]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)
Oct 18 11:43:34 user nova-compute[74190]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)
Oct 18 11:43:34 user nova-compute[74190]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99028d44-32f8-4fc1-97fe-595cdcc4f0b5 (non-flash)
Oct 18 11:43:34 user nova-compute[74190]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6243f09d-1778-4f76-beae-8baceac3112f (non-flash)
Oct 18 11:43:34 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:43:34 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-f5210f97-2b7b-437c-843d-648847baaf22 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6243f09d-1778-4f76-beae-8baceac3112f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.408s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:43:34 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5210f97-2b7b-437c-843d-648847baaf22 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Connected to 172.16.0.220:3260 {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 11:43:34 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-f5210f97-2b7b-437c-843d-648847baaf22 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=74190) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 11:43:34 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-f5210f97-2b7b-437c-843d-648847baaf22 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74190) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 11:43:34 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:35 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.023s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:35 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd254440-8416-4e19-822b-bb2c7e26a3fd]: (4, ('- - 0', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:35 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-f5210f97-2b7b-437c-843d-648847baaf22 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74190) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 11:43:35 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5210f97-2b7b-437c-843d-648847baaf22 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:6243f09d-1778-4f76-beae-8baceac3112f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BqnhLFQv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 11:43:35 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-3896622c-a938-4973-b7c9-4b0d24ee4c3c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] No BDM found with device name vda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 11:43:35 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-3896622c-a938-4973-b7c9-4b0d24ee4c3c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 11:43:35 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-3896622c-a938-4973-b7c9-4b0d24ee4c3c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] No VIF found with MAC fa:16:3e:ee:96:5d, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 11:43:35 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Instance destroyed successfully.
Oct 18 11:43:35 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b97c3c78-b259-4b9d-afb3-9ad8c31a518e tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Checking state {{(pid=74190) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 11:43:35 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b97c3c78-b259-4b9d-afb3-9ad8c31a518e tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lock "c280652c-ffde-40f8-a919-adb8be618db8" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.095s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:43:36 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-f5210f97-2b7b-437c-843d-648847baaf22 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.450s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:43:36 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5210f97-2b7b-437c-843d-648847baaf22 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] <== connect_volume: return (2327ms) {'type': 'block', 'scsi_wwn': '23661663331346136', 'path': '/dev/sdf'} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:43:36 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5210f97-2b7b-437c-843d-648847baaf22 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23661663331346136', 'path': '/dev/sdf'} {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 11:43:36 user nova-compute[74190]: DEBUG nova.objects.instance [None req-f5210f97-2b7b-437c-843d-648847baaf22 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Lazy-loading 'flavor' on Instance uuid 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:43:36 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-f5210f97-2b7b-437c-843d-648847baaf22 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] attach device xml: <disk type="block" device="disk">
Oct 18 11:43:36 user nova-compute[74190]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 11:43:36 user nova-compute[74190]:   <source dev="/dev/sdf"/>
Oct 18 11:43:36 user nova-compute[74190]:   <target dev="vdb" bus="virtio"/>
Oct 18 11:43:36 user nova-compute[74190]:   <serial>6243f09d-1778-4f76-beae-8baceac3112f</serial>
Oct 18 11:43:36 user nova-compute[74190]: </disk>
Oct 18 11:43:36 user nova-compute[74190]:  {{(pid=74190) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 18 11:43:36 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-f5210f97-2b7b-437c-843d-648847baaf22 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] No BDM found with device name vda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 11:43:36 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-f5210f97-2b7b-437c-843d-648847baaf22 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] No BDM found with device name hda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 11:43:36 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-f5210f97-2b7b-437c-843d-648847baaf22 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] No VIF found with MAC fa:16:3e:22:e2:3f, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 11:43:36 user nova-compute[74190]: DEBUG nova.compute.manager [req-c0ba20b1-8af2-46a2-b633-400f520e5af0 req-66f42fe8-de97-43bb-b25d-6aa407d91554 service nova] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Received event network-vif-plugged-80b77e2d-aa04-4996-a0c1-713054affac4 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:43:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-c0ba20b1-8af2-46a2-b633-400f520e5af0 req-66f42fe8-de97-43bb-b25d-6aa407d91554 service nova] Acquiring lock "c280652c-ffde-40f8-a919-adb8be618db8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:43:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-c0ba20b1-8af2-46a2-b633-400f520e5af0 req-66f42fe8-de97-43bb-b25d-6aa407d91554 service nova] Lock "c280652c-ffde-40f8-a919-adb8be618db8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:43:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-c0ba20b1-8af2-46a2-b633-400f520e5af0 req-66f42fe8-de97-43bb-b25d-6aa407d91554 service nova] Lock "c280652c-ffde-40f8-a919-adb8be618db8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:43:36 user nova-compute[74190]: DEBUG nova.compute.manager [req-c0ba20b1-8af2-46a2-b633-400f520e5af0 req-66f42fe8-de97-43bb-b25d-6aa407d91554 service nova] [instance: c280652c-ffde-40f8-a919-adb8be618db8] No waiting events found dispatching network-vif-plugged-80b77e2d-aa04-4996-a0c1-713054affac4 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:43:36 user nova-compute[74190]: WARNING nova.compute.manager [req-c0ba20b1-8af2-46a2-b633-400f520e5af0 req-66f42fe8-de97-43bb-b25d-6aa407d91554 service nova] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Received unexpected event network-vif-plugged-80b77e2d-aa04-4996-a0c1-713054affac4 for instance with vm_state stopped and task_state None.
Oct 18 11:43:38 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:43:39 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:43:41 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b542329-cdd9-4435-a10e-2a36e5cf03e7 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] [instance: 034398e8-e8c4-4e03-a608-440e447c6041] Calling os-brick to attach iSCSI Volume {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 11:43:41 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b542329-cdd9-4435-a10e-2a36e5cf03e7 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8c585296-c9a9-4c7f-8757-618a59bd01d8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QDhaZvqp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:43:41 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-5b542329-cdd9-4435-a10e-2a36e5cf03e7 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:43:41 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-5b542329-cdd9-4435-a10e-2a36e5cf03e7 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:43:41 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-5b542329-cdd9-4435-a10e-2a36e5cf03e7 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:43:41 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-5b542329-cdd9-4435-a10e-2a36e5cf03e7 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:43:41 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-5b542329-cdd9-4435-a10e-2a36e5cf03e7 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c585296-c9a9-4c7f-8757-618a59bd01d8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:43:41 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-5b542329-cdd9-4435-a10e-2a36e5cf03e7 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c585296-c9a9-4c7f-8757-618a59bd01d8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:43:41 user nova-compute[74190]: INFO os_brick.initiator.connectors.iscsi [None req-5b542329-cdd9-4435-a10e-2a36e5cf03e7 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 11:43:41 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c585296-c9a9-4c7f-8757-618a59bd01d8 -p 172.16.0.220:3260 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:41 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c585296-c9a9-4c7f-8757-618a59bd01d8 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:41 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[6593c2d2-0f32-42bb-8e36-e6126eed78d9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:41 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b542329-cdd9-4435-a10e-2a36e5cf03e7 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 11:43:41 user nova-compute[74190]:  {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:43:41 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c585296-c9a9-4c7f-8757-618a59bd01d8 -p 172.16.0.220:3260 --interface default --op new {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:41 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c585296-c9a9-4c7f-8757-618a59bd01d8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:41 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[1661456f-6d6e-4086-bffb-693367dd46f6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8c585296-c9a9-4c7f-8757-618a59bd01d8] added\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:41 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b542329-cdd9-4435-a10e-2a36e5cf03e7 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8c585296-c9a9-4c7f-8757-618a59bd01d8] added
Oct 18 11:43:41 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:43:41 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c585296-c9a9-4c7f-8757-618a59bd01d8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:41 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c585296-c9a9-4c7f-8757-618a59bd01d8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:41 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[51cd5ccf-1130-4584-9b70-d3bd653792d0]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:41 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b542329-cdd9-4435-a10e-2a36e5cf03e7 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:43:41 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c585296-c9a9-4c7f-8757-618a59bd01d8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:41 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c585296-c9a9-4c7f-8757-618a59bd01d8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:41 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d381e3-feca-4a67-8212-1ae8a13522ca]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:41 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b542329-cdd9-4435-a10e-2a36e5cf03e7 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:43:41 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c585296-c9a9-4c7f-8757-618a59bd01d8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QDhaZvqp {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:41 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c585296-c9a9-4c7f-8757-618a59bd01d8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QDhaZvqp" returned: 0 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:41 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[52cb8114-d71b-45df-8259-2522e50da98d]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:41 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b542329-cdd9-4435-a10e-2a36e5cf03e7 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QDhaZvqp'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:43:41 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c585296-c9a9-4c7f-8757-618a59bd01d8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:41 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c585296-c9a9-4c7f-8757-618a59bd01d8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:41 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[c160bae4-2128-423d-b183-587b8be98892]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:41 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b542329-cdd9-4435-a10e-2a36e5cf03e7 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:43:41 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:41 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:41 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[08435661-4e3e-4645-941a-b678096bf3aa]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99028d44-32f8-4fc1-97fe-595cdcc4f0b5 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6243f09d-1778-4f76-beae-8baceac3112f (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:41 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b542329-cdd9-4435-a10e-2a36e5cf03e7 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)
Oct 18 11:43:41 user nova-compute[74190]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)
Oct 18 11:43:41 user nova-compute[74190]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)
Oct 18 11:43:41 user nova-compute[74190]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99028d44-32f8-4fc1-97fe-595cdcc4f0b5 (non-flash)
Oct 18 11:43:41 user nova-compute[74190]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6243f09d-1778-4f76-beae-8baceac3112f (non-flash)
Oct 18 11:43:41 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:43:41 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b542329-cdd9-4435-a10e-2a36e5cf03e7 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)
Oct 18 11:43:41 user nova-compute[74190]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)
Oct 18 11:43:41 user nova-compute[74190]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)
Oct 18 11:43:41 user nova-compute[74190]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99028d44-32f8-4fc1-97fe-595cdcc4f0b5 (non-flash)
Oct 18 11:43:41 user nova-compute[74190]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6243f09d-1778-4f76-beae-8baceac3112f (non-flash)
Oct 18 11:43:41 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:43:41 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c585296-c9a9-4c7f-8757-618a59bd01d8 -p 172.16.0.220:3260 --login {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:41 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c585296-c9a9-4c7f-8757-618a59bd01d8 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:41 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef094238-5a2c-4b10-ba1f-dae328254774]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8c585296-c9a9-4c7f-8757-618a59bd01d8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8c585296-c9a9-4c7f-8757-618a59bd01d8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:41 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b542329-cdd9-4435-a10e-2a36e5cf03e7 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8c585296-c9a9-4c7f-8757-618a59bd01d8, portal: 172.16.0.220,3260]
Oct 18 11:43:41 user nova-compute[74190]: Login to [iface: default, target: iqn.2010-10.org.openstack:8c585296-c9a9-4c7f-8757-618a59bd01d8, portal: 172.16.0.220,3260] successful.
Oct 18 11:43:41 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:43:41 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-3896622c-a938-4973-b7c9-4b0d24ee4c3c tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Lock "c6130edd-eb98-491e-a0ba-6bd59199d9e1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 28.120s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:43:41 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c585296-c9a9-4c7f-8757-618a59bd01d8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:41 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c585296-c9a9-4c7f-8757-618a59bd01d8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:41 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e21d99-63e4-4bfa-bc94-95c0cdf427c2]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:41 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b542329-cdd9-4435-a10e-2a36e5cf03e7 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:43:41 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:41 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:41 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2ad3018-c060-44d5-b1c7-876a9402076c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99028d44-32f8-4fc1-97fe-595cdcc4f0b5 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6243f09d-1778-4f76-beae-8baceac3112f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c585296-c9a9-4c7f-8757-618a59bd01d8 (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:41 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b542329-cdd9-4435-a10e-2a36e5cf03e7 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)
Oct 18 11:43:41 user nova-compute[74190]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)
Oct 18 11:43:41 user nova-compute[74190]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)
Oct 18 11:43:41 user nova-compute[74190]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99028d44-32f8-4fc1-97fe-595cdcc4f0b5 (non-flash)
Oct 18 11:43:41 user nova-compute[74190]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6243f09d-1778-4f76-beae-8baceac3112f (non-flash)
Oct 18 11:43:41 user nova-compute[74190]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c585296-c9a9-4c7f-8757-618a59bd01d8 (non-flash)
Oct 18 11:43:41 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:43:41 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b542329-cdd9-4435-a10e-2a36e5cf03e7 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)
Oct 18 11:43:41 user nova-compute[74190]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)
Oct 18 11:43:41 user nova-compute[74190]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)
Oct 18 11:43:41 user nova-compute[74190]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99028d44-32f8-4fc1-97fe-595cdcc4f0b5 (non-flash)
Oct 18 11:43:41 user nova-compute[74190]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6243f09d-1778-4f76-beae-8baceac3112f (non-flash)
Oct 18 11:43:41 user nova-compute[74190]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c585296-c9a9-4c7f-8757-618a59bd01d8 (non-flash)
Oct 18 11:43:41 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:43:41 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-5b542329-cdd9-4435-a10e-2a36e5cf03e7 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c585296-c9a9-4c7f-8757-618a59bd01d8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.341s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:43:41 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b542329-cdd9-4435-a10e-2a36e5cf03e7 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Connected to 172.16.0.220:3260 {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 11:43:41 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-5b542329-cdd9-4435-a10e-2a36e5cf03e7 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=74190) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 11:43:41 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-5b542329-cdd9-4435-a10e-2a36e5cf03e7 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74190) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 11:43:41 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:41 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:41 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[2727dd1a-a317-4e90-8603-208bab1560db]: (4, ('- - 0', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:41 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-5b542329-cdd9-4435-a10e-2a36e5cf03e7 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74190) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 11:43:41 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b542329-cdd9-4435-a10e-2a36e5cf03e7 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:8c585296-c9a9-4c7f-8757-618a59bd01d8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QDhaZvqp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 11:43:42 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-f5210f97-2b7b-437c-843d-648847baaf22 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Lock "6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 28.387s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:43:42 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-5b542329-cdd9-4435-a10e-2a36e5cf03e7 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.391s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:43:42 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b542329-cdd9-4435-a10e-2a36e5cf03e7 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] <== connect_volume: return (1393ms) {'type': 'block', 'scsi_wwn': '23063323033356639', 'path': '/dev/sdg'} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:43:42 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b542329-cdd9-4435-a10e-2a36e5cf03e7 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] [instance: 034398e8-e8c4-4e03-a608-440e447c6041] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23063323033356639', 'path': '/dev/sdg'} {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 11:43:42 user nova-compute[74190]: DEBUG nova.objects.instance [None req-5b542329-cdd9-4435-a10e-2a36e5cf03e7 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Lazy-loading 'flavor' on Instance uuid 034398e8-e8c4-4e03-a608-440e447c6041 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:43:42 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-5b542329-cdd9-4435-a10e-2a36e5cf03e7 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] attach device xml: <disk type="block" device="disk">
Oct 18 11:43:42 user nova-compute[74190]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 11:43:42 user nova-compute[74190]:   <source dev="/dev/sdg"/>
Oct 18 11:43:42 user nova-compute[74190]:   <target dev="vdb" bus="virtio"/>
Oct 18 11:43:42 user nova-compute[74190]:   <serial>8c585296-c9a9-4c7f-8757-618a59bd01d8</serial>
Oct 18 11:43:42 user nova-compute[74190]: </disk>
Oct 18 11:43:42 user nova-compute[74190]:  {{(pid=74190) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 18 11:43:43 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-5b542329-cdd9-4435-a10e-2a36e5cf03e7 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] No BDM found with device name vda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 11:43:43 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-5b542329-cdd9-4435-a10e-2a36e5cf03e7 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 11:43:43 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-5b542329-cdd9-4435-a10e-2a36e5cf03e7 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] No VIF found with MAC fa:16:3e:42:84:1e, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 11:43:43 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-5b542329-cdd9-4435-a10e-2a36e5cf03e7 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Lock "034398e8-e8c4-4e03-a608-440e447c6041" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.655s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:43:43 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-e549ca55-9349-4caa-9ef3-f426ffd22595 tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Acquiring lock "c6130edd-eb98-491e-a0ba-6bd59199d9e1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:43:43 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-e549ca55-9349-4caa-9ef3-f426ffd22595 tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Lock "c6130edd-eb98-491e-a0ba-6bd59199d9e1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:43:43 user nova-compute[74190]: INFO nova.compute.manager [None req-e549ca55-9349-4caa-9ef3-f426ffd22595 tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] [instance: c6130edd-eb98-491e-a0ba-6bd59199d9e1] Detaching volume 99028d44-32f8-4fc1-97fe-595cdcc4f0b5
Oct 18 11:43:43 user nova-compute[74190]: INFO nova.virt.block_device [None req-e549ca55-9349-4caa-9ef3-f426ffd22595 tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] [instance: c6130edd-eb98-491e-a0ba-6bd59199d9e1] Attempting to driver detach volume 99028d44-32f8-4fc1-97fe-595cdcc4f0b5 from mountpoint /dev/vdb
Oct 18 11:43:43 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-e549ca55-9349-4caa-9ef3-f426ffd22595 tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Attempting to detach device vdb from instance c6130edd-eb98-491e-a0ba-6bd59199d9e1 from the persistent domain config. {{(pid=74190) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 18 11:43:43 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-e549ca55-9349-4caa-9ef3-f426ffd22595 tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 11:43:43 user nova-compute[74190]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 11:43:43 user nova-compute[74190]:   <source dev="/dev/sde"/>
Oct 18 11:43:43 user nova-compute[74190]:   <target dev="vdb" bus="virtio"/>
Oct 18 11:43:43 user nova-compute[74190]:   <serial>99028d44-32f8-4fc1-97fe-595cdcc4f0b5</serial>
Oct 18 11:43:43 user nova-compute[74190]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 18 11:43:43 user nova-compute[74190]: </disk>
Oct 18 11:43:43 user nova-compute[74190]:  {{(pid=74190) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 11:43:43 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-e549ca55-9349-4caa-9ef3-f426ffd22595 tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Successfully detached device vdb from instance c6130edd-eb98-491e-a0ba-6bd59199d9e1 from the persistent domain config.
Oct 18 11:43:43 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-e549ca55-9349-4caa-9ef3-f426ffd22595 tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c6130edd-eb98-491e-a0ba-6bd59199d9e1 from the live domain config. {{(pid=74190) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 18 11:43:43 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-e549ca55-9349-4caa-9ef3-f426ffd22595 tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 11:43:43 user nova-compute[74190]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 11:43:43 user nova-compute[74190]:   <source dev="/dev/sde"/>
Oct 18 11:43:43 user nova-compute[74190]:   <target dev="vdb" bus="virtio"/>
Oct 18 11:43:43 user nova-compute[74190]:   <serial>99028d44-32f8-4fc1-97fe-595cdcc4f0b5</serial>
Oct 18 11:43:43 user nova-compute[74190]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 18 11:43:43 user nova-compute[74190]: </disk>
Oct 18 11:43:43 user nova-compute[74190]:  {{(pid=74190) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 11:43:43 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-36abc8b5-d839-473e-8435-e68bf67bdf14 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Acquiring lock "6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:43:43 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-36abc8b5-d839-473e-8435-e68bf67bdf14 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Lock "6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:43:43 user nova-compute[74190]: INFO nova.compute.manager [None req-36abc8b5-d839-473e-8435-e68bf67bdf14 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] Detaching volume 6243f09d-1778-4f76-beae-8baceac3112f
Oct 18 11:43:43 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:43:44 user nova-compute[74190]: INFO nova.virt.block_device [None req-36abc8b5-d839-473e-8435-e68bf67bdf14 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] Attempting to driver detach volume 6243f09d-1778-4f76-beae-8baceac3112f from mountpoint /dev/vdb
Oct 18 11:43:44 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-36abc8b5-d839-473e-8435-e68bf67bdf14 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Attempting to detach device vdb from instance 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef from the persistent domain config. {{(pid=74190) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 18 11:43:44 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-36abc8b5-d839-473e-8435-e68bf67bdf14 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 11:43:44 user nova-compute[74190]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 11:43:44 user nova-compute[74190]:   <source dev="/dev/sdf"/>
Oct 18 11:43:44 user nova-compute[74190]:   <target dev="vdb" bus="virtio"/>
Oct 18 11:43:44 user nova-compute[74190]:   <serial>6243f09d-1778-4f76-beae-8baceac3112f</serial>
Oct 18 11:43:44 user nova-compute[74190]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 18 11:43:44 user nova-compute[74190]: </disk>
Oct 18 11:43:44 user nova-compute[74190]:  {{(pid=74190) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 11:43:44 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-36abc8b5-d839-473e-8435-e68bf67bdf14 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Successfully detached device vdb from instance 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef from the persistent domain config.
Oct 18 11:43:44 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-36abc8b5-d839-473e-8435-e68bf67bdf14 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef from the live domain config. {{(pid=74190) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 18 11:43:44 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-36abc8b5-d839-473e-8435-e68bf67bdf14 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 11:43:44 user nova-compute[74190]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 11:43:44 user nova-compute[74190]:   <source dev="/dev/sdf"/>
Oct 18 11:43:44 user nova-compute[74190]:   <target dev="vdb" bus="virtio"/>
Oct 18 11:43:44 user nova-compute[74190]:   <serial>6243f09d-1778-4f76-beae-8baceac3112f</serial>
Oct 18 11:43:44 user nova-compute[74190]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 18 11:43:44 user nova-compute[74190]: </disk>
Oct 18 11:43:44 user nova-compute[74190]:  {{(pid=74190) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 11:43:44 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-e549ca55-9349-4caa-9ef3-f426ffd22595 tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c6130edd-eb98-491e-a0ba-6bd59199d9e1 {{(pid=74190) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 18 11:43:44 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:43:44 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-36abc8b5-d839-473e-8435-e68bf67bdf14 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef {{(pid=74190) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 18 11:43:45 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-7a461f47-dc20-4e0f-adea-7cd9285428d6 tempest-TestVolumeSwap-670055737 tempest-TestVolumeSwap-670055737-project-admin] Acquiring lock "034398e8-e8c4-4e03-a608-440e447c6041" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:43:45 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-7a461f47-dc20-4e0f-adea-7cd9285428d6 tempest-TestVolumeSwap-670055737 tempest-TestVolumeSwap-670055737-project-admin] Lock "034398e8-e8c4-4e03-a608-440e447c6041" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:43:45 user nova-compute[74190]: DEBUG os_brick.utils [None req-7a461f47-dc20-4e0f-adea-7cd9285428d6 tempest-TestVolumeSwap-670055737 tempest-TestVolumeSwap-670055737-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:43:45 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:45 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:45 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[565c9644-457e-4dcb-9969-9d6dc1fcdff5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cff158e257e1\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:45 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:45 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:45 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb058fc-1ab8-4ae5-896b-9a85dbaa3561]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:45 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:45 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:45 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd524fa-f8ca-405e-a6f3-9202030a76a7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:45 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[b23d4aab-33ec-4b43-880d-94a597eb85a5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:45 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-7a461f47-dc20-4e0f-adea-7cd9285428d6 tempest-TestVolumeSwap-670055737 tempest-TestVolumeSwap-670055737-project-admin] Running cmd (subprocess): nvme version {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:45 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-7a461f47-dc20-4e0f-adea-7cd9285428d6 tempest-TestVolumeSwap-670055737 tempest-TestVolumeSwap-670055737-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 11:43:45 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7a461f47-dc20-4e0f-adea-7cd9285428d6 tempest-TestVolumeSwap-670055737 tempest-TestVolumeSwap-670055737-project-admin] nvme not present on system {{(pid=74190) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 11:43:45 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:45 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 11:43:45 user nova-compute[74190]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 11:43:45 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[9064a1ce-c819-47de-96cc-f74094ed67bb]: (4, '') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:45 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-7a461f47-dc20-4e0f-adea-7cd9285428d6 tempest-TestVolumeSwap-670055737 tempest-TestVolumeSwap-670055737-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74190) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 11:43:45 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-7a461f47-dc20-4e0f-adea-7cd9285428d6 tempest-TestVolumeSwap-670055737 tempest-TestVolumeSwap-670055737-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 11:43:45 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-7a461f47-dc20-4e0f-adea-7cd9285428d6 tempest-TestVolumeSwap-670055737 tempest-TestVolumeSwap-670055737-project-admin] LIGHTOS: no hostnqn found. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 11:43:45 user nova-compute[74190]: DEBUG os_brick.utils [None req-7a461f47-dc20-4e0f-adea-7cd9285428d6 tempest-TestVolumeSwap-670055737 tempest-TestVolumeSwap-670055737-project-admin] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cff158e257e1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:43:45 user nova-compute[74190]: INFO nova.compute.manager [None req-7a461f47-dc20-4e0f-adea-7cd9285428d6 tempest-TestVolumeSwap-670055737 tempest-TestVolumeSwap-670055737-project-admin] [instance: 034398e8-e8c4-4e03-a608-440e447c6041] Swapping volume 8c585296-c9a9-4c7f-8757-618a59bd01d8 for d7b43003-2d4b-49b0-8449-6fb2ee281920
Oct 18 11:43:48 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:43:48 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:43:48 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:43:48 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:43:48 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:43:48 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Auditing locally available compute resources for user (node: user) {{(pid=74190) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 11:43:48 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034398e8-e8c4-4e03-a608-440e447c6041/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:48 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034398e8-e8c4-4e03-a608-440e447c6041/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:48 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034398e8-e8c4-4e03-a608-440e447c6041/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:48 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034398e8-e8c4-4e03-a608-440e447c6041/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:48 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 11:43:48 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/697d3123-bd6b-42b9-b278-c33c0c00da6f/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:48 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/697d3123-bd6b-42b9-b278-c33c0c00da6f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:48 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/697d3123-bd6b-42b9-b278-c33c0c00da6f/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:43:49 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/697d3123-bd6b-42b9-b278-c33c0c00da6f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:49 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0209c824-88a7-4976-83bf-8a72437f0cc2/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:49 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0209c824-88a7-4976-83bf-8a72437f0cc2/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:49 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0209c824-88a7-4976-83bf-8a72437f0cc2/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:49 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:43:49 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0209c824-88a7-4976-83bf-8a72437f0cc2/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:49 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d56b243d-fbf2-4ae6-8399-80df46b33b82/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:49 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d56b243d-fbf2-4ae6-8399-80df46b33b82/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:49 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d56b243d-fbf2-4ae6-8399-80df46b33b82/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:49 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d56b243d-fbf2-4ae6-8399-80df46b33b82/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:49 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 11:43:49 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6130edd-eb98-491e-a0ba-6bd59199d9e1/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6130edd-eb98-491e-a0ba-6bd59199d9e1/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6130edd-eb98-491e-a0ba-6bd59199d9e1/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6130edd-eb98-491e-a0ba-6bd59199d9e1/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c280652c-ffde-40f8-a919-adb8be618db8/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c280652c-ffde-40f8-a919-adb8be618db8/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c280652c-ffde-40f8-a919-adb8be618db8/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c280652c-ffde-40f8-a919-adb8be618db8/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:50 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 11:43:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:51 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:51 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 11:43:51 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:43:51 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:43:51 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Hypervisor/Node resource view: name=user free_ram=7599MB free_disk=25.646312713623047GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74190) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 11:43:51 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:43:51 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:43:51 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance c280652c-ffde-40f8-a919-adb8be618db8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:43:51 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 0209c824-88a7-4976-83bf-8a72437f0cc2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:43:51 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance c6130edd-eb98-491e-a0ba-6bd59199d9e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:43:51 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:43:51 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance d56b243d-fbf2-4ae6-8399-80df46b33b82 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:43:51 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 034398e8-e8c4-4e03-a608-440e447c6041 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:43:51 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 697d3123-bd6b-42b9-b278-c33c0c00da6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:43:51 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance aabb5eea-8366-482a-8d16-bf271c0fe8d7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:43:51 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 3bd2f6d6-9c07-42a0-869e-566d685cb025 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:43:51 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 11:43:51 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 11:43:52 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 11:43:52 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 11:43:52 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Compute_service record updated for user:user {{(pid=74190) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 11:43:52 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.505s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:43:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0edda291-7d8e-4665-b207-ac0ad80eec69 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] [instance: d56b243d-fbf2-4ae6-8399-80df46b33b82] Calling os-brick to attach iSCSI Volume {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 11:43:52 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-0edda291-7d8e-4665-b207-ac0ad80eec69 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e8097d82-d1b3-459d-8331-682cbe592d49', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MCHISnEL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:43:52 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-0edda291-7d8e-4665-b207-ac0ad80eec69 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:43:52 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-0edda291-7d8e-4665-b207-ac0ad80eec69 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:43:52 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-0edda291-7d8e-4665-b207-ac0ad80eec69 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:43:52 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-0edda291-7d8e-4665-b207-ac0ad80eec69 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:43:52 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-0edda291-7d8e-4665-b207-ac0ad80eec69 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8097d82-d1b3-459d-8331-682cbe592d49" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:43:52 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-0edda291-7d8e-4665-b207-ac0ad80eec69 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8097d82-d1b3-459d-8331-682cbe592d49" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:43:52 user nova-compute[74190]: INFO os_brick.initiator.connectors.iscsi [None req-0edda291-7d8e-4665-b207-ac0ad80eec69 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 11:43:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8097d82-d1b3-459d-8331-682cbe592d49 -p 172.16.0.220:3260 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8097d82-d1b3-459d-8331-682cbe592d49 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:52 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b5e0716-fa9a-4447-a203-6178cbbf9c0f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:52 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-0edda291-7d8e-4665-b207-ac0ad80eec69 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 11:43:52 user nova-compute[74190]:  {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:43:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8097d82-d1b3-459d-8331-682cbe592d49 -p 172.16.0.220:3260 --interface default --op new {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8097d82-d1b3-459d-8331-682cbe592d49 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:52 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad2773f0-e8e8-4534-a356-1a2e4c2588a3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e8097d82-d1b3-459d-8331-682cbe592d49] added\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:52 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-0edda291-7d8e-4665-b207-ac0ad80eec69 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e8097d82-d1b3-459d-8331-682cbe592d49] added
Oct 18 11:43:52 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:43:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8097d82-d1b3-459d-8331-682cbe592d49 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8097d82-d1b3-459d-8331-682cbe592d49 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:52 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[89387c10-c0d1-41e1-9ce9-4b9bb9d9e8dc]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:52 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-0edda291-7d8e-4665-b207-ac0ad80eec69 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:43:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8097d82-d1b3-459d-8331-682cbe592d49 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8097d82-d1b3-459d-8331-682cbe592d49 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:52 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[0479e656-0525-4c17-8657-8db0cb6eef27]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:52 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-0edda291-7d8e-4665-b207-ac0ad80eec69 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:43:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8097d82-d1b3-459d-8331-682cbe592d49 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MCHISnEL {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8097d82-d1b3-459d-8331-682cbe592d49 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MCHISnEL" returned: 0 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:52 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[18879213-6fce-45dd-bf5e-101875c20047]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:52 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-0edda291-7d8e-4665-b207-ac0ad80eec69 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MCHISnEL'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:43:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8097d82-d1b3-459d-8331-682cbe592d49 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8097d82-d1b3-459d-8331-682cbe592d49 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:52 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[eadebe72-b61d-485c-8376-0eb373fecf8a]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:52 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-0edda291-7d8e-4665-b207-ac0ad80eec69 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:43:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:52 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a4b9d9-8ee7-495f-8997-90790163307b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99028d44-32f8-4fc1-97fe-595cdcc4f0b5 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6243f09d-1778-4f76-beae-8baceac3112f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c585296-c9a9-4c7f-8757-618a59bd01d8 (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:52 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-0edda291-7d8e-4665-b207-ac0ad80eec69 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)
Oct 18 11:43:52 user nova-compute[74190]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)
Oct 18 11:43:52 user nova-compute[74190]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)
Oct 18 11:43:52 user nova-compute[74190]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99028d44-32f8-4fc1-97fe-595cdcc4f0b5 (non-flash)
Oct 18 11:43:52 user nova-compute[74190]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6243f09d-1778-4f76-beae-8baceac3112f (non-flash)
Oct 18 11:43:52 user nova-compute[74190]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c585296-c9a9-4c7f-8757-618a59bd01d8 (non-flash)
Oct 18 11:43:52 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:43:52 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-0edda291-7d8e-4665-b207-ac0ad80eec69 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)
Oct 18 11:43:52 user nova-compute[74190]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)
Oct 18 11:43:52 user nova-compute[74190]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)
Oct 18 11:43:52 user nova-compute[74190]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99028d44-32f8-4fc1-97fe-595cdcc4f0b5 (non-flash)
Oct 18 11:43:52 user nova-compute[74190]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6243f09d-1778-4f76-beae-8baceac3112f (non-flash)
Oct 18 11:43:52 user nova-compute[74190]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c585296-c9a9-4c7f-8757-618a59bd01d8 (non-flash)
Oct 18 11:43:52 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:43:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8097d82-d1b3-459d-8331-682cbe592d49 -p 172.16.0.220:3260 --login {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8097d82-d1b3-459d-8331-682cbe592d49 -p 172.16.0.220:3260 --login" returned: 0 in 0.094s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:52 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4a3a45-455e-485f-b52b-e6970b0adde1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e8097d82-d1b3-459d-8331-682cbe592d49, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e8097d82-d1b3-459d-8331-682cbe592d49, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:52 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-0edda291-7d8e-4665-b207-ac0ad80eec69 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e8097d82-d1b3-459d-8331-682cbe592d49, portal: 172.16.0.220,3260]
Oct 18 11:43:52 user nova-compute[74190]: Login to [iface: default, target: iqn.2010-10.org.openstack:e8097d82-d1b3-459d-8331-682cbe592d49, portal: 172.16.0.220,3260] successful.
Oct 18 11:43:52 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:43:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8097d82-d1b3-459d-8331-682cbe592d49 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8097d82-d1b3-459d-8331-682cbe592d49 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:52 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb99697-d975-4e20-8509-fc42e7e5fcd1]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:52 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-0edda291-7d8e-4665-b207-ac0ad80eec69 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:43:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:52 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff65360-99ed-47f7-815f-1314765cc297]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99028d44-32f8-4fc1-97fe-595cdcc4f0b5 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6243f09d-1778-4f76-beae-8baceac3112f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c585296-c9a9-4c7f-8757-618a59bd01d8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8097d82-d1b3-459d-8331-682cbe592d49 (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:52 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-0edda291-7d8e-4665-b207-ac0ad80eec69 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)
Oct 18 11:43:52 user nova-compute[74190]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)
Oct 18 11:43:52 user nova-compute[74190]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)
Oct 18 11:43:52 user nova-compute[74190]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99028d44-32f8-4fc1-97fe-595cdcc4f0b5 (non-flash)
Oct 18 11:43:52 user nova-compute[74190]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6243f09d-1778-4f76-beae-8baceac3112f (non-flash)
Oct 18 11:43:52 user nova-compute[74190]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c585296-c9a9-4c7f-8757-618a59bd01d8 (non-flash)
Oct 18 11:43:52 user nova-compute[74190]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8097d82-d1b3-459d-8331-682cbe592d49 (non-flash)
Oct 18 11:43:52 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:43:52 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-0edda291-7d8e-4665-b207-ac0ad80eec69 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)
Oct 18 11:43:52 user nova-compute[74190]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)
Oct 18 11:43:52 user nova-compute[74190]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)
Oct 18 11:43:52 user nova-compute[74190]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99028d44-32f8-4fc1-97fe-595cdcc4f0b5 (non-flash)
Oct 18 11:43:52 user nova-compute[74190]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6243f09d-1778-4f76-beae-8baceac3112f (non-flash)
Oct 18 11:43:52 user nova-compute[74190]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c585296-c9a9-4c7f-8757-618a59bd01d8 (non-flash)
Oct 18 11:43:52 user nova-compute[74190]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8097d82-d1b3-459d-8331-682cbe592d49 (non-flash)
Oct 18 11:43:52 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:43:52 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-0edda291-7d8e-4665-b207-ac0ad80eec69 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8097d82-d1b3-459d-8331-682cbe592d49" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.336s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:43:52 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-0edda291-7d8e-4665-b207-ac0ad80eec69 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Connected to 172.16.0.220:3260 {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 11:43:52 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-0edda291-7d8e-4665-b207-ac0ad80eec69 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] HCTL ('39', '-', '-', 0) found on session 8 with lun 0 {{(pid=74190) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 11:43:52 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-0edda291-7d8e-4665-b207-ac0ad80eec69 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74190) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 11:43:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:52 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba497f6e-9975-451b-828c-882b4644ba40]: (4, ('- - 0', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:52 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-0edda291-7d8e-4665-b207-ac0ad80eec69 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74190) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 11:43:52 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-0edda291-7d8e-4665-b207-ac0ad80eec69 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:e8097d82-d1b3-459d-8331-682cbe592d49', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MCHISnEL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 11:43:53 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1dfdff28-9089-4596-a417-7a1baa9b18f4 tempest-VolumesAssistedSnapshotsTest-63445179 tempest-VolumesAssistedSnapshotsTest-63445179-project-admin] [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f] Calling os-brick to attach iSCSI Volume {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 11:43:53 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dfdff28-9089-4596-a417-7a1baa9b18f4 tempest-VolumesAssistedSnapshotsTest-63445179 tempest-VolumesAssistedSnapshotsTest-63445179-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3e1907e5-89a1-4792-a656-59422463e8a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eNvYHWLc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:43:53 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-1dfdff28-9089-4596-a417-7a1baa9b18f4 tempest-VolumesAssistedSnapshotsTest-63445179 tempest-VolumesAssistedSnapshotsTest-63445179-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:43:53 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-1dfdff28-9089-4596-a417-7a1baa9b18f4 tempest-VolumesAssistedSnapshotsTest-63445179 tempest-VolumesAssistedSnapshotsTest-63445179-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:43:53 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:43:53 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-0edda291-7d8e-4665-b207-ac0ad80eec69 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.376s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:43:53 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-0edda291-7d8e-4665-b207-ac0ad80eec69 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] <== connect_volume: return (1377ms) {'type': 'block', 'scsi_wwn': '23464363532336231', 'path': '/dev/sdh'} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:43:53 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0edda291-7d8e-4665-b207-ac0ad80eec69 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] [instance: d56b243d-fbf2-4ae6-8399-80df46b33b82] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23464363532336231', 'path': '/dev/sdh'} {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 11:43:53 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-1dfdff28-9089-4596-a417-7a1baa9b18f4 tempest-VolumesAssistedSnapshotsTest-63445179 tempest-VolumesAssistedSnapshotsTest-63445179-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.235s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:43:53 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-1dfdff28-9089-4596-a417-7a1baa9b18f4 tempest-VolumesAssistedSnapshotsTest-63445179 tempest-VolumesAssistedSnapshotsTest-63445179-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:43:53 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-1dfdff28-9089-4596-a417-7a1baa9b18f4 tempest-VolumesAssistedSnapshotsTest-63445179 tempest-VolumesAssistedSnapshotsTest-63445179-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e1907e5-89a1-4792-a656-59422463e8a1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:43:53 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-1dfdff28-9089-4596-a417-7a1baa9b18f4 tempest-VolumesAssistedSnapshotsTest-63445179 tempest-VolumesAssistedSnapshotsTest-63445179-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e1907e5-89a1-4792-a656-59422463e8a1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:43:53 user nova-compute[74190]: INFO os_brick.initiator.connectors.iscsi [None req-1dfdff28-9089-4596-a417-7a1baa9b18f4 tempest-VolumesAssistedSnapshotsTest-63445179 tempest-VolumesAssistedSnapshotsTest-63445179-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 11:43:53 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e1907e5-89a1-4792-a656-59422463e8a1 -p 172.16.0.220:3260 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:54 user nova-compute[74190]: DEBUG nova.objects.instance [None req-0edda291-7d8e-4665-b207-ac0ad80eec69 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Lazy-loading 'flavor' on Instance uuid d56b243d-fbf2-4ae6-8399-80df46b33b82 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:43:54 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e1907e5-89a1-4792-a656-59422463e8a1 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:54 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da64cfa-3c3d-446d-803d-f5990286bbe2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:54 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dfdff28-9089-4596-a417-7a1baa9b18f4 tempest-VolumesAssistedSnapshotsTest-63445179 tempest-VolumesAssistedSnapshotsTest-63445179-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 11:43:54 user nova-compute[74190]:  {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:43:54 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e1907e5-89a1-4792-a656-59422463e8a1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:54 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-0edda291-7d8e-4665-b207-ac0ad80eec69 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] attach device xml: <disk type="block" device="disk">
Oct 18 11:43:54 user nova-compute[74190]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 11:43:54 user nova-compute[74190]:   <source dev="/dev/sdh"/>
Oct 18 11:43:54 user nova-compute[74190]:   <target dev="sdc" bus="scsi"/>
Oct 18 11:43:54 user nova-compute[74190]:   <serial>e8097d82-d1b3-459d-8331-682cbe592d49</serial>
Oct 18 11:43:54 user nova-compute[74190]:   <address type="drive" controller="0" unit="2"/>
Oct 18 11:43:54 user nova-compute[74190]: </disk>
Oct 18 11:43:54 user nova-compute[74190]:  {{(pid=74190) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 18 11:43:54 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e1907e5-89a1-4792-a656-59422463e8a1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:54 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[922a47c8-6725-4e7c-97ab-fa940d1a7db3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3e1907e5-89a1-4792-a656-59422463e8a1] added\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:54 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dfdff28-9089-4596-a417-7a1baa9b18f4 tempest-VolumesAssistedSnapshotsTest-63445179 tempest-VolumesAssistedSnapshotsTest-63445179-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3e1907e5-89a1-4792-a656-59422463e8a1] added
Oct 18 11:43:54 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:43:54 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e1907e5-89a1-4792-a656-59422463e8a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:54 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e1907e5-89a1-4792-a656-59422463e8a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:54 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[235c80d8-9c50-40a6-bccc-21717b9ec3a9]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:54 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dfdff28-9089-4596-a417-7a1baa9b18f4 tempest-VolumesAssistedSnapshotsTest-63445179 tempest-VolumesAssistedSnapshotsTest-63445179-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:43:54 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e1907e5-89a1-4792-a656-59422463e8a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:54 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e1907e5-89a1-4792-a656-59422463e8a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:54 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fcac224-a140-4e2b-a6b2-dd544ddcfa24]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:54 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dfdff28-9089-4596-a417-7a1baa9b18f4 tempest-VolumesAssistedSnapshotsTest-63445179 tempest-VolumesAssistedSnapshotsTest-63445179-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:43:54 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e1907e5-89a1-4792-a656-59422463e8a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eNvYHWLc {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:54 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:43:54 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:43:54 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Starting heal instance info cache {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 11:43:54 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e1907e5-89a1-4792-a656-59422463e8a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eNvYHWLc" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:54 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f1e668-7317-41f1-95dc-be83df983a04]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:54 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dfdff28-9089-4596-a417-7a1baa9b18f4 tempest-VolumesAssistedSnapshotsTest-63445179 tempest-VolumesAssistedSnapshotsTest-63445179-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eNvYHWLc'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:43:54 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e1907e5-89a1-4792-a656-59422463e8a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:54 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e1907e5-89a1-4792-a656-59422463e8a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:54 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[16189d9e-88c7-4279-917a-86d007f44c3b]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:54 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dfdff28-9089-4596-a417-7a1baa9b18f4 tempest-VolumesAssistedSnapshotsTest-63445179 tempest-VolumesAssistedSnapshotsTest-63445179-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:43:54 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:54 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:54 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[112d7241-3960-41d3-bd2b-ece36d964a2f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99028d44-32f8-4fc1-97fe-595cdcc4f0b5 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6243f09d-1778-4f76-beae-8baceac3112f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c585296-c9a9-4c7f-8757-618a59bd01d8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8097d82-d1b3-459d-8331-682cbe592d49 (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:54 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dfdff28-9089-4596-a417-7a1baa9b18f4 tempest-VolumesAssistedSnapshotsTest-63445179 tempest-VolumesAssistedSnapshotsTest-63445179-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)
Oct 18 11:43:54 user nova-compute[74190]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)
Oct 18 11:43:54 user nova-compute[74190]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)
Oct 18 11:43:54 user nova-compute[74190]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99028d44-32f8-4fc1-97fe-595cdcc4f0b5 (non-flash)
Oct 18 11:43:54 user nova-compute[74190]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6243f09d-1778-4f76-beae-8baceac3112f (non-flash)
Oct 18 11:43:54 user nova-compute[74190]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c585296-c9a9-4c7f-8757-618a59bd01d8 (non-flash)
Oct 18 11:43:54 user nova-compute[74190]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8097d82-d1b3-459d-8331-682cbe592d49 (non-flash)
Oct 18 11:43:54 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:43:54 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dfdff28-9089-4596-a417-7a1baa9b18f4 tempest-VolumesAssistedSnapshotsTest-63445179 tempest-VolumesAssistedSnapshotsTest-63445179-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)
Oct 18 11:43:54 user nova-compute[74190]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)
Oct 18 11:43:54 user nova-compute[74190]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)
Oct 18 11:43:54 user nova-compute[74190]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99028d44-32f8-4fc1-97fe-595cdcc4f0b5 (non-flash)
Oct 18 11:43:54 user nova-compute[74190]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6243f09d-1778-4f76-beae-8baceac3112f (non-flash)
Oct 18 11:43:54 user nova-compute[74190]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c585296-c9a9-4c7f-8757-618a59bd01d8 (non-flash)
Oct 18 11:43:54 user nova-compute[74190]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8097d82-d1b3-459d-8331-682cbe592d49 (non-flash)
Oct 18 11:43:54 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:43:54 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e1907e5-89a1-4792-a656-59422463e8a1 -p 172.16.0.220:3260 --login {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:54 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "refresh_cache-0209c824-88a7-4976-83bf-8a72437f0cc2" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:43:54 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquired lock "refresh_cache-0209c824-88a7-4976-83bf-8a72437f0cc2" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:43:54 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] Forcefully refreshing network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 18 11:43:54 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e1907e5-89a1-4792-a656-59422463e8a1 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:54 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e16edbb-8f18-4805-bf32-9da8ab717101]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3e1907e5-89a1-4792-a656-59422463e8a1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3e1907e5-89a1-4792-a656-59422463e8a1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:54 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dfdff28-9089-4596-a417-7a1baa9b18f4 tempest-VolumesAssistedSnapshotsTest-63445179 tempest-VolumesAssistedSnapshotsTest-63445179-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3e1907e5-89a1-4792-a656-59422463e8a1, portal: 172.16.0.220,3260]
Oct 18 11:43:54 user nova-compute[74190]: Login to [iface: default, target: iqn.2010-10.org.openstack:3e1907e5-89a1-4792-a656-59422463e8a1, portal: 172.16.0.220,3260] successful.
Oct 18 11:43:54 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:43:54 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e1907e5-89a1-4792-a656-59422463e8a1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:54 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e1907e5-89a1-4792-a656-59422463e8a1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:54 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[746f2356-2c51-4cf4-ae12-d0c68bc86b18]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:54 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dfdff28-9089-4596-a417-7a1baa9b18f4 tempest-VolumesAssistedSnapshotsTest-63445179 tempest-VolumesAssistedSnapshotsTest-63445179-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:43:54 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:54 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:54 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[135882c1-428e-470c-bcc8-d536bd830ccb]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99028d44-32f8-4fc1-97fe-595cdcc4f0b5 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6243f09d-1778-4f76-beae-8baceac3112f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c585296-c9a9-4c7f-8757-618a59bd01d8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8097d82-d1b3-459d-8331-682cbe592d49 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e1907e5-89a1-4792-a656-59422463e8a1 (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:54 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dfdff28-9089-4596-a417-7a1baa9b18f4 tempest-VolumesAssistedSnapshotsTest-63445179 tempest-VolumesAssistedSnapshotsTest-63445179-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)
Oct 18 11:43:54 user nova-compute[74190]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)
Oct 18 11:43:54 user nova-compute[74190]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)
Oct 18 11:43:54 user nova-compute[74190]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99028d44-32f8-4fc1-97fe-595cdcc4f0b5 (non-flash)
Oct 18 11:43:54 user nova-compute[74190]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6243f09d-1778-4f76-beae-8baceac3112f (non-flash)
Oct 18 11:43:54 user nova-compute[74190]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c585296-c9a9-4c7f-8757-618a59bd01d8 (non-flash)
Oct 18 11:43:54 user nova-compute[74190]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8097d82-d1b3-459d-8331-682cbe592d49 (non-flash)
Oct 18 11:43:54 user nova-compute[74190]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e1907e5-89a1-4792-a656-59422463e8a1 (non-flash)
Oct 18 11:43:54 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:43:54 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dfdff28-9089-4596-a417-7a1baa9b18f4 tempest-VolumesAssistedSnapshotsTest-63445179 tempest-VolumesAssistedSnapshotsTest-63445179-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)
Oct 18 11:43:54 user nova-compute[74190]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)
Oct 18 11:43:54 user nova-compute[74190]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)
Oct 18 11:43:54 user nova-compute[74190]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99028d44-32f8-4fc1-97fe-595cdcc4f0b5 (non-flash)
Oct 18 11:43:54 user nova-compute[74190]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6243f09d-1778-4f76-beae-8baceac3112f (non-flash)
Oct 18 11:43:54 user nova-compute[74190]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c585296-c9a9-4c7f-8757-618a59bd01d8 (non-flash)
Oct 18 11:43:54 user nova-compute[74190]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8097d82-d1b3-459d-8331-682cbe592d49 (non-flash)
Oct 18 11:43:54 user nova-compute[74190]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e1907e5-89a1-4792-a656-59422463e8a1 (non-flash)
Oct 18 11:43:54 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:43:54 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-1dfdff28-9089-4596-a417-7a1baa9b18f4 tempest-VolumesAssistedSnapshotsTest-63445179 tempest-VolumesAssistedSnapshotsTest-63445179-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e1907e5-89a1-4792-a656-59422463e8a1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:43:54 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dfdff28-9089-4596-a417-7a1baa9b18f4 tempest-VolumesAssistedSnapshotsTest-63445179 tempest-VolumesAssistedSnapshotsTest-63445179-project-admin] Connected to 172.16.0.220:3260 {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 11:43:54 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-1dfdff28-9089-4596-a417-7a1baa9b18f4 tempest-VolumesAssistedSnapshotsTest-63445179 tempest-VolumesAssistedSnapshotsTest-63445179-project-admin] HCTL ('40', '-', '-', 0) found on session 9 with lun 0 {{(pid=74190) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 11:43:54 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-1dfdff28-9089-4596-a417-7a1baa9b18f4 tempest-VolumesAssistedSnapshotsTest-63445179 tempest-VolumesAssistedSnapshotsTest-63445179-project-admin] Scanning host 40 c: -, t: -, l: 0) {{(pid=74190) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 11:43:54 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:43:54 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.016s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:43:54 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b0971c-330c-4c6b-91aa-f9afb05574dc]: (4, ('- - 0', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:43:54 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-1dfdff28-9089-4596-a417-7a1baa9b18f4 tempest-VolumesAssistedSnapshotsTest-63445179 tempest-VolumesAssistedSnapshotsTest-63445179-project-admin] Searching for a device in session 9 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=74190) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 11:43:54 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dfdff28-9089-4596-a417-7a1baa9b18f4 tempest-VolumesAssistedSnapshotsTest-63445179 tempest-VolumesAssistedSnapshotsTest-63445179-project-admin] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:3e1907e5-89a1-4792-a656-59422463e8a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eNvYHWLc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 11:43:54 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:43:54 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-0edda291-7d8e-4665-b207-ac0ad80eec69 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] No BDM found with device name sda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 11:43:54 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-0edda291-7d8e-4665-b207-ac0ad80eec69 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 11:43:54 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-0edda291-7d8e-4665-b207-ac0ad80eec69 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] No BDM found with device name sdc, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 11:43:54 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-0edda291-7d8e-4665-b207-ac0ad80eec69 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] No VIF found with MAC fa:16:3e:39:a4:ae, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 11:43:54 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] Updating instance_info_cache with network_info: [{"id": "5e4eb783-7e7c-4501-bf99-33472454f4ac", "address": "fa:16:3e:7e:d2:03", "network": {"id": "f5ab7da4-2b07-4465-9a89-a07eb053ba91", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1315695374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08cf52ce927443158aa731367f08bd57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e4eb783-7e", "ovs_interfaceid": "5e4eb783-7e7c-4501-bf99-33472454f4ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:43:54 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-0edda291-7d8e-4665-b207-ac0ad80eec69 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Lock "d56b243d-fbf2-4ae6-8399-80df46b33b82" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 32.707s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:43:54 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Releasing lock "refresh_cache-0209c824-88a7-4976-83bf-8a72437f0cc2" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:43:54 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] Updated the network info_cache for instance {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 18 11:43:54 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:43:54 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:43:54 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:43:54 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:43:54 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:43:54 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74190) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 11:43:55 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-1dfdff28-9089-4596-a417-7a1baa9b18f4 tempest-VolumesAssistedSnapshotsTest-63445179 tempest-VolumesAssistedSnapshotsTest-63445179-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.356s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:43:55 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dfdff28-9089-4596-a417-7a1baa9b18f4 tempest-VolumesAssistedSnapshotsTest-63445179 tempest-VolumesAssistedSnapshotsTest-63445179-project-admin] <== connect_volume: return (1590ms) {'type': 'block', 'scsi_wwn': '23664323433643435', 'path': '/dev/sdi'} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:43:55 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1dfdff28-9089-4596-a417-7a1baa9b18f4 tempest-VolumesAssistedSnapshotsTest-63445179 tempest-VolumesAssistedSnapshotsTest-63445179-project-admin] [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23664323433643435', 'path': '/dev/sdi'} {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 11:43:55 user nova-compute[74190]: DEBUG nova.objects.instance [None req-1dfdff28-9089-4596-a417-7a1baa9b18f4 tempest-VolumesAssistedSnapshotsTest-63445179 tempest-VolumesAssistedSnapshotsTest-63445179-project-admin] Lazy-loading 'flavor' on Instance uuid 697d3123-bd6b-42b9-b278-c33c0c00da6f {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:43:55 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-1dfdff28-9089-4596-a417-7a1baa9b18f4 tempest-VolumesAssistedSnapshotsTest-63445179 tempest-VolumesAssistedSnapshotsTest-63445179-project-admin] attach device xml: <disk type="block" device="disk">
Oct 18 11:43:55 user nova-compute[74190]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 11:43:55 user nova-compute[74190]:   <source dev="/dev/sdi"/>
Oct 18 11:43:55 user nova-compute[74190]:   <target dev="vdb" bus="virtio"/>
Oct 18 11:43:55 user nova-compute[74190]:   <serial>3e1907e5-89a1-4792-a656-59422463e8a1</serial>
Oct 18 11:43:55 user nova-compute[74190]: </disk>
Oct 18 11:43:55 user nova-compute[74190]:  {{(pid=74190) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 18 11:43:55 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-0946596a-d870-4e19-bd05-8baaef641fb7 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Acquiring lock "d56b243d-fbf2-4ae6-8399-80df46b33b82" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:43:55 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-0946596a-d870-4e19-bd05-8baaef641fb7 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Lock "d56b243d-fbf2-4ae6-8399-80df46b33b82" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:43:55 user nova-compute[74190]: INFO nova.compute.manager [None req-0946596a-d870-4e19-bd05-8baaef641fb7 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] [instance: d56b243d-fbf2-4ae6-8399-80df46b33b82] Detaching volume e8097d82-d1b3-459d-8331-682cbe592d49
Oct 18 11:43:55 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:43:55 user nova-compute[74190]: INFO nova.virt.block_device [None req-0946596a-d870-4e19-bd05-8baaef641fb7 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] [instance: d56b243d-fbf2-4ae6-8399-80df46b33b82] Attempting to driver detach volume e8097d82-d1b3-459d-8331-682cbe592d49 from mountpoint /dev/sdc
Oct 18 11:43:55 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-0946596a-d870-4e19-bd05-8baaef641fb7 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Attempting to detach device sdc from instance d56b243d-fbf2-4ae6-8399-80df46b33b82 from the persistent domain config. {{(pid=74190) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 18 11:43:55 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-0946596a-d870-4e19-bd05-8baaef641fb7 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 11:43:55 user nova-compute[74190]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 11:43:55 user nova-compute[74190]:   <source dev="/dev/sdh"/>
Oct 18 11:43:55 user nova-compute[74190]:   <target dev="sdc" bus="scsi"/>
Oct 18 11:43:55 user nova-compute[74190]:   <serial>e8097d82-d1b3-459d-8331-682cbe592d49</serial>
Oct 18 11:43:55 user nova-compute[74190]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Oct 18 11:43:55 user nova-compute[74190]: </disk>
Oct 18 11:43:55 user nova-compute[74190]:  {{(pid=74190) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 11:43:55 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-0946596a-d870-4e19-bd05-8baaef641fb7 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Successfully detached device sdc from instance d56b243d-fbf2-4ae6-8399-80df46b33b82 from the persistent domain config.
Oct 18 11:43:55 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-0946596a-d870-4e19-bd05-8baaef641fb7 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance d56b243d-fbf2-4ae6-8399-80df46b33b82 from the live domain config. {{(pid=74190) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 18 11:43:55 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-0946596a-d870-4e19-bd05-8baaef641fb7 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 11:43:55 user nova-compute[74190]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 11:43:55 user nova-compute[74190]:   <source dev="/dev/sdh"/>
Oct 18 11:43:55 user nova-compute[74190]:   <target dev="sdc" bus="scsi"/>
Oct 18 11:43:55 user nova-compute[74190]:   <serial>e8097d82-d1b3-459d-8331-682cbe592d49</serial>
Oct 18 11:43:55 user nova-compute[74190]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Oct 18 11:43:55 user nova-compute[74190]: </disk>
Oct 18 11:43:55 user nova-compute[74190]:  {{(pid=74190) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 11:43:55 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-1dfdff28-9089-4596-a417-7a1baa9b18f4 tempest-VolumesAssistedSnapshotsTest-63445179 tempest-VolumesAssistedSnapshotsTest-63445179-project-admin] No BDM found with device name vda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 11:43:55 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-1dfdff28-9089-4596-a417-7a1baa9b18f4 tempest-VolumesAssistedSnapshotsTest-63445179 tempest-VolumesAssistedSnapshotsTest-63445179-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 11:43:55 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-1dfdff28-9089-4596-a417-7a1baa9b18f4 tempest-VolumesAssistedSnapshotsTest-63445179 tempest-VolumesAssistedSnapshotsTest-63445179-project-admin] No VIF found with MAC fa:16:3e:f7:93:c2, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 11:43:55 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-1dfdff28-9089-4596-a417-7a1baa9b18f4 tempest-VolumesAssistedSnapshotsTest-63445179 tempest-VolumesAssistedSnapshotsTest-63445179-project-admin] Lock "697d3123-bd6b-42b9-b278-c33c0c00da6f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.583s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:43:56 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-0946596a-d870-4e19-bd05-8baaef641fb7 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance d56b243d-fbf2-4ae6-8399-80df46b33b82 {{(pid=74190) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 18 11:43:56 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-249521d2-0e73-4c59-9806-909430d1e591 tempest-VolumesAssistedSnapshotsTest-741933638 tempest-VolumesAssistedSnapshotsTest-741933638-project] [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f] volume_snapshot_create: create_info: {'snapshot_id': '2d1db937-f571-4e92-8c69-f6ce26d62f44', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=74190) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Oct 18 11:43:56 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-249521d2-0e73-4c59-9806-909430d1e591 tempest-VolumesAssistedSnapshotsTest-741933638 tempest-VolumesAssistedSnapshotsTest-741933638-project] [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f] snap xml: <domainsnapshot>
Oct 18 11:43:56 user nova-compute[74190]:   <disks>
Oct 18 11:43:56 user nova-compute[74190]:     <disk name="/dev/sdi" snapshot="external" type="file">
Oct 18 11:43:56 user nova-compute[74190]:       <source file="/dev/new_file"/>
Oct 18 11:43:56 user nova-compute[74190]:     </disk>
Oct 18 11:43:56 user nova-compute[74190]:     <disk name="vda" snapshot="no"/>
Oct 18 11:43:56 user nova-compute[74190]:   </disks>
Oct 18 11:43:56 user nova-compute[74190]: </domainsnapshot>
Oct 18 11:43:56 user nova-compute[74190]:  {{(pid=74190) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Oct 18 11:43:56 user nova-compute[74190]: DEBUG nova.objects.instance [None req-249521d2-0e73-4c59-9806-909430d1e591 tempest-VolumesAssistedSnapshotsTest-741933638 tempest-VolumesAssistedSnapshotsTest-741933638-project] Lazy-loading 'system_metadata' on Instance uuid 697d3123-bd6b-42b9-b278-c33c0c00da6f {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:43:56 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-249521d2-0e73-4c59-9806-909430d1e591 tempest-VolumesAssistedSnapshotsTest-741933638 tempest-VolumesAssistedSnapshotsTest-741933638-project] [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver [None req-249521d2-0e73-4c59-9806-909430d1e591 tempest-VolumesAssistedSnapshotsTest-741933638 tempest-VolumesAssistedSnapshotsTest-741933638-project] [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f] Traceback (most recent call last):
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f]     rv = execute(f, *args, **kwargs)
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f]     six.reraise(c, e, tb)
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f]     raise value
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f]     rv = meth(*args, **kwargs)
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f] 
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver [None req-249521d2-0e73-4c59-9806-909430d1e591 tempest-VolumesAssistedSnapshotsTest-741933638 tempest-VolumesAssistedSnapshotsTest-741933638-project] [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f] Traceback (most recent call last):
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f]     self._volume_snapshot_create(context, instance, guest,
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f]     rv = execute(f, *args, **kwargs)
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f]     six.reraise(c, e, tb)
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f]     raise value
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f]     rv = meth(*args, **kwargs)
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f] 
Oct 18 11:43:56 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-ac10da46-9a93-437c-9ab4-c18ad4a23aaa tempest-VolumesAssistedSnapshotsTest-741933638 tempest-VolumesAssistedSnapshotsTest-741933638-project] [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f] volume_snapshot_delete: delete_info: {'volume_id': '3e1907e5-89a1-4792-a656-59422463e8a1'} {{(pid=74190) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver [None req-ac10da46-9a93-437c-9ab4-c18ad4a23aaa tempest-VolumesAssistedSnapshotsTest-741933638 tempest-VolumesAssistedSnapshotsTest-741933638-project] [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f] Traceback (most recent call last):
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f]     self._volume_snapshot_delete(context, instance, volume_id,
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f]     if delete_info['type'] != 'qcow2':
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f] KeyError: 'type'
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f] 
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver [None req-249521d2-0e73-4c59-9806-909430d1e591 tempest-VolumesAssistedSnapshotsTest-741933638 tempest-VolumesAssistedSnapshotsTest-741933638-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 2d1db937-f571-4e92-8c69-f6ce26d62f44 could not be found.
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver     raise value
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver 
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver 
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 2d1db937-f571-4e92-8c69-f6ce26d62f44 could not be found. (HTTP 404) (Request-ID: req-8b95e7c6-1bd4-48db-b7fe-f3e53512011b)
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver 
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver 
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 2d1db937-f571-4e92-8c69-f6ce26d62f44 could not be found.
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver 
Oct 18 11:43:56 user nova-compute[74190]: ERROR oslo_messaging.rpc.server [None req-249521d2-0e73-4c59-9806-909430d1e591 tempest-VolumesAssistedSnapshotsTest-741933638 tempest-VolumesAssistedSnapshotsTest-741933638-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 18 11:43:56 user nova-compute[74190]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 18 11:43:56 user nova-compute[74190]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 18 11:43:56 user nova-compute[74190]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 18 11:43:56 user nova-compute[74190]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 18 11:43:56 user nova-compute[74190]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 18 11:43:56 user nova-compute[74190]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 18 11:43:56 user nova-compute[74190]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 18 11:43:56 user nova-compute[74190]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Oct 18 11:43:56 user nova-compute[74190]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Oct 18 11:43:56 user nova-compute[74190]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 18 11:43:56 user nova-compute[74190]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 18 11:43:56 user nova-compute[74190]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 18 11:43:56 user nova-compute[74190]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 18 11:43:56 user nova-compute[74190]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 18 11:43:56 user nova-compute[74190]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 18 11:43:56 user nova-compute[74190]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 18 11:43:56 user nova-compute[74190]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 18 11:43:56 user nova-compute[74190]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4504, in volume_snapshot_create
Oct 18 11:43:56 user nova-compute[74190]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Oct 18 11:43:56 user nova-compute[74190]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Oct 18 11:43:56 user nova-compute[74190]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 18 11:43:56 user nova-compute[74190]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 18 11:43:56 user nova-compute[74190]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 18 11:43:56 user nova-compute[74190]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 18 11:43:56 user nova-compute[74190]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 18 11:43:56 user nova-compute[74190]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 18 11:43:56 user nova-compute[74190]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Oct 18 11:43:56 user nova-compute[74190]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 18 11:43:56 user nova-compute[74190]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 18 11:43:56 user nova-compute[74190]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 18 11:43:56 user nova-compute[74190]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 18 11:43:56 user nova-compute[74190]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 18 11:43:56 user nova-compute[74190]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 18 11:43:56 user nova-compute[74190]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 18 11:43:56 user nova-compute[74190]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Oct 18 11:43:56 user nova-compute[74190]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 18 11:43:56 user nova-compute[74190]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Oct 18 11:43:56 user nova-compute[74190]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 18 11:43:56 user nova-compute[74190]: ERROR oslo_messaging.rpc.server     raise value
Oct 18 11:43:56 user nova-compute[74190]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 18 11:43:56 user nova-compute[74190]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Oct 18 11:43:56 user nova-compute[74190]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 18 11:43:56 user nova-compute[74190]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 18 11:43:56 user nova-compute[74190]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 18 11:43:56 user nova-compute[74190]: ERROR oslo_messaging.rpc.server 
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver [None req-ac10da46-9a93-437c-9ab4-c18ad4a23aaa tempest-VolumesAssistedSnapshotsTest-741933638 tempest-VolumesAssistedSnapshotsTest-741933638-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver 
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver 
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-f7f9649d-b203-4c21-8d67-72da8caa9c59)
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver 
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver 
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Oct 18 11:43:56 user nova-compute[74190]: ERROR nova.virt.libvirt.driver 
Oct 18 11:43:56 user nova-compute[74190]: ERROR oslo_messaging.rpc.server [None req-ac10da46-9a93-437c-9ab4-c18ad4a23aaa tempest-VolumesAssistedSnapshotsTest-741933638 tempest-VolumesAssistedSnapshotsTest-741933638-project] Exception during message handling: KeyError: 'type'
Oct 18 11:43:56 user nova-compute[74190]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 18 11:43:56 user nova-compute[74190]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 18 11:43:56 user nova-compute[74190]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 18 11:43:56 user nova-compute[74190]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 18 11:43:56 user nova-compute[74190]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 18 11:43:56 user nova-compute[74190]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 18 11:43:56 user nova-compute[74190]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 18 11:43:56 user nova-compute[74190]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Oct 18 11:43:56 user nova-compute[74190]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Oct 18 11:43:56 user nova-compute[74190]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 18 11:43:56 user nova-compute[74190]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 18 11:43:56 user nova-compute[74190]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 18 11:43:56 user nova-compute[74190]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 18 11:43:56 user nova-compute[74190]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 18 11:43:56 user nova-compute[74190]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 18 11:43:56 user nova-compute[74190]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 18 11:43:56 user nova-compute[74190]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 18 11:43:56 user nova-compute[74190]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4516, in volume_snapshot_delete
Oct 18 11:43:56 user nova-compute[74190]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Oct 18 11:43:56 user nova-compute[74190]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Oct 18 11:43:56 user nova-compute[74190]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 18 11:43:56 user nova-compute[74190]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 18 11:43:56 user nova-compute[74190]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 18 11:43:56 user nova-compute[74190]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 18 11:43:56 user nova-compute[74190]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 18 11:43:56 user nova-compute[74190]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 18 11:43:56 user nova-compute[74190]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Oct 18 11:43:56 user nova-compute[74190]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 18 11:43:56 user nova-compute[74190]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Oct 18 11:43:56 user nova-compute[74190]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Oct 18 11:43:56 user nova-compute[74190]: ERROR oslo_messaging.rpc.server 
Oct 18 11:43:57 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-e6cc62d4-07be-4da3-9de2-0283b2fbd923 tempest-VolumesAssistedSnapshotsTest-63445179 tempest-VolumesAssistedSnapshotsTest-63445179-project-admin] Acquiring lock "697d3123-bd6b-42b9-b278-c33c0c00da6f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:43:57 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-e6cc62d4-07be-4da3-9de2-0283b2fbd923 tempest-VolumesAssistedSnapshotsTest-63445179 tempest-VolumesAssistedSnapshotsTest-63445179-project-admin] Lock "697d3123-bd6b-42b9-b278-c33c0c00da6f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:43:57 user nova-compute[74190]: INFO nova.compute.manager [None req-e6cc62d4-07be-4da3-9de2-0283b2fbd923 tempest-VolumesAssistedSnapshotsTest-63445179 tempest-VolumesAssistedSnapshotsTest-63445179-project-admin] [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f] Detaching volume 3e1907e5-89a1-4792-a656-59422463e8a1
Oct 18 11:43:57 user nova-compute[74190]: INFO nova.virt.block_device [None req-e6cc62d4-07be-4da3-9de2-0283b2fbd923 tempest-VolumesAssistedSnapshotsTest-63445179 tempest-VolumesAssistedSnapshotsTest-63445179-project-admin] [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f] Attempting to driver detach volume 3e1907e5-89a1-4792-a656-59422463e8a1 from mountpoint /dev/vdb
Oct 18 11:43:57 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-e6cc62d4-07be-4da3-9de2-0283b2fbd923 tempest-VolumesAssistedSnapshotsTest-63445179 tempest-VolumesAssistedSnapshotsTest-63445179-project-admin] Attempting to detach device vdb from instance 697d3123-bd6b-42b9-b278-c33c0c00da6f from the persistent domain config. {{(pid=74190) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 18 11:43:57 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-e6cc62d4-07be-4da3-9de2-0283b2fbd923 tempest-VolumesAssistedSnapshotsTest-63445179 tempest-VolumesAssistedSnapshotsTest-63445179-project-admin] detach device xml: <disk type="block" device="disk">
Oct 18 11:43:57 user nova-compute[74190]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 11:43:57 user nova-compute[74190]:   <source dev="/dev/sdi"/>
Oct 18 11:43:57 user nova-compute[74190]:   <target dev="vdb" bus="virtio"/>
Oct 18 11:43:57 user nova-compute[74190]:   <serial>3e1907e5-89a1-4792-a656-59422463e8a1</serial>
Oct 18 11:43:57 user nova-compute[74190]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 18 11:43:57 user nova-compute[74190]: </disk>
Oct 18 11:43:57 user nova-compute[74190]:  {{(pid=74190) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 11:43:57 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-e6cc62d4-07be-4da3-9de2-0283b2fbd923 tempest-VolumesAssistedSnapshotsTest-63445179 tempest-VolumesAssistedSnapshotsTest-63445179-project-admin] Successfully detached device vdb from instance 697d3123-bd6b-42b9-b278-c33c0c00da6f from the persistent domain config.
Oct 18 11:43:57 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-e6cc62d4-07be-4da3-9de2-0283b2fbd923 tempest-VolumesAssistedSnapshotsTest-63445179 tempest-VolumesAssistedSnapshotsTest-63445179-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 697d3123-bd6b-42b9-b278-c33c0c00da6f from the live domain config. {{(pid=74190) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 18 11:43:57 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-e6cc62d4-07be-4da3-9de2-0283b2fbd923 tempest-VolumesAssistedSnapshotsTest-63445179 tempest-VolumesAssistedSnapshotsTest-63445179-project-admin] detach device xml: <disk type="block" device="disk">
Oct 18 11:43:57 user nova-compute[74190]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 11:43:57 user nova-compute[74190]:   <source dev="/dev/sdi"/>
Oct 18 11:43:57 user nova-compute[74190]:   <target dev="vdb" bus="virtio"/>
Oct 18 11:43:57 user nova-compute[74190]:   <serial>3e1907e5-89a1-4792-a656-59422463e8a1</serial>
Oct 18 11:43:57 user nova-compute[74190]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 18 11:43:57 user nova-compute[74190]: </disk>
Oct 18 11:43:57 user nova-compute[74190]:  {{(pid=74190) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 11:43:57 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-e6cc62d4-07be-4da3-9de2-0283b2fbd923 tempest-VolumesAssistedSnapshotsTest-63445179 tempest-VolumesAssistedSnapshotsTest-63445179-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 697d3123-bd6b-42b9-b278-c33c0c00da6f {{(pid=74190) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 18 11:43:59 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:04 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-e549ca55-9349-4caa-9ef3-f426ffd22595 tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c6130edd-eb98-491e-a0ba-6bd59199d9e1 is timed out.
Oct 18 11:44:04 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-e549ca55-9349-4caa-9ef3-f426ffd22595 tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Successfully detached device vdb from instance c6130edd-eb98-491e-a0ba-6bd59199d9e1 from the live domain config.
Oct 18 11:44:04 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e549ca55-9349-4caa-9ef3-f426ffd22595 tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] [instance: c6130edd-eb98-491e-a0ba-6bd59199d9e1] calling os-brick to detach iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-e549ca55-9349-4caa-9ef3-f426ffd22595 tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, {'target_iqn': 'iqn.2010-10.org.openstack:99028d44-32f8-4fc1-97fe-595cdcc4f0b5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NWdlnvgU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:44:04 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-e549ca55-9349-4caa-9ef3-f426ffd22595 tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:44:04 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-e549ca55-9349-4caa-9ef3-f426ffd22595 tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-e549ca55-9349-4caa-9ef3-f426ffd22595 tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[53dd59d2-3b47-4721-b45b-ae5c415d1446]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:99028d44-32f8-4fc1-97fe-595cdcc4f0b5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e8097d82-d1b3-459d-8331-682cbe592d49\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c585296-c9a9-4c7f-8757-618a59bd01d8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6243f09d-1778-4f76-beae-8baceac3112f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3e1907e5-89a1-4792-a656-59422463e8a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-e549ca55-9349-4caa-9ef3-f426ffd22595 tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 11:44:04 user nova-compute[74190]: No targets found.
Oct 18 11:44:04 user nova-compute[74190]: iSNS:
Oct 18 11:44:04 user nova-compute[74190]: No targets found.
Oct 18 11:44:04 user nova-compute[74190]: STATIC:
Oct 18 11:44:04 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a
Oct 18 11:44:04 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:44:04 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:44:04 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:99028d44-32f8-4fc1-97fe-595cdcc4f0b5
Oct 18 11:44:04 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:44:04 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:44:04 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:e8097d82-d1b3-459d-8331-682cbe592d49
Oct 18 11:44:04 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:44:04 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:44:04 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb
Oct 18 11:44:04 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:44:04 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:44:04 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:8c585296-c9a9-4c7f-8757-618a59bd01d8
Oct 18 11:44:04 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:44:04 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:44:04 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:6243f09d-1778-4f76-beae-8baceac3112f
Oct 18 11:44:04 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:44:04 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:44:04 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:3e1907e5-89a1-4792-a656-59422463e8a1
Oct 18 11:44:04 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:44:04 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:44:04 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c
Oct 18 11:44:04 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:44:04 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:44:04 user nova-compute[74190]: FIRMWARE:
Oct 18 11:44:04 user nova-compute[74190]: No targets found.
Oct 18 11:44:04 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-e549ca55-9349-4caa-9ef3-f426ffd22595 tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 11:44:04 user nova-compute[74190]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 11:44:04 user nova-compute[74190]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74190) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-e549ca55-9349-4caa-9ef3-f426ffd22595 tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99028d44-32f8-4fc1-97fe-595cdcc4f0b5', 0)] {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad2b4fb-493b-4397-9a48-64f925371632]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e1907e5-89a1-4792-a656-59422463e8a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6243f09d-1778-4f76-beae-8baceac3112f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c585296-c9a9-4c7f-8757-618a59bd01d8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99028d44-32f8-4fc1-97fe-595cdcc4f0b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8097d82-d1b3-459d-8331-682cbe592d49\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[d782f2da-f81a-4129-a583-bcb00afeb962]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99028d44-32f8-4fc1-97fe-595cdcc4f0b5 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6243f09d-1778-4f76-beae-8baceac3112f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c585296-c9a9-4c7f-8757-618a59bd01d8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8097d82-d1b3-459d-8331-682cbe592d49 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e1907e5-89a1-4792-a656-59422463e8a1 (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-e549ca55-9349-4caa-9ef3-f426ffd22595 tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)
Oct 18 11:44:04 user nova-compute[74190]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)
Oct 18 11:44:04 user nova-compute[74190]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)
Oct 18 11:44:04 user nova-compute[74190]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99028d44-32f8-4fc1-97fe-595cdcc4f0b5 (non-flash)
Oct 18 11:44:04 user nova-compute[74190]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6243f09d-1778-4f76-beae-8baceac3112f (non-flash)
Oct 18 11:44:04 user nova-compute[74190]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c585296-c9a9-4c7f-8757-618a59bd01d8 (non-flash)
Oct 18 11:44:04 user nova-compute[74190]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8097d82-d1b3-459d-8331-682cbe592d49 (non-flash)
Oct 18 11:44:04 user nova-compute[74190]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e1907e5-89a1-4792-a656-59422463e8a1 (non-flash)
Oct 18 11:44:04 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-e549ca55-9349-4caa-9ef3-f426ffd22595 tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)
Oct 18 11:44:04 user nova-compute[74190]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)
Oct 18 11:44:04 user nova-compute[74190]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)
Oct 18 11:44:04 user nova-compute[74190]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99028d44-32f8-4fc1-97fe-595cdcc4f0b5 (non-flash)
Oct 18 11:44:04 user nova-compute[74190]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6243f09d-1778-4f76-beae-8baceac3112f (non-flash)
Oct 18 11:44:04 user nova-compute[74190]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c585296-c9a9-4c7f-8757-618a59bd01d8 (non-flash)
Oct 18 11:44:04 user nova-compute[74190]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8097d82-d1b3-459d-8331-682cbe592d49 (non-flash)
Oct 18 11:44:04 user nova-compute[74190]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e1907e5-89a1-4792-a656-59422463e8a1 (non-flash)
Oct 18 11:44:04 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-e549ca55-9349-4caa-9ef3-f426ffd22595 tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1f44599000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99028d44-32f8-4fc1-97fe-595cdcc4f0b5'): ({'sde'}, set())}) {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-e549ca55-9349-4caa-9ef3-f426ffd22595 tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Removing single pathed devices sde {{(pid=74190) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a17cff-79e1-4f90-ab5a-902e7652ff34]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.017s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d2034f-91e2-49c2-baa2-4b33a5038c59]: (4, ('ok\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-e549ca55-9349-4caa-9ef3-f426ffd22595 tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Flushing IO for device /dev/sde {{(pid=74190) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fb39d46-499f-4017-86d6-b2dce2860780]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-e549ca55-9349-4caa-9ef3-f426ffd22595 tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74190) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.034s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd15ab38-1141-44a5-a5b3-70a1fd5bfe42]: (4, ('1', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-e549ca55-9349-4caa-9ef3-f426ffd22595 tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-e549ca55-9349-4caa-9ef3-f426ffd22595 tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] SCSI volumes sde have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-e549ca55-9349-4caa-9ef3-f426ffd22595 tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99028d44-32f8-4fc1-97fe-595cdcc4f0b5')] {{(pid=74190) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99028d44-32f8-4fc1-97fe-595cdcc4f0b5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99028d44-32f8-4fc1-97fe-595cdcc4f0b5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[403a1d70-6875-43fc-86f2-18911a0ba6bf]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-e549ca55-9349-4caa-9ef3-f426ffd22595 tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99028d44-32f8-4fc1-97fe-595cdcc4f0b5 -p 172.16.0.220:3260 --logout {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74190) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99028d44-32f8-4fc1-97fe-595cdcc4f0b5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd30d4d1-2c8f-4dc0-9e48-50ebeb8fa3f2]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:99028d44-32f8-4fc1-97fe-595cdcc4f0b5, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:99028d44-32f8-4fc1-97fe-595cdcc4f0b5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-e549ca55-9349-4caa-9ef3-f426ffd22595 tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:99028d44-32f8-4fc1-97fe-595cdcc4f0b5, portal: 172.16.0.220,3260]
Oct 18 11:44:04 user nova-compute[74190]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:99028d44-32f8-4fc1-97fe-595cdcc4f0b5, portal: 172.16.0.220,3260] successful.
Oct 18 11:44:04 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99028d44-32f8-4fc1-97fe-595cdcc4f0b5 -p 172.16.0.220:3260 --op delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99028d44-32f8-4fc1-97fe-595cdcc4f0b5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[9591675a-2519-4910-9957-92ec58c1f899]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-e549ca55-9349-4caa-9ef3-f426ffd22595 tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-e549ca55-9349-4caa-9ef3-f426ffd22595 tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-e549ca55-9349-4caa-9ef3-f426ffd22595 tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] <== disconnect_volume: return (316ms) None {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e549ca55-9349-4caa-9ef3-f426ffd22595 tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] [instance: c6130edd-eb98-491e-a0ba-6bd59199d9e1] Disconnected iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 11:44:04 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-36abc8b5-d839-473e-8435-e68bf67bdf14 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef is timed out.
Oct 18 11:44:04 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-36abc8b5-d839-473e-8435-e68bf67bdf14 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Successfully detached device vdb from instance 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef from the live domain config.
Oct 18 11:44:04 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36abc8b5-d839-473e-8435-e68bf67bdf14 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] calling os-brick to detach iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-36abc8b5-d839-473e-8435-e68bf67bdf14 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, {'target_iqn': 'iqn.2010-10.org.openstack:6243f09d-1778-4f76-beae-8baceac3112f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BqnhLFQv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:44:04 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-36abc8b5-d839-473e-8435-e68bf67bdf14 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:44:04 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-36abc8b5-d839-473e-8435-e68bf67bdf14 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-36abc8b5-d839-473e-8435-e68bf67bdf14 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb288987-82ad-4905-b72c-a52debb27db3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e8097d82-d1b3-459d-8331-682cbe592d49\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c585296-c9a9-4c7f-8757-618a59bd01d8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6243f09d-1778-4f76-beae-8baceac3112f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3e1907e5-89a1-4792-a656-59422463e8a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-36abc8b5-d839-473e-8435-e68bf67bdf14 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 11:44:04 user nova-compute[74190]: No targets found.
Oct 18 11:44:04 user nova-compute[74190]: iSNS:
Oct 18 11:44:04 user nova-compute[74190]: No targets found.
Oct 18 11:44:04 user nova-compute[74190]: STATIC:
Oct 18 11:44:04 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a
Oct 18 11:44:04 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:44:04 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:44:04 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:e8097d82-d1b3-459d-8331-682cbe592d49
Oct 18 11:44:04 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:44:04 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:44:04 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb
Oct 18 11:44:04 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:44:04 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:44:04 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:8c585296-c9a9-4c7f-8757-618a59bd01d8
Oct 18 11:44:04 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:44:04 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:44:04 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:6243f09d-1778-4f76-beae-8baceac3112f
Oct 18 11:44:04 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:44:04 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:44:04 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:3e1907e5-89a1-4792-a656-59422463e8a1
Oct 18 11:44:04 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:44:04 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:44:04 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c
Oct 18 11:44:04 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:44:04 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:44:04 user nova-compute[74190]: FIRMWARE:
Oct 18 11:44:04 user nova-compute[74190]: No targets found.
Oct 18 11:44:04 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-36abc8b5-d839-473e-8435-e68bf67bdf14 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 11:44:04 user nova-compute[74190]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 11:44:04 user nova-compute[74190]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74190) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-36abc8b5-d839-473e-8435-e68bf67bdf14 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6243f09d-1778-4f76-beae-8baceac3112f', 0)] {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[a148c9c5-db65-4204-beb0-8300e37217b0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e1907e5-89a1-4792-a656-59422463e8a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6243f09d-1778-4f76-beae-8baceac3112f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c585296-c9a9-4c7f-8757-618a59bd01d8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8097d82-d1b3-459d-8331-682cbe592d49\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a8bab77-324c-4cd9-9d42-8a2b74b280c9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6243f09d-1778-4f76-beae-8baceac3112f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c585296-c9a9-4c7f-8757-618a59bd01d8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8097d82-d1b3-459d-8331-682cbe592d49 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e1907e5-89a1-4792-a656-59422463e8a1 (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-36abc8b5-d839-473e-8435-e68bf67bdf14 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)
Oct 18 11:44:04 user nova-compute[74190]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)
Oct 18 11:44:04 user nova-compute[74190]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)
Oct 18 11:44:04 user nova-compute[74190]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6243f09d-1778-4f76-beae-8baceac3112f (non-flash)
Oct 18 11:44:04 user nova-compute[74190]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c585296-c9a9-4c7f-8757-618a59bd01d8 (non-flash)
Oct 18 11:44:04 user nova-compute[74190]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8097d82-d1b3-459d-8331-682cbe592d49 (non-flash)
Oct 18 11:44:04 user nova-compute[74190]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e1907e5-89a1-4792-a656-59422463e8a1 (non-flash)
Oct 18 11:44:04 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-36abc8b5-d839-473e-8435-e68bf67bdf14 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)
Oct 18 11:44:04 user nova-compute[74190]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)
Oct 18 11:44:04 user nova-compute[74190]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)
Oct 18 11:44:04 user nova-compute[74190]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6243f09d-1778-4f76-beae-8baceac3112f (non-flash)
Oct 18 11:44:04 user nova-compute[74190]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c585296-c9a9-4c7f-8757-618a59bd01d8 (non-flash)
Oct 18 11:44:04 user nova-compute[74190]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8097d82-d1b3-459d-8331-682cbe592d49 (non-flash)
Oct 18 11:44:04 user nova-compute[74190]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e1907e5-89a1-4792-a656-59422463e8a1 (non-flash)
Oct 18 11:44:04 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-36abc8b5-d839-473e-8435-e68bf67bdf14 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1f5f7feb90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6243f09d-1778-4f76-beae-8baceac3112f'): ({'sdf'}, set())}) {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-36abc8b5-d839-473e-8435-e68bf67bdf14 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Removing single pathed devices sdf {{(pid=74190) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[362f8b17-0cf6-4cc1-ab9a-205ace220828]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b7f2cd-907b-4179-8e08-31df6132a1a8]: (4, ('ok\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-36abc8b5-d839-473e-8435-e68bf67bdf14 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Flushing IO for device /dev/sdf {{(pid=74190) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[218651e3-e4af-4338-9023-84ed55aaf43a]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-36abc8b5-d839-473e-8435-e68bf67bdf14 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74190) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.042s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7c2f383-e95c-4404-81ff-290d56337c04]: (4, ('1', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-36abc8b5-d839-473e-8435-e68bf67bdf14 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-36abc8b5-d839-473e-8435-e68bf67bdf14 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] SCSI volumes sdf have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-36abc8b5-d839-473e-8435-e68bf67bdf14 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6243f09d-1778-4f76-beae-8baceac3112f')] {{(pid=74190) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6243f09d-1778-4f76-beae-8baceac3112f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6243f09d-1778-4f76-beae-8baceac3112f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[a390ea0c-db50-4236-8dbd-6d1de9861c46]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-36abc8b5-d839-473e-8435-e68bf67bdf14 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6243f09d-1778-4f76-beae-8baceac3112f -p 172.16.0.220:3260 --logout {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6243f09d-1778-4f76-beae-8baceac3112f -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[548c4cf9-86a3-4731-a71a-1435157edff2]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:6243f09d-1778-4f76-beae-8baceac3112f, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:6243f09d-1778-4f76-beae-8baceac3112f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-36abc8b5-d839-473e-8435-e68bf67bdf14 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:6243f09d-1778-4f76-beae-8baceac3112f, portal: 172.16.0.220,3260]
Oct 18 11:44:04 user nova-compute[74190]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:6243f09d-1778-4f76-beae-8baceac3112f, portal: 172.16.0.220,3260] successful.
Oct 18 11:44:04 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6243f09d-1778-4f76-beae-8baceac3112f -p 172.16.0.220:3260 --op delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6243f09d-1778-4f76-beae-8baceac3112f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d61695-e1ba-4e7f-9aed-6683a5ec47c5]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-36abc8b5-d839-473e-8435-e68bf67bdf14 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-36abc8b5-d839-473e-8435-e68bf67bdf14 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-36abc8b5-d839-473e-8435-e68bf67bdf14 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] <== disconnect_volume: return (342ms) None {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:44:04 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36abc8b5-d839-473e-8435-e68bf67bdf14 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] Disconnected iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 11:44:05 user nova-compute[74190]: DEBUG nova.compute.manager [None req-7a461f47-dc20-4e0f-adea-7cd9285428d6 tempest-TestVolumeSwap-670055737 tempest-TestVolumeSwap-670055737-project-admin] [instance: 034398e8-e8c4-4e03-a608-440e447c6041] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'liIufdwV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '034398e8-e8c4-4e03-a608-440e447c6041', 'attached_at': '', 'detached_at': '', 'volume_id': 'd7b43003-2d4b-49b0-8449-6fb2ee281920', 'serial': 'd7b43003-2d4b-49b0-8449-6fb2ee281920'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8c585296-c9a9-4c7f-8757-618a59bd01d8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QDhaZvqp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': '034398e8-e8c4-4e03-a608-440e447c6041', 'attached_at': '', 'detached_at': '', 'volume_id': '8c585296-c9a9-4c7f-8757-618a59bd01d8', 'serial'} {{(pid=74190) _swap_volume /opt/stack/nova/nova/compute/manager.py:7781}}
Oct 18 11:44:05 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a461f47-dc20-4e0f-adea-7cd9285428d6 tempest-TestVolumeSwap-670055737 tempest-TestVolumeSwap-670055737-project-admin] [instance: 034398e8-e8c4-4e03-a608-440e447c6041] Calling os-brick to attach iSCSI Volume {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 11:44:05 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a461f47-dc20-4e0f-adea-7cd9285428d6 tempest-TestVolumeSwap-670055737 tempest-TestVolumeSwap-670055737-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'liIufdwV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:44:05 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-7a461f47-dc20-4e0f-adea-7cd9285428d6 tempest-TestVolumeSwap-670055737 tempest-TestVolumeSwap-670055737-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:44:05 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-7a461f47-dc20-4e0f-adea-7cd9285428d6 tempest-TestVolumeSwap-670055737 tempest-TestVolumeSwap-670055737-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:44:05 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-7a461f47-dc20-4e0f-adea-7cd9285428d6 tempest-TestVolumeSwap-670055737 tempest-TestVolumeSwap-670055737-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:44:05 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-7a461f47-dc20-4e0f-adea-7cd9285428d6 tempest-TestVolumeSwap-670055737 tempest-TestVolumeSwap-670055737-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:44:05 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-7a461f47-dc20-4e0f-adea-7cd9285428d6 tempest-TestVolumeSwap-670055737 tempest-TestVolumeSwap-670055737-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:44:05 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-7a461f47-dc20-4e0f-adea-7cd9285428d6 tempest-TestVolumeSwap-670055737 tempest-TestVolumeSwap-670055737-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:44:05 user nova-compute[74190]: INFO os_brick.initiator.connectors.iscsi [None req-7a461f47-dc20-4e0f-adea-7cd9285428d6 tempest-TestVolumeSwap-670055737 tempest-TestVolumeSwap-670055737-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 11:44:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920 -p 172.16.0.220:3260 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:05 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f5d973-17ba-4a09-b1df-34267bfefa8c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:05 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a461f47-dc20-4e0f-adea-7cd9285428d6 tempest-TestVolumeSwap-670055737 tempest-TestVolumeSwap-670055737-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 11:44:05 user nova-compute[74190]:  {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:44:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920 -p 172.16.0.220:3260 --interface default --op new {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:05 user nova-compute[74190]: DEBUG nova.objects.instance [None req-e549ca55-9349-4caa-9ef3-f426ffd22595 tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Lazy-loading 'flavor' on Instance uuid c6130edd-eb98-491e-a0ba-6bd59199d9e1 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:44:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:05 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[600cdeb9-dd0e-43b8-bcbe-d6e2a9c67c0d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920] added\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:05 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a461f47-dc20-4e0f-adea-7cd9285428d6 tempest-TestVolumeSwap-670055737 tempest-TestVolumeSwap-670055737-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920] added
Oct 18 11:44:05 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:44:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:05 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[34093344-7553-41c3-a573-50f12da60dd6]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:05 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a461f47-dc20-4e0f-adea-7cd9285428d6 tempest-TestVolumeSwap-670055737 tempest-TestVolumeSwap-670055737-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:44:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:05 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-e549ca55-9349-4caa-9ef3-f426ffd22595 tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Lock "c6130edd-eb98-491e-a0ba-6bd59199d9e1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.944s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:44:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:05 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[65286ea9-020e-46c1-a85e-af43f8da2ef7]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:05 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a461f47-dc20-4e0f-adea-7cd9285428d6 tempest-TestVolumeSwap-670055737 tempest-TestVolumeSwap-670055737-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:44:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v liIufdwV {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v liIufdwV" returned: 0 in 0.024s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:05 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a1fad38-1394-4ee8-a0ae-173e1eb47830]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:05 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a461f47-dc20-4e0f-adea-7cd9285428d6 tempest-TestVolumeSwap-670055737 tempest-TestVolumeSwap-670055737-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'liIufdwV'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:44:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:05 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab0585b-1a9a-4251-b3b7-210fa27adce3]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:05 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a461f47-dc20-4e0f-adea-7cd9285428d6 tempest-TestVolumeSwap-670055737 tempest-TestVolumeSwap-670055737-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:44:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:05 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d912c0-4eb8-466a-a630-a6d5c490926f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c585296-c9a9-4c7f-8757-618a59bd01d8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8097d82-d1b3-459d-8331-682cbe592d49 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e1907e5-89a1-4792-a656-59422463e8a1 (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:05 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a461f47-dc20-4e0f-adea-7cd9285428d6 tempest-TestVolumeSwap-670055737 tempest-TestVolumeSwap-670055737-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)
Oct 18 11:44:05 user nova-compute[74190]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)
Oct 18 11:44:05 user nova-compute[74190]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)
Oct 18 11:44:05 user nova-compute[74190]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c585296-c9a9-4c7f-8757-618a59bd01d8 (non-flash)
Oct 18 11:44:05 user nova-compute[74190]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8097d82-d1b3-459d-8331-682cbe592d49 (non-flash)
Oct 18 11:44:05 user nova-compute[74190]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e1907e5-89a1-4792-a656-59422463e8a1 (non-flash)
Oct 18 11:44:05 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:44:05 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a461f47-dc20-4e0f-adea-7cd9285428d6 tempest-TestVolumeSwap-670055737 tempest-TestVolumeSwap-670055737-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)
Oct 18 11:44:05 user nova-compute[74190]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)
Oct 18 11:44:05 user nova-compute[74190]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)
Oct 18 11:44:05 user nova-compute[74190]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c585296-c9a9-4c7f-8757-618a59bd01d8 (non-flash)
Oct 18 11:44:05 user nova-compute[74190]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8097d82-d1b3-459d-8331-682cbe592d49 (non-flash)
Oct 18 11:44:05 user nova-compute[74190]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e1907e5-89a1-4792-a656-59422463e8a1 (non-flash)
Oct 18 11:44:05 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:44:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920 -p 172.16.0.220:3260 --login {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920 -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:05 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[69826e56-395e-4665-a01f-2bdd85bf4f9f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:05 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a461f47-dc20-4e0f-adea-7cd9285428d6 tempest-TestVolumeSwap-670055737 tempest-TestVolumeSwap-670055737-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920, portal: 172.16.0.220,3260]
Oct 18 11:44:05 user nova-compute[74190]: Login to [iface: default, target: iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920, portal: 172.16.0.220,3260] successful.
Oct 18 11:44:05 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:44:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:05 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb48f47-2089-4bc9-883c-46f466d57546]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:05 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a461f47-dc20-4e0f-adea-7cd9285428d6 tempest-TestVolumeSwap-670055737 tempest-TestVolumeSwap-670055737-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:44:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:05 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf90c00-cff7-437d-b74b-5bc8e50abcda]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c585296-c9a9-4c7f-8757-618a59bd01d8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8097d82-d1b3-459d-8331-682cbe592d49 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e1907e5-89a1-4792-a656-59422463e8a1 (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:05 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a461f47-dc20-4e0f-adea-7cd9285428d6 tempest-TestVolumeSwap-670055737 tempest-TestVolumeSwap-670055737-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920 (non-flash)
Oct 18 11:44:05 user nova-compute[74190]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)
Oct 18 11:44:05 user nova-compute[74190]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)
Oct 18 11:44:05 user nova-compute[74190]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)
Oct 18 11:44:05 user nova-compute[74190]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c585296-c9a9-4c7f-8757-618a59bd01d8 (non-flash)
Oct 18 11:44:05 user nova-compute[74190]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8097d82-d1b3-459d-8331-682cbe592d49 (non-flash)
Oct 18 11:44:05 user nova-compute[74190]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e1907e5-89a1-4792-a656-59422463e8a1 (non-flash)
Oct 18 11:44:05 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:44:05 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a461f47-dc20-4e0f-adea-7cd9285428d6 tempest-TestVolumeSwap-670055737 tempest-TestVolumeSwap-670055737-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920 (non-flash)
Oct 18 11:44:05 user nova-compute[74190]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)
Oct 18 11:44:05 user nova-compute[74190]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)
Oct 18 11:44:05 user nova-compute[74190]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)
Oct 18 11:44:05 user nova-compute[74190]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c585296-c9a9-4c7f-8757-618a59bd01d8 (non-flash)
Oct 18 11:44:05 user nova-compute[74190]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8097d82-d1b3-459d-8331-682cbe592d49 (non-flash)
Oct 18 11:44:05 user nova-compute[74190]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e1907e5-89a1-4792-a656-59422463e8a1 (non-flash)
Oct 18 11:44:05 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:44:05 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-7a461f47-dc20-4e0f-adea-7cd9285428d6 tempest-TestVolumeSwap-670055737 tempest-TestVolumeSwap-670055737-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.338s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:44:05 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a461f47-dc20-4e0f-adea-7cd9285428d6 tempest-TestVolumeSwap-670055737 tempest-TestVolumeSwap-670055737-project-admin] Connected to 172.16.0.220:3260 {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 11:44:05 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-7a461f47-dc20-4e0f-adea-7cd9285428d6 tempest-TestVolumeSwap-670055737 tempest-TestVolumeSwap-670055737-project-admin] HCTL ('36', '-', '-', 0) found on session 10 with lun 0 {{(pid=74190) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 11:44:05 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-7a461f47-dc20-4e0f-adea-7cd9285428d6 tempest-TestVolumeSwap-670055737 tempest-TestVolumeSwap-670055737-project-admin] Scanning host 36 c: -, t: -, l: 0) {{(pid=74190) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 11:44:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.023s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:05 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f79c59-2eca-4a88-91e8-6c7b8f2e587d]: (4, ('- - 0', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:05 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-7a461f47-dc20-4e0f-adea-7cd9285428d6 tempest-TestVolumeSwap-670055737 tempest-TestVolumeSwap-670055737-project-admin] Searching for a device in session 10 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74190) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 11:44:05 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a461f47-dc20-4e0f-adea-7cd9285428d6 tempest-TestVolumeSwap-670055737 tempest-TestVolumeSwap-670055737-project-admin] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'liIufdwV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 11:44:05 user nova-compute[74190]: DEBUG nova.objects.instance [None req-36abc8b5-d839-473e-8435-e68bf67bdf14 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Lazy-loading 'flavor' on Instance uuid 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:44:05 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-36abc8b5-d839-473e-8435-e68bf67bdf14 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Lock "6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.071s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:44:06 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-7a461f47-dc20-4e0f-adea-7cd9285428d6 tempest-TestVolumeSwap-670055737 tempest-TestVolumeSwap-670055737-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.379s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:44:06 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a461f47-dc20-4e0f-adea-7cd9285428d6 tempest-TestVolumeSwap-670055737 tempest-TestVolumeSwap-670055737-project-admin] <== connect_volume: return (1382ms) {'type': 'block', 'scsi_wwn': '23431303062633137', 'path': '/dev/sde'} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:44:06 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a461f47-dc20-4e0f-adea-7cd9285428d6 tempest-TestVolumeSwap-670055737 tempest-TestVolumeSwap-670055737-project-admin] [instance: 034398e8-e8c4-4e03-a608-440e447c6041] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23431303062633137', 'path': '/dev/sde'} {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 11:44:06 user nova-compute[74190]: DEBUG nova.objects.instance [None req-7a461f47-dc20-4e0f-adea-7cd9285428d6 tempest-TestVolumeSwap-670055737 tempest-TestVolumeSwap-670055737-project-admin] Lazy-loading 'flavor' on Instance uuid 034398e8-e8c4-4e03-a608-440e447c6041 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:44:06 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-e86fba79-aceb-403f-a2a0-a452cb123427 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Acquiring lock "interface-6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef-b5f712f6-6733-4725-b563-2218a4a58813" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:44:06 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-e86fba79-aceb-403f-a2a0-a452cb123427 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Lock "interface-6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef-b5f712f6-6733-4725-b563-2218a4a58813" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:44:06 user nova-compute[74190]: DEBUG nova.objects.instance [None req-e86fba79-aceb-403f-a2a0-a452cb123427 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Lazy-loading 'flavor' on Instance uuid 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:44:06 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-e86fba79-aceb-403f-a2a0-a452cb123427 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T11:41:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-239478616',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-239478616',id=5,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDiL4Y3YjaIYG9f48clgmLYvNf1xzm1drxLs+YLjigprz2IgSEssC/H3MORsYOE3v5yg6mGeg/8ep19TIA+gnsVGZGVVookzYwja4uGKlJS/z4feKfCDiLYrj74IwuE8uQ==',key_name='tempest-keypair-654404793',keypairs=<?>,launch_index=0,launched_at=2023-10-18T11:41:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='72f55b03dea844739b3e36d4f73b23e0',ramdisk_id='',reservation_id='r-iliez3d9',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1663776612',owner_user_name='tempest-TaggedAttachmentsTest-1663776612-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T11:41:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a587bc7358fe4d289926428f94766374',uuid=6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b5f712f6-6733-4725-b563-2218a4a58813", "address": "fa:16:3e:ab:58:86", "network": {"id": "a814b9ab-3007-49af-aa0f-13a6d655952a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1870963685", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "72f55b03dea844739b3e36d4f73b23e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f712f6-67", "ovs_interfaceid": "b5f712f6-6733-4725-b563-2218a4a58813", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74190) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 11:44:06 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-e86fba79-aceb-403f-a2a0-a452cb123427 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Converting VIF {"id": "b5f712f6-6733-4725-b563-2218a4a58813", "address": "fa:16:3e:ab:58:86", "network": {"id": "a814b9ab-3007-49af-aa0f-13a6d655952a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1870963685", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "72f55b03dea844739b3e36d4f73b23e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f712f6-67", "ovs_interfaceid": "b5f712f6-6733-4725-b563-2218a4a58813", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:44:06 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-e86fba79-aceb-403f-a2a0-a452cb123427 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:58:86,bridge_name='br-int',has_traffic_filtering=True,id=b5f712f6-6733-4725-b563-2218a4a58813,network=Network(a814b9ab-3007-49af-aa0f-13a6d655952a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5f712f6-67') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:44:06 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-e86fba79-aceb-403f-a2a0-a452cb123427 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:ab:58:86"/><model type="virtio"/><mtu size="1442"/><target dev="tapb5f712f6-67"/></interface> {{(pid=74190) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 18 11:44:06 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-e86fba79-aceb-403f-a2a0-a452cb123427 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:ab:58:86"/><model type="virtio"/><mtu size="1442"/><target dev="tapb5f712f6-67"/></interface> {{(pid=74190) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 18 11:44:06 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-e86fba79-aceb-403f-a2a0-a452cb123427 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Attempting to detach device tapb5f712f6-67 from instance 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef from the persistent domain config. {{(pid=74190) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 18 11:44:06 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-e86fba79-aceb-403f-a2a0-a452cb123427 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] detach device xml: <interface type="ethernet">
Oct 18 11:44:06 user nova-compute[74190]:   <mac address="fa:16:3e:ab:58:86"/>
Oct 18 11:44:06 user nova-compute[74190]:   <model type="virtio"/>
Oct 18 11:44:06 user nova-compute[74190]:   <mtu size="1442"/>
Oct 18 11:44:06 user nova-compute[74190]:   <target dev="tapb5f712f6-67"/>
Oct 18 11:44:06 user nova-compute[74190]: </interface>
Oct 18 11:44:06 user nova-compute[74190]:  {{(pid=74190) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 11:44:06 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-e86fba79-aceb-403f-a2a0-a452cb123427 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:ab:58:86"/><model type="virtio"/><mtu size="1442"/><target dev="tapb5f712f6-67"/></interface> {{(pid=74190) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 18 11:44:06 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-e86fba79-aceb-403f-a2a0-a452cb123427 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:ab:58:86"/><model type="virtio"/><mtu size="1442"/><target dev="tapb5f712f6-67"/></interface>not found in domain: <domain type='kvm' id='5'>
Oct 18 11:44:06 user nova-compute[74190]:   <name>instance-00000005</name>
Oct 18 11:44:06 user nova-compute[74190]:   <uuid>6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef</uuid>
Oct 18 11:44:06 user nova-compute[74190]:   <metadata>
Oct 18 11:44:06 user nova-compute[74190]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 11:44:06 user nova-compute[74190]:   <nova:package version="0.0.0"/>
Oct 18 11:44:06 user nova-compute[74190]:   <nova:name>tempest-device-tagging-server-239478616</nova:name>
Oct 18 11:44:06 user nova-compute[74190]:   <nova:creationTime>2023-10-18 11:43:12</nova:creationTime>
Oct 18 11:44:06 user nova-compute[74190]:   <nova:flavor name="m1.tiny">
Oct 18 11:44:06 user nova-compute[74190]:     <nova:memory>512</nova:memory>
Oct 18 11:44:06 user nova-compute[74190]:     <nova:disk>1</nova:disk>
Oct 18 11:44:06 user nova-compute[74190]:     <nova:swap>0</nova:swap>
Oct 18 11:44:06 user nova-compute[74190]:     <nova:ephemeral>0</nova:ephemeral>
Oct 18 11:44:06 user nova-compute[74190]:     <nova:vcpus>1</nova:vcpus>
Oct 18 11:44:06 user nova-compute[74190]:   </nova:flavor>
Oct 18 11:44:06 user nova-compute[74190]:   <nova:owner>
Oct 18 11:44:06 user nova-compute[74190]:     <nova:user uuid="a587bc7358fe4d289926428f94766374">tempest-TaggedAttachmentsTest-1663776612-project-member</nova:user>
Oct 18 11:44:06 user nova-compute[74190]:     <nova:project uuid="72f55b03dea844739b3e36d4f73b23e0">tempest-TaggedAttachmentsTest-1663776612</nova:project>
Oct 18 11:44:06 user nova-compute[74190]:   </nova:owner>
Oct 18 11:44:06 user nova-compute[74190]:   <nova:root type="image" uuid="6e88bbf0-6e78-49a8-b3c5-9453d22a89df"/>
Oct 18 11:44:06 user nova-compute[74190]:   <nova:ports>
Oct 18 11:44:06 user nova-compute[74190]:     <nova:port uuid="2f3b8cfe-f9f2-4dc5-b368-f67ef363266c">
Oct 18 11:44:06 user nova-compute[74190]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 18 11:44:06 user nova-compute[74190]:     </nova:port>
Oct 18 11:44:06 user nova-compute[74190]:     <nova:port uuid="b5f712f6-6733-4725-b563-2218a4a58813">
Oct 18 11:44:06 user nova-compute[74190]:       <nova:ip type="fixed" address="10.10.10.149" ipVersion="4"/>
Oct 18 11:44:06 user nova-compute[74190]:     </nova:port>
Oct 18 11:44:06 user nova-compute[74190]:   </nova:ports>
Oct 18 11:44:06 user nova-compute[74190]: </nova:instance>
Oct 18 11:44:06 user nova-compute[74190]:   </metadata>
Oct 18 11:44:06 user nova-compute[74190]:   <memory unit='KiB'>524288</memory>
Oct 18 11:44:06 user nova-compute[74190]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 18 11:44:06 user nova-compute[74190]:   <vcpu placement='static'>1</vcpu>
Oct 18 11:44:06 user nova-compute[74190]:   <resource>
Oct 18 11:44:06 user nova-compute[74190]:     <partition>/machine</partition>
Oct 18 11:44:06 user nova-compute[74190]:   </resource>
Oct 18 11:44:06 user nova-compute[74190]:   <sysinfo type='smbios'>
Oct 18 11:44:06 user nova-compute[74190]:     <system>
Oct 18 11:44:06 user nova-compute[74190]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 18 11:44:06 user nova-compute[74190]:       <entry name='product'>OpenStack Nova</entry>
Oct 18 11:44:06 user nova-compute[74190]:       <entry name='version'>0.0.0</entry>
Oct 18 11:44:06 user nova-compute[74190]:       <entry name='serial'>6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef</entry>
Oct 18 11:44:06 user nova-compute[74190]:       <entry name='uuid'>6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef</entry>
Oct 18 11:44:06 user nova-compute[74190]:       <entry name='family'>Virtual Machine</entry>
Oct 18 11:44:06 user nova-compute[74190]:     </system>
Oct 18 11:44:06 user nova-compute[74190]:   </sysinfo>
Oct 18 11:44:06 user nova-compute[74190]:   <os>
Oct 18 11:44:06 user nova-compute[74190]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 18 11:44:06 user nova-compute[74190]:     <boot dev='hd'/>
Oct 18 11:44:06 user nova-compute[74190]:     <smbios mode='sysinfo'/>
Oct 18 11:44:06 user nova-compute[74190]:   </os>
Oct 18 11:44:06 user nova-compute[74190]:   <features>
Oct 18 11:44:06 user nova-compute[74190]:     <acpi/>
Oct 18 11:44:06 user nova-compute[74190]:     <apic/>
Oct 18 11:44:06 user nova-compute[74190]:     <vmcoreinfo state='on'/>
Oct 18 11:44:06 user nova-compute[74190]:   </features>
Oct 18 11:44:06 user nova-compute[74190]:   <cpu mode='custom' match='exact' check='full'>
Oct 18 11:44:06 user nova-compute[74190]:     <model fallback='forbid'>Nehalem</model>
Oct 18 11:44:06 user nova-compute[74190]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 18 11:44:06 user nova-compute[74190]:     <feature policy='require' name='vme'/>
Oct 18 11:44:06 user nova-compute[74190]:     <feature policy='require' name='x2apic'/>
Oct 18 11:44:06 user nova-compute[74190]:     <feature policy='require' name='hypervisor'/>
Oct 18 11:44:06 user nova-compute[74190]:   </cpu>
Oct 18 11:44:06 user nova-compute[74190]:   <clock offset='utc'>
Oct 18 11:44:06 user nova-compute[74190]:     <timer name='pit' tickpolicy='delay'/>
Oct 18 11:44:06 user nova-compute[74190]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 18 11:44:06 user nova-compute[74190]:     <timer name='hpet' present='no'/>
Oct 18 11:44:06 user nova-compute[74190]:   </clock>
Oct 18 11:44:06 user nova-compute[74190]:   <on_poweroff>destroy</on_poweroff>
Oct 18 11:44:06 user nova-compute[74190]:   <on_reboot>restart</on_reboot>
Oct 18 11:44:06 user nova-compute[74190]:   <on_crash>destroy</on_crash>
Oct 18 11:44:06 user nova-compute[74190]:   <devices>
Oct 18 11:44:06 user nova-compute[74190]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 18 11:44:06 user nova-compute[74190]:     <disk type='file' device='disk'>
Oct 18 11:44:06 user nova-compute[74190]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 18 11:44:06 user nova-compute[74190]:       <source file='/opt/stack/data/nova/instances/6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef/disk' index='2'/>
Oct 18 11:44:06 user nova-compute[74190]:       <backingStore type='file' index='3'>
Oct 18 11:44:06 user nova-compute[74190]:         <format type='raw'/>
Oct 18 11:44:06 user nova-compute[74190]:         <source file='/opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f'/>
Oct 18 11:44:06 user nova-compute[74190]:         <backingStore/>
Oct 18 11:44:06 user nova-compute[74190]:       </backingStore>
Oct 18 11:44:06 user nova-compute[74190]:       <target dev='vda' bus='virtio'/>
Oct 18 11:44:06 user nova-compute[74190]:       <alias name='virtio-disk0'/>
Oct 18 11:44:06 user nova-compute[74190]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 18 11:44:06 user nova-compute[74190]:     </disk>
Oct 18 11:44:06 user nova-compute[74190]:     <disk type='file' device='cdrom'>
Oct 18 11:44:06 user nova-compute[74190]:       <driver name='qemu' type='raw' cache='none'/>
Oct 18 11:44:06 user nova-compute[74190]:       <source file='/opt/stack/data/nova/instances/6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef/disk.config' index='1'/>
Oct 18 11:44:06 user nova-compute[74190]:       <backingStore/>
Oct 18 11:44:06 user nova-compute[74190]:       <target dev='hda' bus='ide'/>
Oct 18 11:44:06 user nova-compute[74190]:       <readonly/>
Oct 18 11:44:06 user nova-compute[74190]:       <alias name='ide0-0-0'/>
Oct 18 11:44:06 user nova-compute[74190]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 18 11:44:06 user nova-compute[74190]:     </disk>
Oct 18 11:44:06 user nova-compute[74190]:     <controller type='usb' index='0' model='none'>
Oct 18 11:44:06 user nova-compute[74190]:       <alias name='usb'/>
Oct 18 11:44:06 user nova-compute[74190]:     </controller>
Oct 18 11:44:06 user nova-compute[74190]:     <controller type='pci' index='0' model='pci-root'>
Oct 18 11:44:06 user nova-compute[74190]:       <alias name='pci.0'/>
Oct 18 11:44:06 user nova-compute[74190]:     </controller>
Oct 18 11:44:06 user nova-compute[74190]:     <controller type='ide' index='0'>
Oct 18 11:44:06 user nova-compute[74190]:       <alias name='ide'/>
Oct 18 11:44:06 user nova-compute[74190]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 18 11:44:06 user nova-compute[74190]:     </controller>
Oct 18 11:44:06 user nova-compute[74190]:     <interface type='ethernet'>
Oct 18 11:44:06 user nova-compute[74190]:       <mac address='fa:16:3e:22:e2:3f'/>
Oct 18 11:44:06 user nova-compute[74190]:       <target dev='tap2f3b8cfe-f9'/>
Oct 18 11:44:06 user nova-compute[74190]:       <model type='virtio'/>
Oct 18 11:44:06 user nova-compute[74190]:       <mtu size='1442'/>
Oct 18 11:44:06 user nova-compute[74190]:       <alias name='net0'/>
Oct 18 11:44:06 user nova-compute[74190]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 18 11:44:06 user nova-compute[74190]:     </interface>
Oct 18 11:44:06 user nova-compute[74190]:     <interface type='ethernet'>
Oct 18 11:44:06 user nova-compute[74190]:       <mac address='fa:16:3e:ab:58:86'/>
Oct 18 11:44:06 user nova-compute[74190]:       <target dev='tapb5f712f6-67'/>
Oct 18 11:44:06 user nova-compute[74190]:       <model type='virtio'/>
Oct 18 11:44:06 user nova-compute[74190]:       <mtu size='1442'/>
Oct 18 11:44:06 user nova-compute[74190]:       <alias name='net1'/>
Oct 18 11:44:06 user nova-compute[74190]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Oct 18 11:44:06 user nova-compute[74190]:     </interface>
Oct 18 11:44:06 user nova-compute[74190]:     <serial type='pty'>
Oct 18 11:44:06 user nova-compute[74190]:       <source path='/dev/pts/4'/>
Oct 18 11:44:06 user nova-compute[74190]:       <log file='/opt/stack/data/nova/instances/6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef/console.log' append='off'/>
Oct 18 11:44:06 user nova-compute[74190]:       <target type='isa-serial' port='0'>
Oct 18 11:44:06 user nova-compute[74190]:         <model name='isa-serial'/>
Oct 18 11:44:06 user nova-compute[74190]:       </target>
Oct 18 11:44:06 user nova-compute[74190]:       <alias name='serial0'/>
Oct 18 11:44:06 user nova-compute[74190]:     </serial>
Oct 18 11:44:06 user nova-compute[74190]:     <console type='pty' tty='/dev/pts/4'>
Oct 18 11:44:06 user nova-compute[74190]:       <source path='/dev/pts/4'/>
Oct 18 11:44:06 user nova-compute[74190]:       <log file='/opt/stack/data/nova/instances/6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef/console.log' append='off'/>
Oct 18 11:44:06 user nova-compute[74190]:       <target type='serial' port='0'/>
Oct 18 11:44:06 user nova-compute[74190]:       <alias name='serial0'/>
Oct 18 11:44:06 user nova-compute[74190]:     </console>
Oct 18 11:44:06 user nova-compute[74190]:     <input type='mouse' bus='ps2'>
Oct 18 11:44:06 user nova-compute[74190]:       <alias name='input0'/>
Oct 18 11:44:06 user nova-compute[74190]:     </input>
Oct 18 11:44:06 user nova-compute[74190]:     <input type='keyboard' bus='ps2'>
Oct 18 11:44:06 user nova-compute[74190]:       <alias name='input1'/>
Oct 18 11:44:06 user nova-compute[74190]:     </input>
Oct 18 11:44:06 user nova-compute[74190]:     <graphics type='vnc' port='5904' autoport='yes' listen='0.0.0.0'>
Oct 18 11:44:06 user nova-compute[74190]:       <listen type='address' address='0.0.0.0'/>
Oct 18 11:44:06 user nova-compute[74190]:     </graphics>
Oct 18 11:44:06 user nova-compute[74190]:     <audio id='1' type='none'/>
Oct 18 11:44:06 user nova-compute[74190]:     <video>
Oct 18 11:44:06 user nova-compute[74190]:       <model type='virtio' heads='1' primary='yes'/>
Oct 18 11:44:06 user nova-compute[74190]:       <alias name='video0'/>
Oct 18 11:44:06 user nova-compute[74190]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 18 11:44:06 user nova-compute[74190]:     </video>
Oct 18 11:44:06 user nova-compute[74190]:     <memballoon model='virtio'>
Oct 18 11:44:06 user nova-compute[74190]:       <stats period='10'/>
Oct 18 11:44:06 user nova-compute[74190]:       <alias name='balloon0'/>
Oct 18 11:44:06 user nova-compute[74190]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 18 11:44:06 user nova-compute[74190]:     </memballoon>
Oct 18 11:44:06 user nova-compute[74190]:     <rng model='virtio'>
Oct 18 11:44:06 user nova-compute[74190]:       <backend model='random'>/dev/urandom</backend>
Oct 18 11:44:06 user nova-compute[74190]:       <alias name='rng0'/>
Oct 18 11:44:06 user nova-compute[74190]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 18 11:44:06 user nova-compute[74190]:     </rng>
Oct 18 11:44:06 user nova-compute[74190]:   </devices>
Oct 18 11:44:06 user nova-compute[74190]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 18 11:44:06 user nova-compute[74190]:     <label>libvirt-6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef</label>
Oct 18 11:44:06 user nova-compute[74190]:     <imagelabel>libvirt-6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef</imagelabel>
Oct 18 11:44:06 user nova-compute[74190]:   </seclabel>
Oct 18 11:44:06 user nova-compute[74190]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 18 11:44:06 user nova-compute[74190]:     <label>+64055:+108</label>
Oct 18 11:44:06 user nova-compute[74190]:     <imagelabel>+64055:+108</imagelabel>
Oct 18 11:44:06 user nova-compute[74190]:   </seclabel>
Oct 18 11:44:06 user nova-compute[74190]: </domain>
Oct 18 11:44:06 user nova-compute[74190]:  {{(pid=74190) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 18 11:44:06 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-e86fba79-aceb-403f-a2a0-a452cb123427 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Successfully detached device tapb5f712f6-67 from instance 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef from the persistent domain config.
Oct 18 11:44:06 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-e86fba79-aceb-403f-a2a0-a452cb123427 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] (1/8): Attempting to detach device tapb5f712f6-67 with device alias net1 from instance 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef from the live domain config. {{(pid=74190) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 18 11:44:06 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-e86fba79-aceb-403f-a2a0-a452cb123427 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] detach device xml: <interface type="ethernet">
Oct 18 11:44:06 user nova-compute[74190]:   <mac address="fa:16:3e:ab:58:86"/>
Oct 18 11:44:06 user nova-compute[74190]:   <model type="virtio"/>
Oct 18 11:44:06 user nova-compute[74190]:   <mtu size="1442"/>
Oct 18 11:44:06 user nova-compute[74190]:   <target dev="tapb5f712f6-67"/>
Oct 18 11:44:06 user nova-compute[74190]: </interface>
Oct 18 11:44:06 user nova-compute[74190]:  {{(pid=74190) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 11:44:07 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:07 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:07 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-e86fba79-aceb-403f-a2a0-a452cb123427 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Start waiting for the detach event from libvirt for device tapb5f712f6-67 with device alias net1 for instance 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef {{(pid=74190) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 18 11:44:07 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:07 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:07 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:07 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-7a461f47-dc20-4e0f-adea-7cd9285428d6 tempest-TestVolumeSwap-670055737 tempest-TestVolumeSwap-670055737-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=74190) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 18 11:44:07 user nova-compute[74190]: DEBUG nova.compute.manager [req-347df96c-0ccf-421f-a718-d39c5882f646 req-d10dddef-5a2b-4d25-8e2d-06ead9eb3bd0 service nova] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] Received event network-vif-unplugged-b5f712f6-6733-4725-b563-2218a4a58813 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:44:07 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-347df96c-0ccf-421f-a718-d39c5882f646 req-d10dddef-5a2b-4d25-8e2d-06ead9eb3bd0 service nova] Acquiring lock "6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:44:07 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-347df96c-0ccf-421f-a718-d39c5882f646 req-d10dddef-5a2b-4d25-8e2d-06ead9eb3bd0 service nova] Lock "6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:44:07 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-347df96c-0ccf-421f-a718-d39c5882f646 req-d10dddef-5a2b-4d25-8e2d-06ead9eb3bd0 service nova] Lock "6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:44:07 user nova-compute[74190]: DEBUG nova.compute.manager [req-347df96c-0ccf-421f-a718-d39c5882f646 req-d10dddef-5a2b-4d25-8e2d-06ead9eb3bd0 service nova] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] No waiting events found dispatching network-vif-unplugged-b5f712f6-6733-4725-b563-2218a4a58813 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:44:07 user nova-compute[74190]: WARNING nova.compute.manager [req-347df96c-0ccf-421f-a718-d39c5882f646 req-d10dddef-5a2b-4d25-8e2d-06ead9eb3bd0 service nova] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] Received unexpected event network-vif-unplugged-b5f712f6-6733-4725-b563-2218a4a58813 for instance with vm_state active and task_state None.
Oct 18 11:44:07 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-7a461f47-dc20-4e0f-adea-7cd9285428d6 tempest-TestVolumeSwap-670055737 tempest-TestVolumeSwap-670055737-project-admin] COPY block job progress, current cursor: 147849216 final cursor: 1073741824 {{(pid=74190) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 18 11:44:08 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-7a461f47-dc20-4e0f-adea-7cd9285428d6 tempest-TestVolumeSwap-670055737 tempest-TestVolumeSwap-670055737-project-admin] COPY block job progress, current cursor: 307232768 final cursor: 1073741824 {{(pid=74190) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 18 11:44:08 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-7a461f47-dc20-4e0f-adea-7cd9285428d6 tempest-TestVolumeSwap-670055737 tempest-TestVolumeSwap-670055737-project-admin] COPY block job progress, current cursor: 434110464 final cursor: 1073741824 {{(pid=74190) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 18 11:44:09 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-7a461f47-dc20-4e0f-adea-7cd9285428d6 tempest-TestVolumeSwap-670055737 tempest-TestVolumeSwap-670055737-project-admin] COPY block job progress, current cursor: 579862528 final cursor: 1073741824 {{(pid=74190) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 18 11:44:09 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:09 user nova-compute[74190]: DEBUG nova.compute.manager [req-d0bc853b-6a9a-4f41-bd65-bbb8dd643405 req-d8e68a2e-f097-4f44-ba18-9b2122275e08 service nova] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] Received event network-vif-plugged-b5f712f6-6733-4725-b563-2218a4a58813 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:44:09 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d0bc853b-6a9a-4f41-bd65-bbb8dd643405 req-d8e68a2e-f097-4f44-ba18-9b2122275e08 service nova] Acquiring lock "6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:44:09 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d0bc853b-6a9a-4f41-bd65-bbb8dd643405 req-d8e68a2e-f097-4f44-ba18-9b2122275e08 service nova] Lock "6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:44:09 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d0bc853b-6a9a-4f41-bd65-bbb8dd643405 req-d8e68a2e-f097-4f44-ba18-9b2122275e08 service nova] Lock "6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:44:09 user nova-compute[74190]: DEBUG nova.compute.manager [req-d0bc853b-6a9a-4f41-bd65-bbb8dd643405 req-d8e68a2e-f097-4f44-ba18-9b2122275e08 service nova] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] No waiting events found dispatching network-vif-plugged-b5f712f6-6733-4725-b563-2218a4a58813 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:44:09 user nova-compute[74190]: WARNING nova.compute.manager [req-d0bc853b-6a9a-4f41-bd65-bbb8dd643405 req-d8e68a2e-f097-4f44-ba18-9b2122275e08 service nova] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] Received unexpected event network-vif-plugged-b5f712f6-6733-4725-b563-2218a4a58813 for instance with vm_state active and task_state None.
Oct 18 11:44:09 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-7a461f47-dc20-4e0f-adea-7cd9285428d6 tempest-TestVolumeSwap-670055737 tempest-TestVolumeSwap-670055737-project-admin] COPY block job progress, current cursor: 761266176 final cursor: 1073741824 {{(pid=74190) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 18 11:44:10 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-7a461f47-dc20-4e0f-adea-7cd9285428d6 tempest-TestVolumeSwap-670055737 tempest-TestVolumeSwap-670055737-project-admin] COPY block job progress, current cursor: 826277888 final cursor: 1073741824 {{(pid=74190) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 18 11:44:10 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-7a461f47-dc20-4e0f-adea-7cd9285428d6 tempest-TestVolumeSwap-670055737 tempest-TestVolumeSwap-670055737-project-admin] COPY block job progress, current cursor: 1018167296 final cursor: 1073741824 {{(pid=74190) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 18 11:44:11 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-7a461f47-dc20-4e0f-adea-7cd9285428d6 tempest-TestVolumeSwap-670055737 tempest-TestVolumeSwap-670055737-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74190) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 18 11:44:11 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a461f47-dc20-4e0f-adea-7cd9285428d6 tempest-TestVolumeSwap-670055737 tempest-TestVolumeSwap-670055737-project-admin] [instance: 034398e8-e8c4-4e03-a608-440e447c6041] calling os-brick to detach iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 11:44:11 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a461f47-dc20-4e0f-adea-7cd9285428d6 tempest-TestVolumeSwap-670055737 tempest-TestVolumeSwap-670055737-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, {'target_iqn': 'iqn.2010-10.org.openstack:8c585296-c9a9-4c7f-8757-618a59bd01d8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QDhaZvqp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:44:11 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-7a461f47-dc20-4e0f-adea-7cd9285428d6 tempest-TestVolumeSwap-670055737 tempest-TestVolumeSwap-670055737-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:44:11 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-7a461f47-dc20-4e0f-adea-7cd9285428d6 tempest-TestVolumeSwap-670055737 tempest-TestVolumeSwap-670055737-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:44:11 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-7a461f47-dc20-4e0f-adea-7cd9285428d6 tempest-TestVolumeSwap-670055737 tempest-TestVolumeSwap-670055737-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:44:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.032s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:11 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b34827-614d-42e5-93de-6085b665ff47]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e8097d82-d1b3-459d-8331-682cbe592d49\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c585296-c9a9-4c7f-8757-618a59bd01d8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3e1907e5-89a1-4792-a656-59422463e8a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:11 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a461f47-dc20-4e0f-adea-7cd9285428d6 tempest-TestVolumeSwap-670055737 tempest-TestVolumeSwap-670055737-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 11:44:11 user nova-compute[74190]: No targets found.
Oct 18 11:44:11 user nova-compute[74190]: iSNS:
Oct 18 11:44:11 user nova-compute[74190]: No targets found.
Oct 18 11:44:11 user nova-compute[74190]: STATIC:
Oct 18 11:44:11 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a
Oct 18 11:44:11 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:44:11 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:44:11 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920
Oct 18 11:44:11 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:44:11 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:44:11 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:e8097d82-d1b3-459d-8331-682cbe592d49
Oct 18 11:44:11 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:44:11 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:44:11 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb
Oct 18 11:44:11 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:44:11 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:44:11 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:8c585296-c9a9-4c7f-8757-618a59bd01d8
Oct 18 11:44:11 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:44:11 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:44:11 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:3e1907e5-89a1-4792-a656-59422463e8a1
Oct 18 11:44:11 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:44:11 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:44:11 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c
Oct 18 11:44:11 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:44:11 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:44:11 user nova-compute[74190]: FIRMWARE:
Oct 18 11:44:11 user nova-compute[74190]: No targets found.
Oct 18 11:44:11 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:44:11 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a461f47-dc20-4e0f-adea-7cd9285428d6 tempest-TestVolumeSwap-670055737 tempest-TestVolumeSwap-670055737-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 11:44:11 user nova-compute[74190]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 11:44:11 user nova-compute[74190]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74190) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 11:44:11 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a461f47-dc20-4e0f-adea-7cd9285428d6 tempest-TestVolumeSwap-670055737 tempest-TestVolumeSwap-670055737-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c585296-c9a9-4c7f-8757-618a59bd01d8', 0)] {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 11:44:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:11 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[610e76a6-fc97-40c8-a86c-b60e90b919fa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e1907e5-89a1-4792-a656-59422463e8a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c585296-c9a9-4c7f-8757-618a59bd01d8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8097d82-d1b3-459d-8331-682cbe592d49\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:11 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd28c31a-9e49-42a7-9bd0-cb7d4bf6b8dd]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c585296-c9a9-4c7f-8757-618a59bd01d8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8097d82-d1b3-459d-8331-682cbe592d49 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e1907e5-89a1-4792-a656-59422463e8a1 (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:11 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a461f47-dc20-4e0f-adea-7cd9285428d6 tempest-TestVolumeSwap-670055737 tempest-TestVolumeSwap-670055737-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920 (non-flash)
Oct 18 11:44:11 user nova-compute[74190]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)
Oct 18 11:44:11 user nova-compute[74190]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)
Oct 18 11:44:11 user nova-compute[74190]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)
Oct 18 11:44:11 user nova-compute[74190]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c585296-c9a9-4c7f-8757-618a59bd01d8 (non-flash)
Oct 18 11:44:11 user nova-compute[74190]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8097d82-d1b3-459d-8331-682cbe592d49 (non-flash)
Oct 18 11:44:11 user nova-compute[74190]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e1907e5-89a1-4792-a656-59422463e8a1 (non-flash)
Oct 18 11:44:11 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:44:11 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a461f47-dc20-4e0f-adea-7cd9285428d6 tempest-TestVolumeSwap-670055737 tempest-TestVolumeSwap-670055737-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920 (non-flash)
Oct 18 11:44:11 user nova-compute[74190]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)
Oct 18 11:44:11 user nova-compute[74190]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)
Oct 18 11:44:11 user nova-compute[74190]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)
Oct 18 11:44:11 user nova-compute[74190]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c585296-c9a9-4c7f-8757-618a59bd01d8 (non-flash)
Oct 18 11:44:11 user nova-compute[74190]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8097d82-d1b3-459d-8331-682cbe592d49 (non-flash)
Oct 18 11:44:11 user nova-compute[74190]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e1907e5-89a1-4792-a656-59422463e8a1 (non-flash)
Oct 18 11:44:11 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:44:11 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a461f47-dc20-4e0f-adea-7cd9285428d6 tempest-TestVolumeSwap-670055737 tempest-TestVolumeSwap-670055737-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1f44538790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c585296-c9a9-4c7f-8757-618a59bd01d8'): ({'sdg'}, set())}) {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 11:44:11 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-7a461f47-dc20-4e0f-adea-7cd9285428d6 tempest-TestVolumeSwap-670055737 tempest-TestVolumeSwap-670055737-project-admin] Removing single pathed devices sdg {{(pid=74190) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 11:44:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:11 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[9211eca5-c5a8-4b91-9bf2-832092d16ed1]: (4, ('path checker states:\nup                  6\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.022s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:11 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea78c07-1afb-4745-8fee-0ffcca60ac37]: (4, ('ok\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:11 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-7a461f47-dc20-4e0f-adea-7cd9285428d6 tempest-TestVolumeSwap-670055737 tempest-TestVolumeSwap-670055737-project-admin] Flushing IO for device /dev/sdg {{(pid=74190) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 11:44:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:11 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[c094e7eb-69ff-4d2a-83ff-ab984625ee41]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:11 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-7a461f47-dc20-4e0f-adea-7cd9285428d6 tempest-TestVolumeSwap-670055737 tempest-TestVolumeSwap-670055737-project-admin] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74190) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 11:44:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.055s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:11 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd790115-e48a-41c0-a02e-11eb0af9e21c]: (4, ('1', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:11 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-7a461f47-dc20-4e0f-adea-7cd9285428d6 tempest-TestVolumeSwap-670055737 tempest-TestVolumeSwap-670055737-project-admin] Checking to see if SCSI volumes sdg have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 11:44:11 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-7a461f47-dc20-4e0f-adea-7cd9285428d6 tempest-TestVolumeSwap-670055737 tempest-TestVolumeSwap-670055737-project-admin] SCSI volumes sdg have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 11:44:11 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a461f47-dc20-4e0f-adea-7cd9285428d6 tempest-TestVolumeSwap-670055737 tempest-TestVolumeSwap-670055737-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c585296-c9a9-4c7f-8757-618a59bd01d8')] {{(pid=74190) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 11:44:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c585296-c9a9-4c7f-8757-618a59bd01d8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c585296-c9a9-4c7f-8757-618a59bd01d8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:11 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[e069e67f-a0c0-43a1-89e3-13edcfc68af7]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:11 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a461f47-dc20-4e0f-adea-7cd9285428d6 tempest-TestVolumeSwap-670055737 tempest-TestVolumeSwap-670055737-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:44:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c585296-c9a9-4c7f-8757-618a59bd01d8 -p 172.16.0.220:3260 --logout {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c585296-c9a9-4c7f-8757-618a59bd01d8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:11 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[c092c949-dfad-41c0-b231-2022b04b04e2]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:8c585296-c9a9-4c7f-8757-618a59bd01d8, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:8c585296-c9a9-4c7f-8757-618a59bd01d8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:11 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a461f47-dc20-4e0f-adea-7cd9285428d6 tempest-TestVolumeSwap-670055737 tempest-TestVolumeSwap-670055737-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:8c585296-c9a9-4c7f-8757-618a59bd01d8, portal: 172.16.0.220,3260]
Oct 18 11:44:11 user nova-compute[74190]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:8c585296-c9a9-4c7f-8757-618a59bd01d8, portal: 172.16.0.220,3260] successful.
Oct 18 11:44:11 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:44:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c585296-c9a9-4c7f-8757-618a59bd01d8 -p 172.16.0.220:3260 --op delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c585296-c9a9-4c7f-8757-618a59bd01d8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:11 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c68109-129d-4de2-a170-aa7d0b2317f9]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:11 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a461f47-dc20-4e0f-adea-7cd9285428d6 tempest-TestVolumeSwap-670055737 tempest-TestVolumeSwap-670055737-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:44:11 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-7a461f47-dc20-4e0f-adea-7cd9285428d6 tempest-TestVolumeSwap-670055737 tempest-TestVolumeSwap-670055737-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.380s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:44:11 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a461f47-dc20-4e0f-adea-7cd9285428d6 tempest-TestVolumeSwap-670055737 tempest-TestVolumeSwap-670055737-project-admin] <== disconnect_volume: return (382ms) None {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:44:11 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a461f47-dc20-4e0f-adea-7cd9285428d6 tempest-TestVolumeSwap-670055737 tempest-TestVolumeSwap-670055737-project-admin] [instance: 034398e8-e8c4-4e03-a608-440e447c6041] Disconnected iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 11:44:12 user nova-compute[74190]: DEBUG nova.compute.manager [None req-7a461f47-dc20-4e0f-adea-7cd9285428d6 tempest-TestVolumeSwap-670055737 tempest-TestVolumeSwap-670055737-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'liIufdwV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '034398e8-e8c4-4e03-a608-440e447c6041', 'attached_at': '', 'detached_at': '', 'volume_id': 'd7b43003-2d4b-49b0-8449-6fb2ee281920', 'serial'} {{(pid=74190) _swap_volume /opt/stack/nova/nova/compute/manager.py:7790}}
Oct 18 11:44:12 user nova-compute[74190]: DEBUG nova.compute.manager [None req-7a461f47-dc20-4e0f-adea-7cd9285428d6 tempest-TestVolumeSwap-670055737 tempest-TestVolumeSwap-670055737-project-admin] [instance: 034398e8-e8c4-4e03-a608-440e447c6041] swap_volume: removing Cinder connection for volume 8c585296-c9a9-4c7f-8757-618a59bd01d8 {{(pid=74190) _swap_volume /opt/stack/nova/nova/compute/manager.py:7835}}
Oct 18 11:44:12 user nova-compute[74190]: DEBUG nova.compute.manager [None req-7a461f47-dc20-4e0f-adea-7cd9285428d6 tempest-TestVolumeSwap-670055737 tempest-TestVolumeSwap-670055737-project-admin] [instance: 034398e8-e8c4-4e03-a608-440e447c6041] swap_volume: Updating volume 8c585296-c9a9-4c7f-8757-618a59bd01d8 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "liIufdwV", "auth_password": "yW4rxBoJzR5CNb", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sde", "volume_id": "d7b43003-2d4b-49b0-8449-6fb2ee281920"}, "status": "reserved", "instance": "034398e8-e8c4-4e03-a608-440e447c6041", "attached_at": "", "detached_at": "", "volume_id": "d7b43003-2d4b-49b0-8449-6fb2ee281920", "serial": "d7b43003-2d4b-49b0-8449-6fb2ee281920"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'd7b43003-2d4b-49b0-8449-6fb2ee281920', 'no_device': None, 'attachment_id': '1e6c59c5-7709-4d3d-9b15-02ac21c5899b'} {{(pid=74190) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7983}}
Oct 18 11:44:12 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-7a461f47-dc20-4e0f-adea-7cd9285428d6 tempest-TestVolumeSwap-670055737 tempest-TestVolumeSwap-670055737-project-admin] Lock "034398e8-e8c4-4e03-a608-440e447c6041" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 27.826s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:44:13 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-2d8b3904-7b29-41b4-9948-e674bb5b8d11 tempest-TestVolumeSwap-670055737 tempest-TestVolumeSwap-670055737-project-admin] Acquiring lock "034398e8-e8c4-4e03-a608-440e447c6041" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:44:13 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-2d8b3904-7b29-41b4-9948-e674bb5b8d11 tempest-TestVolumeSwap-670055737 tempest-TestVolumeSwap-670055737-project-admin] Lock "034398e8-e8c4-4e03-a608-440e447c6041" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:44:13 user nova-compute[74190]: DEBUG os_brick.utils [None req-2d8b3904-7b29-41b4-9948-e674bb5b8d11 tempest-TestVolumeSwap-670055737 tempest-TestVolumeSwap-670055737-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:44:13 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:13 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:13 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[b11b13a3-f55a-43f8-a1ff-09cd18f6e91c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cff158e257e1\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:13 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:13 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:13 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d8e089-4002-4ef9-b60b-59c24300bbff]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:13 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:13 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:13 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea8e19f8-a8f1-414b-825b-2a38bafaea6c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:13 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f60458-85c7-4454-b728-24e0f5af962d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:13 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-2d8b3904-7b29-41b4-9948-e674bb5b8d11 tempest-TestVolumeSwap-670055737 tempest-TestVolumeSwap-670055737-project-admin] Running cmd (subprocess): nvme version {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:13 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-2d8b3904-7b29-41b4-9948-e674bb5b8d11 tempest-TestVolumeSwap-670055737 tempest-TestVolumeSwap-670055737-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 11:44:13 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2d8b3904-7b29-41b4-9948-e674bb5b8d11 tempest-TestVolumeSwap-670055737 tempest-TestVolumeSwap-670055737-project-admin] nvme not present on system {{(pid=74190) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 11:44:13 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:13 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 11:44:13 user nova-compute[74190]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 11:44:13 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[015a5b67-011d-42e1-9eff-65e3d4754164]: (4, '') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:13 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-2d8b3904-7b29-41b4-9948-e674bb5b8d11 tempest-TestVolumeSwap-670055737 tempest-TestVolumeSwap-670055737-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74190) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 11:44:13 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-2d8b3904-7b29-41b4-9948-e674bb5b8d11 tempest-TestVolumeSwap-670055737 tempest-TestVolumeSwap-670055737-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 11:44:13 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-2d8b3904-7b29-41b4-9948-e674bb5b8d11 tempest-TestVolumeSwap-670055737 tempest-TestVolumeSwap-670055737-project-admin] LIGHTOS: no hostnqn found. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 11:44:13 user nova-compute[74190]: DEBUG os_brick.utils [None req-2d8b3904-7b29-41b4-9948-e674bb5b8d11 tempest-TestVolumeSwap-670055737 tempest-TestVolumeSwap-670055737-project-admin] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cff158e257e1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:44:14 user nova-compute[74190]: INFO nova.compute.manager [None req-2d8b3904-7b29-41b4-9948-e674bb5b8d11 tempest-TestVolumeSwap-670055737 tempest-TestVolumeSwap-670055737-project-admin] [instance: 034398e8-e8c4-4e03-a608-440e447c6041] Swapping volume d7b43003-2d4b-49b0-8449-6fb2ee281920 for 8c585296-c9a9-4c7f-8757-618a59bd01d8
Oct 18 11:44:14 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:44:14 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:14 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74190) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 11:44:14 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 11:44:14 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 11:44:14 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:16 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-0946596a-d870-4e19-bd05-8baaef641fb7 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance d56b243d-fbf2-4ae6-8399-80df46b33b82 is timed out.
Oct 18 11:44:16 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-0946596a-d870-4e19-bd05-8baaef641fb7 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Successfully detached device sdc from instance d56b243d-fbf2-4ae6-8399-80df46b33b82 from the live domain config.
Oct 18 11:44:16 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0946596a-d870-4e19-bd05-8baaef641fb7 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] [instance: d56b243d-fbf2-4ae6-8399-80df46b33b82] calling os-brick to detach iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 11:44:16 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-0946596a-d870-4e19-bd05-8baaef641fb7 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, {'target_iqn': 'iqn.2010-10.org.openstack:e8097d82-d1b3-459d-8331-682cbe592d49', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MCHISnEL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:44:16 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-0946596a-d870-4e19-bd05-8baaef641fb7 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:44:16 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-0946596a-d870-4e19-bd05-8baaef641fb7 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:44:16 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-0946596a-d870-4e19-bd05-8baaef641fb7 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:44:16 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:16 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:16 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce24f7e2-5fc6-43c2-91b9-9594117e22b0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e8097d82-d1b3-459d-8331-682cbe592d49\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3e1907e5-89a1-4792-a656-59422463e8a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:16 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-0946596a-d870-4e19-bd05-8baaef641fb7 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 11:44:16 user nova-compute[74190]: No targets found.
Oct 18 11:44:16 user nova-compute[74190]: iSNS:
Oct 18 11:44:16 user nova-compute[74190]: No targets found.
Oct 18 11:44:16 user nova-compute[74190]: STATIC:
Oct 18 11:44:16 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a
Oct 18 11:44:16 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:44:16 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:44:16 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920
Oct 18 11:44:16 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:44:16 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:44:16 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:e8097d82-d1b3-459d-8331-682cbe592d49
Oct 18 11:44:16 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:44:16 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:44:16 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb
Oct 18 11:44:16 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:44:16 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:44:16 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:3e1907e5-89a1-4792-a656-59422463e8a1
Oct 18 11:44:16 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:44:16 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:44:16 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c
Oct 18 11:44:16 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:44:16 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:44:16 user nova-compute[74190]: FIRMWARE:
Oct 18 11:44:16 user nova-compute[74190]: No targets found.
Oct 18 11:44:16 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:44:16 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-0946596a-d870-4e19-bd05-8baaef641fb7 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 11:44:16 user nova-compute[74190]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 11:44:16 user nova-compute[74190]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74190) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 11:44:16 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-0946596a-d870-4e19-bd05-8baaef641fb7 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8097d82-d1b3-459d-8331-682cbe592d49', 0)] {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 11:44:16 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:16 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:16 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a517962-8c85-43b8-9ed3-fc73ed2c884f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e1907e5-89a1-4792-a656-59422463e8a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8097d82-d1b3-459d-8331-682cbe592d49\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:16 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:16 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:16 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b301f11-1d26-4e45-a3ba-1e4ac882808a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8097d82-d1b3-459d-8331-682cbe592d49 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e1907e5-89a1-4792-a656-59422463e8a1 (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:16 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-0946596a-d870-4e19-bd05-8baaef641fb7 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920 (non-flash)
Oct 18 11:44:16 user nova-compute[74190]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)
Oct 18 11:44:16 user nova-compute[74190]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)
Oct 18 11:44:16 user nova-compute[74190]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)
Oct 18 11:44:16 user nova-compute[74190]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8097d82-d1b3-459d-8331-682cbe592d49 (non-flash)
Oct 18 11:44:16 user nova-compute[74190]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e1907e5-89a1-4792-a656-59422463e8a1 (non-flash)
Oct 18 11:44:16 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:44:16 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-0946596a-d870-4e19-bd05-8baaef641fb7 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920 (non-flash)
Oct 18 11:44:16 user nova-compute[74190]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)
Oct 18 11:44:16 user nova-compute[74190]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)
Oct 18 11:44:16 user nova-compute[74190]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)
Oct 18 11:44:16 user nova-compute[74190]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8097d82-d1b3-459d-8331-682cbe592d49 (non-flash)
Oct 18 11:44:16 user nova-compute[74190]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e1907e5-89a1-4792-a656-59422463e8a1 (non-flash)
Oct 18 11:44:16 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:44:16 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-0946596a-d870-4e19-bd05-8baaef641fb7 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1f44660ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8097d82-d1b3-459d-8331-682cbe592d49'): ({'sdh'}, set())}) {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 11:44:16 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-0946596a-d870-4e19-bd05-8baaef641fb7 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Removing single pathed devices sdh {{(pid=74190) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 11:44:16 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:16 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:16 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[b873963e-89eb-416b-8400-7143ff02d7e6]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:16 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:16 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:16 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[f40d1987-0fd1-4cfa-bda2-00132522ecd1]: (4, ('ok\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:16 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-0946596a-d870-4e19-bd05-8baaef641fb7 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Flushing IO for device /dev/sdh {{(pid=74190) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 11:44:16 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:16 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.015s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:16 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e70bdc3-b908-48b6-a639-32a38b16d73b]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:16 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-0946596a-d870-4e19-bd05-8baaef641fb7 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74190) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 11:44:16 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:16 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.046s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:16 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[aca13478-db9c-4e2a-8569-2ba64cb438f4]: (4, ('1', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:16 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-0946596a-d870-4e19-bd05-8baaef641fb7 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 11:44:16 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-0946596a-d870-4e19-bd05-8baaef641fb7 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] SCSI volumes sdh have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 11:44:16 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-0946596a-d870-4e19-bd05-8baaef641fb7 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8097d82-d1b3-459d-8331-682cbe592d49')] {{(pid=74190) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 11:44:16 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8097d82-d1b3-459d-8331-682cbe592d49 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:16 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8097d82-d1b3-459d-8331-682cbe592d49 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:16 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d55ba5-4f22-43af-b731-b9b4a53e0d1f]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:16 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-0946596a-d870-4e19-bd05-8baaef641fb7 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:44:16 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8097d82-d1b3-459d-8331-682cbe592d49 -p 172.16.0.220:3260 --logout {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:16 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8097d82-d1b3-459d-8331-682cbe592d49 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:16 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ceece03-f954-4b4f-9320-0025ea5227ac]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:e8097d82-d1b3-459d-8331-682cbe592d49, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:e8097d82-d1b3-459d-8331-682cbe592d49, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:16 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-0946596a-d870-4e19-bd05-8baaef641fb7 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:e8097d82-d1b3-459d-8331-682cbe592d49, portal: 172.16.0.220,3260]
Oct 18 11:44:16 user nova-compute[74190]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:e8097d82-d1b3-459d-8331-682cbe592d49, portal: 172.16.0.220,3260] successful.
Oct 18 11:44:16 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:44:16 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8097d82-d1b3-459d-8331-682cbe592d49 -p 172.16.0.220:3260 --op delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:16 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8097d82-d1b3-459d-8331-682cbe592d49 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:16 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b7b055-a533-42f4-b822-b9c0ee9db0fe]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:16 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-0946596a-d870-4e19-bd05-8baaef641fb7 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:44:16 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-0946596a-d870-4e19-bd05-8baaef641fb7 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:44:16 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-0946596a-d870-4e19-bd05-8baaef641fb7 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] <== disconnect_volume: return (339ms) None {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:44:16 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0946596a-d870-4e19-bd05-8baaef641fb7 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] [instance: d56b243d-fbf2-4ae6-8399-80df46b33b82] Disconnected iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 11:44:17 user nova-compute[74190]: DEBUG nova.objects.instance [None req-0946596a-d870-4e19-bd05-8baaef641fb7 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Lazy-loading 'flavor' on Instance uuid d56b243d-fbf2-4ae6-8399-80df46b33b82 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:44:17 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-0946596a-d870-4e19-bd05-8baaef641fb7 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Lock "d56b243d-fbf2-4ae6-8399-80df46b33b82" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.217s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:44:17 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-e6cc62d4-07be-4da3-9de2-0283b2fbd923 tempest-VolumesAssistedSnapshotsTest-63445179 tempest-VolumesAssistedSnapshotsTest-63445179-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 697d3123-bd6b-42b9-b278-c33c0c00da6f is timed out.
Oct 18 11:44:17 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-e6cc62d4-07be-4da3-9de2-0283b2fbd923 tempest-VolumesAssistedSnapshotsTest-63445179 tempest-VolumesAssistedSnapshotsTest-63445179-project-admin] Successfully detached device vdb from instance 697d3123-bd6b-42b9-b278-c33c0c00da6f from the live domain config.
Oct 18 11:44:17 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6cc62d4-07be-4da3-9de2-0283b2fbd923 tempest-VolumesAssistedSnapshotsTest-63445179 tempest-VolumesAssistedSnapshotsTest-63445179-project-admin] [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f] calling os-brick to detach iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 11:44:17 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6cc62d4-07be-4da3-9de2-0283b2fbd923 tempest-VolumesAssistedSnapshotsTest-63445179 tempest-VolumesAssistedSnapshotsTest-63445179-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, {'target_iqn': 'iqn.2010-10.org.openstack:3e1907e5-89a1-4792-a656-59422463e8a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eNvYHWLc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:44:17 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-e6cc62d4-07be-4da3-9de2-0283b2fbd923 tempest-VolumesAssistedSnapshotsTest-63445179 tempest-VolumesAssistedSnapshotsTest-63445179-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:44:17 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-e6cc62d4-07be-4da3-9de2-0283b2fbd923 tempest-VolumesAssistedSnapshotsTest-63445179 tempest-VolumesAssistedSnapshotsTest-63445179-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:44:17 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-e6cc62d4-07be-4da3-9de2-0283b2fbd923 tempest-VolumesAssistedSnapshotsTest-63445179 tempest-VolumesAssistedSnapshotsTest-63445179-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:44:17 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:17 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:17 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b9770e4-18b6-48b0-9c81-cc8b4c933956]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3e1907e5-89a1-4792-a656-59422463e8a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:17 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6cc62d4-07be-4da3-9de2-0283b2fbd923 tempest-VolumesAssistedSnapshotsTest-63445179 tempest-VolumesAssistedSnapshotsTest-63445179-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 11:44:17 user nova-compute[74190]: No targets found.
Oct 18 11:44:17 user nova-compute[74190]: iSNS:
Oct 18 11:44:17 user nova-compute[74190]: No targets found.
Oct 18 11:44:17 user nova-compute[74190]: STATIC:
Oct 18 11:44:17 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a
Oct 18 11:44:17 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:44:17 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:44:17 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920
Oct 18 11:44:17 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:44:17 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:44:17 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb
Oct 18 11:44:17 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:44:17 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:44:17 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:3e1907e5-89a1-4792-a656-59422463e8a1
Oct 18 11:44:17 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:44:17 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:44:17 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c
Oct 18 11:44:17 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:44:17 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:44:17 user nova-compute[74190]: FIRMWARE:
Oct 18 11:44:17 user nova-compute[74190]: No targets found.
Oct 18 11:44:17 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:44:17 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6cc62d4-07be-4da3-9de2-0283b2fbd923 tempest-VolumesAssistedSnapshotsTest-63445179 tempest-VolumesAssistedSnapshotsTest-63445179-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 11:44:17 user nova-compute[74190]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 11:44:17 user nova-compute[74190]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74190) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 11:44:17 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6cc62d4-07be-4da3-9de2-0283b2fbd923 tempest-VolumesAssistedSnapshotsTest-63445179 tempest-VolumesAssistedSnapshotsTest-63445179-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e1907e5-89a1-4792-a656-59422463e8a1', 0)] {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 11:44:17 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:17 user nova-compute[74190]: ERROR nova.volume.cinder [None req-2d8b3904-7b29-41b4-9948-e674bb5b8d11 tempest-TestVolumeSwap-670055737 tempest-TestVolumeSwap-670055737-project-admin] Update attachment failed for attachment 5164ba6c-e6c3-4fe8-9e94-9bebbf29f609. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-34e7c7f3-759f-44e4-b242-4b0135fb775d) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-34e7c7f3-759f-44e4-b242-4b0135fb775d)
Oct 18 11:44:17 user nova-compute[74190]: ERROR nova.compute.manager [None req-2d8b3904-7b29-41b4-9948-e674bb5b8d11 tempest-TestVolumeSwap-670055737 tempest-TestVolumeSwap-670055737-project-admin] [instance: 034398e8-e8c4-4e03-a608-440e447c6041] Failed to connect to volume 8c585296-c9a9-4c7f-8757-618a59bd01d8 with volume at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-34e7c7f3-759f-44e4-b242-4b0135fb775d)
Oct 18 11:44:17 user nova-compute[74190]: ERROR nova.compute.manager [instance: 034398e8-e8c4-4e03-a608-440e447c6041] Traceback (most recent call last):
Oct 18 11:44:17 user nova-compute[74190]: ERROR nova.compute.manager [instance: 034398e8-e8c4-4e03-a608-440e447c6041]   File "/opt/stack/nova/nova/compute/manager.py", line 7769, in _swap_volume
Oct 18 11:44:17 user nova-compute[74190]: ERROR nova.compute.manager [instance: 034398e8-e8c4-4e03-a608-440e447c6041]     old_cinfo, new_cinfo = self._init_volume_connection(
Oct 18 11:44:17 user nova-compute[74190]: ERROR nova.compute.manager [instance: 034398e8-e8c4-4e03-a608-440e447c6041]   File "/opt/stack/nova/nova/compute/manager.py", line 7742, in _init_volume_connection
Oct 18 11:44:17 user nova-compute[74190]: ERROR nova.compute.manager [instance: 034398e8-e8c4-4e03-a608-440e447c6041]     new_cinfo = self.volume_api.attachment_update(
Oct 18 11:44:17 user nova-compute[74190]: ERROR nova.compute.manager [instance: 034398e8-e8c4-4e03-a608-440e447c6041]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 18 11:44:17 user nova-compute[74190]: ERROR nova.compute.manager [instance: 034398e8-e8c4-4e03-a608-440e447c6041]     res = method(self, ctx, *args, **kwargs)
Oct 18 11:44:17 user nova-compute[74190]: ERROR nova.compute.manager [instance: 034398e8-e8c4-4e03-a608-440e447c6041]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 18 11:44:17 user nova-compute[74190]: ERROR nova.compute.manager [instance: 034398e8-e8c4-4e03-a608-440e447c6041]     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 18 11:44:17 user nova-compute[74190]: ERROR nova.compute.manager [instance: 034398e8-e8c4-4e03-a608-440e447c6041]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 18 11:44:17 user nova-compute[74190]: ERROR nova.compute.manager [instance: 034398e8-e8c4-4e03-a608-440e447c6041]     with excutils.save_and_reraise_exception():
Oct 18 11:44:17 user nova-compute[74190]: ERROR nova.compute.manager [instance: 034398e8-e8c4-4e03-a608-440e447c6041]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 18 11:44:17 user nova-compute[74190]: ERROR nova.compute.manager [instance: 034398e8-e8c4-4e03-a608-440e447c6041]     self.force_reraise()
Oct 18 11:44:17 user nova-compute[74190]: ERROR nova.compute.manager [instance: 034398e8-e8c4-4e03-a608-440e447c6041]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 18 11:44:17 user nova-compute[74190]: ERROR nova.compute.manager [instance: 034398e8-e8c4-4e03-a608-440e447c6041]     raise self.value
Oct 18 11:44:17 user nova-compute[74190]: ERROR nova.compute.manager [instance: 034398e8-e8c4-4e03-a608-440e447c6041]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 18 11:44:17 user nova-compute[74190]: ERROR nova.compute.manager [instance: 034398e8-e8c4-4e03-a608-440e447c6041]     context, '3.44', skip_version_check=True).attachments.update(
Oct 18 11:44:17 user nova-compute[74190]: ERROR nova.compute.manager [instance: 034398e8-e8c4-4e03-a608-440e447c6041]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 18 11:44:17 user nova-compute[74190]: ERROR nova.compute.manager [instance: 034398e8-e8c4-4e03-a608-440e447c6041]     return method.func(obj, *args, **kwargs)
Oct 18 11:44:17 user nova-compute[74190]: ERROR nova.compute.manager [instance: 034398e8-e8c4-4e03-a608-440e447c6041]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 18 11:44:17 user nova-compute[74190]: ERROR nova.compute.manager [instance: 034398e8-e8c4-4e03-a608-440e447c6041]     resp = self._update('/attachments/%s' % id, body)
Oct 18 11:44:17 user nova-compute[74190]: ERROR nova.compute.manager [instance: 034398e8-e8c4-4e03-a608-440e447c6041]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 18 11:44:17 user nova-compute[74190]: ERROR nova.compute.manager [instance: 034398e8-e8c4-4e03-a608-440e447c6041]     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 18 11:44:17 user nova-compute[74190]: ERROR nova.compute.manager [instance: 034398e8-e8c4-4e03-a608-440e447c6041]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 18 11:44:17 user nova-compute[74190]: ERROR nova.compute.manager [instance: 034398e8-e8c4-4e03-a608-440e447c6041]     return self._cs_request(url, 'PUT', **kwargs)
Oct 18 11:44:17 user nova-compute[74190]: ERROR nova.compute.manager [instance: 034398e8-e8c4-4e03-a608-440e447c6041]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 18 11:44:17 user nova-compute[74190]: ERROR nova.compute.manager [instance: 034398e8-e8c4-4e03-a608-440e447c6041]     return self.request(url, method, **kwargs)
Oct 18 11:44:17 user nova-compute[74190]: ERROR nova.compute.manager [instance: 034398e8-e8c4-4e03-a608-440e447c6041]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 18 11:44:17 user nova-compute[74190]: ERROR nova.compute.manager [instance: 034398e8-e8c4-4e03-a608-440e447c6041]     raise exceptions.from_response(resp, body)
Oct 18 11:44:17 user nova-compute[74190]: ERROR nova.compute.manager [instance: 034398e8-e8c4-4e03-a608-440e447c6041] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-34e7c7f3-759f-44e4-b242-4b0135fb775d)
Oct 18 11:44:17 user nova-compute[74190]: ERROR nova.compute.manager [instance: 034398e8-e8c4-4e03-a608-440e447c6041] 
Oct 18 11:44:17 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:17 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[320e4e98-2f0d-4f16-b003-7ef08220bd78]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e1907e5-89a1-4792-a656-59422463e8a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:17 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:17 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:17 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[916b8a3b-994e-4eaf-be42-0368ce8c9e10]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e1907e5-89a1-4792-a656-59422463e8a1 (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:17 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6cc62d4-07be-4da3-9de2-0283b2fbd923 tempest-VolumesAssistedSnapshotsTest-63445179 tempest-VolumesAssistedSnapshotsTest-63445179-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920 (non-flash)
Oct 18 11:44:17 user nova-compute[74190]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)
Oct 18 11:44:17 user nova-compute[74190]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)
Oct 18 11:44:17 user nova-compute[74190]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)
Oct 18 11:44:17 user nova-compute[74190]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e1907e5-89a1-4792-a656-59422463e8a1 (non-flash)
Oct 18 11:44:17 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:44:17 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6cc62d4-07be-4da3-9de2-0283b2fbd923 tempest-VolumesAssistedSnapshotsTest-63445179 tempest-VolumesAssistedSnapshotsTest-63445179-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920 (non-flash)
Oct 18 11:44:17 user nova-compute[74190]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)
Oct 18 11:44:17 user nova-compute[74190]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)
Oct 18 11:44:17 user nova-compute[74190]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)
Oct 18 11:44:17 user nova-compute[74190]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e1907e5-89a1-4792-a656-59422463e8a1 (non-flash)
Oct 18 11:44:17 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:44:17 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6cc62d4-07be-4da3-9de2-0283b2fbd923 tempest-VolumesAssistedSnapshotsTest-63445179 tempest-VolumesAssistedSnapshotsTest-63445179-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1f44404790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e1907e5-89a1-4792-a656-59422463e8a1'): ({'sdi'}, set())}) {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 11:44:17 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-e6cc62d4-07be-4da3-9de2-0283b2fbd923 tempest-VolumesAssistedSnapshotsTest-63445179 tempest-VolumesAssistedSnapshotsTest-63445179-project-admin] Removing single pathed devices sdi {{(pid=74190) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 11:44:17 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:17 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:17 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[a157afe1-972d-4fab-aa67-6a6221f662a4]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:17 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:18 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[970cf2d1-3784-44f9-a416-a0ef52ed8c34]: (4, ('ok\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:18 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-e6cc62d4-07be-4da3-9de2-0283b2fbd923 tempest-VolumesAssistedSnapshotsTest-63445179 tempest-VolumesAssistedSnapshotsTest-63445179-project-admin] Flushing IO for device /dev/sdi {{(pid=74190) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 11:44:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:18 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[0afcb7de-d8d4-43c7-90a2-019b74c77692]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:18 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-e6cc62d4-07be-4da3-9de2-0283b2fbd923 tempest-VolumesAssistedSnapshotsTest-63445179 tempest-VolumesAssistedSnapshotsTest-63445179-project-admin] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=74190) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 11:44:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.056s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:18 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a7d1244-8334-4888-8f05-48c8bdcbe8f8]: (4, ('1', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:18 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-e6cc62d4-07be-4da3-9de2-0283b2fbd923 tempest-VolumesAssistedSnapshotsTest-63445179 tempest-VolumesAssistedSnapshotsTest-63445179-project-admin] Checking to see if SCSI volumes sdi have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 11:44:18 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-e6cc62d4-07be-4da3-9de2-0283b2fbd923 tempest-VolumesAssistedSnapshotsTest-63445179 tempest-VolumesAssistedSnapshotsTest-63445179-project-admin] SCSI volumes sdi have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 11:44:18 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6cc62d4-07be-4da3-9de2-0283b2fbd923 tempest-VolumesAssistedSnapshotsTest-63445179 tempest-VolumesAssistedSnapshotsTest-63445179-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e1907e5-89a1-4792-a656-59422463e8a1')] {{(pid=74190) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 11:44:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e1907e5-89a1-4792-a656-59422463e8a1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e1907e5-89a1-4792-a656-59422463e8a1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:18 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a8820de-7ccc-4fbb-965b-11f279ae5ef0]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:18 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6cc62d4-07be-4da3-9de2-0283b2fbd923 tempest-VolumesAssistedSnapshotsTest-63445179 tempest-VolumesAssistedSnapshotsTest-63445179-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:44:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e1907e5-89a1-4792-a656-59422463e8a1 -p 172.16.0.220:3260 --logout {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:18 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-2d8b3904-7b29-41b4-9948-e674bb5b8d11 tempest-TestVolumeSwap-670055737 tempest-TestVolumeSwap-670055737-project-admin] Lock "034398e8-e8c4-4e03-a608-440e447c6041" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 4.333s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:44:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e1907e5-89a1-4792-a656-59422463e8a1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:18 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fa2c7f7-ccf1-4c6a-b093-0c644e80e22a]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:3e1907e5-89a1-4792-a656-59422463e8a1, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:3e1907e5-89a1-4792-a656-59422463e8a1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:18 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6cc62d4-07be-4da3-9de2-0283b2fbd923 tempest-VolumesAssistedSnapshotsTest-63445179 tempest-VolumesAssistedSnapshotsTest-63445179-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:3e1907e5-89a1-4792-a656-59422463e8a1, portal: 172.16.0.220,3260]
Oct 18 11:44:18 user nova-compute[74190]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:3e1907e5-89a1-4792-a656-59422463e8a1, portal: 172.16.0.220,3260] successful.
Oct 18 11:44:18 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:44:18 user nova-compute[74190]: ERROR oslo_messaging.rpc.server [None req-2d8b3904-7b29-41b4-9948-e674bb5b8d11 tempest-TestVolumeSwap-670055737 tempest-TestVolumeSwap-670055737-project-admin] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-34e7c7f3-759f-44e4-b242-4b0135fb775d)
Oct 18 11:44:18 user nova-compute[74190]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 18 11:44:18 user nova-compute[74190]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 18 11:44:18 user nova-compute[74190]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 18 11:44:18 user nova-compute[74190]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 18 11:44:18 user nova-compute[74190]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 18 11:44:18 user nova-compute[74190]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 18 11:44:18 user nova-compute[74190]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 18 11:44:18 user nova-compute[74190]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 18 11:44:18 user nova-compute[74190]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 18 11:44:18 user nova-compute[74190]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 18 11:44:18 user nova-compute[74190]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 18 11:44:18 user nova-compute[74190]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 18 11:44:18 user nova-compute[74190]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 18 11:44:18 user nova-compute[74190]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 18 11:44:18 user nova-compute[74190]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 18 11:44:18 user nova-compute[74190]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Oct 18 11:44:18 user nova-compute[74190]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 18 11:44:18 user nova-compute[74190]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Oct 18 11:44:18 user nova-compute[74190]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 18 11:44:18 user nova-compute[74190]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 18 11:44:18 user nova-compute[74190]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 18 11:44:18 user nova-compute[74190]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 18 11:44:18 user nova-compute[74190]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 18 11:44:18 user nova-compute[74190]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Oct 18 11:44:18 user nova-compute[74190]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 18 11:44:18 user nova-compute[74190]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7902, in swap_volume
Oct 18 11:44:18 user nova-compute[74190]: ERROR oslo_messaging.rpc.server     _do_locked_swap_volume(context, old_volume_id, new_volume_id, instance,
Oct 18 11:44:18 user nova-compute[74190]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Oct 18 11:44:18 user nova-compute[74190]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Oct 18 11:44:18 user nova-compute[74190]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7900, in _do_locked_swap_volume
Oct 18 11:44:18 user nova-compute[74190]: ERROR oslo_messaging.rpc.server     self._do_swap_volume(context, old_volume_id, new_volume_id,
Oct 18 11:44:18 user nova-compute[74190]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7944, in _do_swap_volume
Oct 18 11:44:18 user nova-compute[74190]: ERROR oslo_messaging.rpc.server     comp_ret, new_cinfo = self._swap_volume(context,
Oct 18 11:44:18 user nova-compute[74190]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7793, in _swap_volume
Oct 18 11:44:18 user nova-compute[74190]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 18 11:44:18 user nova-compute[74190]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 18 11:44:18 user nova-compute[74190]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 18 11:44:18 user nova-compute[74190]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 18 11:44:18 user nova-compute[74190]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 18 11:44:18 user nova-compute[74190]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7769, in _swap_volume
Oct 18 11:44:18 user nova-compute[74190]: ERROR oslo_messaging.rpc.server     old_cinfo, new_cinfo = self._init_volume_connection(
Oct 18 11:44:18 user nova-compute[74190]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7742, in _init_volume_connection
Oct 18 11:44:18 user nova-compute[74190]: ERROR oslo_messaging.rpc.server     new_cinfo = self.volume_api.attachment_update(
Oct 18 11:44:18 user nova-compute[74190]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 18 11:44:18 user nova-compute[74190]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Oct 18 11:44:18 user nova-compute[74190]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 18 11:44:18 user nova-compute[74190]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 18 11:44:18 user nova-compute[74190]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 18 11:44:18 user nova-compute[74190]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 18 11:44:18 user nova-compute[74190]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 18 11:44:18 user nova-compute[74190]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 18 11:44:18 user nova-compute[74190]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 18 11:44:18 user nova-compute[74190]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 18 11:44:18 user nova-compute[74190]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 18 11:44:18 user nova-compute[74190]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Oct 18 11:44:18 user nova-compute[74190]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 18 11:44:18 user nova-compute[74190]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Oct 18 11:44:18 user nova-compute[74190]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 18 11:44:18 user nova-compute[74190]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Oct 18 11:44:18 user nova-compute[74190]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 18 11:44:18 user nova-compute[74190]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 18 11:44:18 user nova-compute[74190]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 18 11:44:18 user nova-compute[74190]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Oct 18 11:44:18 user nova-compute[74190]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 18 11:44:18 user nova-compute[74190]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Oct 18 11:44:18 user nova-compute[74190]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 18 11:44:18 user nova-compute[74190]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Oct 18 11:44:18 user nova-compute[74190]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-34e7c7f3-759f-44e4-b242-4b0135fb775d)
Oct 18 11:44:18 user nova-compute[74190]: ERROR oslo_messaging.rpc.server 
Oct 18 11:44:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e1907e5-89a1-4792-a656-59422463e8a1 -p 172.16.0.220:3260 --op delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e1907e5-89a1-4792-a656-59422463e8a1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:18 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b21ae03-19bf-4fea-a910-77279048302f]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:18 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6cc62d4-07be-4da3-9de2-0283b2fbd923 tempest-VolumesAssistedSnapshotsTest-63445179 tempest-VolumesAssistedSnapshotsTest-63445179-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:44:18 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-e6cc62d4-07be-4da3-9de2-0283b2fbd923 tempest-VolumesAssistedSnapshotsTest-63445179 tempest-VolumesAssistedSnapshotsTest-63445179-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.367s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:44:18 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6cc62d4-07be-4da3-9de2-0283b2fbd923 tempest-VolumesAssistedSnapshotsTest-63445179 tempest-VolumesAssistedSnapshotsTest-63445179-project-admin] <== disconnect_volume: return (368ms) None {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:44:18 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6cc62d4-07be-4da3-9de2-0283b2fbd923 tempest-VolumesAssistedSnapshotsTest-63445179 tempest-VolumesAssistedSnapshotsTest-63445179-project-admin] [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f] Disconnected iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 11:44:18 user nova-compute[74190]: DEBUG nova.compute.manager [req-e7a51ac6-0f88-4920-a0c5-c306a5c7a331 req-732cbbbb-86d2-44b4-9fe9-68ae9cb188b0 service nova] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Received event network-changed-21163c28-d799-420c-96b5-6ea0e829dc93 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:44:18 user nova-compute[74190]: DEBUG nova.compute.manager [req-e7a51ac6-0f88-4920-a0c5-c306a5c7a331 req-732cbbbb-86d2-44b4-9fe9-68ae9cb188b0 service nova] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Refreshing instance network info cache due to event network-changed-21163c28-d799-420c-96b5-6ea0e829dc93. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 11:44:18 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-e7a51ac6-0f88-4920-a0c5-c306a5c7a331 req-732cbbbb-86d2-44b4-9fe9-68ae9cb188b0 service nova] Acquiring lock "refresh_cache-aabb5eea-8366-482a-8d16-bf271c0fe8d7" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:44:18 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-e7a51ac6-0f88-4920-a0c5-c306a5c7a331 req-732cbbbb-86d2-44b4-9fe9-68ae9cb188b0 service nova] Acquired lock "refresh_cache-aabb5eea-8366-482a-8d16-bf271c0fe8d7" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:44:18 user nova-compute[74190]: DEBUG nova.network.neutron [req-e7a51ac6-0f88-4920-a0c5-c306a5c7a331 req-732cbbbb-86d2-44b4-9fe9-68ae9cb188b0 service nova] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Refreshing network info cache for port 21163c28-d799-420c-96b5-6ea0e829dc93 {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 11:44:18 user nova-compute[74190]: DEBUG nova.network.neutron [req-e7a51ac6-0f88-4920-a0c5-c306a5c7a331 req-732cbbbb-86d2-44b4-9fe9-68ae9cb188b0 service nova] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Updated VIF entry in instance network info cache for port 21163c28-d799-420c-96b5-6ea0e829dc93. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 11:44:18 user nova-compute[74190]: DEBUG nova.network.neutron [req-e7a51ac6-0f88-4920-a0c5-c306a5c7a331 req-732cbbbb-86d2-44b4-9fe9-68ae9cb188b0 service nova] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Updating instance_info_cache with network_info: [{"id": "21163c28-d799-420c-96b5-6ea0e829dc93", "address": "fa:16:3e:d8:31:38", "network": {"id": "40790864-a5db-4f62-adde-28ee0dc256cc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-682684827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f5028593e4e4805aaa839c6759be293", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21163c28-d7", "ovs_interfaceid": "21163c28-d799-420c-96b5-6ea0e829dc93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:44:18 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-e7a51ac6-0f88-4920-a0c5-c306a5c7a331 req-732cbbbb-86d2-44b4-9fe9-68ae9cb188b0 service nova] Releasing lock "refresh_cache-aabb5eea-8366-482a-8d16-bf271c0fe8d7" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:44:18 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-6c28a580-4ff1-41f9-b610-91b0d18d0b74 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Acquiring lock "d56b243d-fbf2-4ae6-8399-80df46b33b82" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:44:18 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-6c28a580-4ff1-41f9-b610-91b0d18d0b74 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Lock "d56b243d-fbf2-4ae6-8399-80df46b33b82" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:44:18 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-6c28a580-4ff1-41f9-b610-91b0d18d0b74 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Acquiring lock "d56b243d-fbf2-4ae6-8399-80df46b33b82-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:44:18 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-6c28a580-4ff1-41f9-b610-91b0d18d0b74 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Lock "d56b243d-fbf2-4ae6-8399-80df46b33b82-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:44:18 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-6c28a580-4ff1-41f9-b610-91b0d18d0b74 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Lock "d56b243d-fbf2-4ae6-8399-80df46b33b82-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:44:18 user nova-compute[74190]: INFO nova.compute.manager [None req-6c28a580-4ff1-41f9-b610-91b0d18d0b74 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] [instance: d56b243d-fbf2-4ae6-8399-80df46b33b82] Terminating instance
Oct 18 11:44:18 user nova-compute[74190]: DEBUG nova.compute.manager [None req-6c28a580-4ff1-41f9-b610-91b0d18d0b74 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] [instance: d56b243d-fbf2-4ae6-8399-80df46b33b82] Start destroying the instance on the hypervisor. {{(pid=74190) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 11:44:18 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:18 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:19 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:19 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:19 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:19 user nova-compute[74190]: DEBUG nova.compute.manager [req-0a63ad2f-bf60-44f7-9de1-794f67b87d83 req-61b310ce-3f5c-45f3-aa6c-20e47f567288 service nova] [instance: d56b243d-fbf2-4ae6-8399-80df46b33b82] Received event network-vif-unplugged-a4d61a40-a5fd-4bca-899e-5569a7bc1e1b {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:44:19 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-0a63ad2f-bf60-44f7-9de1-794f67b87d83 req-61b310ce-3f5c-45f3-aa6c-20e47f567288 service nova] Acquiring lock "d56b243d-fbf2-4ae6-8399-80df46b33b82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:44:19 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-0a63ad2f-bf60-44f7-9de1-794f67b87d83 req-61b310ce-3f5c-45f3-aa6c-20e47f567288 service nova] Lock "d56b243d-fbf2-4ae6-8399-80df46b33b82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:44:19 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-0a63ad2f-bf60-44f7-9de1-794f67b87d83 req-61b310ce-3f5c-45f3-aa6c-20e47f567288 service nova] Lock "d56b243d-fbf2-4ae6-8399-80df46b33b82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:44:19 user nova-compute[74190]: DEBUG nova.compute.manager [req-0a63ad2f-bf60-44f7-9de1-794f67b87d83 req-61b310ce-3f5c-45f3-aa6c-20e47f567288 service nova] [instance: d56b243d-fbf2-4ae6-8399-80df46b33b82] No waiting events found dispatching network-vif-unplugged-a4d61a40-a5fd-4bca-899e-5569a7bc1e1b {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:44:19 user nova-compute[74190]: DEBUG nova.compute.manager [req-0a63ad2f-bf60-44f7-9de1-794f67b87d83 req-61b310ce-3f5c-45f3-aa6c-20e47f567288 service nova] [instance: d56b243d-fbf2-4ae6-8399-80df46b33b82] Received event network-vif-unplugged-a4d61a40-a5fd-4bca-899e-5569a7bc1e1b for instance with task_state deleting. {{(pid=74190) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 11:44:19 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:19 user nova-compute[74190]: DEBUG nova.objects.instance [None req-e6cc62d4-07be-4da3-9de2-0283b2fbd923 tempest-VolumesAssistedSnapshotsTest-63445179 tempest-VolumesAssistedSnapshotsTest-63445179-project-admin] Lazy-loading 'flavor' on Instance uuid 697d3123-bd6b-42b9-b278-c33c0c00da6f {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:44:19 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-e6cc62d4-07be-4da3-9de2-0283b2fbd923 tempest-VolumesAssistedSnapshotsTest-63445179 tempest-VolumesAssistedSnapshotsTest-63445179-project-admin] Lock "697d3123-bd6b-42b9-b278-c33c0c00da6f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.476s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:44:19 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: d56b243d-fbf2-4ae6-8399-80df46b33b82] Instance destroyed successfully.
Oct 18 11:44:19 user nova-compute[74190]: DEBUG nova.objects.instance [None req-6c28a580-4ff1-41f9-b610-91b0d18d0b74 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Lazy-loading 'resources' on Instance uuid d56b243d-fbf2-4ae6-8399-80df46b33b82 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:44:19 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-6c28a580-4ff1-41f9-b610-91b0d18d0b74 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T11:41:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-261747563',display_name='tempest-AttachSCSIVolumeTestJSON-server-261747563',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-261747563',id=6,image_ref='77266ca3-fb2b-4f8a-82e1-da6951fc684a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEGT361osT4JUlVvS7ROETsggH9sfRlsoM8ZLlBohdnwhZ8nz59PSJx4jzhky4mFFJFF50iZAB15da8PvVqtd+qk9kz2pB3xH+ym+6ACMcETAdxU2byMCWVYTXpKZzQFBg==',key_name='tempest-keypair-1035152576',keypairs=<?>,launch_index=0,launched_at=2023-10-18T11:41:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dbc2f7422d534064967a7bf458650f0e',ramdisk_id='',reservation_id='r-3s8gq5ja',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='77266ca3-fb2b-4f8a-82e1-da6951fc684a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-463001897',owner_user_name='tempest-AttachSCSIVolumeTestJSON-463001897-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T11:41:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b56705ee715145aa93daf157d9c1571b',uuid=d56b243d-fbf2-4ae6-8399-80df46b33b82,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a4d61a40-a5fd-4bca-899e-5569a7bc1e1b", "address": "fa:16:3e:39:a4:ae", "network": {"id": "5b2a9095-d135-4b4a-9aee-82ddbd43faca", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1054223283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc2f7422d534064967a7bf458650f0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4d61a40-a5", "ovs_interfaceid": "a4d61a40-a5fd-4bca-899e-5569a7bc1e1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 11:44:19 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-6c28a580-4ff1-41f9-b610-91b0d18d0b74 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Converting VIF {"id": "a4d61a40-a5fd-4bca-899e-5569a7bc1e1b", "address": "fa:16:3e:39:a4:ae", "network": {"id": "5b2a9095-d135-4b4a-9aee-82ddbd43faca", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1054223283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc2f7422d534064967a7bf458650f0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4d61a40-a5", "ovs_interfaceid": "a4d61a40-a5fd-4bca-899e-5569a7bc1e1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:44:19 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-6c28a580-4ff1-41f9-b610-91b0d18d0b74 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:39:a4:ae,bridge_name='br-int',has_traffic_filtering=True,id=a4d61a40-a5fd-4bca-899e-5569a7bc1e1b,network=Network(5b2a9095-d135-4b4a-9aee-82ddbd43faca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4d61a40-a5') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:44:19 user nova-compute[74190]: DEBUG os_vif [None req-6c28a580-4ff1-41f9-b610-91b0d18d0b74 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:a4:ae,bridge_name='br-int',has_traffic_filtering=True,id=a4d61a40-a5fd-4bca-899e-5569a7bc1e1b,network=Network(5b2a9095-d135-4b4a-9aee-82ddbd43faca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4d61a40-a5') {{(pid=74190) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 11:44:19 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:19 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa4d61a40-a5, bridge=br-int, if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:44:19 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:19 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:44:19 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:19 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:19 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cef52e55-af40-4e15-9104-c7d2a3114e03) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:44:19 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:19 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:44:19 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:19 user nova-compute[74190]: INFO os_vif [None req-6c28a580-4ff1-41f9-b610-91b0d18d0b74 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:a4:ae,bridge_name='br-int',has_traffic_filtering=True,id=a4d61a40-a5fd-4bca-899e-5569a7bc1e1b,network=Network(5b2a9095-d135-4b4a-9aee-82ddbd43faca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4d61a40-a5')
Oct 18 11:44:19 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-6c28a580-4ff1-41f9-b610-91b0d18d0b74 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] [instance: d56b243d-fbf2-4ae6-8399-80df46b33b82] Deleting instance files /opt/stack/data/nova/instances/d56b243d-fbf2-4ae6-8399-80df46b33b82_del
Oct 18 11:44:19 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-6c28a580-4ff1-41f9-b610-91b0d18d0b74 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] [instance: d56b243d-fbf2-4ae6-8399-80df46b33b82] Deletion of /opt/stack/data/nova/instances/d56b243d-fbf2-4ae6-8399-80df46b33b82_del complete
Oct 18 11:44:19 user nova-compute[74190]: INFO nova.compute.manager [None req-6c28a580-4ff1-41f9-b610-91b0d18d0b74 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] [instance: d56b243d-fbf2-4ae6-8399-80df46b33b82] Took 0.96 seconds to destroy the instance on the hypervisor.
Oct 18 11:44:19 user nova-compute[74190]: DEBUG oslo.service.loopingcall [None req-6c28a580-4ff1-41f9-b610-91b0d18d0b74 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74190) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 11:44:19 user nova-compute[74190]: DEBUG nova.compute.manager [-] [instance: d56b243d-fbf2-4ae6-8399-80df46b33b82] Deallocating network for instance {{(pid=74190) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 11:44:19 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: d56b243d-fbf2-4ae6-8399-80df46b33b82] deallocate_for_instance() {{(pid=74190) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 11:44:19 user nova-compute[74190]: INFO nova.compute.manager [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Rebuilding instance
Oct 18 11:44:19 user nova-compute[74190]: DEBUG nova.compute.manager [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Checking state {{(pid=74190) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 11:44:20 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:20 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:20 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:20 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:20 user nova-compute[74190]: DEBUG nova.compute.manager [req-d4cfd496-df71-4480-87e6-f1c64d259acf req-5dc3f530-52fa-45a4-8ab6-e2867a5c5329 service nova] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Received event network-vif-unplugged-21163c28-d799-420c-96b5-6ea0e829dc93 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:44:20 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d4cfd496-df71-4480-87e6-f1c64d259acf req-5dc3f530-52fa-45a4-8ab6-e2867a5c5329 service nova] Acquiring lock "aabb5eea-8366-482a-8d16-bf271c0fe8d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:44:20 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d4cfd496-df71-4480-87e6-f1c64d259acf req-5dc3f530-52fa-45a4-8ab6-e2867a5c5329 service nova] Lock "aabb5eea-8366-482a-8d16-bf271c0fe8d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:44:20 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d4cfd496-df71-4480-87e6-f1c64d259acf req-5dc3f530-52fa-45a4-8ab6-e2867a5c5329 service nova] Lock "aabb5eea-8366-482a-8d16-bf271c0fe8d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:44:20 user nova-compute[74190]: DEBUG nova.compute.manager [req-d4cfd496-df71-4480-87e6-f1c64d259acf req-5dc3f530-52fa-45a4-8ab6-e2867a5c5329 service nova] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] No waiting events found dispatching network-vif-unplugged-21163c28-d799-420c-96b5-6ea0e829dc93 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:44:20 user nova-compute[74190]: WARNING nova.compute.manager [req-d4cfd496-df71-4480-87e6-f1c64d259acf req-5dc3f530-52fa-45a4-8ab6-e2867a5c5329 service nova] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Received unexpected event network-vif-unplugged-21163c28-d799-420c-96b5-6ea0e829dc93 for instance with vm_state active and task_state rebuilding.
Oct 18 11:44:20 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Instance destroyed successfully.
Oct 18 11:44:20 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Instance destroyed successfully.
Oct 18 11:44:20 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:42:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-705838820',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1751107250',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCGAytsGwKIkIlWHJHinPWL79JZWbDLUxBsDePH5prj/RtI6Z3qHCyazEDqxn5098+uhRVuFwPPlZKB1iRU99f3IUwmSBv9DCo1T4Kl+DbCeNTfJ+46eAnqPOhZREa0v/Q==',key_name='tempest-keypair-458715235',keypairs=<?>,launch_index=0,launched_at=2023-10-18T11:42:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5f5028593e4e4805aaa839c6759be293',ramdisk_id='',reservation_id='r-6je5vmge',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1161132701',owner_user_name='tempest-ServerActionsV293TestJSON-1161132701-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:44:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='58fb2050865044f9a0d621a9ca328ece',uuid=aabb5eea-8366-482a-8d16-bf271c0fe8d7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "21163c28-d799-420c-96b5-6ea0e829dc93", "address": "fa:16:3e:d8:31:38", "network": {"id": "40790864-a5db-4f62-adde-28ee0dc256cc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-682684827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f5028593e4e4805aaa839c6759be293", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21163c28-d7", "ovs_interfaceid": "21163c28-d799-420c-96b5-6ea0e829dc93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 11:44:20 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Converting VIF {"id": "21163c28-d799-420c-96b5-6ea0e829dc93", "address": "fa:16:3e:d8:31:38", "network": {"id": "40790864-a5db-4f62-adde-28ee0dc256cc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-682684827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f5028593e4e4805aaa839c6759be293", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21163c28-d7", "ovs_interfaceid": "21163c28-d799-420c-96b5-6ea0e829dc93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:44:20 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d8:31:38,bridge_name='br-int',has_traffic_filtering=True,id=21163c28-d799-420c-96b5-6ea0e829dc93,network=Network(40790864-a5db-4f62-adde-28ee0dc256cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21163c28-d7') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:44:20 user nova-compute[74190]: DEBUG os_vif [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:31:38,bridge_name='br-int',has_traffic_filtering=True,id=21163c28-d799-420c-96b5-6ea0e829dc93,network=Network(40790864-a5db-4f62-adde-28ee0dc256cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21163c28-d7') {{(pid=74190) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 11:44:20 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:20 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap21163c28-d7, bridge=br-int, if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:44:20 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:20 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:44:20 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:20 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:20 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cb742216-8166-4a1d-b4a5-62fb5837d8e5) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:44:20 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:20 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:44:20 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:20 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: d56b243d-fbf2-4ae6-8399-80df46b33b82] Updating instance_info_cache with network_info: [] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:44:20 user nova-compute[74190]: INFO os_vif [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:31:38,bridge_name='br-int',has_traffic_filtering=True,id=21163c28-d799-420c-96b5-6ea0e829dc93,network=Network(40790864-a5db-4f62-adde-28ee0dc256cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21163c28-d7')
Oct 18 11:44:20 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] calling os-brick to detach iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 11:44:20 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, {'target_iqn': 'iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ahIObAot', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:44:20 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 18 11:44:20 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:44:20 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:44:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:20 user nova-compute[74190]: INFO nova.compute.manager [-] [instance: d56b243d-fbf2-4ae6-8399-80df46b33b82] Took 1.02 seconds to deallocate network for instance.
Oct 18 11:44:20 user nova-compute[74190]: DEBUG nova.compute.manager [req-4b59af4f-cab1-472c-975c-c3c57721fe19 req-cef31b12-012b-43ce-8c88-71ae6b375373 service nova] [instance: d56b243d-fbf2-4ae6-8399-80df46b33b82] Received event network-vif-deleted-a4d61a40-a5fd-4bca-899e-5569a7bc1e1b {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:44:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:20 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a816ec-5dbc-428c-a945-7487dc8b37b8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:20 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 11:44:20 user nova-compute[74190]: No targets found.
Oct 18 11:44:20 user nova-compute[74190]: iSNS:
Oct 18 11:44:20 user nova-compute[74190]: No targets found.
Oct 18 11:44:20 user nova-compute[74190]: STATIC:
Oct 18 11:44:20 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a
Oct 18 11:44:20 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:44:20 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:44:20 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920
Oct 18 11:44:20 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:44:20 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:44:20 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb
Oct 18 11:44:20 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:44:20 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:44:20 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c
Oct 18 11:44:20 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:44:20 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:44:20 user nova-compute[74190]: FIRMWARE:
Oct 18 11:44:20 user nova-compute[74190]: No targets found.
Oct 18 11:44:20 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:44:20 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 11:44:20 user nova-compute[74190]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 11:44:20 user nova-compute[74190]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74190) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 11:44:20 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c', 0)] {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 11:44:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:20 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[37756dfa-e4be-46bb-aa97-8915ffe7c45f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:20 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ba6d1f-fcf7-44d4-87d5-5c2edc814706]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:20 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920 (non-flash)
Oct 18 11:44:20 user nova-compute[74190]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)
Oct 18 11:44:20 user nova-compute[74190]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)
Oct 18 11:44:20 user nova-compute[74190]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)
Oct 18 11:44:20 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:44:20 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920 (non-flash)
Oct 18 11:44:20 user nova-compute[74190]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)
Oct 18 11:44:20 user nova-compute[74190]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)
Oct 18 11:44:20 user nova-compute[74190]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)
Oct 18 11:44:20 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:44:20 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1f44785090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c'): ({'sdb'}, set())}) {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 11:44:20 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Removing single pathed devices sdb {{(pid=74190) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 11:44:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:20 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-6c28a580-4ff1-41f9-b610-91b0d18d0b74 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:44:20 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-6c28a580-4ff1-41f9-b610-91b0d18d0b74 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:44:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:20 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[9653c3df-5744-4354-8994-2fa75fad748b]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:20 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d4040ea-2c58-439e-9731-0c445df23768]: (4, ('ok\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:20 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Flushing IO for device /dev/sdb {{(pid=74190) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 11:44:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:20 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[d36c039b-8a8d-406d-bcbe-3c8e7dc0f189]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:20 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74190) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 11:44:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:21 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f3479e9-bbd5-4903-a912-7ae9a9154dd6]: (4, ('1', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:21 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 11:44:21 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] SCSI volumes sdb have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 11:44:21 user nova-compute[74190]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO714d9597-38785f3db29c3b11', '/dev/disk/by-id/scsi-23338373835663364', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_714d9597') {{(pid=85217) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 18 11:44:21 user nova-compute[74190]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO714d9597-38785f3db29c3b11
Oct 18 11:44:21 user nova-compute[74190]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23338373835663364
Oct 18 11:44:21 user nova-compute[74190]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_714d9597
Oct 18 11:44:21 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[be59e293-7d95-4753-a31c-a1636f47a336]: (4, None) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:21 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c')] {{(pid=74190) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 11:44:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:21 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f10947-bf62-4de1-9c0f-d6b750b60250]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:21 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:44:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c -p 172.16.0.220:3260 --logout {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:21 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc178fdb-9404-4d82-91a0-08a80ac31692]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:21 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c, portal: 172.16.0.220,3260]
Oct 18 11:44:21 user nova-compute[74190]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c, portal: 172.16.0.220,3260] successful.
Oct 18 11:44:21 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:44:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c -p 172.16.0.220:3260 --op delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:21 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdec18bb-7cf7-49dc-989d-06e76550d221]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:21 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:44:21 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:44:21 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] <== disconnect_volume: return (334ms) None {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:44:21 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Disconnected iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 11:44:21 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Deleting instance files /opt/stack/data/nova/instances/aabb5eea-8366-482a-8d16-bf271c0fe8d7_del
Oct 18 11:44:21 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Deletion of /opt/stack/data/nova/instances/aabb5eea-8366-482a-8d16-bf271c0fe8d7_del complete
Oct 18 11:44:21 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-6c28a580-4ff1-41f9-b610-91b0d18d0b74 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 11:44:21 user nova-compute[74190]: DEBUG nova.compute.manager [req-72b09532-1094-4c60-b583-48777c79107b req-b466a1da-1659-4432-a0b9-433d028fe56c service nova] [instance: d56b243d-fbf2-4ae6-8399-80df46b33b82] Received event network-vif-plugged-a4d61a40-a5fd-4bca-899e-5569a7bc1e1b {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:44:21 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-72b09532-1094-4c60-b583-48777c79107b req-b466a1da-1659-4432-a0b9-433d028fe56c service nova] Acquiring lock "d56b243d-fbf2-4ae6-8399-80df46b33b82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:44:21 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-72b09532-1094-4c60-b583-48777c79107b req-b466a1da-1659-4432-a0b9-433d028fe56c service nova] Lock "d56b243d-fbf2-4ae6-8399-80df46b33b82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:44:21 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-72b09532-1094-4c60-b583-48777c79107b req-b466a1da-1659-4432-a0b9-433d028fe56c service nova] Lock "d56b243d-fbf2-4ae6-8399-80df46b33b82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:44:21 user nova-compute[74190]: DEBUG nova.compute.manager [req-72b09532-1094-4c60-b583-48777c79107b req-b466a1da-1659-4432-a0b9-433d028fe56c service nova] [instance: d56b243d-fbf2-4ae6-8399-80df46b33b82] No waiting events found dispatching network-vif-plugged-a4d61a40-a5fd-4bca-899e-5569a7bc1e1b {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:44:21 user nova-compute[74190]: WARNING nova.compute.manager [req-72b09532-1094-4c60-b583-48777c79107b req-b466a1da-1659-4432-a0b9-433d028fe56c service nova] [instance: d56b243d-fbf2-4ae6-8399-80df46b33b82] Received unexpected event network-vif-plugged-a4d61a40-a5fd-4bca-899e-5569a7bc1e1b for instance with vm_state deleted and task_state None.
Oct 18 11:44:21 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-6c28a580-4ff1-41f9-b610-91b0d18d0b74 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 11:44:21 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-6c28a580-4ff1-41f9-b610-91b0d18d0b74 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.427s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:44:21 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance aabb5eea-8366-482a-8d16-bf271c0fe8d7 could not be found.
Oct 18 11:44:21 user nova-compute[74190]: INFO nova.scheduler.client.report [None req-6c28a580-4ff1-41f9-b610-91b0d18d0b74 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Deleted allocations for instance d56b243d-fbf2-4ae6-8399-80df46b33b82
Oct 18 11:44:21 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] calling os-brick to detach iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 11:44:21 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, {'target_iqn': 'iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ahIObAot', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:44:21 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 18 11:44:21 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:44:21 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:44:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:21 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0032f21-0a89-469b-9742-b120a4d26554]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:21 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 11:44:21 user nova-compute[74190]: No targets found.
Oct 18 11:44:21 user nova-compute[74190]: iSNS:
Oct 18 11:44:21 user nova-compute[74190]: No targets found.
Oct 18 11:44:21 user nova-compute[74190]: STATIC:
Oct 18 11:44:21 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a
Oct 18 11:44:21 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:44:21 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:44:21 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920
Oct 18 11:44:21 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:44:21 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:44:21 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb
Oct 18 11:44:21 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:44:21 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:44:21 user nova-compute[74190]: FIRMWARE:
Oct 18 11:44:21 user nova-compute[74190]: No targets found.
Oct 18 11:44:21 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:44:21 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 11:44:21 user nova-compute[74190]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 11:44:21 user nova-compute[74190]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74190) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 11:44:21 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c', 0)] {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 11:44:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:21 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c71a22d-d030-4051-adfe-2ee87b04cb70]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:21 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe06f48d-d84b-4825-92c4-0cfc07fd3d65]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:21 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920 (non-flash)
Oct 18 11:44:21 user nova-compute[74190]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)
Oct 18 11:44:21 user nova-compute[74190]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)
Oct 18 11:44:21 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:44:21 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920 (non-flash)
Oct 18 11:44:21 user nova-compute[74190]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)
Oct 18 11:44:21 user nova-compute[74190]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)
Oct 18 11:44:21 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:44:21 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1f44538f70>, {}) {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 11:44:21 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Disconnecting from: [] {{(pid=74190) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 11:44:21 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.081s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:44:21 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] <== disconnect_volume: return (83ms) None {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:44:21 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Disconnected iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 11:44:21 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-6c28a580-4ff1-41f9-b610-91b0d18d0b74 tempest-AttachSCSIVolumeTestJSON-463001897 tempest-AttachSCSIVolumeTestJSON-463001897-project-member] Lock "d56b243d-fbf2-4ae6-8399-80df46b33b82" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.723s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:44:22 user nova-compute[74190]: DEBUG nova.compute.manager [req-ad4b0178-1350-4063-9ab0-7963d3a79f30 req-bb9e476b-f4b6-4034-9cdb-da7e08711e5d service nova] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Received event network-vif-plugged-21163c28-d799-420c-96b5-6ea0e829dc93 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:44:22 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-ad4b0178-1350-4063-9ab0-7963d3a79f30 req-bb9e476b-f4b6-4034-9cdb-da7e08711e5d service nova] Acquiring lock "aabb5eea-8366-482a-8d16-bf271c0fe8d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:44:22 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-ad4b0178-1350-4063-9ab0-7963d3a79f30 req-bb9e476b-f4b6-4034-9cdb-da7e08711e5d service nova] Lock "aabb5eea-8366-482a-8d16-bf271c0fe8d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:44:22 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-ad4b0178-1350-4063-9ab0-7963d3a79f30 req-bb9e476b-f4b6-4034-9cdb-da7e08711e5d service nova] Lock "aabb5eea-8366-482a-8d16-bf271c0fe8d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:44:22 user nova-compute[74190]: DEBUG nova.compute.manager [req-ad4b0178-1350-4063-9ab0-7963d3a79f30 req-bb9e476b-f4b6-4034-9cdb-da7e08711e5d service nova] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] No waiting events found dispatching network-vif-plugged-21163c28-d799-420c-96b5-6ea0e829dc93 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:44:22 user nova-compute[74190]: WARNING nova.compute.manager [req-ad4b0178-1350-4063-9ab0-7963d3a79f30 req-bb9e476b-f4b6-4034-9cdb-da7e08711e5d service nova] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Received unexpected event network-vif-plugged-21163c28-d799-420c-96b5-6ea0e829dc93 for instance with vm_state active and task_state rebuilding.
Oct 18 11:44:22 user nova-compute[74190]: DEBUG nova.compute.manager [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Preparing to wait for external event volume-reimaged-5c87f389-42e2-4d78-8bdb-4d5bda76216c {{(pid=74190) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Oct 18 11:44:22 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Acquiring lock "aabb5eea-8366-482a-8d16-bf271c0fe8d7-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:44:22 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Lock "aabb5eea-8366-482a-8d16-bf271c0fe8d7-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:44:22 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Lock "aabb5eea-8366-482a-8d16-bf271c0fe8d7-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:44:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:25 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:27 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-e86fba79-aceb-403f-a2a0-a452cb123427 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Waiting for libvirt event about the detach of device tapb5f712f6-67 with device alias net1 from instance 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef is timed out.
Oct 18 11:44:27 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-e86fba79-aceb-403f-a2a0-a452cb123427 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:ab:58:86"/><model type="virtio"/><mtu size="1442"/><target dev="tapb5f712f6-67"/></interface> {{(pid=74190) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 18 11:44:27 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-e86fba79-aceb-403f-a2a0-a452cb123427 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:ab:58:86"/><model type="virtio"/><mtu size="1442"/><target dev="tapb5f712f6-67"/></interface>not found in domain: <domain type='kvm' id='5'>
Oct 18 11:44:27 user nova-compute[74190]:   <name>instance-00000005</name>
Oct 18 11:44:27 user nova-compute[74190]:   <uuid>6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef</uuid>
Oct 18 11:44:27 user nova-compute[74190]:   <metadata>
Oct 18 11:44:27 user nova-compute[74190]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 11:44:27 user nova-compute[74190]:   <nova:package version="0.0.0"/>
Oct 18 11:44:27 user nova-compute[74190]:   <nova:name>tempest-device-tagging-server-239478616</nova:name>
Oct 18 11:44:27 user nova-compute[74190]:   <nova:creationTime>2023-10-18 11:43:12</nova:creationTime>
Oct 18 11:44:27 user nova-compute[74190]:   <nova:flavor name="m1.tiny">
Oct 18 11:44:27 user nova-compute[74190]:     <nova:memory>512</nova:memory>
Oct 18 11:44:27 user nova-compute[74190]:     <nova:disk>1</nova:disk>
Oct 18 11:44:27 user nova-compute[74190]:     <nova:swap>0</nova:swap>
Oct 18 11:44:27 user nova-compute[74190]:     <nova:ephemeral>0</nova:ephemeral>
Oct 18 11:44:27 user nova-compute[74190]:     <nova:vcpus>1</nova:vcpus>
Oct 18 11:44:27 user nova-compute[74190]:   </nova:flavor>
Oct 18 11:44:27 user nova-compute[74190]:   <nova:owner>
Oct 18 11:44:27 user nova-compute[74190]:     <nova:user uuid="a587bc7358fe4d289926428f94766374">tempest-TaggedAttachmentsTest-1663776612-project-member</nova:user>
Oct 18 11:44:27 user nova-compute[74190]:     <nova:project uuid="72f55b03dea844739b3e36d4f73b23e0">tempest-TaggedAttachmentsTest-1663776612</nova:project>
Oct 18 11:44:27 user nova-compute[74190]:   </nova:owner>
Oct 18 11:44:27 user nova-compute[74190]:   <nova:root type="image" uuid="6e88bbf0-6e78-49a8-b3c5-9453d22a89df"/>
Oct 18 11:44:27 user nova-compute[74190]:   <nova:ports>
Oct 18 11:44:27 user nova-compute[74190]:     <nova:port uuid="2f3b8cfe-f9f2-4dc5-b368-f67ef363266c">
Oct 18 11:44:27 user nova-compute[74190]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 18 11:44:27 user nova-compute[74190]:     </nova:port>
Oct 18 11:44:27 user nova-compute[74190]:     <nova:port uuid="b5f712f6-6733-4725-b563-2218a4a58813">
Oct 18 11:44:27 user nova-compute[74190]:       <nova:ip type="fixed" address="10.10.10.149" ipVersion="4"/>
Oct 18 11:44:27 user nova-compute[74190]:     </nova:port>
Oct 18 11:44:27 user nova-compute[74190]:   </nova:ports>
Oct 18 11:44:27 user nova-compute[74190]: </nova:instance>
Oct 18 11:44:27 user nova-compute[74190]:   </metadata>
Oct 18 11:44:27 user nova-compute[74190]:   <memory unit='KiB'>524288</memory>
Oct 18 11:44:27 user nova-compute[74190]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 18 11:44:27 user nova-compute[74190]:   <vcpu placement='static'>1</vcpu>
Oct 18 11:44:27 user nova-compute[74190]:   <resource>
Oct 18 11:44:27 user nova-compute[74190]:     <partition>/machine</partition>
Oct 18 11:44:27 user nova-compute[74190]:   </resource>
Oct 18 11:44:27 user nova-compute[74190]:   <sysinfo type='smbios'>
Oct 18 11:44:27 user nova-compute[74190]:     <system>
Oct 18 11:44:27 user nova-compute[74190]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 18 11:44:27 user nova-compute[74190]:       <entry name='product'>OpenStack Nova</entry>
Oct 18 11:44:27 user nova-compute[74190]:       <entry name='version'>0.0.0</entry>
Oct 18 11:44:27 user nova-compute[74190]:       <entry name='serial'>6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef</entry>
Oct 18 11:44:27 user nova-compute[74190]:       <entry name='uuid'>6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef</entry>
Oct 18 11:44:27 user nova-compute[74190]:       <entry name='family'>Virtual Machine</entry>
Oct 18 11:44:27 user nova-compute[74190]:     </system>
Oct 18 11:44:27 user nova-compute[74190]:   </sysinfo>
Oct 18 11:44:27 user nova-compute[74190]:   <os>
Oct 18 11:44:27 user nova-compute[74190]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 18 11:44:27 user nova-compute[74190]:     <boot dev='hd'/>
Oct 18 11:44:27 user nova-compute[74190]:     <smbios mode='sysinfo'/>
Oct 18 11:44:27 user nova-compute[74190]:   </os>
Oct 18 11:44:27 user nova-compute[74190]:   <features>
Oct 18 11:44:27 user nova-compute[74190]:     <acpi/>
Oct 18 11:44:27 user nova-compute[74190]:     <apic/>
Oct 18 11:44:27 user nova-compute[74190]:     <vmcoreinfo state='on'/>
Oct 18 11:44:27 user nova-compute[74190]:   </features>
Oct 18 11:44:27 user nova-compute[74190]:   <cpu mode='custom' match='exact' check='full'>
Oct 18 11:44:27 user nova-compute[74190]:     <model fallback='forbid'>Nehalem</model>
Oct 18 11:44:27 user nova-compute[74190]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 18 11:44:27 user nova-compute[74190]:     <feature policy='require' name='vme'/>
Oct 18 11:44:27 user nova-compute[74190]:     <feature policy='require' name='x2apic'/>
Oct 18 11:44:27 user nova-compute[74190]:     <feature policy='require' name='hypervisor'/>
Oct 18 11:44:27 user nova-compute[74190]:   </cpu>
Oct 18 11:44:27 user nova-compute[74190]:   <clock offset='utc'>
Oct 18 11:44:27 user nova-compute[74190]:     <timer name='pit' tickpolicy='delay'/>
Oct 18 11:44:27 user nova-compute[74190]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 18 11:44:27 user nova-compute[74190]:     <timer name='hpet' present='no'/>
Oct 18 11:44:27 user nova-compute[74190]:   </clock>
Oct 18 11:44:27 user nova-compute[74190]:   <on_poweroff>destroy</on_poweroff>
Oct 18 11:44:27 user nova-compute[74190]:   <on_reboot>restart</on_reboot>
Oct 18 11:44:27 user nova-compute[74190]:   <on_crash>destroy</on_crash>
Oct 18 11:44:27 user nova-compute[74190]:   <devices>
Oct 18 11:44:27 user nova-compute[74190]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 18 11:44:27 user nova-compute[74190]:     <disk type='file' device='disk'>
Oct 18 11:44:27 user nova-compute[74190]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 18 11:44:27 user nova-compute[74190]:       <source file='/opt/stack/data/nova/instances/6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef/disk' index='2'/>
Oct 18 11:44:27 user nova-compute[74190]:       <backingStore type='file' index='3'>
Oct 18 11:44:27 user nova-compute[74190]:         <format type='raw'/>
Oct 18 11:44:27 user nova-compute[74190]:         <source file='/opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f'/>
Oct 18 11:44:27 user nova-compute[74190]:         <backingStore/>
Oct 18 11:44:27 user nova-compute[74190]:       </backingStore>
Oct 18 11:44:27 user nova-compute[74190]:       <target dev='vda' bus='virtio'/>
Oct 18 11:44:27 user nova-compute[74190]:       <alias name='virtio-disk0'/>
Oct 18 11:44:27 user nova-compute[74190]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 18 11:44:27 user nova-compute[74190]:     </disk>
Oct 18 11:44:27 user nova-compute[74190]:     <disk type='file' device='cdrom'>
Oct 18 11:44:27 user nova-compute[74190]:       <driver name='qemu' type='raw' cache='none'/>
Oct 18 11:44:27 user nova-compute[74190]:       <source file='/opt/stack/data/nova/instances/6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef/disk.config' index='1'/>
Oct 18 11:44:27 user nova-compute[74190]:       <backingStore/>
Oct 18 11:44:27 user nova-compute[74190]:       <target dev='hda' bus='ide'/>
Oct 18 11:44:27 user nova-compute[74190]:       <readonly/>
Oct 18 11:44:27 user nova-compute[74190]:       <alias name='ide0-0-0'/>
Oct 18 11:44:27 user nova-compute[74190]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 18 11:44:27 user nova-compute[74190]:     </disk>
Oct 18 11:44:27 user nova-compute[74190]:     <controller type='usb' index='0' model='none'>
Oct 18 11:44:27 user nova-compute[74190]:       <alias name='usb'/>
Oct 18 11:44:27 user nova-compute[74190]:     </controller>
Oct 18 11:44:27 user nova-compute[74190]:     <controller type='pci' index='0' model='pci-root'>
Oct 18 11:44:27 user nova-compute[74190]:       <alias name='pci.0'/>
Oct 18 11:44:27 user nova-compute[74190]:     </controller>
Oct 18 11:44:27 user nova-compute[74190]:     <controller type='ide' index='0'>
Oct 18 11:44:27 user nova-compute[74190]:       <alias name='ide'/>
Oct 18 11:44:27 user nova-compute[74190]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 18 11:44:27 user nova-compute[74190]:     </controller>
Oct 18 11:44:27 user nova-compute[74190]:     <interface type='ethernet'>
Oct 18 11:44:27 user nova-compute[74190]:       <mac address='fa:16:3e:22:e2:3f'/>
Oct 18 11:44:27 user nova-compute[74190]:       <target dev='tap2f3b8cfe-f9'/>
Oct 18 11:44:27 user nova-compute[74190]:       <model type='virtio'/>
Oct 18 11:44:27 user nova-compute[74190]:       <mtu size='1442'/>
Oct 18 11:44:27 user nova-compute[74190]:       <alias name='net0'/>
Oct 18 11:44:27 user nova-compute[74190]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 18 11:44:27 user nova-compute[74190]:     </interface>
Oct 18 11:44:27 user nova-compute[74190]:     <serial type='pty'>
Oct 18 11:44:27 user nova-compute[74190]:       <source path='/dev/pts/4'/>
Oct 18 11:44:27 user nova-compute[74190]:       <log file='/opt/stack/data/nova/instances/6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef/console.log' append='off'/>
Oct 18 11:44:27 user nova-compute[74190]:       <target type='isa-serial' port='0'>
Oct 18 11:44:27 user nova-compute[74190]:         <model name='isa-serial'/>
Oct 18 11:44:27 user nova-compute[74190]:       </target>
Oct 18 11:44:27 user nova-compute[74190]:       <alias name='serial0'/>
Oct 18 11:44:27 user nova-compute[74190]:     </serial>
Oct 18 11:44:27 user nova-compute[74190]:     <console type='pty' tty='/dev/pts/4'>
Oct 18 11:44:27 user nova-compute[74190]:       <source path='/dev/pts/4'/>
Oct 18 11:44:27 user nova-compute[74190]:       <log file='/opt/stack/data/nova/instances/6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef/console.log' append='off'/>
Oct 18 11:44:27 user nova-compute[74190]:       <target type='serial' port='0'/>
Oct 18 11:44:27 user nova-compute[74190]:       <alias name='serial0'/>
Oct 18 11:44:27 user nova-compute[74190]:     </console>
Oct 18 11:44:27 user nova-compute[74190]:     <input type='mouse' bus='ps2'>
Oct 18 11:44:27 user nova-compute[74190]:       <alias name='input0'/>
Oct 18 11:44:27 user nova-compute[74190]:     </input>
Oct 18 11:44:27 user nova-compute[74190]:     <input type='keyboard' bus='ps2'>
Oct 18 11:44:27 user nova-compute[74190]:       <alias name='input1'/>
Oct 18 11:44:27 user nova-compute[74190]:     </input>
Oct 18 11:44:27 user nova-compute[74190]:     <graphics type='vnc' port='5904' autoport='yes' listen='0.0.0.0'>
Oct 18 11:44:27 user nova-compute[74190]:       <listen type='address' address='0.0.0.0'/>
Oct 18 11:44:27 user nova-compute[74190]:     </graphics>
Oct 18 11:44:27 user nova-compute[74190]:     <audio id='1' type='none'/>
Oct 18 11:44:27 user nova-compute[74190]:     <video>
Oct 18 11:44:27 user nova-compute[74190]:       <model type='virtio' heads='1' primary='yes'/>
Oct 18 11:44:27 user nova-compute[74190]:       <alias name='video0'/>
Oct 18 11:44:27 user nova-compute[74190]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 18 11:44:27 user nova-compute[74190]:     </video>
Oct 18 11:44:27 user nova-compute[74190]:     <memballoon model='virtio'>
Oct 18 11:44:27 user nova-compute[74190]:       <stats period='10'/>
Oct 18 11:44:27 user nova-compute[74190]:       <alias name='balloon0'/>
Oct 18 11:44:27 user nova-compute[74190]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 18 11:44:27 user nova-compute[74190]:     </memballoon>
Oct 18 11:44:27 user nova-compute[74190]:     <rng model='virtio'>
Oct 18 11:44:27 user nova-compute[74190]:       <backend model='random'>/dev/urandom</backend>
Oct 18 11:44:27 user nova-compute[74190]:       <alias name='rng0'/>
Oct 18 11:44:27 user nova-compute[74190]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 18 11:44:27 user nova-compute[74190]:     </rng>
Oct 18 11:44:27 user nova-compute[74190]:   </devices>
Oct 18 11:44:27 user nova-compute[74190]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 18 11:44:27 user nova-compute[74190]:     <label>libvirt-6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef</label>
Oct 18 11:44:27 user nova-compute[74190]:     <imagelabel>libvirt-6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef</imagelabel>
Oct 18 11:44:27 user nova-compute[74190]:   </seclabel>
Oct 18 11:44:27 user nova-compute[74190]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 18 11:44:27 user nova-compute[74190]:     <label>+64055:+108</label>
Oct 18 11:44:27 user nova-compute[74190]:     <imagelabel>+64055:+108</imagelabel>
Oct 18 11:44:27 user nova-compute[74190]:   </seclabel>
Oct 18 11:44:27 user nova-compute[74190]: </domain>
Oct 18 11:44:27 user nova-compute[74190]:  {{(pid=74190) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 18 11:44:27 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-e86fba79-aceb-403f-a2a0-a452cb123427 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Successfully detached device tapb5f712f6-67 from instance 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef from the live domain config.
Oct 18 11:44:27 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-e86fba79-aceb-403f-a2a0-a452cb123427 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T11:41:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-239478616',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-239478616',id=5,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDiL4Y3YjaIYG9f48clgmLYvNf1xzm1drxLs+YLjigprz2IgSEssC/H3MORsYOE3v5yg6mGeg/8ep19TIA+gnsVGZGVVookzYwja4uGKlJS/z4feKfCDiLYrj74IwuE8uQ==',key_name='tempest-keypair-654404793',keypairs=<?>,launch_index=0,launched_at=2023-10-18T11:41:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='72f55b03dea844739b3e36d4f73b23e0',ramdisk_id='',reservation_id='r-iliez3d9',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1663776612',owner_user_name='tempest-TaggedAttachmentsTest-1663776612-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T11:41:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a587bc7358fe4d289926428f94766374',uuid=6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b5f712f6-6733-4725-b563-2218a4a58813", "address": "fa:16:3e:ab:58:86", "network": {"id": "a814b9ab-3007-49af-aa0f-13a6d655952a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1870963685", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "72f55b03dea844739b3e36d4f73b23e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f712f6-67", "ovs_interfaceid": "b5f712f6-6733-4725-b563-2218a4a58813", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 11:44:27 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-e86fba79-aceb-403f-a2a0-a452cb123427 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Converting VIF {"id": "b5f712f6-6733-4725-b563-2218a4a58813", "address": "fa:16:3e:ab:58:86", "network": {"id": "a814b9ab-3007-49af-aa0f-13a6d655952a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1870963685", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "72f55b03dea844739b3e36d4f73b23e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f712f6-67", "ovs_interfaceid": "b5f712f6-6733-4725-b563-2218a4a58813", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:44:27 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-e86fba79-aceb-403f-a2a0-a452cb123427 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:58:86,bridge_name='br-int',has_traffic_filtering=True,id=b5f712f6-6733-4725-b563-2218a4a58813,network=Network(a814b9ab-3007-49af-aa0f-13a6d655952a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5f712f6-67') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:44:27 user nova-compute[74190]: DEBUG os_vif [None req-e86fba79-aceb-403f-a2a0-a452cb123427 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:58:86,bridge_name='br-int',has_traffic_filtering=True,id=b5f712f6-6733-4725-b563-2218a4a58813,network=Network(a814b9ab-3007-49af-aa0f-13a6d655952a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5f712f6-67') {{(pid=74190) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 11:44:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb5f712f6-67, bridge=br-int, if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:44:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:44:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a57ebc37-b8da-4051-af2f-977823a191f1) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:44:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:44:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:27 user nova-compute[74190]: INFO os_vif [None req-e86fba79-aceb-403f-a2a0-a452cb123427 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:58:86,bridge_name='br-int',has_traffic_filtering=True,id=b5f712f6-6733-4725-b563-2218a4a58813,network=Network(a814b9ab-3007-49af-aa0f-13a6d655952a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5f712f6-67')
Oct 18 11:44:27 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-e86fba79-aceb-403f-a2a0-a452cb123427 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 11:44:27 user nova-compute[74190]:   <nova:package version="0.0.0"/>
Oct 18 11:44:27 user nova-compute[74190]:   <nova:name>tempest-device-tagging-server-239478616</nova:name>
Oct 18 11:44:27 user nova-compute[74190]:   <nova:creationTime>2023-10-18 11:44:27</nova:creationTime>
Oct 18 11:44:27 user nova-compute[74190]:   <nova:flavor name="m1.tiny">
Oct 18 11:44:27 user nova-compute[74190]:     <nova:memory>512</nova:memory>
Oct 18 11:44:27 user nova-compute[74190]:     <nova:disk>1</nova:disk>
Oct 18 11:44:27 user nova-compute[74190]:     <nova:swap>0</nova:swap>
Oct 18 11:44:27 user nova-compute[74190]:     <nova:ephemeral>0</nova:ephemeral>
Oct 18 11:44:27 user nova-compute[74190]:     <nova:vcpus>1</nova:vcpus>
Oct 18 11:44:27 user nova-compute[74190]:   </nova:flavor>
Oct 18 11:44:27 user nova-compute[74190]:   <nova:owner>
Oct 18 11:44:27 user nova-compute[74190]:     <nova:user uuid="a587bc7358fe4d289926428f94766374">tempest-TaggedAttachmentsTest-1663776612-project-member</nova:user>
Oct 18 11:44:27 user nova-compute[74190]:     <nova:project uuid="72f55b03dea844739b3e36d4f73b23e0">tempest-TaggedAttachmentsTest-1663776612</nova:project>
Oct 18 11:44:27 user nova-compute[74190]:   </nova:owner>
Oct 18 11:44:27 user nova-compute[74190]:   <nova:root type="image" uuid="6e88bbf0-6e78-49a8-b3c5-9453d22a89df"/>
Oct 18 11:44:27 user nova-compute[74190]:   <nova:ports>
Oct 18 11:44:27 user nova-compute[74190]:     <nova:port uuid="2f3b8cfe-f9f2-4dc5-b368-f67ef363266c">
Oct 18 11:44:27 user nova-compute[74190]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 18 11:44:27 user nova-compute[74190]:     </nova:port>
Oct 18 11:44:27 user nova-compute[74190]:   </nova:ports>
Oct 18 11:44:27 user nova-compute[74190]: </nova:instance>
Oct 18 11:44:27 user nova-compute[74190]:  {{(pid=74190) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 18 11:44:28 user nova-compute[74190]: DEBUG nova.compute.manager [req-d08bf2b0-3627-4054-ab45-8cb94d2f4c64 req-593a00f8-afdb-4f8f-8457-708a2f9a2015 service nova] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] Received event network-vif-deleted-b5f712f6-6733-4725-b563-2218a4a58813 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:44:28 user nova-compute[74190]: INFO nova.compute.manager [req-d08bf2b0-3627-4054-ab45-8cb94d2f4c64 req-593a00f8-afdb-4f8f-8457-708a2f9a2015 service nova] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] Neutron deleted interface b5f712f6-6733-4725-b563-2218a4a58813; detaching it from the instance and deleting it from the info cache
Oct 18 11:44:28 user nova-compute[74190]: DEBUG nova.network.neutron [req-d08bf2b0-3627-4054-ab45-8cb94d2f4c64 req-593a00f8-afdb-4f8f-8457-708a2f9a2015 service nova] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] Updating instance_info_cache with network_info: [{"id": "2f3b8cfe-f9f2-4dc5-b368-f67ef363266c", "address": "fa:16:3e:22:e2:3f", "network": {"id": "c9482f29-6e29-48c6-beb9-64721a29b3d9", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1092346276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72f55b03dea844739b3e36d4f73b23e0", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f3b8cfe-f9", "ovs_interfaceid": "2f3b8cfe-f9f2-4dc5-b368-f67ef363266c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:44:28 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-e86fba79-aceb-403f-a2a0-a452cb123427 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Acquiring lock "refresh_cache-6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:44:28 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-e86fba79-aceb-403f-a2a0-a452cb123427 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Acquired lock "refresh_cache-6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:44:28 user nova-compute[74190]: DEBUG nova.network.neutron [None req-e86fba79-aceb-403f-a2a0-a452cb123427 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] Building network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 11:44:28 user nova-compute[74190]: DEBUG nova.objects.instance [req-d08bf2b0-3627-4054-ab45-8cb94d2f4c64 req-593a00f8-afdb-4f8f-8457-708a2f9a2015 service nova] Lazy-loading 'system_metadata' on Instance uuid 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:44:28 user nova-compute[74190]: DEBUG nova.objects.instance [req-d08bf2b0-3627-4054-ab45-8cb94d2f4c64 req-593a00f8-afdb-4f8f-8457-708a2f9a2015 service nova] Lazy-loading 'flavor' on Instance uuid 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:44:28 user nova-compute[74190]: DEBUG nova.objects.base [req-d08bf2b0-3627-4054-ab45-8cb94d2f4c64 req-593a00f8-afdb-4f8f-8457-708a2f9a2015 service nova] Object Instance<6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef> lazy-loaded attributes: system_metadata,flavor {{(pid=74190) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 11:44:28 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [req-d08bf2b0-3627-4054-ab45-8cb94d2f4c64 req-593a00f8-afdb-4f8f-8457-708a2f9a2015 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T11:41:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-239478616',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-239478616',id=5,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDiL4Y3YjaIYG9f48clgmLYvNf1xzm1drxLs+YLjigprz2IgSEssC/H3MORsYOE3v5yg6mGeg/8ep19TIA+gnsVGZGVVookzYwja4uGKlJS/z4feKfCDiLYrj74IwuE8uQ==',key_name='tempest-keypair-654404793',keypairs=<?>,launch_index=0,launched_at=2023-10-18T11:41:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='72f55b03dea844739b3e36d4f73b23e0',ramdisk_id='',reservation_id='r-iliez3d9',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1663776612',owner_user_name='tempest-TaggedAttachmentsTest-1663776612-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T11:41:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a587bc7358fe4d289926428f94766374',uuid=6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b5f712f6-6733-4725-b563-2218a4a58813", "address": "fa:16:3e:ab:58:86", "network": {"id": "a814b9ab-3007-49af-aa0f-13a6d655952a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1870963685", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "72f55b03dea844739b3e36d4f73b23e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f712f6-67", "ovs_interfaceid": "b5f712f6-6733-4725-b563-2218a4a58813", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74190) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 11:44:28 user nova-compute[74190]: DEBUG nova.network.os_vif_util [req-d08bf2b0-3627-4054-ab45-8cb94d2f4c64 req-593a00f8-afdb-4f8f-8457-708a2f9a2015 service nova] Converting VIF {"id": "b5f712f6-6733-4725-b563-2218a4a58813", "address": "fa:16:3e:ab:58:86", "network": {"id": "a814b9ab-3007-49af-aa0f-13a6d655952a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1870963685", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "72f55b03dea844739b3e36d4f73b23e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f712f6-67", "ovs_interfaceid": "b5f712f6-6733-4725-b563-2218a4a58813", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:44:28 user nova-compute[74190]: DEBUG nova.network.os_vif_util [req-d08bf2b0-3627-4054-ab45-8cb94d2f4c64 req-593a00f8-afdb-4f8f-8457-708a2f9a2015 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:58:86,bridge_name='br-int',has_traffic_filtering=True,id=b5f712f6-6733-4725-b563-2218a4a58813,network=Network(a814b9ab-3007-49af-aa0f-13a6d655952a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5f712f6-67') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:44:28 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [req-d08bf2b0-3627-4054-ab45-8cb94d2f4c64 req-593a00f8-afdb-4f8f-8457-708a2f9a2015 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:ab:58:86"/><model type="virtio"/><mtu size="1442"/><target dev="tapb5f712f6-67"/></interface> {{(pid=74190) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 18 11:44:28 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [req-d08bf2b0-3627-4054-ab45-8cb94d2f4c64 req-593a00f8-afdb-4f8f-8457-708a2f9a2015 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:ab:58:86"/><model type="virtio"/><mtu size="1442"/><target dev="tapb5f712f6-67"/></interface>not found in domain: <domain type='kvm' id='5'>
Oct 18 11:44:28 user nova-compute[74190]:   <name>instance-00000005</name>
Oct 18 11:44:28 user nova-compute[74190]:   <uuid>6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef</uuid>
Oct 18 11:44:28 user nova-compute[74190]:   <metadata>
Oct 18 11:44:28 user nova-compute[74190]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 11:44:28 user nova-compute[74190]:   <nova:package version="0.0.0"/>
Oct 18 11:44:28 user nova-compute[74190]:   <nova:name>tempest-device-tagging-server-239478616</nova:name>
Oct 18 11:44:28 user nova-compute[74190]:   <nova:creationTime>2023-10-18 11:44:27</nova:creationTime>
Oct 18 11:44:28 user nova-compute[74190]:   <nova:flavor name="m1.tiny">
Oct 18 11:44:28 user nova-compute[74190]:     <nova:memory>512</nova:memory>
Oct 18 11:44:28 user nova-compute[74190]:     <nova:disk>1</nova:disk>
Oct 18 11:44:28 user nova-compute[74190]:     <nova:swap>0</nova:swap>
Oct 18 11:44:28 user nova-compute[74190]:     <nova:ephemeral>0</nova:ephemeral>
Oct 18 11:44:28 user nova-compute[74190]:     <nova:vcpus>1</nova:vcpus>
Oct 18 11:44:28 user nova-compute[74190]:   </nova:flavor>
Oct 18 11:44:28 user nova-compute[74190]:   <nova:owner>
Oct 18 11:44:28 user nova-compute[74190]:     <nova:user uuid="a587bc7358fe4d289926428f94766374">tempest-TaggedAttachmentsTest-1663776612-project-member</nova:user>
Oct 18 11:44:28 user nova-compute[74190]:     <nova:project uuid="72f55b03dea844739b3e36d4f73b23e0">tempest-TaggedAttachmentsTest-1663776612</nova:project>
Oct 18 11:44:28 user nova-compute[74190]:   </nova:owner>
Oct 18 11:44:28 user nova-compute[74190]:   <nova:root type="image" uuid="6e88bbf0-6e78-49a8-b3c5-9453d22a89df"/>
Oct 18 11:44:28 user nova-compute[74190]:   <nova:ports>
Oct 18 11:44:28 user nova-compute[74190]:     <nova:port uuid="2f3b8cfe-f9f2-4dc5-b368-f67ef363266c">
Oct 18 11:44:28 user nova-compute[74190]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 18 11:44:28 user nova-compute[74190]:     </nova:port>
Oct 18 11:44:28 user nova-compute[74190]:   </nova:ports>
Oct 18 11:44:28 user nova-compute[74190]: </nova:instance>
Oct 18 11:44:28 user nova-compute[74190]:   </metadata>
Oct 18 11:44:28 user nova-compute[74190]:   <memory unit='KiB'>524288</memory>
Oct 18 11:44:28 user nova-compute[74190]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 18 11:44:28 user nova-compute[74190]:   <vcpu placement='static'>1</vcpu>
Oct 18 11:44:28 user nova-compute[74190]:   <resource>
Oct 18 11:44:28 user nova-compute[74190]:     <partition>/machine</partition>
Oct 18 11:44:28 user nova-compute[74190]:   </resource>
Oct 18 11:44:28 user nova-compute[74190]:   <sysinfo type='smbios'>
Oct 18 11:44:28 user nova-compute[74190]:     <system>
Oct 18 11:44:28 user nova-compute[74190]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 18 11:44:28 user nova-compute[74190]:       <entry name='product'>OpenStack Nova</entry>
Oct 18 11:44:28 user nova-compute[74190]:       <entry name='version'>0.0.0</entry>
Oct 18 11:44:28 user nova-compute[74190]:       <entry name='serial'>6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef</entry>
Oct 18 11:44:28 user nova-compute[74190]:       <entry name='uuid'>6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef</entry>
Oct 18 11:44:28 user nova-compute[74190]:       <entry name='family'>Virtual Machine</entry>
Oct 18 11:44:28 user nova-compute[74190]:     </system>
Oct 18 11:44:28 user nova-compute[74190]:   </sysinfo>
Oct 18 11:44:28 user nova-compute[74190]:   <os>
Oct 18 11:44:28 user nova-compute[74190]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 18 11:44:28 user nova-compute[74190]:     <boot dev='hd'/>
Oct 18 11:44:28 user nova-compute[74190]:     <smbios mode='sysinfo'/>
Oct 18 11:44:28 user nova-compute[74190]:   </os>
Oct 18 11:44:28 user nova-compute[74190]:   <features>
Oct 18 11:44:28 user nova-compute[74190]:     <acpi/>
Oct 18 11:44:28 user nova-compute[74190]:     <apic/>
Oct 18 11:44:28 user nova-compute[74190]:     <vmcoreinfo state='on'/>
Oct 18 11:44:28 user nova-compute[74190]:   </features>
Oct 18 11:44:28 user nova-compute[74190]:   <cpu mode='custom' match='exact' check='full'>
Oct 18 11:44:28 user nova-compute[74190]:     <model fallback='forbid'>Nehalem</model>
Oct 18 11:44:28 user nova-compute[74190]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 18 11:44:28 user nova-compute[74190]:     <feature policy='require' name='vme'/>
Oct 18 11:44:28 user nova-compute[74190]:     <feature policy='require' name='x2apic'/>
Oct 18 11:44:28 user nova-compute[74190]:     <feature policy='require' name='hypervisor'/>
Oct 18 11:44:28 user nova-compute[74190]:   </cpu>
Oct 18 11:44:28 user nova-compute[74190]:   <clock offset='utc'>
Oct 18 11:44:28 user nova-compute[74190]:     <timer name='pit' tickpolicy='delay'/>
Oct 18 11:44:28 user nova-compute[74190]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 18 11:44:28 user nova-compute[74190]:     <timer name='hpet' present='no'/>
Oct 18 11:44:28 user nova-compute[74190]:   </clock>
Oct 18 11:44:28 user nova-compute[74190]:   <on_poweroff>destroy</on_poweroff>
Oct 18 11:44:28 user nova-compute[74190]:   <on_reboot>restart</on_reboot>
Oct 18 11:44:28 user nova-compute[74190]:   <on_crash>destroy</on_crash>
Oct 18 11:44:28 user nova-compute[74190]:   <devices>
Oct 18 11:44:28 user nova-compute[74190]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 18 11:44:28 user nova-compute[74190]:     <disk type='file' device='disk'>
Oct 18 11:44:28 user nova-compute[74190]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 18 11:44:28 user nova-compute[74190]:       <source file='/opt/stack/data/nova/instances/6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef/disk' index='2'/>
Oct 18 11:44:28 user nova-compute[74190]:       <backingStore type='file' index='3'>
Oct 18 11:44:28 user nova-compute[74190]:         <format type='raw'/>
Oct 18 11:44:28 user nova-compute[74190]:         <source file='/opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f'/>
Oct 18 11:44:28 user nova-compute[74190]:         <backingStore/>
Oct 18 11:44:28 user nova-compute[74190]:       </backingStore>
Oct 18 11:44:28 user nova-compute[74190]:       <target dev='vda' bus='virtio'/>
Oct 18 11:44:28 user nova-compute[74190]:       <alias name='virtio-disk0'/>
Oct 18 11:44:28 user nova-compute[74190]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 18 11:44:28 user nova-compute[74190]:     </disk>
Oct 18 11:44:28 user nova-compute[74190]:     <disk type='file' device='cdrom'>
Oct 18 11:44:28 user nova-compute[74190]:       <driver name='qemu' type='raw' cache='none'/>
Oct 18 11:44:28 user nova-compute[74190]:       <source file='/opt/stack/data/nova/instances/6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef/disk.config' index='1'/>
Oct 18 11:44:28 user nova-compute[74190]:       <backingStore/>
Oct 18 11:44:28 user nova-compute[74190]:       <target dev='hda' bus='ide'/>
Oct 18 11:44:28 user nova-compute[74190]:       <readonly/>
Oct 18 11:44:28 user nova-compute[74190]:       <alias name='ide0-0-0'/>
Oct 18 11:44:28 user nova-compute[74190]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 18 11:44:28 user nova-compute[74190]:     </disk>
Oct 18 11:44:28 user nova-compute[74190]:     <controller type='usb' index='0' model='none'>
Oct 18 11:44:28 user nova-compute[74190]:       <alias name='usb'/>
Oct 18 11:44:28 user nova-compute[74190]:     </controller>
Oct 18 11:44:28 user nova-compute[74190]:     <controller type='pci' index='0' model='pci-root'>
Oct 18 11:44:28 user nova-compute[74190]:       <alias name='pci.0'/>
Oct 18 11:44:28 user nova-compute[74190]:     </controller>
Oct 18 11:44:28 user nova-compute[74190]:     <controller type='ide' index='0'>
Oct 18 11:44:28 user nova-compute[74190]:       <alias name='ide'/>
Oct 18 11:44:28 user nova-compute[74190]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 18 11:44:28 user nova-compute[74190]:     </controller>
Oct 18 11:44:28 user nova-compute[74190]:     <interface type='ethernet'>
Oct 18 11:44:28 user nova-compute[74190]:       <mac address='fa:16:3e:22:e2:3f'/>
Oct 18 11:44:28 user nova-compute[74190]:       <target dev='tap2f3b8cfe-f9'/>
Oct 18 11:44:28 user nova-compute[74190]:       <model type='virtio'/>
Oct 18 11:44:28 user nova-compute[74190]:       <mtu size='1442'/>
Oct 18 11:44:28 user nova-compute[74190]:       <alias name='net0'/>
Oct 18 11:44:28 user nova-compute[74190]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 18 11:44:28 user nova-compute[74190]:     </interface>
Oct 18 11:44:28 user nova-compute[74190]:     <serial type='pty'>
Oct 18 11:44:28 user nova-compute[74190]:       <source path='/dev/pts/4'/>
Oct 18 11:44:28 user nova-compute[74190]:       <log file='/opt/stack/data/nova/instances/6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef/console.log' append='off'/>
Oct 18 11:44:28 user nova-compute[74190]:       <target type='isa-serial' port='0'>
Oct 18 11:44:28 user nova-compute[74190]:         <model name='isa-serial'/>
Oct 18 11:44:28 user nova-compute[74190]:       </target>
Oct 18 11:44:28 user nova-compute[74190]:       <alias name='serial0'/>
Oct 18 11:44:28 user nova-compute[74190]:     </serial>
Oct 18 11:44:28 user nova-compute[74190]:     <console type='pty' tty='/dev/pts/4'>
Oct 18 11:44:28 user nova-compute[74190]:       <source path='/dev/pts/4'/>
Oct 18 11:44:28 user nova-compute[74190]:       <log file='/opt/stack/data/nova/instances/6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef/console.log' append='off'/>
Oct 18 11:44:28 user nova-compute[74190]:       <target type='serial' port='0'/>
Oct 18 11:44:28 user nova-compute[74190]:       <alias name='serial0'/>
Oct 18 11:44:28 user nova-compute[74190]:     </console>
Oct 18 11:44:28 user nova-compute[74190]:     <input type='mouse' bus='ps2'>
Oct 18 11:44:28 user nova-compute[74190]:       <alias name='input0'/>
Oct 18 11:44:28 user nova-compute[74190]:     </input>
Oct 18 11:44:28 user nova-compute[74190]:     <input type='keyboard' bus='ps2'>
Oct 18 11:44:28 user nova-compute[74190]:       <alias name='input1'/>
Oct 18 11:44:28 user nova-compute[74190]:     </input>
Oct 18 11:44:28 user nova-compute[74190]:     <graphics type='vnc' port='5904' autoport='yes' listen='0.0.0.0'>
Oct 18 11:44:28 user nova-compute[74190]:       <listen type='address' address='0.0.0.0'/>
Oct 18 11:44:28 user nova-compute[74190]:     </graphics>
Oct 18 11:44:28 user nova-compute[74190]:     <audio id='1' type='none'/>
Oct 18 11:44:28 user nova-compute[74190]:     <video>
Oct 18 11:44:28 user nova-compute[74190]:       <model type='virtio' heads='1' primary='yes'/>
Oct 18 11:44:28 user nova-compute[74190]:       <alias name='video0'/>
Oct 18 11:44:28 user nova-compute[74190]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 18 11:44:28 user nova-compute[74190]:     </video>
Oct 18 11:44:28 user nova-compute[74190]:     <memballoon model='virtio'>
Oct 18 11:44:28 user nova-compute[74190]:       <stats period='10'/>
Oct 18 11:44:28 user nova-compute[74190]:       <alias name='balloon0'/>
Oct 18 11:44:28 user nova-compute[74190]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 18 11:44:28 user nova-compute[74190]:     </memballoon>
Oct 18 11:44:28 user nova-compute[74190]:     <rng model='virtio'>
Oct 18 11:44:28 user nova-compute[74190]:       <backend model='random'>/dev/urandom</backend>
Oct 18 11:44:28 user nova-compute[74190]:       <alias name='rng0'/>
Oct 18 11:44:28 user nova-compute[74190]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 18 11:44:28 user nova-compute[74190]:     </rng>
Oct 18 11:44:28 user nova-compute[74190]:   </devices>
Oct 18 11:44:28 user nova-compute[74190]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 18 11:44:28 user nova-compute[74190]:     <label>libvirt-6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef</label>
Oct 18 11:44:28 user nova-compute[74190]:     <imagelabel>libvirt-6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef</imagelabel>
Oct 18 11:44:28 user nova-compute[74190]:   </seclabel>
Oct 18 11:44:28 user nova-compute[74190]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 18 11:44:28 user nova-compute[74190]:     <label>+64055:+108</label>
Oct 18 11:44:28 user nova-compute[74190]:     <imagelabel>+64055:+108</imagelabel>
Oct 18 11:44:28 user nova-compute[74190]:   </seclabel>
Oct 18 11:44:28 user nova-compute[74190]: </domain>
Oct 18 11:44:28 user nova-compute[74190]:  {{(pid=74190) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 18 11:44:28 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [req-d08bf2b0-3627-4054-ab45-8cb94d2f4c64 req-593a00f8-afdb-4f8f-8457-708a2f9a2015 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:ab:58:86"/><model type="virtio"/><mtu size="1442"/><target dev="tapb5f712f6-67"/></interface> {{(pid=74190) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 18 11:44:28 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [req-d08bf2b0-3627-4054-ab45-8cb94d2f4c64 req-593a00f8-afdb-4f8f-8457-708a2f9a2015 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:ab:58:86"/><model type="virtio"/><mtu size="1442"/><target dev="tapb5f712f6-67"/></interface>not found in domain: <domain type='kvm' id='5'>
Oct 18 11:44:28 user nova-compute[74190]:   <name>instance-00000005</name>
Oct 18 11:44:28 user nova-compute[74190]:   <uuid>6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef</uuid>
Oct 18 11:44:28 user nova-compute[74190]:   <metadata>
Oct 18 11:44:28 user nova-compute[74190]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 11:44:28 user nova-compute[74190]:   <nova:package version="0.0.0"/>
Oct 18 11:44:28 user nova-compute[74190]:   <nova:name>tempest-device-tagging-server-239478616</nova:name>
Oct 18 11:44:28 user nova-compute[74190]:   <nova:creationTime>2023-10-18 11:44:27</nova:creationTime>
Oct 18 11:44:28 user nova-compute[74190]:   <nova:flavor name="m1.tiny">
Oct 18 11:44:28 user nova-compute[74190]:     <nova:memory>512</nova:memory>
Oct 18 11:44:28 user nova-compute[74190]:     <nova:disk>1</nova:disk>
Oct 18 11:44:28 user nova-compute[74190]:     <nova:swap>0</nova:swap>
Oct 18 11:44:28 user nova-compute[74190]:     <nova:ephemeral>0</nova:ephemeral>
Oct 18 11:44:28 user nova-compute[74190]:     <nova:vcpus>1</nova:vcpus>
Oct 18 11:44:28 user nova-compute[74190]:   </nova:flavor>
Oct 18 11:44:28 user nova-compute[74190]:   <nova:owner>
Oct 18 11:44:28 user nova-compute[74190]:     <nova:user uuid="a587bc7358fe4d289926428f94766374">tempest-TaggedAttachmentsTest-1663776612-project-member</nova:user>
Oct 18 11:44:28 user nova-compute[74190]:     <nova:project uuid="72f55b03dea844739b3e36d4f73b23e0">tempest-TaggedAttachmentsTest-1663776612</nova:project>
Oct 18 11:44:28 user nova-compute[74190]:   </nova:owner>
Oct 18 11:44:28 user nova-compute[74190]:   <nova:root type="image" uuid="6e88bbf0-6e78-49a8-b3c5-9453d22a89df"/>
Oct 18 11:44:28 user nova-compute[74190]:   <nova:ports>
Oct 18 11:44:28 user nova-compute[74190]:     <nova:port uuid="2f3b8cfe-f9f2-4dc5-b368-f67ef363266c">
Oct 18 11:44:28 user nova-compute[74190]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 18 11:44:28 user nova-compute[74190]:     </nova:port>
Oct 18 11:44:28 user nova-compute[74190]:   </nova:ports>
Oct 18 11:44:28 user nova-compute[74190]: </nova:instance>
Oct 18 11:44:28 user nova-compute[74190]:   </metadata>
Oct 18 11:44:28 user nova-compute[74190]:   <memory unit='KiB'>524288</memory>
Oct 18 11:44:28 user nova-compute[74190]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 18 11:44:28 user nova-compute[74190]:   <vcpu placement='static'>1</vcpu>
Oct 18 11:44:28 user nova-compute[74190]:   <resource>
Oct 18 11:44:28 user nova-compute[74190]:     <partition>/machine</partition>
Oct 18 11:44:28 user nova-compute[74190]:   </resource>
Oct 18 11:44:28 user nova-compute[74190]:   <sysinfo type='smbios'>
Oct 18 11:44:28 user nova-compute[74190]:     <system>
Oct 18 11:44:28 user nova-compute[74190]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 18 11:44:28 user nova-compute[74190]:       <entry name='product'>OpenStack Nova</entry>
Oct 18 11:44:28 user nova-compute[74190]:       <entry name='version'>0.0.0</entry>
Oct 18 11:44:28 user nova-compute[74190]:       <entry name='serial'>6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef</entry>
Oct 18 11:44:28 user nova-compute[74190]:       <entry name='uuid'>6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef</entry>
Oct 18 11:44:28 user nova-compute[74190]:       <entry name='family'>Virtual Machine</entry>
Oct 18 11:44:28 user nova-compute[74190]:     </system>
Oct 18 11:44:28 user nova-compute[74190]:   </sysinfo>
Oct 18 11:44:28 user nova-compute[74190]:   <os>
Oct 18 11:44:28 user nova-compute[74190]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 18 11:44:28 user nova-compute[74190]:     <boot dev='hd'/>
Oct 18 11:44:28 user nova-compute[74190]:     <smbios mode='sysinfo'/>
Oct 18 11:44:28 user nova-compute[74190]:   </os>
Oct 18 11:44:28 user nova-compute[74190]:   <features>
Oct 18 11:44:28 user nova-compute[74190]:     <acpi/>
Oct 18 11:44:28 user nova-compute[74190]:     <apic/>
Oct 18 11:44:28 user nova-compute[74190]:     <vmcoreinfo state='on'/>
Oct 18 11:44:28 user nova-compute[74190]:   </features>
Oct 18 11:44:28 user nova-compute[74190]:   <cpu mode='custom' match='exact' check='full'>
Oct 18 11:44:28 user nova-compute[74190]:     <model fallback='forbid'>Nehalem</model>
Oct 18 11:44:28 user nova-compute[74190]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 18 11:44:28 user nova-compute[74190]:     <feature policy='require' name='vme'/>
Oct 18 11:44:28 user nova-compute[74190]:     <feature policy='require' name='x2apic'/>
Oct 18 11:44:28 user nova-compute[74190]:     <feature policy='require' name='hypervisor'/>
Oct 18 11:44:28 user nova-compute[74190]:   </cpu>
Oct 18 11:44:28 user nova-compute[74190]:   <clock offset='utc'>
Oct 18 11:44:28 user nova-compute[74190]:     <timer name='pit' tickpolicy='delay'/>
Oct 18 11:44:28 user nova-compute[74190]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 18 11:44:28 user nova-compute[74190]:     <timer name='hpet' present='no'/>
Oct 18 11:44:28 user nova-compute[74190]:   </clock>
Oct 18 11:44:28 user nova-compute[74190]:   <on_poweroff>destroy</on_poweroff>
Oct 18 11:44:28 user nova-compute[74190]:   <on_reboot>restart</on_reboot>
Oct 18 11:44:28 user nova-compute[74190]:   <on_crash>destroy</on_crash>
Oct 18 11:44:28 user nova-compute[74190]:   <devices>
Oct 18 11:44:28 user nova-compute[74190]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 18 11:44:28 user nova-compute[74190]:     <disk type='file' device='disk'>
Oct 18 11:44:28 user nova-compute[74190]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 18 11:44:28 user nova-compute[74190]:       <source file='/opt/stack/data/nova/instances/6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef/disk' index='2'/>
Oct 18 11:44:28 user nova-compute[74190]:       <backingStore type='file' index='3'>
Oct 18 11:44:28 user nova-compute[74190]:         <format type='raw'/>
Oct 18 11:44:28 user nova-compute[74190]:         <source file='/opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f'/>
Oct 18 11:44:28 user nova-compute[74190]:         <backingStore/>
Oct 18 11:44:28 user nova-compute[74190]:       </backingStore>
Oct 18 11:44:28 user nova-compute[74190]:       <target dev='vda' bus='virtio'/>
Oct 18 11:44:28 user nova-compute[74190]:       <alias name='virtio-disk0'/>
Oct 18 11:44:28 user nova-compute[74190]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 18 11:44:28 user nova-compute[74190]:     </disk>
Oct 18 11:44:28 user nova-compute[74190]:     <disk type='file' device='cdrom'>
Oct 18 11:44:28 user nova-compute[74190]:       <driver name='qemu' type='raw' cache='none'/>
Oct 18 11:44:28 user nova-compute[74190]:       <source file='/opt/stack/data/nova/instances/6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef/disk.config' index='1'/>
Oct 18 11:44:28 user nova-compute[74190]:       <backingStore/>
Oct 18 11:44:28 user nova-compute[74190]:       <target dev='hda' bus='ide'/>
Oct 18 11:44:28 user nova-compute[74190]:       <readonly/>
Oct 18 11:44:28 user nova-compute[74190]:       <alias name='ide0-0-0'/>
Oct 18 11:44:28 user nova-compute[74190]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 18 11:44:28 user nova-compute[74190]:     </disk>
Oct 18 11:44:28 user nova-compute[74190]:     <controller type='usb' index='0' model='none'>
Oct 18 11:44:28 user nova-compute[74190]:       <alias name='usb'/>
Oct 18 11:44:28 user nova-compute[74190]:     </controller>
Oct 18 11:44:28 user nova-compute[74190]:     <controller type='pci' index='0' model='pci-root'>
Oct 18 11:44:28 user nova-compute[74190]:       <alias name='pci.0'/>
Oct 18 11:44:28 user nova-compute[74190]:     </controller>
Oct 18 11:44:28 user nova-compute[74190]:     <controller type='ide' index='0'>
Oct 18 11:44:28 user nova-compute[74190]:       <alias name='ide'/>
Oct 18 11:44:28 user nova-compute[74190]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 18 11:44:28 user nova-compute[74190]:     </controller>
Oct 18 11:44:28 user nova-compute[74190]:     <interface type='ethernet'>
Oct 18 11:44:28 user nova-compute[74190]:       <mac address='fa:16:3e:22:e2:3f'/>
Oct 18 11:44:28 user nova-compute[74190]:       <target dev='tap2f3b8cfe-f9'/>
Oct 18 11:44:28 user nova-compute[74190]:       <model type='virtio'/>
Oct 18 11:44:28 user nova-compute[74190]:       <mtu size='1442'/>
Oct 18 11:44:28 user nova-compute[74190]:       <alias name='net0'/>
Oct 18 11:44:28 user nova-compute[74190]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 18 11:44:28 user nova-compute[74190]:     </interface>
Oct 18 11:44:28 user nova-compute[74190]:     <serial type='pty'>
Oct 18 11:44:28 user nova-compute[74190]:       <source path='/dev/pts/4'/>
Oct 18 11:44:28 user nova-compute[74190]:       <log file='/opt/stack/data/nova/instances/6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef/console.log' append='off'/>
Oct 18 11:44:28 user nova-compute[74190]:       <target type='isa-serial' port='0'>
Oct 18 11:44:28 user nova-compute[74190]:         <model name='isa-serial'/>
Oct 18 11:44:28 user nova-compute[74190]:       </target>
Oct 18 11:44:28 user nova-compute[74190]:       <alias name='serial0'/>
Oct 18 11:44:28 user nova-compute[74190]:     </serial>
Oct 18 11:44:28 user nova-compute[74190]:     <console type='pty' tty='/dev/pts/4'>
Oct 18 11:44:28 user nova-compute[74190]:       <source path='/dev/pts/4'/>
Oct 18 11:44:28 user nova-compute[74190]:       <log file='/opt/stack/data/nova/instances/6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef/console.log' append='off'/>
Oct 18 11:44:28 user nova-compute[74190]:       <target type='serial' port='0'/>
Oct 18 11:44:28 user nova-compute[74190]:       <alias name='serial0'/>
Oct 18 11:44:28 user nova-compute[74190]:     </console>
Oct 18 11:44:28 user nova-compute[74190]:     <input type='mouse' bus='ps2'>
Oct 18 11:44:28 user nova-compute[74190]:       <alias name='input0'/>
Oct 18 11:44:28 user nova-compute[74190]:     </input>
Oct 18 11:44:28 user nova-compute[74190]:     <input type='keyboard' bus='ps2'>
Oct 18 11:44:28 user nova-compute[74190]:       <alias name='input1'/>
Oct 18 11:44:28 user nova-compute[74190]:     </input>
Oct 18 11:44:28 user nova-compute[74190]:     <graphics type='vnc' port='5904' autoport='yes' listen='0.0.0.0'>
Oct 18 11:44:28 user nova-compute[74190]:       <listen type='address' address='0.0.0.0'/>
Oct 18 11:44:28 user nova-compute[74190]:     </graphics>
Oct 18 11:44:28 user nova-compute[74190]:     <audio id='1' type='none'/>
Oct 18 11:44:28 user nova-compute[74190]:     <video>
Oct 18 11:44:28 user nova-compute[74190]:       <model type='virtio' heads='1' primary='yes'/>
Oct 18 11:44:28 user nova-compute[74190]:       <alias name='video0'/>
Oct 18 11:44:28 user nova-compute[74190]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 18 11:44:28 user nova-compute[74190]:     </video>
Oct 18 11:44:28 user nova-compute[74190]:     <memballoon model='virtio'>
Oct 18 11:44:28 user nova-compute[74190]:       <stats period='10'/>
Oct 18 11:44:28 user nova-compute[74190]:       <alias name='balloon0'/>
Oct 18 11:44:28 user nova-compute[74190]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 18 11:44:28 user nova-compute[74190]:     </memballoon>
Oct 18 11:44:28 user nova-compute[74190]:     <rng model='virtio'>
Oct 18 11:44:28 user nova-compute[74190]:       <backend model='random'>/dev/urandom</backend>
Oct 18 11:44:28 user nova-compute[74190]:       <alias name='rng0'/>
Oct 18 11:44:28 user nova-compute[74190]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 18 11:44:28 user nova-compute[74190]:     </rng>
Oct 18 11:44:28 user nova-compute[74190]:   </devices>
Oct 18 11:44:28 user nova-compute[74190]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 18 11:44:28 user nova-compute[74190]:     <label>libvirt-6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef</label>
Oct 18 11:44:28 user nova-compute[74190]:     <imagelabel>libvirt-6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef</imagelabel>
Oct 18 11:44:28 user nova-compute[74190]:   </seclabel>
Oct 18 11:44:28 user nova-compute[74190]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 18 11:44:28 user nova-compute[74190]:     <label>+64055:+108</label>
Oct 18 11:44:28 user nova-compute[74190]:     <imagelabel>+64055:+108</imagelabel>
Oct 18 11:44:28 user nova-compute[74190]:   </seclabel>
Oct 18 11:44:28 user nova-compute[74190]: </domain>
Oct 18 11:44:28 user nova-compute[74190]:  {{(pid=74190) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 18 11:44:28 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [req-d08bf2b0-3627-4054-ab45-8cb94d2f4c64 req-593a00f8-afdb-4f8f-8457-708a2f9a2015 service nova] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] Detaching interface fa:16:3e:ab:58:86 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tapb5f712f6-67' not found.
Oct 18 11:44:28 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [req-d08bf2b0-3627-4054-ab45-8cb94d2f4c64 req-593a00f8-afdb-4f8f-8457-708a2f9a2015 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T11:41:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-239478616',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-239478616',id=5,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDiL4Y3YjaIYG9f48clgmLYvNf1xzm1drxLs+YLjigprz2IgSEssC/H3MORsYOE3v5yg6mGeg/8ep19TIA+gnsVGZGVVookzYwja4uGKlJS/z4feKfCDiLYrj74IwuE8uQ==',key_name='tempest-keypair-654404793',keypairs=<?>,launch_index=0,launched_at=2023-10-18T11:41:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='72f55b03dea844739b3e36d4f73b23e0',ramdisk_id='',reservation_id='r-iliez3d9',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1663776612',owner_user_name='tempest-TaggedAttachmentsTest-1663776612-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T11:41:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a587bc7358fe4d289926428f94766374',uuid=6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b5f712f6-6733-4725-b563-2218a4a58813", "address": "fa:16:3e:ab:58:86", "network": {"id": "a814b9ab-3007-49af-aa0f-13a6d655952a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1870963685", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "72f55b03dea844739b3e36d4f73b23e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f712f6-67", "ovs_interfaceid": "b5f712f6-6733-4725-b563-2218a4a58813", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 11:44:28 user nova-compute[74190]: DEBUG nova.network.os_vif_util [req-d08bf2b0-3627-4054-ab45-8cb94d2f4c64 req-593a00f8-afdb-4f8f-8457-708a2f9a2015 service nova] Converting VIF {"id": "b5f712f6-6733-4725-b563-2218a4a58813", "address": "fa:16:3e:ab:58:86", "network": {"id": "a814b9ab-3007-49af-aa0f-13a6d655952a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1870963685", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "72f55b03dea844739b3e36d4f73b23e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f712f6-67", "ovs_interfaceid": "b5f712f6-6733-4725-b563-2218a4a58813", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:44:28 user nova-compute[74190]: DEBUG nova.network.os_vif_util [req-d08bf2b0-3627-4054-ab45-8cb94d2f4c64 req-593a00f8-afdb-4f8f-8457-708a2f9a2015 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:58:86,bridge_name='br-int',has_traffic_filtering=True,id=b5f712f6-6733-4725-b563-2218a4a58813,network=Network(a814b9ab-3007-49af-aa0f-13a6d655952a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5f712f6-67') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:44:28 user nova-compute[74190]: DEBUG os_vif [req-d08bf2b0-3627-4054-ab45-8cb94d2f4c64 req-593a00f8-afdb-4f8f-8457-708a2f9a2015 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:58:86,bridge_name='br-int',has_traffic_filtering=True,id=b5f712f6-6733-4725-b563-2218a4a58813,network=Network(a814b9ab-3007-49af-aa0f-13a6d655952a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5f712f6-67') {{(pid=74190) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 11:44:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb5f712f6-67, bridge=br-int, if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:44:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 11:44:28 user nova-compute[74190]: INFO os_vif [req-d08bf2b0-3627-4054-ab45-8cb94d2f4c64 req-593a00f8-afdb-4f8f-8457-708a2f9a2015 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:58:86,bridge_name='br-int',has_traffic_filtering=True,id=b5f712f6-6733-4725-b563-2218a4a58813,network=Network(a814b9ab-3007-49af-aa0f-13a6d655952a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5f712f6-67')
Oct 18 11:44:28 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [req-d08bf2b0-3627-4054-ab45-8cb94d2f4c64 req-593a00f8-afdb-4f8f-8457-708a2f9a2015 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 11:44:28 user nova-compute[74190]:   <nova:package version="0.0.0"/>
Oct 18 11:44:28 user nova-compute[74190]:   <nova:name>tempest-device-tagging-server-239478616</nova:name>
Oct 18 11:44:28 user nova-compute[74190]:   <nova:creationTime>2023-10-18 11:44:28</nova:creationTime>
Oct 18 11:44:28 user nova-compute[74190]:   <nova:flavor name="m1.tiny">
Oct 18 11:44:28 user nova-compute[74190]:     <nova:memory>512</nova:memory>
Oct 18 11:44:28 user nova-compute[74190]:     <nova:disk>1</nova:disk>
Oct 18 11:44:28 user nova-compute[74190]:     <nova:swap>0</nova:swap>
Oct 18 11:44:28 user nova-compute[74190]:     <nova:ephemeral>0</nova:ephemeral>
Oct 18 11:44:28 user nova-compute[74190]:     <nova:vcpus>1</nova:vcpus>
Oct 18 11:44:28 user nova-compute[74190]:   </nova:flavor>
Oct 18 11:44:28 user nova-compute[74190]:   <nova:owner>
Oct 18 11:44:28 user nova-compute[74190]:     <nova:user uuid="a587bc7358fe4d289926428f94766374">tempest-TaggedAttachmentsTest-1663776612-project-member</nova:user>
Oct 18 11:44:28 user nova-compute[74190]:     <nova:project uuid="72f55b03dea844739b3e36d4f73b23e0">tempest-TaggedAttachmentsTest-1663776612</nova:project>
Oct 18 11:44:28 user nova-compute[74190]:   </nova:owner>
Oct 18 11:44:28 user nova-compute[74190]:   <nova:root type="image" uuid="6e88bbf0-6e78-49a8-b3c5-9453d22a89df"/>
Oct 18 11:44:28 user nova-compute[74190]:   <nova:ports>
Oct 18 11:44:28 user nova-compute[74190]:     <nova:port uuid="2f3b8cfe-f9f2-4dc5-b368-f67ef363266c">
Oct 18 11:44:28 user nova-compute[74190]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 18 11:44:28 user nova-compute[74190]:     </nova:port>
Oct 18 11:44:28 user nova-compute[74190]:   </nova:ports>
Oct 18 11:44:28 user nova-compute[74190]: </nova:instance>
Oct 18 11:44:28 user nova-compute[74190]:  {{(pid=74190) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 18 11:44:28 user nova-compute[74190]: DEBUG nova.network.neutron [None req-e86fba79-aceb-403f-a2a0-a452cb123427 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] Updating instance_info_cache with network_info: [{"id": "2f3b8cfe-f9f2-4dc5-b368-f67ef363266c", "address": "fa:16:3e:22:e2:3f", "network": {"id": "c9482f29-6e29-48c6-beb9-64721a29b3d9", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1092346276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72f55b03dea844739b3e36d4f73b23e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f3b8cfe-f9", "ovs_interfaceid": "2f3b8cfe-f9f2-4dc5-b368-f67ef363266c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:44:28 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-e86fba79-aceb-403f-a2a0-a452cb123427 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Releasing lock "refresh_cache-6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:44:28 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-e86fba79-aceb-403f-a2a0-a452cb123427 tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Lock "interface-6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef-b5f712f6-6733-4725-b563-2218a4a58813" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.950s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:44:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:32 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-99d2a368-49aa-42ed-91da-d040269db43d tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Acquiring lock "849ec21f-b785-47e7-a9fa-f89af1f78a2b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:44:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-99d2a368-49aa-42ed-91da-d040269db43d tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Lock "849ec21f-b785-47e7-a9fa-f89af1f78a2b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:44:34 user nova-compute[74190]: DEBUG nova.compute.manager [None req-99d2a368-49aa-42ed-91da-d040269db43d tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] [instance: 849ec21f-b785-47e7-a9fa-f89af1f78a2b] Starting instance... {{(pid=74190) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 11:44:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-99d2a368-49aa-42ed-91da-d040269db43d tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:44:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-99d2a368-49aa-42ed-91da-d040269db43d tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:44:34 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-99d2a368-49aa-42ed-91da-d040269db43d tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74190) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 11:44:34 user nova-compute[74190]: INFO nova.compute.claims [None req-99d2a368-49aa-42ed-91da-d040269db43d tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] [instance: 849ec21f-b785-47e7-a9fa-f89af1f78a2b] Claim successful on node user
Oct 18 11:44:35 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-99d2a368-49aa-42ed-91da-d040269db43d tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 11:44:35 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-99d2a368-49aa-42ed-91da-d040269db43d tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 11:44:35 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-99d2a368-49aa-42ed-91da-d040269db43d tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.372s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:44:35 user nova-compute[74190]: DEBUG nova.compute.manager [None req-99d2a368-49aa-42ed-91da-d040269db43d tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] [instance: 849ec21f-b785-47e7-a9fa-f89af1f78a2b] Start building networks asynchronously for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 11:44:35 user nova-compute[74190]: DEBUG nova.compute.manager [None req-99d2a368-49aa-42ed-91da-d040269db43d tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] [instance: 849ec21f-b785-47e7-a9fa-f89af1f78a2b] Allocating IP information in the background. {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 11:44:35 user nova-compute[74190]: DEBUG nova.network.neutron [None req-99d2a368-49aa-42ed-91da-d040269db43d tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] [instance: 849ec21f-b785-47e7-a9fa-f89af1f78a2b] allocate_for_instance() {{(pid=74190) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 11:44:35 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-99d2a368-49aa-42ed-91da-d040269db43d tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] [instance: 849ec21f-b785-47e7-a9fa-f89af1f78a2b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 11:44:35 user nova-compute[74190]: DEBUG nova.compute.manager [None req-99d2a368-49aa-42ed-91da-d040269db43d tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] [instance: 849ec21f-b785-47e7-a9fa-f89af1f78a2b] Start building block device mappings for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 11:44:35 user nova-compute[74190]: DEBUG nova.policy [None req-99d2a368-49aa-42ed-91da-d040269db43d tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4c68a9cb13814419a38413f9513d5a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d83064382624b4d895b0d7bff463f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74190) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 11:44:35 user nova-compute[74190]: DEBUG nova.compute.manager [None req-99d2a368-49aa-42ed-91da-d040269db43d tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] [instance: 849ec21f-b785-47e7-a9fa-f89af1f78a2b] Start spawning the instance on the hypervisor. {{(pid=74190) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 11:44:35 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-99d2a368-49aa-42ed-91da-d040269db43d tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] [instance: 849ec21f-b785-47e7-a9fa-f89af1f78a2b] Creating instance directory {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 11:44:35 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-99d2a368-49aa-42ed-91da-d040269db43d tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] [instance: 849ec21f-b785-47e7-a9fa-f89af1f78a2b] Creating image(s)
Oct 18 11:44:35 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-99d2a368-49aa-42ed-91da-d040269db43d tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Acquiring lock "/opt/stack/data/nova/instances/849ec21f-b785-47e7-a9fa-f89af1f78a2b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:44:35 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-99d2a368-49aa-42ed-91da-d040269db43d tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Lock "/opt/stack/data/nova/instances/849ec21f-b785-47e7-a9fa-f89af1f78a2b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:44:35 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-99d2a368-49aa-42ed-91da-d040269db43d tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Lock "/opt/stack/data/nova/instances/849ec21f-b785-47e7-a9fa-f89af1f78a2b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:44:35 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-99d2a368-49aa-42ed-91da-d040269db43d tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:35 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-99d2a368-49aa-42ed-91da-d040269db43d tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.183s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:35 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-99d2a368-49aa-42ed-91da-d040269db43d tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Acquiring lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:44:35 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-99d2a368-49aa-42ed-91da-d040269db43d tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:44:35 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-99d2a368-49aa-42ed-91da-d040269db43d tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:35 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-99d2a368-49aa-42ed-91da-d040269db43d tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.205s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:35 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-99d2a368-49aa-42ed-91da-d040269db43d tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f,backing_fmt=raw /opt/stack/data/nova/instances/849ec21f-b785-47e7-a9fa-f89af1f78a2b/disk 1073741824 {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:35 user nova-compute[74190]: DEBUG nova.network.neutron [None req-99d2a368-49aa-42ed-91da-d040269db43d tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] [instance: 849ec21f-b785-47e7-a9fa-f89af1f78a2b] Successfully created port: 95e0a8d6-2dba-4fb8-8d7d-b630e649d0f8 {{(pid=74190) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 11:44:36 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-99d2a368-49aa-42ed-91da-d040269db43d tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f,backing_fmt=raw /opt/stack/data/nova/instances/849ec21f-b785-47e7-a9fa-f89af1f78a2b/disk 1073741824" returned: 0 in 0.168s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-99d2a368-49aa-42ed-91da-d040269db43d tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.379s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:44:36 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-99d2a368-49aa-42ed-91da-d040269db43d tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:36 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-99d2a368-49aa-42ed-91da-d040269db43d tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.178s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:36 user nova-compute[74190]: DEBUG nova.virt.disk.api [None req-99d2a368-49aa-42ed-91da-d040269db43d tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Checking if we can resize image /opt/stack/data/nova/instances/849ec21f-b785-47e7-a9fa-f89af1f78a2b/disk. size=1073741824 {{(pid=74190) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 18 11:44:36 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-99d2a368-49aa-42ed-91da-d040269db43d tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/849ec21f-b785-47e7-a9fa-f89af1f78a2b/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:36 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-99d2a368-49aa-42ed-91da-d040269db43d tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/849ec21f-b785-47e7-a9fa-f89af1f78a2b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:36 user nova-compute[74190]: DEBUG nova.virt.disk.api [None req-99d2a368-49aa-42ed-91da-d040269db43d tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Cannot resize image /opt/stack/data/nova/instances/849ec21f-b785-47e7-a9fa-f89af1f78a2b/disk to a smaller size. {{(pid=74190) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 18 11:44:36 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-99d2a368-49aa-42ed-91da-d040269db43d tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] [instance: 849ec21f-b785-47e7-a9fa-f89af1f78a2b] Created local disks {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 11:44:36 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-99d2a368-49aa-42ed-91da-d040269db43d tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] [instance: 849ec21f-b785-47e7-a9fa-f89af1f78a2b] Ensure instance console log exists: /opt/stack/data/nova/instances/849ec21f-b785-47e7-a9fa-f89af1f78a2b/console.log {{(pid=74190) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 11:44:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-99d2a368-49aa-42ed-91da-d040269db43d tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:44:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-99d2a368-49aa-42ed-91da-d040269db43d tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:44:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-99d2a368-49aa-42ed-91da-d040269db43d tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:44:36 user nova-compute[74190]: DEBUG nova.network.neutron [None req-99d2a368-49aa-42ed-91da-d040269db43d tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] [instance: 849ec21f-b785-47e7-a9fa-f89af1f78a2b] Successfully updated port: 95e0a8d6-2dba-4fb8-8d7d-b630e649d0f8 {{(pid=74190) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 11:44:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-99d2a368-49aa-42ed-91da-d040269db43d tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Acquiring lock "refresh_cache-849ec21f-b785-47e7-a9fa-f89af1f78a2b" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:44:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-99d2a368-49aa-42ed-91da-d040269db43d tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Acquired lock "refresh_cache-849ec21f-b785-47e7-a9fa-f89af1f78a2b" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:44:36 user nova-compute[74190]: DEBUG nova.network.neutron [None req-99d2a368-49aa-42ed-91da-d040269db43d tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] [instance: 849ec21f-b785-47e7-a9fa-f89af1f78a2b] Building network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 11:44:36 user nova-compute[74190]: DEBUG nova.compute.manager [req-6a336585-5e8a-4d31-b5fd-c15b49edd2dc req-57aa1f72-864b-43d1-957f-311776205d62 service nova] [instance: 849ec21f-b785-47e7-a9fa-f89af1f78a2b] Received event network-changed-95e0a8d6-2dba-4fb8-8d7d-b630e649d0f8 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:44:36 user nova-compute[74190]: DEBUG nova.compute.manager [req-6a336585-5e8a-4d31-b5fd-c15b49edd2dc req-57aa1f72-864b-43d1-957f-311776205d62 service nova] [instance: 849ec21f-b785-47e7-a9fa-f89af1f78a2b] Refreshing instance network info cache due to event network-changed-95e0a8d6-2dba-4fb8-8d7d-b630e649d0f8. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 11:44:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-6a336585-5e8a-4d31-b5fd-c15b49edd2dc req-57aa1f72-864b-43d1-957f-311776205d62 service nova] Acquiring lock "refresh_cache-849ec21f-b785-47e7-a9fa-f89af1f78a2b" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:44:36 user nova-compute[74190]: DEBUG nova.network.neutron [None req-99d2a368-49aa-42ed-91da-d040269db43d tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] [instance: 849ec21f-b785-47e7-a9fa-f89af1f78a2b] Instance cache missing network info. {{(pid=74190) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 11:44:37 user nova-compute[74190]: DEBUG nova.network.neutron [None req-99d2a368-49aa-42ed-91da-d040269db43d tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] [instance: 849ec21f-b785-47e7-a9fa-f89af1f78a2b] Updating instance_info_cache with network_info: [{"id": "95e0a8d6-2dba-4fb8-8d7d-b630e649d0f8", "address": "fa:16:3e:ed:16:7e", "network": {"id": "c174814d-6217-4201-9af1-1575a8dcf751", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-981245321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d83064382624b4d895b0d7bff463f4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95e0a8d6-2d", "ovs_interfaceid": "95e0a8d6-2dba-4fb8-8d7d-b630e649d0f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:44:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-99d2a368-49aa-42ed-91da-d040269db43d tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Releasing lock "refresh_cache-849ec21f-b785-47e7-a9fa-f89af1f78a2b" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:44:37 user nova-compute[74190]: DEBUG nova.compute.manager [None req-99d2a368-49aa-42ed-91da-d040269db43d tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] [instance: 849ec21f-b785-47e7-a9fa-f89af1f78a2b] Instance network_info: |[{"id": "95e0a8d6-2dba-4fb8-8d7d-b630e649d0f8", "address": "fa:16:3e:ed:16:7e", "network": {"id": "c174814d-6217-4201-9af1-1575a8dcf751", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-981245321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d83064382624b4d895b0d7bff463f4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95e0a8d6-2d", "ovs_interfaceid": "95e0a8d6-2dba-4fb8-8d7d-b630e649d0f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 11:44:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-6a336585-5e8a-4d31-b5fd-c15b49edd2dc req-57aa1f72-864b-43d1-957f-311776205d62 service nova] Acquired lock "refresh_cache-849ec21f-b785-47e7-a9fa-f89af1f78a2b" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:44:37 user nova-compute[74190]: DEBUG nova.network.neutron [req-6a336585-5e8a-4d31-b5fd-c15b49edd2dc req-57aa1f72-864b-43d1-957f-311776205d62 service nova] [instance: 849ec21f-b785-47e7-a9fa-f89af1f78a2b] Refreshing network info cache for port 95e0a8d6-2dba-4fb8-8d7d-b630e649d0f8 {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 11:44:37 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-99d2a368-49aa-42ed-91da-d040269db43d tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] [instance: 849ec21f-b785-47e7-a9fa-f89af1f78a2b] Start _get_guest_xml network_info=[{"id": "95e0a8d6-2dba-4fb8-8d7d-b630e649d0f8", "address": "fa:16:3e:ed:16:7e", "network": {"id": "c174814d-6217-4201-9af1-1575a8dcf751", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-981245321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d83064382624b4d895b0d7bff463f4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95e0a8d6-2d", "ovs_interfaceid": "95e0a8d6-2dba-4fb8-8d7d-b630e649d0f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'image_id': '6e88bbf0-6e78-49a8-b3c5-9453d22a89df'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 11:44:37 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-99d2a368-49aa-42ed-91da-d040269db43d tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:44:37 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-99d2a368-49aa-42ed-91da-d040269db43d tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:44:37 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-99d2a368-49aa-42ed-91da-d040269db43d tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 11:44:37 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-99d2a368-49aa-42ed-91da-d040269db43d tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] CPU controller missing on host. {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 11:44:37 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-99d2a368-49aa-42ed-91da-d040269db43d tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 11:44:37 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-99d2a368-49aa-42ed-91da-d040269db43d tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] CPU controller found on host. {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 11:44:37 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-99d2a368-49aa-42ed-91da-d040269db43d tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74190) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 11:44:37 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-99d2a368-49aa-42ed-91da-d040269db43d tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T11:37:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 11:44:37 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-99d2a368-49aa-42ed-91da-d040269db43d tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Flavor limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 11:44:37 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-99d2a368-49aa-42ed-91da-d040269db43d tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Image limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 11:44:37 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-99d2a368-49aa-42ed-91da-d040269db43d tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Flavor pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 11:44:37 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-99d2a368-49aa-42ed-91da-d040269db43d tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Image pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 11:44:37 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-99d2a368-49aa-42ed-91da-d040269db43d tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 11:44:37 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-99d2a368-49aa-42ed-91da-d040269db43d tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 11:44:37 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-99d2a368-49aa-42ed-91da-d040269db43d tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 11:44:37 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-99d2a368-49aa-42ed-91da-d040269db43d tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Got 1 possible topologies {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 11:44:37 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-99d2a368-49aa-42ed-91da-d040269db43d tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 11:44:37 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-99d2a368-49aa-42ed-91da-d040269db43d tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 11:44:37 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-99d2a368-49aa-42ed-91da-d040269db43d tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:44:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1931953829',display_name='tempest-VolumesAdminNegativeTest-server-1931953829',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1931953829',id=11,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d83064382624b4d895b0d7bff463f4f',ramdisk_id='',reservation_id='r-0mdrup09',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1125052526',owner_user_name='tempest-VolumesAdminNegativeTest-1125052526-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:44:35Z,user_data=None,user_id='4c68a9cb13814419a38413f9513d5a80',uuid=849ec21f-b785-47e7-a9fa-f89af1f78a2b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "95e0a8d6-2dba-4fb8-8d7d-b630e649d0f8", "address": "fa:16:3e:ed:16:7e", "network": {"id": "c174814d-6217-4201-9af1-1575a8dcf751", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-981245321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d83064382624b4d895b0d7bff463f4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95e0a8d6-2d", "ovs_interfaceid": "95e0a8d6-2dba-4fb8-8d7d-b630e649d0f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74190) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 11:44:37 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-99d2a368-49aa-42ed-91da-d040269db43d tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Converting VIF {"id": "95e0a8d6-2dba-4fb8-8d7d-b630e649d0f8", "address": "fa:16:3e:ed:16:7e", "network": {"id": "c174814d-6217-4201-9af1-1575a8dcf751", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-981245321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d83064382624b4d895b0d7bff463f4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95e0a8d6-2d", "ovs_interfaceid": "95e0a8d6-2dba-4fb8-8d7d-b630e649d0f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:44:37 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-99d2a368-49aa-42ed-91da-d040269db43d tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:16:7e,bridge_name='br-int',has_traffic_filtering=True,id=95e0a8d6-2dba-4fb8-8d7d-b630e649d0f8,network=Network(c174814d-6217-4201-9af1-1575a8dcf751),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95e0a8d6-2d') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:44:37 user nova-compute[74190]: DEBUG nova.objects.instance [None req-99d2a368-49aa-42ed-91da-d040269db43d tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Lazy-loading 'pci_devices' on Instance uuid 849ec21f-b785-47e7-a9fa-f89af1f78a2b {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:44:37 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-99d2a368-49aa-42ed-91da-d040269db43d tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] [instance: 849ec21f-b785-47e7-a9fa-f89af1f78a2b] End _get_guest_xml xml=<domain type="kvm">
Oct 18 11:44:37 user nova-compute[74190]:   <uuid>849ec21f-b785-47e7-a9fa-f89af1f78a2b</uuid>
Oct 18 11:44:37 user nova-compute[74190]:   <name>instance-0000000b</name>
Oct 18 11:44:37 user nova-compute[74190]:   <memory>524288</memory>
Oct 18 11:44:37 user nova-compute[74190]:   <vcpu>1</vcpu>
Oct 18 11:44:37 user nova-compute[74190]:   <metadata>
Oct 18 11:44:37 user nova-compute[74190]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 11:44:37 user nova-compute[74190]:       <nova:package version="0.0.0"/>
Oct 18 11:44:37 user nova-compute[74190]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1931953829</nova:name>
Oct 18 11:44:37 user nova-compute[74190]:       <nova:creationTime>2023-10-18 11:44:37</nova:creationTime>
Oct 18 11:44:37 user nova-compute[74190]:       <nova:flavor name="m1.tiny">
Oct 18 11:44:37 user nova-compute[74190]:         <nova:memory>512</nova:memory>
Oct 18 11:44:37 user nova-compute[74190]:         <nova:disk>1</nova:disk>
Oct 18 11:44:37 user nova-compute[74190]:         <nova:swap>0</nova:swap>
Oct 18 11:44:37 user nova-compute[74190]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 11:44:37 user nova-compute[74190]:         <nova:vcpus>1</nova:vcpus>
Oct 18 11:44:37 user nova-compute[74190]:       </nova:flavor>
Oct 18 11:44:37 user nova-compute[74190]:       <nova:owner>
Oct 18 11:44:37 user nova-compute[74190]:         <nova:user uuid="4c68a9cb13814419a38413f9513d5a80">tempest-VolumesAdminNegativeTest-1125052526-project-member</nova:user>
Oct 18 11:44:37 user nova-compute[74190]:         <nova:project uuid="6d83064382624b4d895b0d7bff463f4f">tempest-VolumesAdminNegativeTest-1125052526</nova:project>
Oct 18 11:44:37 user nova-compute[74190]:       </nova:owner>
Oct 18 11:44:37 user nova-compute[74190]:       <nova:root type="image" uuid="6e88bbf0-6e78-49a8-b3c5-9453d22a89df"/>
Oct 18 11:44:37 user nova-compute[74190]:       <nova:ports>
Oct 18 11:44:37 user nova-compute[74190]:         <nova:port uuid="95e0a8d6-2dba-4fb8-8d7d-b630e649d0f8">
Oct 18 11:44:37 user nova-compute[74190]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 18 11:44:37 user nova-compute[74190]:         </nova:port>
Oct 18 11:44:37 user nova-compute[74190]:       </nova:ports>
Oct 18 11:44:37 user nova-compute[74190]:     </nova:instance>
Oct 18 11:44:37 user nova-compute[74190]:   </metadata>
Oct 18 11:44:37 user nova-compute[74190]:   <sysinfo type="smbios">
Oct 18 11:44:37 user nova-compute[74190]:     <system>
Oct 18 11:44:37 user nova-compute[74190]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 11:44:37 user nova-compute[74190]:       <entry name="product">OpenStack Nova</entry>
Oct 18 11:44:37 user nova-compute[74190]:       <entry name="version">0.0.0</entry>
Oct 18 11:44:37 user nova-compute[74190]:       <entry name="serial">849ec21f-b785-47e7-a9fa-f89af1f78a2b</entry>
Oct 18 11:44:37 user nova-compute[74190]:       <entry name="uuid">849ec21f-b785-47e7-a9fa-f89af1f78a2b</entry>
Oct 18 11:44:37 user nova-compute[74190]:       <entry name="family">Virtual Machine</entry>
Oct 18 11:44:37 user nova-compute[74190]:     </system>
Oct 18 11:44:37 user nova-compute[74190]:   </sysinfo>
Oct 18 11:44:37 user nova-compute[74190]:   <os>
Oct 18 11:44:37 user nova-compute[74190]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 11:44:37 user nova-compute[74190]:     <boot dev="hd"/>
Oct 18 11:44:37 user nova-compute[74190]:     <smbios mode="sysinfo"/>
Oct 18 11:44:37 user nova-compute[74190]:   </os>
Oct 18 11:44:37 user nova-compute[74190]:   <features>
Oct 18 11:44:37 user nova-compute[74190]:     <acpi/>
Oct 18 11:44:37 user nova-compute[74190]:     <apic/>
Oct 18 11:44:37 user nova-compute[74190]:     <vmcoreinfo/>
Oct 18 11:44:37 user nova-compute[74190]:   </features>
Oct 18 11:44:37 user nova-compute[74190]:   <clock offset="utc">
Oct 18 11:44:37 user nova-compute[74190]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 11:44:37 user nova-compute[74190]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 11:44:37 user nova-compute[74190]:     <timer name="hpet" present="no"/>
Oct 18 11:44:37 user nova-compute[74190]:   </clock>
Oct 18 11:44:37 user nova-compute[74190]:   <cpu mode="custom" match="exact">
Oct 18 11:44:37 user nova-compute[74190]:     <model>Nehalem</model>
Oct 18 11:44:37 user nova-compute[74190]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 11:44:37 user nova-compute[74190]:   </cpu>
Oct 18 11:44:37 user nova-compute[74190]:   <devices>
Oct 18 11:44:37 user nova-compute[74190]:     <disk type="file" device="disk">
Oct 18 11:44:37 user nova-compute[74190]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 11:44:37 user nova-compute[74190]:       <source file="/opt/stack/data/nova/instances/849ec21f-b785-47e7-a9fa-f89af1f78a2b/disk"/>
Oct 18 11:44:37 user nova-compute[74190]:       <target dev="vda" bus="virtio"/>
Oct 18 11:44:37 user nova-compute[74190]:     </disk>
Oct 18 11:44:37 user nova-compute[74190]:     <interface type="ethernet">
Oct 18 11:44:37 user nova-compute[74190]:       <mac address="fa:16:3e:ed:16:7e"/>
Oct 18 11:44:37 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:44:37 user nova-compute[74190]:       <mtu size="1442"/>
Oct 18 11:44:37 user nova-compute[74190]:       <target dev="tap95e0a8d6-2d"/>
Oct 18 11:44:37 user nova-compute[74190]:     </interface>
Oct 18 11:44:37 user nova-compute[74190]:     <serial type="pty">
Oct 18 11:44:37 user nova-compute[74190]:       <log file="/opt/stack/data/nova/instances/849ec21f-b785-47e7-a9fa-f89af1f78a2b/console.log" append="off"/>
Oct 18 11:44:37 user nova-compute[74190]:     </serial>
Oct 18 11:44:37 user nova-compute[74190]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 11:44:37 user nova-compute[74190]:     <video>
Oct 18 11:44:37 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:44:37 user nova-compute[74190]:     </video>
Oct 18 11:44:37 user nova-compute[74190]:     <rng model="virtio">
Oct 18 11:44:37 user nova-compute[74190]:       <backend model="random">/dev/urandom</backend>
Oct 18 11:44:37 user nova-compute[74190]:     </rng>
Oct 18 11:44:37 user nova-compute[74190]:     <controller type="usb" index="0" model="none"/>
Oct 18 11:44:37 user nova-compute[74190]:     <memballoon model="virtio">
Oct 18 11:44:37 user nova-compute[74190]:       <stats period="10"/>
Oct 18 11:44:37 user nova-compute[74190]:     </memballoon>
Oct 18 11:44:37 user nova-compute[74190]:   </devices>
Oct 18 11:44:37 user nova-compute[74190]: </domain>
Oct 18 11:44:37 user nova-compute[74190]:  {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 11:44:37 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-99d2a368-49aa-42ed-91da-d040269db43d tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:44:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1931953829',display_name='tempest-VolumesAdminNegativeTest-server-1931953829',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1931953829',id=11,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d83064382624b4d895b0d7bff463f4f',ramdisk_id='',reservation_id='r-0mdrup09',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1125052526',owner_user_name='tempest-VolumesAdminNegativeTest-1125052526-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:44:35Z,user_data=None,user_id='4c68a9cb13814419a38413f9513d5a80',uuid=849ec21f-b785-47e7-a9fa-f89af1f78a2b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "95e0a8d6-2dba-4fb8-8d7d-b630e649d0f8", "address": "fa:16:3e:ed:16:7e", "network": {"id": "c174814d-6217-4201-9af1-1575a8dcf751", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-981245321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d83064382624b4d895b0d7bff463f4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95e0a8d6-2d", "ovs_interfaceid": "95e0a8d6-2dba-4fb8-8d7d-b630e649d0f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 11:44:37 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-99d2a368-49aa-42ed-91da-d040269db43d tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Converting VIF {"id": "95e0a8d6-2dba-4fb8-8d7d-b630e649d0f8", "address": "fa:16:3e:ed:16:7e", "network": {"id": "c174814d-6217-4201-9af1-1575a8dcf751", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-981245321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d83064382624b4d895b0d7bff463f4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95e0a8d6-2d", "ovs_interfaceid": "95e0a8d6-2dba-4fb8-8d7d-b630e649d0f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:44:37 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-99d2a368-49aa-42ed-91da-d040269db43d tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:16:7e,bridge_name='br-int',has_traffic_filtering=True,id=95e0a8d6-2dba-4fb8-8d7d-b630e649d0f8,network=Network(c174814d-6217-4201-9af1-1575a8dcf751),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95e0a8d6-2d') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:44:37 user nova-compute[74190]: DEBUG os_vif [None req-99d2a368-49aa-42ed-91da-d040269db43d tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:16:7e,bridge_name='br-int',has_traffic_filtering=True,id=95e0a8d6-2dba-4fb8-8d7d-b630e649d0f8,network=Network(c174814d-6217-4201-9af1-1575a8dcf751),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95e0a8d6-2d') {{(pid=74190) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 11:44:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:44:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 11:44:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '28b83c61-1ba0-5c08-9e0e-802285831ee6', '_type': 'linux-noop'}}, row=False) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:44:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:44:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap95e0a8d6-2d, may_exist=True, interface_attrs={}) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:44:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap95e0a8d6-2d, col_values=(('qos', UUID('7347b8e6-49df-4f2a-8cfd-e2e4049bef27')),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:44:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap95e0a8d6-2d, col_values=(('external_ids', {'iface-id': '95e0a8d6-2dba-4fb8-8d7d-b630e649d0f8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:16:7e', 'vm-uuid': '849ec21f-b785-47e7-a9fa-f89af1f78a2b'}),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:44:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:44:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:37 user nova-compute[74190]: INFO os_vif [None req-99d2a368-49aa-42ed-91da-d040269db43d tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:16:7e,bridge_name='br-int',has_traffic_filtering=True,id=95e0a8d6-2dba-4fb8-8d7d-b630e649d0f8,network=Network(c174814d-6217-4201-9af1-1575a8dcf751),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95e0a8d6-2d')
Oct 18 11:44:37 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-99d2a368-49aa-42ed-91da-d040269db43d tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] No BDM found with device name vda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 11:44:37 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-99d2a368-49aa-42ed-91da-d040269db43d tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] No VIF found with MAC fa:16:3e:ed:16:7e, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 11:44:37 user nova-compute[74190]: DEBUG nova.network.neutron [req-6a336585-5e8a-4d31-b5fd-c15b49edd2dc req-57aa1f72-864b-43d1-957f-311776205d62 service nova] [instance: 849ec21f-b785-47e7-a9fa-f89af1f78a2b] Updated VIF entry in instance network info cache for port 95e0a8d6-2dba-4fb8-8d7d-b630e649d0f8. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 11:44:37 user nova-compute[74190]: DEBUG nova.network.neutron [req-6a336585-5e8a-4d31-b5fd-c15b49edd2dc req-57aa1f72-864b-43d1-957f-311776205d62 service nova] [instance: 849ec21f-b785-47e7-a9fa-f89af1f78a2b] Updating instance_info_cache with network_info: [{"id": "95e0a8d6-2dba-4fb8-8d7d-b630e649d0f8", "address": "fa:16:3e:ed:16:7e", "network": {"id": "c174814d-6217-4201-9af1-1575a8dcf751", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-981245321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d83064382624b4d895b0d7bff463f4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95e0a8d6-2d", "ovs_interfaceid": "95e0a8d6-2dba-4fb8-8d7d-b630e649d0f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:44:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-6a336585-5e8a-4d31-b5fd-c15b49edd2dc req-57aa1f72-864b-43d1-957f-311776205d62 service nova] Releasing lock "refresh_cache-849ec21f-b785-47e7-a9fa-f89af1f78a2b" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:44:38 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:38 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:38 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:38 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:38 user nova-compute[74190]: DEBUG nova.compute.manager [req-68017176-12c0-4859-a189-a2c8ba5f7262 req-deb22455-0ae3-428d-8d47-29a5bd12bb89 service nova] [instance: 849ec21f-b785-47e7-a9fa-f89af1f78a2b] Received event network-vif-plugged-95e0a8d6-2dba-4fb8-8d7d-b630e649d0f8 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:44:38 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-68017176-12c0-4859-a189-a2c8ba5f7262 req-deb22455-0ae3-428d-8d47-29a5bd12bb89 service nova] Acquiring lock "849ec21f-b785-47e7-a9fa-f89af1f78a2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:44:38 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-68017176-12c0-4859-a189-a2c8ba5f7262 req-deb22455-0ae3-428d-8d47-29a5bd12bb89 service nova] Lock "849ec21f-b785-47e7-a9fa-f89af1f78a2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:44:38 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-68017176-12c0-4859-a189-a2c8ba5f7262 req-deb22455-0ae3-428d-8d47-29a5bd12bb89 service nova] Lock "849ec21f-b785-47e7-a9fa-f89af1f78a2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:44:38 user nova-compute[74190]: DEBUG nova.compute.manager [req-68017176-12c0-4859-a189-a2c8ba5f7262 req-deb22455-0ae3-428d-8d47-29a5bd12bb89 service nova] [instance: 849ec21f-b785-47e7-a9fa-f89af1f78a2b] No waiting events found dispatching network-vif-plugged-95e0a8d6-2dba-4fb8-8d7d-b630e649d0f8 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:44:38 user nova-compute[74190]: WARNING nova.compute.manager [req-68017176-12c0-4859-a189-a2c8ba5f7262 req-deb22455-0ae3-428d-8d47-29a5bd12bb89 service nova] [instance: 849ec21f-b785-47e7-a9fa-f89af1f78a2b] Received unexpected event network-vif-plugged-95e0a8d6-2dba-4fb8-8d7d-b630e649d0f8 for instance with vm_state building and task_state spawning.
Oct 18 11:44:38 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:38 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:40 user nova-compute[74190]: DEBUG nova.compute.manager [req-3067b5ac-47dc-432b-af46-2f6109ce28f8 req-4b48e93d-0ae5-48da-8799-7bf57550e198 service nova] [instance: 849ec21f-b785-47e7-a9fa-f89af1f78a2b] Received event network-vif-plugged-95e0a8d6-2dba-4fb8-8d7d-b630e649d0f8 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:44:40 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-3067b5ac-47dc-432b-af46-2f6109ce28f8 req-4b48e93d-0ae5-48da-8799-7bf57550e198 service nova] Acquiring lock "849ec21f-b785-47e7-a9fa-f89af1f78a2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:44:40 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-3067b5ac-47dc-432b-af46-2f6109ce28f8 req-4b48e93d-0ae5-48da-8799-7bf57550e198 service nova] Lock "849ec21f-b785-47e7-a9fa-f89af1f78a2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:44:40 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-3067b5ac-47dc-432b-af46-2f6109ce28f8 req-4b48e93d-0ae5-48da-8799-7bf57550e198 service nova] Lock "849ec21f-b785-47e7-a9fa-f89af1f78a2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:44:40 user nova-compute[74190]: DEBUG nova.compute.manager [req-3067b5ac-47dc-432b-af46-2f6109ce28f8 req-4b48e93d-0ae5-48da-8799-7bf57550e198 service nova] [instance: 849ec21f-b785-47e7-a9fa-f89af1f78a2b] No waiting events found dispatching network-vif-plugged-95e0a8d6-2dba-4fb8-8d7d-b630e649d0f8 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:44:40 user nova-compute[74190]: WARNING nova.compute.manager [req-3067b5ac-47dc-432b-af46-2f6109ce28f8 req-4b48e93d-0ae5-48da-8799-7bf57550e198 service nova] [instance: 849ec21f-b785-47e7-a9fa-f89af1f78a2b] Received unexpected event network-vif-plugged-95e0a8d6-2dba-4fb8-8d7d-b630e649d0f8 for instance with vm_state building and task_state spawning.
Oct 18 11:44:41 user nova-compute[74190]: DEBUG nova.compute.manager [None req-99d2a368-49aa-42ed-91da-d040269db43d tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] [instance: 849ec21f-b785-47e7-a9fa-f89af1f78a2b] Instance event wait completed in 0 seconds for  {{(pid=74190) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 11:44:41 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-99d2a368-49aa-42ed-91da-d040269db43d tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] [instance: 849ec21f-b785-47e7-a9fa-f89af1f78a2b] Guest created on hypervisor {{(pid=74190) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 11:44:41 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 849ec21f-b785-47e7-a9fa-f89af1f78a2b] Instance spawned successfully.
Oct 18 11:44:41 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-99d2a368-49aa-42ed-91da-d040269db43d tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] [instance: 849ec21f-b785-47e7-a9fa-f89af1f78a2b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 11:44:41 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-99d2a368-49aa-42ed-91da-d040269db43d tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] [instance: 849ec21f-b785-47e7-a9fa-f89af1f78a2b] Found default for hw_cdrom_bus of ide {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:44:41 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-99d2a368-49aa-42ed-91da-d040269db43d tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] [instance: 849ec21f-b785-47e7-a9fa-f89af1f78a2b] Found default for hw_disk_bus of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:44:41 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-99d2a368-49aa-42ed-91da-d040269db43d tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] [instance: 849ec21f-b785-47e7-a9fa-f89af1f78a2b] Found default for hw_input_bus of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:44:41 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-99d2a368-49aa-42ed-91da-d040269db43d tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] [instance: 849ec21f-b785-47e7-a9fa-f89af1f78a2b] Found default for hw_pointer_model of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:44:41 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-99d2a368-49aa-42ed-91da-d040269db43d tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] [instance: 849ec21f-b785-47e7-a9fa-f89af1f78a2b] Found default for hw_video_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:44:41 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-99d2a368-49aa-42ed-91da-d040269db43d tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] [instance: 849ec21f-b785-47e7-a9fa-f89af1f78a2b] Found default for hw_vif_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:44:41 user nova-compute[74190]: INFO nova.compute.manager [None req-99d2a368-49aa-42ed-91da-d040269db43d tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] [instance: 849ec21f-b785-47e7-a9fa-f89af1f78a2b] Took 5.71 seconds to spawn the instance on the hypervisor.
Oct 18 11:44:41 user nova-compute[74190]: DEBUG nova.compute.manager [None req-99d2a368-49aa-42ed-91da-d040269db43d tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] [instance: 849ec21f-b785-47e7-a9fa-f89af1f78a2b] Checking state {{(pid=74190) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 11:44:41 user nova-compute[74190]: INFO nova.compute.manager [None req-99d2a368-49aa-42ed-91da-d040269db43d tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] [instance: 849ec21f-b785-47e7-a9fa-f89af1f78a2b] Took 6.50 seconds to build instance.
Oct 18 11:44:41 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-99d2a368-49aa-42ed-91da-d040269db43d tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Lock "849ec21f-b785-47e7-a9fa-f89af1f78a2b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.605s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:44:41 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-87f60768-0bbc-4265-b5b0-0e21180a66ee tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Acquiring lock "3bd2f6d6-9c07-42a0-869e-566d685cb025" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:44:41 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-87f60768-0bbc-4265-b5b0-0e21180a66ee tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Lock "3bd2f6d6-9c07-42a0-869e-566d685cb025" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:44:41 user nova-compute[74190]: INFO nova.compute.manager [None req-87f60768-0bbc-4265-b5b0-0e21180a66ee tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Shelve offloading
Oct 18 11:44:41 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:41 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:41 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:41 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:41 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:42 user nova-compute[74190]: DEBUG nova.compute.manager [req-e1961049-1177-4568-b54a-56a27a7217e5 req-c7f793d9-85d0-42e0-8e07-05d8c5752ce5 service nova] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Received event network-vif-unplugged-9eca4d9a-28f0-4818-beef-e65c22f351dd {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:44:42 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-e1961049-1177-4568-b54a-56a27a7217e5 req-c7f793d9-85d0-42e0-8e07-05d8c5752ce5 service nova] Acquiring lock "3bd2f6d6-9c07-42a0-869e-566d685cb025-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:44:42 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-e1961049-1177-4568-b54a-56a27a7217e5 req-c7f793d9-85d0-42e0-8e07-05d8c5752ce5 service nova] Lock "3bd2f6d6-9c07-42a0-869e-566d685cb025-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:44:42 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-e1961049-1177-4568-b54a-56a27a7217e5 req-c7f793d9-85d0-42e0-8e07-05d8c5752ce5 service nova] Lock "3bd2f6d6-9c07-42a0-869e-566d685cb025-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:44:42 user nova-compute[74190]: DEBUG nova.compute.manager [req-e1961049-1177-4568-b54a-56a27a7217e5 req-c7f793d9-85d0-42e0-8e07-05d8c5752ce5 service nova] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] No waiting events found dispatching network-vif-unplugged-9eca4d9a-28f0-4818-beef-e65c22f351dd {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:44:42 user nova-compute[74190]: WARNING nova.compute.manager [req-e1961049-1177-4568-b54a-56a27a7217e5 req-c7f793d9-85d0-42e0-8e07-05d8c5752ce5 service nova] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Received unexpected event network-vif-unplugged-9eca4d9a-28f0-4818-beef-e65c22f351dd for instance with vm_state active and task_state shelving.
Oct 18 11:44:42 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:42 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Instance destroyed successfully.
Oct 18 11:44:42 user nova-compute[74190]: DEBUG nova.compute.manager [None req-87f60768-0bbc-4265-b5b0-0e21180a66ee tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Checking state {{(pid=74190) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 11:44:42 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-87f60768-0bbc-4265-b5b0-0e21180a66ee tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Acquiring lock "refresh_cache-3bd2f6d6-9c07-42a0-869e-566d685cb025" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:44:42 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-87f60768-0bbc-4265-b5b0-0e21180a66ee tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Acquired lock "refresh_cache-3bd2f6d6-9c07-42a0-869e-566d685cb025" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:44:42 user nova-compute[74190]: DEBUG nova.network.neutron [None req-87f60768-0bbc-4265-b5b0-0e21180a66ee tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Building network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 11:44:43 user nova-compute[74190]: DEBUG nova.compute.manager [req-3ccf1d26-1aa8-493c-85b5-0c19184ff774 req-8339ba85-5175-46c2-8628-f875138d858f service nova] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Received event network-changed-9eca4d9a-28f0-4818-beef-e65c22f351dd {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:44:43 user nova-compute[74190]: DEBUG nova.compute.manager [req-3ccf1d26-1aa8-493c-85b5-0c19184ff774 req-8339ba85-5175-46c2-8628-f875138d858f service nova] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Refreshing instance network info cache due to event network-changed-9eca4d9a-28f0-4818-beef-e65c22f351dd. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 11:44:43 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-3ccf1d26-1aa8-493c-85b5-0c19184ff774 req-8339ba85-5175-46c2-8628-f875138d858f service nova] Acquiring lock "refresh_cache-3bd2f6d6-9c07-42a0-869e-566d685cb025" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:44:43 user nova-compute[74190]: DEBUG nova.network.neutron [None req-87f60768-0bbc-4265-b5b0-0e21180a66ee tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Updating instance_info_cache with network_info: [{"id": "9eca4d9a-28f0-4818-beef-e65c22f351dd", "address": "fa:16:3e:f6:77:76", "network": {"id": "0c5cbb41-ba77-494a-904b-4c37e3205eb9", "bridge": "br-int", "label": "tempest-TestShelveInstance-1626181921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d3e15d2b7944cba9ed86eb5c01ec98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9eca4d9a-28", "ovs_interfaceid": "9eca4d9a-28f0-4818-beef-e65c22f351dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:44:43 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-87f60768-0bbc-4265-b5b0-0e21180a66ee tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Releasing lock "refresh_cache-3bd2f6d6-9c07-42a0-869e-566d685cb025" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:44:43 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-3ccf1d26-1aa8-493c-85b5-0c19184ff774 req-8339ba85-5175-46c2-8628-f875138d858f service nova] Acquired lock "refresh_cache-3bd2f6d6-9c07-42a0-869e-566d685cb025" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:44:43 user nova-compute[74190]: DEBUG nova.network.neutron [req-3ccf1d26-1aa8-493c-85b5-0c19184ff774 req-8339ba85-5175-46c2-8628-f875138d858f service nova] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Refreshing network info cache for port 9eca4d9a-28f0-4818-beef-e65c22f351dd {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 11:44:43 user nova-compute[74190]: DEBUG nova.network.neutron [req-3ccf1d26-1aa8-493c-85b5-0c19184ff774 req-8339ba85-5175-46c2-8628-f875138d858f service nova] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Updated VIF entry in instance network info cache for port 9eca4d9a-28f0-4818-beef-e65c22f351dd. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 11:44:43 user nova-compute[74190]: DEBUG nova.network.neutron [req-3ccf1d26-1aa8-493c-85b5-0c19184ff774 req-8339ba85-5175-46c2-8628-f875138d858f service nova] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Updating instance_info_cache with network_info: [{"id": "9eca4d9a-28f0-4818-beef-e65c22f351dd", "address": "fa:16:3e:f6:77:76", "network": {"id": "0c5cbb41-ba77-494a-904b-4c37e3205eb9", "bridge": "br-int", "label": "tempest-TestShelveInstance-1626181921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d3e15d2b7944cba9ed86eb5c01ec98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9eca4d9a-28", "ovs_interfaceid": "9eca4d9a-28f0-4818-beef-e65c22f351dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:44:43 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-3ccf1d26-1aa8-493c-85b5-0c19184ff774 req-8339ba85-5175-46c2-8628-f875138d858f service nova] Releasing lock "refresh_cache-3bd2f6d6-9c07-42a0-869e-566d685cb025" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:44:44 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:44 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Instance destroyed successfully.
Oct 18 11:44:44 user nova-compute[74190]: DEBUG nova.objects.instance [None req-87f60768-0bbc-4265-b5b0-0e21180a66ee tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Lazy-loading 'resources' on Instance uuid 3bd2f6d6-9c07-42a0-869e-566d685cb025 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:44:44 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-87f60768-0bbc-4265-b5b0-0e21180a66ee tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:42:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-750462458',display_name='tempest-TestShelveInstance-server-750462458',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-750462458',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNt8SmvdArTyzkvCUI1kam2NbMC+rHv9iOWZki8JEEHP7fMgDgi8kkk7jXIMVKa+sVcv9nkOeL15Uby8ToS2uWym1iteM771YGpKWzDAM0HogCtKby6MGktNG2smezvdMg==',key_name='tempest-TestShelveInstance-1292603838',keypairs=<?>,launch_index=0,launched_at=2023-10-18T11:43:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1d3e15d2b7944cba9ed86eb5c01ec98a',ramdisk_id='',reservation_id='r-n4ye783u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1202197307',owner_user_name='tempest-TestShelveInstance-1202197307-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T11:43:19Z,user_data=None,user_id='06661e802ad947d2a4e07e3d60a94d14',uuid=3bd2f6d6-9c07-42a0-869e-566d685cb025,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9eca4d9a-28f0-4818-beef-e65c22f351dd", "address": "fa:16:3e:f6:77:76", "network": {"id": "0c5cbb41-ba77-494a-904b-4c37e3205eb9", "bridge": "br-int", "label": "tempest-TestShelveInstance-1626181921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d3e15d2b7944cba9ed86eb5c01ec98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9eca4d9a-28", "ovs_interfaceid": "9eca4d9a-28f0-4818-beef-e65c22f351dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 11:44:44 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-87f60768-0bbc-4265-b5b0-0e21180a66ee tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Converting VIF {"id": "9eca4d9a-28f0-4818-beef-e65c22f351dd", "address": "fa:16:3e:f6:77:76", "network": {"id": "0c5cbb41-ba77-494a-904b-4c37e3205eb9", "bridge": "br-int", "label": "tempest-TestShelveInstance-1626181921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d3e15d2b7944cba9ed86eb5c01ec98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9eca4d9a-28", "ovs_interfaceid": "9eca4d9a-28f0-4818-beef-e65c22f351dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:44:44 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-87f60768-0bbc-4265-b5b0-0e21180a66ee tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:77:76,bridge_name='br-int',has_traffic_filtering=True,id=9eca4d9a-28f0-4818-beef-e65c22f351dd,network=Network(0c5cbb41-ba77-494a-904b-4c37e3205eb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9eca4d9a-28') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:44:44 user nova-compute[74190]: DEBUG os_vif [None req-87f60768-0bbc-4265-b5b0-0e21180a66ee tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:77:76,bridge_name='br-int',has_traffic_filtering=True,id=9eca4d9a-28f0-4818-beef-e65c22f351dd,network=Network(0c5cbb41-ba77-494a-904b-4c37e3205eb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9eca4d9a-28') {{(pid=74190) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 11:44:44 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:44 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9eca4d9a-28, bridge=br-int, if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:44:44 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:44 user nova-compute[74190]: DEBUG nova.compute.manager [req-8836ae50-f5c3-4717-8aa9-b1e1688e612a req-448a47f0-2eec-4097-adcd-d621da70c85f service nova] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Received event network-changed-9eca4d9a-28f0-4818-beef-e65c22f351dd {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:44:44 user nova-compute[74190]: DEBUG nova.compute.manager [req-8836ae50-f5c3-4717-8aa9-b1e1688e612a req-448a47f0-2eec-4097-adcd-d621da70c85f service nova] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Refreshing instance network info cache due to event network-changed-9eca4d9a-28f0-4818-beef-e65c22f351dd. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 11:44:44 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-8836ae50-f5c3-4717-8aa9-b1e1688e612a req-448a47f0-2eec-4097-adcd-d621da70c85f service nova] Acquiring lock "refresh_cache-3bd2f6d6-9c07-42a0-869e-566d685cb025" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:44:44 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-8836ae50-f5c3-4717-8aa9-b1e1688e612a req-448a47f0-2eec-4097-adcd-d621da70c85f service nova] Acquired lock "refresh_cache-3bd2f6d6-9c07-42a0-869e-566d685cb025" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:44:44 user nova-compute[74190]: DEBUG nova.network.neutron [req-8836ae50-f5c3-4717-8aa9-b1e1688e612a req-448a47f0-2eec-4097-adcd-d621da70c85f service nova] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Refreshing network info cache for port 9eca4d9a-28f0-4818-beef-e65c22f351dd {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 11:44:44 user nova-compute[74190]: DEBUG nova.compute.manager [req-3b02a98d-4e52-4c77-9d26-98279c95b020 req-a347d870-68f5-4c5d-8e28-7b9e82a00c94 service nova] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Received event network-vif-plugged-9eca4d9a-28f0-4818-beef-e65c22f351dd {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:44:44 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-3b02a98d-4e52-4c77-9d26-98279c95b020 req-a347d870-68f5-4c5d-8e28-7b9e82a00c94 service nova] Acquiring lock "3bd2f6d6-9c07-42a0-869e-566d685cb025-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:44:44 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-3b02a98d-4e52-4c77-9d26-98279c95b020 req-a347d870-68f5-4c5d-8e28-7b9e82a00c94 service nova] Lock "3bd2f6d6-9c07-42a0-869e-566d685cb025-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:44:44 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-3b02a98d-4e52-4c77-9d26-98279c95b020 req-a347d870-68f5-4c5d-8e28-7b9e82a00c94 service nova] Lock "3bd2f6d6-9c07-42a0-869e-566d685cb025-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:44:44 user nova-compute[74190]: DEBUG nova.compute.manager [req-3b02a98d-4e52-4c77-9d26-98279c95b020 req-a347d870-68f5-4c5d-8e28-7b9e82a00c94 service nova] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] No waiting events found dispatching network-vif-plugged-9eca4d9a-28f0-4818-beef-e65c22f351dd {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:44:44 user nova-compute[74190]: WARNING nova.compute.manager [req-3b02a98d-4e52-4c77-9d26-98279c95b020 req-a347d870-68f5-4c5d-8e28-7b9e82a00c94 service nova] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Received unexpected event network-vif-plugged-9eca4d9a-28f0-4818-beef-e65c22f351dd for instance with vm_state active and task_state shelving.
Oct 18 11:44:44 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:44 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:44 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fae87706-fbab-4a17-a3e6-3c41602e4a19) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:44:44 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:44 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:44:44 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:44 user nova-compute[74190]: INFO os_vif [None req-87f60768-0bbc-4265-b5b0-0e21180a66ee tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:77:76,bridge_name='br-int',has_traffic_filtering=True,id=9eca4d9a-28f0-4818-beef-e65c22f351dd,network=Network(0c5cbb41-ba77-494a-904b-4c37e3205eb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9eca4d9a-28')
Oct 18 11:44:44 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87f60768-0bbc-4265-b5b0-0e21180a66ee tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] calling os-brick to detach iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 11:44:44 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f60768-0bbc-4265-b5b0-0e21180a66ee tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, {'target_iqn': 'iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bnWydGUY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:44:44 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-87f60768-0bbc-4265-b5b0-0e21180a66ee tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:44:44 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-87f60768-0bbc-4265-b5b0-0e21180a66ee tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:44:44 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-87f60768-0bbc-4265-b5b0-0e21180a66ee tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:44:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:44 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd7eafc9-655d-4073-ab32-1e9fcba87445]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:44 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f60768-0bbc-4265-b5b0-0e21180a66ee tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 11:44:44 user nova-compute[74190]: No targets found.
Oct 18 11:44:44 user nova-compute[74190]: iSNS:
Oct 18 11:44:44 user nova-compute[74190]: No targets found.
Oct 18 11:44:44 user nova-compute[74190]: STATIC:
Oct 18 11:44:44 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a
Oct 18 11:44:44 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:44:44 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:44:44 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920
Oct 18 11:44:44 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:44:44 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:44:44 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb
Oct 18 11:44:44 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:44:44 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:44:44 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c
Oct 18 11:44:44 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:44:44 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:44:44 user nova-compute[74190]: FIRMWARE:
Oct 18 11:44:44 user nova-compute[74190]: No targets found.
Oct 18 11:44:44 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:44:44 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f60768-0bbc-4265-b5b0-0e21180a66ee tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 11:44:44 user nova-compute[74190]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 11:44:44 user nova-compute[74190]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74190) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 11:44:44 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f60768-0bbc-4265-b5b0-0e21180a66ee tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a', 0)] {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 11:44:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:44 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[101f92a3-04d9-4428-b59d-9fd831706af8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:44 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1821052-24db-4dc0-b211-234b506611a8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:44 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f60768-0bbc-4265-b5b0-0e21180a66ee tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920 (non-flash)
Oct 18 11:44:44 user nova-compute[74190]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)
Oct 18 11:44:44 user nova-compute[74190]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)
Oct 18 11:44:44 user nova-compute[74190]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)
Oct 18 11:44:44 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:44:44 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f60768-0bbc-4265-b5b0-0e21180a66ee tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920 (non-flash)
Oct 18 11:44:44 user nova-compute[74190]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)
Oct 18 11:44:44 user nova-compute[74190]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)
Oct 18 11:44:44 user nova-compute[74190]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)
Oct 18 11:44:44 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:44:44 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f60768-0bbc-4265-b5b0-0e21180a66ee tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1f4453ab90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a'): ({'sdc'}, set())}) {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 11:44:44 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-87f60768-0bbc-4265-b5b0-0e21180a66ee tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Removing single pathed devices sdc {{(pid=74190) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 11:44:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:44 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[9364815e-42d9-4c13-bdc5-9c2f63a23a60]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.028s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:44 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaacbe6f-ae96-429b-be43-46a6aaf8ee6a]: (4, ('ok\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:44 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-87f60768-0bbc-4265-b5b0-0e21180a66ee tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Flushing IO for device /dev/sdc {{(pid=74190) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 11:44:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:44 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f9a391c-06e9-4f94-b096-87d2bb5f013c]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:44 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-87f60768-0bbc-4265-b5b0-0e21180a66ee tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74190) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 11:44:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.059s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:44 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[850e9d5b-836e-44a1-9cad-10aa39e5fd65]: (4, ('1', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:44 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-87f60768-0bbc-4265-b5b0-0e21180a66ee tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 11:44:44 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-87f60768-0bbc-4265-b5b0-0e21180a66ee tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] SCSI volumes sdc have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 11:44:44 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f60768-0bbc-4265-b5b0-0e21180a66ee tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a')] {{(pid=74190) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 11:44:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:44 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[44dceda9-fb5c-4e0a-b723-a0e55b54ae75]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:44 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f60768-0bbc-4265-b5b0-0e21180a66ee tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:44:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a -p 172.16.0.220:3260 --logout {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:44 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec6c91c-19b8-4cc0-8790-e440f04b0805]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:44 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f60768-0bbc-4265-b5b0-0e21180a66ee tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a, portal: 172.16.0.220,3260]
Oct 18 11:44:44 user nova-compute[74190]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a, portal: 172.16.0.220,3260] successful.
Oct 18 11:44:44 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:44:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a -p 172.16.0.220:3260 --op delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:44 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d28b54b-4c61-4a03-9cbf-17b2b52be425]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:44 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f60768-0bbc-4265-b5b0-0e21180a66ee tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:44:44 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-87f60768-0bbc-4265-b5b0-0e21180a66ee tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.375s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:44:44 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f60768-0bbc-4265-b5b0-0e21180a66ee tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] <== disconnect_volume: return (377ms) None {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:44:44 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87f60768-0bbc-4265-b5b0-0e21180a66ee tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Disconnected iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 11:44:44 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-87f60768-0bbc-4265-b5b0-0e21180a66ee tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Deleting instance files /opt/stack/data/nova/instances/3bd2f6d6-9c07-42a0-869e-566d685cb025_del
Oct 18 11:44:44 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-87f60768-0bbc-4265-b5b0-0e21180a66ee tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Deletion of /opt/stack/data/nova/instances/3bd2f6d6-9c07-42a0-869e-566d685cb025_del complete
Oct 18 11:44:44 user nova-compute[74190]: DEBUG nova.network.neutron [req-8836ae50-f5c3-4717-8aa9-b1e1688e612a req-448a47f0-2eec-4097-adcd-d621da70c85f service nova] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Updated VIF entry in instance network info cache for port 9eca4d9a-28f0-4818-beef-e65c22f351dd. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 11:44:44 user nova-compute[74190]: DEBUG nova.network.neutron [req-8836ae50-f5c3-4717-8aa9-b1e1688e612a req-448a47f0-2eec-4097-adcd-d621da70c85f service nova] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Updating instance_info_cache with network_info: [{"id": "9eca4d9a-28f0-4818-beef-e65c22f351dd", "address": "fa:16:3e:f6:77:76", "network": {"id": "0c5cbb41-ba77-494a-904b-4c37e3205eb9", "bridge": null, "label": "tempest-TestShelveInstance-1626181921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d3e15d2b7944cba9ed86eb5c01ec98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap9eca4d9a-28", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:44:44 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-8836ae50-f5c3-4717-8aa9-b1e1688e612a req-448a47f0-2eec-4097-adcd-d621da70c85f service nova] Releasing lock "refresh_cache-3bd2f6d6-9c07-42a0-869e-566d685cb025" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:44:46 user nova-compute[74190]: INFO nova.scheduler.client.report [None req-87f60768-0bbc-4265-b5b0-0e21180a66ee tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Deleted allocations for instance 3bd2f6d6-9c07-42a0-869e-566d685cb025
Oct 18 11:44:46 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-87f60768-0bbc-4265-b5b0-0e21180a66ee tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:44:46 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-87f60768-0bbc-4265-b5b0-0e21180a66ee tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:44:46 user nova-compute[74190]: DEBUG nova.objects.instance [None req-87f60768-0bbc-4265-b5b0-0e21180a66ee tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Lazy-loading 'numa_topology' on Instance uuid 3bd2f6d6-9c07-42a0-869e-566d685cb025 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:44:46 user nova-compute[74190]: DEBUG nova.objects.base [None req-87f60768-0bbc-4265-b5b0-0e21180a66ee tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Object Instance<3bd2f6d6-9c07-42a0-869e-566d685cb025> lazy-loaded attributes: resources,numa_topology {{(pid=74190) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 11:44:46 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-87f60768-0bbc-4265-b5b0-0e21180a66ee tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 11:44:46 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-87f60768-0bbc-4265-b5b0-0e21180a66ee tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 11:44:46 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-87f60768-0bbc-4265-b5b0-0e21180a66ee tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.433s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:44:46 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-87f60768-0bbc-4265-b5b0-0e21180a66ee tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Lock "3bd2f6d6-9c07-42a0-869e-566d685cb025" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 5.138s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:44:48 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:44:48 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:44:48 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:44:48 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:44:48 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:44:48 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:44:48 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Auditing locally available compute resources for user (node: user) {{(pid=74190) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 11:44:48 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/849ec21f-b785-47e7-a9fa-f89af1f78a2b/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:48 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/849ec21f-b785-47e7-a9fa-f89af1f78a2b/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:48 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/849ec21f-b785-47e7-a9fa-f89af1f78a2b/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:48 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/849ec21f-b785-47e7-a9fa-f89af1f78a2b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:48 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034398e8-e8c4-4e03-a608-440e447c6041/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:48 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034398e8-e8c4-4e03-a608-440e447c6041/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:48 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034398e8-e8c4-4e03-a608-440e447c6041/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:49 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034398e8-e8c4-4e03-a608-440e447c6041/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:49 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 11:44:49 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:49 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/697d3123-bd6b-42b9-b278-c33c0c00da6f/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:49 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:49 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/697d3123-bd6b-42b9-b278-c33c0c00da6f/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:49 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/697d3123-bd6b-42b9-b278-c33c0c00da6f/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:49 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/697d3123-bd6b-42b9-b278-c33c0c00da6f/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:49 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0209c824-88a7-4976-83bf-8a72437f0cc2/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:49 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0209c824-88a7-4976-83bf-8a72437f0cc2/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:49 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0209c824-88a7-4976-83bf-8a72437f0cc2/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:49 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0209c824-88a7-4976-83bf-8a72437f0cc2/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:49 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6130edd-eb98-491e-a0ba-6bd59199d9e1/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6130edd-eb98-491e-a0ba-6bd59199d9e1/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6130edd-eb98-491e-a0ba-6bd59199d9e1/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6130edd-eb98-491e-a0ba-6bd59199d9e1/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c280652c-ffde-40f8-a919-adb8be618db8/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c280652c-ffde-40f8-a919-adb8be618db8/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c280652c-ffde-40f8-a919-adb8be618db8/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c280652c-ffde-40f8-a919-adb8be618db8/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:50 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 11:44:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:50 user nova-compute[74190]: DEBUG nova.compute.manager [req-8603ba55-10bb-42b7-beca-1903b579cf2c req-c4dea2f2-16f9-4b8c-96ff-8a7e908dd614 service nova] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Received event volume-reimaged-5c87f389-42e2-4d78-8bdb-4d5bda76216c {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:44:50 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-8603ba55-10bb-42b7-beca-1903b579cf2c req-c4dea2f2-16f9-4b8c-96ff-8a7e908dd614 service nova] Acquiring lock "aabb5eea-8366-482a-8d16-bf271c0fe8d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:44:50 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-8603ba55-10bb-42b7-beca-1903b579cf2c req-c4dea2f2-16f9-4b8c-96ff-8a7e908dd614 service nova] Lock "aabb5eea-8366-482a-8d16-bf271c0fe8d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:44:50 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-8603ba55-10bb-42b7-beca-1903b579cf2c req-c4dea2f2-16f9-4b8c-96ff-8a7e908dd614 service nova] Lock "aabb5eea-8366-482a-8d16-bf271c0fe8d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:44:50 user nova-compute[74190]: DEBUG nova.compute.manager [req-8603ba55-10bb-42b7-beca-1903b579cf2c req-c4dea2f2-16f9-4b8c-96ff-8a7e908dd614 service nova] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Processing event volume-reimaged-5c87f389-42e2-4d78-8bdb-4d5bda76216c {{(pid=74190) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10871}}
Oct 18 11:44:50 user nova-compute[74190]: DEBUG nova.compute.manager [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Instance event wait completed in 28 seconds for volume-reimaged {{(pid=74190) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 11:44:50 user nova-compute[74190]: INFO nova.virt.block_device [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Booting with volume 5c87f389-42e2-4d78-8bdb-4d5bda76216c at /dev/vda
Oct 18 11:44:50 user nova-compute[74190]: DEBUG os_brick.utils [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:44:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:50 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[321ef553-1f4b-41d2-850e-897ace7e8012]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cff158e257e1\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:50 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ca658d-649a-43d3-a00f-20e26c364104]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:51 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:51 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd5dc54-ebdf-48b0-84d9-89ff9f244ac8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:51 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a01cf81-5006-423d-a741-31201d6c5eb2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:51 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Running cmd (subprocess): nvme version {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:51 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] 'nvme version' failed. Not Retrying. {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 11:44:51 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] nvme not present on system {{(pid=74190) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 11:44:51 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:51 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 11:44:51 user nova-compute[74190]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 11:44:51 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[2650f514-8db2-4513-beec-9cee32618020]: (4, '') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:51 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74190) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 11:44:51 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 11:44:51 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] LIGHTOS: no hostnqn found. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 11:44:51 user nova-compute[74190]: DEBUG os_brick.utils [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] <== get_connector_properties: return (187ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cff158e257e1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:44:51 user nova-compute[74190]: DEBUG nova.virt.block_device [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Updating existing volume attachment record: 75c6e754-c724-4338-99b7-2494ada4db25 {{(pid=74190) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 11:44:51 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:51 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:44:51 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:44:51 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Hypervisor/Node resource view: name=user free_ram=8150MB free_disk=25.644882202148438GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74190) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 11:44:51 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:44:51 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:44:52 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance c280652c-ffde-40f8-a919-adb8be618db8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:44:52 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 0209c824-88a7-4976-83bf-8a72437f0cc2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:44:52 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance c6130edd-eb98-491e-a0ba-6bd59199d9e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:44:52 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:44:52 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 034398e8-e8c4-4e03-a608-440e447c6041 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:44:52 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 697d3123-bd6b-42b9-b278-c33c0c00da6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:44:52 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance aabb5eea-8366-482a-8d16-bf271c0fe8d7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:44:52 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 849ec21f-b785-47e7-a9fa-f89af1f78a2b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:44:52 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 11:44:52 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 11:44:52 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 11:44:52 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 11:44:52 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Compute_service record updated for user:user {{(pid=74190) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 11:44:52 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.675s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:44:52 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-34be0e93-aae8-48fc-b5bb-1cbd3af3e2d3 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Acquiring lock "52d7b8e5-02cc-4148-86e2-ceb295e81afc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:44:52 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-34be0e93-aae8-48fc-b5bb-1cbd3af3e2d3 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lock "52d7b8e5-02cc-4148-86e2-ceb295e81afc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:44:52 user nova-compute[74190]: DEBUG nova.compute.manager [None req-34be0e93-aae8-48fc-b5bb-1cbd3af3e2d3 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Starting instance... {{(pid=74190) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 11:44:52 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-34be0e93-aae8-48fc-b5bb-1cbd3af3e2d3 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:44:52 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-34be0e93-aae8-48fc-b5bb-1cbd3af3e2d3 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:44:52 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-34be0e93-aae8-48fc-b5bb-1cbd3af3e2d3 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74190) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 11:44:52 user nova-compute[74190]: INFO nova.compute.claims [None req-34be0e93-aae8-48fc-b5bb-1cbd3af3e2d3 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Claim successful on node user
Oct 18 11:44:53 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-34be0e93-aae8-48fc-b5bb-1cbd3af3e2d3 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 11:44:53 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-34be0e93-aae8-48fc-b5bb-1cbd3af3e2d3 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 11:44:53 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-34be0e93-aae8-48fc-b5bb-1cbd3af3e2d3 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.989s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:44:53 user nova-compute[74190]: DEBUG nova.compute.manager [None req-34be0e93-aae8-48fc-b5bb-1cbd3af3e2d3 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Start building networks asynchronously for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 11:44:54 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:54 user nova-compute[74190]: DEBUG nova.compute.manager [None req-34be0e93-aae8-48fc-b5bb-1cbd3af3e2d3 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Allocating IP information in the background. {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 11:44:54 user nova-compute[74190]: DEBUG nova.network.neutron [None req-34be0e93-aae8-48fc-b5bb-1cbd3af3e2d3 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] allocate_for_instance() {{(pid=74190) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 11:44:54 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-34be0e93-aae8-48fc-b5bb-1cbd3af3e2d3 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 11:44:54 user nova-compute[74190]: DEBUG nova.compute.manager [None req-34be0e93-aae8-48fc-b5bb-1cbd3af3e2d3 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Start building block device mappings for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 11:44:54 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:54 user nova-compute[74190]: DEBUG nova.policy [None req-34be0e93-aae8-48fc-b5bb-1cbd3af3e2d3 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b771e627a76b4540bf8de665df3d7787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cf52ce927443158aa731367f08bd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74190) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 11:44:54 user nova-compute[74190]: DEBUG nova.compute.manager [None req-34be0e93-aae8-48fc-b5bb-1cbd3af3e2d3 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Start spawning the instance on the hypervisor. {{(pid=74190) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 11:44:54 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-34be0e93-aae8-48fc-b5bb-1cbd3af3e2d3 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Creating instance directory {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 11:44:54 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-34be0e93-aae8-48fc-b5bb-1cbd3af3e2d3 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Creating image(s)
Oct 18 11:44:54 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-34be0e93-aae8-48fc-b5bb-1cbd3af3e2d3 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Acquiring lock "/opt/stack/data/nova/instances/52d7b8e5-02cc-4148-86e2-ceb295e81afc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:44:54 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-34be0e93-aae8-48fc-b5bb-1cbd3af3e2d3 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lock "/opt/stack/data/nova/instances/52d7b8e5-02cc-4148-86e2-ceb295e81afc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:44:54 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-34be0e93-aae8-48fc-b5bb-1cbd3af3e2d3 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lock "/opt/stack/data/nova/instances/52d7b8e5-02cc-4148-86e2-ceb295e81afc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:44:54 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-34be0e93-aae8-48fc-b5bb-1cbd3af3e2d3 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:54 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:44:54 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:44:54 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Starting heal instance info cache {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 11:44:54 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-34be0e93-aae8-48fc-b5bb-1cbd3af3e2d3 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.208s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:54 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-34be0e93-aae8-48fc-b5bb-1cbd3af3e2d3 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Acquiring lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:44:54 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-34be0e93-aae8-48fc-b5bb-1cbd3af3e2d3 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:44:54 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-34be0e93-aae8-48fc-b5bb-1cbd3af3e2d3 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:54 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "refresh_cache-c6130edd-eb98-491e-a0ba-6bd59199d9e1" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:44:54 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquired lock "refresh_cache-c6130edd-eb98-491e-a0ba-6bd59199d9e1" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:44:54 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: c6130edd-eb98-491e-a0ba-6bd59199d9e1] Forcefully refreshing network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 18 11:44:54 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-34be0e93-aae8-48fc-b5bb-1cbd3af3e2d3 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.232s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:54 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-34be0e93-aae8-48fc-b5bb-1cbd3af3e2d3 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f,backing_fmt=raw /opt/stack/data/nova/instances/52d7b8e5-02cc-4148-86e2-ceb295e81afc/disk 1073741824 {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:54 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-34be0e93-aae8-48fc-b5bb-1cbd3af3e2d3 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f,backing_fmt=raw /opt/stack/data/nova/instances/52d7b8e5-02cc-4148-86e2-ceb295e81afc/disk 1073741824" returned: 0 in 0.063s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:54 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-34be0e93-aae8-48fc-b5bb-1cbd3af3e2d3 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.302s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:44:54 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-34be0e93-aae8-48fc-b5bb-1cbd3af3e2d3 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:55 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-34be0e93-aae8-48fc-b5bb-1cbd3af3e2d3 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.224s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:55 user nova-compute[74190]: DEBUG nova.virt.disk.api [None req-34be0e93-aae8-48fc-b5bb-1cbd3af3e2d3 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Checking if we can resize image /opt/stack/data/nova/instances/52d7b8e5-02cc-4148-86e2-ceb295e81afc/disk. size=1073741824 {{(pid=74190) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 18 11:44:55 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-34be0e93-aae8-48fc-b5bb-1cbd3af3e2d3 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d7b8e5-02cc-4148-86e2-ceb295e81afc/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:55 user nova-compute[74190]: DEBUG nova.network.neutron [None req-34be0e93-aae8-48fc-b5bb-1cbd3af3e2d3 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Successfully created port: 550e157d-7f82-41a1-b4ba-9dbb43037d8c {{(pid=74190) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 11:44:55 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-34be0e93-aae8-48fc-b5bb-1cbd3af3e2d3 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d7b8e5-02cc-4148-86e2-ceb295e81afc/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:55 user nova-compute[74190]: DEBUG nova.virt.disk.api [None req-34be0e93-aae8-48fc-b5bb-1cbd3af3e2d3 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Cannot resize image /opt/stack/data/nova/instances/52d7b8e5-02cc-4148-86e2-ceb295e81afc/disk to a smaller size. {{(pid=74190) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 18 11:44:55 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-34be0e93-aae8-48fc-b5bb-1cbd3af3e2d3 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Created local disks {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 11:44:55 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-34be0e93-aae8-48fc-b5bb-1cbd3af3e2d3 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Ensure instance console log exists: /opt/stack/data/nova/instances/52d7b8e5-02cc-4148-86e2-ceb295e81afc/console.log {{(pid=74190) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 11:44:55 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-34be0e93-aae8-48fc-b5bb-1cbd3af3e2d3 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:44:55 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-34be0e93-aae8-48fc-b5bb-1cbd3af3e2d3 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:44:55 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-34be0e93-aae8-48fc-b5bb-1cbd3af3e2d3 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:44:55 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: c6130edd-eb98-491e-a0ba-6bd59199d9e1] Updating instance_info_cache with network_info: [{"id": "bd84fceb-8a04-45a0-8f05-7bc856ed1a36", "address": "fa:16:3e:ee:96:5d", "network": {"id": "c174814d-6217-4201-9af1-1575a8dcf751", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-981245321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d83064382624b4d895b0d7bff463f4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd84fceb-8a", "ovs_interfaceid": "bd84fceb-8a04-45a0-8f05-7bc856ed1a36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:44:55 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Releasing lock "refresh_cache-c6130edd-eb98-491e-a0ba-6bd59199d9e1" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:44:55 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: c6130edd-eb98-491e-a0ba-6bd59199d9e1] Updated the network info_cache for instance {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 18 11:44:55 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:44:55 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:44:55 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:44:55 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:44:55 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:44:55 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74190) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 11:44:55 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:56 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Acquiring lock "3c3cce66-9d7a-4f23-a92a-d10b3efd5e86" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:44:56 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Lock "3c3cce66-9d7a-4f23-a92a-d10b3efd5e86" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:44:56 user nova-compute[74190]: INFO nova.compute.manager [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Unshelving
Oct 18 11:44:56 user nova-compute[74190]: INFO nova.virt.block_device [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Booting with volume ed247316-68aa-443b-90b8-b42632ce1a86 at /dev/vdc
Oct 18 11:44:56 user nova-compute[74190]: DEBUG nova.network.neutron [None req-34be0e93-aae8-48fc-b5bb-1cbd3af3e2d3 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Successfully updated port: 550e157d-7f82-41a1-b4ba-9dbb43037d8c {{(pid=74190) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 11:44:56 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-34be0e93-aae8-48fc-b5bb-1cbd3af3e2d3 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Acquiring lock "refresh_cache-52d7b8e5-02cc-4148-86e2-ceb295e81afc" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:44:56 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-34be0e93-aae8-48fc-b5bb-1cbd3af3e2d3 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Acquired lock "refresh_cache-52d7b8e5-02cc-4148-86e2-ceb295e81afc" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:44:56 user nova-compute[74190]: DEBUG nova.network.neutron [None req-34be0e93-aae8-48fc-b5bb-1cbd3af3e2d3 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Building network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 11:44:56 user nova-compute[74190]: DEBUG os_brick.utils [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:44:56 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:56 user nova-compute[74190]: DEBUG nova.compute.manager [req-705c2267-9f18-4755-9674-1470a7a3c1a8 req-f8a68a65-5f45-4171-951a-f383caf8219f service nova] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Received event network-changed-550e157d-7f82-41a1-b4ba-9dbb43037d8c {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:44:56 user nova-compute[74190]: DEBUG nova.compute.manager [req-705c2267-9f18-4755-9674-1470a7a3c1a8 req-f8a68a65-5f45-4171-951a-f383caf8219f service nova] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Refreshing instance network info cache due to event network-changed-550e157d-7f82-41a1-b4ba-9dbb43037d8c. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 11:44:56 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-705c2267-9f18-4755-9674-1470a7a3c1a8 req-f8a68a65-5f45-4171-951a-f383caf8219f service nova] Acquiring lock "refresh_cache-52d7b8e5-02cc-4148-86e2-ceb295e81afc" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:44:56 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:56 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[93400a54-f38a-4054-9762-98a55d47a102]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cff158e257e1\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:56 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:56 user nova-compute[74190]: DEBUG nova.network.neutron [None req-34be0e93-aae8-48fc-b5bb-1cbd3af3e2d3 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Instance cache missing network info. {{(pid=74190) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 11:44:56 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:56 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd87f4a-742c-4155-beba-c8595f736682]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:56 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:56 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:44:56 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b545b9-a69b-41bf-8503-58a82980d814]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:56 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[e61ca403-bf0d-4e80-8e89-f3eea74085e8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:56 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Running cmd (subprocess): nvme version {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:56 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] 'nvme version' failed. Not Retrying. {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 11:44:56 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] nvme not present on system {{(pid=74190) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 11:44:56 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:44:56 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 11:44:56 user nova-compute[74190]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 11:44:56 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[244c13b3-c23c-4676-b042-54e4bb00d671]: (4, '') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:44:56 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74190) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 11:44:56 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 11:44:56 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] LIGHTOS: no hostnqn found. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 11:44:56 user nova-compute[74190]: DEBUG os_brick.utils [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] <== get_connector_properties: return (155ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cff158e257e1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:44:56 user nova-compute[74190]: DEBUG nova.virt.block_device [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Updating existing volume attachment record: c8e92cf0-ed5f-4305-87f9-c9a932176c89 {{(pid=74190) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 11:44:56 user nova-compute[74190]: DEBUG nova.network.neutron [None req-34be0e93-aae8-48fc-b5bb-1cbd3af3e2d3 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Updating instance_info_cache with network_info: [{"id": "550e157d-7f82-41a1-b4ba-9dbb43037d8c", "address": "fa:16:3e:88:36:f0", "network": {"id": "f5ab7da4-2b07-4465-9a89-a07eb053ba91", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1315695374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08cf52ce927443158aa731367f08bd57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap550e157d-7f", "ovs_interfaceid": "550e157d-7f82-41a1-b4ba-9dbb43037d8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:44:56 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-34be0e93-aae8-48fc-b5bb-1cbd3af3e2d3 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Releasing lock "refresh_cache-52d7b8e5-02cc-4148-86e2-ceb295e81afc" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:44:56 user nova-compute[74190]: DEBUG nova.compute.manager [None req-34be0e93-aae8-48fc-b5bb-1cbd3af3e2d3 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Instance network_info: |[{"id": "550e157d-7f82-41a1-b4ba-9dbb43037d8c", "address": "fa:16:3e:88:36:f0", "network": {"id": "f5ab7da4-2b07-4465-9a89-a07eb053ba91", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1315695374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08cf52ce927443158aa731367f08bd57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap550e157d-7f", "ovs_interfaceid": "550e157d-7f82-41a1-b4ba-9dbb43037d8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 11:44:56 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-705c2267-9f18-4755-9674-1470a7a3c1a8 req-f8a68a65-5f45-4171-951a-f383caf8219f service nova] Acquired lock "refresh_cache-52d7b8e5-02cc-4148-86e2-ceb295e81afc" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:44:56 user nova-compute[74190]: DEBUG nova.network.neutron [req-705c2267-9f18-4755-9674-1470a7a3c1a8 req-f8a68a65-5f45-4171-951a-f383caf8219f service nova] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Refreshing network info cache for port 550e157d-7f82-41a1-b4ba-9dbb43037d8c {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 11:44:56 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-34be0e93-aae8-48fc-b5bb-1cbd3af3e2d3 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Start _get_guest_xml network_info=[{"id": "550e157d-7f82-41a1-b4ba-9dbb43037d8c", "address": "fa:16:3e:88:36:f0", "network": {"id": "f5ab7da4-2b07-4465-9a89-a07eb053ba91", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1315695374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08cf52ce927443158aa731367f08bd57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap550e157d-7f", "ovs_interfaceid": "550e157d-7f82-41a1-b4ba-9dbb43037d8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'image_id': '6e88bbf0-6e78-49a8-b3c5-9453d22a89df'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 11:44:56 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-34be0e93-aae8-48fc-b5bb-1cbd3af3e2d3 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:44:56 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-34be0e93-aae8-48fc-b5bb-1cbd3af3e2d3 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:44:56 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-34be0e93-aae8-48fc-b5bb-1cbd3af3e2d3 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 11:44:56 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-34be0e93-aae8-48fc-b5bb-1cbd3af3e2d3 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] CPU controller missing on host. {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 11:44:56 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-34be0e93-aae8-48fc-b5bb-1cbd3af3e2d3 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 11:44:56 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-34be0e93-aae8-48fc-b5bb-1cbd3af3e2d3 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] CPU controller found on host. {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 11:44:56 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-34be0e93-aae8-48fc-b5bb-1cbd3af3e2d3 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74190) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 11:44:56 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-34be0e93-aae8-48fc-b5bb-1cbd3af3e2d3 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T11:37:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 11:44:56 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-34be0e93-aae8-48fc-b5bb-1cbd3af3e2d3 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Flavor limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 11:44:56 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-34be0e93-aae8-48fc-b5bb-1cbd3af3e2d3 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Image limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 11:44:56 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-34be0e93-aae8-48fc-b5bb-1cbd3af3e2d3 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Flavor pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 11:44:56 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-34be0e93-aae8-48fc-b5bb-1cbd3af3e2d3 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Image pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 11:44:56 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-34be0e93-aae8-48fc-b5bb-1cbd3af3e2d3 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 11:44:56 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-34be0e93-aae8-48fc-b5bb-1cbd3af3e2d3 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 11:44:56 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-34be0e93-aae8-48fc-b5bb-1cbd3af3e2d3 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 11:44:56 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-34be0e93-aae8-48fc-b5bb-1cbd3af3e2d3 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Got 1 possible topologies {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 11:44:56 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-34be0e93-aae8-48fc-b5bb-1cbd3af3e2d3 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 11:44:56 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-34be0e93-aae8-48fc-b5bb-1cbd3af3e2d3 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 11:44:56 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-34be0e93-aae8-48fc-b5bb-1cbd3af3e2d3 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:44:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-438639954',display_name='tempest-tempest.common.compute-instance-438639954',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-438639954',id=12,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFdYXPh75Q7xKUqDE9zPp25KXyLhkj0/QLZATeV9ge1D1Ga7GiFXEGYg8QjRnvIAI0+WdgkHzK6fQEWBqJjE2h37Va7NyrV0Yc22ekpkzrQQ2biGg9l9Yf1LSoVy9aLWgA==',key_name='tempest-keypair-286461082',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='08cf52ce927443158aa731367f08bd57',ramdisk_id='',reservation_id='r-5s39f1w2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1288544694',owner_user_name='tempest-ServerActionsTestOtherA-1288544694-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:44:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b771e627a76b4540bf8de665df3d7787',uuid=52d7b8e5-02cc-4148-86e2-ceb295e81afc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "550e157d-7f82-41a1-b4ba-9dbb43037d8c", "address": "fa:16:3e:88:36:f0", "network": {"id": "f5ab7da4-2b07-4465-9a89-a07eb053ba91", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1315695374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08cf52ce927443158aa731367f08bd57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap550e157d-7f", "ovs_interfaceid": "550e157d-7f82-41a1-b4ba-9dbb43037d8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74190) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 11:44:56 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-34be0e93-aae8-48fc-b5bb-1cbd3af3e2d3 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Converting VIF {"id": "550e157d-7f82-41a1-b4ba-9dbb43037d8c", "address": "fa:16:3e:88:36:f0", "network": {"id": "f5ab7da4-2b07-4465-9a89-a07eb053ba91", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1315695374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08cf52ce927443158aa731367f08bd57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap550e157d-7f", "ovs_interfaceid": "550e157d-7f82-41a1-b4ba-9dbb43037d8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:44:56 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-34be0e93-aae8-48fc-b5bb-1cbd3af3e2d3 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:36:f0,bridge_name='br-int',has_traffic_filtering=True,id=550e157d-7f82-41a1-b4ba-9dbb43037d8c,network=Network(f5ab7da4-2b07-4465-9a89-a07eb053ba91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap550e157d-7f') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:44:56 user nova-compute[74190]: DEBUG nova.objects.instance [None req-34be0e93-aae8-48fc-b5bb-1cbd3af3e2d3 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lazy-loading 'pci_devices' on Instance uuid 52d7b8e5-02cc-4148-86e2-ceb295e81afc {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:44:56 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-34be0e93-aae8-48fc-b5bb-1cbd3af3e2d3 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] End _get_guest_xml xml=<domain type="kvm">
Oct 18 11:44:56 user nova-compute[74190]:   <uuid>52d7b8e5-02cc-4148-86e2-ceb295e81afc</uuid>
Oct 18 11:44:56 user nova-compute[74190]:   <name>instance-0000000c</name>
Oct 18 11:44:56 user nova-compute[74190]:   <memory>524288</memory>
Oct 18 11:44:56 user nova-compute[74190]:   <vcpu>1</vcpu>
Oct 18 11:44:56 user nova-compute[74190]:   <metadata>
Oct 18 11:44:56 user nova-compute[74190]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 11:44:56 user nova-compute[74190]:       <nova:package version="0.0.0"/>
Oct 18 11:44:56 user nova-compute[74190]:       <nova:name>tempest-tempest.common.compute-instance-438639954</nova:name>
Oct 18 11:44:56 user nova-compute[74190]:       <nova:creationTime>2023-10-18 11:44:56</nova:creationTime>
Oct 18 11:44:56 user nova-compute[74190]:       <nova:flavor name="m1.tiny">
Oct 18 11:44:56 user nova-compute[74190]:         <nova:memory>512</nova:memory>
Oct 18 11:44:56 user nova-compute[74190]:         <nova:disk>1</nova:disk>
Oct 18 11:44:56 user nova-compute[74190]:         <nova:swap>0</nova:swap>
Oct 18 11:44:56 user nova-compute[74190]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 11:44:56 user nova-compute[74190]:         <nova:vcpus>1</nova:vcpus>
Oct 18 11:44:56 user nova-compute[74190]:       </nova:flavor>
Oct 18 11:44:56 user nova-compute[74190]:       <nova:owner>
Oct 18 11:44:56 user nova-compute[74190]:         <nova:user uuid="b771e627a76b4540bf8de665df3d7787">tempest-ServerActionsTestOtherA-1288544694-project-member</nova:user>
Oct 18 11:44:56 user nova-compute[74190]:         <nova:project uuid="08cf52ce927443158aa731367f08bd57">tempest-ServerActionsTestOtherA-1288544694</nova:project>
Oct 18 11:44:56 user nova-compute[74190]:       </nova:owner>
Oct 18 11:44:56 user nova-compute[74190]:       <nova:root type="image" uuid="6e88bbf0-6e78-49a8-b3c5-9453d22a89df"/>
Oct 18 11:44:56 user nova-compute[74190]:       <nova:ports>
Oct 18 11:44:56 user nova-compute[74190]:         <nova:port uuid="550e157d-7f82-41a1-b4ba-9dbb43037d8c">
Oct 18 11:44:56 user nova-compute[74190]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 18 11:44:56 user nova-compute[74190]:         </nova:port>
Oct 18 11:44:56 user nova-compute[74190]:       </nova:ports>
Oct 18 11:44:56 user nova-compute[74190]:     </nova:instance>
Oct 18 11:44:56 user nova-compute[74190]:   </metadata>
Oct 18 11:44:56 user nova-compute[74190]:   <sysinfo type="smbios">
Oct 18 11:44:56 user nova-compute[74190]:     <system>
Oct 18 11:44:56 user nova-compute[74190]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 11:44:56 user nova-compute[74190]:       <entry name="product">OpenStack Nova</entry>
Oct 18 11:44:56 user nova-compute[74190]:       <entry name="version">0.0.0</entry>
Oct 18 11:44:56 user nova-compute[74190]:       <entry name="serial">52d7b8e5-02cc-4148-86e2-ceb295e81afc</entry>
Oct 18 11:44:56 user nova-compute[74190]:       <entry name="uuid">52d7b8e5-02cc-4148-86e2-ceb295e81afc</entry>
Oct 18 11:44:56 user nova-compute[74190]:       <entry name="family">Virtual Machine</entry>
Oct 18 11:44:56 user nova-compute[74190]:     </system>
Oct 18 11:44:56 user nova-compute[74190]:   </sysinfo>
Oct 18 11:44:56 user nova-compute[74190]:   <os>
Oct 18 11:44:56 user nova-compute[74190]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 11:44:56 user nova-compute[74190]:     <boot dev="hd"/>
Oct 18 11:44:56 user nova-compute[74190]:     <smbios mode="sysinfo"/>
Oct 18 11:44:56 user nova-compute[74190]:   </os>
Oct 18 11:44:56 user nova-compute[74190]:   <features>
Oct 18 11:44:56 user nova-compute[74190]:     <acpi/>
Oct 18 11:44:56 user nova-compute[74190]:     <apic/>
Oct 18 11:44:56 user nova-compute[74190]:     <vmcoreinfo/>
Oct 18 11:44:56 user nova-compute[74190]:   </features>
Oct 18 11:44:56 user nova-compute[74190]:   <clock offset="utc">
Oct 18 11:44:56 user nova-compute[74190]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 11:44:56 user nova-compute[74190]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 11:44:56 user nova-compute[74190]:     <timer name="hpet" present="no"/>
Oct 18 11:44:56 user nova-compute[74190]:   </clock>
Oct 18 11:44:56 user nova-compute[74190]:   <cpu mode="custom" match="exact">
Oct 18 11:44:56 user nova-compute[74190]:     <model>Nehalem</model>
Oct 18 11:44:56 user nova-compute[74190]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 11:44:56 user nova-compute[74190]:   </cpu>
Oct 18 11:44:56 user nova-compute[74190]:   <devices>
Oct 18 11:44:56 user nova-compute[74190]:     <disk type="file" device="disk">
Oct 18 11:44:56 user nova-compute[74190]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 11:44:56 user nova-compute[74190]:       <source file="/opt/stack/data/nova/instances/52d7b8e5-02cc-4148-86e2-ceb295e81afc/disk"/>
Oct 18 11:44:56 user nova-compute[74190]:       <target dev="vda" bus="virtio"/>
Oct 18 11:44:56 user nova-compute[74190]:     </disk>
Oct 18 11:44:56 user nova-compute[74190]:     <interface type="ethernet">
Oct 18 11:44:56 user nova-compute[74190]:       <mac address="fa:16:3e:88:36:f0"/>
Oct 18 11:44:56 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:44:56 user nova-compute[74190]:       <mtu size="1442"/>
Oct 18 11:44:56 user nova-compute[74190]:       <target dev="tap550e157d-7f"/>
Oct 18 11:44:56 user nova-compute[74190]:     </interface>
Oct 18 11:44:56 user nova-compute[74190]:     <serial type="pty">
Oct 18 11:44:56 user nova-compute[74190]:       <log file="/opt/stack/data/nova/instances/52d7b8e5-02cc-4148-86e2-ceb295e81afc/console.log" append="off"/>
Oct 18 11:44:56 user nova-compute[74190]:     </serial>
Oct 18 11:44:56 user nova-compute[74190]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 11:44:56 user nova-compute[74190]:     <video>
Oct 18 11:44:56 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:44:56 user nova-compute[74190]:     </video>
Oct 18 11:44:56 user nova-compute[74190]:     <rng model="virtio">
Oct 18 11:44:56 user nova-compute[74190]:       <backend model="random">/dev/urandom</backend>
Oct 18 11:44:56 user nova-compute[74190]:     </rng>
Oct 18 11:44:56 user nova-compute[74190]:     <controller type="usb" index="0" model="none"/>
Oct 18 11:44:56 user nova-compute[74190]:     <memballoon model="virtio">
Oct 18 11:44:56 user nova-compute[74190]:       <stats period="10"/>
Oct 18 11:44:56 user nova-compute[74190]:     </memballoon>
Oct 18 11:44:56 user nova-compute[74190]:   </devices>
Oct 18 11:44:56 user nova-compute[74190]: </domain>
Oct 18 11:44:56 user nova-compute[74190]:  {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 11:44:56 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-34be0e93-aae8-48fc-b5bb-1cbd3af3e2d3 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:44:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-438639954',display_name='tempest-tempest.common.compute-instance-438639954',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-438639954',id=12,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFdYXPh75Q7xKUqDE9zPp25KXyLhkj0/QLZATeV9ge1D1Ga7GiFXEGYg8QjRnvIAI0+WdgkHzK6fQEWBqJjE2h37Va7NyrV0Yc22ekpkzrQQ2biGg9l9Yf1LSoVy9aLWgA==',key_name='tempest-keypair-286461082',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='08cf52ce927443158aa731367f08bd57',ramdisk_id='',reservation_id='r-5s39f1w2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1288544694',owner_user_name='tempest-ServerActionsTestOtherA-1288544694-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:44:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b771e627a76b4540bf8de665df3d7787',uuid=52d7b8e5-02cc-4148-86e2-ceb295e81afc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "550e157d-7f82-41a1-b4ba-9dbb43037d8c", "address": "fa:16:3e:88:36:f0", "network": {"id": "f5ab7da4-2b07-4465-9a89-a07eb053ba91", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1315695374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08cf52ce927443158aa731367f08bd57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap550e157d-7f", "ovs_interfaceid": "550e157d-7f82-41a1-b4ba-9dbb43037d8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 11:44:56 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-34be0e93-aae8-48fc-b5bb-1cbd3af3e2d3 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Converting VIF {"id": "550e157d-7f82-41a1-b4ba-9dbb43037d8c", "address": "fa:16:3e:88:36:f0", "network": {"id": "f5ab7da4-2b07-4465-9a89-a07eb053ba91", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1315695374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08cf52ce927443158aa731367f08bd57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap550e157d-7f", "ovs_interfaceid": "550e157d-7f82-41a1-b4ba-9dbb43037d8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:44:56 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-34be0e93-aae8-48fc-b5bb-1cbd3af3e2d3 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:36:f0,bridge_name='br-int',has_traffic_filtering=True,id=550e157d-7f82-41a1-b4ba-9dbb43037d8c,network=Network(f5ab7da4-2b07-4465-9a89-a07eb053ba91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap550e157d-7f') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:44:56 user nova-compute[74190]: DEBUG os_vif [None req-34be0e93-aae8-48fc-b5bb-1cbd3af3e2d3 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:36:f0,bridge_name='br-int',has_traffic_filtering=True,id=550e157d-7f82-41a1-b4ba-9dbb43037d8c,network=Network(f5ab7da4-2b07-4465-9a89-a07eb053ba91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap550e157d-7f') {{(pid=74190) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 11:44:56 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:56 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:44:56 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 11:44:56 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:56 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '900ba144-0ff4-5b0d-a816-c56aed8e4294', '_type': 'linux-noop'}}, row=False) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:44:56 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:56 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:44:56 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:56 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:56 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap550e157d-7f, may_exist=True, interface_attrs={}) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:44:56 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap550e157d-7f, col_values=(('qos', UUID('2a7316df-73f0-415f-a0b4-0df0d7fe1fdd')),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:44:56 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap550e157d-7f, col_values=(('external_ids', {'iface-id': '550e157d-7f82-41a1-b4ba-9dbb43037d8c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:36:f0', 'vm-uuid': '52d7b8e5-02cc-4148-86e2-ceb295e81afc'}),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:44:56 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:56 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:44:57 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:57 user nova-compute[74190]: INFO os_vif [None req-34be0e93-aae8-48fc-b5bb-1cbd3af3e2d3 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:36:f0,bridge_name='br-int',has_traffic_filtering=True,id=550e157d-7f82-41a1-b4ba-9dbb43037d8c,network=Network(f5ab7da4-2b07-4465-9a89-a07eb053ba91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap550e157d-7f')
Oct 18 11:44:57 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-34be0e93-aae8-48fc-b5bb-1cbd3af3e2d3 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] No BDM found with device name vda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 11:44:57 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-34be0e93-aae8-48fc-b5bb-1cbd3af3e2d3 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] No VIF found with MAC fa:16:3e:88:36:f0, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 11:44:57 user nova-compute[74190]: DEBUG nova.network.neutron [req-705c2267-9f18-4755-9674-1470a7a3c1a8 req-f8a68a65-5f45-4171-951a-f383caf8219f service nova] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Updated VIF entry in instance network info cache for port 550e157d-7f82-41a1-b4ba-9dbb43037d8c. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 11:44:57 user nova-compute[74190]: DEBUG nova.network.neutron [req-705c2267-9f18-4755-9674-1470a7a3c1a8 req-f8a68a65-5f45-4171-951a-f383caf8219f service nova] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Updating instance_info_cache with network_info: [{"id": "550e157d-7f82-41a1-b4ba-9dbb43037d8c", "address": "fa:16:3e:88:36:f0", "network": {"id": "f5ab7da4-2b07-4465-9a89-a07eb053ba91", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1315695374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08cf52ce927443158aa731367f08bd57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap550e157d-7f", "ovs_interfaceid": "550e157d-7f82-41a1-b4ba-9dbb43037d8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:44:57 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-705c2267-9f18-4755-9674-1470a7a3c1a8 req-f8a68a65-5f45-4171-951a-f383caf8219f service nova] Releasing lock "refresh_cache-52d7b8e5-02cc-4148-86e2-ceb295e81afc" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:44:57 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-0fda42db-7cc3-4cd1-89b5-775c52d76b6b tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Acquiring lock "6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:44:57 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-0fda42db-7cc3-4cd1-89b5-775c52d76b6b tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Lock "6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:44:57 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-0fda42db-7cc3-4cd1-89b5-775c52d76b6b tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Acquiring lock "6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:44:57 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-0fda42db-7cc3-4cd1-89b5-775c52d76b6b tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Lock "6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:44:57 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-0fda42db-7cc3-4cd1-89b5-775c52d76b6b tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Lock "6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:44:57 user nova-compute[74190]: INFO nova.compute.manager [None req-0fda42db-7cc3-4cd1-89b5-775c52d76b6b tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] Terminating instance
Oct 18 11:44:57 user nova-compute[74190]: DEBUG nova.compute.manager [None req-0fda42db-7cc3-4cd1-89b5-775c52d76b6b tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] Start destroying the instance on the hypervisor. {{(pid=74190) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 11:44:57 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:58 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:58 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:58 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:58 user nova-compute[74190]: DEBUG nova.compute.manager [req-3e6c2228-e113-401e-912b-2e02963973fc req-2a70c145-ac7c-47e4-8c19-d1d64d6dbb7a service nova] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] Received event network-vif-unplugged-2f3b8cfe-f9f2-4dc5-b368-f67ef363266c {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:44:58 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-3e6c2228-e113-401e-912b-2e02963973fc req-2a70c145-ac7c-47e4-8c19-d1d64d6dbb7a service nova] Acquiring lock "6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:44:58 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-3e6c2228-e113-401e-912b-2e02963973fc req-2a70c145-ac7c-47e4-8c19-d1d64d6dbb7a service nova] Lock "6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:44:58 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-3e6c2228-e113-401e-912b-2e02963973fc req-2a70c145-ac7c-47e4-8c19-d1d64d6dbb7a service nova] Lock "6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:44:58 user nova-compute[74190]: DEBUG nova.compute.manager [req-3e6c2228-e113-401e-912b-2e02963973fc req-2a70c145-ac7c-47e4-8c19-d1d64d6dbb7a service nova] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] No waiting events found dispatching network-vif-unplugged-2f3b8cfe-f9f2-4dc5-b368-f67ef363266c {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:44:58 user nova-compute[74190]: DEBUG nova.compute.manager [req-3e6c2228-e113-401e-912b-2e02963973fc req-2a70c145-ac7c-47e4-8c19-d1d64d6dbb7a service nova] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] Received event network-vif-unplugged-2f3b8cfe-f9f2-4dc5-b368-f67ef363266c for instance with task_state deleting. {{(pid=74190) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 11:44:58 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:58 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:58 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:58 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:58 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:58 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:58 user nova-compute[74190]: DEBUG nova.compute.manager [req-d62d0657-34e3-4d89-a391-b900280cfa04 req-5119a151-b272-4694-8b92-55da5e671d6c service nova] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Received event network-vif-plugged-550e157d-7f82-41a1-b4ba-9dbb43037d8c {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:44:58 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d62d0657-34e3-4d89-a391-b900280cfa04 req-5119a151-b272-4694-8b92-55da5e671d6c service nova] Acquiring lock "52d7b8e5-02cc-4148-86e2-ceb295e81afc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:44:58 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d62d0657-34e3-4d89-a391-b900280cfa04 req-5119a151-b272-4694-8b92-55da5e671d6c service nova] Lock "52d7b8e5-02cc-4148-86e2-ceb295e81afc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:44:58 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d62d0657-34e3-4d89-a391-b900280cfa04 req-5119a151-b272-4694-8b92-55da5e671d6c service nova] Lock "52d7b8e5-02cc-4148-86e2-ceb295e81afc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:44:58 user nova-compute[74190]: DEBUG nova.compute.manager [req-d62d0657-34e3-4d89-a391-b900280cfa04 req-5119a151-b272-4694-8b92-55da5e671d6c service nova] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] No waiting events found dispatching network-vif-plugged-550e157d-7f82-41a1-b4ba-9dbb43037d8c {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:44:58 user nova-compute[74190]: WARNING nova.compute.manager [req-d62d0657-34e3-4d89-a391-b900280cfa04 req-5119a151-b272-4694-8b92-55da5e671d6c service nova] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Received unexpected event network-vif-plugged-550e157d-7f82-41a1-b4ba-9dbb43037d8c for instance with vm_state building and task_state spawning.
Oct 18 11:44:59 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:59 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] Instance destroyed successfully.
Oct 18 11:44:59 user nova-compute[74190]: DEBUG nova.objects.instance [None req-0fda42db-7cc3-4cd1-89b5-775c52d76b6b tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Lazy-loading 'resources' on Instance uuid 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:44:59 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-0fda42db-7cc3-4cd1-89b5-775c52d76b6b tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T11:41:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-239478616',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-239478616',id=5,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDiL4Y3YjaIYG9f48clgmLYvNf1xzm1drxLs+YLjigprz2IgSEssC/H3MORsYOE3v5yg6mGeg/8ep19TIA+gnsVGZGVVookzYwja4uGKlJS/z4feKfCDiLYrj74IwuE8uQ==',key_name='tempest-keypair-654404793',keypairs=<?>,launch_index=0,launched_at=2023-10-18T11:41:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='72f55b03dea844739b3e36d4f73b23e0',ramdisk_id='',reservation_id='r-iliez3d9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1663776612',owner_user_name='tempest-TaggedAttachmentsTest-1663776612-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T11:41:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a587bc7358fe4d289926428f94766374',uuid=6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2f3b8cfe-f9f2-4dc5-b368-f67ef363266c", "address": "fa:16:3e:22:e2:3f", "network": {"id": "c9482f29-6e29-48c6-beb9-64721a29b3d9", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1092346276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72f55b03dea844739b3e36d4f73b23e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f3b8cfe-f9", "ovs_interfaceid": "2f3b8cfe-f9f2-4dc5-b368-f67ef363266c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 11:44:59 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-0fda42db-7cc3-4cd1-89b5-775c52d76b6b tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Converting VIF {"id": "2f3b8cfe-f9f2-4dc5-b368-f67ef363266c", "address": "fa:16:3e:22:e2:3f", "network": {"id": "c9482f29-6e29-48c6-beb9-64721a29b3d9", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1092346276-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72f55b03dea844739b3e36d4f73b23e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f3b8cfe-f9", "ovs_interfaceid": "2f3b8cfe-f9f2-4dc5-b368-f67ef363266c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:44:59 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-0fda42db-7cc3-4cd1-89b5-775c52d76b6b tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:22:e2:3f,bridge_name='br-int',has_traffic_filtering=True,id=2f3b8cfe-f9f2-4dc5-b368-f67ef363266c,network=Network(c9482f29-6e29-48c6-beb9-64721a29b3d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f3b8cfe-f9') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:44:59 user nova-compute[74190]: DEBUG os_vif [None req-0fda42db-7cc3-4cd1-89b5-775c52d76b6b tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:e2:3f,bridge_name='br-int',has_traffic_filtering=True,id=2f3b8cfe-f9f2-4dc5-b368-f67ef363266c,network=Network(c9482f29-6e29-48c6-beb9-64721a29b3d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f3b8cfe-f9') {{(pid=74190) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 11:44:59 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:59 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2f3b8cfe-f9, bridge=br-int, if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:44:59 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:59 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:44:59 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:59 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:59 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b28d4d89-d667-47b1-b728-a8dad1c89c40) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:44:59 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:59 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:44:59 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:59 user nova-compute[74190]: INFO os_vif [None req-0fda42db-7cc3-4cd1-89b5-775c52d76b6b tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:e2:3f,bridge_name='br-int',has_traffic_filtering=True,id=2f3b8cfe-f9f2-4dc5-b368-f67ef363266c,network=Network(c9482f29-6e29-48c6-beb9-64721a29b3d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f3b8cfe-f9')
Oct 18 11:44:59 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-0fda42db-7cc3-4cd1-89b5-775c52d76b6b tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] Deleting instance files /opt/stack/data/nova/instances/6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef_del
Oct 18 11:44:59 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-0fda42db-7cc3-4cd1-89b5-775c52d76b6b tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] Deletion of /opt/stack/data/nova/instances/6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef_del complete
Oct 18 11:44:59 user nova-compute[74190]: INFO nova.compute.manager [None req-0fda42db-7cc3-4cd1-89b5-775c52d76b6b tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] Took 1.68 seconds to destroy the instance on the hypervisor.
Oct 18 11:44:59 user nova-compute[74190]: DEBUG oslo.service.loopingcall [None req-0fda42db-7cc3-4cd1-89b5-775c52d76b6b tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74190) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 11:44:59 user nova-compute[74190]: DEBUG nova.compute.manager [-] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] Deallocating network for instance {{(pid=74190) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 11:44:59 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] deallocate_for_instance() {{(pid=74190) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 11:44:59 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-ab3d260d-f19b-42d9-895a-2d5c2ad99940 tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] Acquiring lock "697d3123-bd6b-42b9-b278-c33c0c00da6f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:44:59 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-ab3d260d-f19b-42d9-895a-2d5c2ad99940 tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] Lock "697d3123-bd6b-42b9-b278-c33c0c00da6f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:44:59 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-ab3d260d-f19b-42d9-895a-2d5c2ad99940 tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] Acquiring lock "697d3123-bd6b-42b9-b278-c33c0c00da6f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:44:59 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-ab3d260d-f19b-42d9-895a-2d5c2ad99940 tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] Lock "697d3123-bd6b-42b9-b278-c33c0c00da6f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:44:59 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-ab3d260d-f19b-42d9-895a-2d5c2ad99940 tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] Lock "697d3123-bd6b-42b9-b278-c33c0c00da6f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:44:59 user nova-compute[74190]: INFO nova.compute.manager [None req-ab3d260d-f19b-42d9-895a-2d5c2ad99940 tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f] Terminating instance
Oct 18 11:44:59 user nova-compute[74190]: DEBUG nova.compute.manager [None req-ab3d260d-f19b-42d9-895a-2d5c2ad99940 tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f] Start destroying the instance on the hypervisor. {{(pid=74190) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 11:44:59 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:59 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:59 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:44:59 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:00 user nova-compute[74190]: DEBUG nova.compute.manager [req-e13bd0b8-e4e2-4cca-9ac1-79857b411e2d req-3e8c5483-379a-46fa-a461-c332e897b85c service nova] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] Received event network-vif-plugged-2f3b8cfe-f9f2-4dc5-b368-f67ef363266c {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:45:00 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-e13bd0b8-e4e2-4cca-9ac1-79857b411e2d req-3e8c5483-379a-46fa-a461-c332e897b85c service nova] Acquiring lock "6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:45:00 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-e13bd0b8-e4e2-4cca-9ac1-79857b411e2d req-3e8c5483-379a-46fa-a461-c332e897b85c service nova] Lock "6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:45:00 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-e13bd0b8-e4e2-4cca-9ac1-79857b411e2d req-3e8c5483-379a-46fa-a461-c332e897b85c service nova] Lock "6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:45:00 user nova-compute[74190]: DEBUG nova.compute.manager [req-e13bd0b8-e4e2-4cca-9ac1-79857b411e2d req-3e8c5483-379a-46fa-a461-c332e897b85c service nova] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] No waiting events found dispatching network-vif-plugged-2f3b8cfe-f9f2-4dc5-b368-f67ef363266c {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:45:00 user nova-compute[74190]: WARNING nova.compute.manager [req-e13bd0b8-e4e2-4cca-9ac1-79857b411e2d req-3e8c5483-379a-46fa-a461-c332e897b85c service nova] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] Received unexpected event network-vif-plugged-2f3b8cfe-f9f2-4dc5-b368-f67ef363266c for instance with vm_state active and task_state deleting.
Oct 18 11:45:00 user nova-compute[74190]: DEBUG nova.compute.manager [req-e13bd0b8-e4e2-4cca-9ac1-79857b411e2d req-3e8c5483-379a-46fa-a461-c332e897b85c service nova] [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f] Received event network-vif-unplugged-9087f286-715a-4bb2-a211-27119477ac6b {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:45:00 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-e13bd0b8-e4e2-4cca-9ac1-79857b411e2d req-3e8c5483-379a-46fa-a461-c332e897b85c service nova] Acquiring lock "697d3123-bd6b-42b9-b278-c33c0c00da6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:45:00 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-e13bd0b8-e4e2-4cca-9ac1-79857b411e2d req-3e8c5483-379a-46fa-a461-c332e897b85c service nova] Lock "697d3123-bd6b-42b9-b278-c33c0c00da6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:45:00 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-e13bd0b8-e4e2-4cca-9ac1-79857b411e2d req-3e8c5483-379a-46fa-a461-c332e897b85c service nova] Lock "697d3123-bd6b-42b9-b278-c33c0c00da6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:45:00 user nova-compute[74190]: DEBUG nova.compute.manager [req-e13bd0b8-e4e2-4cca-9ac1-79857b411e2d req-3e8c5483-379a-46fa-a461-c332e897b85c service nova] [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f] No waiting events found dispatching network-vif-unplugged-9087f286-715a-4bb2-a211-27119477ac6b {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:45:00 user nova-compute[74190]: DEBUG nova.compute.manager [req-e13bd0b8-e4e2-4cca-9ac1-79857b411e2d req-3e8c5483-379a-46fa-a461-c332e897b85c service nova] [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f] Received event network-vif-unplugged-9087f286-715a-4bb2-a211-27119477ac6b for instance with task_state deleting. {{(pid=74190) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 11:45:00 user nova-compute[74190]: DEBUG nova.compute.manager [req-e13bd0b8-e4e2-4cca-9ac1-79857b411e2d req-3e8c5483-379a-46fa-a461-c332e897b85c service nova] [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f] Received event network-vif-plugged-9087f286-715a-4bb2-a211-27119477ac6b {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:45:00 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-e13bd0b8-e4e2-4cca-9ac1-79857b411e2d req-3e8c5483-379a-46fa-a461-c332e897b85c service nova] Acquiring lock "697d3123-bd6b-42b9-b278-c33c0c00da6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:45:00 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-e13bd0b8-e4e2-4cca-9ac1-79857b411e2d req-3e8c5483-379a-46fa-a461-c332e897b85c service nova] Lock "697d3123-bd6b-42b9-b278-c33c0c00da6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:45:00 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-e13bd0b8-e4e2-4cca-9ac1-79857b411e2d req-3e8c5483-379a-46fa-a461-c332e897b85c service nova] Lock "697d3123-bd6b-42b9-b278-c33c0c00da6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:45:00 user nova-compute[74190]: DEBUG nova.compute.manager [req-e13bd0b8-e4e2-4cca-9ac1-79857b411e2d req-3e8c5483-379a-46fa-a461-c332e897b85c service nova] [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f] No waiting events found dispatching network-vif-plugged-9087f286-715a-4bb2-a211-27119477ac6b {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:45:00 user nova-compute[74190]: WARNING nova.compute.manager [req-e13bd0b8-e4e2-4cca-9ac1-79857b411e2d req-3e8c5483-379a-46fa-a461-c332e897b85c service nova] [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f] Received unexpected event network-vif-plugged-9087f286-715a-4bb2-a211-27119477ac6b for instance with vm_state active and task_state deleting.
Oct 18 11:45:00 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f] Instance destroyed successfully.
Oct 18 11:45:00 user nova-compute[74190]: DEBUG nova.objects.instance [None req-ab3d260d-f19b-42d9-895a-2d5c2ad99940 tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] Lazy-loading 'resources' on Instance uuid 697d3123-bd6b-42b9-b278-c33c0c00da6f {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:45:00 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-ab3d260d-f19b-42d9-895a-2d5c2ad99940 tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:41:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1737404817',display_name='tempest-VolumesAssistedSnapshotsTest-server-1737404817',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1737404817',id=8,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFxSnU+o1nJa1IER2JPisxhrwZNjvPpqfPD8HQuhMyx42JmEIhWSBVKBL42HljjIk2atU8eX3EIwbIy9rY34YXOQTDFMPmY9NErlQUGAxNzV8HYQpixshmwzt/WRBKHQnw==',key_name='tempest-keypair-613465599',keypairs=<?>,launch_index=0,launched_at=2023-10-18T11:41:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0d5cced34b384eb79833c41a1c607ef3',ramdisk_id='',reservation_id='r-45rvwoyu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1301090683',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1301090683-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T11:41:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2bbf67b2fa0149c19a86fa723f662569',uuid=697d3123-bd6b-42b9-b278-c33c0c00da6f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9087f286-715a-4bb2-a211-27119477ac6b", "address": "fa:16:3e:f7:93:c2", "network": {"id": "ad63fd35-616c-40f8-9849-e84a2c75ad29", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2145418188-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d5cced34b384eb79833c41a1c607ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9087f286-71", "ovs_interfaceid": "9087f286-715a-4bb2-a211-27119477ac6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 11:45:00 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-ab3d260d-f19b-42d9-895a-2d5c2ad99940 tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] Converting VIF {"id": "9087f286-715a-4bb2-a211-27119477ac6b", "address": "fa:16:3e:f7:93:c2", "network": {"id": "ad63fd35-616c-40f8-9849-e84a2c75ad29", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2145418188-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d5cced34b384eb79833c41a1c607ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9087f286-71", "ovs_interfaceid": "9087f286-715a-4bb2-a211-27119477ac6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:45:00 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-ab3d260d-f19b-42d9-895a-2d5c2ad99940 tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f7:93:c2,bridge_name='br-int',has_traffic_filtering=True,id=9087f286-715a-4bb2-a211-27119477ac6b,network=Network(ad63fd35-616c-40f8-9849-e84a2c75ad29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9087f286-71') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:45:00 user nova-compute[74190]: DEBUG os_vif [None req-ab3d260d-f19b-42d9-895a-2d5c2ad99940 tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:93:c2,bridge_name='br-int',has_traffic_filtering=True,id=9087f286-715a-4bb2-a211-27119477ac6b,network=Network(ad63fd35-616c-40f8-9849-e84a2c75ad29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9087f286-71') {{(pid=74190) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 11:45:00 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:00 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9087f286-71, bridge=br-int, if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:45:00 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:00 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:45:00 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:00 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:00 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=89a4cc7c-541a-4a02-b8d4-f418fac7313c) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:45:00 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:00 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:45:00 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:00 user nova-compute[74190]: INFO os_vif [None req-ab3d260d-f19b-42d9-895a-2d5c2ad99940 tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:93:c2,bridge_name='br-int',has_traffic_filtering=True,id=9087f286-715a-4bb2-a211-27119477ac6b,network=Network(ad63fd35-616c-40f8-9849-e84a2c75ad29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9087f286-71')
Oct 18 11:45:00 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-ab3d260d-f19b-42d9-895a-2d5c2ad99940 tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f] Deleting instance files /opt/stack/data/nova/instances/697d3123-bd6b-42b9-b278-c33c0c00da6f_del
Oct 18 11:45:00 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-ab3d260d-f19b-42d9-895a-2d5c2ad99940 tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f] Deletion of /opt/stack/data/nova/instances/697d3123-bd6b-42b9-b278-c33c0c00da6f_del complete
Oct 18 11:45:00 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] Updating instance_info_cache with network_info: [] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:45:00 user nova-compute[74190]: DEBUG nova.compute.manager [req-a8a479d2-e2d6-43bf-a27e-b4cc994dbe37 req-2d3baec7-981f-4b41-9ed6-7e59f7d76e20 service nova] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] Received event network-vif-deleted-2f3b8cfe-f9f2-4dc5-b368-f67ef363266c {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:45:00 user nova-compute[74190]: INFO nova.compute.manager [req-a8a479d2-e2d6-43bf-a27e-b4cc994dbe37 req-2d3baec7-981f-4b41-9ed6-7e59f7d76e20 service nova] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] Neutron deleted interface 2f3b8cfe-f9f2-4dc5-b368-f67ef363266c; detaching it from the instance and deleting it from the info cache
Oct 18 11:45:00 user nova-compute[74190]: DEBUG nova.network.neutron [req-a8a479d2-e2d6-43bf-a27e-b4cc994dbe37 req-2d3baec7-981f-4b41-9ed6-7e59f7d76e20 service nova] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] Updating instance_info_cache with network_info: [] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:45:00 user nova-compute[74190]: INFO nova.compute.manager [-] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] Took 1.17 seconds to deallocate network for instance.
Oct 18 11:45:00 user nova-compute[74190]: INFO nova.compute.manager [None req-ab3d260d-f19b-42d9-895a-2d5c2ad99940 tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f] Took 0.95 seconds to destroy the instance on the hypervisor.
Oct 18 11:45:00 user nova-compute[74190]: DEBUG oslo.service.loopingcall [None req-ab3d260d-f19b-42d9-895a-2d5c2ad99940 tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74190) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 11:45:00 user nova-compute[74190]: DEBUG nova.compute.manager [-] [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f] Deallocating network for instance {{(pid=74190) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 11:45:00 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f] deallocate_for_instance() {{(pid=74190) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 11:45:00 user nova-compute[74190]: DEBUG nova.compute.manager [req-a8a479d2-e2d6-43bf-a27e-b4cc994dbe37 req-2d3baec7-981f-4b41-9ed6-7e59f7d76e20 service nova] [instance: 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef] Detach interface failed, port_id=2f3b8cfe-f9f2-4dc5-b368-f67ef363266c, reason: Instance 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef could not be found. {{(pid=74190) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 18 11:45:00 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-0fda42db-7cc3-4cd1-89b5-775c52d76b6b tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:45:00 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-0fda42db-7cc3-4cd1-89b5-775c52d76b6b tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:45:00 user nova-compute[74190]: DEBUG nova.compute.manager [req-7e58956b-c4de-408c-96b2-01b12018213f req-c9b5c2da-0213-4fec-a456-e465fac25b29 service nova] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Received event network-vif-plugged-550e157d-7f82-41a1-b4ba-9dbb43037d8c {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:45:00 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-7e58956b-c4de-408c-96b2-01b12018213f req-c9b5c2da-0213-4fec-a456-e465fac25b29 service nova] Acquiring lock "52d7b8e5-02cc-4148-86e2-ceb295e81afc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:45:00 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-7e58956b-c4de-408c-96b2-01b12018213f req-c9b5c2da-0213-4fec-a456-e465fac25b29 service nova] Lock "52d7b8e5-02cc-4148-86e2-ceb295e81afc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:45:00 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-7e58956b-c4de-408c-96b2-01b12018213f req-c9b5c2da-0213-4fec-a456-e465fac25b29 service nova] Lock "52d7b8e5-02cc-4148-86e2-ceb295e81afc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:45:00 user nova-compute[74190]: DEBUG nova.compute.manager [req-7e58956b-c4de-408c-96b2-01b12018213f req-c9b5c2da-0213-4fec-a456-e465fac25b29 service nova] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] No waiting events found dispatching network-vif-plugged-550e157d-7f82-41a1-b4ba-9dbb43037d8c {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:45:00 user nova-compute[74190]: WARNING nova.compute.manager [req-7e58956b-c4de-408c-96b2-01b12018213f req-c9b5c2da-0213-4fec-a456-e465fac25b29 service nova] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Received unexpected event network-vif-plugged-550e157d-7f82-41a1-b4ba-9dbb43037d8c for instance with vm_state building and task_state spawning.
Oct 18 11:45:01 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-0fda42db-7cc3-4cd1-89b5-775c52d76b6b tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 11:45:01 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-0fda42db-7cc3-4cd1-89b5-775c52d76b6b tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 11:45:01 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-0fda42db-7cc3-4cd1-89b5-775c52d76b6b tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.394s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:45:01 user nova-compute[74190]: INFO nova.scheduler.client.report [None req-0fda42db-7cc3-4cd1-89b5-775c52d76b6b tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Deleted allocations for instance 6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef
Oct 18 11:45:01 user nova-compute[74190]: DEBUG nova.compute.manager [None req-34be0e93-aae8-48fc-b5bb-1cbd3af3e2d3 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Instance event wait completed in 0 seconds for  {{(pid=74190) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 11:45:01 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-34be0e93-aae8-48fc-b5bb-1cbd3af3e2d3 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Guest created on hypervisor {{(pid=74190) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 11:45:01 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-0fda42db-7cc3-4cd1-89b5-775c52d76b6b tempest-TaggedAttachmentsTest-1663776612 tempest-TaggedAttachmentsTest-1663776612-project-member] Lock "6fd7da62-f83d-48d8-bd6d-a8ee4c5c02ef" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.667s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:45:01 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Instance spawned successfully.
Oct 18 11:45:01 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-34be0e93-aae8-48fc-b5bb-1cbd3af3e2d3 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 11:45:01 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-34be0e93-aae8-48fc-b5bb-1cbd3af3e2d3 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Found default for hw_cdrom_bus of ide {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:45:01 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-34be0e93-aae8-48fc-b5bb-1cbd3af3e2d3 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Found default for hw_disk_bus of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:45:01 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-34be0e93-aae8-48fc-b5bb-1cbd3af3e2d3 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Found default for hw_input_bus of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:45:01 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-34be0e93-aae8-48fc-b5bb-1cbd3af3e2d3 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Found default for hw_pointer_model of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:45:01 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-34be0e93-aae8-48fc-b5bb-1cbd3af3e2d3 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Found default for hw_video_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:45:01 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-34be0e93-aae8-48fc-b5bb-1cbd3af3e2d3 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Found default for hw_vif_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:45:01 user nova-compute[74190]: INFO nova.compute.manager [None req-34be0e93-aae8-48fc-b5bb-1cbd3af3e2d3 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Took 7.35 seconds to spawn the instance on the hypervisor.
Oct 18 11:45:01 user nova-compute[74190]: DEBUG nova.compute.manager [None req-34be0e93-aae8-48fc-b5bb-1cbd3af3e2d3 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Checking state {{(pid=74190) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 11:45:01 user nova-compute[74190]: INFO nova.compute.manager [None req-34be0e93-aae8-48fc-b5bb-1cbd3af3e2d3 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Took 9.12 seconds to build instance.
Oct 18 11:45:01 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f] Updating instance_info_cache with network_info: [] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:45:01 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-34be0e93-aae8-48fc-b5bb-1cbd3af3e2d3 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lock "52d7b8e5-02cc-4148-86e2-ceb295e81afc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.272s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:45:01 user nova-compute[74190]: INFO nova.compute.manager [-] [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f] Took 1.07 seconds to deallocate network for instance.
Oct 18 11:45:01 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-ab3d260d-f19b-42d9-895a-2d5c2ad99940 tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:45:01 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-ab3d260d-f19b-42d9-895a-2d5c2ad99940 tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:45:02 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-ab3d260d-f19b-42d9-895a-2d5c2ad99940 tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 11:45:02 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-ab3d260d-f19b-42d9-895a-2d5c2ad99940 tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 11:45:02 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-ab3d260d-f19b-42d9-895a-2d5c2ad99940 tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.474s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:45:02 user nova-compute[74190]: INFO nova.scheduler.client.report [None req-ab3d260d-f19b-42d9-895a-2d5c2ad99940 tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] Deleted allocations for instance 697d3123-bd6b-42b9-b278-c33c0c00da6f
Oct 18 11:45:02 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-ab3d260d-f19b-42d9-895a-2d5c2ad99940 tempest-VolumesAssistedSnapshotsTest-1301090683 tempest-VolumesAssistedSnapshotsTest-1301090683-project-member] Lock "697d3123-bd6b-42b9-b278-c33c0c00da6f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.773s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:45:02 user nova-compute[74190]: DEBUG nova.compute.manager [req-c98d9f92-31d4-4798-9c25-a3b49abbf247 req-5d2ec3a6-7e2e-4e84-8408-353030c07eb3 service nova] [instance: 697d3123-bd6b-42b9-b278-c33c0c00da6f] Received event network-vif-deleted-9087f286-715a-4bb2-a211-27119477ac6b {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:45:04 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:05 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:09 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:10 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:10 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Creating instance directory {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 11:45:10 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Creating image(s)
Oct 18 11:45:10 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Did not create local disks {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 18 11:45:10 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Ensure instance console log exists: /opt/stack/data/nova/instances/aabb5eea-8366-482a-8d16-bf271c0fe8d7/console.log {{(pid=74190) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 11:45:10 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:45:10 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:45:10 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:45:10 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Start _get_guest_xml network_info=[{"id": "21163c28-d799-420c-96b5-6ea0e829dc93", "address": "fa:16:3e:d8:31:38", "network": {"id": "40790864-a5db-4f62-adde-28ee0dc256cc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-682684827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f5028593e4e4805aaa839c6759be293", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21163c28-d7", "ovs_interfaceid": "21163c28-d799-420c-96b5-6ea0e829dc93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ahIObAot', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'aabb5eea-8366-482a-8d16-bf271c0fe8d7', 'attached_at': '', 'detached_at': '', 'volume_id': '5c87f389-42e2-4d78-8bdb-4d5bda76216c', 'serial': '5c87f389-42e2-4d78-8bdb-4d5bda76216c'}, 'delete_on_termination': True, 'guest_format': None, 'attachment_id': '75c6e754-c724-4338-99b7-2494ada4db25', 'volume_type': None} {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 11:45:10 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 18 11:45:10 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 18 11:45:10 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 11:45:10 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] CPU controller missing on host. {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 11:45:10 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 11:45:10 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] CPU controller found on host. {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 11:45:10 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74190) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 11:45:10 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T11:37:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 11:45:10 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Flavor limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 11:45:10 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Image limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 11:45:10 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Flavor pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 11:45:10 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Image pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 11:45:10 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 11:45:10 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 11:45:10 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 11:45:10 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Got 1 possible topologies {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 11:45:10 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 11:45:10 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 11:45:11 user nova-compute[74190]: DEBUG nova.objects.instance [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Lazy-loading 'vcpu_model' on Instance uuid aabb5eea-8366-482a-8d16-bf271c0fe8d7 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:45:11 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Calling os-brick to attach iSCSI Volume {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 11:45:11 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ahIObAot', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:45:11 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 18 11:45:11 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:45:11 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:45:11 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 18 11:45:11 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:45:11 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:45:11 user nova-compute[74190]: INFO os_brick.initiator.connectors.iscsi [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 11:45:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c -p 172.16.0.220:3260 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:45:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:45:11 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[64491156-9d71-4152-abc5-f61684b800f9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:45:11 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 11:45:11 user nova-compute[74190]:  {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:45:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c -p 172.16.0.220:3260 --interface default --op new {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:45:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:45:11 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[73570d47-71f7-473e-8615-4df46a4f99cd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c] added\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:45:11 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c] added
Oct 18 11:45:11 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:45:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:45:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:45:11 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3abf3eb-f375-48c4-8d24-92d60eb2f1f8]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:45:11 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:45:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:45:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:45:11 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d65626b-af6a-4ca3-b5dd-9d7bb982e2e8]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:45:11 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:45:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ahIObAot {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:45:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ahIObAot" returned: 0 in 0.027s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:45:11 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[eddc8811-5f85-47d0-8be0-602655673b8f]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:45:11 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ahIObAot'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:45:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:45:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:45:11 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[48dd794c-cfeb-4013-9a19-d37a4971e2c0]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:45:11 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:45:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:45:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:45:11 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[fefc2da4-255d-4956-992d-86ff32fa2c15]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:45:11 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920 (non-flash)
Oct 18 11:45:11 user nova-compute[74190]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)
Oct 18 11:45:11 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:45:11 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920 (non-flash)
Oct 18 11:45:11 user nova-compute[74190]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)
Oct 18 11:45:11 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:45:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c -p 172.16.0.220:3260 --login {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:45:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:45:11 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[84eb3463-a878-47b1-b663-6426ef2b9e37]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:45:11 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c, portal: 172.16.0.220,3260]
Oct 18 11:45:11 user nova-compute[74190]: Login to [iface: default, target: iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c, portal: 172.16.0.220,3260] successful.
Oct 18 11:45:11 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:45:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:45:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:45:11 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[c546c8e6-8b43-4bba-ab8c-d7bf8da62531]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:45:11 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:45:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:45:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:45:11 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[a00c6cad-01d7-487f-8213-ff46e880ac5c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:45:11 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920 (non-flash)
Oct 18 11:45:11 user nova-compute[74190]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)
Oct 18 11:45:11 user nova-compute[74190]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)
Oct 18 11:45:11 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:45:11 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920 (non-flash)
Oct 18 11:45:11 user nova-compute[74190]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)
Oct 18 11:45:11 user nova-compute[74190]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)
Oct 18 11:45:11 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:45:11 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:45:11 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Connected to 172.16.0.220:3260 {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 11:45:11 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] HCTL ('33', '-', '-', 0) found on session 12 with lun 0 {{(pid=74190) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 11:45:11 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74190) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 11:45:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:45:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:45:11 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[0487ba1f-afc0-45a4-bf72-69dbf711954d]: (4, ('- - 0', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:45:11 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Searching for a device in session 12 and hctl ['33', '*', '*', 0] yield: None {{(pid=74190) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 11:45:12 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Searching for a device in session 12 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74190) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 11:45:12 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ahIObAot', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 11:45:12 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:45:12 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] <== connect_volume: return (1330ms) {'type': 'block', 'scsi_wwn': '23338373835663364', 'path': '/dev/sdb'} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:45:12 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23338373835663364', 'path': '/dev/sdb'} {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 11:45:12 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-18T11:42:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-705838820',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1751107250',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCGAytsGwKIkIlWHJHinPWL79JZWbDLUxBsDePH5prj/RtI6Z3qHCyazEDqxn5098+uhRVuFwPPlZKB1iRU99f3IUwmSBv9DCo1T4Kl+DbCeNTfJ+46eAnqPOhZREa0v/Q==',key_name='tempest-keypair-458715235',keypairs=<?>,launch_index=0,launched_at=2023-10-18T11:42:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5f5028593e4e4805aaa839c6759be293',ramdisk_id='',reservation_id='r-6je5vmge',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1161132701',owner_user_name='tempest-ServerActionsV293TestJSON-1161132701-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:44:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='58fb2050865044f9a0d621a9ca328ece',uuid=aabb5eea-8366-482a-8d16-bf271c0fe8d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "21163c28-d799-420c-96b5-6ea0e829dc93", "address": "fa:16:3e:d8:31:38", "network": {"id": "40790864-a5db-4f62-adde-28ee0dc256cc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-682684827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f5028593e4e4805aaa839c6759be293", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21163c28-d7", "ovs_interfaceid": "21163c28-d799-420c-96b5-6ea0e829dc93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74190) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 11:45:12 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Converting VIF {"id": "21163c28-d799-420c-96b5-6ea0e829dc93", "address": "fa:16:3e:d8:31:38", "network": {"id": "40790864-a5db-4f62-adde-28ee0dc256cc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-682684827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f5028593e4e4805aaa839c6759be293", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21163c28-d7", "ovs_interfaceid": "21163c28-d799-420c-96b5-6ea0e829dc93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:45:12 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d8:31:38,bridge_name='br-int',has_traffic_filtering=True,id=21163c28-d799-420c-96b5-6ea0e829dc93,network=Network(40790864-a5db-4f62-adde-28ee0dc256cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21163c28-d7') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:45:12 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] End _get_guest_xml xml=<domain type="kvm">
Oct 18 11:45:12 user nova-compute[74190]:   <uuid>aabb5eea-8366-482a-8d16-bf271c0fe8d7</uuid>
Oct 18 11:45:12 user nova-compute[74190]:   <name>instance-00000009</name>
Oct 18 11:45:12 user nova-compute[74190]:   <memory>524288</memory>
Oct 18 11:45:12 user nova-compute[74190]:   <vcpu>1</vcpu>
Oct 18 11:45:12 user nova-compute[74190]:   <metadata>
Oct 18 11:45:12 user nova-compute[74190]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 11:45:12 user nova-compute[74190]:       <nova:package version="0.0.0"/>
Oct 18 11:45:12 user nova-compute[74190]:       <nova:name>tempest-ServerActionsV293TestJSON-server-705838820</nova:name>
Oct 18 11:45:12 user nova-compute[74190]:       <nova:creationTime>2023-10-18 11:45:10</nova:creationTime>
Oct 18 11:45:12 user nova-compute[74190]:       <nova:flavor name="m1.tiny">
Oct 18 11:45:12 user nova-compute[74190]:         <nova:memory>512</nova:memory>
Oct 18 11:45:12 user nova-compute[74190]:         <nova:disk>1</nova:disk>
Oct 18 11:45:12 user nova-compute[74190]:         <nova:swap>0</nova:swap>
Oct 18 11:45:12 user nova-compute[74190]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 11:45:12 user nova-compute[74190]:         <nova:vcpus>1</nova:vcpus>
Oct 18 11:45:12 user nova-compute[74190]:       </nova:flavor>
Oct 18 11:45:12 user nova-compute[74190]:       <nova:owner>
Oct 18 11:45:12 user nova-compute[74190]:         <nova:user uuid="58fb2050865044f9a0d621a9ca328ece">tempest-ServerActionsV293TestJSON-1161132701-project-member</nova:user>
Oct 18 11:45:12 user nova-compute[74190]:         <nova:project uuid="5f5028593e4e4805aaa839c6759be293">tempest-ServerActionsV293TestJSON-1161132701</nova:project>
Oct 18 11:45:12 user nova-compute[74190]:       </nova:owner>
Oct 18 11:45:12 user nova-compute[74190]:       <nova:ports>
Oct 18 11:45:12 user nova-compute[74190]:         <nova:port uuid="21163c28-d799-420c-96b5-6ea0e829dc93">
Oct 18 11:45:12 user nova-compute[74190]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 18 11:45:12 user nova-compute[74190]:         </nova:port>
Oct 18 11:45:12 user nova-compute[74190]:       </nova:ports>
Oct 18 11:45:12 user nova-compute[74190]:     </nova:instance>
Oct 18 11:45:12 user nova-compute[74190]:   </metadata>
Oct 18 11:45:12 user nova-compute[74190]:   <sysinfo type="smbios">
Oct 18 11:45:12 user nova-compute[74190]:     <system>
Oct 18 11:45:12 user nova-compute[74190]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 11:45:12 user nova-compute[74190]:       <entry name="product">OpenStack Nova</entry>
Oct 18 11:45:12 user nova-compute[74190]:       <entry name="version">0.0.0</entry>
Oct 18 11:45:12 user nova-compute[74190]:       <entry name="serial">aabb5eea-8366-482a-8d16-bf271c0fe8d7</entry>
Oct 18 11:45:12 user nova-compute[74190]:       <entry name="uuid">aabb5eea-8366-482a-8d16-bf271c0fe8d7</entry>
Oct 18 11:45:12 user nova-compute[74190]:       <entry name="family">Virtual Machine</entry>
Oct 18 11:45:12 user nova-compute[74190]:     </system>
Oct 18 11:45:12 user nova-compute[74190]:   </sysinfo>
Oct 18 11:45:12 user nova-compute[74190]:   <os>
Oct 18 11:45:12 user nova-compute[74190]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 11:45:12 user nova-compute[74190]:     <boot dev="hd"/>
Oct 18 11:45:12 user nova-compute[74190]:     <smbios mode="sysinfo"/>
Oct 18 11:45:12 user nova-compute[74190]:   </os>
Oct 18 11:45:12 user nova-compute[74190]:   <features>
Oct 18 11:45:12 user nova-compute[74190]:     <acpi/>
Oct 18 11:45:12 user nova-compute[74190]:     <apic/>
Oct 18 11:45:12 user nova-compute[74190]:     <vmcoreinfo/>
Oct 18 11:45:12 user nova-compute[74190]:   </features>
Oct 18 11:45:12 user nova-compute[74190]:   <clock offset="utc">
Oct 18 11:45:12 user nova-compute[74190]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 11:45:12 user nova-compute[74190]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 11:45:12 user nova-compute[74190]:     <timer name="hpet" present="no"/>
Oct 18 11:45:12 user nova-compute[74190]:   </clock>
Oct 18 11:45:12 user nova-compute[74190]:   <cpu mode="custom" match="exact">
Oct 18 11:45:12 user nova-compute[74190]:     <model>Nehalem</model>
Oct 18 11:45:12 user nova-compute[74190]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 11:45:12 user nova-compute[74190]:   </cpu>
Oct 18 11:45:12 user nova-compute[74190]:   <devices>
Oct 18 11:45:12 user nova-compute[74190]:     <disk type="block" device="disk">
Oct 18 11:45:12 user nova-compute[74190]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 11:45:12 user nova-compute[74190]:       <source dev="/dev/sdb"/>
Oct 18 11:45:12 user nova-compute[74190]:       <target dev="vda" bus="virtio"/>
Oct 18 11:45:12 user nova-compute[74190]:       <serial>5c87f389-42e2-4d78-8bdb-4d5bda76216c</serial>
Oct 18 11:45:12 user nova-compute[74190]:     </disk>
Oct 18 11:45:12 user nova-compute[74190]:     <interface type="ethernet">
Oct 18 11:45:12 user nova-compute[74190]:       <mac address="fa:16:3e:d8:31:38"/>
Oct 18 11:45:12 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:45:12 user nova-compute[74190]:       <mtu size="1442"/>
Oct 18 11:45:12 user nova-compute[74190]:       <target dev="tap21163c28-d7"/>
Oct 18 11:45:12 user nova-compute[74190]:     </interface>
Oct 18 11:45:12 user nova-compute[74190]:     <serial type="pty">
Oct 18 11:45:12 user nova-compute[74190]:       <log file="/opt/stack/data/nova/instances/aabb5eea-8366-482a-8d16-bf271c0fe8d7/console.log" append="off"/>
Oct 18 11:45:12 user nova-compute[74190]:     </serial>
Oct 18 11:45:12 user nova-compute[74190]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 11:45:12 user nova-compute[74190]:     <video>
Oct 18 11:45:12 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:45:12 user nova-compute[74190]:     </video>
Oct 18 11:45:12 user nova-compute[74190]:     <rng model="virtio">
Oct 18 11:45:12 user nova-compute[74190]:       <backend model="random">/dev/urandom</backend>
Oct 18 11:45:12 user nova-compute[74190]:     </rng>
Oct 18 11:45:12 user nova-compute[74190]:     <controller type="usb" index="0" model="none"/>
Oct 18 11:45:12 user nova-compute[74190]:     <memballoon model="virtio">
Oct 18 11:45:12 user nova-compute[74190]:       <stats period="10"/>
Oct 18 11:45:12 user nova-compute[74190]:     </memballoon>
Oct 18 11:45:12 user nova-compute[74190]:   </devices>
Oct 18 11:45:12 user nova-compute[74190]: </domain>
Oct 18 11:45:12 user nova-compute[74190]:  {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 11:45:12 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-18T11:42:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-705838820',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1751107250',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCGAytsGwKIkIlWHJHinPWL79JZWbDLUxBsDePH5prj/RtI6Z3qHCyazEDqxn5098+uhRVuFwPPlZKB1iRU99f3IUwmSBv9DCo1T4Kl+DbCeNTfJ+46eAnqPOhZREa0v/Q==',key_name='tempest-keypair-458715235',keypairs=<?>,launch_index=0,launched_at=2023-10-18T11:42:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5f5028593e4e4805aaa839c6759be293',ramdisk_id='',reservation_id='r-6je5vmge',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1161132701',owner_user_name='tempest-ServerActionsV293TestJSON-1161132701-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:44:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='58fb2050865044f9a0d621a9ca328ece',uuid=aabb5eea-8366-482a-8d16-bf271c0fe8d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "21163c28-d799-420c-96b5-6ea0e829dc93", "address": "fa:16:3e:d8:31:38", "network": {"id": "40790864-a5db-4f62-adde-28ee0dc256cc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-682684827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f5028593e4e4805aaa839c6759be293", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21163c28-d7", "ovs_interfaceid": "21163c28-d799-420c-96b5-6ea0e829dc93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 11:45:12 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Converting VIF {"id": "21163c28-d799-420c-96b5-6ea0e829dc93", "address": "fa:16:3e:d8:31:38", "network": {"id": "40790864-a5db-4f62-adde-28ee0dc256cc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-682684827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f5028593e4e4805aaa839c6759be293", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21163c28-d7", "ovs_interfaceid": "21163c28-d799-420c-96b5-6ea0e829dc93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:45:12 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d8:31:38,bridge_name='br-int',has_traffic_filtering=True,id=21163c28-d799-420c-96b5-6ea0e829dc93,network=Network(40790864-a5db-4f62-adde-28ee0dc256cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21163c28-d7') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:45:12 user nova-compute[74190]: DEBUG os_vif [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:31:38,bridge_name='br-int',has_traffic_filtering=True,id=21163c28-d799-420c-96b5-6ea0e829dc93,network=Network(40790864-a5db-4f62-adde-28ee0dc256cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21163c28-d7') {{(pid=74190) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 11:45:12 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:12 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:45:12 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 11:45:12 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:12 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4bb5c835-874f-5a51-b9d7-776327462e61', '_type': 'linux-noop'}}, row=False) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:45:12 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:12 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:45:12 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:12 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:12 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap21163c28-d7, may_exist=True, interface_attrs={}) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:45:12 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap21163c28-d7, col_values=(('qos', UUID('41d69f07-99f8-4726-84e7-c5d0d607469f')),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:45:12 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap21163c28-d7, col_values=(('external_ids', {'iface-id': '21163c28-d799-420c-96b5-6ea0e829dc93', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d8:31:38', 'vm-uuid': 'aabb5eea-8366-482a-8d16-bf271c0fe8d7'}),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:45:12 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:12 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:45:12 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:12 user nova-compute[74190]: INFO os_vif [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:31:38,bridge_name='br-int',has_traffic_filtering=True,id=21163c28-d799-420c-96b5-6ea0e829dc93,network=Network(40790864-a5db-4f62-adde-28ee0dc256cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21163c28-d7')
Oct 18 11:45:12 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] No BDM found with device name vda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 11:45:12 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] No VIF found with MAC fa:16:3e:d8:31:38, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 11:45:13 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:13 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:13 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:13 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:14 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:14 user nova-compute[74190]: DEBUG nova.compute.manager [req-39c58213-8e40-4074-a355-12bfdc375030 req-4fdbd591-2192-44a4-a82c-ce056591414c service nova] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Received event network-vif-plugged-21163c28-d799-420c-96b5-6ea0e829dc93 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:45:14 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-39c58213-8e40-4074-a355-12bfdc375030 req-4fdbd591-2192-44a4-a82c-ce056591414c service nova] Acquiring lock "aabb5eea-8366-482a-8d16-bf271c0fe8d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:45:14 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-39c58213-8e40-4074-a355-12bfdc375030 req-4fdbd591-2192-44a4-a82c-ce056591414c service nova] Lock "aabb5eea-8366-482a-8d16-bf271c0fe8d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:45:14 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-39c58213-8e40-4074-a355-12bfdc375030 req-4fdbd591-2192-44a4-a82c-ce056591414c service nova] Lock "aabb5eea-8366-482a-8d16-bf271c0fe8d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:45:14 user nova-compute[74190]: DEBUG nova.compute.manager [req-39c58213-8e40-4074-a355-12bfdc375030 req-4fdbd591-2192-44a4-a82c-ce056591414c service nova] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] No waiting events found dispatching network-vif-plugged-21163c28-d799-420c-96b5-6ea0e829dc93 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:45:14 user nova-compute[74190]: WARNING nova.compute.manager [req-39c58213-8e40-4074-a355-12bfdc375030 req-4fdbd591-2192-44a4-a82c-ce056591414c service nova] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Received unexpected event network-vif-plugged-21163c28-d799-420c-96b5-6ea0e829dc93 for instance with vm_state active and task_state rebuild_spawning.
Oct 18 11:45:14 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:14 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:14 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:14 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:14 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:16 user nova-compute[74190]: DEBUG nova.compute.manager [req-8f913990-5897-436b-abb2-473aaec094d0 req-ff2e65fd-a383-4b70-9634-9c78452d2420 service nova] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Received event network-vif-plugged-21163c28-d799-420c-96b5-6ea0e829dc93 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:45:16 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-8f913990-5897-436b-abb2-473aaec094d0 req-ff2e65fd-a383-4b70-9634-9c78452d2420 service nova] Acquiring lock "aabb5eea-8366-482a-8d16-bf271c0fe8d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:45:16 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-8f913990-5897-436b-abb2-473aaec094d0 req-ff2e65fd-a383-4b70-9634-9c78452d2420 service nova] Lock "aabb5eea-8366-482a-8d16-bf271c0fe8d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:45:16 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-8f913990-5897-436b-abb2-473aaec094d0 req-ff2e65fd-a383-4b70-9634-9c78452d2420 service nova] Lock "aabb5eea-8366-482a-8d16-bf271c0fe8d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:45:16 user nova-compute[74190]: DEBUG nova.compute.manager [req-8f913990-5897-436b-abb2-473aaec094d0 req-ff2e65fd-a383-4b70-9634-9c78452d2420 service nova] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] No waiting events found dispatching network-vif-plugged-21163c28-d799-420c-96b5-6ea0e829dc93 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:45:16 user nova-compute[74190]: WARNING nova.compute.manager [req-8f913990-5897-436b-abb2-473aaec094d0 req-ff2e65fd-a383-4b70-9634-9c78452d2420 service nova] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Received unexpected event network-vif-plugged-21163c28-d799-420c-96b5-6ea0e829dc93 for instance with vm_state active and task_state rebuild_spawning.
Oct 18 11:45:16 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:45:16 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:45:16 user nova-compute[74190]: DEBUG nova.objects.instance [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Lazy-loading 'pci_requests' on Instance uuid 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:45:16 user nova-compute[74190]: DEBUG nova.objects.instance [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Lazy-loading 'numa_topology' on Instance uuid 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:45:16 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74190) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 11:45:16 user nova-compute[74190]: INFO nova.compute.claims [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Claim successful on node user
Oct 18 11:45:16 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 11:45:16 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 11:45:16 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.567s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:45:16 user nova-compute[74190]: INFO nova.network.neutron [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Updating port 8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 18 11:45:16 user nova-compute[74190]: DEBUG nova.compute.manager [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Instance event wait completed in 0 seconds for  {{(pid=74190) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 11:45:16 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Guest created on hypervisor {{(pid=74190) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 11:45:16 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Instance spawned successfully.
Oct 18 11:45:16 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 11:45:16 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Found default for hw_cdrom_bus of ide {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:45:16 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Found default for hw_disk_bus of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:45:16 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Found default for hw_input_bus of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:45:16 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Found default for hw_pointer_model of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:45:16 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Found default for hw_video_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:45:16 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Found default for hw_vif_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:45:17 user nova-compute[74190]: DEBUG nova.compute.manager [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Checking state {{(pid=74190) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 11:45:17 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:45:17 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:45:17 user nova-compute[74190]: DEBUG nova.objects.instance [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74190) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1078}}
Oct 18 11:45:17 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-8603ba55-10bb-42b7-beca-1903b579cf2c tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.099s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:45:17 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:17 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Acquiring lock "refresh_cache-3c3cce66-9d7a-4f23-a92a-d10b3efd5e86" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:45:17 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Acquired lock "refresh_cache-3c3cce66-9d7a-4f23-a92a-d10b3efd5e86" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:45:17 user nova-compute[74190]: DEBUG nova.network.neutron [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Building network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 11:45:17 user nova-compute[74190]: DEBUG nova.compute.manager [req-469315a9-661f-457d-9dec-e3a36ca9fee9 req-a94d8b7f-9f0c-44a1-b2cb-e032361b77e2 service nova] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Received event network-changed-8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:45:17 user nova-compute[74190]: DEBUG nova.compute.manager [req-469315a9-661f-457d-9dec-e3a36ca9fee9 req-a94d8b7f-9f0c-44a1-b2cb-e032361b77e2 service nova] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Refreshing instance network info cache due to event network-changed-8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 11:45:17 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-469315a9-661f-457d-9dec-e3a36ca9fee9 req-a94d8b7f-9f0c-44a1-b2cb-e032361b77e2 service nova] Acquiring lock "refresh_cache-3c3cce66-9d7a-4f23-a92a-d10b3efd5e86" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:45:17 user nova-compute[74190]: DEBUG nova.network.neutron [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Updating instance_info_cache with network_info: [{"id": "8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9", "address": "fa:16:3e:93:46:f1", "network": {"id": "e6ae8edc-7014-4341-91b2-4c82d72c9bb9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-15434410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548640fa718f4fdfa21c1a7783519c9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d891e1d-9d", "ovs_interfaceid": "8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:45:17 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Releasing lock "refresh_cache-3c3cce66-9d7a-4f23-a92a-d10b3efd5e86" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:45:17 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Creating instance directory {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 11:45:17 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Creating image(s)
Oct 18 11:45:17 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Acquiring lock "/opt/stack/data/nova/instances/3c3cce66-9d7a-4f23-a92a-d10b3efd5e86/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:45:17 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Lock "/opt/stack/data/nova/instances/3c3cce66-9d7a-4f23-a92a-d10b3efd5e86/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:45:17 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Lock "/opt/stack/data/nova/instances/3c3cce66-9d7a-4f23-a92a-d10b3efd5e86/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:45:17 user nova-compute[74190]: DEBUG nova.objects.instance [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:45:17 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-469315a9-661f-457d-9dec-e3a36ca9fee9 req-a94d8b7f-9f0c-44a1-b2cb-e032361b77e2 service nova] Acquired lock "refresh_cache-3c3cce66-9d7a-4f23-a92a-d10b3efd5e86" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:45:17 user nova-compute[74190]: DEBUG nova.network.neutron [req-469315a9-661f-457d-9dec-e3a36ca9fee9 req-a94d8b7f-9f0c-44a1-b2cb-e032361b77e2 service nova] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Refreshing network info cache for port 8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9 {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 11:45:18 user nova-compute[74190]: DEBUG nova.objects.base [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Object Instance<3c3cce66-9d7a-4f23-a92a-d10b3efd5e86> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74190) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 11:45:18 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Acquiring lock "938199af668ae7cf2361688e6fe7cbbbeb8ee8ad" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:45:18 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Lock "938199af668ae7cf2361688e6fe7cbbbeb8ee8ad" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:45:19 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/938199af668ae7cf2361688e6fe7cbbbeb8ee8ad.part --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:45:19 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:19 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/938199af668ae7cf2361688e6fe7cbbbeb8ee8ad.part --force-share --output=json" returned: 0 in 0.198s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:45:19 user nova-compute[74190]: DEBUG nova.virt.images [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] 549de22b-33ca-4291-a665-7a3504b7d6a1 was qcow2, converting to raw {{(pid=74190) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 18 11:45:19 user nova-compute[74190]: DEBUG nova.privsep.utils [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74190) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 18 11:45:19 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/938199af668ae7cf2361688e6fe7cbbbeb8ee8ad.part /opt/stack/data/nova/instances/_base/938199af668ae7cf2361688e6fe7cbbbeb8ee8ad.converted {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:45:19 user nova-compute[74190]: DEBUG nova.network.neutron [req-469315a9-661f-457d-9dec-e3a36ca9fee9 req-a94d8b7f-9f0c-44a1-b2cb-e032361b77e2 service nova] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Updated VIF entry in instance network info cache for port 8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 11:45:19 user nova-compute[74190]: DEBUG nova.network.neutron [req-469315a9-661f-457d-9dec-e3a36ca9fee9 req-a94d8b7f-9f0c-44a1-b2cb-e032361b77e2 service nova] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Updating instance_info_cache with network_info: [{"id": "8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9", "address": "fa:16:3e:93:46:f1", "network": {"id": "e6ae8edc-7014-4341-91b2-4c82d72c9bb9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-15434410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548640fa718f4fdfa21c1a7783519c9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d891e1d-9d", "ovs_interfaceid": "8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:45:19 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-469315a9-661f-457d-9dec-e3a36ca9fee9 req-a94d8b7f-9f0c-44a1-b2cb-e032361b77e2 service nova] Releasing lock "refresh_cache-3c3cce66-9d7a-4f23-a92a-d10b3efd5e86" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:45:19 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/938199af668ae7cf2361688e6fe7cbbbeb8ee8ad.part /opt/stack/data/nova/instances/_base/938199af668ae7cf2361688e6fe7cbbbeb8ee8ad.converted" returned: 0 in 0.440s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:45:19 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/938199af668ae7cf2361688e6fe7cbbbeb8ee8ad.converted --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:45:19 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/938199af668ae7cf2361688e6fe7cbbbeb8ee8ad.converted --force-share --output=json" returned: 0 in 0.212s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:45:19 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Lock "938199af668ae7cf2361688e6fe7cbbbeb8ee8ad" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.944s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:45:19 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/938199af668ae7cf2361688e6fe7cbbbeb8ee8ad --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:45:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/938199af668ae7cf2361688e6fe7cbbbeb8ee8ad --force-share --output=json" returned: 0 in 0.217s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:45:20 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Acquiring lock "938199af668ae7cf2361688e6fe7cbbbeb8ee8ad" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:45:20 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Lock "938199af668ae7cf2361688e6fe7cbbbeb8ee8ad" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:45:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/938199af668ae7cf2361688e6fe7cbbbeb8ee8ad --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:45:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/938199af668ae7cf2361688e6fe7cbbbeb8ee8ad --force-share --output=json" returned: 0 in 0.212s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:45:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/938199af668ae7cf2361688e6fe7cbbbeb8ee8ad,backing_fmt=raw /opt/stack/data/nova/instances/3c3cce66-9d7a-4f23-a92a-d10b3efd5e86/disk 1073741824 {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:45:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/938199af668ae7cf2361688e6fe7cbbbeb8ee8ad,backing_fmt=raw /opt/stack/data/nova/instances/3c3cce66-9d7a-4f23-a92a-d10b3efd5e86/disk 1073741824" returned: 0 in 0.059s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:45:20 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Lock "938199af668ae7cf2361688e6fe7cbbbeb8ee8ad" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.279s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:45:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/938199af668ae7cf2361688e6fe7cbbbeb8ee8ad --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:45:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/938199af668ae7cf2361688e6fe7cbbbeb8ee8ad --force-share --output=json" returned: 0 in 0.201s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:45:20 user nova-compute[74190]: DEBUG nova.objects.instance [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Lazy-loading 'migration_context' on Instance uuid 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:45:20 user nova-compute[74190]: DEBUG nova.objects.base [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Object Instance<3c3cce66-9d7a-4f23-a92a-d10b3efd5e86> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74190) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 11:45:20 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Rebasing disk image.
Oct 18 11:45:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:45:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.186s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:45:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f -F raw /opt/stack/data/nova/instances/3c3cce66-9d7a-4f23-a92a-d10b3efd5e86/disk {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:45:22 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:23 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f -F raw /opt/stack/data/nova/instances/3c3cce66-9d7a-4f23-a92a-d10b3efd5e86/disk" returned: 0 in 2.232s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:45:23 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Created local disks {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 11:45:23 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Ensure instance console log exists: /opt/stack/data/nova/instances/3c3cce66-9d7a-4f23-a92a-d10b3efd5e86/console.log {{(pid=74190) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 11:45:23 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:45:23 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:45:23 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:45:23 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Start _get_guest_xml network_info=[{"id": "8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9", "address": "fa:16:3e:93:46:f1", "network": {"id": "e6ae8edc-7014-4341-91b2-4c82d72c9bb9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-15434410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548640fa718f4fdfa21c1a7783519c9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d891e1d-9d", "ovs_interfaceid": "8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='2fe26f0d1cf2a19102f4724a12cfd3d3',container_format='bare',created_at=2023-10-18T11:43:02Z,direct_url=<?>,disk_format='qcow2',id=549de22b-33ca-4291-a665-7a3504b7d6a1,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-483118733-shelved',owner='548640fa718f4fdfa21c1a7783519c9f',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-18T11:43:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'image_id': '6e88bbf0-6e78-49a8-b3c5-9453d22a89df'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'device_type': 'disk', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ed247316-68aa-443b-90b8-b42632ce1a86', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HLsNRbcj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '3c3cce66-9d7a-4f23-a92a-d10b3efd5e86', 'attached_at': '', 'detached_at': '', 'volume_id': 'ed247316-68aa-443b-90b8-b42632ce1a86', 'serial': 'ed247316-68aa-443b-90b8-b42632ce1a86'}, 'delete_on_termination': False, 'guest_format': None, 'attachment_id': 'c8e92cf0-ed5f-4305-87f9-c9a932176c89', 'volume_type': None} {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 11:45:23 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:45:23 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:45:23 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 11:45:23 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] CPU controller missing on host. {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 11:45:23 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 11:45:23 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] CPU controller found on host. {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 11:45:23 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74190) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 11:45:23 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T11:37:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='2fe26f0d1cf2a19102f4724a12cfd3d3',container_format='bare',created_at=2023-10-18T11:43:02Z,direct_url=<?>,disk_format='qcow2',id=549de22b-33ca-4291-a665-7a3504b7d6a1,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-483118733-shelved',owner='548640fa718f4fdfa21c1a7783519c9f',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-18T11:43:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 11:45:23 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Flavor limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 11:45:23 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Image limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 11:45:23 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Flavor pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 11:45:23 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Image pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 11:45:23 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 11:45:23 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 11:45:23 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 11:45:23 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Got 1 possible topologies {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 11:45:23 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 11:45:23 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 11:45:23 user nova-compute[74190]: DEBUG nova.objects.instance [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:45:23 user nova-compute[74190]: DEBUG nova.objects.base [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Object Instance<3c3cce66-9d7a-4f23-a92a-d10b3efd5e86> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74190) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 11:45:23 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Calling os-brick to attach iSCSI Volume {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 11:45:23 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ed247316-68aa-443b-90b8-b42632ce1a86', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HLsNRbcj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:45:23 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:45:23 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:45:23 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:45:23 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:45:23 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed247316-68aa-443b-90b8-b42632ce1a86" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:45:23 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed247316-68aa-443b-90b8-b42632ce1a86" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:45:23 user nova-compute[74190]: INFO os_brick.initiator.connectors.iscsi [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 11:45:23 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed247316-68aa-443b-90b8-b42632ce1a86 -p 172.16.0.220:3260 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:45:23 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed247316-68aa-443b-90b8-b42632ce1a86 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:45:23 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[72464cfb-cc6e-4a0a-a1fe-404d39f34fb5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:45:23 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 11:45:23 user nova-compute[74190]:  {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:45:23 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed247316-68aa-443b-90b8-b42632ce1a86 -p 172.16.0.220:3260 --interface default --op new {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:45:23 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed247316-68aa-443b-90b8-b42632ce1a86 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:45:23 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[80252104-9c5b-428e-b43d-bb31cbc4444d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ed247316-68aa-443b-90b8-b42632ce1a86] added\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:45:23 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ed247316-68aa-443b-90b8-b42632ce1a86] added
Oct 18 11:45:23 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:45:23 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed247316-68aa-443b-90b8-b42632ce1a86 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:45:23 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed247316-68aa-443b-90b8-b42632ce1a86 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:45:23 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c2fefde-fe71-40ae-a170-32d3cbb8ea8c]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:45:23 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:45:23 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed247316-68aa-443b-90b8-b42632ce1a86 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:45:23 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed247316-68aa-443b-90b8-b42632ce1a86 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:45:23 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f218174-109d-413f-adb6-399ccab6f4f9]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:45:23 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:45:23 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed247316-68aa-443b-90b8-b42632ce1a86 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HLsNRbcj {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:45:23 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed247316-68aa-443b-90b8-b42632ce1a86 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HLsNRbcj" returned: 0 in 0.022s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:45:23 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[d46ffb1d-435c-4d8a-a9e3-c4bd854b0dd1]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:45:23 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HLsNRbcj'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:45:23 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed247316-68aa-443b-90b8-b42632ce1a86 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:45:23 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed247316-68aa-443b-90b8-b42632ce1a86 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.057s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:45:23 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f09305-7c2c-448e-835a-177e00f9bb2f]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:45:23 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:45:23 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:45:23 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.090s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:45:23 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[2086a57f-b8c3-4e56-bef6-011144601499]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:45:23 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920 (non-flash)
Oct 18 11:45:23 user nova-compute[74190]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)
Oct 18 11:45:23 user nova-compute[74190]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)
Oct 18 11:45:23 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:45:23 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920 (non-flash)
Oct 18 11:45:23 user nova-compute[74190]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)
Oct 18 11:45:23 user nova-compute[74190]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)
Oct 18 11:45:23 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:45:23 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed247316-68aa-443b-90b8-b42632ce1a86 -p 172.16.0.220:3260 --login {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:45:23 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed247316-68aa-443b-90b8-b42632ce1a86 -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:45:23 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[588dc25f-362c-44c4-8cee-ea3f55e4e2a2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ed247316-68aa-443b-90b8-b42632ce1a86, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ed247316-68aa-443b-90b8-b42632ce1a86, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:45:23 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ed247316-68aa-443b-90b8-b42632ce1a86, portal: 172.16.0.220,3260]
Oct 18 11:45:23 user nova-compute[74190]: Login to [iface: default, target: iqn.2010-10.org.openstack:ed247316-68aa-443b-90b8-b42632ce1a86, portal: 172.16.0.220,3260] successful.
Oct 18 11:45:23 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:45:23 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed247316-68aa-443b-90b8-b42632ce1a86 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:45:23 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed247316-68aa-443b-90b8-b42632ce1a86 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:45:23 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[f24c3e4a-0d47-4a0f-8e73-509ebbc248c7]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:45:23 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:45:23 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:45:23 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:45:23 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd743b1-6474-4749-b11e-1d8e47dc6f82]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed247316-68aa-443b-90b8-b42632ce1a86 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:45:23 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920 (non-flash)
Oct 18 11:45:23 user nova-compute[74190]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)
Oct 18 11:45:23 user nova-compute[74190]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed247316-68aa-443b-90b8-b42632ce1a86 (non-flash)
Oct 18 11:45:23 user nova-compute[74190]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)
Oct 18 11:45:23 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:45:23 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920 (non-flash)
Oct 18 11:45:23 user nova-compute[74190]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)
Oct 18 11:45:23 user nova-compute[74190]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed247316-68aa-443b-90b8-b42632ce1a86 (non-flash)
Oct 18 11:45:23 user nova-compute[74190]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)
Oct 18 11:45:23 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:45:23 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed247316-68aa-443b-90b8-b42632ce1a86" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.443s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:45:23 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Connected to 172.16.0.220:3260 {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 11:45:23 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] HCTL ('34', '-', '-', 0) found on session 13 with lun 0 {{(pid=74190) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 11:45:23 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74190) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 11:45:23 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:45:23 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:45:23 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3cd67fc-b04e-424f-9d3a-be1d77a2cc01]: (4, ('- - 0', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:45:23 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Searching for a device in session 13 and hctl ['34', '*', '*', 0] yield: None {{(pid=74190) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 11:45:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:24 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Searching for a device in session 13 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74190) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 11:45:24 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ed247316-68aa-443b-90b8-b42632ce1a86', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HLsNRbcj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 11:45:24 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.480s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:45:24 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] <== connect_volume: return (1482ms) {'type': 'block', 'scsi_wwn': '23437353535343333', 'path': '/dev/sdc'} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:45:24 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23437353535343333', 'path': '/dev/sdc'} {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 11:45:24 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-18T11:41:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-483118733',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-483118733',id=2,image_ref='549de22b-33ca-4291-a665-7a3504b7d6a1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-576336985',keypairs=<?>,launch_index=0,launched_at=2023-10-18T11:41:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='548640fa718f4fdfa21c1a7783519c9f',ramdisk_id='',reservation_id='r-2fa6tit7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-83921126',owner_user_name='tempest-AttachVolumeShelveTestJSON-83921126-project-member',shelved_at='2023-10-18T11:43:06.799122',shelved_host='user',shelved_image_id='549de22b-33ca-4291-a665-7a3504b7d6a1'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:44:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='829b310c15b54dc7836d0b9d7fd757ed',uuid=3c3cce66-9d7a-4f23-a92a-d10b3efd5e86,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9", "address": "fa:16:3e:93:46:f1", "network": {"id": "e6ae8edc-7014-4341-91b2-4c82d72c9bb9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-15434410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548640fa718f4fdfa21c1a7783519c9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d891e1d-9d", "ovs_interfaceid": "8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74190) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 11:45:24 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Converting VIF {"id": "8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9", "address": "fa:16:3e:93:46:f1", "network": {"id": "e6ae8edc-7014-4341-91b2-4c82d72c9bb9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-15434410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548640fa718f4fdfa21c1a7783519c9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d891e1d-9d", "ovs_interfaceid": "8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:45:24 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:46:f1,bridge_name='br-int',has_traffic_filtering=True,id=8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9,network=Network(e6ae8edc-7014-4341-91b2-4c82d72c9bb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d891e1d-9d') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:45:24 user nova-compute[74190]: DEBUG nova.objects.instance [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Lazy-loading 'pci_devices' on Instance uuid 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:45:24 user nova-compute[74190]: DEBUG nova.objects.base [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Object Instance<3c3cce66-9d7a-4f23-a92a-d10b3efd5e86> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74190) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 11:45:24 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] End _get_guest_xml xml=<domain type="kvm">
Oct 18 11:45:24 user nova-compute[74190]:   <uuid>3c3cce66-9d7a-4f23-a92a-d10b3efd5e86</uuid>
Oct 18 11:45:24 user nova-compute[74190]:   <name>instance-00000002</name>
Oct 18 11:45:24 user nova-compute[74190]:   <memory>524288</memory>
Oct 18 11:45:24 user nova-compute[74190]:   <vcpu>1</vcpu>
Oct 18 11:45:24 user nova-compute[74190]:   <metadata>
Oct 18 11:45:24 user nova-compute[74190]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 11:45:24 user nova-compute[74190]:       <nova:package version="0.0.0"/>
Oct 18 11:45:24 user nova-compute[74190]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-483118733</nova:name>
Oct 18 11:45:24 user nova-compute[74190]:       <nova:creationTime>2023-10-18 11:45:23</nova:creationTime>
Oct 18 11:45:24 user nova-compute[74190]:       <nova:flavor name="m1.tiny">
Oct 18 11:45:24 user nova-compute[74190]:         <nova:memory>512</nova:memory>
Oct 18 11:45:24 user nova-compute[74190]:         <nova:disk>1</nova:disk>
Oct 18 11:45:24 user nova-compute[74190]:         <nova:swap>0</nova:swap>
Oct 18 11:45:24 user nova-compute[74190]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 11:45:24 user nova-compute[74190]:         <nova:vcpus>1</nova:vcpus>
Oct 18 11:45:24 user nova-compute[74190]:       </nova:flavor>
Oct 18 11:45:24 user nova-compute[74190]:       <nova:owner>
Oct 18 11:45:24 user nova-compute[74190]:         <nova:user uuid="829b310c15b54dc7836d0b9d7fd757ed">tempest-AttachVolumeShelveTestJSON-83921126-project-member</nova:user>
Oct 18 11:45:24 user nova-compute[74190]:         <nova:project uuid="548640fa718f4fdfa21c1a7783519c9f">tempest-AttachVolumeShelveTestJSON-83921126</nova:project>
Oct 18 11:45:24 user nova-compute[74190]:       </nova:owner>
Oct 18 11:45:24 user nova-compute[74190]:       <nova:root type="image" uuid="549de22b-33ca-4291-a665-7a3504b7d6a1"/>
Oct 18 11:45:24 user nova-compute[74190]:       <nova:ports>
Oct 18 11:45:24 user nova-compute[74190]:         <nova:port uuid="8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9">
Oct 18 11:45:24 user nova-compute[74190]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 18 11:45:24 user nova-compute[74190]:         </nova:port>
Oct 18 11:45:24 user nova-compute[74190]:       </nova:ports>
Oct 18 11:45:24 user nova-compute[74190]:     </nova:instance>
Oct 18 11:45:24 user nova-compute[74190]:   </metadata>
Oct 18 11:45:24 user nova-compute[74190]:   <sysinfo type="smbios">
Oct 18 11:45:24 user nova-compute[74190]:     <system>
Oct 18 11:45:24 user nova-compute[74190]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 11:45:24 user nova-compute[74190]:       <entry name="product">OpenStack Nova</entry>
Oct 18 11:45:24 user nova-compute[74190]:       <entry name="version">0.0.0</entry>
Oct 18 11:45:24 user nova-compute[74190]:       <entry name="serial">3c3cce66-9d7a-4f23-a92a-d10b3efd5e86</entry>
Oct 18 11:45:24 user nova-compute[74190]:       <entry name="uuid">3c3cce66-9d7a-4f23-a92a-d10b3efd5e86</entry>
Oct 18 11:45:24 user nova-compute[74190]:       <entry name="family">Virtual Machine</entry>
Oct 18 11:45:24 user nova-compute[74190]:     </system>
Oct 18 11:45:24 user nova-compute[74190]:   </sysinfo>
Oct 18 11:45:24 user nova-compute[74190]:   <os>
Oct 18 11:45:24 user nova-compute[74190]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 11:45:24 user nova-compute[74190]:     <boot dev="hd"/>
Oct 18 11:45:24 user nova-compute[74190]:     <smbios mode="sysinfo"/>
Oct 18 11:45:24 user nova-compute[74190]:   </os>
Oct 18 11:45:24 user nova-compute[74190]:   <features>
Oct 18 11:45:24 user nova-compute[74190]:     <acpi/>
Oct 18 11:45:24 user nova-compute[74190]:     <apic/>
Oct 18 11:45:24 user nova-compute[74190]:     <vmcoreinfo/>
Oct 18 11:45:24 user nova-compute[74190]:   </features>
Oct 18 11:45:24 user nova-compute[74190]:   <clock offset="utc">
Oct 18 11:45:24 user nova-compute[74190]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 11:45:24 user nova-compute[74190]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 11:45:24 user nova-compute[74190]:     <timer name="hpet" present="no"/>
Oct 18 11:45:24 user nova-compute[74190]:   </clock>
Oct 18 11:45:24 user nova-compute[74190]:   <cpu mode="custom" match="exact">
Oct 18 11:45:24 user nova-compute[74190]:     <model>Nehalem</model>
Oct 18 11:45:24 user nova-compute[74190]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 11:45:24 user nova-compute[74190]:   </cpu>
Oct 18 11:45:24 user nova-compute[74190]:   <devices>
Oct 18 11:45:24 user nova-compute[74190]:     <disk type="file" device="disk">
Oct 18 11:45:24 user nova-compute[74190]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 11:45:24 user nova-compute[74190]:       <source file="/opt/stack/data/nova/instances/3c3cce66-9d7a-4f23-a92a-d10b3efd5e86/disk"/>
Oct 18 11:45:24 user nova-compute[74190]:       <target dev="vda" bus="virtio"/>
Oct 18 11:45:24 user nova-compute[74190]:     </disk>
Oct 18 11:45:24 user nova-compute[74190]:     <disk type="block" device="disk">
Oct 18 11:45:24 user nova-compute[74190]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 11:45:24 user nova-compute[74190]:       <source dev="/dev/sdc"/>
Oct 18 11:45:24 user nova-compute[74190]:       <target dev="vdc" bus="virtio"/>
Oct 18 11:45:24 user nova-compute[74190]:       <serial>ed247316-68aa-443b-90b8-b42632ce1a86</serial>
Oct 18 11:45:24 user nova-compute[74190]:     </disk>
Oct 18 11:45:24 user nova-compute[74190]:     <interface type="ethernet">
Oct 18 11:45:24 user nova-compute[74190]:       <mac address="fa:16:3e:93:46:f1"/>
Oct 18 11:45:24 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:45:24 user nova-compute[74190]:       <mtu size="1442"/>
Oct 18 11:45:24 user nova-compute[74190]:       <target dev="tap8d891e1d-9d"/>
Oct 18 11:45:24 user nova-compute[74190]:     </interface>
Oct 18 11:45:24 user nova-compute[74190]:     <serial type="pty">
Oct 18 11:45:24 user nova-compute[74190]:       <log file="/opt/stack/data/nova/instances/3c3cce66-9d7a-4f23-a92a-d10b3efd5e86/console.log" append="off"/>
Oct 18 11:45:24 user nova-compute[74190]:     </serial>
Oct 18 11:45:24 user nova-compute[74190]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 11:45:24 user nova-compute[74190]:     <video>
Oct 18 11:45:24 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:45:24 user nova-compute[74190]:     </video>
Oct 18 11:45:24 user nova-compute[74190]:     <rng model="virtio">
Oct 18 11:45:24 user nova-compute[74190]:       <backend model="random">/dev/urandom</backend>
Oct 18 11:45:24 user nova-compute[74190]:     </rng>
Oct 18 11:45:24 user nova-compute[74190]:     <controller type="usb" index="0" model="none"/>
Oct 18 11:45:24 user nova-compute[74190]:     <memballoon model="virtio">
Oct 18 11:45:24 user nova-compute[74190]:       <stats period="10"/>
Oct 18 11:45:24 user nova-compute[74190]:     </memballoon>
Oct 18 11:45:24 user nova-compute[74190]:   </devices>
Oct 18 11:45:24 user nova-compute[74190]: </domain>
Oct 18 11:45:24 user nova-compute[74190]:  {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 11:45:24 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-18T11:41:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-483118733',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-483118733',id=2,image_ref='549de22b-33ca-4291-a665-7a3504b7d6a1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-576336985',keypairs=<?>,launch_index=0,launched_at=2023-10-18T11:41:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='548640fa718f4fdfa21c1a7783519c9f',ramdisk_id='',reservation_id='r-2fa6tit7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-83921126',owner_user_name='tempest-AttachVolumeShelveTestJSON-83921126-project-member',shelved_at='2023-10-18T11:43:06.799122',shelved_host='user',shelved_image_id='549de22b-33ca-4291-a665-7a3504b7d6a1'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:44:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='829b310c15b54dc7836d0b9d7fd757ed',uuid=3c3cce66-9d7a-4f23-a92a-d10b3efd5e86,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9", "address": "fa:16:3e:93:46:f1", "network": {"id": "e6ae8edc-7014-4341-91b2-4c82d72c9bb9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-15434410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548640fa718f4fdfa21c1a7783519c9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d891e1d-9d", "ovs_interfaceid": "8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 11:45:24 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Converting VIF {"id": "8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9", "address": "fa:16:3e:93:46:f1", "network": {"id": "e6ae8edc-7014-4341-91b2-4c82d72c9bb9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-15434410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548640fa718f4fdfa21c1a7783519c9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d891e1d-9d", "ovs_interfaceid": "8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:45:24 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:46:f1,bridge_name='br-int',has_traffic_filtering=True,id=8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9,network=Network(e6ae8edc-7014-4341-91b2-4c82d72c9bb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d891e1d-9d') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:45:24 user nova-compute[74190]: DEBUG os_vif [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:46:f1,bridge_name='br-int',has_traffic_filtering=True,id=8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9,network=Network(e6ae8edc-7014-4341-91b2-4c82d72c9bb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d891e1d-9d') {{(pid=74190) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 11:45:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:45:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 11:45:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '044b497e-8b10-5994-866b-86a33ec58905', '_type': 'linux-noop'}}, row=False) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:45:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:45:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8d891e1d-9d, may_exist=True, interface_attrs={}) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:45:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8d891e1d-9d, col_values=(('qos', UUID('f425f089-07d2-42a1-843f-e3f2def4cb74')),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:45:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8d891e1d-9d, col_values=(('external_ids', {'iface-id': '8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:93:46:f1', 'vm-uuid': '3c3cce66-9d7a-4f23-a92a-d10b3efd5e86'}),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:45:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:45:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:24 user nova-compute[74190]: INFO os_vif [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:46:f1,bridge_name='br-int',has_traffic_filtering=True,id=8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9,network=Network(e6ae8edc-7014-4341-91b2-4c82d72c9bb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d891e1d-9d')
Oct 18 11:45:24 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] No BDM found with device name vda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 11:45:24 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 11:45:24 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] No VIF found with MAC fa:16:3e:93:46:f1, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 11:45:25 user nova-compute[74190]: DEBUG nova.objects.instance [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lazy-loading 'flavor' on Instance uuid c280652c-ffde-40f8-a919-adb8be618db8 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:45:25 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Acquiring lock "refresh_cache-c280652c-ffde-40f8-a919-adb8be618db8" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:45:25 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Acquired lock "refresh_cache-c280652c-ffde-40f8-a919-adb8be618db8" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:45:25 user nova-compute[74190]: DEBUG nova.network.neutron [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Building network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 11:45:25 user nova-compute[74190]: DEBUG nova.objects.instance [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lazy-loading 'info_cache' on Instance uuid c280652c-ffde-40f8-a919-adb8be618db8 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:45:25 user nova-compute[74190]: DEBUG nova.objects.base [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Object Instance<c280652c-ffde-40f8-a919-adb8be618db8> lazy-loaded attributes: flavor,info_cache {{(pid=74190) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 11:45:25 user nova-compute[74190]: DEBUG nova.network.neutron [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Updating instance_info_cache with network_info: [{"id": "80b77e2d-aa04-4996-a0c1-713054affac4", "address": "fa:16:3e:4f:00:ce", "network": {"id": "cf0a4705-3fff-4716-87ac-b0ca7700e11c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1739631852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cf8d4d4f504e82868ed295e054644c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80b77e2d-aa", "ovs_interfaceid": "80b77e2d-aa04-4996-a0c1-713054affac4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:45:25 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Releasing lock "refresh_cache-c280652c-ffde-40f8-a919-adb8be618db8" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:45:26 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Instance destroyed successfully.
Oct 18 11:45:26 user nova-compute[74190]: DEBUG nova.objects.instance [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lazy-loading 'resources' on Instance uuid c280652c-ffde-40f8-a919-adb8be618db8 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG nova.objects.base [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Object Instance<c280652c-ffde-40f8-a919-adb8be618db8> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74190) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:40:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-711461105',display_name='tempest-AttachVolumeTestJSON-server-711461105',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-711461105',id=1,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPnE2mtL+LbI3yVW2kYaN2Dxz5V1+PIccsOPxNaLovIe8VN7EUmA+C39USstHm9Yifnik7GFCenLhGnFytwIhcv6ox30HzhlwfaoDrZEfYtFLQ2I1/Og7nqCIt/6qIOiKA==',key_name='tempest-keypair-355856933',keypairs=<?>,launch_index=0,launched_at=2023-10-18T11:41:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='99cf8d4d4f504e82868ed295e054644c',ramdisk_id='',reservation_id='r-zf27bcaw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2125017306',owner_user_name='tempest-AttachVolumeTestJSON-2125017306-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T11:43:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='852309a19f1b4d49a4974c3be53f67cb',uuid=c280652c-ffde-40f8-a919-adb8be618db8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "80b77e2d-aa04-4996-a0c1-713054affac4", "address": "fa:16:3e:4f:00:ce", "network": {"id": "cf0a4705-3fff-4716-87ac-b0ca7700e11c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1739631852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cf8d4d4f504e82868ed295e054644c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80b77e2d-aa", "ovs_interfaceid": "80b77e2d-aa04-4996-a0c1-713054affac4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Converting VIF {"id": "80b77e2d-aa04-4996-a0c1-713054affac4", "address": "fa:16:3e:4f:00:ce", "network": {"id": "cf0a4705-3fff-4716-87ac-b0ca7700e11c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1739631852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cf8d4d4f504e82868ed295e054644c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80b77e2d-aa", "ovs_interfaceid": "80b77e2d-aa04-4996-a0c1-713054affac4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:00:ce,bridge_name='br-int',has_traffic_filtering=True,id=80b77e2d-aa04-4996-a0c1-713054affac4,network=Network(cf0a4705-3fff-4716-87ac-b0ca7700e11c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80b77e2d-aa') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG os_vif [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:00:ce,bridge_name='br-int',has_traffic_filtering=True,id=80b77e2d-aa04-4996-a0c1-713054affac4,network=Network(cf0a4705-3fff-4716-87ac-b0ca7700e11c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80b77e2d-aa') {{(pid=74190) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap80b77e2d-aa, bridge=br-int, if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5712a6ad-0364-40b8-89a5-f16b60d146fb) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:26 user nova-compute[74190]: INFO os_vif [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:00:ce,bridge_name='br-int',has_traffic_filtering=True,id=80b77e2d-aa04-4996-a0c1-713054affac4,network=Network(cf0a4705-3fff-4716-87ac-b0ca7700e11c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80b77e2d-aa')
Oct 18 11:45:26 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: c280652c-ffde-40f8-a919-adb8be618db8] calling os-brick to detach iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, {'target_iqn': 'iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tNhfvoBT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:45:26 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:45:26 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[95822cc7-5d2e-45a1-ad1b-044b295fc25f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ed247316-68aa-443b-90b8-b42632ce1a86\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 11:45:26 user nova-compute[74190]: No targets found.
Oct 18 11:45:26 user nova-compute[74190]: iSNS:
Oct 18 11:45:26 user nova-compute[74190]: No targets found.
Oct 18 11:45:26 user nova-compute[74190]: STATIC:
Oct 18 11:45:26 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:ed247316-68aa-443b-90b8-b42632ce1a86
Oct 18 11:45:26 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:45:26 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:45:26 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920
Oct 18 11:45:26 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:45:26 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:45:26 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb
Oct 18 11:45:26 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:45:26 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:45:26 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c
Oct 18 11:45:26 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:45:26 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:45:26 user nova-compute[74190]: FIRMWARE:
Oct 18 11:45:26 user nova-compute[74190]: No targets found.
Oct 18 11:45:26 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 11:45:26 user nova-compute[74190]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 11:45:26 user nova-compute[74190]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74190) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb', 0)] {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[549bad4e-94fe-43d2-aba3-3714d6551083]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed247316-68aa-443b-90b8-b42632ce1a86\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f9d809-6be4-4774-99ce-3a0f81b4e350]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed247316-68aa-443b-90b8-b42632ce1a86 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920 (non-flash)
Oct 18 11:45:26 user nova-compute[74190]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)
Oct 18 11:45:26 user nova-compute[74190]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed247316-68aa-443b-90b8-b42632ce1a86 (non-flash)
Oct 18 11:45:26 user nova-compute[74190]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)
Oct 18 11:45:26 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920 (non-flash)
Oct 18 11:45:26 user nova-compute[74190]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)
Oct 18 11:45:26 user nova-compute[74190]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed247316-68aa-443b-90b8-b42632ce1a86 (non-flash)
Oct 18 11:45:26 user nova-compute[74190]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)
Oct 18 11:45:26 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1f44662ef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb'): ({'sdd'}, set())}) {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Removing single pathed devices sdd {{(pid=74190) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[469fb458-2661-46d0-91bf-aafb76894c26]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.028s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[24154de4-c92c-464d-9cf8-9f97711c52d5]: (4, ('ok\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Flushing IO for device /dev/sdd {{(pid=74190) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[61444297-fdd6-48a6-98d8-9abfe9ce156f]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74190) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.063s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[f09cd565-3adb-49a6-b980-4b0a27ab772d]: (4, ('1', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] SCSI volumes sdd have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb')] {{(pid=74190) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a1a02dd-621e-4f26-8f5f-3aa412bb7417]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb -p 172.16.0.220:3260 --logout {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f06a1d-6ac5-4831-b53c-900492522ca9]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb, portal: 172.16.0.220,3260]
Oct 18 11:45:26 user nova-compute[74190]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb, portal: 172.16.0.220,3260] successful.
Oct 18 11:45:26 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb -p 172.16.0.220:3260 --op delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a676f29-9f2a-4260-910f-7741baed5f1a]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.400s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] <== disconnect_volume: return (402ms) None {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Disconnected iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Start _get_guest_xml network_info=[{"id": "80b77e2d-aa04-4996-a0c1-713054affac4", "address": "fa:16:3e:4f:00:ce", "network": {"id": "cf0a4705-3fff-4716-87ac-b0ca7700e11c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1739631852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cf8d4d4f504e82868ed295e054644c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80b77e2d-aa", "ovs_interfaceid": "80b77e2d-aa04-4996-a0c1-713054affac4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'image_id': '6e88bbf0-6e78-49a8-b3c5-9453d22a89df'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tNhfvoBT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'c280652c-ffde-40f8-a919-adb8be618db8', 'attached_at': '', 'detached_at': '', 'volume_id': '04ab732f-c6a7-459c-b856-68eeee8c77cb', 'serial': '04ab732f-c6a7-459c-b856-68eeee8c77cb'}, 'delete_on_termination': False, 'guest_format': None, 'attachment_id': '1fc455ad-834a-4d42-87b3-f96bab6de7a9', 'volume_type': None} {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG nova.objects.instance [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lazy-loading 'numa_topology' on Instance uuid c280652c-ffde-40f8-a919-adb8be618db8 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG nova.objects.base [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Object Instance<c280652c-ffde-40f8-a919-adb8be618db8> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74190) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 11:45:26 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:45:26 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:45:26 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] CPU controller missing on host. {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] CPU controller found on host. {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74190) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T11:37:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Flavor limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Image limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Flavor pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Image pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Got 1 possible topologies {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG nova.objects.instance [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lazy-loading 'vcpu_model' on Instance uuid c280652c-ffde-40f8-a919-adb8be618db8 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG nova.compute.manager [req-3ad502f2-bbdc-430d-aaf4-4dfc11e05221 req-a28c9df0-1170-4996-b263-896ae3983789 service nova] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Received event network-vif-plugged-8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-3ad502f2-bbdc-430d-aaf4-4dfc11e05221 req-a28c9df0-1170-4996-b263-896ae3983789 service nova] Acquiring lock "3c3cce66-9d7a-4f23-a92a-d10b3efd5e86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-3ad502f2-bbdc-430d-aaf4-4dfc11e05221 req-a28c9df0-1170-4996-b263-896ae3983789 service nova] Lock "3c3cce66-9d7a-4f23-a92a-d10b3efd5e86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-3ad502f2-bbdc-430d-aaf4-4dfc11e05221 req-a28c9df0-1170-4996-b263-896ae3983789 service nova] Lock "3c3cce66-9d7a-4f23-a92a-d10b3efd5e86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG nova.compute.manager [req-3ad502f2-bbdc-430d-aaf4-4dfc11e05221 req-a28c9df0-1170-4996-b263-896ae3983789 service nova] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] No waiting events found dispatching network-vif-plugged-8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:45:26 user nova-compute[74190]: WARNING nova.compute.manager [req-3ad502f2-bbdc-430d-aaf4-4dfc11e05221 req-a28c9df0-1170-4996-b263-896ae3983789 service nova] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Received unexpected event network-vif-plugged-8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 18 11:45:26 user nova-compute[74190]: DEBUG nova.objects.base [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Object Instance<c280652c-ffde-40f8-a919-adb8be618db8> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74190) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Calling os-brick to attach iSCSI Volume {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tNhfvoBT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:45:26 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:45:26 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:45:26 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:45:26 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:45:26 user nova-compute[74190]: INFO os_brick.initiator.connectors.iscsi [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 11:45:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb -p 172.16.0.220:3260 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb -p 172.16.0.220:3260" returned: 21 in 0.034s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[e77b06ad-b6dc-4d59-910f-df4f3b09e734]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 11:45:26 user nova-compute[74190]:  {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb -p 172.16.0.220:3260 --interface default --op new {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[5736be0a-557a-4e35-a676-66623b37e62a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb] added\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb] added
Oct 18 11:45:26 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.033s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3feb77d-b8dd-4003-9a70-809edf9252c7]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a0373bc-d26f-407f-8c0a-0432d804c82f]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tNhfvoBT {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tNhfvoBT" returned: 0 in 0.028s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab524114-b821-4065-a961-58c5b6907e5a]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tNhfvoBT'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3966e0d-4902-4dde-abb5-c7019774ca01]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[68006922-0c69-4211-8acd-7f12d1b0f1af]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed247316-68aa-443b-90b8-b42632ce1a86 (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920 (non-flash)
Oct 18 11:45:26 user nova-compute[74190]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)
Oct 18 11:45:26 user nova-compute[74190]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed247316-68aa-443b-90b8-b42632ce1a86 (non-flash)
Oct 18 11:45:26 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920 (non-flash)
Oct 18 11:45:26 user nova-compute[74190]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)
Oct 18 11:45:26 user nova-compute[74190]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed247316-68aa-443b-90b8-b42632ce1a86 (non-flash)
Oct 18 11:45:26 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:45:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb -p 172.16.0.220:3260 --login {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:45:27 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb -p 172.16.0.220:3260 --login" returned: 0 in 0.100s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:45:27 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[f43c6192-d9bd-427f-b3ec-07437025e9df]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:45:27 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb, portal: 172.16.0.220,3260]
Oct 18 11:45:27 user nova-compute[74190]: Login to [iface: default, target: iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb, portal: 172.16.0.220,3260] successful.
Oct 18 11:45:27 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:45:27 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:45:27 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:45:27 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[12099788-5815-4a00-882d-00e52784d87d]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:45:27 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:45:27 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:45:27 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.051s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:45:27 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec23462b-145c-470f-8356-b5cf739cd8b8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed247316-68aa-443b-90b8-b42632ce1a86 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:45:27 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920 (non-flash)
Oct 18 11:45:27 user nova-compute[74190]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)
Oct 18 11:45:27 user nova-compute[74190]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed247316-68aa-443b-90b8-b42632ce1a86 (non-flash)
Oct 18 11:45:27 user nova-compute[74190]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)
Oct 18 11:45:27 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:45:27 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920 (non-flash)
Oct 18 11:45:27 user nova-compute[74190]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)
Oct 18 11:45:27 user nova-compute[74190]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed247316-68aa-443b-90b8-b42632ce1a86 (non-flash)
Oct 18 11:45:27 user nova-compute[74190]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)
Oct 18 11:45:27 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:45:27 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.459s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:45:27 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Connected to 172.16.0.220:3260 {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 11:45:27 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] HCTL ('35', '-', '-', 0) found on session 14 with lun 0 {{(pid=74190) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 11:45:27 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74190) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 11:45:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:27 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:45:27 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.025s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:45:27 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[671bc383-0e17-4b0c-ab00-6fe458eefa3d]: (4, ('- - 0', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:45:27 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Searching for a device in session 14 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74190) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 11:45:27 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tNhfvoBT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 11:45:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:28 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.528s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:45:28 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] <== connect_volume: return (1529ms) {'type': 'block', 'scsi_wwn': '26262666635396430', 'path': '/dev/sdd'} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:45:28 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26262666635396430', 'path': '/dev/sdd'} {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 11:45:28 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:40:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-711461105',display_name='tempest-AttachVolumeTestJSON-server-711461105',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-711461105',id=1,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPnE2mtL+LbI3yVW2kYaN2Dxz5V1+PIccsOPxNaLovIe8VN7EUmA+C39USstHm9Yifnik7GFCenLhGnFytwIhcv6ox30HzhlwfaoDrZEfYtFLQ2I1/Og7nqCIt/6qIOiKA==',key_name='tempest-keypair-355856933',keypairs=<?>,launch_index=0,launched_at=2023-10-18T11:41:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='99cf8d4d4f504e82868ed295e054644c',ramdisk_id='',reservation_id='r-zf27bcaw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2125017306',owner_user_name='tempest-AttachVolumeTestJSON-2125017306-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T11:43:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='852309a19f1b4d49a4974c3be53f67cb',uuid=c280652c-ffde-40f8-a919-adb8be618db8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "80b77e2d-aa04-4996-a0c1-713054affac4", "address": "fa:16:3e:4f:00:ce", "network": {"id": "cf0a4705-3fff-4716-87ac-b0ca7700e11c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1739631852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cf8d4d4f504e82868ed295e054644c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80b77e2d-aa", "ovs_interfaceid": "80b77e2d-aa04-4996-a0c1-713054affac4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74190) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 11:45:28 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Converting VIF {"id": "80b77e2d-aa04-4996-a0c1-713054affac4", "address": "fa:16:3e:4f:00:ce", "network": {"id": "cf0a4705-3fff-4716-87ac-b0ca7700e11c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1739631852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cf8d4d4f504e82868ed295e054644c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80b77e2d-aa", "ovs_interfaceid": "80b77e2d-aa04-4996-a0c1-713054affac4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:45:28 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:00:ce,bridge_name='br-int',has_traffic_filtering=True,id=80b77e2d-aa04-4996-a0c1-713054affac4,network=Network(cf0a4705-3fff-4716-87ac-b0ca7700e11c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80b77e2d-aa') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:45:28 user nova-compute[74190]: DEBUG nova.objects.instance [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lazy-loading 'pci_devices' on Instance uuid c280652c-ffde-40f8-a919-adb8be618db8 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:45:28 user nova-compute[74190]: DEBUG nova.objects.base [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Object Instance<c280652c-ffde-40f8-a919-adb8be618db8> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74190) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 11:45:28 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: c280652c-ffde-40f8-a919-adb8be618db8] End _get_guest_xml xml=<domain type="kvm">
Oct 18 11:45:28 user nova-compute[74190]:   <uuid>c280652c-ffde-40f8-a919-adb8be618db8</uuid>
Oct 18 11:45:28 user nova-compute[74190]:   <name>instance-00000001</name>
Oct 18 11:45:28 user nova-compute[74190]:   <memory>524288</memory>
Oct 18 11:45:28 user nova-compute[74190]:   <vcpu>1</vcpu>
Oct 18 11:45:28 user nova-compute[74190]:   <metadata>
Oct 18 11:45:28 user nova-compute[74190]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 11:45:28 user nova-compute[74190]:       <nova:package version="0.0.0"/>
Oct 18 11:45:28 user nova-compute[74190]:       <nova:name>tempest-AttachVolumeTestJSON-server-711461105</nova:name>
Oct 18 11:45:28 user nova-compute[74190]:       <nova:creationTime>2023-10-18 11:45:26</nova:creationTime>
Oct 18 11:45:28 user nova-compute[74190]:       <nova:flavor name="m1.tiny">
Oct 18 11:45:28 user nova-compute[74190]:         <nova:memory>512</nova:memory>
Oct 18 11:45:28 user nova-compute[74190]:         <nova:disk>1</nova:disk>
Oct 18 11:45:28 user nova-compute[74190]:         <nova:swap>0</nova:swap>
Oct 18 11:45:28 user nova-compute[74190]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 11:45:28 user nova-compute[74190]:         <nova:vcpus>1</nova:vcpus>
Oct 18 11:45:28 user nova-compute[74190]:       </nova:flavor>
Oct 18 11:45:28 user nova-compute[74190]:       <nova:owner>
Oct 18 11:45:28 user nova-compute[74190]:         <nova:user uuid="852309a19f1b4d49a4974c3be53f67cb">tempest-AttachVolumeTestJSON-2125017306-project-member</nova:user>
Oct 18 11:45:28 user nova-compute[74190]:         <nova:project uuid="99cf8d4d4f504e82868ed295e054644c">tempest-AttachVolumeTestJSON-2125017306</nova:project>
Oct 18 11:45:28 user nova-compute[74190]:       </nova:owner>
Oct 18 11:45:28 user nova-compute[74190]:       <nova:root type="image" uuid="6e88bbf0-6e78-49a8-b3c5-9453d22a89df"/>
Oct 18 11:45:28 user nova-compute[74190]:       <nova:ports>
Oct 18 11:45:28 user nova-compute[74190]:         <nova:port uuid="80b77e2d-aa04-4996-a0c1-713054affac4">
Oct 18 11:45:28 user nova-compute[74190]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 18 11:45:28 user nova-compute[74190]:         </nova:port>
Oct 18 11:45:28 user nova-compute[74190]:       </nova:ports>
Oct 18 11:45:28 user nova-compute[74190]:     </nova:instance>
Oct 18 11:45:28 user nova-compute[74190]:   </metadata>
Oct 18 11:45:28 user nova-compute[74190]:   <sysinfo type="smbios">
Oct 18 11:45:28 user nova-compute[74190]:     <system>
Oct 18 11:45:28 user nova-compute[74190]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 11:45:28 user nova-compute[74190]:       <entry name="product">OpenStack Nova</entry>
Oct 18 11:45:28 user nova-compute[74190]:       <entry name="version">0.0.0</entry>
Oct 18 11:45:28 user nova-compute[74190]:       <entry name="serial">c280652c-ffde-40f8-a919-adb8be618db8</entry>
Oct 18 11:45:28 user nova-compute[74190]:       <entry name="uuid">c280652c-ffde-40f8-a919-adb8be618db8</entry>
Oct 18 11:45:28 user nova-compute[74190]:       <entry name="family">Virtual Machine</entry>
Oct 18 11:45:28 user nova-compute[74190]:     </system>
Oct 18 11:45:28 user nova-compute[74190]:   </sysinfo>
Oct 18 11:45:28 user nova-compute[74190]:   <os>
Oct 18 11:45:28 user nova-compute[74190]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 11:45:28 user nova-compute[74190]:     <boot dev="hd"/>
Oct 18 11:45:28 user nova-compute[74190]:     <smbios mode="sysinfo"/>
Oct 18 11:45:28 user nova-compute[74190]:   </os>
Oct 18 11:45:28 user nova-compute[74190]:   <features>
Oct 18 11:45:28 user nova-compute[74190]:     <acpi/>
Oct 18 11:45:28 user nova-compute[74190]:     <apic/>
Oct 18 11:45:28 user nova-compute[74190]:     <vmcoreinfo/>
Oct 18 11:45:28 user nova-compute[74190]:   </features>
Oct 18 11:45:28 user nova-compute[74190]:   <clock offset="utc">
Oct 18 11:45:28 user nova-compute[74190]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 11:45:28 user nova-compute[74190]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 11:45:28 user nova-compute[74190]:     <timer name="hpet" present="no"/>
Oct 18 11:45:28 user nova-compute[74190]:   </clock>
Oct 18 11:45:28 user nova-compute[74190]:   <cpu mode="custom" match="exact">
Oct 18 11:45:28 user nova-compute[74190]:     <model>Nehalem</model>
Oct 18 11:45:28 user nova-compute[74190]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 11:45:28 user nova-compute[74190]:   </cpu>
Oct 18 11:45:28 user nova-compute[74190]:   <devices>
Oct 18 11:45:28 user nova-compute[74190]:     <disk type="file" device="disk">
Oct 18 11:45:28 user nova-compute[74190]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 11:45:28 user nova-compute[74190]:       <source file="/opt/stack/data/nova/instances/c280652c-ffde-40f8-a919-adb8be618db8/disk"/>
Oct 18 11:45:28 user nova-compute[74190]:       <target dev="vda" bus="virtio"/>
Oct 18 11:45:28 user nova-compute[74190]:     </disk>
Oct 18 11:45:28 user nova-compute[74190]:     <disk type="block" device="disk">
Oct 18 11:45:28 user nova-compute[74190]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 11:45:28 user nova-compute[74190]:       <source dev="/dev/sdd"/>
Oct 18 11:45:28 user nova-compute[74190]:       <target dev="vdb" bus="virtio"/>
Oct 18 11:45:28 user nova-compute[74190]:       <serial>04ab732f-c6a7-459c-b856-68eeee8c77cb</serial>
Oct 18 11:45:28 user nova-compute[74190]:     </disk>
Oct 18 11:45:28 user nova-compute[74190]:     <interface type="ethernet">
Oct 18 11:45:28 user nova-compute[74190]:       <mac address="fa:16:3e:4f:00:ce"/>
Oct 18 11:45:28 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:45:28 user nova-compute[74190]:       <mtu size="1442"/>
Oct 18 11:45:28 user nova-compute[74190]:       <target dev="tap80b77e2d-aa"/>
Oct 18 11:45:28 user nova-compute[74190]:     </interface>
Oct 18 11:45:28 user nova-compute[74190]:     <serial type="pty">
Oct 18 11:45:28 user nova-compute[74190]:       <log file="/opt/stack/data/nova/instances/c280652c-ffde-40f8-a919-adb8be618db8/console.log" append="off"/>
Oct 18 11:45:28 user nova-compute[74190]:     </serial>
Oct 18 11:45:28 user nova-compute[74190]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 11:45:28 user nova-compute[74190]:     <video>
Oct 18 11:45:28 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:45:28 user nova-compute[74190]:     </video>
Oct 18 11:45:28 user nova-compute[74190]:     <rng model="virtio">
Oct 18 11:45:28 user nova-compute[74190]:       <backend model="random">/dev/urandom</backend>
Oct 18 11:45:28 user nova-compute[74190]:     </rng>
Oct 18 11:45:28 user nova-compute[74190]:     <controller type="usb" index="0" model="none"/>
Oct 18 11:45:28 user nova-compute[74190]:     <memballoon model="virtio">
Oct 18 11:45:28 user nova-compute[74190]:       <stats period="10"/>
Oct 18 11:45:28 user nova-compute[74190]:     </memballoon>
Oct 18 11:45:28 user nova-compute[74190]:   </devices>
Oct 18 11:45:28 user nova-compute[74190]: </domain>
Oct 18 11:45:28 user nova-compute[74190]:  {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 11:45:28 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c280652c-ffde-40f8-a919-adb8be618db8/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:45:28 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c280652c-ffde-40f8-a919-adb8be618db8/disk --force-share --output=json" returned: 0 in 0.285s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:45:28 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c280652c-ffde-40f8-a919-adb8be618db8/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:45:28 user nova-compute[74190]: DEBUG nova.compute.manager [req-16e69143-1c87-42b4-8b3a-490f92df6259 req-cbdb9c75-cbc7-4bd9-a50d-bba547f4e09b service nova] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Received event network-vif-plugged-8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:45:28 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-16e69143-1c87-42b4-8b3a-490f92df6259 req-cbdb9c75-cbc7-4bd9-a50d-bba547f4e09b service nova] Acquiring lock "3c3cce66-9d7a-4f23-a92a-d10b3efd5e86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:45:28 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-16e69143-1c87-42b4-8b3a-490f92df6259 req-cbdb9c75-cbc7-4bd9-a50d-bba547f4e09b service nova] Lock "3c3cce66-9d7a-4f23-a92a-d10b3efd5e86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:45:28 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-16e69143-1c87-42b4-8b3a-490f92df6259 req-cbdb9c75-cbc7-4bd9-a50d-bba547f4e09b service nova] Lock "3c3cce66-9d7a-4f23-a92a-d10b3efd5e86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:45:28 user nova-compute[74190]: DEBUG nova.compute.manager [req-16e69143-1c87-42b4-8b3a-490f92df6259 req-cbdb9c75-cbc7-4bd9-a50d-bba547f4e09b service nova] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] No waiting events found dispatching network-vif-plugged-8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:45:28 user nova-compute[74190]: WARNING nova.compute.manager [req-16e69143-1c87-42b4-8b3a-490f92df6259 req-cbdb9c75-cbc7-4bd9-a50d-bba547f4e09b service nova] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Received unexpected event network-vif-plugged-8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 18 11:45:28 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c280652c-ffde-40f8-a919-adb8be618db8/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:45:28 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 11:45:28 user nova-compute[74190]: DEBUG nova.objects.instance [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lazy-loading 'trusted_certs' on Instance uuid c280652c-ffde-40f8-a919-adb8be618db8 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:45:28 user nova-compute[74190]: DEBUG nova.objects.base [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Object Instance<c280652c-ffde-40f8-a919-adb8be618db8> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74190) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 11:45:28 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:45:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:29 user nova-compute[74190]: DEBUG nova.compute.manager [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Instance event wait completed in 0 seconds for  {{(pid=74190) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 11:45:29 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Guest created on hypervisor {{(pid=74190) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 11:45:29 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Instance spawned successfully.
Oct 18 11:45:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.254s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:45:29 user nova-compute[74190]: DEBUG nova.virt.disk.api [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c280652c-ffde-40f8-a919-adb8be618db8/disk. size=1073741824 {{(pid=74190) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 18 11:45:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c280652c-ffde-40f8-a919-adb8be618db8/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:45:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c280652c-ffde-40f8-a919-adb8be618db8/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:45:29 user nova-compute[74190]: DEBUG nova.virt.disk.api [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Cannot resize image /opt/stack/data/nova/instances/c280652c-ffde-40f8-a919-adb8be618db8/disk to a smaller size. {{(pid=74190) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 18 11:45:29 user nova-compute[74190]: DEBUG nova.objects.instance [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lazy-loading 'migration_context' on Instance uuid c280652c-ffde-40f8-a919-adb8be618db8 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:45:29 user nova-compute[74190]: DEBUG nova.objects.base [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Object Instance<c280652c-ffde-40f8-a919-adb8be618db8> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74190) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 11:45:29 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:40:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-711461105',display_name='tempest-AttachVolumeTestJSON-server-711461105',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-711461105',id=1,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPnE2mtL+LbI3yVW2kYaN2Dxz5V1+PIccsOPxNaLovIe8VN7EUmA+C39USstHm9Yifnik7GFCenLhGnFytwIhcv6ox30HzhlwfaoDrZEfYtFLQ2I1/Og7nqCIt/6qIOiKA==',key_name='tempest-keypair-355856933',keypairs=<?>,launch_index=0,launched_at=2023-10-18T11:41:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='99cf8d4d4f504e82868ed295e054644c',ramdisk_id='',reservation_id='r-zf27bcaw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2125017306',owner_user_name='tempest-AttachVolumeTestJSON-2125017306-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:43:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='852309a19f1b4d49a4974c3be53f67cb',uuid=c280652c-ffde-40f8-a919-adb8be618db8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "80b77e2d-aa04-4996-a0c1-713054affac4", "address": "fa:16:3e:4f:00:ce", "network": {"id": "cf0a4705-3fff-4716-87ac-b0ca7700e11c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1739631852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cf8d4d4f504e82868ed295e054644c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80b77e2d-aa", "ovs_interfaceid": "80b77e2d-aa04-4996-a0c1-713054affac4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 11:45:29 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Converting VIF {"id": "80b77e2d-aa04-4996-a0c1-713054affac4", "address": "fa:16:3e:4f:00:ce", "network": {"id": "cf0a4705-3fff-4716-87ac-b0ca7700e11c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1739631852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cf8d4d4f504e82868ed295e054644c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80b77e2d-aa", "ovs_interfaceid": "80b77e2d-aa04-4996-a0c1-713054affac4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:45:29 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:00:ce,bridge_name='br-int',has_traffic_filtering=True,id=80b77e2d-aa04-4996-a0c1-713054affac4,network=Network(cf0a4705-3fff-4716-87ac-b0ca7700e11c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80b77e2d-aa') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:45:29 user nova-compute[74190]: DEBUG os_vif [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:00:ce,bridge_name='br-int',has_traffic_filtering=True,id=80b77e2d-aa04-4996-a0c1-713054affac4,network=Network(cf0a4705-3fff-4716-87ac-b0ca7700e11c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80b77e2d-aa') {{(pid=74190) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 11:45:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:45:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 11:45:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2576e2aa-e5b5-5773-b422-eed291832674', '_type': 'linux-noop'}}, row=False) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:45:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:45:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap80b77e2d-aa, may_exist=True, interface_attrs={}) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:45:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap80b77e2d-aa, col_values=(('qos', UUID('23f05794-9183-472a-92b4-9ec6941f0c84')),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:45:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap80b77e2d-aa, col_values=(('external_ids', {'iface-id': '80b77e2d-aa04-4996-a0c1-713054affac4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:00:ce', 'vm-uuid': 'c280652c-ffde-40f8-a919-adb8be618db8'}),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:45:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:45:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:29 user nova-compute[74190]: INFO os_vif [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:00:ce,bridge_name='br-int',has_traffic_filtering=True,id=80b77e2d-aa04-4996-a0c1-713054affac4,network=Network(cf0a4705-3fff-4716-87ac-b0ca7700e11c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80b77e2d-aa')
Oct 18 11:45:29 user nova-compute[74190]: DEBUG nova.compute.manager [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Checking state {{(pid=74190) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 11:45:29 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-6e043496-cedb-47cf-91d1-5801ac7b8601 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Lock "3c3cce66-9d7a-4f23-a92a-d10b3efd5e86" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 33.461s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:45:31 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:31 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:31 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:31 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:31 user nova-compute[74190]: DEBUG nova.compute.manager [req-29cb620b-8d6f-4009-8e09-4ac7ef121b83 req-b9b45dae-da43-4fa3-a530-ba2934e83962 service nova] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Received event network-vif-plugged-80b77e2d-aa04-4996-a0c1-713054affac4 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:45:31 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-29cb620b-8d6f-4009-8e09-4ac7ef121b83 req-b9b45dae-da43-4fa3-a530-ba2934e83962 service nova] Acquiring lock "c280652c-ffde-40f8-a919-adb8be618db8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:45:31 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-29cb620b-8d6f-4009-8e09-4ac7ef121b83 req-b9b45dae-da43-4fa3-a530-ba2934e83962 service nova] Lock "c280652c-ffde-40f8-a919-adb8be618db8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:45:31 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-29cb620b-8d6f-4009-8e09-4ac7ef121b83 req-b9b45dae-da43-4fa3-a530-ba2934e83962 service nova] Lock "c280652c-ffde-40f8-a919-adb8be618db8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:45:31 user nova-compute[74190]: DEBUG nova.compute.manager [req-29cb620b-8d6f-4009-8e09-4ac7ef121b83 req-b9b45dae-da43-4fa3-a530-ba2934e83962 service nova] [instance: c280652c-ffde-40f8-a919-adb8be618db8] No waiting events found dispatching network-vif-plugged-80b77e2d-aa04-4996-a0c1-713054affac4 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:45:31 user nova-compute[74190]: WARNING nova.compute.manager [req-29cb620b-8d6f-4009-8e09-4ac7ef121b83 req-b9b45dae-da43-4fa3-a530-ba2934e83962 service nova] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Received unexpected event network-vif-plugged-80b77e2d-aa04-4996-a0c1-713054affac4 for instance with vm_state stopped and task_state powering-on.
Oct 18 11:45:32 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:32 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:32 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:32 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:33 user nova-compute[74190]: DEBUG nova.compute.manager [req-63ee9857-d391-4b0d-aae0-f8c2a23fdeee req-65f8426b-d2af-4dc5-9dd9-85dfbd1ee1f5 service nova] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Received event network-vif-plugged-80b77e2d-aa04-4996-a0c1-713054affac4 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:45:33 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-63ee9857-d391-4b0d-aae0-f8c2a23fdeee req-65f8426b-d2af-4dc5-9dd9-85dfbd1ee1f5 service nova] Acquiring lock "c280652c-ffde-40f8-a919-adb8be618db8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:45:33 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-63ee9857-d391-4b0d-aae0-f8c2a23fdeee req-65f8426b-d2af-4dc5-9dd9-85dfbd1ee1f5 service nova] Lock "c280652c-ffde-40f8-a919-adb8be618db8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:45:33 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-63ee9857-d391-4b0d-aae0-f8c2a23fdeee req-65f8426b-d2af-4dc5-9dd9-85dfbd1ee1f5 service nova] Lock "c280652c-ffde-40f8-a919-adb8be618db8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:45:33 user nova-compute[74190]: DEBUG nova.compute.manager [req-63ee9857-d391-4b0d-aae0-f8c2a23fdeee req-65f8426b-d2af-4dc5-9dd9-85dfbd1ee1f5 service nova] [instance: c280652c-ffde-40f8-a919-adb8be618db8] No waiting events found dispatching network-vif-plugged-80b77e2d-aa04-4996-a0c1-713054affac4 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:45:33 user nova-compute[74190]: WARNING nova.compute.manager [req-63ee9857-d391-4b0d-aae0-f8c2a23fdeee req-65f8426b-d2af-4dc5-9dd9-85dfbd1ee1f5 service nova] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Received unexpected event network-vif-plugged-80b77e2d-aa04-4996-a0c1-713054affac4 for instance with vm_state stopped and task_state powering-on.
Oct 18 11:45:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:34 user nova-compute[74190]: DEBUG nova.compute.manager [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Instance event wait completed in 0 seconds for  {{(pid=74190) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 11:45:34 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Instance rebooted successfully.
Oct 18 11:45:34 user nova-compute[74190]: DEBUG nova.compute.manager [None req-8e6cffc9-c5f3-4b30-a390-c580040740fe tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Checking state {{(pid=74190) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 11:45:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:35 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:39 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:39 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:41 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-214dbcbf-4570-4a9c-af5b-a8cf7826cc10 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Acquiring lock "bdfe420d-f46c-44ad-8773-b675f42e24ed" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:45:41 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-214dbcbf-4570-4a9c-af5b-a8cf7826cc10 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Lock "bdfe420d-f46c-44ad-8773-b675f42e24ed" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:45:41 user nova-compute[74190]: DEBUG nova.compute.manager [None req-214dbcbf-4570-4a9c-af5b-a8cf7826cc10 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Starting instance... {{(pid=74190) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 11:45:41 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-214dbcbf-4570-4a9c-af5b-a8cf7826cc10 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:45:41 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-214dbcbf-4570-4a9c-af5b-a8cf7826cc10 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:45:41 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-214dbcbf-4570-4a9c-af5b-a8cf7826cc10 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74190) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 11:45:41 user nova-compute[74190]: INFO nova.compute.claims [None req-214dbcbf-4570-4a9c-af5b-a8cf7826cc10 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Claim successful on node user
Oct 18 11:45:41 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-214dbcbf-4570-4a9c-af5b-a8cf7826cc10 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 11:45:41 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-214dbcbf-4570-4a9c-af5b-a8cf7826cc10 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 11:45:41 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-214dbcbf-4570-4a9c-af5b-a8cf7826cc10 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.413s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:45:41 user nova-compute[74190]: DEBUG nova.compute.manager [None req-214dbcbf-4570-4a9c-af5b-a8cf7826cc10 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Start building networks asynchronously for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 11:45:41 user nova-compute[74190]: DEBUG nova.compute.manager [None req-214dbcbf-4570-4a9c-af5b-a8cf7826cc10 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Allocating IP information in the background. {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 11:45:41 user nova-compute[74190]: DEBUG nova.network.neutron [None req-214dbcbf-4570-4a9c-af5b-a8cf7826cc10 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] allocate_for_instance() {{(pid=74190) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 11:45:41 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-214dbcbf-4570-4a9c-af5b-a8cf7826cc10 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 11:45:41 user nova-compute[74190]: DEBUG nova.compute.manager [None req-214dbcbf-4570-4a9c-af5b-a8cf7826cc10 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Start building block device mappings for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 11:45:41 user nova-compute[74190]: DEBUG nova.policy [None req-214dbcbf-4570-4a9c-af5b-a8cf7826cc10 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c5f5ddf3c4174afcbe7075b7f89b4f05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce179d9f22684865b577bd91bc841400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74190) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 11:45:42 user nova-compute[74190]: DEBUG nova.compute.manager [None req-214dbcbf-4570-4a9c-af5b-a8cf7826cc10 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Start spawning the instance on the hypervisor. {{(pid=74190) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 11:45:42 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-214dbcbf-4570-4a9c-af5b-a8cf7826cc10 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Creating instance directory {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 11:45:42 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-214dbcbf-4570-4a9c-af5b-a8cf7826cc10 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Creating image(s)
Oct 18 11:45:42 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-214dbcbf-4570-4a9c-af5b-a8cf7826cc10 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Acquiring lock "/opt/stack/data/nova/instances/bdfe420d-f46c-44ad-8773-b675f42e24ed/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:45:42 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-214dbcbf-4570-4a9c-af5b-a8cf7826cc10 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Lock "/opt/stack/data/nova/instances/bdfe420d-f46c-44ad-8773-b675f42e24ed/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:45:42 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-214dbcbf-4570-4a9c-af5b-a8cf7826cc10 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Lock "/opt/stack/data/nova/instances/bdfe420d-f46c-44ad-8773-b675f42e24ed/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:45:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-214dbcbf-4570-4a9c-af5b-a8cf7826cc10 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:45:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-214dbcbf-4570-4a9c-af5b-a8cf7826cc10 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.274s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:45:42 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-214dbcbf-4570-4a9c-af5b-a8cf7826cc10 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Acquiring lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:45:42 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-214dbcbf-4570-4a9c-af5b-a8cf7826cc10 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:45:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-214dbcbf-4570-4a9c-af5b-a8cf7826cc10 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:45:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-214dbcbf-4570-4a9c-af5b-a8cf7826cc10 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.226s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:45:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-214dbcbf-4570-4a9c-af5b-a8cf7826cc10 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f,backing_fmt=raw /opt/stack/data/nova/instances/bdfe420d-f46c-44ad-8773-b675f42e24ed/disk 1073741824 {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:45:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-214dbcbf-4570-4a9c-af5b-a8cf7826cc10 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f,backing_fmt=raw /opt/stack/data/nova/instances/bdfe420d-f46c-44ad-8773-b675f42e24ed/disk 1073741824" returned: 0 in 0.063s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:45:42 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-214dbcbf-4570-4a9c-af5b-a8cf7826cc10 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.300s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:45:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-214dbcbf-4570-4a9c-af5b-a8cf7826cc10 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:45:42 user nova-compute[74190]: DEBUG nova.network.neutron [None req-214dbcbf-4570-4a9c-af5b-a8cf7826cc10 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Successfully created port: 5f5b65f1-7748-4422-8b45-e1b88476716d {{(pid=74190) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 11:45:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-214dbcbf-4570-4a9c-af5b-a8cf7826cc10 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.219s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:45:42 user nova-compute[74190]: DEBUG nova.virt.disk.api [None req-214dbcbf-4570-4a9c-af5b-a8cf7826cc10 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bdfe420d-f46c-44ad-8773-b675f42e24ed/disk. size=1073741824 {{(pid=74190) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 18 11:45:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-214dbcbf-4570-4a9c-af5b-a8cf7826cc10 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdfe420d-f46c-44ad-8773-b675f42e24ed/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:45:43 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-214dbcbf-4570-4a9c-af5b-a8cf7826cc10 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdfe420d-f46c-44ad-8773-b675f42e24ed/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:45:43 user nova-compute[74190]: DEBUG nova.virt.disk.api [None req-214dbcbf-4570-4a9c-af5b-a8cf7826cc10 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Cannot resize image /opt/stack/data/nova/instances/bdfe420d-f46c-44ad-8773-b675f42e24ed/disk to a smaller size. {{(pid=74190) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 18 11:45:43 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-214dbcbf-4570-4a9c-af5b-a8cf7826cc10 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Created local disks {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 11:45:43 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-214dbcbf-4570-4a9c-af5b-a8cf7826cc10 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Ensure instance console log exists: /opt/stack/data/nova/instances/bdfe420d-f46c-44ad-8773-b675f42e24ed/console.log {{(pid=74190) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 11:45:43 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-214dbcbf-4570-4a9c-af5b-a8cf7826cc10 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:45:43 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-214dbcbf-4570-4a9c-af5b-a8cf7826cc10 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:45:43 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-214dbcbf-4570-4a9c-af5b-a8cf7826cc10 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:45:43 user nova-compute[74190]: DEBUG nova.network.neutron [None req-214dbcbf-4570-4a9c-af5b-a8cf7826cc10 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Successfully updated port: 5f5b65f1-7748-4422-8b45-e1b88476716d {{(pid=74190) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 11:45:43 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-214dbcbf-4570-4a9c-af5b-a8cf7826cc10 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Acquiring lock "refresh_cache-bdfe420d-f46c-44ad-8773-b675f42e24ed" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:45:43 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-214dbcbf-4570-4a9c-af5b-a8cf7826cc10 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Acquired lock "refresh_cache-bdfe420d-f46c-44ad-8773-b675f42e24ed" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:45:43 user nova-compute[74190]: DEBUG nova.network.neutron [None req-214dbcbf-4570-4a9c-af5b-a8cf7826cc10 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Building network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 11:45:43 user nova-compute[74190]: DEBUG nova.compute.manager [req-e346a1c1-4f09-4121-9747-1a9fbeaec389 req-5707e3f9-34e9-47a7-9381-37c3f0df7cca service nova] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Received event network-changed-5f5b65f1-7748-4422-8b45-e1b88476716d {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:45:43 user nova-compute[74190]: DEBUG nova.compute.manager [req-e346a1c1-4f09-4121-9747-1a9fbeaec389 req-5707e3f9-34e9-47a7-9381-37c3f0df7cca service nova] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Refreshing instance network info cache due to event network-changed-5f5b65f1-7748-4422-8b45-e1b88476716d. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 11:45:43 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-e346a1c1-4f09-4121-9747-1a9fbeaec389 req-5707e3f9-34e9-47a7-9381-37c3f0df7cca service nova] Acquiring lock "refresh_cache-bdfe420d-f46c-44ad-8773-b675f42e24ed" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:45:43 user nova-compute[74190]: DEBUG nova.network.neutron [None req-214dbcbf-4570-4a9c-af5b-a8cf7826cc10 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Instance cache missing network info. {{(pid=74190) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 11:45:44 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:44 user nova-compute[74190]: DEBUG nova.network.neutron [None req-214dbcbf-4570-4a9c-af5b-a8cf7826cc10 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Updating instance_info_cache with network_info: [{"id": "5f5b65f1-7748-4422-8b45-e1b88476716d", "address": "fa:16:3e:cb:ff:0f", "network": {"id": "7be8675d-326a-4184-9b3e-fbaa02a4e1fc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-468552750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce179d9f22684865b577bd91bc841400", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5b65f1-77", "ovs_interfaceid": "5f5b65f1-7748-4422-8b45-e1b88476716d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:45:44 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-214dbcbf-4570-4a9c-af5b-a8cf7826cc10 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Releasing lock "refresh_cache-bdfe420d-f46c-44ad-8773-b675f42e24ed" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:45:44 user nova-compute[74190]: DEBUG nova.compute.manager [None req-214dbcbf-4570-4a9c-af5b-a8cf7826cc10 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Instance network_info: |[{"id": "5f5b65f1-7748-4422-8b45-e1b88476716d", "address": "fa:16:3e:cb:ff:0f", "network": {"id": "7be8675d-326a-4184-9b3e-fbaa02a4e1fc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-468552750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce179d9f22684865b577bd91bc841400", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5b65f1-77", "ovs_interfaceid": "5f5b65f1-7748-4422-8b45-e1b88476716d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 11:45:44 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-e346a1c1-4f09-4121-9747-1a9fbeaec389 req-5707e3f9-34e9-47a7-9381-37c3f0df7cca service nova] Acquired lock "refresh_cache-bdfe420d-f46c-44ad-8773-b675f42e24ed" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:45:44 user nova-compute[74190]: DEBUG nova.network.neutron [req-e346a1c1-4f09-4121-9747-1a9fbeaec389 req-5707e3f9-34e9-47a7-9381-37c3f0df7cca service nova] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Refreshing network info cache for port 5f5b65f1-7748-4422-8b45-e1b88476716d {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 11:45:44 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-214dbcbf-4570-4a9c-af5b-a8cf7826cc10 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Start _get_guest_xml network_info=[{"id": "5f5b65f1-7748-4422-8b45-e1b88476716d", "address": "fa:16:3e:cb:ff:0f", "network": {"id": "7be8675d-326a-4184-9b3e-fbaa02a4e1fc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-468552750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce179d9f22684865b577bd91bc841400", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5b65f1-77", "ovs_interfaceid": "5f5b65f1-7748-4422-8b45-e1b88476716d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'image_id': '6e88bbf0-6e78-49a8-b3c5-9453d22a89df'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 11:45:44 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-214dbcbf-4570-4a9c-af5b-a8cf7826cc10 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:45:44 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-214dbcbf-4570-4a9c-af5b-a8cf7826cc10 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:45:44 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-214dbcbf-4570-4a9c-af5b-a8cf7826cc10 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 11:45:44 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-214dbcbf-4570-4a9c-af5b-a8cf7826cc10 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] CPU controller missing on host. {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 11:45:44 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-214dbcbf-4570-4a9c-af5b-a8cf7826cc10 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 11:45:44 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-214dbcbf-4570-4a9c-af5b-a8cf7826cc10 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] CPU controller found on host. {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 11:45:44 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-214dbcbf-4570-4a9c-af5b-a8cf7826cc10 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74190) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 11:45:44 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-214dbcbf-4570-4a9c-af5b-a8cf7826cc10 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T11:37:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 11:45:44 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-214dbcbf-4570-4a9c-af5b-a8cf7826cc10 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Flavor limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 11:45:44 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-214dbcbf-4570-4a9c-af5b-a8cf7826cc10 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Image limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 11:45:44 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-214dbcbf-4570-4a9c-af5b-a8cf7826cc10 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Flavor pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 11:45:44 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-214dbcbf-4570-4a9c-af5b-a8cf7826cc10 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Image pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 11:45:44 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-214dbcbf-4570-4a9c-af5b-a8cf7826cc10 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 11:45:44 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-214dbcbf-4570-4a9c-af5b-a8cf7826cc10 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 11:45:44 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-214dbcbf-4570-4a9c-af5b-a8cf7826cc10 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 11:45:44 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-214dbcbf-4570-4a9c-af5b-a8cf7826cc10 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Got 1 possible topologies {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 11:45:44 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-214dbcbf-4570-4a9c-af5b-a8cf7826cc10 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 11:45:44 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-214dbcbf-4570-4a9c-af5b-a8cf7826cc10 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 11:45:44 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-214dbcbf-4570-4a9c-af5b-a8cf7826cc10 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:45:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1652011593',display_name='tempest-ServerActionsTestOtherB-server-1652011593',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1652011593',id=13,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJf2+oC1LymyOUKrd79qlp9w/sLNNXOE0jNeE016Gw/qD1l2yX0bGo5VP+iKF1MHpeTJ2Ix6czkMyFuUdVqQvcY91kItew2KCNk3ZYu6m5FRy6Ycq3v+bQ+PiA7mcNgHFg==',key_name='tempest-keypair-1546248338',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ce179d9f22684865b577bd91bc841400',ramdisk_id='',reservation_id='r-iuitp9n6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1277618284',owner_user_name='tempest-ServerActionsTestOtherB-1277618284-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:45:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c5f5ddf3c4174afcbe7075b7f89b4f05',uuid=bdfe420d-f46c-44ad-8773-b675f42e24ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f5b65f1-7748-4422-8b45-e1b88476716d", "address": "fa:16:3e:cb:ff:0f", "network": {"id": "7be8675d-326a-4184-9b3e-fbaa02a4e1fc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-468552750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce179d9f22684865b577bd91bc841400", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5b65f1-77", "ovs_interfaceid": "5f5b65f1-7748-4422-8b45-e1b88476716d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74190) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 11:45:44 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-214dbcbf-4570-4a9c-af5b-a8cf7826cc10 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Converting VIF {"id": "5f5b65f1-7748-4422-8b45-e1b88476716d", "address": "fa:16:3e:cb:ff:0f", "network": {"id": "7be8675d-326a-4184-9b3e-fbaa02a4e1fc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-468552750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce179d9f22684865b577bd91bc841400", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5b65f1-77", "ovs_interfaceid": "5f5b65f1-7748-4422-8b45-e1b88476716d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:45:44 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-214dbcbf-4570-4a9c-af5b-a8cf7826cc10 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:ff:0f,bridge_name='br-int',has_traffic_filtering=True,id=5f5b65f1-7748-4422-8b45-e1b88476716d,network=Network(7be8675d-326a-4184-9b3e-fbaa02a4e1fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f5b65f1-77') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:45:44 user nova-compute[74190]: DEBUG nova.objects.instance [None req-214dbcbf-4570-4a9c-af5b-a8cf7826cc10 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Lazy-loading 'pci_devices' on Instance uuid bdfe420d-f46c-44ad-8773-b675f42e24ed {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:45:44 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-214dbcbf-4570-4a9c-af5b-a8cf7826cc10 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] End _get_guest_xml xml=<domain type="kvm">
Oct 18 11:45:44 user nova-compute[74190]:   <uuid>bdfe420d-f46c-44ad-8773-b675f42e24ed</uuid>
Oct 18 11:45:44 user nova-compute[74190]:   <name>instance-0000000d</name>
Oct 18 11:45:44 user nova-compute[74190]:   <memory>524288</memory>
Oct 18 11:45:44 user nova-compute[74190]:   <vcpu>1</vcpu>
Oct 18 11:45:44 user nova-compute[74190]:   <metadata>
Oct 18 11:45:44 user nova-compute[74190]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 11:45:44 user nova-compute[74190]:       <nova:package version="0.0.0"/>
Oct 18 11:45:44 user nova-compute[74190]:       <nova:name>tempest-ServerActionsTestOtherB-server-1652011593</nova:name>
Oct 18 11:45:44 user nova-compute[74190]:       <nova:creationTime>2023-10-18 11:45:44</nova:creationTime>
Oct 18 11:45:44 user nova-compute[74190]:       <nova:flavor name="m1.tiny">
Oct 18 11:45:44 user nova-compute[74190]:         <nova:memory>512</nova:memory>
Oct 18 11:45:44 user nova-compute[74190]:         <nova:disk>1</nova:disk>
Oct 18 11:45:44 user nova-compute[74190]:         <nova:swap>0</nova:swap>
Oct 18 11:45:44 user nova-compute[74190]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 11:45:44 user nova-compute[74190]:         <nova:vcpus>1</nova:vcpus>
Oct 18 11:45:44 user nova-compute[74190]:       </nova:flavor>
Oct 18 11:45:44 user nova-compute[74190]:       <nova:owner>
Oct 18 11:45:44 user nova-compute[74190]:         <nova:user uuid="c5f5ddf3c4174afcbe7075b7f89b4f05">tempest-ServerActionsTestOtherB-1277618284-project-member</nova:user>
Oct 18 11:45:44 user nova-compute[74190]:         <nova:project uuid="ce179d9f22684865b577bd91bc841400">tempest-ServerActionsTestOtherB-1277618284</nova:project>
Oct 18 11:45:44 user nova-compute[74190]:       </nova:owner>
Oct 18 11:45:44 user nova-compute[74190]:       <nova:root type="image" uuid="6e88bbf0-6e78-49a8-b3c5-9453d22a89df"/>
Oct 18 11:45:44 user nova-compute[74190]:       <nova:ports>
Oct 18 11:45:44 user nova-compute[74190]:         <nova:port uuid="5f5b65f1-7748-4422-8b45-e1b88476716d">
Oct 18 11:45:44 user nova-compute[74190]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 18 11:45:44 user nova-compute[74190]:         </nova:port>
Oct 18 11:45:44 user nova-compute[74190]:       </nova:ports>
Oct 18 11:45:44 user nova-compute[74190]:     </nova:instance>
Oct 18 11:45:44 user nova-compute[74190]:   </metadata>
Oct 18 11:45:44 user nova-compute[74190]:   <sysinfo type="smbios">
Oct 18 11:45:44 user nova-compute[74190]:     <system>
Oct 18 11:45:44 user nova-compute[74190]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 11:45:44 user nova-compute[74190]:       <entry name="product">OpenStack Nova</entry>
Oct 18 11:45:44 user nova-compute[74190]:       <entry name="version">0.0.0</entry>
Oct 18 11:45:44 user nova-compute[74190]:       <entry name="serial">bdfe420d-f46c-44ad-8773-b675f42e24ed</entry>
Oct 18 11:45:44 user nova-compute[74190]:       <entry name="uuid">bdfe420d-f46c-44ad-8773-b675f42e24ed</entry>
Oct 18 11:45:44 user nova-compute[74190]:       <entry name="family">Virtual Machine</entry>
Oct 18 11:45:44 user nova-compute[74190]:     </system>
Oct 18 11:45:44 user nova-compute[74190]:   </sysinfo>
Oct 18 11:45:44 user nova-compute[74190]:   <os>
Oct 18 11:45:44 user nova-compute[74190]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 11:45:44 user nova-compute[74190]:     <boot dev="hd"/>
Oct 18 11:45:44 user nova-compute[74190]:     <smbios mode="sysinfo"/>
Oct 18 11:45:44 user nova-compute[74190]:   </os>
Oct 18 11:45:44 user nova-compute[74190]:   <features>
Oct 18 11:45:44 user nova-compute[74190]:     <acpi/>
Oct 18 11:45:44 user nova-compute[74190]:     <apic/>
Oct 18 11:45:44 user nova-compute[74190]:     <vmcoreinfo/>
Oct 18 11:45:44 user nova-compute[74190]:   </features>
Oct 18 11:45:44 user nova-compute[74190]:   <clock offset="utc">
Oct 18 11:45:44 user nova-compute[74190]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 11:45:44 user nova-compute[74190]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 11:45:44 user nova-compute[74190]:     <timer name="hpet" present="no"/>
Oct 18 11:45:44 user nova-compute[74190]:   </clock>
Oct 18 11:45:44 user nova-compute[74190]:   <cpu mode="custom" match="exact">
Oct 18 11:45:44 user nova-compute[74190]:     <model>Nehalem</model>
Oct 18 11:45:44 user nova-compute[74190]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 11:45:44 user nova-compute[74190]:   </cpu>
Oct 18 11:45:44 user nova-compute[74190]:   <devices>
Oct 18 11:45:44 user nova-compute[74190]:     <disk type="file" device="disk">
Oct 18 11:45:44 user nova-compute[74190]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 11:45:44 user nova-compute[74190]:       <source file="/opt/stack/data/nova/instances/bdfe420d-f46c-44ad-8773-b675f42e24ed/disk"/>
Oct 18 11:45:44 user nova-compute[74190]:       <target dev="vda" bus="virtio"/>
Oct 18 11:45:44 user nova-compute[74190]:     </disk>
Oct 18 11:45:44 user nova-compute[74190]:     <interface type="ethernet">
Oct 18 11:45:44 user nova-compute[74190]:       <mac address="fa:16:3e:cb:ff:0f"/>
Oct 18 11:45:44 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:45:44 user nova-compute[74190]:       <mtu size="1442"/>
Oct 18 11:45:44 user nova-compute[74190]:       <target dev="tap5f5b65f1-77"/>
Oct 18 11:45:44 user nova-compute[74190]:     </interface>
Oct 18 11:45:44 user nova-compute[74190]:     <serial type="pty">
Oct 18 11:45:44 user nova-compute[74190]:       <log file="/opt/stack/data/nova/instances/bdfe420d-f46c-44ad-8773-b675f42e24ed/console.log" append="off"/>
Oct 18 11:45:44 user nova-compute[74190]:     </serial>
Oct 18 11:45:44 user nova-compute[74190]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 11:45:44 user nova-compute[74190]:     <video>
Oct 18 11:45:44 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:45:44 user nova-compute[74190]:     </video>
Oct 18 11:45:44 user nova-compute[74190]:     <rng model="virtio">
Oct 18 11:45:44 user nova-compute[74190]:       <backend model="random">/dev/urandom</backend>
Oct 18 11:45:44 user nova-compute[74190]:     </rng>
Oct 18 11:45:44 user nova-compute[74190]:     <controller type="usb" index="0" model="none"/>
Oct 18 11:45:44 user nova-compute[74190]:     <memballoon model="virtio">
Oct 18 11:45:44 user nova-compute[74190]:       <stats period="10"/>
Oct 18 11:45:44 user nova-compute[74190]:     </memballoon>
Oct 18 11:45:44 user nova-compute[74190]:   </devices>
Oct 18 11:45:44 user nova-compute[74190]: </domain>
Oct 18 11:45:44 user nova-compute[74190]:  {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 11:45:44 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-214dbcbf-4570-4a9c-af5b-a8cf7826cc10 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:45:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1652011593',display_name='tempest-ServerActionsTestOtherB-server-1652011593',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1652011593',id=13,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJf2+oC1LymyOUKrd79qlp9w/sLNNXOE0jNeE016Gw/qD1l2yX0bGo5VP+iKF1MHpeTJ2Ix6czkMyFuUdVqQvcY91kItew2KCNk3ZYu6m5FRy6Ycq3v+bQ+PiA7mcNgHFg==',key_name='tempest-keypair-1546248338',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ce179d9f22684865b577bd91bc841400',ramdisk_id='',reservation_id='r-iuitp9n6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1277618284',owner_user_name='tempest-ServerActionsTestOtherB-1277618284-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:45:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c5f5ddf3c4174afcbe7075b7f89b4f05',uuid=bdfe420d-f46c-44ad-8773-b675f42e24ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f5b65f1-7748-4422-8b45-e1b88476716d", "address": "fa:16:3e:cb:ff:0f", "network": {"id": "7be8675d-326a-4184-9b3e-fbaa02a4e1fc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-468552750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce179d9f22684865b577bd91bc841400", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5b65f1-77", "ovs_interfaceid": "5f5b65f1-7748-4422-8b45-e1b88476716d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 11:45:44 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-214dbcbf-4570-4a9c-af5b-a8cf7826cc10 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Converting VIF {"id": "5f5b65f1-7748-4422-8b45-e1b88476716d", "address": "fa:16:3e:cb:ff:0f", "network": {"id": "7be8675d-326a-4184-9b3e-fbaa02a4e1fc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-468552750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce179d9f22684865b577bd91bc841400", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5b65f1-77", "ovs_interfaceid": "5f5b65f1-7748-4422-8b45-e1b88476716d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:45:44 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-214dbcbf-4570-4a9c-af5b-a8cf7826cc10 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:ff:0f,bridge_name='br-int',has_traffic_filtering=True,id=5f5b65f1-7748-4422-8b45-e1b88476716d,network=Network(7be8675d-326a-4184-9b3e-fbaa02a4e1fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f5b65f1-77') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:45:44 user nova-compute[74190]: DEBUG os_vif [None req-214dbcbf-4570-4a9c-af5b-a8cf7826cc10 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:ff:0f,bridge_name='br-int',has_traffic_filtering=True,id=5f5b65f1-7748-4422-8b45-e1b88476716d,network=Network(7be8675d-326a-4184-9b3e-fbaa02a4e1fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f5b65f1-77') {{(pid=74190) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 11:45:44 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:44 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:45:44 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 11:45:44 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:44 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3fd0ec1e-344b-5167-9f79-aed34c0ad165', '_type': 'linux-noop'}}, row=False) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:45:44 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:44 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:44 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:44 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5f5b65f1-77, may_exist=True, interface_attrs={}) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:45:44 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5f5b65f1-77, col_values=(('qos', UUID('6c9f3f82-84f1-4012-b122-774794b36ee2')),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:45:44 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5f5b65f1-77, col_values=(('external_ids', {'iface-id': '5f5b65f1-7748-4422-8b45-e1b88476716d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cb:ff:0f', 'vm-uuid': 'bdfe420d-f46c-44ad-8773-b675f42e24ed'}),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:45:44 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:44 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:45:44 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:44 user nova-compute[74190]: INFO os_vif [None req-214dbcbf-4570-4a9c-af5b-a8cf7826cc10 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:ff:0f,bridge_name='br-int',has_traffic_filtering=True,id=5f5b65f1-7748-4422-8b45-e1b88476716d,network=Network(7be8675d-326a-4184-9b3e-fbaa02a4e1fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f5b65f1-77')
Oct 18 11:45:44 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-214dbcbf-4570-4a9c-af5b-a8cf7826cc10 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] No BDM found with device name vda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 11:45:44 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-214dbcbf-4570-4a9c-af5b-a8cf7826cc10 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] No VIF found with MAC fa:16:3e:cb:ff:0f, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 11:45:44 user nova-compute[74190]: DEBUG nova.network.neutron [req-e346a1c1-4f09-4121-9747-1a9fbeaec389 req-5707e3f9-34e9-47a7-9381-37c3f0df7cca service nova] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Updated VIF entry in instance network info cache for port 5f5b65f1-7748-4422-8b45-e1b88476716d. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 11:45:44 user nova-compute[74190]: DEBUG nova.network.neutron [req-e346a1c1-4f09-4121-9747-1a9fbeaec389 req-5707e3f9-34e9-47a7-9381-37c3f0df7cca service nova] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Updating instance_info_cache with network_info: [{"id": "5f5b65f1-7748-4422-8b45-e1b88476716d", "address": "fa:16:3e:cb:ff:0f", "network": {"id": "7be8675d-326a-4184-9b3e-fbaa02a4e1fc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-468552750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce179d9f22684865b577bd91bc841400", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5b65f1-77", "ovs_interfaceid": "5f5b65f1-7748-4422-8b45-e1b88476716d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:45:44 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-e346a1c1-4f09-4121-9747-1a9fbeaec389 req-5707e3f9-34e9-47a7-9381-37c3f0df7cca service nova] Releasing lock "refresh_cache-bdfe420d-f46c-44ad-8773-b675f42e24ed" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:45:46 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:46 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:46 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:46 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:46 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:46 user nova-compute[74190]: DEBUG nova.compute.manager [req-4fc6edfd-c81b-4a68-83b9-6b3ec12d8866 req-30dcfb7e-5e4e-4911-9d54-ae12b97ad94f service nova] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Received event network-vif-plugged-5f5b65f1-7748-4422-8b45-e1b88476716d {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:45:46 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-4fc6edfd-c81b-4a68-83b9-6b3ec12d8866 req-30dcfb7e-5e4e-4911-9d54-ae12b97ad94f service nova] Acquiring lock "bdfe420d-f46c-44ad-8773-b675f42e24ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:45:46 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-4fc6edfd-c81b-4a68-83b9-6b3ec12d8866 req-30dcfb7e-5e4e-4911-9d54-ae12b97ad94f service nova] Lock "bdfe420d-f46c-44ad-8773-b675f42e24ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:45:46 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-4fc6edfd-c81b-4a68-83b9-6b3ec12d8866 req-30dcfb7e-5e4e-4911-9d54-ae12b97ad94f service nova] Lock "bdfe420d-f46c-44ad-8773-b675f42e24ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:45:46 user nova-compute[74190]: DEBUG nova.compute.manager [req-4fc6edfd-c81b-4a68-83b9-6b3ec12d8866 req-30dcfb7e-5e4e-4911-9d54-ae12b97ad94f service nova] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] No waiting events found dispatching network-vif-plugged-5f5b65f1-7748-4422-8b45-e1b88476716d {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:45:46 user nova-compute[74190]: WARNING nova.compute.manager [req-4fc6edfd-c81b-4a68-83b9-6b3ec12d8866 req-30dcfb7e-5e4e-4911-9d54-ae12b97ad94f service nova] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Received unexpected event network-vif-plugged-5f5b65f1-7748-4422-8b45-e1b88476716d for instance with vm_state building and task_state spawning.
Oct 18 11:45:46 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:46 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:46 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:46 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:48 user nova-compute[74190]: DEBUG nova.compute.manager [req-dd3a1a2b-61cf-4580-b924-c8ef33d85a44 req-7ddd1dca-5928-4938-86a2-55bdde6d563c service nova] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Received event network-vif-plugged-5f5b65f1-7748-4422-8b45-e1b88476716d {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:45:48 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-dd3a1a2b-61cf-4580-b924-c8ef33d85a44 req-7ddd1dca-5928-4938-86a2-55bdde6d563c service nova] Acquiring lock "bdfe420d-f46c-44ad-8773-b675f42e24ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:45:48 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-dd3a1a2b-61cf-4580-b924-c8ef33d85a44 req-7ddd1dca-5928-4938-86a2-55bdde6d563c service nova] Lock "bdfe420d-f46c-44ad-8773-b675f42e24ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:45:48 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-dd3a1a2b-61cf-4580-b924-c8ef33d85a44 req-7ddd1dca-5928-4938-86a2-55bdde6d563c service nova] Lock "bdfe420d-f46c-44ad-8773-b675f42e24ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:45:48 user nova-compute[74190]: DEBUG nova.compute.manager [req-dd3a1a2b-61cf-4580-b924-c8ef33d85a44 req-7ddd1dca-5928-4938-86a2-55bdde6d563c service nova] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] No waiting events found dispatching network-vif-plugged-5f5b65f1-7748-4422-8b45-e1b88476716d {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:45:48 user nova-compute[74190]: WARNING nova.compute.manager [req-dd3a1a2b-61cf-4580-b924-c8ef33d85a44 req-7ddd1dca-5928-4938-86a2-55bdde6d563c service nova] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Received unexpected event network-vif-plugged-5f5b65f1-7748-4422-8b45-e1b88476716d for instance with vm_state building and task_state spawning.
Oct 18 11:45:48 user nova-compute[74190]: DEBUG nova.compute.manager [None req-214dbcbf-4570-4a9c-af5b-a8cf7826cc10 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Instance event wait completed in 0 seconds for  {{(pid=74190) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 11:45:48 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-214dbcbf-4570-4a9c-af5b-a8cf7826cc10 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Guest created on hypervisor {{(pid=74190) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 11:45:48 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Instance spawned successfully.
Oct 18 11:45:48 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-214dbcbf-4570-4a9c-af5b-a8cf7826cc10 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 11:45:48 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-214dbcbf-4570-4a9c-af5b-a8cf7826cc10 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Found default for hw_cdrom_bus of ide {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:45:48 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-214dbcbf-4570-4a9c-af5b-a8cf7826cc10 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Found default for hw_disk_bus of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:45:48 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-214dbcbf-4570-4a9c-af5b-a8cf7826cc10 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Found default for hw_input_bus of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:45:48 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-214dbcbf-4570-4a9c-af5b-a8cf7826cc10 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Found default for hw_pointer_model of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:45:48 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-214dbcbf-4570-4a9c-af5b-a8cf7826cc10 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Found default for hw_video_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:45:48 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-214dbcbf-4570-4a9c-af5b-a8cf7826cc10 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Found default for hw_vif_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:45:48 user nova-compute[74190]: INFO nova.compute.manager [None req-214dbcbf-4570-4a9c-af5b-a8cf7826cc10 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Took 6.42 seconds to spawn the instance on the hypervisor.
Oct 18 11:45:48 user nova-compute[74190]: DEBUG nova.compute.manager [None req-214dbcbf-4570-4a9c-af5b-a8cf7826cc10 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Checking state {{(pid=74190) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 11:45:48 user nova-compute[74190]: INFO nova.compute.manager [None req-214dbcbf-4570-4a9c-af5b-a8cf7826cc10 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Took 7.20 seconds to build instance.
Oct 18 11:45:48 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-214dbcbf-4570-4a9c-af5b-a8cf7826cc10 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Lock "bdfe420d-f46c-44ad-8773-b675f42e24ed" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.330s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:45:49 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:49 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:50 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:45:50 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:45:50 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:45:50 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:45:50 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:45:50 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Auditing locally available compute resources for user (node: user) {{(pid=74190) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 11:45:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/849ec21f-b785-47e7-a9fa-f89af1f78a2b/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:45:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/849ec21f-b785-47e7-a9fa-f89af1f78a2b/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:45:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/849ec21f-b785-47e7-a9fa-f89af1f78a2b/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:45:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/849ec21f-b785-47e7-a9fa-f89af1f78a2b/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:45:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034398e8-e8c4-4e03-a608-440e447c6041/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:45:51 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034398e8-e8c4-4e03-a608-440e447c6041/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:45:51 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034398e8-e8c4-4e03-a608-440e447c6041/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:45:51 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034398e8-e8c4-4e03-a608-440e447c6041/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:45:51 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 11:45:51 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c3cce66-9d7a-4f23-a92a-d10b3efd5e86/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:45:51 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c3cce66-9d7a-4f23-a92a-d10b3efd5e86/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:45:51 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c3cce66-9d7a-4f23-a92a-d10b3efd5e86/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:45:51 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c3cce66-9d7a-4f23-a92a-d10b3efd5e86/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:45:51 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 11:45:51 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0209c824-88a7-4976-83bf-8a72437f0cc2/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:45:51 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0209c824-88a7-4976-83bf-8a72437f0cc2/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:45:51 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0209c824-88a7-4976-83bf-8a72437f0cc2/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:45:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0209c824-88a7-4976-83bf-8a72437f0cc2/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:45:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d7b8e5-02cc-4148-86e2-ceb295e81afc/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:45:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d7b8e5-02cc-4148-86e2-ceb295e81afc/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:45:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d7b8e5-02cc-4148-86e2-ceb295e81afc/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:45:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d7b8e5-02cc-4148-86e2-ceb295e81afc/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:45:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6130edd-eb98-491e-a0ba-6bd59199d9e1/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:45:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6130edd-eb98-491e-a0ba-6bd59199d9e1/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:45:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6130edd-eb98-491e-a0ba-6bd59199d9e1/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:45:53 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6130edd-eb98-491e-a0ba-6bd59199d9e1/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:45:53 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c280652c-ffde-40f8-a919-adb8be618db8/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:45:53 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c280652c-ffde-40f8-a919-adb8be618db8/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:45:53 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c280652c-ffde-40f8-a919-adb8be618db8/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:45:53 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c280652c-ffde-40f8-a919-adb8be618db8/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:45:53 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 11:45:53 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 11:45:53 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdfe420d-f46c-44ad-8773-b675f42e24ed/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:45:53 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdfe420d-f46c-44ad-8773-b675f42e24ed/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:45:53 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdfe420d-f46c-44ad-8773-b675f42e24ed/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:45:53 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:53 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdfe420d-f46c-44ad-8773-b675f42e24ed/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:45:54 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:54 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:45:54 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:45:54 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Hypervisor/Node resource view: name=user free_ram=7645MB free_disk=25.643878936767578GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74190) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 11:45:54 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:45:54 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:45:54 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance c280652c-ffde-40f8-a919-adb8be618db8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:45:54 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 0209c824-88a7-4976-83bf-8a72437f0cc2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:45:54 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance c6130edd-eb98-491e-a0ba-6bd59199d9e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:45:54 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 034398e8-e8c4-4e03-a608-440e447c6041 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:45:54 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance aabb5eea-8366-482a-8d16-bf271c0fe8d7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:45:54 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 849ec21f-b785-47e7-a9fa-f89af1f78a2b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:45:54 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 52d7b8e5-02cc-4148-86e2-ceb295e81afc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:45:54 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:45:54 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance bdfe420d-f46c-44ad-8773-b675f42e24ed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:45:54 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 11:45:54 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 11:45:54 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 11:45:54 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 11:45:54 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Compute_service record updated for user:user {{(pid=74190) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 11:45:54 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.556s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:45:56 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:45:56 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Starting heal instance info cache {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 11:45:56 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "refresh_cache-034398e8-e8c4-4e03-a608-440e447c6041" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:45:56 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquired lock "refresh_cache-034398e8-e8c4-4e03-a608-440e447c6041" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:45:56 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 034398e8-e8c4-4e03-a608-440e447c6041] Forcefully refreshing network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 18 11:45:56 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 034398e8-e8c4-4e03-a608-440e447c6041] Updating instance_info_cache with network_info: [{"id": "abefd824-cd1a-4947-996f-85553155dd8b", "address": "fa:16:3e:42:84:1e", "network": {"id": "1424584d-abb9-4d38-bcdc-3c0969e1bf01", "bridge": "br-int", "label": "tempest-TestVolumeSwap-127887868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21f627e5a9344c9bad9923c2b0cbec3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabefd824-cd", "ovs_interfaceid": "abefd824-cd1a-4947-996f-85553155dd8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:45:57 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Releasing lock "refresh_cache-034398e8-e8c4-4e03-a608-440e447c6041" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:45:57 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 034398e8-e8c4-4e03-a608-440e447c6041] Updated the network info_cache for instance {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 18 11:45:57 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:45:57 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:45:57 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:45:57 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:45:57 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:45:57 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74190) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 11:45:57 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:45:57 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:58 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:59 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:45:59 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:46:01 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:46:03 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:46:04 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:46:04 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:46:06 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:46:09 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:46:09 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:46:13 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:46:14 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:46:14 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:46:15 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:46:19 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:46:19 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:46:19 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:46:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:46:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:46:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:46:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:46:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:46:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Acquiring lock "3bd2f6d6-9c07-42a0-869e-566d685cb025" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:46:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Lock "3bd2f6d6-9c07-42a0-869e-566d685cb025" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:46:34 user nova-compute[74190]: INFO nova.compute.manager [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Unshelving
Oct 18 11:46:34 user nova-compute[74190]: INFO nova.virt.block_device [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Booting with volume 2d829820-7b5f-42f9-81ab-8efc923f288a at /dev/vda
Oct 18 11:46:34 user nova-compute[74190]: DEBUG os_brick.utils [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:46:34 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:46:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:46:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:46:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74190) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 11:46:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 11:46:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 11:46:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:46:34 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:46:34 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf617dd-e5ef-4d88-a19a-860680b8ca51]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cff158e257e1\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:46:34 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:46:34 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.030s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:46:34 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bec0c2a-f601-4270-a775-e6c9c635fc59]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:46:34 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:46:34 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:46:34 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce7e59d-a1c0-4f42-820b-e5b9979dbaec]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:46:34 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b957f7-6dc6-4396-9c0b-db8f5b2bd755]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:46:34 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Running cmd (subprocess): nvme version {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:46:34 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] 'nvme version' failed. Not Retrying. {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 11:46:34 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] nvme not present on system {{(pid=74190) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 11:46:34 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:46:34 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 11:46:34 user nova-compute[74190]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 11:46:34 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[9714d706-a59d-4d17-bbae-9769b38900d6]: (4, '') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:46:34 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74190) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 11:46:34 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 11:46:34 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] LIGHTOS: no hostnqn found. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 11:46:34 user nova-compute[74190]: DEBUG os_brick.utils [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cff158e257e1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:46:34 user nova-compute[74190]: DEBUG nova.virt.block_device [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Updating existing volume attachment record: 3389f83d-ceb6-49a2-ab95-b052b6b9f769 {{(pid=74190) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 11:46:39 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:46:39 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:46:39 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-0d40ca1d-ace3-46be-9eba-89fa41fccdb7 tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Acquiring lock "849ec21f-b785-47e7-a9fa-f89af1f78a2b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:46:39 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-0d40ca1d-ace3-46be-9eba-89fa41fccdb7 tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Lock "849ec21f-b785-47e7-a9fa-f89af1f78a2b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:46:39 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-0d40ca1d-ace3-46be-9eba-89fa41fccdb7 tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Acquiring lock "849ec21f-b785-47e7-a9fa-f89af1f78a2b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:46:39 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-0d40ca1d-ace3-46be-9eba-89fa41fccdb7 tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Lock "849ec21f-b785-47e7-a9fa-f89af1f78a2b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:46:39 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-0d40ca1d-ace3-46be-9eba-89fa41fccdb7 tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Lock "849ec21f-b785-47e7-a9fa-f89af1f78a2b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:46:39 user nova-compute[74190]: INFO nova.compute.manager [None req-0d40ca1d-ace3-46be-9eba-89fa41fccdb7 tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] [instance: 849ec21f-b785-47e7-a9fa-f89af1f78a2b] Terminating instance
Oct 18 11:46:39 user nova-compute[74190]: DEBUG nova.compute.manager [None req-0d40ca1d-ace3-46be-9eba-89fa41fccdb7 tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] [instance: 849ec21f-b785-47e7-a9fa-f89af1f78a2b] Start destroying the instance on the hypervisor. {{(pid=74190) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 11:46:39 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:46:39 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:46:40 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:46:40 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:46:40 user nova-compute[74190]: DEBUG nova.compute.manager [req-7f46b1f3-3d1b-4a3b-99d8-0eeb6406bd01 req-317ba9e6-fe4f-4383-a05a-b05329611e0e service nova] [instance: 849ec21f-b785-47e7-a9fa-f89af1f78a2b] Received event network-vif-unplugged-95e0a8d6-2dba-4fb8-8d7d-b630e649d0f8 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:46:40 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-7f46b1f3-3d1b-4a3b-99d8-0eeb6406bd01 req-317ba9e6-fe4f-4383-a05a-b05329611e0e service nova] Acquiring lock "849ec21f-b785-47e7-a9fa-f89af1f78a2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:46:40 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-7f46b1f3-3d1b-4a3b-99d8-0eeb6406bd01 req-317ba9e6-fe4f-4383-a05a-b05329611e0e service nova] Lock "849ec21f-b785-47e7-a9fa-f89af1f78a2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:46:40 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-7f46b1f3-3d1b-4a3b-99d8-0eeb6406bd01 req-317ba9e6-fe4f-4383-a05a-b05329611e0e service nova] Lock "849ec21f-b785-47e7-a9fa-f89af1f78a2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:46:40 user nova-compute[74190]: DEBUG nova.compute.manager [req-7f46b1f3-3d1b-4a3b-99d8-0eeb6406bd01 req-317ba9e6-fe4f-4383-a05a-b05329611e0e service nova] [instance: 849ec21f-b785-47e7-a9fa-f89af1f78a2b] No waiting events found dispatching network-vif-unplugged-95e0a8d6-2dba-4fb8-8d7d-b630e649d0f8 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:46:40 user nova-compute[74190]: DEBUG nova.compute.manager [req-7f46b1f3-3d1b-4a3b-99d8-0eeb6406bd01 req-317ba9e6-fe4f-4383-a05a-b05329611e0e service nova] [instance: 849ec21f-b785-47e7-a9fa-f89af1f78a2b] Received event network-vif-unplugged-95e0a8d6-2dba-4fb8-8d7d-b630e649d0f8 for instance with task_state deleting. {{(pid=74190) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 11:46:40 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 849ec21f-b785-47e7-a9fa-f89af1f78a2b] Instance destroyed successfully.
Oct 18 11:46:40 user nova-compute[74190]: DEBUG nova.objects.instance [None req-0d40ca1d-ace3-46be-9eba-89fa41fccdb7 tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Lazy-loading 'resources' on Instance uuid 849ec21f-b785-47e7-a9fa-f89af1f78a2b {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:46:40 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-0d40ca1d-ace3-46be-9eba-89fa41fccdb7 tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:44:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1931953829',display_name='tempest-VolumesAdminNegativeTest-server-1931953829',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1931953829',id=11,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-18T11:44:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6d83064382624b4d895b0d7bff463f4f',ramdisk_id='',reservation_id='r-0mdrup09',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1125052526',owner_user_name='tempest-VolumesAdminNegativeTest-1125052526-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T11:44:41Z,user_data=None,user_id='4c68a9cb13814419a38413f9513d5a80',uuid=849ec21f-b785-47e7-a9fa-f89af1f78a2b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "95e0a8d6-2dba-4fb8-8d7d-b630e649d0f8", "address": "fa:16:3e:ed:16:7e", "network": {"id": "c174814d-6217-4201-9af1-1575a8dcf751", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-981245321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d83064382624b4d895b0d7bff463f4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95e0a8d6-2d", "ovs_interfaceid": "95e0a8d6-2dba-4fb8-8d7d-b630e649d0f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 11:46:40 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-0d40ca1d-ace3-46be-9eba-89fa41fccdb7 tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Converting VIF {"id": "95e0a8d6-2dba-4fb8-8d7d-b630e649d0f8", "address": "fa:16:3e:ed:16:7e", "network": {"id": "c174814d-6217-4201-9af1-1575a8dcf751", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-981245321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d83064382624b4d895b0d7bff463f4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95e0a8d6-2d", "ovs_interfaceid": "95e0a8d6-2dba-4fb8-8d7d-b630e649d0f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:46:40 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-0d40ca1d-ace3-46be-9eba-89fa41fccdb7 tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:16:7e,bridge_name='br-int',has_traffic_filtering=True,id=95e0a8d6-2dba-4fb8-8d7d-b630e649d0f8,network=Network(c174814d-6217-4201-9af1-1575a8dcf751),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95e0a8d6-2d') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:46:40 user nova-compute[74190]: DEBUG os_vif [None req-0d40ca1d-ace3-46be-9eba-89fa41fccdb7 tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:16:7e,bridge_name='br-int',has_traffic_filtering=True,id=95e0a8d6-2dba-4fb8-8d7d-b630e649d0f8,network=Network(c174814d-6217-4201-9af1-1575a8dcf751),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95e0a8d6-2d') {{(pid=74190) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 11:46:40 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:46:40 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap95e0a8d6-2d, bridge=br-int, if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:46:40 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:46:40 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:46:40 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:46:40 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7347b8e6-49df-4f2a-8cfd-e2e4049bef27) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:46:40 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:46:40 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:46:40 user nova-compute[74190]: INFO os_vif [None req-0d40ca1d-ace3-46be-9eba-89fa41fccdb7 tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:16:7e,bridge_name='br-int',has_traffic_filtering=True,id=95e0a8d6-2dba-4fb8-8d7d-b630e649d0f8,network=Network(c174814d-6217-4201-9af1-1575a8dcf751),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95e0a8d6-2d')
Oct 18 11:46:40 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-0d40ca1d-ace3-46be-9eba-89fa41fccdb7 tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] [instance: 849ec21f-b785-47e7-a9fa-f89af1f78a2b] Deleting instance files /opt/stack/data/nova/instances/849ec21f-b785-47e7-a9fa-f89af1f78a2b_del
Oct 18 11:46:40 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-0d40ca1d-ace3-46be-9eba-89fa41fccdb7 tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] [instance: 849ec21f-b785-47e7-a9fa-f89af1f78a2b] Deletion of /opt/stack/data/nova/instances/849ec21f-b785-47e7-a9fa-f89af1f78a2b_del complete
Oct 18 11:46:40 user nova-compute[74190]: INFO nova.compute.manager [None req-0d40ca1d-ace3-46be-9eba-89fa41fccdb7 tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] [instance: 849ec21f-b785-47e7-a9fa-f89af1f78a2b] Took 1.05 seconds to destroy the instance on the hypervisor.
Oct 18 11:46:40 user nova-compute[74190]: DEBUG oslo.service.loopingcall [None req-0d40ca1d-ace3-46be-9eba-89fa41fccdb7 tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74190) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 11:46:40 user nova-compute[74190]: DEBUG nova.compute.manager [-] [instance: 849ec21f-b785-47e7-a9fa-f89af1f78a2b] Deallocating network for instance {{(pid=74190) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 11:46:40 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: 849ec21f-b785-47e7-a9fa-f89af1f78a2b] deallocate_for_instance() {{(pid=74190) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 11:46:41 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: 849ec21f-b785-47e7-a9fa-f89af1f78a2b] Updating instance_info_cache with network_info: [] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:46:41 user nova-compute[74190]: INFO nova.compute.manager [-] [instance: 849ec21f-b785-47e7-a9fa-f89af1f78a2b] Took 0.52 seconds to deallocate network for instance.
Oct 18 11:46:41 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-0d40ca1d-ace3-46be-9eba-89fa41fccdb7 tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:46:41 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-0d40ca1d-ace3-46be-9eba-89fa41fccdb7 tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:46:41 user nova-compute[74190]: DEBUG nova.compute.manager [req-bb90dcc8-1d23-4e1a-9458-c6fe1cf48a27 req-024a8aab-0988-46e5-89aa-58071ff03720 service nova] [instance: 849ec21f-b785-47e7-a9fa-f89af1f78a2b] Received event network-vif-deleted-95e0a8d6-2dba-4fb8-8d7d-b630e649d0f8 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:46:41 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-0d40ca1d-ace3-46be-9eba-89fa41fccdb7 tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 11:46:41 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-0d40ca1d-ace3-46be-9eba-89fa41fccdb7 tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 11:46:41 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-0d40ca1d-ace3-46be-9eba-89fa41fccdb7 tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.361s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:46:41 user nova-compute[74190]: INFO nova.scheduler.client.report [None req-0d40ca1d-ace3-46be-9eba-89fa41fccdb7 tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Deleted allocations for instance 849ec21f-b785-47e7-a9fa-f89af1f78a2b
Oct 18 11:46:41 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-0d40ca1d-ace3-46be-9eba-89fa41fccdb7 tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Lock "849ec21f-b785-47e7-a9fa-f89af1f78a2b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.125s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:46:42 user nova-compute[74190]: DEBUG nova.compute.manager [req-c85f4984-fb65-406f-ba73-70aedff2155b req-3cc7d9c0-bfb3-4c90-899f-0c2d4e9ede1a service nova] [instance: 849ec21f-b785-47e7-a9fa-f89af1f78a2b] Received event network-vif-plugged-95e0a8d6-2dba-4fb8-8d7d-b630e649d0f8 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:46:42 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-c85f4984-fb65-406f-ba73-70aedff2155b req-3cc7d9c0-bfb3-4c90-899f-0c2d4e9ede1a service nova] Acquiring lock "849ec21f-b785-47e7-a9fa-f89af1f78a2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:46:42 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-c85f4984-fb65-406f-ba73-70aedff2155b req-3cc7d9c0-bfb3-4c90-899f-0c2d4e9ede1a service nova] Lock "849ec21f-b785-47e7-a9fa-f89af1f78a2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:46:42 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-c85f4984-fb65-406f-ba73-70aedff2155b req-3cc7d9c0-bfb3-4c90-899f-0c2d4e9ede1a service nova] Lock "849ec21f-b785-47e7-a9fa-f89af1f78a2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:46:42 user nova-compute[74190]: DEBUG nova.compute.manager [req-c85f4984-fb65-406f-ba73-70aedff2155b req-3cc7d9c0-bfb3-4c90-899f-0c2d4e9ede1a service nova] [instance: 849ec21f-b785-47e7-a9fa-f89af1f78a2b] No waiting events found dispatching network-vif-plugged-95e0a8d6-2dba-4fb8-8d7d-b630e649d0f8 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:46:42 user nova-compute[74190]: WARNING nova.compute.manager [req-c85f4984-fb65-406f-ba73-70aedff2155b req-3cc7d9c0-bfb3-4c90-899f-0c2d4e9ede1a service nova] [instance: 849ec21f-b785-47e7-a9fa-f89af1f78a2b] Received unexpected event network-vif-plugged-95e0a8d6-2dba-4fb8-8d7d-b630e649d0f8 for instance with vm_state deleted and task_state None.
Oct 18 11:46:43 user nova-compute[74190]: DEBUG nova.compute.manager [req-e791239a-e513-4208-9345-101b22b700aa req-32460958-5f2a-4a6d-b43a-d47634678f69 service nova] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Received event network-changed-550e157d-7f82-41a1-b4ba-9dbb43037d8c {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:46:43 user nova-compute[74190]: DEBUG nova.compute.manager [req-e791239a-e513-4208-9345-101b22b700aa req-32460958-5f2a-4a6d-b43a-d47634678f69 service nova] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Refreshing instance network info cache due to event network-changed-550e157d-7f82-41a1-b4ba-9dbb43037d8c. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 11:46:43 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-e791239a-e513-4208-9345-101b22b700aa req-32460958-5f2a-4a6d-b43a-d47634678f69 service nova] Acquiring lock "refresh_cache-52d7b8e5-02cc-4148-86e2-ceb295e81afc" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:46:43 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-e791239a-e513-4208-9345-101b22b700aa req-32460958-5f2a-4a6d-b43a-d47634678f69 service nova] Acquired lock "refresh_cache-52d7b8e5-02cc-4148-86e2-ceb295e81afc" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:46:43 user nova-compute[74190]: DEBUG nova.network.neutron [req-e791239a-e513-4208-9345-101b22b700aa req-32460958-5f2a-4a6d-b43a-d47634678f69 service nova] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Refreshing network info cache for port 550e157d-7f82-41a1-b4ba-9dbb43037d8c {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 11:46:44 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:46:44 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-09f083d4-f775-48d7-aef9-d3dd7dee7c2c tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Acquiring lock "52d7b8e5-02cc-4148-86e2-ceb295e81afc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:46:44 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-09f083d4-f775-48d7-aef9-d3dd7dee7c2c tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lock "52d7b8e5-02cc-4148-86e2-ceb295e81afc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:46:44 user nova-compute[74190]: DEBUG nova.network.neutron [req-e791239a-e513-4208-9345-101b22b700aa req-32460958-5f2a-4a6d-b43a-d47634678f69 service nova] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Updated VIF entry in instance network info cache for port 550e157d-7f82-41a1-b4ba-9dbb43037d8c. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 11:46:44 user nova-compute[74190]: DEBUG nova.network.neutron [req-e791239a-e513-4208-9345-101b22b700aa req-32460958-5f2a-4a6d-b43a-d47634678f69 service nova] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Updating instance_info_cache with network_info: [{"id": "550e157d-7f82-41a1-b4ba-9dbb43037d8c", "address": "fa:16:3e:88:36:f0", "network": {"id": "f5ab7da4-2b07-4465-9a89-a07eb053ba91", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1315695374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08cf52ce927443158aa731367f08bd57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap550e157d-7f", "ovs_interfaceid": "550e157d-7f82-41a1-b4ba-9dbb43037d8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:46:44 user nova-compute[74190]: DEBUG nova.objects.instance [None req-09f083d4-f775-48d7-aef9-d3dd7dee7c2c tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lazy-loading 'flavor' on Instance uuid 52d7b8e5-02cc-4148-86e2-ceb295e81afc {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:46:44 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-e791239a-e513-4208-9345-101b22b700aa req-32460958-5f2a-4a6d-b43a-d47634678f69 service nova] Releasing lock "refresh_cache-52d7b8e5-02cc-4148-86e2-ceb295e81afc" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:46:44 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-09f083d4-f775-48d7-aef9-d3dd7dee7c2c tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lock "52d7b8e5-02cc-4148-86e2-ceb295e81afc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:46:44 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-09f083d4-f775-48d7-aef9-d3dd7dee7c2c tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Acquiring lock "52d7b8e5-02cc-4148-86e2-ceb295e81afc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:46:44 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-09f083d4-f775-48d7-aef9-d3dd7dee7c2c tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lock "52d7b8e5-02cc-4148-86e2-ceb295e81afc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:46:44 user nova-compute[74190]: INFO nova.compute.manager [None req-09f083d4-f775-48d7-aef9-d3dd7dee7c2c tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Attaching volume b46a9877-5222-479e-a581-dfc0618bfe49 to /dev/vdb
Oct 18 11:46:44 user nova-compute[74190]: DEBUG os_brick.utils [None req-09f083d4-f775-48d7-aef9-d3dd7dee7c2c tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:46:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:46:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:46:44 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d101620-efab-4476-9859-e0fb8b035500]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cff158e257e1\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:46:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:46:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:46:44 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce4e5ccd-102b-4ded-9b5a-c515d7ae881c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:46:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:46:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:46:44 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c31563-e85b-4290-a274-38be2726a358]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:46:44 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[2866ecbb-f353-4d3b-82b9-7ddd430a1518]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:46:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-09f083d4-f775-48d7-aef9-d3dd7dee7c2c tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Running cmd (subprocess): nvme version {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:46:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-09f083d4-f775-48d7-aef9-d3dd7dee7c2c tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] 'nvme version' failed. Not Retrying. {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 11:46:44 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.nvmeof [None req-09f083d4-f775-48d7-aef9-d3dd7dee7c2c tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] nvme not present on system {{(pid=74190) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 11:46:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:46:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 11:46:44 user nova-compute[74190]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 11:46:44 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccbfdf95-4330-4b88-b83f-07f2a67949a4]: (4, '') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:46:44 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-09f083d4-f775-48d7-aef9-d3dd7dee7c2c tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74190) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 11:46:44 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-09f083d4-f775-48d7-aef9-d3dd7dee7c2c tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 11:46:44 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-09f083d4-f775-48d7-aef9-d3dd7dee7c2c tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] LIGHTOS: no hostnqn found. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 11:46:44 user nova-compute[74190]: DEBUG os_brick.utils [None req-09f083d4-f775-48d7-aef9-d3dd7dee7c2c tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cff158e257e1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:46:44 user nova-compute[74190]: DEBUG nova.virt.block_device [None req-09f083d4-f775-48d7-aef9-d3dd7dee7c2c tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Updating existing volume attachment record: fc6ddbe1-ce2a-4b11-b3b9-ceea3d1a3ee3 {{(pid=74190) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 11:46:45 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:46:45 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Cleaning up deleted instances {{(pid=74190) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 18 11:46:45 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] There are 0 instances to clean {{(pid=74190) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 18 11:46:45 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-3b672764-b64d-4483-b298-31236a15e644 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Acquiring lock "3c3cce66-9d7a-4f23-a92a-d10b3efd5e86" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:46:45 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-3b672764-b64d-4483-b298-31236a15e644 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Lock "3c3cce66-9d7a-4f23-a92a-d10b3efd5e86" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:46:45 user nova-compute[74190]: INFO nova.compute.manager [None req-3b672764-b64d-4483-b298-31236a15e644 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Detaching volume ed247316-68aa-443b-90b8-b42632ce1a86
Oct 18 11:46:45 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:46:45 user nova-compute[74190]: INFO nova.virt.block_device [None req-3b672764-b64d-4483-b298-31236a15e644 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Attempting to driver detach volume ed247316-68aa-443b-90b8-b42632ce1a86 from mountpoint /dev/vdc
Oct 18 11:46:45 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-3b672764-b64d-4483-b298-31236a15e644 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Attempting to detach device vdc from instance 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86 from the persistent domain config. {{(pid=74190) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 18 11:46:45 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-3b672764-b64d-4483-b298-31236a15e644 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 11:46:45 user nova-compute[74190]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 11:46:45 user nova-compute[74190]:   <source dev="/dev/sdc"/>
Oct 18 11:46:45 user nova-compute[74190]:   <target dev="vdc" bus="virtio"/>
Oct 18 11:46:45 user nova-compute[74190]:   <serial>ed247316-68aa-443b-90b8-b42632ce1a86</serial>
Oct 18 11:46:45 user nova-compute[74190]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 18 11:46:45 user nova-compute[74190]: </disk>
Oct 18 11:46:45 user nova-compute[74190]:  {{(pid=74190) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 11:46:45 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-3b672764-b64d-4483-b298-31236a15e644 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Successfully detached device vdc from instance 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86 from the persistent domain config.
Oct 18 11:46:45 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-3b672764-b64d-4483-b298-31236a15e644 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86 from the live domain config. {{(pid=74190) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 18 11:46:45 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-3b672764-b64d-4483-b298-31236a15e644 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 11:46:45 user nova-compute[74190]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 11:46:45 user nova-compute[74190]:   <source dev="/dev/sdc"/>
Oct 18 11:46:45 user nova-compute[74190]:   <target dev="vdc" bus="virtio"/>
Oct 18 11:46:45 user nova-compute[74190]:   <serial>ed247316-68aa-443b-90b8-b42632ce1a86</serial>
Oct 18 11:46:45 user nova-compute[74190]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 18 11:46:45 user nova-compute[74190]: </disk>
Oct 18 11:46:45 user nova-compute[74190]:  {{(pid=74190) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 11:46:46 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-3b672764-b64d-4483-b298-31236a15e644 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86 {{(pid=74190) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 18 11:46:47 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:46:47 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74190) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 18 11:46:49 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:46:50 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:46:51 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:46:51 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:46:51 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:46:51 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:46:51 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:46:51 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:46:51 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Auditing locally available compute resources for user (node: user) {{(pid=74190) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 11:46:51 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034398e8-e8c4-4e03-a608-440e447c6041/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:46:51 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034398e8-e8c4-4e03-a608-440e447c6041/disk --force-share --output=json" returned: 0 in 0.276s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:46:51 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034398e8-e8c4-4e03-a608-440e447c6041/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:46:51 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034398e8-e8c4-4e03-a608-440e447c6041/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:46:51 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 11:46:51 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c3cce66-9d7a-4f23-a92a-d10b3efd5e86/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:46:51 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c3cce66-9d7a-4f23-a92a-d10b3efd5e86/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:46:51 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c3cce66-9d7a-4f23-a92a-d10b3efd5e86/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:46:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c3cce66-9d7a-4f23-a92a-d10b3efd5e86/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:46:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0209c824-88a7-4976-83bf-8a72437f0cc2/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:46:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0209c824-88a7-4976-83bf-8a72437f0cc2/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:46:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0209c824-88a7-4976-83bf-8a72437f0cc2/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:46:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0209c824-88a7-4976-83bf-8a72437f0cc2/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:46:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d7b8e5-02cc-4148-86e2-ceb295e81afc/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:46:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d7b8e5-02cc-4148-86e2-ceb295e81afc/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:46:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d7b8e5-02cc-4148-86e2-ceb295e81afc/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:46:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d7b8e5-02cc-4148-86e2-ceb295e81afc/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:46:53 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6130edd-eb98-491e-a0ba-6bd59199d9e1/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:46:53 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:46:53 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.004s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:46:53 user nova-compute[74190]: DEBUG nova.objects.instance [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Lazy-loading 'pci_requests' on Instance uuid 3bd2f6d6-9c07-42a0-869e-566d685cb025 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:46:53 user nova-compute[74190]: DEBUG nova.objects.instance [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Lazy-loading 'numa_topology' on Instance uuid 3bd2f6d6-9c07-42a0-869e-566d685cb025 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:46:53 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74190) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 11:46:53 user nova-compute[74190]: INFO nova.compute.claims [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Claim successful on node user
Oct 18 11:46:53 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6130edd-eb98-491e-a0ba-6bd59199d9e1/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:46:53 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6130edd-eb98-491e-a0ba-6bd59199d9e1/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:46:53 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6130edd-eb98-491e-a0ba-6bd59199d9e1/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:46:53 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c280652c-ffde-40f8-a919-adb8be618db8/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:46:53 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 11:46:53 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 11:46:53 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.540s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:46:53 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c280652c-ffde-40f8-a919-adb8be618db8/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:46:53 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c280652c-ffde-40f8-a919-adb8be618db8/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:46:53 user nova-compute[74190]: INFO nova.network.neutron [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Updating port 9eca4d9a-28f0-4818-beef-e65c22f351dd with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 18 11:46:53 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c280652c-ffde-40f8-a919-adb8be618db8/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:46:53 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 11:46:53 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 11:46:53 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdfe420d-f46c-44ad-8773-b675f42e24ed/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:46:54 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdfe420d-f46c-44ad-8773-b675f42e24ed/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:46:54 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdfe420d-f46c-44ad-8773-b675f42e24ed/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:46:54 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:46:54 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdfe420d-f46c-44ad-8773-b675f42e24ed/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:46:54 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Acquiring lock "refresh_cache-3bd2f6d6-9c07-42a0-869e-566d685cb025" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:46:54 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Acquired lock "refresh_cache-3bd2f6d6-9c07-42a0-869e-566d685cb025" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:46:54 user nova-compute[74190]: DEBUG nova.network.neutron [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Building network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 11:46:54 user nova-compute[74190]: DEBUG nova.compute.manager [req-4e62bc30-a60a-4f2b-87f5-b572a0311f72 req-7be53ec0-ad9d-4039-8b0d-c220751796c2 service nova] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Received event network-changed-9eca4d9a-28f0-4818-beef-e65c22f351dd {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:46:54 user nova-compute[74190]: DEBUG nova.compute.manager [req-4e62bc30-a60a-4f2b-87f5-b572a0311f72 req-7be53ec0-ad9d-4039-8b0d-c220751796c2 service nova] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Refreshing instance network info cache due to event network-changed-9eca4d9a-28f0-4818-beef-e65c22f351dd. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 11:46:54 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-4e62bc30-a60a-4f2b-87f5-b572a0311f72 req-7be53ec0-ad9d-4039-8b0d-c220751796c2 service nova] Acquiring lock "refresh_cache-3bd2f6d6-9c07-42a0-869e-566d685cb025" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:46:54 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:46:54 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:46:54 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Hypervisor/Node resource view: name=user free_ram=7711MB free_disk=25.63030242919922GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74190) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 11:46:54 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:46:54 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:46:54 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance c280652c-ffde-40f8-a919-adb8be618db8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:46:54 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 0209c824-88a7-4976-83bf-8a72437f0cc2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:46:54 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance c6130edd-eb98-491e-a0ba-6bd59199d9e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:46:54 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 034398e8-e8c4-4e03-a608-440e447c6041 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:46:54 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance aabb5eea-8366-482a-8d16-bf271c0fe8d7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:46:54 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 52d7b8e5-02cc-4148-86e2-ceb295e81afc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:46:54 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:46:54 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance bdfe420d-f46c-44ad-8773-b675f42e24ed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:46:54 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (11291cdf-1d1c-43a5-bad7-6a29a5f06f66): {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. Skipping heal of allocations during the task state transition. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1777}}
Oct 18 11:46:54 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 11:46:54 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 11:46:55 user nova-compute[74190]: DEBUG nova.network.neutron [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Updating instance_info_cache with network_info: [{"id": "9eca4d9a-28f0-4818-beef-e65c22f351dd", "address": "fa:16:3e:f6:77:76", "network": {"id": "0c5cbb41-ba77-494a-904b-4c37e3205eb9", "bridge": "br-int", "label": "tempest-TestShelveInstance-1626181921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d3e15d2b7944cba9ed86eb5c01ec98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9eca4d9a-28", "ovs_interfaceid": "9eca4d9a-28f0-4818-beef-e65c22f351dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:46:55 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 11:46:55 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Releasing lock "refresh_cache-3bd2f6d6-9c07-42a0-869e-566d685cb025" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:46:55 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Creating instance directory {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 11:46:55 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Creating image(s)
Oct 18 11:46:55 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Did not create local disks {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 18 11:46:55 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Ensure instance console log exists: /opt/stack/data/nova/instances/3bd2f6d6-9c07-42a0-869e-566d685cb025/console.log {{(pid=74190) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 11:46:55 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:46:55 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:46:55 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:46:55 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Start _get_guest_xml network_info=[{"id": "9eca4d9a-28f0-4818-beef-e65c22f351dd", "address": "fa:16:3e:f6:77:76", "network": {"id": "0c5cbb41-ba77-494a-904b-4c37e3205eb9", "bridge": "br-int", "label": "tempest-TestShelveInstance-1626181921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d3e15d2b7944cba9ed86eb5c01ec98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9eca4d9a-28", "ovs_interfaceid": "9eca4d9a-28f0-4818-beef-e65c22f351dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bnWydGUY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3bd2f6d6-9c07-42a0-869e-566d685cb025', 'attached_at': '', 'detached_at': '', 'volume_id': '2d829820-7b5f-42f9-81ab-8efc923f288a', 'serial': '2d829820-7b5f-42f9-81ab-8efc923f288a'}, 'delete_on_termination': True, 'guest_format': None, 'attachment_id': '3389f83d-ceb6-49a2-ab95-b052b6b9f769', 'volume_type': None} {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 11:46:55 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-4e62bc30-a60a-4f2b-87f5-b572a0311f72 req-7be53ec0-ad9d-4039-8b0d-c220751796c2 service nova] Acquired lock "refresh_cache-3bd2f6d6-9c07-42a0-869e-566d685cb025" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:46:55 user nova-compute[74190]: DEBUG nova.network.neutron [req-4e62bc30-a60a-4f2b-87f5-b572a0311f72 req-7be53ec0-ad9d-4039-8b0d-c220751796c2 service nova] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Refreshing network info cache for port 9eca4d9a-28f0-4818-beef-e65c22f351dd {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 11:46:55 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 11:46:55 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:46:55 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:46:55 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 11:46:55 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] CPU controller missing on host. {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 11:46:55 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 11:46:55 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] CPU controller found on host. {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 11:46:55 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74190) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 11:46:55 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T11:37:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 11:46:55 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Flavor limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 11:46:55 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Image limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 11:46:55 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Flavor pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 11:46:55 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Image pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 11:46:55 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 11:46:55 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 11:46:55 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 11:46:55 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Got 1 possible topologies {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 11:46:55 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 11:46:55 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 11:46:55 user nova-compute[74190]: DEBUG nova.objects.instance [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3bd2f6d6-9c07-42a0-869e-566d685cb025 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:46:55 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Compute_service record updated for user:user {{(pid=74190) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 11:46:55 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.445s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:46:55 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:46:55 user nova-compute[74190]: DEBUG nova.objects.base [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Object Instance<3bd2f6d6-9c07-42a0-869e-566d685cb025> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=74190) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 11:46:55 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Calling os-brick to attach iSCSI Volume {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 11:46:55 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bnWydGUY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:46:55 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:46:55 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:46:55 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:46:55 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:46:55 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:46:55 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:46:55 user nova-compute[74190]: INFO os_brick.initiator.connectors.iscsi [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 11:46:55 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a -p 172.16.0.220:3260 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:46:55 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:46:55 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[41db4d47-592f-4a95-b587-d93f141a350f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:46:55 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 11:46:55 user nova-compute[74190]:  {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:46:55 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a -p 172.16.0.220:3260 --interface default --op new {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:46:55 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:46:55 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[b88737f6-6188-4b80-b27c-d36d51ab4b76]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a] added\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:46:55 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a] added
Oct 18 11:46:55 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:46:55 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:46:55 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.039s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:46:55 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[a26864b3-f39e-45c2-91df-d263d1830b4e]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:46:55 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:46:55 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:46:55 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:46:55 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b16dd85-e782-43fa-8e57-e931543b0e2c]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:46:55 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:46:55 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bnWydGUY {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:46:55 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bnWydGUY" returned: 0 in 0.032s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:46:55 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[96267bfe-815e-4cb8-a954-d9906337f92e]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:46:55 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bnWydGUY'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:46:55 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:46:55 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:46:55 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ba311e-00cf-4ac6-a241-b49b8bd819a9]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:46:55 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:46:55 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:46:55 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:46:55 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ebda317-a85f-4fee-b487-aff3bc3aeb0e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed247316-68aa-443b-90b8-b42632ce1a86 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:46:55 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920 (non-flash)
Oct 18 11:46:55 user nova-compute[74190]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)
Oct 18 11:46:55 user nova-compute[74190]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed247316-68aa-443b-90b8-b42632ce1a86 (non-flash)
Oct 18 11:46:55 user nova-compute[74190]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)
Oct 18 11:46:55 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:46:55 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920 (non-flash)
Oct 18 11:46:55 user nova-compute[74190]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)
Oct 18 11:46:55 user nova-compute[74190]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed247316-68aa-443b-90b8-b42632ce1a86 (non-flash)
Oct 18 11:46:55 user nova-compute[74190]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)
Oct 18 11:46:55 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:46:55 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a -p 172.16.0.220:3260 --login {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:46:55 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:46:55 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[a41a13b9-954a-444b-a7c7-c38ccca08161]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:46:55 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a, portal: 172.16.0.220,3260]
Oct 18 11:46:55 user nova-compute[74190]: Login to [iface: default, target: iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a, portal: 172.16.0.220,3260] successful.
Oct 18 11:46:55 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:46:55 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:46:55 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:46:55 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f8324bb-b310-4d84-8413-814b5045f8ab]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:46:55 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:46:55 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:46:55 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:46:55 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dde5de0-874e-4dd5-9e53-cdc724dba00a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed247316-68aa-443b-90b8-b42632ce1a86 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:46:55 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920 (non-flash)
Oct 18 11:46:55 user nova-compute[74190]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)
Oct 18 11:46:55 user nova-compute[74190]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed247316-68aa-443b-90b8-b42632ce1a86 (non-flash)
Oct 18 11:46:55 user nova-compute[74190]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)
Oct 18 11:46:55 user nova-compute[74190]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)
Oct 18 11:46:55 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:46:55 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920 (non-flash)
Oct 18 11:46:55 user nova-compute[74190]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)
Oct 18 11:46:55 user nova-compute[74190]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed247316-68aa-443b-90b8-b42632ce1a86 (non-flash)
Oct 18 11:46:55 user nova-compute[74190]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)
Oct 18 11:46:55 user nova-compute[74190]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)
Oct 18 11:46:55 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:46:55 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.372s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:46:55 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Connected to 172.16.0.220:3260 {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 11:46:55 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] HCTL ('37', '-', '-', 0) found on session 15 with lun 0 {{(pid=74190) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 11:46:55 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74190) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 11:46:55 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:46:55 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:46:55 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[53263862-18f7-40b0-877e-cb9a25288c55]: (4, ('- - 0', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:46:55 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Searching for a device in session 15 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74190) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 11:46:55 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bnWydGUY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 11:46:55 user nova-compute[74190]: DEBUG nova.network.neutron [req-4e62bc30-a60a-4f2b-87f5-b572a0311f72 req-7be53ec0-ad9d-4039-8b0d-c220751796c2 service nova] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Updated VIF entry in instance network info cache for port 9eca4d9a-28f0-4818-beef-e65c22f351dd. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 11:46:55 user nova-compute[74190]: DEBUG nova.network.neutron [req-4e62bc30-a60a-4f2b-87f5-b572a0311f72 req-7be53ec0-ad9d-4039-8b0d-c220751796c2 service nova] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Updating instance_info_cache with network_info: [{"id": "9eca4d9a-28f0-4818-beef-e65c22f351dd", "address": "fa:16:3e:f6:77:76", "network": {"id": "0c5cbb41-ba77-494a-904b-4c37e3205eb9", "bridge": "br-int", "label": "tempest-TestShelveInstance-1626181921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d3e15d2b7944cba9ed86eb5c01ec98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9eca4d9a-28", "ovs_interfaceid": "9eca4d9a-28f0-4818-beef-e65c22f351dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:46:55 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-4e62bc30-a60a-4f2b-87f5-b572a0311f72 req-7be53ec0-ad9d-4039-8b0d-c220751796c2 service nova] Releasing lock "refresh_cache-3bd2f6d6-9c07-42a0-869e-566d685cb025" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:46:55 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:46:56 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:46:56 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:46:56 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:46:56 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Starting heal instance info cache {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 11:46:56 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Didn't find any instances for network info cache update. {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 18 11:46:56 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:46:56 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:46:56 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:46:56 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:46:56 user nova-compute[74190]: WARNING nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] While synchronizing instance power states, found 9 instances in the database and 8 instances on the hypervisor.
Oct 18 11:46:56 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Triggering sync for uuid c280652c-ffde-40f8-a919-adb8be618db8 {{(pid=74190) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 18 11:46:56 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Triggering sync for uuid 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86 {{(pid=74190) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 18 11:46:56 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Triggering sync for uuid 0209c824-88a7-4976-83bf-8a72437f0cc2 {{(pid=74190) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 18 11:46:56 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Triggering sync for uuid c6130edd-eb98-491e-a0ba-6bd59199d9e1 {{(pid=74190) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 18 11:46:56 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Triggering sync for uuid 034398e8-e8c4-4e03-a608-440e447c6041 {{(pid=74190) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 18 11:46:56 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Triggering sync for uuid aabb5eea-8366-482a-8d16-bf271c0fe8d7 {{(pid=74190) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 18 11:46:56 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Triggering sync for uuid 3bd2f6d6-9c07-42a0-869e-566d685cb025 {{(pid=74190) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 18 11:46:56 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Triggering sync for uuid 52d7b8e5-02cc-4148-86e2-ceb295e81afc {{(pid=74190) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 18 11:46:56 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Triggering sync for uuid bdfe420d-f46c-44ad-8773-b675f42e24ed {{(pid=74190) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 18 11:46:56 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "c280652c-ffde-40f8-a919-adb8be618db8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:46:56 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "c280652c-ffde-40f8-a919-adb8be618db8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:46:56 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "3c3cce66-9d7a-4f23-a92a-d10b3efd5e86" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:46:56 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "0209c824-88a7-4976-83bf-8a72437f0cc2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:46:56 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "0209c824-88a7-4976-83bf-8a72437f0cc2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:46:56 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "c6130edd-eb98-491e-a0ba-6bd59199d9e1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:46:56 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "c6130edd-eb98-491e-a0ba-6bd59199d9e1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:46:56 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "034398e8-e8c4-4e03-a608-440e447c6041" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:46:56 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "034398e8-e8c4-4e03-a608-440e447c6041" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:46:56 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "aabb5eea-8366-482a-8d16-bf271c0fe8d7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:46:56 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "aabb5eea-8366-482a-8d16-bf271c0fe8d7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:46:56 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "3bd2f6d6-9c07-42a0-869e-566d685cb025" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:46:56 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "52d7b8e5-02cc-4148-86e2-ceb295e81afc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:46:56 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "bdfe420d-f46c-44ad-8773-b675f42e24ed" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:46:56 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "bdfe420d-f46c-44ad-8773-b675f42e24ed" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:46:56 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:46:56 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74190) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 11:46:56 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "0209c824-88a7-4976-83bf-8a72437f0cc2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.059s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:46:56 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "c6130edd-eb98-491e-a0ba-6bd59199d9e1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.070s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:46:56 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "aabb5eea-8366-482a-8d16-bf271c0fe8d7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.072s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:46:56 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "c280652c-ffde-40f8-a919-adb8be618db8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.077s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:46:56 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "bdfe420d-f46c-44ad-8773-b675f42e24ed" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.073s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:46:56 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "034398e8-e8c4-4e03-a608-440e447c6041" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.082s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:46:56 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.411s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:46:56 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] <== connect_volume: return (1414ms) {'type': 'block', 'scsi_wwn': '23537653530323334', 'path': '/dev/sdf'} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:46:56 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23537653530323334', 'path': '/dev/sdf'} {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 11:46:56 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-18T11:42:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-750462458',display_name='tempest-TestShelveInstance-server-750462458',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-750462458',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1292603838',keypairs=<?>,launch_index=0,launched_at=2023-10-18T11:43:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='1d3e15d2b7944cba9ed86eb5c01ec98a',ramdisk_id='',reservation_id='r-n4ye783u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1202197307',owner_user_name='tempest-TestShelveInstance-1202197307-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T11:46:34Z,user_data=None,user_id='06661e802ad947d2a4e07e3d60a94d14',uuid=3bd2f6d6-9c07-42a0-869e-566d685cb025,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "9eca4d9a-28f0-4818-beef-e65c22f351dd", "address": "fa:16:3e:f6:77:76", "network": {"id": "0c5cbb41-ba77-494a-904b-4c37e3205eb9", "bridge": "br-int", "label": "tempest-TestShelveInstance-1626181921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d3e15d2b7944cba9ed86eb5c01ec98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9eca4d9a-28", "ovs_interfaceid": "9eca4d9a-28f0-4818-beef-e65c22f351dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74190) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 11:46:56 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Converting VIF {"id": "9eca4d9a-28f0-4818-beef-e65c22f351dd", "address": "fa:16:3e:f6:77:76", "network": {"id": "0c5cbb41-ba77-494a-904b-4c37e3205eb9", "bridge": "br-int", "label": "tempest-TestShelveInstance-1626181921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d3e15d2b7944cba9ed86eb5c01ec98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9eca4d9a-28", "ovs_interfaceid": "9eca4d9a-28f0-4818-beef-e65c22f351dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:46:56 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:77:76,bridge_name='br-int',has_traffic_filtering=True,id=9eca4d9a-28f0-4818-beef-e65c22f351dd,network=Network(0c5cbb41-ba77-494a-904b-4c37e3205eb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9eca4d9a-28') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:46:56 user nova-compute[74190]: DEBUG nova.objects.instance [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Lazy-loading 'pci_devices' on Instance uuid 3bd2f6d6-9c07-42a0-869e-566d685cb025 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:46:56 user nova-compute[74190]: DEBUG nova.objects.base [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Object Instance<3bd2f6d6-9c07-42a0-869e-566d685cb025> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=74190) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 11:46:56 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] End _get_guest_xml xml=<domain type="kvm">
Oct 18 11:46:56 user nova-compute[74190]:   <uuid>3bd2f6d6-9c07-42a0-869e-566d685cb025</uuid>
Oct 18 11:46:56 user nova-compute[74190]:   <name>instance-0000000a</name>
Oct 18 11:46:56 user nova-compute[74190]:   <memory>524288</memory>
Oct 18 11:46:56 user nova-compute[74190]:   <vcpu>1</vcpu>
Oct 18 11:46:56 user nova-compute[74190]:   <metadata>
Oct 18 11:46:56 user nova-compute[74190]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 11:46:56 user nova-compute[74190]:       <nova:package version="0.0.0"/>
Oct 18 11:46:56 user nova-compute[74190]:       <nova:name>tempest-TestShelveInstance-server-750462458</nova:name>
Oct 18 11:46:56 user nova-compute[74190]:       <nova:creationTime>2023-10-18 11:46:55</nova:creationTime>
Oct 18 11:46:56 user nova-compute[74190]:       <nova:flavor name="m1.tiny">
Oct 18 11:46:56 user nova-compute[74190]:         <nova:memory>512</nova:memory>
Oct 18 11:46:56 user nova-compute[74190]:         <nova:disk>1</nova:disk>
Oct 18 11:46:56 user nova-compute[74190]:         <nova:swap>0</nova:swap>
Oct 18 11:46:56 user nova-compute[74190]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 11:46:56 user nova-compute[74190]:         <nova:vcpus>1</nova:vcpus>
Oct 18 11:46:56 user nova-compute[74190]:       </nova:flavor>
Oct 18 11:46:56 user nova-compute[74190]:       <nova:owner>
Oct 18 11:46:56 user nova-compute[74190]:         <nova:user uuid="06661e802ad947d2a4e07e3d60a94d14">tempest-TestShelveInstance-1202197307-project-member</nova:user>
Oct 18 11:46:56 user nova-compute[74190]:         <nova:project uuid="1d3e15d2b7944cba9ed86eb5c01ec98a">tempest-TestShelveInstance-1202197307</nova:project>
Oct 18 11:46:56 user nova-compute[74190]:       </nova:owner>
Oct 18 11:46:56 user nova-compute[74190]:       <nova:ports>
Oct 18 11:46:56 user nova-compute[74190]:         <nova:port uuid="9eca4d9a-28f0-4818-beef-e65c22f351dd">
Oct 18 11:46:56 user nova-compute[74190]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 18 11:46:56 user nova-compute[74190]:         </nova:port>
Oct 18 11:46:56 user nova-compute[74190]:       </nova:ports>
Oct 18 11:46:56 user nova-compute[74190]:     </nova:instance>
Oct 18 11:46:56 user nova-compute[74190]:   </metadata>
Oct 18 11:46:56 user nova-compute[74190]:   <sysinfo type="smbios">
Oct 18 11:46:56 user nova-compute[74190]:     <system>
Oct 18 11:46:56 user nova-compute[74190]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 11:46:56 user nova-compute[74190]:       <entry name="product">OpenStack Nova</entry>
Oct 18 11:46:56 user nova-compute[74190]:       <entry name="version">0.0.0</entry>
Oct 18 11:46:56 user nova-compute[74190]:       <entry name="serial">3bd2f6d6-9c07-42a0-869e-566d685cb025</entry>
Oct 18 11:46:56 user nova-compute[74190]:       <entry name="uuid">3bd2f6d6-9c07-42a0-869e-566d685cb025</entry>
Oct 18 11:46:56 user nova-compute[74190]:       <entry name="family">Virtual Machine</entry>
Oct 18 11:46:56 user nova-compute[74190]:     </system>
Oct 18 11:46:56 user nova-compute[74190]:   </sysinfo>
Oct 18 11:46:56 user nova-compute[74190]:   <os>
Oct 18 11:46:56 user nova-compute[74190]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 11:46:56 user nova-compute[74190]:     <boot dev="hd"/>
Oct 18 11:46:56 user nova-compute[74190]:     <smbios mode="sysinfo"/>
Oct 18 11:46:56 user nova-compute[74190]:   </os>
Oct 18 11:46:56 user nova-compute[74190]:   <features>
Oct 18 11:46:56 user nova-compute[74190]:     <acpi/>
Oct 18 11:46:56 user nova-compute[74190]:     <apic/>
Oct 18 11:46:56 user nova-compute[74190]:     <vmcoreinfo/>
Oct 18 11:46:56 user nova-compute[74190]:   </features>
Oct 18 11:46:56 user nova-compute[74190]:   <clock offset="utc">
Oct 18 11:46:56 user nova-compute[74190]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 11:46:56 user nova-compute[74190]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 11:46:56 user nova-compute[74190]:     <timer name="hpet" present="no"/>
Oct 18 11:46:56 user nova-compute[74190]:   </clock>
Oct 18 11:46:56 user nova-compute[74190]:   <cpu mode="custom" match="exact">
Oct 18 11:46:56 user nova-compute[74190]:     <model>Nehalem</model>
Oct 18 11:46:56 user nova-compute[74190]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 11:46:56 user nova-compute[74190]:   </cpu>
Oct 18 11:46:56 user nova-compute[74190]:   <devices>
Oct 18 11:46:56 user nova-compute[74190]:     <disk type="block" device="disk">
Oct 18 11:46:56 user nova-compute[74190]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 11:46:56 user nova-compute[74190]:       <source dev="/dev/sdf"/>
Oct 18 11:46:56 user nova-compute[74190]:       <target dev="vda" bus="virtio"/>
Oct 18 11:46:56 user nova-compute[74190]:       <serial>2d829820-7b5f-42f9-81ab-8efc923f288a</serial>
Oct 18 11:46:56 user nova-compute[74190]:     </disk>
Oct 18 11:46:56 user nova-compute[74190]:     <interface type="ethernet">
Oct 18 11:46:56 user nova-compute[74190]:       <mac address="fa:16:3e:f6:77:76"/>
Oct 18 11:46:56 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:46:56 user nova-compute[74190]:       <mtu size="1442"/>
Oct 18 11:46:56 user nova-compute[74190]:       <target dev="tap9eca4d9a-28"/>
Oct 18 11:46:56 user nova-compute[74190]:     </interface>
Oct 18 11:46:56 user nova-compute[74190]:     <serial type="pty">
Oct 18 11:46:56 user nova-compute[74190]:       <log file="/opt/stack/data/nova/instances/3bd2f6d6-9c07-42a0-869e-566d685cb025/console.log" append="off"/>
Oct 18 11:46:56 user nova-compute[74190]:     </serial>
Oct 18 11:46:56 user nova-compute[74190]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 11:46:56 user nova-compute[74190]:     <video>
Oct 18 11:46:56 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:46:56 user nova-compute[74190]:     </video>
Oct 18 11:46:56 user nova-compute[74190]:     <rng model="virtio">
Oct 18 11:46:56 user nova-compute[74190]:       <backend model="random">/dev/urandom</backend>
Oct 18 11:46:56 user nova-compute[74190]:     </rng>
Oct 18 11:46:56 user nova-compute[74190]:     <controller type="usb" index="0" model="none"/>
Oct 18 11:46:56 user nova-compute[74190]:     <memballoon model="virtio">
Oct 18 11:46:56 user nova-compute[74190]:       <stats period="10"/>
Oct 18 11:46:56 user nova-compute[74190]:     </memballoon>
Oct 18 11:46:56 user nova-compute[74190]:   </devices>
Oct 18 11:46:56 user nova-compute[74190]: </domain>
Oct 18 11:46:56 user nova-compute[74190]:  {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 11:46:56 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-18T11:42:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-750462458',display_name='tempest-TestShelveInstance-server-750462458',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-750462458',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1292603838',keypairs=<?>,launch_index=0,launched_at=2023-10-18T11:43:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='1d3e15d2b7944cba9ed86eb5c01ec98a',ramdisk_id='',reservation_id='r-n4ye783u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1202197307',owner_user_name='tempest-TestShelveInstance-1202197307-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T11:46:34Z,user_data=None,user_id='06661e802ad947d2a4e07e3d60a94d14',uuid=3bd2f6d6-9c07-42a0-869e-566d685cb025,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "9eca4d9a-28f0-4818-beef-e65c22f351dd", "address": "fa:16:3e:f6:77:76", "network": {"id": "0c5cbb41-ba77-494a-904b-4c37e3205eb9", "bridge": "br-int", "label": "tempest-TestShelveInstance-1626181921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d3e15d2b7944cba9ed86eb5c01ec98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9eca4d9a-28", "ovs_interfaceid": "9eca4d9a-28f0-4818-beef-e65c22f351dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 11:46:56 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Converting VIF {"id": "9eca4d9a-28f0-4818-beef-e65c22f351dd", "address": "fa:16:3e:f6:77:76", "network": {"id": "0c5cbb41-ba77-494a-904b-4c37e3205eb9", "bridge": "br-int", "label": "tempest-TestShelveInstance-1626181921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d3e15d2b7944cba9ed86eb5c01ec98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9eca4d9a-28", "ovs_interfaceid": "9eca4d9a-28f0-4818-beef-e65c22f351dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:46:56 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:77:76,bridge_name='br-int',has_traffic_filtering=True,id=9eca4d9a-28f0-4818-beef-e65c22f351dd,network=Network(0c5cbb41-ba77-494a-904b-4c37e3205eb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9eca4d9a-28') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:46:56 user nova-compute[74190]: DEBUG os_vif [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:77:76,bridge_name='br-int',has_traffic_filtering=True,id=9eca4d9a-28f0-4818-beef-e65c22f351dd,network=Network(0c5cbb41-ba77-494a-904b-4c37e3205eb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9eca4d9a-28') {{(pid=74190) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 11:46:56 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:46:56 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:46:56 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 11:46:56 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:46:56 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd6d01370-9ca1-5d09-b3b8-9fa4a606e8bf', '_type': 'linux-noop'}}, row=False) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:46:56 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:46:56 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:46:56 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:46:56 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9eca4d9a-28, may_exist=True, interface_attrs={}) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:46:56 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9eca4d9a-28, col_values=(('qos', UUID('5ed4b7a3-0518-40df-adf2-dff3811245b5')),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:46:56 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9eca4d9a-28, col_values=(('external_ids', {'iface-id': '9eca4d9a-28f0-4818-beef-e65c22f351dd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:77:76', 'vm-uuid': '3bd2f6d6-9c07-42a0-869e-566d685cb025'}),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:46:56 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:46:56 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:46:56 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:46:56 user nova-compute[74190]: INFO os_vif [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:77:76,bridge_name='br-int',has_traffic_filtering=True,id=9eca4d9a-28f0-4818-beef-e65c22f351dd,network=Network(0c5cbb41-ba77-494a-904b-4c37e3205eb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9eca4d9a-28')
Oct 18 11:46:56 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] No BDM found with device name vda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 11:46:56 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] No VIF found with MAC fa:16:3e:f6:77:76, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 11:46:58 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:46:58 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:46:58 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:46:58 user nova-compute[74190]: DEBUG nova.compute.manager [req-b51d0f05-1125-44a9-976a-63051f78b2d0 req-f1e36ebd-08f3-4da7-ad0a-b119d822dde0 service nova] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Received event network-vif-plugged-9eca4d9a-28f0-4818-beef-e65c22f351dd {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:46:58 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-b51d0f05-1125-44a9-976a-63051f78b2d0 req-f1e36ebd-08f3-4da7-ad0a-b119d822dde0 service nova] Acquiring lock "3bd2f6d6-9c07-42a0-869e-566d685cb025-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:46:58 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-b51d0f05-1125-44a9-976a-63051f78b2d0 req-f1e36ebd-08f3-4da7-ad0a-b119d822dde0 service nova] Lock "3bd2f6d6-9c07-42a0-869e-566d685cb025-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:46:58 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-b51d0f05-1125-44a9-976a-63051f78b2d0 req-f1e36ebd-08f3-4da7-ad0a-b119d822dde0 service nova] Lock "3bd2f6d6-9c07-42a0-869e-566d685cb025-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:46:58 user nova-compute[74190]: DEBUG nova.compute.manager [req-b51d0f05-1125-44a9-976a-63051f78b2d0 req-f1e36ebd-08f3-4da7-ad0a-b119d822dde0 service nova] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] No waiting events found dispatching network-vif-plugged-9eca4d9a-28f0-4818-beef-e65c22f351dd {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:46:58 user nova-compute[74190]: WARNING nova.compute.manager [req-b51d0f05-1125-44a9-976a-63051f78b2d0 req-f1e36ebd-08f3-4da7-ad0a-b119d822dde0 service nova] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Received unexpected event network-vif-plugged-9eca4d9a-28f0-4818-beef-e65c22f351dd for instance with vm_state shelved_offloaded and task_state spawning.
Oct 18 11:46:58 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:46:58 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:46:58 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:46:58 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:46:58 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:46:59 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Acquiring lock "738fc62c-293c-4fee-9943-45033e0f2602" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:46:59 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Lock "738fc62c-293c-4fee-9943-45033e0f2602" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:46:59 user nova-compute[74190]: DEBUG nova.compute.manager [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Starting instance... {{(pid=74190) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 11:46:59 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:46:59 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:46:59 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:46:59 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74190) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 11:46:59 user nova-compute[74190]: INFO nova.compute.claims [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Claim successful on node user
Oct 18 11:46:59 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 11:46:59 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 11:46:59 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.447s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:46:59 user nova-compute[74190]: DEBUG nova.compute.manager [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Start building networks asynchronously for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 11:46:59 user nova-compute[74190]: DEBUG nova.compute.manager [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Allocating IP information in the background. {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 11:46:59 user nova-compute[74190]: DEBUG nova.network.neutron [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] allocate_for_instance() {{(pid=74190) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 11:46:59 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 11:46:59 user nova-compute[74190]: DEBUG nova.compute.manager [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Start building block device mappings for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 11:46:59 user nova-compute[74190]: INFO nova.virt.block_device [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Booting with volume 2637fe23-3624-4fe8-954e-266b32cf18a9 at /dev/vda
Oct 18 11:46:59 user nova-compute[74190]: DEBUG os_brick.utils [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:46:59 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:46:59 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:46:59 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad57e707-506e-4e13-a922-0a093f080650]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cff158e257e1\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:46:59 user nova-compute[74190]: DEBUG nova.policy [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f9a4dc36419840d2ae7eac09cbeeea9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53275b2e537640b59e1bb6bcb8368780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74190) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 11:46:59 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:46:59 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:46:59 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[54710a5d-6fa6-4e98-a084-64592d8277ad]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:46:59 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:00 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:00 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f41e33a-eb3d-4eb7-a075-14a473f9f69e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:47:00 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[f63e4952-0f31-42ff-a652-cb8a50fcfe6e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:47:00 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Running cmd (subprocess): nvme version {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:00 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] 'nvme version' failed. Not Retrying. {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 11:47:00 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] nvme not present on system {{(pid=74190) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 11:47:00 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:00 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 11:47:00 user nova-compute[74190]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 11:47:00 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[38732210-801a-4fd7-a04b-97b3238090c9]: (4, '') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:47:00 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74190) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 11:47:00 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 11:47:00 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] LIGHTOS: no hostnqn found. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 11:47:00 user nova-compute[74190]: DEBUG os_brick.utils [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cff158e257e1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:47:00 user nova-compute[74190]: DEBUG nova.virt.block_device [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Updating existing volume attachment record: a51a8446-cd37-4a19-a963-eea79afd2f36 {{(pid=74190) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 11:47:00 user nova-compute[74190]: DEBUG nova.compute.manager [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Instance event wait completed in 0 seconds for  {{(pid=74190) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 11:47:00 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Guest created on hypervisor {{(pid=74190) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 11:47:00 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Instance spawned successfully.
Oct 18 11:47:00 user nova-compute[74190]: DEBUG nova.compute.manager [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Checking state {{(pid=74190) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 11:47:00 user nova-compute[74190]: DEBUG nova.compute.manager [req-606b74a1-8c42-4794-8691-5e7f7652dbc3 req-fe20c686-7dc8-408a-b27f-298ff68f40b8 service nova] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Received event network-vif-plugged-9eca4d9a-28f0-4818-beef-e65c22f351dd {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:47:00 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-606b74a1-8c42-4794-8691-5e7f7652dbc3 req-fe20c686-7dc8-408a-b27f-298ff68f40b8 service nova] Acquiring lock "3bd2f6d6-9c07-42a0-869e-566d685cb025-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:47:00 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-606b74a1-8c42-4794-8691-5e7f7652dbc3 req-fe20c686-7dc8-408a-b27f-298ff68f40b8 service nova] Lock "3bd2f6d6-9c07-42a0-869e-566d685cb025-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:47:00 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-606b74a1-8c42-4794-8691-5e7f7652dbc3 req-fe20c686-7dc8-408a-b27f-298ff68f40b8 service nova] Lock "3bd2f6d6-9c07-42a0-869e-566d685cb025-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:47:00 user nova-compute[74190]: DEBUG nova.compute.manager [req-606b74a1-8c42-4794-8691-5e7f7652dbc3 req-fe20c686-7dc8-408a-b27f-298ff68f40b8 service nova] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] No waiting events found dispatching network-vif-plugged-9eca4d9a-28f0-4818-beef-e65c22f351dd {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:47:00 user nova-compute[74190]: WARNING nova.compute.manager [req-606b74a1-8c42-4794-8691-5e7f7652dbc3 req-fe20c686-7dc8-408a-b27f-298ff68f40b8 service nova] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Received unexpected event network-vif-plugged-9eca4d9a-28f0-4818-beef-e65c22f351dd for instance with vm_state shelved_offloaded and task_state spawning.
Oct 18 11:47:00 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-c1ccb533-9f6a-4f80-9dc1-0c1a1bcbafb3 tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Lock "3bd2f6d6-9c07-42a0-869e-566d685cb025" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 26.370s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:47:00 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "3bd2f6d6-9c07-42a0-869e-566d685cb025" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 4.239s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:47:00 user nova-compute[74190]: INFO nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] During sync_power_state the instance has a pending task (spawning). Skip.
Oct 18 11:47:00 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "3bd2f6d6-9c07-42a0-869e-566d685cb025" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:47:00 user nova-compute[74190]: DEBUG nova.network.neutron [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Successfully created port: e00eb1ac-378c-4d70-9936-d90df4c9cfbb {{(pid=74190) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 11:47:01 user nova-compute[74190]: DEBUG nova.network.neutron [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Successfully created port: 1a3a415f-eace-4edd-8643-565472342393 {{(pid=74190) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 11:47:01 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:47:02 user nova-compute[74190]: DEBUG nova.network.neutron [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Successfully created port: cfde954f-7659-43ce-a771-b817aef06692 {{(pid=74190) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 11:47:02 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-874df56a-c12c-4602-bc5c-b4b65f6dc37b tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Acquiring lock "aabb5eea-8366-482a-8d16-bf271c0fe8d7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:47:02 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-874df56a-c12c-4602-bc5c-b4b65f6dc37b tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Lock "aabb5eea-8366-482a-8d16-bf271c0fe8d7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:47:02 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-874df56a-c12c-4602-bc5c-b4b65f6dc37b tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Acquiring lock "aabb5eea-8366-482a-8d16-bf271c0fe8d7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:47:02 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-874df56a-c12c-4602-bc5c-b4b65f6dc37b tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Lock "aabb5eea-8366-482a-8d16-bf271c0fe8d7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:47:02 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-874df56a-c12c-4602-bc5c-b4b65f6dc37b tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Lock "aabb5eea-8366-482a-8d16-bf271c0fe8d7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:47:02 user nova-compute[74190]: INFO nova.compute.manager [None req-874df56a-c12c-4602-bc5c-b4b65f6dc37b tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Terminating instance
Oct 18 11:47:02 user nova-compute[74190]: DEBUG nova.compute.manager [None req-874df56a-c12c-4602-bc5c-b4b65f6dc37b tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Start destroying the instance on the hypervisor. {{(pid=74190) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 11:47:02 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:47:02 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:47:02 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:47:02 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:47:02 user nova-compute[74190]: DEBUG nova.compute.manager [req-18c6c8c5-1302-4575-b5e8-357e78a89fd5 req-a5f7bfe3-1031-4b13-af1d-7f9d48646185 service nova] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Received event network-vif-unplugged-21163c28-d799-420c-96b5-6ea0e829dc93 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:47:02 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-18c6c8c5-1302-4575-b5e8-357e78a89fd5 req-a5f7bfe3-1031-4b13-af1d-7f9d48646185 service nova] Acquiring lock "aabb5eea-8366-482a-8d16-bf271c0fe8d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:47:02 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-18c6c8c5-1302-4575-b5e8-357e78a89fd5 req-a5f7bfe3-1031-4b13-af1d-7f9d48646185 service nova] Lock "aabb5eea-8366-482a-8d16-bf271c0fe8d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:47:02 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-18c6c8c5-1302-4575-b5e8-357e78a89fd5 req-a5f7bfe3-1031-4b13-af1d-7f9d48646185 service nova] Lock "aabb5eea-8366-482a-8d16-bf271c0fe8d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:47:02 user nova-compute[74190]: DEBUG nova.compute.manager [req-18c6c8c5-1302-4575-b5e8-357e78a89fd5 req-a5f7bfe3-1031-4b13-af1d-7f9d48646185 service nova] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] No waiting events found dispatching network-vif-unplugged-21163c28-d799-420c-96b5-6ea0e829dc93 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:47:02 user nova-compute[74190]: DEBUG nova.compute.manager [req-18c6c8c5-1302-4575-b5e8-357e78a89fd5 req-a5f7bfe3-1031-4b13-af1d-7f9d48646185 service nova] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Received event network-vif-unplugged-21163c28-d799-420c-96b5-6ea0e829dc93 for instance with task_state deleting. {{(pid=74190) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 11:47:03 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:47:03 user nova-compute[74190]: DEBUG nova.network.neutron [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Successfully created port: ce10d70d-8444-4bd5-adfd-3fc346977282 {{(pid=74190) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 11:47:03 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:47:03 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:47:03 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Instance destroyed successfully.
Oct 18 11:47:03 user nova-compute[74190]: DEBUG nova.objects.instance [None req-874df56a-c12c-4602-bc5c-b4b65f6dc37b tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Lazy-loading 'resources' on Instance uuid aabb5eea-8366-482a-8d16-bf271c0fe8d7 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:47:03 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-874df56a-c12c-4602-bc5c-b4b65f6dc37b tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-18T11:42:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-705838820',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1751107250',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCGAytsGwKIkIlWHJHinPWL79JZWbDLUxBsDePH5prj/RtI6Z3qHCyazEDqxn5098+uhRVuFwPPlZKB1iRU99f3IUwmSBv9DCo1T4Kl+DbCeNTfJ+46eAnqPOhZREa0v/Q==',key_name='tempest-keypair-458715235',keypairs=<?>,launch_index=0,launched_at=2023-10-18T11:45:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5f5028593e4e4805aaa839c6759be293',ramdisk_id='',reservation_id='r-6je5vmge',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1161132701',owner_user_name='tempest-ServerActionsV293TestJSON-1161132701-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T11:45:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='58fb2050865044f9a0d621a9ca328ece',uuid=aabb5eea-8366-482a-8d16-bf271c0fe8d7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "21163c28-d799-420c-96b5-6ea0e829dc93", "address": "fa:16:3e:d8:31:38", "network": {"id": "40790864-a5db-4f62-adde-28ee0dc256cc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-682684827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f5028593e4e4805aaa839c6759be293", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21163c28-d7", "ovs_interfaceid": "21163c28-d799-420c-96b5-6ea0e829dc93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 11:47:03 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-874df56a-c12c-4602-bc5c-b4b65f6dc37b tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Converting VIF {"id": "21163c28-d799-420c-96b5-6ea0e829dc93", "address": "fa:16:3e:d8:31:38", "network": {"id": "40790864-a5db-4f62-adde-28ee0dc256cc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-682684827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f5028593e4e4805aaa839c6759be293", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21163c28-d7", "ovs_interfaceid": "21163c28-d799-420c-96b5-6ea0e829dc93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:47:03 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-874df56a-c12c-4602-bc5c-b4b65f6dc37b tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d8:31:38,bridge_name='br-int',has_traffic_filtering=True,id=21163c28-d799-420c-96b5-6ea0e829dc93,network=Network(40790864-a5db-4f62-adde-28ee0dc256cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21163c28-d7') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:47:03 user nova-compute[74190]: DEBUG os_vif [None req-874df56a-c12c-4602-bc5c-b4b65f6dc37b tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:31:38,bridge_name='br-int',has_traffic_filtering=True,id=21163c28-d799-420c-96b5-6ea0e829dc93,network=Network(40790864-a5db-4f62-adde-28ee0dc256cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21163c28-d7') {{(pid=74190) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 11:47:03 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:47:03 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap21163c28-d7, bridge=br-int, if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:47:03 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:47:03 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:47:03 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:47:03 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=41d69f07-99f8-4726-84e7-c5d0d607469f) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:47:03 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:47:03 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:47:03 user nova-compute[74190]: INFO os_vif [None req-874df56a-c12c-4602-bc5c-b4b65f6dc37b tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:31:38,bridge_name='br-int',has_traffic_filtering=True,id=21163c28-d799-420c-96b5-6ea0e829dc93,network=Network(40790864-a5db-4f62-adde-28ee0dc256cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21163c28-d7')
Oct 18 11:47:03 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-874df56a-c12c-4602-bc5c-b4b65f6dc37b tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] calling os-brick to detach iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 11:47:03 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-874df56a-c12c-4602-bc5c-b4b65f6dc37b tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, {'target_iqn': 'iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ahIObAot', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:47:03 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-874df56a-c12c-4602-bc5c-b4b65f6dc37b tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:47:03 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-874df56a-c12c-4602-bc5c-b4b65f6dc37b tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:47:03 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-874df56a-c12c-4602-bc5c-b4b65f6dc37b tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:47:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:03 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e16e5b-fced-4971-bfbf-7830a0da509c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ed247316-68aa-443b-90b8-b42632ce1a86\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:47:03 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-874df56a-c12c-4602-bc5c-b4b65f6dc37b tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 11:47:03 user nova-compute[74190]: No targets found.
Oct 18 11:47:03 user nova-compute[74190]: iSNS:
Oct 18 11:47:03 user nova-compute[74190]: No targets found.
Oct 18 11:47:03 user nova-compute[74190]: STATIC:
Oct 18 11:47:03 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a
Oct 18 11:47:03 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:47:03 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:47:03 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:ed247316-68aa-443b-90b8-b42632ce1a86
Oct 18 11:47:03 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:47:03 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:47:03 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920
Oct 18 11:47:03 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:47:03 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:47:03 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb
Oct 18 11:47:03 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:47:03 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:47:03 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c
Oct 18 11:47:03 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:47:03 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:47:03 user nova-compute[74190]: FIRMWARE:
Oct 18 11:47:03 user nova-compute[74190]: No targets found.
Oct 18 11:47:03 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:47:03 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-874df56a-c12c-4602-bc5c-b4b65f6dc37b tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 11:47:03 user nova-compute[74190]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 11:47:03 user nova-compute[74190]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74190) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 11:47:03 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-874df56a-c12c-4602-bc5c-b4b65f6dc37b tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c', 0)] {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 11:47:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.071s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:03 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ee8eb4-7aec-47cf-9957-24abfd70ba1e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed247316-68aa-443b-90b8-b42632ce1a86\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:47:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:03 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e541917-8d6f-41e1-97b4-411bc25c9340]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed247316-68aa-443b-90b8-b42632ce1a86 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:47:03 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-874df56a-c12c-4602-bc5c-b4b65f6dc37b tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920 (non-flash)
Oct 18 11:47:03 user nova-compute[74190]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)
Oct 18 11:47:03 user nova-compute[74190]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed247316-68aa-443b-90b8-b42632ce1a86 (non-flash)
Oct 18 11:47:03 user nova-compute[74190]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)
Oct 18 11:47:03 user nova-compute[74190]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)
Oct 18 11:47:03 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:47:03 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-874df56a-c12c-4602-bc5c-b4b65f6dc37b tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920 (non-flash)
Oct 18 11:47:03 user nova-compute[74190]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c (non-flash)
Oct 18 11:47:03 user nova-compute[74190]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed247316-68aa-443b-90b8-b42632ce1a86 (non-flash)
Oct 18 11:47:03 user nova-compute[74190]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)
Oct 18 11:47:03 user nova-compute[74190]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)
Oct 18 11:47:03 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:47:03 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-874df56a-c12c-4602-bc5c-b4b65f6dc37b tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1f4459a680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c'): ({'sdb'}, set())}) {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 11:47:03 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-874df56a-c12c-4602-bc5c-b4b65f6dc37b tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Removing single pathed devices sdb {{(pid=74190) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 11:47:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:03 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[74262a44-62b9-432b-a900-cadff63da76e]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:47:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.030s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:03 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a567030-7218-4d8d-9aa1-6a536d870c86]: (4, ('ok\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:47:03 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-874df56a-c12c-4602-bc5c-b4b65f6dc37b tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Flushing IO for device /dev/sdb {{(pid=74190) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 11:47:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:03 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae612808-930a-4ee0-bd35-13ae5da170f2]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:47:03 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-874df56a-c12c-4602-bc5c-b4b65f6dc37b tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74190) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 11:47:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.067s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:03 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[659adaf0-04eb-40b4-b04b-de79b046b68e]: (4, ('1', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:47:03 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-874df56a-c12c-4602-bc5c-b4b65f6dc37b tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 11:47:03 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-874df56a-c12c-4602-bc5c-b4b65f6dc37b tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] SCSI volumes sdb have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 11:47:03 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-874df56a-c12c-4602-bc5c-b4b65f6dc37b tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c')] {{(pid=74190) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 11:47:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:03 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[d141f287-73a6-4c63-a2ab-c0dbb212abae]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:47:03 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-874df56a-c12c-4602-bc5c-b4b65f6dc37b tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:47:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c -p 172.16.0.220:3260 --logout {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:03 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[40e08e63-d244-4515-b002-2caff4f893e3]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:47:03 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-874df56a-c12c-4602-bc5c-b4b65f6dc37b tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c, portal: 172.16.0.220,3260]
Oct 18 11:47:03 user nova-compute[74190]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c, portal: 172.16.0.220,3260] successful.
Oct 18 11:47:03 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:47:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c -p 172.16.0.220:3260 --op delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c87f389-42e2-4d78-8bdb-4d5bda76216c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:03 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e8605c-d37e-4b8e-842f-65fb0b493ddc]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:47:03 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-874df56a-c12c-4602-bc5c-b4b65f6dc37b tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:47:03 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-874df56a-c12c-4602-bc5c-b4b65f6dc37b tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.494s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:47:03 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-874df56a-c12c-4602-bc5c-b4b65f6dc37b tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] <== disconnect_volume: return (495ms) None {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:47:03 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-874df56a-c12c-4602-bc5c-b4b65f6dc37b tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Disconnected iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 11:47:03 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-874df56a-c12c-4602-bc5c-b4b65f6dc37b tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Deleting instance files /opt/stack/data/nova/instances/aabb5eea-8366-482a-8d16-bf271c0fe8d7_del
Oct 18 11:47:03 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-874df56a-c12c-4602-bc5c-b4b65f6dc37b tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Deletion of /opt/stack/data/nova/instances/aabb5eea-8366-482a-8d16-bf271c0fe8d7_del complete
Oct 18 11:47:04 user nova-compute[74190]: INFO nova.compute.manager [None req-874df56a-c12c-4602-bc5c-b4b65f6dc37b tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Took 1.82 seconds to destroy the instance on the hypervisor.
Oct 18 11:47:04 user nova-compute[74190]: DEBUG oslo.service.loopingcall [None req-874df56a-c12c-4602-bc5c-b4b65f6dc37b tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74190) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 11:47:04 user nova-compute[74190]: DEBUG nova.compute.manager [-] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Deallocating network for instance {{(pid=74190) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 11:47:04 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] deallocate_for_instance() {{(pid=74190) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 11:47:04 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:47:04 user nova-compute[74190]: DEBUG nova.network.neutron [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Successfully created port: 644ec7e2-9907-4ecb-8d84-95b2ae66d866 {{(pid=74190) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 11:47:04 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09f083d4-f775-48d7-aef9-d3dd7dee7c2c tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Calling os-brick to attach iSCSI Volume {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 11:47:04 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f083d4-f775-48d7-aef9-d3dd7dee7c2c tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RNGiwTkM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:47:04 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-09f083d4-f775-48d7-aef9-d3dd7dee7c2c tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:47:04 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-09f083d4-f775-48d7-aef9-d3dd7dee7c2c tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:47:04 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-09f083d4-f775-48d7-aef9-d3dd7dee7c2c tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:47:04 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-09f083d4-f775-48d7-aef9-d3dd7dee7c2c tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:47:04 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-09f083d4-f775-48d7-aef9-d3dd7dee7c2c tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:47:04 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-09f083d4-f775-48d7-aef9-d3dd7dee7c2c tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:47:04 user nova-compute[74190]: INFO os_brick.initiator.connectors.iscsi [None req-09f083d4-f775-48d7-aef9-d3dd7dee7c2c tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 11:47:04 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49 -p 172.16.0.220:3260 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:04 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:04 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[307398f7-7785-4c61-ab2f-c4332074c8f3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:47:04 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f083d4-f775-48d7-aef9-d3dd7dee7c2c tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 11:47:04 user nova-compute[74190]:  {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:47:04 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49 -p 172.16.0.220:3260 --interface default --op new {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:04 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:04 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d40e016-123b-4c30-8182-7a9e45842368]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49] added\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:47:04 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f083d4-f775-48d7-aef9-d3dd7dee7c2c tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49] added
Oct 18 11:47:04 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:47:04 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:04 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:04 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e59fa7-f6bd-4546-80b1-3aa46a278ee8]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:47:04 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f083d4-f775-48d7-aef9-d3dd7dee7c2c tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:47:04 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:04 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:04 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[73cafa55-c745-4fda-a784-e8d71f258f40]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:47:04 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f083d4-f775-48d7-aef9-d3dd7dee7c2c tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:47:04 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RNGiwTkM {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:04 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RNGiwTkM" returned: 0 in 0.027s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:04 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c1763e-1d4d-4b06-9767-d312cee2864d]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:47:04 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f083d4-f775-48d7-aef9-d3dd7dee7c2c tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RNGiwTkM'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:47:04 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:04 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:04 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba47fcc-f6dc-44d8-89fd-8cd7267e05ec]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:47:04 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f083d4-f775-48d7-aef9-d3dd7dee7c2c tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:47:04 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:04 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:04 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[a303d53f-4ac4-41bc-9337-6943581372ac]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed247316-68aa-443b-90b8-b42632ce1a86 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:47:04 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f083d4-f775-48d7-aef9-d3dd7dee7c2c tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920 (non-flash)
Oct 18 11:47:04 user nova-compute[74190]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed247316-68aa-443b-90b8-b42632ce1a86 (non-flash)
Oct 18 11:47:04 user nova-compute[74190]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)
Oct 18 11:47:04 user nova-compute[74190]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)
Oct 18 11:47:04 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:47:04 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f083d4-f775-48d7-aef9-d3dd7dee7c2c tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920 (non-flash)
Oct 18 11:47:04 user nova-compute[74190]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed247316-68aa-443b-90b8-b42632ce1a86 (non-flash)
Oct 18 11:47:04 user nova-compute[74190]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)
Oct 18 11:47:04 user nova-compute[74190]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)
Oct 18 11:47:04 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:47:04 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49 -p 172.16.0.220:3260 --login {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:04 user nova-compute[74190]: DEBUG nova.compute.manager [req-bc080236-64dd-4758-b324-c2a9332bc693 req-83bb7a9c-cffc-409d-b7c2-247622443172 service nova] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Received event network-vif-plugged-21163c28-d799-420c-96b5-6ea0e829dc93 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:47:04 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-bc080236-64dd-4758-b324-c2a9332bc693 req-83bb7a9c-cffc-409d-b7c2-247622443172 service nova] Acquiring lock "aabb5eea-8366-482a-8d16-bf271c0fe8d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:47:04 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-bc080236-64dd-4758-b324-c2a9332bc693 req-83bb7a9c-cffc-409d-b7c2-247622443172 service nova] Lock "aabb5eea-8366-482a-8d16-bf271c0fe8d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:47:04 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-bc080236-64dd-4758-b324-c2a9332bc693 req-83bb7a9c-cffc-409d-b7c2-247622443172 service nova] Lock "aabb5eea-8366-482a-8d16-bf271c0fe8d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:47:04 user nova-compute[74190]: DEBUG nova.compute.manager [req-bc080236-64dd-4758-b324-c2a9332bc693 req-83bb7a9c-cffc-409d-b7c2-247622443172 service nova] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] No waiting events found dispatching network-vif-plugged-21163c28-d799-420c-96b5-6ea0e829dc93 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:47:04 user nova-compute[74190]: WARNING nova.compute.manager [req-bc080236-64dd-4758-b324-c2a9332bc693 req-83bb7a9c-cffc-409d-b7c2-247622443172 service nova] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Received unexpected event network-vif-plugged-21163c28-d799-420c-96b5-6ea0e829dc93 for instance with vm_state active and task_state deleting.
Oct 18 11:47:04 user nova-compute[74190]: DEBUG nova.network.neutron [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Successfully updated port: e00eb1ac-378c-4d70-9936-d90df4c9cfbb {{(pid=74190) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 11:47:04 user nova-compute[74190]: DEBUG nova.compute.manager [req-50c7c857-0567-4464-9f3f-0689311ce078 req-19ef46b5-527f-4f26-b51e-d4f25a017e18 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Received event network-changed-e00eb1ac-378c-4d70-9936-d90df4c9cfbb {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:47:04 user nova-compute[74190]: DEBUG nova.compute.manager [req-50c7c857-0567-4464-9f3f-0689311ce078 req-19ef46b5-527f-4f26-b51e-d4f25a017e18 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Refreshing instance network info cache due to event network-changed-e00eb1ac-378c-4d70-9936-d90df4c9cfbb. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 11:47:04 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-50c7c857-0567-4464-9f3f-0689311ce078 req-19ef46b5-527f-4f26-b51e-d4f25a017e18 service nova] Acquiring lock "refresh_cache-738fc62c-293c-4fee-9943-45033e0f2602" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:47:04 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-50c7c857-0567-4464-9f3f-0689311ce078 req-19ef46b5-527f-4f26-b51e-d4f25a017e18 service nova] Acquired lock "refresh_cache-738fc62c-293c-4fee-9943-45033e0f2602" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:47:04 user nova-compute[74190]: DEBUG nova.network.neutron [req-50c7c857-0567-4464-9f3f-0689311ce078 req-19ef46b5-527f-4f26-b51e-d4f25a017e18 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Refreshing network info cache for port e00eb1ac-378c-4d70-9936-d90df4c9cfbb {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 11:47:04 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49 -p 172.16.0.220:3260 --login" returned: 0 in 0.093s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:04 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[d00dcdcc-4df8-4a29-a23a-7136c75a730b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:47:04 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f083d4-f775-48d7-aef9-d3dd7dee7c2c tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49, portal: 172.16.0.220,3260]
Oct 18 11:47:04 user nova-compute[74190]: Login to [iface: default, target: iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49, portal: 172.16.0.220,3260] successful.
Oct 18 11:47:04 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:47:04 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:05 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9507ebd-eeef-4904-8e53-4c5106415de0]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:47:05 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f083d4-f775-48d7-aef9-d3dd7dee7c2c tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:47:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:05 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[f21e2d07-32fe-45cb-a357-992bd86d90b3]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed247316-68aa-443b-90b8-b42632ce1a86 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49 (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:47:05 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f083d4-f775-48d7-aef9-d3dd7dee7c2c tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920 (non-flash)
Oct 18 11:47:05 user nova-compute[74190]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed247316-68aa-443b-90b8-b42632ce1a86 (non-flash)
Oct 18 11:47:05 user nova-compute[74190]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)
Oct 18 11:47:05 user nova-compute[74190]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)
Oct 18 11:47:05 user nova-compute[74190]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49 (non-flash)
Oct 18 11:47:05 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:47:05 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f083d4-f775-48d7-aef9-d3dd7dee7c2c tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920 (non-flash)
Oct 18 11:47:05 user nova-compute[74190]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed247316-68aa-443b-90b8-b42632ce1a86 (non-flash)
Oct 18 11:47:05 user nova-compute[74190]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)
Oct 18 11:47:05 user nova-compute[74190]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)
Oct 18 11:47:05 user nova-compute[74190]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49 (non-flash)
Oct 18 11:47:05 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:47:05 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-09f083d4-f775-48d7-aef9-d3dd7dee7c2c tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.405s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:47:05 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f083d4-f775-48d7-aef9-d3dd7dee7c2c tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Connected to 172.16.0.220:3260 {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 11:47:05 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-09f083d4-f775-48d7-aef9-d3dd7dee7c2c tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] HCTL ('33', '-', '-', 0) found on session 16 with lun 0 {{(pid=74190) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 11:47:05 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-09f083d4-f775-48d7-aef9-d3dd7dee7c2c tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74190) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 11:47:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:05 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc28aeec-e6c5-4f21-bf50-8a73dc3ae09c]: (4, ('- - 0', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:47:05 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-09f083d4-f775-48d7-aef9-d3dd7dee7c2c tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Searching for a device in session 16 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74190) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 11:47:05 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f083d4-f775-48d7-aef9-d3dd7dee7c2c tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RNGiwTkM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 11:47:05 user nova-compute[74190]: DEBUG nova.network.neutron [req-50c7c857-0567-4464-9f3f-0689311ce078 req-19ef46b5-527f-4f26-b51e-d4f25a017e18 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Instance cache missing network info. {{(pid=74190) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 11:47:05 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Updating instance_info_cache with network_info: [] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:47:05 user nova-compute[74190]: INFO nova.compute.manager [-] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Took 1.10 seconds to deallocate network for instance.
Oct 18 11:47:05 user nova-compute[74190]: DEBUG nova.network.neutron [req-50c7c857-0567-4464-9f3f-0689311ce078 req-19ef46b5-527f-4f26-b51e-d4f25a017e18 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Updating instance_info_cache with network_info: [] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:47:05 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-50c7c857-0567-4464-9f3f-0689311ce078 req-19ef46b5-527f-4f26-b51e-d4f25a017e18 service nova] Releasing lock "refresh_cache-738fc62c-293c-4fee-9943-45033e0f2602" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:47:05 user nova-compute[74190]: DEBUG nova.network.neutron [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Successfully updated port: 906d428b-8be9-4ac1-ac30-4f48a5448c11 {{(pid=74190) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 11:47:06 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-09f083d4-f775-48d7-aef9-d3dd7dee7c2c tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.458s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:47:06 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f083d4-f775-48d7-aef9-d3dd7dee7c2c tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] <== connect_volume: return (1460ms) {'type': 'block', 'scsi_wwn': '23531396435663636', 'path': '/dev/sdb'} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:47:06 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09f083d4-f775-48d7-aef9-d3dd7dee7c2c tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23531396435663636', 'path': '/dev/sdb'} {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 11:47:06 user nova-compute[74190]: DEBUG nova.objects.instance [None req-09f083d4-f775-48d7-aef9-d3dd7dee7c2c tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lazy-loading 'flavor' on Instance uuid 52d7b8e5-02cc-4148-86e2-ceb295e81afc {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:47:06 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-09f083d4-f775-48d7-aef9-d3dd7dee7c2c tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] attach device xml: <disk type="block" device="disk">
Oct 18 11:47:06 user nova-compute[74190]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 11:47:06 user nova-compute[74190]:   <source dev="/dev/sdb"/>
Oct 18 11:47:06 user nova-compute[74190]:   <target dev="vdb" bus="virtio"/>
Oct 18 11:47:06 user nova-compute[74190]:   <serial>b46a9877-5222-479e-a581-dfc0618bfe49</serial>
Oct 18 11:47:06 user nova-compute[74190]: </disk>
Oct 18 11:47:06 user nova-compute[74190]:  {{(pid=74190) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 18 11:47:06 user nova-compute[74190]: INFO nova.compute.manager [None req-874df56a-c12c-4602-bc5c-b4b65f6dc37b tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Took 1.08 seconds to detach 1 volumes for instance.
Oct 18 11:47:06 user nova-compute[74190]: DEBUG nova.compute.manager [None req-874df56a-c12c-4602-bc5c-b4b65f6dc37b tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Deleting volume: 5c87f389-42e2-4d78-8bdb-4d5bda76216c {{(pid=74190) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 18 11:47:06 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-874df56a-c12c-4602-bc5c-b4b65f6dc37b tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:47:06 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-874df56a-c12c-4602-bc5c-b4b65f6dc37b tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:47:06 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-3b672764-b64d-4483-b298-31236a15e644 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86 is timed out.
Oct 18 11:47:06 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-3b672764-b64d-4483-b298-31236a15e644 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Successfully detached device vdc from instance 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86 from the live domain config.
Oct 18 11:47:06 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b672764-b64d-4483-b298-31236a15e644 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] calling os-brick to detach iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 11:47:06 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b672764-b64d-4483-b298-31236a15e644 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, {'target_iqn': 'iqn.2010-10.org.openstack:ed247316-68aa-443b-90b8-b42632ce1a86', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HLsNRbcj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:47:06 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-3b672764-b64d-4483-b298-31236a15e644 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:47:06 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-3b672764-b64d-4483-b298-31236a15e644 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:47:06 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-3b672764-b64d-4483-b298-31236a15e644 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:47:06 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:06 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.041s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:06 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[a20ec47d-618c-494e-bf6f-e410182c4beb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ed247316-68aa-443b-90b8-b42632ce1a86\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:47:06 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b672764-b64d-4483-b298-31236a15e644 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 11:47:06 user nova-compute[74190]: No targets found.
Oct 18 11:47:06 user nova-compute[74190]: iSNS:
Oct 18 11:47:06 user nova-compute[74190]: No targets found.
Oct 18 11:47:06 user nova-compute[74190]: STATIC:
Oct 18 11:47:06 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a
Oct 18 11:47:06 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:47:06 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:47:06 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:ed247316-68aa-443b-90b8-b42632ce1a86
Oct 18 11:47:06 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:47:06 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:47:06 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920
Oct 18 11:47:06 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:47:06 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:47:06 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49
Oct 18 11:47:06 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:47:06 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:47:06 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb
Oct 18 11:47:06 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:47:06 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:47:06 user nova-compute[74190]: FIRMWARE:
Oct 18 11:47:06 user nova-compute[74190]: No targets found.
Oct 18 11:47:06 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:47:06 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b672764-b64d-4483-b298-31236a15e644 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 11:47:06 user nova-compute[74190]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 11:47:06 user nova-compute[74190]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74190) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 11:47:06 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b672764-b64d-4483-b298-31236a15e644 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed247316-68aa-443b-90b8-b42632ce1a86', 0)] {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 11:47:06 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:06 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:06 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc0084ba-ee41-4418-b058-79392f0bddbd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed247316-68aa-443b-90b8-b42632ce1a86\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:47:06 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:06 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:06 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed5121c-93d1-4bd7-bd2c-c5929971cb1b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed247316-68aa-443b-90b8-b42632ce1a86 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49 (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:47:06 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b672764-b64d-4483-b298-31236a15e644 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920 (non-flash)
Oct 18 11:47:06 user nova-compute[74190]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed247316-68aa-443b-90b8-b42632ce1a86 (non-flash)
Oct 18 11:47:06 user nova-compute[74190]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)
Oct 18 11:47:06 user nova-compute[74190]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)
Oct 18 11:47:06 user nova-compute[74190]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49 (non-flash)
Oct 18 11:47:06 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:47:06 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b672764-b64d-4483-b298-31236a15e644 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920 (non-flash)
Oct 18 11:47:06 user nova-compute[74190]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed247316-68aa-443b-90b8-b42632ce1a86 (non-flash)
Oct 18 11:47:06 user nova-compute[74190]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)
Oct 18 11:47:06 user nova-compute[74190]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)
Oct 18 11:47:06 user nova-compute[74190]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49 (non-flash)
Oct 18 11:47:06 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:47:06 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b672764-b64d-4483-b298-31236a15e644 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1f446fe170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed247316-68aa-443b-90b8-b42632ce1a86'): ({'sdc'}, set())}) {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 11:47:06 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-3b672764-b64d-4483-b298-31236a15e644 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Removing single pathed devices sdc {{(pid=74190) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 11:47:06 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:06 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:06 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[16043a7c-4b6e-40d2-a17b-f07a98b57cc3]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:47:06 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:06 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.027s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:06 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a7e4e39-ad61-4409-abb8-712c6f6e5c57]: (4, ('ok\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:47:06 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-3b672764-b64d-4483-b298-31236a15e644 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Flushing IO for device /dev/sdc {{(pid=74190) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 11:47:06 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:06 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:06 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dce5c2e-fae8-4f6e-aef2-e6e4111312b2]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:47:06 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-3b672764-b64d-4483-b298-31236a15e644 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74190) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 11:47:06 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:06 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-09f083d4-f775-48d7-aef9-d3dd7dee7c2c tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] No BDM found with device name vda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 11:47:06 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-09f083d4-f775-48d7-aef9-d3dd7dee7c2c tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 11:47:06 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-09f083d4-f775-48d7-aef9-d3dd7dee7c2c tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] No VIF found with MAC fa:16:3e:88:36:f0, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 11:47:06 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.065s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:06 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b2cc4a6-f626-4b97-bd18-a69572d5ebae]: (4, ('1', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:47:06 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-3b672764-b64d-4483-b298-31236a15e644 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 11:47:06 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-3b672764-b64d-4483-b298-31236a15e644 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] SCSI volumes sdc have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 11:47:06 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b672764-b64d-4483-b298-31236a15e644 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed247316-68aa-443b-90b8-b42632ce1a86')] {{(pid=74190) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 11:47:06 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed247316-68aa-443b-90b8-b42632ce1a86 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:06 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed247316-68aa-443b-90b8-b42632ce1a86 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:06 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fbfb407-27e4-4141-ad70-cf695100ddd1]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:47:06 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b672764-b64d-4483-b298-31236a15e644 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:47:06 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed247316-68aa-443b-90b8-b42632ce1a86 -p 172.16.0.220:3260 --logout {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:06 user nova-compute[74190]: DEBUG nova.network.neutron [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Successfully updated port: 44bc05d9-08bc-49ab-80a4-ee736c201a4b {{(pid=74190) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 11:47:06 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed247316-68aa-443b-90b8-b42632ce1a86 -p 172.16.0.220:3260 --logout" returned: 0 in 0.094s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:06 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[48018c6f-926e-4528-b372-155772c7afec]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:ed247316-68aa-443b-90b8-b42632ce1a86, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:ed247316-68aa-443b-90b8-b42632ce1a86, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:47:06 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b672764-b64d-4483-b298-31236a15e644 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:ed247316-68aa-443b-90b8-b42632ce1a86, portal: 172.16.0.220,3260]
Oct 18 11:47:06 user nova-compute[74190]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:ed247316-68aa-443b-90b8-b42632ce1a86, portal: 172.16.0.220,3260] successful.
Oct 18 11:47:06 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:47:06 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed247316-68aa-443b-90b8-b42632ce1a86 -p 172.16.0.220:3260 --op delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:06 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-874df56a-c12c-4602-bc5c-b4b65f6dc37b tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 11:47:06 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-874df56a-c12c-4602-bc5c-b4b65f6dc37b tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 11:47:06 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed247316-68aa-443b-90b8-b42632ce1a86 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.044s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:06 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f829fea-a8b5-47b7-b09c-1c2ae4969d8d]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:47:06 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b672764-b64d-4483-b298-31236a15e644 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:47:06 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-3b672764-b64d-4483-b298-31236a15e644 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.494s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:47:06 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b672764-b64d-4483-b298-31236a15e644 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] <== disconnect_volume: return (496ms) None {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:47:06 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b672764-b64d-4483-b298-31236a15e644 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Disconnected iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 11:47:06 user nova-compute[74190]: DEBUG nova.compute.manager [req-e1038bf0-96b4-4aa9-beb8-36a3c202b22c req-30c87fe8-59bd-4eb3-9397-bad02bf4e71a service nova] [instance: aabb5eea-8366-482a-8d16-bf271c0fe8d7] Received event network-vif-deleted-21163c28-d799-420c-96b5-6ea0e829dc93 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:47:06 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-09f083d4-f775-48d7-aef9-d3dd7dee7c2c tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lock "52d7b8e5-02cc-4148-86e2-ceb295e81afc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.374s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:47:06 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "52d7b8e5-02cc-4148-86e2-ceb295e81afc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 10.665s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:47:06 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-874df56a-c12c-4602-bc5c-b4b65f6dc37b tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.577s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:47:07 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "52d7b8e5-02cc-4148-86e2-ceb295e81afc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.060s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:47:07 user nova-compute[74190]: INFO nova.scheduler.client.report [None req-874df56a-c12c-4602-bc5c-b4b65f6dc37b tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Deleted allocations for instance aabb5eea-8366-482a-8d16-bf271c0fe8d7
Oct 18 11:47:07 user nova-compute[74190]: DEBUG nova.compute.manager [req-8ab74885-fbee-468f-8148-907de4e23a63 req-740d681c-2429-4436-bc94-b7057a504e57 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Received event network-changed-906d428b-8be9-4ac1-ac30-4f48a5448c11 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:47:07 user nova-compute[74190]: DEBUG nova.compute.manager [req-8ab74885-fbee-468f-8148-907de4e23a63 req-740d681c-2429-4436-bc94-b7057a504e57 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Refreshing instance network info cache due to event network-changed-906d428b-8be9-4ac1-ac30-4f48a5448c11. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 11:47:07 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-8ab74885-fbee-468f-8148-907de4e23a63 req-740d681c-2429-4436-bc94-b7057a504e57 service nova] Acquiring lock "refresh_cache-738fc62c-293c-4fee-9943-45033e0f2602" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:47:07 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-8ab74885-fbee-468f-8148-907de4e23a63 req-740d681c-2429-4436-bc94-b7057a504e57 service nova] Acquired lock "refresh_cache-738fc62c-293c-4fee-9943-45033e0f2602" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:47:07 user nova-compute[74190]: DEBUG nova.network.neutron [req-8ab74885-fbee-468f-8148-907de4e23a63 req-740d681c-2429-4436-bc94-b7057a504e57 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Refreshing network info cache for port 906d428b-8be9-4ac1-ac30-4f48a5448c11 {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 11:47:07 user nova-compute[74190]: DEBUG nova.network.neutron [req-8ab74885-fbee-468f-8148-907de4e23a63 req-740d681c-2429-4436-bc94-b7057a504e57 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Instance cache missing network info. {{(pid=74190) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 11:47:07 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-874df56a-c12c-4602-bc5c-b4b65f6dc37b tempest-ServerActionsV293TestJSON-1161132701 tempest-ServerActionsV293TestJSON-1161132701-project-member] Lock "aabb5eea-8366-482a-8d16-bf271c0fe8d7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.955s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:47:07 user nova-compute[74190]: DEBUG nova.network.neutron [req-8ab74885-fbee-468f-8148-907de4e23a63 req-740d681c-2429-4436-bc94-b7057a504e57 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Updating instance_info_cache with network_info: [] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:47:07 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-8ab74885-fbee-468f-8148-907de4e23a63 req-740d681c-2429-4436-bc94-b7057a504e57 service nova] Releasing lock "refresh_cache-738fc62c-293c-4fee-9943-45033e0f2602" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:47:07 user nova-compute[74190]: DEBUG nova.compute.manager [req-8ab74885-fbee-468f-8148-907de4e23a63 req-740d681c-2429-4436-bc94-b7057a504e57 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Received event network-changed-44bc05d9-08bc-49ab-80a4-ee736c201a4b {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:47:07 user nova-compute[74190]: DEBUG nova.compute.manager [req-8ab74885-fbee-468f-8148-907de4e23a63 req-740d681c-2429-4436-bc94-b7057a504e57 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Refreshing instance network info cache due to event network-changed-44bc05d9-08bc-49ab-80a4-ee736c201a4b. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 11:47:07 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-8ab74885-fbee-468f-8148-907de4e23a63 req-740d681c-2429-4436-bc94-b7057a504e57 service nova] Acquiring lock "refresh_cache-738fc62c-293c-4fee-9943-45033e0f2602" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:47:07 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-8ab74885-fbee-468f-8148-907de4e23a63 req-740d681c-2429-4436-bc94-b7057a504e57 service nova] Acquired lock "refresh_cache-738fc62c-293c-4fee-9943-45033e0f2602" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:47:07 user nova-compute[74190]: DEBUG nova.network.neutron [req-8ab74885-fbee-468f-8148-907de4e23a63 req-740d681c-2429-4436-bc94-b7057a504e57 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Refreshing network info cache for port 44bc05d9-08bc-49ab-80a4-ee736c201a4b {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 11:47:07 user nova-compute[74190]: DEBUG nova.network.neutron [req-8ab74885-fbee-468f-8148-907de4e23a63 req-740d681c-2429-4436-bc94-b7057a504e57 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Instance cache missing network info. {{(pid=74190) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 11:47:07 user nova-compute[74190]: DEBUG nova.network.neutron [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Successfully updated port: 1a3a415f-eace-4edd-8643-565472342393 {{(pid=74190) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 11:47:07 user nova-compute[74190]: DEBUG nova.network.neutron [req-8ab74885-fbee-468f-8148-907de4e23a63 req-740d681c-2429-4436-bc94-b7057a504e57 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Updating instance_info_cache with network_info: [] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:47:07 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-8ab74885-fbee-468f-8148-907de4e23a63 req-740d681c-2429-4436-bc94-b7057a504e57 service nova] Releasing lock "refresh_cache-738fc62c-293c-4fee-9943-45033e0f2602" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:47:08 user nova-compute[74190]: DEBUG nova.network.neutron [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Successfully updated port: cfde954f-7659-43ce-a771-b817aef06692 {{(pid=74190) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 11:47:08 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:47:08 user nova-compute[74190]: INFO nova.compute.manager [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Rebuilding instance
Oct 18 11:47:08 user nova-compute[74190]: DEBUG nova.compute.manager [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Checking state {{(pid=74190) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 11:47:08 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:47:09 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:47:09 user nova-compute[74190]: DEBUG nova.compute.manager [req-57a95eba-b3ef-41f1-a093-486b1a8b77c5 req-eef019ae-60f1-4e9f-8061-b9ddaa01b78e service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Received event network-changed-1a3a415f-eace-4edd-8643-565472342393 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:47:09 user nova-compute[74190]: DEBUG nova.compute.manager [req-57a95eba-b3ef-41f1-a093-486b1a8b77c5 req-eef019ae-60f1-4e9f-8061-b9ddaa01b78e service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Refreshing instance network info cache due to event network-changed-1a3a415f-eace-4edd-8643-565472342393. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 11:47:09 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-57a95eba-b3ef-41f1-a093-486b1a8b77c5 req-eef019ae-60f1-4e9f-8061-b9ddaa01b78e service nova] Acquiring lock "refresh_cache-738fc62c-293c-4fee-9943-45033e0f2602" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:47:09 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-57a95eba-b3ef-41f1-a093-486b1a8b77c5 req-eef019ae-60f1-4e9f-8061-b9ddaa01b78e service nova] Acquired lock "refresh_cache-738fc62c-293c-4fee-9943-45033e0f2602" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:47:09 user nova-compute[74190]: DEBUG nova.network.neutron [req-57a95eba-b3ef-41f1-a093-486b1a8b77c5 req-eef019ae-60f1-4e9f-8061-b9ddaa01b78e service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Refreshing network info cache for port 1a3a415f-eace-4edd-8643-565472342393 {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 11:47:09 user nova-compute[74190]: DEBUG nova.network.neutron [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Successfully updated port: ce10d70d-8444-4bd5-adfd-3fc346977282 {{(pid=74190) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 11:47:09 user nova-compute[74190]: DEBUG nova.compute.manager [req-1e90d91f-140f-472c-a483-1080ad3190a9 req-fd28f284-8cf4-407d-a599-61e27c599fa1 service nova] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Received event network-vif-unplugged-550e157d-7f82-41a1-b4ba-9dbb43037d8c {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:47:09 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-1e90d91f-140f-472c-a483-1080ad3190a9 req-fd28f284-8cf4-407d-a599-61e27c599fa1 service nova] Acquiring lock "52d7b8e5-02cc-4148-86e2-ceb295e81afc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:47:09 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-1e90d91f-140f-472c-a483-1080ad3190a9 req-fd28f284-8cf4-407d-a599-61e27c599fa1 service nova] Lock "52d7b8e5-02cc-4148-86e2-ceb295e81afc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:47:09 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-1e90d91f-140f-472c-a483-1080ad3190a9 req-fd28f284-8cf4-407d-a599-61e27c599fa1 service nova] Lock "52d7b8e5-02cc-4148-86e2-ceb295e81afc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:47:09 user nova-compute[74190]: DEBUG nova.compute.manager [req-1e90d91f-140f-472c-a483-1080ad3190a9 req-fd28f284-8cf4-407d-a599-61e27c599fa1 service nova] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] No waiting events found dispatching network-vif-unplugged-550e157d-7f82-41a1-b4ba-9dbb43037d8c {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:47:09 user nova-compute[74190]: WARNING nova.compute.manager [req-1e90d91f-140f-472c-a483-1080ad3190a9 req-fd28f284-8cf4-407d-a599-61e27c599fa1 service nova] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Received unexpected event network-vif-unplugged-550e157d-7f82-41a1-b4ba-9dbb43037d8c for instance with vm_state active and task_state rebuilding.
Oct 18 11:47:09 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:47:09 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:47:09 user nova-compute[74190]: DEBUG nova.network.neutron [req-57a95eba-b3ef-41f1-a093-486b1a8b77c5 req-eef019ae-60f1-4e9f-8061-b9ddaa01b78e service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Instance cache missing network info. {{(pid=74190) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 11:47:09 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Instance destroyed successfully.
Oct 18 11:47:09 user nova-compute[74190]: DEBUG nova.network.neutron [req-57a95eba-b3ef-41f1-a093-486b1a8b77c5 req-eef019ae-60f1-4e9f-8061-b9ddaa01b78e service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Updating instance_info_cache with network_info: [] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:47:09 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-57a95eba-b3ef-41f1-a093-486b1a8b77c5 req-eef019ae-60f1-4e9f-8061-b9ddaa01b78e service nova] Releasing lock "refresh_cache-738fc62c-293c-4fee-9943-45033e0f2602" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:47:09 user nova-compute[74190]: DEBUG nova.compute.manager [req-57a95eba-b3ef-41f1-a093-486b1a8b77c5 req-eef019ae-60f1-4e9f-8061-b9ddaa01b78e service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Received event network-changed-cfde954f-7659-43ce-a771-b817aef06692 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:47:09 user nova-compute[74190]: DEBUG nova.compute.manager [req-57a95eba-b3ef-41f1-a093-486b1a8b77c5 req-eef019ae-60f1-4e9f-8061-b9ddaa01b78e service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Refreshing instance network info cache due to event network-changed-cfde954f-7659-43ce-a771-b817aef06692. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 11:47:09 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-57a95eba-b3ef-41f1-a093-486b1a8b77c5 req-eef019ae-60f1-4e9f-8061-b9ddaa01b78e service nova] Acquiring lock "refresh_cache-738fc62c-293c-4fee-9943-45033e0f2602" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:47:09 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-57a95eba-b3ef-41f1-a093-486b1a8b77c5 req-eef019ae-60f1-4e9f-8061-b9ddaa01b78e service nova] Acquired lock "refresh_cache-738fc62c-293c-4fee-9943-45033e0f2602" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:47:09 user nova-compute[74190]: DEBUG nova.network.neutron [req-57a95eba-b3ef-41f1-a093-486b1a8b77c5 req-eef019ae-60f1-4e9f-8061-b9ddaa01b78e service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Refreshing network info cache for port cfde954f-7659-43ce-a771-b817aef06692 {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 11:47:09 user nova-compute[74190]: INFO nova.compute.manager [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Detaching volume b46a9877-5222-479e-a581-dfc0618bfe49
Oct 18 11:47:10 user nova-compute[74190]: DEBUG nova.network.neutron [req-57a95eba-b3ef-41f1-a093-486b1a8b77c5 req-eef019ae-60f1-4e9f-8061-b9ddaa01b78e service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Instance cache missing network info. {{(pid=74190) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 11:47:10 user nova-compute[74190]: DEBUG nova.network.neutron [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Successfully updated port: 644ec7e2-9907-4ecb-8d84-95b2ae66d866 {{(pid=74190) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 11:47:10 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Acquiring lock "refresh_cache-738fc62c-293c-4fee-9943-45033e0f2602" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:47:10 user nova-compute[74190]: INFO nova.virt.block_device [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Attempting to driver detach volume b46a9877-5222-479e-a581-dfc0618bfe49 from mountpoint /dev/vdb
Oct 18 11:47:10 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Attempting to detach device vdb from instance 52d7b8e5-02cc-4148-86e2-ceb295e81afc from the persistent domain config. {{(pid=74190) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 18 11:47:10 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 11:47:10 user nova-compute[74190]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 11:47:10 user nova-compute[74190]:   <source dev="/dev/sdb"/>
Oct 18 11:47:10 user nova-compute[74190]:   <target dev="vdb" bus="virtio"/>
Oct 18 11:47:10 user nova-compute[74190]:   <serial>b46a9877-5222-479e-a581-dfc0618bfe49</serial>
Oct 18 11:47:10 user nova-compute[74190]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 18 11:47:10 user nova-compute[74190]: </disk>
Oct 18 11:47:10 user nova-compute[74190]:  {{(pid=74190) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 11:47:10 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Successfully detached device vdb from instance 52d7b8e5-02cc-4148-86e2-ceb295e81afc from the persistent domain config.
Oct 18 11:47:10 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] calling os-brick to detach iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 11:47:10 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, {'target_iqn': 'iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RNGiwTkM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:47:10 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 18 11:47:10 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:47:10 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:47:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:10 user nova-compute[74190]: DEBUG nova.network.neutron [req-57a95eba-b3ef-41f1-a093-486b1a8b77c5 req-eef019ae-60f1-4e9f-8061-b9ddaa01b78e service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Updating instance_info_cache with network_info: [] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:47:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:10 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[915b8dc8-9e4a-4d06-9b63-5d173e3b04db]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:47:10 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 11:47:10 user nova-compute[74190]: No targets found.
Oct 18 11:47:10 user nova-compute[74190]: iSNS:
Oct 18 11:47:10 user nova-compute[74190]: No targets found.
Oct 18 11:47:10 user nova-compute[74190]: STATIC:
Oct 18 11:47:10 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a
Oct 18 11:47:10 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:47:10 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:47:10 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920
Oct 18 11:47:10 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:47:10 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:47:10 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49
Oct 18 11:47:10 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:47:10 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:47:10 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb
Oct 18 11:47:10 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:47:10 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:47:10 user nova-compute[74190]: FIRMWARE:
Oct 18 11:47:10 user nova-compute[74190]: No targets found.
Oct 18 11:47:10 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:47:10 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 11:47:10 user nova-compute[74190]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 11:47:10 user nova-compute[74190]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74190) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 11:47:10 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49', 0)] {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 11:47:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:10 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-57a95eba-b3ef-41f1-a093-486b1a8b77c5 req-eef019ae-60f1-4e9f-8061-b9ddaa01b78e service nova] Releasing lock "refresh_cache-738fc62c-293c-4fee-9943-45033e0f2602" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:47:10 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Acquired lock "refresh_cache-738fc62c-293c-4fee-9943-45033e0f2602" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:47:10 user nova-compute[74190]: DEBUG nova.network.neutron [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Building network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 11:47:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:10 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[e479abe7-9368-4e04-ac84-998d97109f12]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:47:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:10 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[189c0956-7a52-4586-b700-cd75e63ec040]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49 (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:47:10 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920 (non-flash)
Oct 18 11:47:10 user nova-compute[74190]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)
Oct 18 11:47:10 user nova-compute[74190]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)
Oct 18 11:47:10 user nova-compute[74190]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49 (non-flash)
Oct 18 11:47:10 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:47:10 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920 (non-flash)
Oct 18 11:47:10 user nova-compute[74190]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)
Oct 18 11:47:10 user nova-compute[74190]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)
Oct 18 11:47:10 user nova-compute[74190]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49 (non-flash)
Oct 18 11:47:10 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:47:10 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1f44674d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49'): ({'sdb'}, set())}) {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 11:47:10 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Removing single pathed devices sdb {{(pid=74190) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 11:47:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:10 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[ace999d5-3c1d-4298-b2de-56ad421aab46]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:47:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:10 user nova-compute[74190]: DEBUG nova.network.neutron [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Instance cache missing network info. {{(pid=74190) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 11:47:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:10 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[df033ce4-910e-4aac-bdbe-f62423e34fa8]: (4, ('ok\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:47:10 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Flushing IO for device /dev/sdb {{(pid=74190) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 11:47:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:10 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb4b456-7138-46c8-a156-e22b5d039047]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:47:10 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74190) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 11:47:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:10 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b85752f-7703-4681-bfee-ebb213cff7da]: (4, ('1', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:47:10 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 11:47:10 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] SCSI volumes sdb have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 11:47:10 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49')] {{(pid=74190) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 11:47:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:10 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d9a62a-58db-4dc4-bf1a-ad0a422f54c4]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:47:10 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:47:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49 -p 172.16.0.220:3260 --logout {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:10 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f69a05-2b12-4140-b8c5-76c30872c3a7]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:47:10 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49, portal: 172.16.0.220,3260]
Oct 18 11:47:10 user nova-compute[74190]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49, portal: 172.16.0.220,3260] successful.
Oct 18 11:47:10 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:47:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49 -p 172.16.0.220:3260 --op delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:10 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5276c35-c377-4d74-8cc1-0b50a20e11f5]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:47:10 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:47:10 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:47:10 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] <== disconnect_volume: return (342ms) None {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:47:10 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Disconnected iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 11:47:11 user nova-compute[74190]: DEBUG nova.compute.manager [req-50772f29-4215-42a1-b9b3-28345344b1d6 req-f3144087-5dd9-403e-a19b-8be6b6ef9f01 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Received event network-changed-ce10d70d-8444-4bd5-adfd-3fc346977282 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:47:11 user nova-compute[74190]: DEBUG nova.compute.manager [req-50772f29-4215-42a1-b9b3-28345344b1d6 req-f3144087-5dd9-403e-a19b-8be6b6ef9f01 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Refreshing instance network info cache due to event network-changed-ce10d70d-8444-4bd5-adfd-3fc346977282. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 11:47:11 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-50772f29-4215-42a1-b9b3-28345344b1d6 req-f3144087-5dd9-403e-a19b-8be6b6ef9f01 service nova] Acquiring lock "refresh_cache-738fc62c-293c-4fee-9943-45033e0f2602" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:47:11 user nova-compute[74190]: DEBUG nova.compute.manager [req-6ae411a3-fa7c-46e1-b800-ec6a8689d7b2 req-889b5928-7f2a-4cc8-a277-5928eaf4a0d5 service nova] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Received event network-vif-plugged-550e157d-7f82-41a1-b4ba-9dbb43037d8c {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:47:11 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-6ae411a3-fa7c-46e1-b800-ec6a8689d7b2 req-889b5928-7f2a-4cc8-a277-5928eaf4a0d5 service nova] Acquiring lock "52d7b8e5-02cc-4148-86e2-ceb295e81afc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:47:11 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-6ae411a3-fa7c-46e1-b800-ec6a8689d7b2 req-889b5928-7f2a-4cc8-a277-5928eaf4a0d5 service nova] Lock "52d7b8e5-02cc-4148-86e2-ceb295e81afc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:47:11 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-6ae411a3-fa7c-46e1-b800-ec6a8689d7b2 req-889b5928-7f2a-4cc8-a277-5928eaf4a0d5 service nova] Lock "52d7b8e5-02cc-4148-86e2-ceb295e81afc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:47:11 user nova-compute[74190]: DEBUG nova.compute.manager [req-6ae411a3-fa7c-46e1-b800-ec6a8689d7b2 req-889b5928-7f2a-4cc8-a277-5928eaf4a0d5 service nova] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] No waiting events found dispatching network-vif-plugged-550e157d-7f82-41a1-b4ba-9dbb43037d8c {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:47:11 user nova-compute[74190]: WARNING nova.compute.manager [req-6ae411a3-fa7c-46e1-b800-ec6a8689d7b2 req-889b5928-7f2a-4cc8-a277-5928eaf4a0d5 service nova] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Received unexpected event network-vif-plugged-550e157d-7f82-41a1-b4ba-9dbb43037d8c for instance with vm_state active and task_state rebuilding.
Oct 18 11:47:11 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Instance destroyed successfully.
Oct 18 11:47:11 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:44:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-438639954',display_name='tempest-ServerActionsTestOtherA-server-123298975',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-438639954',id=12,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFdYXPh75Q7xKUqDE9zPp25KXyLhkj0/QLZATeV9ge1D1Ga7GiFXEGYg8QjRnvIAI0+WdgkHzK6fQEWBqJjE2h37Va7NyrV0Yc22ekpkzrQQ2biGg9l9Yf1LSoVy9aLWgA==',key_name='tempest-keypair-286461082',keypairs=<?>,launch_index=0,launched_at=2023-10-18T11:45:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='08cf52ce927443158aa731367f08bd57',ramdisk_id='',reservation_id='r-5s39f1w2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1288544694',owner_user_name='tempest-ServerActionsTestOtherA-1288544694-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:47:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b771e627a76b4540bf8de665df3d7787',uuid=52d7b8e5-02cc-4148-86e2-ceb295e81afc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "550e157d-7f82-41a1-b4ba-9dbb43037d8c", "address": "fa:16:3e:88:36:f0", "network": {"id": "f5ab7da4-2b07-4465-9a89-a07eb053ba91", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1315695374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08cf52ce927443158aa731367f08bd57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap550e157d-7f", "ovs_interfaceid": "550e157d-7f82-41a1-b4ba-9dbb43037d8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 11:47:11 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Converting VIF {"id": "550e157d-7f82-41a1-b4ba-9dbb43037d8c", "address": "fa:16:3e:88:36:f0", "network": {"id": "f5ab7da4-2b07-4465-9a89-a07eb053ba91", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1315695374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08cf52ce927443158aa731367f08bd57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap550e157d-7f", "ovs_interfaceid": "550e157d-7f82-41a1-b4ba-9dbb43037d8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:47:11 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:88:36:f0,bridge_name='br-int',has_traffic_filtering=True,id=550e157d-7f82-41a1-b4ba-9dbb43037d8c,network=Network(f5ab7da4-2b07-4465-9a89-a07eb053ba91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap550e157d-7f') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:47:11 user nova-compute[74190]: DEBUG os_vif [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:36:f0,bridge_name='br-int',has_traffic_filtering=True,id=550e157d-7f82-41a1-b4ba-9dbb43037d8c,network=Network(f5ab7da4-2b07-4465-9a89-a07eb053ba91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap550e157d-7f') {{(pid=74190) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 11:47:11 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:47:11 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap550e157d-7f, bridge=br-int, if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:47:11 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:47:11 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:47:11 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:47:11 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2a7316df-73f0-415f-a0b4-0df0d7fe1fdd) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:47:11 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:47:11 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:47:11 user nova-compute[74190]: INFO os_vif [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:36:f0,bridge_name='br-int',has_traffic_filtering=True,id=550e157d-7f82-41a1-b4ba-9dbb43037d8c,network=Network(f5ab7da4-2b07-4465-9a89-a07eb053ba91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap550e157d-7f')
Oct 18 11:47:11 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] calling os-brick to detach iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 11:47:11 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, {'target_iqn': 'iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RNGiwTkM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:47:11 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 18 11:47:11 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:47:11 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:47:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:11 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa66b33c-8e31-42ae-a29d-c7df7d492936]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:47:11 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 11:47:11 user nova-compute[74190]: No targets found.
Oct 18 11:47:11 user nova-compute[74190]: iSNS:
Oct 18 11:47:11 user nova-compute[74190]: No targets found.
Oct 18 11:47:11 user nova-compute[74190]: STATIC:
Oct 18 11:47:11 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a
Oct 18 11:47:11 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:47:11 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:47:11 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920
Oct 18 11:47:11 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:47:11 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:47:11 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb
Oct 18 11:47:11 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:47:11 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:47:11 user nova-compute[74190]: FIRMWARE:
Oct 18 11:47:11 user nova-compute[74190]: No targets found.
Oct 18 11:47:11 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:47:11 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 11:47:11 user nova-compute[74190]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 11:47:11 user nova-compute[74190]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74190) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 11:47:11 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49', 0)] {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 11:47:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:11 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6ae43e8-cd47-4bbe-b3fc-12bdb46e4135]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:47:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:11 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a56628-e9dd-46cb-be33-1a957050cdef]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:47:11 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920 (non-flash)
Oct 18 11:47:11 user nova-compute[74190]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)
Oct 18 11:47:11 user nova-compute[74190]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)
Oct 18 11:47:11 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:47:11 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920 (non-flash)
Oct 18 11:47:11 user nova-compute[74190]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)
Oct 18 11:47:11 user nova-compute[74190]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)
Oct 18 11:47:11 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:47:11 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1f44677b50>, {}) {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 11:47:11 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Disconnecting from: [] {{(pid=74190) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 11:47:11 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.097s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:47:11 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] <== disconnect_volume: return (100ms) None {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:47:11 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Disconnected iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 11:47:11 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Deleting instance files /opt/stack/data/nova/instances/52d7b8e5-02cc-4148-86e2-ceb295e81afc_del
Oct 18 11:47:11 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Deletion of /opt/stack/data/nova/instances/52d7b8e5-02cc-4148-86e2-ceb295e81afc_del complete
Oct 18 11:47:12 user nova-compute[74190]: INFO nova.virt.block_device [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Booting with volume b46a9877-5222-479e-a581-dfc0618bfe49 at /dev/vdb
Oct 18 11:47:12 user nova-compute[74190]: DEBUG os_brick.utils [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:47:12 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:12 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:12 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[56fbb54b-7f01-4082-bd4e-fc98e3726520]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cff158e257e1\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:47:12 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:12 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:12 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[998d6015-3255-46c9-96a3-5506f6c8830b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:47:12 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:12 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:12 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e7aec68-2129-49f8-83dd-716d69d66955]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:47:12 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e7687b-1d58-42f7-a394-8b9b27763e5a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:47:12 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Running cmd (subprocess): nvme version {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:12 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] 'nvme version' failed. Not Retrying. {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 11:47:12 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] nvme not present on system {{(pid=74190) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 11:47:12 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:12 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 11:47:12 user nova-compute[74190]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 11:47:12 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[041395d0-d726-4ca7-8852-83913b83063a]: (4, '') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:47:12 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74190) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 11:47:12 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 11:47:12 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] LIGHTOS: no hostnqn found. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 11:47:12 user nova-compute[74190]: DEBUG os_brick.utils [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cff158e257e1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:47:12 user nova-compute[74190]: DEBUG nova.virt.block_device [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Updating existing volume attachment record: 21751254-689f-407e-9046-fd3daa6aa33f {{(pid=74190) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 11:47:12 user nova-compute[74190]: DEBUG nova.network.neutron [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Updating instance_info_cache with network_info: [{"id": "e00eb1ac-378c-4d70-9936-d90df4c9cfbb", "address": "fa:16:3e:8c:f3:0b", "network": {"id": "4abb382b-0dbd-4b6c-9403-85021fb1c43a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-328462262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53275b2e537640b59e1bb6bcb8368780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape00eb1ac-37", "ovs_interfaceid": "e00eb1ac-378c-4d70-9936-d90df4c9cfbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "906d428b-8be9-4ac1-ac30-4f48a5448c11", "address": "fa:16:3e:6d:e6:6e", "network": {"id": "991f3e6a-9513-4e2d-8ce6-e34c5a8e8d33", "bridge": "br-int", "label": "tempest-device-tagging-net1-1313342702", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "53275b2e537640b59e1bb6bcb8368780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap906d428b-8b", "ovs_interfaceid": "906d428b-8be9-4ac1-ac30-4f48a5448c11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "44bc05d9-08bc-49ab-80a4-ee736c201a4b", "address": "fa:16:3e:50:48:95", "network": {"id": "991f3e6a-9513-4e2d-8ce6-e34c5a8e8d33", "bridge": "br-int", "label": "tempest-device-tagging-net1-1313342702", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "53275b2e537640b59e1bb6bcb8368780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44bc05d9-08", "ovs_interfaceid": "44bc05d9-08bc-49ab-80a4-ee736c201a4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1a3a415f-eace-4edd-8643-565472342393", "address": "fa:16:3e:db:69:76", "network": {"id": "991f3e6a-9513-4e2d-8ce6-e34c5a8e8d33", "bridge": "br-int", "label": "tempest-device-tagging-net1-1313342702", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "53275b2e537640b59e1bb6bcb8368780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a3a415f-ea", "ovs_interfaceid": "1a3a415f-eace-4edd-8643-565472342393", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cfde954f-7659-43ce-a771-b817aef06692", "address": "fa:16:3e:da:06:44", "network": {"id": "991f3e6a-9513-4e2d-8ce6-e34c5a8e8d33", "bridge": "br-int", "label": "tempest-device-tagging-net1-1313342702", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "53275b2e537640b59e1bb6bcb8368780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfde954f-76", "ovs_interfaceid": "cfde954f-7659-43ce-a771-b817aef06692", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ce10d70d-8444-4bd5-adfd-3fc346977282", "address": "fa:16:3e:b3:96:2f", "network": {"id": "f58bb855-be1b-4895-bc60-5dfa56567d43", "bridge": "br-int", "label": "tempest-device-tagging-net2-1711719607", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "53275b2e537640b59e1bb6bcb8368780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce10d70d-84", "ovs_interfaceid": "ce10d70d-8444-4bd5-adfd-3fc346977282", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "644ec7e2-9907-4ecb-8d84-95b2ae66d866", "address": "fa:16:3e:c2:8f:71", "network": {"id": "f58bb855-be1b-4895-bc60-5dfa56567d43", "bridge": "br-int", "label": "tempest-device-tagging-net2-1711719607", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "53275b2e537640b59e1bb6bcb8368780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap644ec7e2-99", "ovs_interfaceid": "644ec7e2-9907-4ecb-8d84-95b2ae66d866", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:47:12 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Releasing lock "refresh_cache-738fc62c-293c-4fee-9943-45033e0f2602" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:47:12 user nova-compute[74190]: DEBUG nova.compute.manager [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Instance network_info: |[{"id": "e00eb1ac-378c-4d70-9936-d90df4c9cfbb", "address": "fa:16:3e:8c:f3:0b", "network": {"id": "4abb382b-0dbd-4b6c-9403-85021fb1c43a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-328462262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53275b2e537640b59e1bb6bcb8368780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape00eb1ac-37", "ovs_interfaceid": "e00eb1ac-378c-4d70-9936-d90df4c9cfbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "906d428b-8be9-4ac1-ac30-4f48a5448c11", "address": "fa:16:3e:6d:e6:6e", "network": {"id": "991f3e6a-9513-4e2d-8ce6-e34c5a8e8d33", "bridge": "br-int", "label": "tempest-device-tagging-net1-1313342702", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "53275b2e537640b59e1bb6bcb8368780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap906d428b-8b", "ovs_interfaceid": "906d428b-8be9-4ac1-ac30-4f48a5448c11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "44bc05d9-08bc-49ab-80a4-ee736c201a4b", "address": "fa:16:3e:50:48:95", "network": {"id": "991f3e6a-9513-4e2d-8ce6-e34c5a8e8d33", "bridge": "br-int", "label": "tempest-device-tagging-net1-1313342702", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "53275b2e537640b59e1bb6bcb8368780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44bc05d9-08", "ovs_interfaceid": "44bc05d9-08bc-49ab-80a4-ee736c201a4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1a3a415f-eace-4edd-8643-565472342393", "address": "fa:16:3e:db:69:76", "network": {"id": "991f3e6a-9513-4e2d-8ce6-e34c5a8e8d33", "bridge": "br-int", "label": "tempest-device-tagging-net1-1313342702", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "53275b2e537640b59e1bb6bcb8368780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a3a415f-ea", "ovs_interfaceid": "1a3a415f-eace-4edd-8643-565472342393", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cfde954f-7659-43ce-a771-b817aef06692", "address": "fa:16:3e:da:06:44", "network": {"id": "991f3e6a-9513-4e2d-8ce6-e34c5a8e8d33", "bridge": "br-int", "label": "tempest-device-tagging-net1-1313342702", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "53275b2e537640b59e1bb6bcb8368780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfde954f-76", "ovs_interfaceid": "cfde954f-7659-43ce-a771-b817aef06692", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ce10d70d-8444-4bd5-adfd-3fc346977282", "address": "fa:16:3e:b3:96:2f", "network": {"id": "f58bb855-be1b-4895-bc60-5dfa56567d43", "bridge": "br-int", "label": "tempest-device-tagging-net2-1711719607", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "53275b2e537640b59e1bb6bcb8368780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce10d70d-84", "ovs_interfaceid": "ce10d70d-8444-4bd5-adfd-3fc346977282", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "644ec7e2-9907-4ecb-8d84-95b2ae66d866", "address": "fa:16:3e:c2:8f:71", "network": {"id": "f58bb855-be1b-4895-bc60-5dfa56567d43", "bridge": "br-int", "label": "tempest-device-tagging-net2-1711719607", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "53275b2e537640b59e1bb6bcb8368780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap644ec7e2-99", "ovs_interfaceid": "644ec7e2-9907-4ecb-8d84-95b2ae66d866", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 11:47:12 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-50772f29-4215-42a1-b9b3-28345344b1d6 req-f3144087-5dd9-403e-a19b-8be6b6ef9f01 service nova] Acquired lock "refresh_cache-738fc62c-293c-4fee-9943-45033e0f2602" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:47:12 user nova-compute[74190]: DEBUG nova.network.neutron [req-50772f29-4215-42a1-b9b3-28345344b1d6 req-f3144087-5dd9-403e-a19b-8be6b6ef9f01 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Refreshing network info cache for port ce10d70d-8444-4bd5-adfd-3fc346977282 {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 11:47:13 user nova-compute[74190]: DEBUG nova.network.neutron [req-50772f29-4215-42a1-b9b3-28345344b1d6 req-f3144087-5dd9-403e-a19b-8be6b6ef9f01 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Updated VIF entry in instance network info cache for port ce10d70d-8444-4bd5-adfd-3fc346977282. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 11:47:13 user nova-compute[74190]: DEBUG nova.network.neutron [req-50772f29-4215-42a1-b9b3-28345344b1d6 req-f3144087-5dd9-403e-a19b-8be6b6ef9f01 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Updating instance_info_cache with network_info: [{"id": "e00eb1ac-378c-4d70-9936-d90df4c9cfbb", "address": "fa:16:3e:8c:f3:0b", "network": {"id": "4abb382b-0dbd-4b6c-9403-85021fb1c43a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-328462262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53275b2e537640b59e1bb6bcb8368780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape00eb1ac-37", "ovs_interfaceid": "e00eb1ac-378c-4d70-9936-d90df4c9cfbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "906d428b-8be9-4ac1-ac30-4f48a5448c11", "address": "fa:16:3e:6d:e6:6e", "network": {"id": "991f3e6a-9513-4e2d-8ce6-e34c5a8e8d33", "bridge": "br-int", "label": "tempest-device-tagging-net1-1313342702", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "53275b2e537640b59e1bb6bcb8368780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap906d428b-8b", "ovs_interfaceid": "906d428b-8be9-4ac1-ac30-4f48a5448c11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "44bc05d9-08bc-49ab-80a4-ee736c201a4b", "address": "fa:16:3e:50:48:95", "network": {"id": "991f3e6a-9513-4e2d-8ce6-e34c5a8e8d33", "bridge": "br-int", "label": "tempest-device-tagging-net1-1313342702", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "53275b2e537640b59e1bb6bcb8368780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44bc05d9-08", "ovs_interfaceid": "44bc05d9-08bc-49ab-80a4-ee736c201a4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1a3a415f-eace-4edd-8643-565472342393", "address": "fa:16:3e:db:69:76", "network": {"id": "991f3e6a-9513-4e2d-8ce6-e34c5a8e8d33", "bridge": "br-int", "label": "tempest-device-tagging-net1-1313342702", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "53275b2e537640b59e1bb6bcb8368780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a3a415f-ea", "ovs_interfaceid": "1a3a415f-eace-4edd-8643-565472342393", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cfde954f-7659-43ce-a771-b817aef06692", "address": "fa:16:3e:da:06:44", "network": {"id": "991f3e6a-9513-4e2d-8ce6-e34c5a8e8d33", "bridge": "br-int", "label": "tempest-device-tagging-net1-1313342702", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "53275b2e537640b59e1bb6bcb8368780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfde954f-76", "ovs_interfaceid": "cfde954f-7659-43ce-a771-b817aef06692", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ce10d70d-8444-4bd5-adfd-3fc346977282", "address": "fa:16:3e:b3:96:2f", "network": {"id": "f58bb855-be1b-4895-bc60-5dfa56567d43", "bridge": "br-int", "label": "tempest-device-tagging-net2-1711719607", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "53275b2e537640b59e1bb6bcb8368780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce10d70d-84", "ovs_interfaceid": "ce10d70d-8444-4bd5-adfd-3fc346977282", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "644ec7e2-9907-4ecb-8d84-95b2ae66d866", "address": "fa:16:3e:c2:8f:71", "network": {"id": "f58bb855-be1b-4895-bc60-5dfa56567d43", "bridge": "br-int", "label": "tempest-device-tagging-net2-1711719607", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "53275b2e537640b59e1bb6bcb8368780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap644ec7e2-99", "ovs_interfaceid": "644ec7e2-9907-4ecb-8d84-95b2ae66d866", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:47:13 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-50772f29-4215-42a1-b9b3-28345344b1d6 req-f3144087-5dd9-403e-a19b-8be6b6ef9f01 service nova] Releasing lock "refresh_cache-738fc62c-293c-4fee-9943-45033e0f2602" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:47:13 user nova-compute[74190]: DEBUG nova.compute.manager [req-50772f29-4215-42a1-b9b3-28345344b1d6 req-f3144087-5dd9-403e-a19b-8be6b6ef9f01 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Received event network-changed-644ec7e2-9907-4ecb-8d84-95b2ae66d866 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:47:13 user nova-compute[74190]: DEBUG nova.compute.manager [req-50772f29-4215-42a1-b9b3-28345344b1d6 req-f3144087-5dd9-403e-a19b-8be6b6ef9f01 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Refreshing instance network info cache due to event network-changed-644ec7e2-9907-4ecb-8d84-95b2ae66d866. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 11:47:13 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-50772f29-4215-42a1-b9b3-28345344b1d6 req-f3144087-5dd9-403e-a19b-8be6b6ef9f01 service nova] Acquiring lock "refresh_cache-738fc62c-293c-4fee-9943-45033e0f2602" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:47:13 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-50772f29-4215-42a1-b9b3-28345344b1d6 req-f3144087-5dd9-403e-a19b-8be6b6ef9f01 service nova] Acquired lock "refresh_cache-738fc62c-293c-4fee-9943-45033e0f2602" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:47:13 user nova-compute[74190]: DEBUG nova.network.neutron [req-50772f29-4215-42a1-b9b3-28345344b1d6 req-f3144087-5dd9-403e-a19b-8be6b6ef9f01 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Refreshing network info cache for port 644ec7e2-9907-4ecb-8d84-95b2ae66d866 {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 11:47:13 user nova-compute[74190]: DEBUG nova.network.neutron [req-50772f29-4215-42a1-b9b3-28345344b1d6 req-f3144087-5dd9-403e-a19b-8be6b6ef9f01 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Updated VIF entry in instance network info cache for port 644ec7e2-9907-4ecb-8d84-95b2ae66d866. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 11:47:13 user nova-compute[74190]: DEBUG nova.network.neutron [req-50772f29-4215-42a1-b9b3-28345344b1d6 req-f3144087-5dd9-403e-a19b-8be6b6ef9f01 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Updating instance_info_cache with network_info: [{"id": "e00eb1ac-378c-4d70-9936-d90df4c9cfbb", "address": "fa:16:3e:8c:f3:0b", "network": {"id": "4abb382b-0dbd-4b6c-9403-85021fb1c43a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-328462262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53275b2e537640b59e1bb6bcb8368780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape00eb1ac-37", "ovs_interfaceid": "e00eb1ac-378c-4d70-9936-d90df4c9cfbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "906d428b-8be9-4ac1-ac30-4f48a5448c11", "address": "fa:16:3e:6d:e6:6e", "network": {"id": "991f3e6a-9513-4e2d-8ce6-e34c5a8e8d33", "bridge": "br-int", "label": "tempest-device-tagging-net1-1313342702", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "53275b2e537640b59e1bb6bcb8368780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap906d428b-8b", "ovs_interfaceid": "906d428b-8be9-4ac1-ac30-4f48a5448c11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "44bc05d9-08bc-49ab-80a4-ee736c201a4b", "address": "fa:16:3e:50:48:95", "network": {"id": "991f3e6a-9513-4e2d-8ce6-e34c5a8e8d33", "bridge": "br-int", "label": "tempest-device-tagging-net1-1313342702", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "53275b2e537640b59e1bb6bcb8368780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44bc05d9-08", "ovs_interfaceid": "44bc05d9-08bc-49ab-80a4-ee736c201a4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1a3a415f-eace-4edd-8643-565472342393", "address": "fa:16:3e:db:69:76", "network": {"id": "991f3e6a-9513-4e2d-8ce6-e34c5a8e8d33", "bridge": "br-int", "label": "tempest-device-tagging-net1-1313342702", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "53275b2e537640b59e1bb6bcb8368780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a3a415f-ea", "ovs_interfaceid": "1a3a415f-eace-4edd-8643-565472342393", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cfde954f-7659-43ce-a771-b817aef06692", "address": "fa:16:3e:da:06:44", "network": {"id": "991f3e6a-9513-4e2d-8ce6-e34c5a8e8d33", "bridge": "br-int", "label": "tempest-device-tagging-net1-1313342702", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "53275b2e537640b59e1bb6bcb8368780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfde954f-76", "ovs_interfaceid": "cfde954f-7659-43ce-a771-b817aef06692", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ce10d70d-8444-4bd5-adfd-3fc346977282", "address": "fa:16:3e:b3:96:2f", "network": {"id": "f58bb855-be1b-4895-bc60-5dfa56567d43", "bridge": "br-int", "label": "tempest-device-tagging-net2-1711719607", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "53275b2e537640b59e1bb6bcb8368780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce10d70d-84", "ovs_interfaceid": "ce10d70d-8444-4bd5-adfd-3fc346977282", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "644ec7e2-9907-4ecb-8d84-95b2ae66d866", "address": "fa:16:3e:c2:8f:71", "network": {"id": "f58bb855-be1b-4895-bc60-5dfa56567d43", "bridge": "br-int", "label": "tempest-device-tagging-net2-1711719607", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "53275b2e537640b59e1bb6bcb8368780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap644ec7e2-99", "ovs_interfaceid": "644ec7e2-9907-4ecb-8d84-95b2ae66d866", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:47:13 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-50772f29-4215-42a1-b9b3-28345344b1d6 req-f3144087-5dd9-403e-a19b-8be6b6ef9f01 service nova] Releasing lock "refresh_cache-738fc62c-293c-4fee-9943-45033e0f2602" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:47:16 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:47:19 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:47:21 user nova-compute[74190]: DEBUG nova.objects.instance [None req-3b672764-b64d-4483-b298-31236a15e644 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Lazy-loading 'flavor' on Instance uuid 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:47:21 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-3b672764-b64d-4483-b298-31236a15e644 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Lock "3c3cce66-9d7a-4f23-a92a-d10b3efd5e86" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 35.515s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:47:21 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "3c3cce66-9d7a-4f23-a92a-d10b3efd5e86" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 24.938s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:47:21 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "3c3cce66-9d7a-4f23-a92a-d10b3efd5e86" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:47:21 user nova-compute[74190]: INFO nova.virt.block_device [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Booting with volume 838cbbc1-303e-481f-a54c-ebb014989095 at /dev/vdb
Oct 18 11:47:21 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-440a51e1-571e-419f-bb49-ba9319c27357 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Acquiring lock "c280652c-ffde-40f8-a919-adb8be618db8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:47:21 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-440a51e1-571e-419f-bb49-ba9319c27357 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lock "c280652c-ffde-40f8-a919-adb8be618db8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:47:21 user nova-compute[74190]: INFO nova.compute.manager [None req-440a51e1-571e-419f-bb49-ba9319c27357 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Detaching volume 04ab732f-c6a7-459c-b856-68eeee8c77cb
Oct 18 11:47:21 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:47:21 user nova-compute[74190]: DEBUG os_brick.utils [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:47:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:21 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c8fd47-c048-4237-bbda-f6f4fee47f4c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cff158e257e1\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:47:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:21 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcaebd29-5765-407f-876b-673dfc81dab7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:47:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:21 user nova-compute[74190]: INFO nova.virt.block_device [None req-440a51e1-571e-419f-bb49-ba9319c27357 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Attempting to driver detach volume 04ab732f-c6a7-459c-b856-68eeee8c77cb from mountpoint /dev/vdb
Oct 18 11:47:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:21 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c53dcba-16e5-469e-b3cf-9c0aa040db8e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:47:21 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a2f71d6-ad5e-479a-8f19-3220ab41f080]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:47:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Running cmd (subprocess): nvme version {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] 'nvme version' failed. Not Retrying. {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 11:47:21 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] nvme not present on system {{(pid=74190) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 11:47:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 11:47:21 user nova-compute[74190]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 11:47:21 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e5b8827-d994-4d29-a5a0-0b13c3f26924]: (4, '') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:47:21 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74190) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 11:47:21 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 11:47:21 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] LIGHTOS: no hostnqn found. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 11:47:21 user nova-compute[74190]: DEBUG os_brick.utils [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cff158e257e1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:47:21 user nova-compute[74190]: DEBUG nova.virt.block_device [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Updating existing volume attachment record: 69b1166c-bad1-4a33-a855-0993f771cb84 {{(pid=74190) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 11:47:21 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-440a51e1-571e-419f-bb49-ba9319c27357 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Attempting to detach device vdb from instance c280652c-ffde-40f8-a919-adb8be618db8 from the persistent domain config. {{(pid=74190) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 18 11:47:21 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-440a51e1-571e-419f-bb49-ba9319c27357 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 11:47:21 user nova-compute[74190]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 11:47:21 user nova-compute[74190]:   <source dev="/dev/sdd"/>
Oct 18 11:47:21 user nova-compute[74190]:   <target dev="vdb" bus="virtio"/>
Oct 18 11:47:21 user nova-compute[74190]:   <serial>04ab732f-c6a7-459c-b856-68eeee8c77cb</serial>
Oct 18 11:47:21 user nova-compute[74190]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 18 11:47:21 user nova-compute[74190]: </disk>
Oct 18 11:47:21 user nova-compute[74190]:  {{(pid=74190) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 11:47:21 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-440a51e1-571e-419f-bb49-ba9319c27357 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Successfully detached device vdb from instance c280652c-ffde-40f8-a919-adb8be618db8 from the persistent domain config.
Oct 18 11:47:21 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-440a51e1-571e-419f-bb49-ba9319c27357 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c280652c-ffde-40f8-a919-adb8be618db8 from the live domain config. {{(pid=74190) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 18 11:47:21 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-440a51e1-571e-419f-bb49-ba9319c27357 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 11:47:21 user nova-compute[74190]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 11:47:21 user nova-compute[74190]:   <source dev="/dev/sdd"/>
Oct 18 11:47:21 user nova-compute[74190]:   <target dev="vdb" bus="virtio"/>
Oct 18 11:47:21 user nova-compute[74190]:   <serial>04ab732f-c6a7-459c-b856-68eeee8c77cb</serial>
Oct 18 11:47:21 user nova-compute[74190]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 18 11:47:21 user nova-compute[74190]: </disk>
Oct 18 11:47:21 user nova-compute[74190]:  {{(pid=74190) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 11:47:22 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-440a51e1-571e-419f-bb49-ba9319c27357 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c280652c-ffde-40f8-a919-adb8be618db8 {{(pid=74190) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 18 11:47:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:47:26 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:47:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:47:29 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-d6705f5b-5b09-448e-ace0-169a1724f060 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Acquiring lock "034398e8-e8c4-4e03-a608-440e447c6041" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:47:29 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-d6705f5b-5b09-448e-ace0-169a1724f060 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Lock "034398e8-e8c4-4e03-a608-440e447c6041" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:47:29 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-d6705f5b-5b09-448e-ace0-169a1724f060 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Acquiring lock "034398e8-e8c4-4e03-a608-440e447c6041-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:47:29 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-d6705f5b-5b09-448e-ace0-169a1724f060 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Lock "034398e8-e8c4-4e03-a608-440e447c6041-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:47:29 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-d6705f5b-5b09-448e-ace0-169a1724f060 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Lock "034398e8-e8c4-4e03-a608-440e447c6041-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:47:29 user nova-compute[74190]: INFO nova.compute.manager [None req-d6705f5b-5b09-448e-ace0-169a1724f060 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] [instance: 034398e8-e8c4-4e03-a608-440e447c6041] Terminating instance
Oct 18 11:47:29 user nova-compute[74190]: DEBUG nova.compute.manager [None req-d6705f5b-5b09-448e-ace0-169a1724f060 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] [instance: 034398e8-e8c4-4e03-a608-440e447c6041] Start destroying the instance on the hypervisor. {{(pid=74190) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 11:47:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:47:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:47:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:47:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:47:30 user nova-compute[74190]: DEBUG nova.compute.manager [req-38dc1d92-34c7-4464-8345-0af3b3b6e37b req-494cc154-d3c5-496d-81ee-5c6c9a861616 service nova] [instance: 034398e8-e8c4-4e03-a608-440e447c6041] Received event network-vif-unplugged-abefd824-cd1a-4947-996f-85553155dd8b {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:47:30 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-38dc1d92-34c7-4464-8345-0af3b3b6e37b req-494cc154-d3c5-496d-81ee-5c6c9a861616 service nova] Acquiring lock "034398e8-e8c4-4e03-a608-440e447c6041-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:47:30 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-38dc1d92-34c7-4464-8345-0af3b3b6e37b req-494cc154-d3c5-496d-81ee-5c6c9a861616 service nova] Lock "034398e8-e8c4-4e03-a608-440e447c6041-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:47:30 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-38dc1d92-34c7-4464-8345-0af3b3b6e37b req-494cc154-d3c5-496d-81ee-5c6c9a861616 service nova] Lock "034398e8-e8c4-4e03-a608-440e447c6041-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:47:30 user nova-compute[74190]: DEBUG nova.compute.manager [req-38dc1d92-34c7-4464-8345-0af3b3b6e37b req-494cc154-d3c5-496d-81ee-5c6c9a861616 service nova] [instance: 034398e8-e8c4-4e03-a608-440e447c6041] No waiting events found dispatching network-vif-unplugged-abefd824-cd1a-4947-996f-85553155dd8b {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:47:30 user nova-compute[74190]: DEBUG nova.compute.manager [req-38dc1d92-34c7-4464-8345-0af3b3b6e37b req-494cc154-d3c5-496d-81ee-5c6c9a861616 service nova] [instance: 034398e8-e8c4-4e03-a608-440e447c6041] Received event network-vif-unplugged-abefd824-cd1a-4947-996f-85553155dd8b for instance with task_state deleting. {{(pid=74190) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 11:47:30 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 034398e8-e8c4-4e03-a608-440e447c6041] Instance destroyed successfully.
Oct 18 11:47:30 user nova-compute[74190]: DEBUG nova.objects.instance [None req-d6705f5b-5b09-448e-ace0-169a1724f060 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Lazy-loading 'resources' on Instance uuid 034398e8-e8c4-4e03-a608-440e447c6041 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:47:30 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-d6705f5b-5b09-448e-ace0-169a1724f060 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:41:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1784183391',display_name='tempest-TestVolumeSwap-server-1784183391',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1784183391',id=7,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJWN+onDAlmnEVCYcz/0ARd9rVyKVLT5sVo/ztAOW+tHwQVRoLQRXLpJ4tjJ9+2d4yIDw3vBhx3lpVM69nyC2kABxoaIXrV2usOW6AAD9qfsN/NYQGSY7RnCwvCIGxVraA==',key_name='tempest-keypair-1866958635',keypairs=<?>,launch_index=0,launched_at=2023-10-18T11:41:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='21f627e5a9344c9bad9923c2b0cbec3b',ramdisk_id='',reservation_id='r-rcmji229',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1982013856',owner_user_name='tempest-TestVolumeSwap-1982013856-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T11:41:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dfa9681837ca44ca933fd55bf453a182',uuid=034398e8-e8c4-4e03-a608-440e447c6041,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "abefd824-cd1a-4947-996f-85553155dd8b", "address": "fa:16:3e:42:84:1e", "network": {"id": "1424584d-abb9-4d38-bcdc-3c0969e1bf01", "bridge": "br-int", "label": "tempest-TestVolumeSwap-127887868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21f627e5a9344c9bad9923c2b0cbec3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabefd824-cd", "ovs_interfaceid": "abefd824-cd1a-4947-996f-85553155dd8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 11:47:30 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-d6705f5b-5b09-448e-ace0-169a1724f060 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Converting VIF {"id": "abefd824-cd1a-4947-996f-85553155dd8b", "address": "fa:16:3e:42:84:1e", "network": {"id": "1424584d-abb9-4d38-bcdc-3c0969e1bf01", "bridge": "br-int", "label": "tempest-TestVolumeSwap-127887868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21f627e5a9344c9bad9923c2b0cbec3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabefd824-cd", "ovs_interfaceid": "abefd824-cd1a-4947-996f-85553155dd8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:47:30 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-d6705f5b-5b09-448e-ace0-169a1724f060 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:42:84:1e,bridge_name='br-int',has_traffic_filtering=True,id=abefd824-cd1a-4947-996f-85553155dd8b,network=Network(1424584d-abb9-4d38-bcdc-3c0969e1bf01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabefd824-cd') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:47:30 user nova-compute[74190]: DEBUG os_vif [None req-d6705f5b-5b09-448e-ace0-169a1724f060 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:84:1e,bridge_name='br-int',has_traffic_filtering=True,id=abefd824-cd1a-4947-996f-85553155dd8b,network=Network(1424584d-abb9-4d38-bcdc-3c0969e1bf01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabefd824-cd') {{(pid=74190) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 11:47:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:47:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapabefd824-cd, bridge=br-int, if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:47:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:47:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:47:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:47:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9a77450c-67a4-4895-972c-4e1acb5334a9) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:47:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:47:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:47:30 user nova-compute[74190]: INFO os_vif [None req-d6705f5b-5b09-448e-ace0-169a1724f060 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:84:1e,bridge_name='br-int',has_traffic_filtering=True,id=abefd824-cd1a-4947-996f-85553155dd8b,network=Network(1424584d-abb9-4d38-bcdc-3c0969e1bf01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabefd824-cd')
Oct 18 11:47:30 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6705f5b-5b09-448e-ace0-169a1724f060 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] [instance: 034398e8-e8c4-4e03-a608-440e447c6041] calling os-brick to detach iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 11:47:30 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6705f5b-5b09-448e-ace0-169a1724f060 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, {'target_iqn': 'iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'liIufdwV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'volume_id': 'd7b43003-2d4b-49b0-8449-6fb2ee281920'}, None), 'kwargs': True}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:47:30 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-d6705f5b-5b09-448e-ace0-169a1724f060 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:47:30 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-d6705f5b-5b09-448e-ace0-169a1724f060 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:47:30 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-d6705f5b-5b09-448e-ace0-169a1724f060 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:47:30 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:30 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:30 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[51defb19-5e7d-4823-8ae4-5324a3563dd5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:47:30 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6705f5b-5b09-448e-ace0-169a1724f060 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 11:47:30 user nova-compute[74190]: No targets found.
Oct 18 11:47:30 user nova-compute[74190]: iSNS:
Oct 18 11:47:30 user nova-compute[74190]: No targets found.
Oct 18 11:47:30 user nova-compute[74190]: STATIC:
Oct 18 11:47:30 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a
Oct 18 11:47:30 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:47:30 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:47:30 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920
Oct 18 11:47:30 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:47:30 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:47:30 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb
Oct 18 11:47:30 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:47:30 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:47:30 user nova-compute[74190]: FIRMWARE:
Oct 18 11:47:30 user nova-compute[74190]: No targets found.
Oct 18 11:47:30 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:47:30 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6705f5b-5b09-448e-ace0-169a1724f060 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 11:47:30 user nova-compute[74190]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 11:47:30 user nova-compute[74190]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74190) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 11:47:30 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6705f5b-5b09-448e-ace0-169a1724f060 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920', 0)] {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 11:47:30 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:30 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:30 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf369a2c-cd2c-44ea-b13c-3c28cb125fbb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:47:30 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:30 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:30 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[51146d0f-8d92-403e-ab8e-add3627f6743]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:47:30 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6705f5b-5b09-448e-ace0-169a1724f060 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920 (non-flash)
Oct 18 11:47:30 user nova-compute[74190]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)
Oct 18 11:47:30 user nova-compute[74190]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)
Oct 18 11:47:30 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:47:30 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6705f5b-5b09-448e-ace0-169a1724f060 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920 (non-flash)
Oct 18 11:47:30 user nova-compute[74190]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)
Oct 18 11:47:30 user nova-compute[74190]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)
Oct 18 11:47:30 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:47:30 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6705f5b-5b09-448e-ace0-169a1724f060 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1f44692950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920'): ({'sde'}, set())}) {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 11:47:30 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-d6705f5b-5b09-448e-ace0-169a1724f060 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Removing single pathed devices sde {{(pid=74190) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 11:47:30 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:30 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:30 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bbecfdd-5fdb-40fe-b718-38ffffb9f33b]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:47:30 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:31 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:31 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c58b77-0769-4d71-93f3-9f6e8a7a7ac7]: (4, ('ok\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:47:31 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-d6705f5b-5b09-448e-ace0-169a1724f060 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Flushing IO for device /dev/sde {{(pid=74190) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 11:47:31 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:31 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:31 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b91f1e-b91d-4730-9589-f492ef251672]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:47:31 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-d6705f5b-5b09-448e-ace0-169a1724f060 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74190) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 11:47:31 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:31 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.049s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:31 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[967d178e-aaf4-4403-8bc0-8013e8cc0a99]: (4, ('1', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:47:31 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-d6705f5b-5b09-448e-ace0-169a1724f060 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 11:47:31 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-d6705f5b-5b09-448e-ace0-169a1724f060 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] SCSI volumes sde have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 11:47:31 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6705f5b-5b09-448e-ace0-169a1724f060 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920')] {{(pid=74190) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 11:47:31 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:31 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:31 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d1d9039-6c17-447e-affe-fa6087eaaa68]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:47:31 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6705f5b-5b09-448e-ace0-169a1724f060 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:47:31 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920 -p 172.16.0.220:3260 --logout {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:31 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:31 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ccf4532-da4b-43ad-80f9-f0f18468868e]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:47:31 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6705f5b-5b09-448e-ace0-169a1724f060 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920, portal: 172.16.0.220,3260]
Oct 18 11:47:31 user nova-compute[74190]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920, portal: 172.16.0.220,3260] successful.
Oct 18 11:47:31 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:47:31 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920 -p 172.16.0.220:3260 --op delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:31 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7b43003-2d4b-49b0-8449-6fb2ee281920 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:31 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[8948b7d1-c185-405c-aa46-d8bf14c75a6c]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:47:31 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6705f5b-5b09-448e-ace0-169a1724f060 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:47:31 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-d6705f5b-5b09-448e-ace0-169a1724f060 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:47:31 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6705f5b-5b09-448e-ace0-169a1724f060 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] <== disconnect_volume: return (329ms) None {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:47:31 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6705f5b-5b09-448e-ace0-169a1724f060 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] [instance: 034398e8-e8c4-4e03-a608-440e447c6041] Disconnected iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 11:47:31 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-d6705f5b-5b09-448e-ace0-169a1724f060 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] [instance: 034398e8-e8c4-4e03-a608-440e447c6041] Deleting instance files /opt/stack/data/nova/instances/034398e8-e8c4-4e03-a608-440e447c6041_del
Oct 18 11:47:31 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-d6705f5b-5b09-448e-ace0-169a1724f060 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] [instance: 034398e8-e8c4-4e03-a608-440e447c6041] Deletion of /opt/stack/data/nova/instances/034398e8-e8c4-4e03-a608-440e447c6041_del complete
Oct 18 11:47:31 user nova-compute[74190]: INFO nova.compute.manager [None req-d6705f5b-5b09-448e-ace0-169a1724f060 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] [instance: 034398e8-e8c4-4e03-a608-440e447c6041] Took 1.45 seconds to destroy the instance on the hypervisor.
Oct 18 11:47:31 user nova-compute[74190]: DEBUG oslo.service.loopingcall [None req-d6705f5b-5b09-448e-ace0-169a1724f060 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74190) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 11:47:31 user nova-compute[74190]: DEBUG nova.compute.manager [-] [instance: 034398e8-e8c4-4e03-a608-440e447c6041] Deallocating network for instance {{(pid=74190) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 11:47:31 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: 034398e8-e8c4-4e03-a608-440e447c6041] deallocate_for_instance() {{(pid=74190) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 11:47:31 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Creating instance directory {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 11:47:31 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Creating image(s)
Oct 18 11:47:31 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Acquiring lock "/opt/stack/data/nova/instances/52d7b8e5-02cc-4148-86e2-ceb295e81afc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:47:31 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lock "/opt/stack/data/nova/instances/52d7b8e5-02cc-4148-86e2-ceb295e81afc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:47:31 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lock "/opt/stack/data/nova/instances/52d7b8e5-02cc-4148-86e2-ceb295e81afc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:47:31 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:31 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.180s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:31 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Acquiring lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:47:31 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:47:31 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.192s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f,backing_fmt=raw /opt/stack/data/nova/instances/52d7b8e5-02cc-4148-86e2-ceb295e81afc/disk 1073741824 {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f,backing_fmt=raw /opt/stack/data/nova/instances/52d7b8e5-02cc-4148-86e2-ceb295e81afc/disk 1073741824" returned: 0 in 0.052s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:32 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:47:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:32 user nova-compute[74190]: DEBUG nova.compute.manager [req-2fa4a42d-ac02-49f5-a7ce-06c6fc4b12ac req-f9bff3fd-49f7-42a0-b0bd-3f21f0d68d78 service nova] [instance: 034398e8-e8c4-4e03-a608-440e447c6041] Received event network-vif-plugged-abefd824-cd1a-4947-996f-85553155dd8b {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:47:32 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-2fa4a42d-ac02-49f5-a7ce-06c6fc4b12ac req-f9bff3fd-49f7-42a0-b0bd-3f21f0d68d78 service nova] Acquiring lock "034398e8-e8c4-4e03-a608-440e447c6041-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:47:32 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-2fa4a42d-ac02-49f5-a7ce-06c6fc4b12ac req-f9bff3fd-49f7-42a0-b0bd-3f21f0d68d78 service nova] Lock "034398e8-e8c4-4e03-a608-440e447c6041-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:47:32 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-2fa4a42d-ac02-49f5-a7ce-06c6fc4b12ac req-f9bff3fd-49f7-42a0-b0bd-3f21f0d68d78 service nova] Lock "034398e8-e8c4-4e03-a608-440e447c6041-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:47:32 user nova-compute[74190]: DEBUG nova.compute.manager [req-2fa4a42d-ac02-49f5-a7ce-06c6fc4b12ac req-f9bff3fd-49f7-42a0-b0bd-3f21f0d68d78 service nova] [instance: 034398e8-e8c4-4e03-a608-440e447c6041] No waiting events found dispatching network-vif-plugged-abefd824-cd1a-4947-996f-85553155dd8b {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:47:32 user nova-compute[74190]: WARNING nova.compute.manager [req-2fa4a42d-ac02-49f5-a7ce-06c6fc4b12ac req-f9bff3fd-49f7-42a0-b0bd-3f21f0d68d78 service nova] [instance: 034398e8-e8c4-4e03-a608-440e447c6041] Received unexpected event network-vif-plugged-abefd824-cd1a-4947-996f-85553155dd8b for instance with vm_state active and task_state deleting.
Oct 18 11:47:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.214s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:32 user nova-compute[74190]: DEBUG nova.virt.disk.api [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Checking if we can resize image /opt/stack/data/nova/instances/52d7b8e5-02cc-4148-86e2-ceb295e81afc/disk. size=1073741824 {{(pid=74190) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 18 11:47:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d7b8e5-02cc-4148-86e2-ceb295e81afc/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:32 user nova-compute[74190]: DEBUG nova.compute.manager [req-92b8bc9d-7c85-45e8-a286-f70415e4f913 req-cef967d1-5df3-4d53-a99c-d0e3d95acad4 service nova] [instance: 034398e8-e8c4-4e03-a608-440e447c6041] Received event network-vif-deleted-abefd824-cd1a-4947-996f-85553155dd8b {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:47:32 user nova-compute[74190]: INFO nova.compute.manager [req-92b8bc9d-7c85-45e8-a286-f70415e4f913 req-cef967d1-5df3-4d53-a99c-d0e3d95acad4 service nova] [instance: 034398e8-e8c4-4e03-a608-440e447c6041] Neutron deleted interface abefd824-cd1a-4947-996f-85553155dd8b; detaching it from the instance and deleting it from the info cache
Oct 18 11:47:32 user nova-compute[74190]: DEBUG nova.network.neutron [req-92b8bc9d-7c85-45e8-a286-f70415e4f913 req-cef967d1-5df3-4d53-a99c-d0e3d95acad4 service nova] [instance: 034398e8-e8c4-4e03-a608-440e447c6041] Updating instance_info_cache with network_info: [] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:47:32 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: 034398e8-e8c4-4e03-a608-440e447c6041] Updating instance_info_cache with network_info: [] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:47:32 user nova-compute[74190]: INFO nova.compute.manager [-] [instance: 034398e8-e8c4-4e03-a608-440e447c6041] Took 1.10 seconds to deallocate network for instance.
Oct 18 11:47:32 user nova-compute[74190]: DEBUG nova.compute.manager [req-92b8bc9d-7c85-45e8-a286-f70415e4f913 req-cef967d1-5df3-4d53-a99c-d0e3d95acad4 service nova] [instance: 034398e8-e8c4-4e03-a608-440e447c6041] Detach interface failed, port_id=abefd824-cd1a-4947-996f-85553155dd8b, reason: Instance 034398e8-e8c4-4e03-a608-440e447c6041 could not be found. {{(pid=74190) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 18 11:47:32 user nova-compute[74190]: DEBUG nova.compute.manager [req-4dd16bf9-a3eb-470b-97ae-98e25db71611 req-3a980745-09cd-4d14-8480-853f08b0e33d service nova] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Received event network-changed-5f5b65f1-7748-4422-8b45-e1b88476716d {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:47:32 user nova-compute[74190]: DEBUG nova.compute.manager [req-4dd16bf9-a3eb-470b-97ae-98e25db71611 req-3a980745-09cd-4d14-8480-853f08b0e33d service nova] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Refreshing instance network info cache due to event network-changed-5f5b65f1-7748-4422-8b45-e1b88476716d. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 11:47:32 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-4dd16bf9-a3eb-470b-97ae-98e25db71611 req-3a980745-09cd-4d14-8480-853f08b0e33d service nova] Acquiring lock "refresh_cache-bdfe420d-f46c-44ad-8773-b675f42e24ed" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:47:32 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-4dd16bf9-a3eb-470b-97ae-98e25db71611 req-3a980745-09cd-4d14-8480-853f08b0e33d service nova] Acquired lock "refresh_cache-bdfe420d-f46c-44ad-8773-b675f42e24ed" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:47:32 user nova-compute[74190]: DEBUG nova.network.neutron [req-4dd16bf9-a3eb-470b-97ae-98e25db71611 req-3a980745-09cd-4d14-8480-853f08b0e33d service nova] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Refreshing network info cache for port 5f5b65f1-7748-4422-8b45-e1b88476716d {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 11:47:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d7b8e5-02cc-4148-86e2-ceb295e81afc/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:32 user nova-compute[74190]: DEBUG nova.virt.disk.api [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Cannot resize image /opt/stack/data/nova/instances/52d7b8e5-02cc-4148-86e2-ceb295e81afc/disk to a smaller size. {{(pid=74190) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 18 11:47:32 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Created local disks {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 11:47:32 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Ensure instance console log exists: /opt/stack/data/nova/instances/52d7b8e5-02cc-4148-86e2-ceb295e81afc/console.log {{(pid=74190) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 11:47:32 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:47:32 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:47:32 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:47:32 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Start _get_guest_xml network_info=[{"id": "550e157d-7f82-41a1-b4ba-9dbb43037d8c", "address": "fa:16:3e:88:36:f0", "network": {"id": "f5ab7da4-2b07-4465-9a89-a07eb053ba91", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1315695374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08cf52ce927443158aa731367f08bd57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap550e157d-7f", "ovs_interfaceid": "550e157d-7f82-41a1-b4ba-9dbb43037d8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'image_id': '6e88bbf0-6e78-49a8-b3c5-9453d22a89df'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RNGiwTkM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '52d7b8e5-02cc-4148-86e2-ceb295e81afc', 'attached_at': '', 'detached_at': '', 'volume_id': 'b46a9877-5222-479e-a581-dfc0618bfe49', 'serial': 'b46a9877-5222-479e-a581-dfc0618bfe49'}, 'delete_on_termination': False, 'guest_format': None, 'attachment_id': '21751254-689f-407e-9046-fd3daa6aa33f', 'volume_type': None} {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 11:47:32 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 18 11:47:32 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 18 11:47:32 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 11:47:32 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] CPU controller missing on host. {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 11:47:32 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 11:47:32 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] CPU controller found on host. {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 11:47:32 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74190) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 11:47:32 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T11:37:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 11:47:32 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Flavor limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 11:47:32 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Image limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 11:47:32 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Flavor pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 11:47:32 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Image pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 11:47:32 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 11:47:32 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 11:47:32 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 11:47:32 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Got 1 possible topologies {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 11:47:32 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 11:47:32 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 11:47:32 user nova-compute[74190]: DEBUG nova.objects.instance [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lazy-loading 'vcpu_model' on Instance uuid 52d7b8e5-02cc-4148-86e2-ceb295e81afc {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:47:32 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Calling os-brick to attach iSCSI Volume {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 11:47:32 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RNGiwTkM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:47:32 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 18 11:47:32 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:47:32 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:47:32 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 18 11:47:32 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:47:32 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:47:32 user nova-compute[74190]: INFO os_brick.initiator.connectors.iscsi [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 11:47:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49 -p 172.16.0.220:3260 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:32 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[df380725-8593-430f-8d6b-36b34a76901d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:47:32 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 11:47:32 user nova-compute[74190]:  {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:47:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49 -p 172.16.0.220:3260 --interface default --op new {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:32 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[d737898d-395a-4a20-af32-233df43e4e3d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49] added\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:47:32 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49] added
Oct 18 11:47:32 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:47:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:32 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c42a895-6ae4-4098-be75-1ad444a66707]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:47:32 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:47:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:32 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de09991-5a30-44f4-be21-c95e9b7b8207]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:47:32 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:47:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RNGiwTkM {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RNGiwTkM" returned: 0 in 0.023s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:32 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[88011bce-b056-40c5-ae25-29708abec237]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:47:32 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RNGiwTkM'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:47:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:32 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c366f6-042c-4e14-9f25-3cc647b7df74]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:47:32 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:47:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:32 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[80fc3627-9e38-4604-a342-148f6e544f78]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:47:32 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)
Oct 18 11:47:32 user nova-compute[74190]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)
Oct 18 11:47:32 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:47:32 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)
Oct 18 11:47:32 user nova-compute[74190]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)
Oct 18 11:47:32 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:47:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49 -p 172.16.0.220:3260 --login {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:32 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[946c577e-21cd-423c-831e-7cfeda973102]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:47:32 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49, portal: 172.16.0.220,3260]
Oct 18 11:47:32 user nova-compute[74190]: Login to [iface: default, target: iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49, portal: 172.16.0.220,3260] successful.
Oct 18 11:47:32 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:47:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:32 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a8549d-b772-4fd0-b4a0-d80dd2d3a221]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:47:32 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:47:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:33 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:33 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[d69dd872-8690-4a1f-b72e-fc0697df20b1]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49 (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:47:33 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)
Oct 18 11:47:33 user nova-compute[74190]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)
Oct 18 11:47:33 user nova-compute[74190]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49 (non-flash)
Oct 18 11:47:33 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:47:33 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)
Oct 18 11:47:33 user nova-compute[74190]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)
Oct 18 11:47:33 user nova-compute[74190]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49 (non-flash)
Oct 18 11:47:33 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:47:33 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:47:33 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Connected to 172.16.0.220:3260 {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 11:47:33 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] HCTL ('33', '-', '-', 0) found on session 17 with lun 0 {{(pid=74190) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 11:47:33 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74190) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 11:47:33 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:33 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.024s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:33 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[819cc7e3-8af4-4cd8-a568-d257551d50c8]: (4, ('- - 0', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:47:33 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Searching for a device in session 17 and hctl ['33', '*', '*', 0] yield: None {{(pid=74190) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 11:47:33 user nova-compute[74190]: DEBUG nova.network.neutron [req-4dd16bf9-a3eb-470b-97ae-98e25db71611 req-3a980745-09cd-4d14-8480-853f08b0e33d service nova] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Updated VIF entry in instance network info cache for port 5f5b65f1-7748-4422-8b45-e1b88476716d. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 11:47:33 user nova-compute[74190]: DEBUG nova.network.neutron [req-4dd16bf9-a3eb-470b-97ae-98e25db71611 req-3a980745-09cd-4d14-8480-853f08b0e33d service nova] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Updating instance_info_cache with network_info: [{"id": "5f5b65f1-7748-4422-8b45-e1b88476716d", "address": "fa:16:3e:cb:ff:0f", "network": {"id": "7be8675d-326a-4184-9b3e-fbaa02a4e1fc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-468552750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce179d9f22684865b577bd91bc841400", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5b65f1-77", "ovs_interfaceid": "5f5b65f1-7748-4422-8b45-e1b88476716d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:47:33 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-4dd16bf9-a3eb-470b-97ae-98e25db71611 req-3a980745-09cd-4d14-8480-853f08b0e33d service nova] Releasing lock "refresh_cache-bdfe420d-f46c-44ad-8773-b675f42e24ed" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:47:33 user nova-compute[74190]: INFO nova.compute.manager [None req-d6705f5b-5b09-448e-ace0-169a1724f060 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] [instance: 034398e8-e8c4-4e03-a608-440e447c6041] Took 1.16 seconds to detach 1 volumes for instance.
Oct 18 11:47:33 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-d6705f5b-5b09-448e-ace0-169a1724f060 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:47:33 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-d6705f5b-5b09-448e-ace0-169a1724f060 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:47:33 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-d6705f5b-5b09-448e-ace0-169a1724f060 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Refreshing inventories for resource provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 18 11:47:33 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-d6705f5b-5b09-448e-ace0-169a1724f060 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Updating ProviderTree inventory for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 18 11:47:33 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-d6705f5b-5b09-448e-ace0-169a1724f060 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Updating inventory in ProviderTree for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 18 11:47:33 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-d6705f5b-5b09-448e-ace0-169a1724f060 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Refreshing aggregate associations for resource provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66, aggregates: None {{(pid=74190) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 18 11:47:33 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-d6705f5b-5b09-448e-ace0-169a1724f060 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Refreshing trait associations for resource provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66, traits: COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE42,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_ACCELERATORS,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=74190) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 18 11:47:34 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Searching for a device in session 17 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74190) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 11:47:34 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RNGiwTkM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 11:47:34 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:47:34 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] <== connect_volume: return (1365ms) {'type': 'block', 'scsi_wwn': '23531396435663636', 'path': '/dev/sdb'} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:47:34 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23531396435663636', 'path': '/dev/sdb'} {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 11:47:34 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-18T11:44:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-438639954',display_name='tempest-ServerActionsTestOtherA-server-123298975',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-438639954',id=12,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFdYXPh75Q7xKUqDE9zPp25KXyLhkj0/QLZATeV9ge1D1Ga7GiFXEGYg8QjRnvIAI0+WdgkHzK6fQEWBqJjE2h37Va7NyrV0Yc22ekpkzrQQ2biGg9l9Yf1LSoVy9aLWgA==',key_name='tempest-keypair-286461082',keypairs=<?>,launch_index=0,launched_at=2023-10-18T11:45:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='08cf52ce927443158aa731367f08bd57',ramdisk_id='',reservation_id='r-5s39f1w2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1288544694',owner_user_name='tempest-ServerActionsTestOtherA-1288544694-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:47:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b771e627a76b4540bf8de665df3d7787',uuid=52d7b8e5-02cc-4148-86e2-ceb295e81afc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "550e157d-7f82-41a1-b4ba-9dbb43037d8c", "address": "fa:16:3e:88:36:f0", "network": {"id": "f5ab7da4-2b07-4465-9a89-a07eb053ba91", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1315695374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08cf52ce927443158aa731367f08bd57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap550e157d-7f", "ovs_interfaceid": "550e157d-7f82-41a1-b4ba-9dbb43037d8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74190) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 11:47:34 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Converting VIF {"id": "550e157d-7f82-41a1-b4ba-9dbb43037d8c", "address": "fa:16:3e:88:36:f0", "network": {"id": "f5ab7da4-2b07-4465-9a89-a07eb053ba91", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1315695374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08cf52ce927443158aa731367f08bd57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap550e157d-7f", "ovs_interfaceid": "550e157d-7f82-41a1-b4ba-9dbb43037d8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:47:34 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:88:36:f0,bridge_name='br-int',has_traffic_filtering=True,id=550e157d-7f82-41a1-b4ba-9dbb43037d8c,network=Network(f5ab7da4-2b07-4465-9a89-a07eb053ba91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap550e157d-7f') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:47:34 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] End _get_guest_xml xml=<domain type="kvm">
Oct 18 11:47:34 user nova-compute[74190]:   <uuid>52d7b8e5-02cc-4148-86e2-ceb295e81afc</uuid>
Oct 18 11:47:34 user nova-compute[74190]:   <name>instance-0000000c</name>
Oct 18 11:47:34 user nova-compute[74190]:   <memory>524288</memory>
Oct 18 11:47:34 user nova-compute[74190]:   <vcpu>1</vcpu>
Oct 18 11:47:34 user nova-compute[74190]:   <metadata>
Oct 18 11:47:34 user nova-compute[74190]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 11:47:34 user nova-compute[74190]:       <nova:package version="0.0.0"/>
Oct 18 11:47:34 user nova-compute[74190]:       <nova:name>tempest-ServerActionsTestOtherA-server-123298975</nova:name>
Oct 18 11:47:34 user nova-compute[74190]:       <nova:creationTime>2023-10-18 11:47:32</nova:creationTime>
Oct 18 11:47:34 user nova-compute[74190]:       <nova:flavor name="m1.tiny">
Oct 18 11:47:34 user nova-compute[74190]:         <nova:memory>512</nova:memory>
Oct 18 11:47:34 user nova-compute[74190]:         <nova:disk>1</nova:disk>
Oct 18 11:47:34 user nova-compute[74190]:         <nova:swap>0</nova:swap>
Oct 18 11:47:34 user nova-compute[74190]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 11:47:34 user nova-compute[74190]:         <nova:vcpus>1</nova:vcpus>
Oct 18 11:47:34 user nova-compute[74190]:       </nova:flavor>
Oct 18 11:47:34 user nova-compute[74190]:       <nova:owner>
Oct 18 11:47:34 user nova-compute[74190]:         <nova:user uuid="b771e627a76b4540bf8de665df3d7787">tempest-ServerActionsTestOtherA-1288544694-project-member</nova:user>
Oct 18 11:47:34 user nova-compute[74190]:         <nova:project uuid="08cf52ce927443158aa731367f08bd57">tempest-ServerActionsTestOtherA-1288544694</nova:project>
Oct 18 11:47:34 user nova-compute[74190]:       </nova:owner>
Oct 18 11:47:34 user nova-compute[74190]:       <nova:root type="image" uuid="6e88bbf0-6e78-49a8-b3c5-9453d22a89df"/>
Oct 18 11:47:34 user nova-compute[74190]:       <nova:ports>
Oct 18 11:47:34 user nova-compute[74190]:         <nova:port uuid="550e157d-7f82-41a1-b4ba-9dbb43037d8c">
Oct 18 11:47:34 user nova-compute[74190]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 18 11:47:34 user nova-compute[74190]:         </nova:port>
Oct 18 11:47:34 user nova-compute[74190]:       </nova:ports>
Oct 18 11:47:34 user nova-compute[74190]:     </nova:instance>
Oct 18 11:47:34 user nova-compute[74190]:   </metadata>
Oct 18 11:47:34 user nova-compute[74190]:   <sysinfo type="smbios">
Oct 18 11:47:34 user nova-compute[74190]:     <system>
Oct 18 11:47:34 user nova-compute[74190]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 11:47:34 user nova-compute[74190]:       <entry name="product">OpenStack Nova</entry>
Oct 18 11:47:34 user nova-compute[74190]:       <entry name="version">0.0.0</entry>
Oct 18 11:47:34 user nova-compute[74190]:       <entry name="serial">52d7b8e5-02cc-4148-86e2-ceb295e81afc</entry>
Oct 18 11:47:34 user nova-compute[74190]:       <entry name="uuid">52d7b8e5-02cc-4148-86e2-ceb295e81afc</entry>
Oct 18 11:47:34 user nova-compute[74190]:       <entry name="family">Virtual Machine</entry>
Oct 18 11:47:34 user nova-compute[74190]:     </system>
Oct 18 11:47:34 user nova-compute[74190]:   </sysinfo>
Oct 18 11:47:34 user nova-compute[74190]:   <os>
Oct 18 11:47:34 user nova-compute[74190]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 11:47:34 user nova-compute[74190]:     <boot dev="hd"/>
Oct 18 11:47:34 user nova-compute[74190]:     <smbios mode="sysinfo"/>
Oct 18 11:47:34 user nova-compute[74190]:   </os>
Oct 18 11:47:34 user nova-compute[74190]:   <features>
Oct 18 11:47:34 user nova-compute[74190]:     <acpi/>
Oct 18 11:47:34 user nova-compute[74190]:     <apic/>
Oct 18 11:47:34 user nova-compute[74190]:     <vmcoreinfo/>
Oct 18 11:47:34 user nova-compute[74190]:   </features>
Oct 18 11:47:34 user nova-compute[74190]:   <clock offset="utc">
Oct 18 11:47:34 user nova-compute[74190]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 11:47:34 user nova-compute[74190]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 11:47:34 user nova-compute[74190]:     <timer name="hpet" present="no"/>
Oct 18 11:47:34 user nova-compute[74190]:   </clock>
Oct 18 11:47:34 user nova-compute[74190]:   <cpu mode="custom" match="exact">
Oct 18 11:47:34 user nova-compute[74190]:     <model>Nehalem</model>
Oct 18 11:47:34 user nova-compute[74190]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 11:47:34 user nova-compute[74190]:   </cpu>
Oct 18 11:47:34 user nova-compute[74190]:   <devices>
Oct 18 11:47:34 user nova-compute[74190]:     <disk type="file" device="disk">
Oct 18 11:47:34 user nova-compute[74190]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 11:47:34 user nova-compute[74190]:       <source file="/opt/stack/data/nova/instances/52d7b8e5-02cc-4148-86e2-ceb295e81afc/disk"/>
Oct 18 11:47:34 user nova-compute[74190]:       <target dev="vda" bus="virtio"/>
Oct 18 11:47:34 user nova-compute[74190]:     </disk>
Oct 18 11:47:34 user nova-compute[74190]:     <disk type="block" device="disk">
Oct 18 11:47:34 user nova-compute[74190]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 11:47:34 user nova-compute[74190]:       <source dev="/dev/sdb"/>
Oct 18 11:47:34 user nova-compute[74190]:       <target dev="vdb" bus="virtio"/>
Oct 18 11:47:34 user nova-compute[74190]:       <serial>b46a9877-5222-479e-a581-dfc0618bfe49</serial>
Oct 18 11:47:34 user nova-compute[74190]:     </disk>
Oct 18 11:47:34 user nova-compute[74190]:     <interface type="ethernet">
Oct 18 11:47:34 user nova-compute[74190]:       <mac address="fa:16:3e:88:36:f0"/>
Oct 18 11:47:34 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:47:34 user nova-compute[74190]:       <mtu size="1442"/>
Oct 18 11:47:34 user nova-compute[74190]:       <target dev="tap550e157d-7f"/>
Oct 18 11:47:34 user nova-compute[74190]:     </interface>
Oct 18 11:47:34 user nova-compute[74190]:     <serial type="pty">
Oct 18 11:47:34 user nova-compute[74190]:       <log file="/opt/stack/data/nova/instances/52d7b8e5-02cc-4148-86e2-ceb295e81afc/console.log" append="off"/>
Oct 18 11:47:34 user nova-compute[74190]:     </serial>
Oct 18 11:47:34 user nova-compute[74190]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 11:47:34 user nova-compute[74190]:     <video>
Oct 18 11:47:34 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:47:34 user nova-compute[74190]:     </video>
Oct 18 11:47:34 user nova-compute[74190]:     <rng model="virtio">
Oct 18 11:47:34 user nova-compute[74190]:       <backend model="random">/dev/urandom</backend>
Oct 18 11:47:34 user nova-compute[74190]:     </rng>
Oct 18 11:47:34 user nova-compute[74190]:     <controller type="usb" index="0" model="none"/>
Oct 18 11:47:34 user nova-compute[74190]:     <memballoon model="virtio">
Oct 18 11:47:34 user nova-compute[74190]:       <stats period="10"/>
Oct 18 11:47:34 user nova-compute[74190]:     </memballoon>
Oct 18 11:47:34 user nova-compute[74190]:   </devices>
Oct 18 11:47:34 user nova-compute[74190]: </domain>
Oct 18 11:47:34 user nova-compute[74190]:  {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 11:47:34 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-18T11:44:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-438639954',display_name='tempest-ServerActionsTestOtherA-server-123298975',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-438639954',id=12,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFdYXPh75Q7xKUqDE9zPp25KXyLhkj0/QLZATeV9ge1D1Ga7GiFXEGYg8QjRnvIAI0+WdgkHzK6fQEWBqJjE2h37Va7NyrV0Yc22ekpkzrQQ2biGg9l9Yf1LSoVy9aLWgA==',key_name='tempest-keypair-286461082',keypairs=<?>,launch_index=0,launched_at=2023-10-18T11:45:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='08cf52ce927443158aa731367f08bd57',ramdisk_id='',reservation_id='r-5s39f1w2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1288544694',owner_user_name='tempest-ServerActionsTestOtherA-1288544694-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:47:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b771e627a76b4540bf8de665df3d7787',uuid=52d7b8e5-02cc-4148-86e2-ceb295e81afc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "550e157d-7f82-41a1-b4ba-9dbb43037d8c", "address": "fa:16:3e:88:36:f0", "network": {"id": "f5ab7da4-2b07-4465-9a89-a07eb053ba91", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1315695374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08cf52ce927443158aa731367f08bd57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap550e157d-7f", "ovs_interfaceid": "550e157d-7f82-41a1-b4ba-9dbb43037d8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 11:47:34 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Converting VIF {"id": "550e157d-7f82-41a1-b4ba-9dbb43037d8c", "address": "fa:16:3e:88:36:f0", "network": {"id": "f5ab7da4-2b07-4465-9a89-a07eb053ba91", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1315695374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08cf52ce927443158aa731367f08bd57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap550e157d-7f", "ovs_interfaceid": "550e157d-7f82-41a1-b4ba-9dbb43037d8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:47:34 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:88:36:f0,bridge_name='br-int',has_traffic_filtering=True,id=550e157d-7f82-41a1-b4ba-9dbb43037d8c,network=Network(f5ab7da4-2b07-4465-9a89-a07eb053ba91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap550e157d-7f') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:47:34 user nova-compute[74190]: DEBUG os_vif [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:36:f0,bridge_name='br-int',has_traffic_filtering=True,id=550e157d-7f82-41a1-b4ba-9dbb43037d8c,network=Network(f5ab7da4-2b07-4465-9a89-a07eb053ba91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap550e157d-7f') {{(pid=74190) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 11:47:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:47:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:47:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 11:47:34 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-d6705f5b-5b09-448e-ace0-169a1724f060 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 11:47:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:47:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '900ba144-0ff4-5b0d-a816-c56aed8e4294', '_type': 'linux-noop'}}, row=False) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:47:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:47:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:47:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:47:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:47:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap550e157d-7f, may_exist=True, interface_attrs={}) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:47:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap550e157d-7f, col_values=(('qos', UUID('4df88888-5e19-4319-b296-030e91bcf2e2')),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:47:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap550e157d-7f, col_values=(('external_ids', {'iface-id': '550e157d-7f82-41a1-b4ba-9dbb43037d8c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:36:f0', 'vm-uuid': '52d7b8e5-02cc-4148-86e2-ceb295e81afc'}),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:47:34 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-d6705f5b-5b09-448e-ace0-169a1724f060 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 11:47:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:47:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:47:34 user nova-compute[74190]: INFO os_vif [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:36:f0,bridge_name='br-int',has_traffic_filtering=True,id=550e157d-7f82-41a1-b4ba-9dbb43037d8c,network=Network(f5ab7da4-2b07-4465-9a89-a07eb053ba91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap550e157d-7f')
Oct 18 11:47:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-d6705f5b-5b09-448e-ace0-169a1724f060 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.510s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:47:34 user nova-compute[74190]: INFO nova.scheduler.client.report [None req-d6705f5b-5b09-448e-ace0-169a1724f060 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Deleted allocations for instance 034398e8-e8c4-4e03-a608-440e447c6041
Oct 18 11:47:34 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] No BDM found with device name vda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 11:47:34 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 11:47:34 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] No VIF found with MAC fa:16:3e:88:36:f0, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 11:47:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-d6705f5b-5b09-448e-ace0-169a1724f060 tempest-TestVolumeSwap-1982013856 tempest-TestVolumeSwap-1982013856-project-member] Lock "034398e8-e8c4-4e03-a608-440e447c6041" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.500s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:47:35 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:47:35 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:47:35 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:47:35 user nova-compute[74190]: DEBUG nova.compute.manager [req-443d62da-a0f4-4627-b509-42f183d77e4a req-a79ae14a-f55d-402b-9271-a7a8382eb670 service nova] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Received event network-vif-plugged-550e157d-7f82-41a1-b4ba-9dbb43037d8c {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:47:35 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-443d62da-a0f4-4627-b509-42f183d77e4a req-a79ae14a-f55d-402b-9271-a7a8382eb670 service nova] Acquiring lock "52d7b8e5-02cc-4148-86e2-ceb295e81afc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:47:35 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-443d62da-a0f4-4627-b509-42f183d77e4a req-a79ae14a-f55d-402b-9271-a7a8382eb670 service nova] Lock "52d7b8e5-02cc-4148-86e2-ceb295e81afc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:47:35 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-443d62da-a0f4-4627-b509-42f183d77e4a req-a79ae14a-f55d-402b-9271-a7a8382eb670 service nova] Lock "52d7b8e5-02cc-4148-86e2-ceb295e81afc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:47:35 user nova-compute[74190]: DEBUG nova.compute.manager [req-443d62da-a0f4-4627-b509-42f183d77e4a req-a79ae14a-f55d-402b-9271-a7a8382eb670 service nova] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] No waiting events found dispatching network-vif-plugged-550e157d-7f82-41a1-b4ba-9dbb43037d8c {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:47:35 user nova-compute[74190]: WARNING nova.compute.manager [req-443d62da-a0f4-4627-b509-42f183d77e4a req-a79ae14a-f55d-402b-9271-a7a8382eb670 service nova] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Received unexpected event network-vif-plugged-550e157d-7f82-41a1-b4ba-9dbb43037d8c for instance with vm_state active and task_state rebuild_spawning.
Oct 18 11:47:35 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:47:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-1dc9789c-e05e-442b-9af1-5046eea154ba tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Acquiring lock "3c3cce66-9d7a-4f23-a92a-d10b3efd5e86" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:47:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-1dc9789c-e05e-442b-9af1-5046eea154ba tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Lock "3c3cce66-9d7a-4f23-a92a-d10b3efd5e86" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:47:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-1dc9789c-e05e-442b-9af1-5046eea154ba tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Acquiring lock "3c3cce66-9d7a-4f23-a92a-d10b3efd5e86-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:47:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-1dc9789c-e05e-442b-9af1-5046eea154ba tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Lock "3c3cce66-9d7a-4f23-a92a-d10b3efd5e86-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:47:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-1dc9789c-e05e-442b-9af1-5046eea154ba tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Lock "3c3cce66-9d7a-4f23-a92a-d10b3efd5e86-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:47:36 user nova-compute[74190]: INFO nova.compute.manager [None req-1dc9789c-e05e-442b-9af1-5046eea154ba tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Terminating instance
Oct 18 11:47:36 user nova-compute[74190]: DEBUG nova.compute.manager [None req-1dc9789c-e05e-442b-9af1-5046eea154ba tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Start destroying the instance on the hypervisor. {{(pid=74190) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 11:47:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:47:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:47:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:47:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:47:36 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Instance destroyed successfully.
Oct 18 11:47:36 user nova-compute[74190]: DEBUG nova.objects.instance [None req-1dc9789c-e05e-442b-9af1-5046eea154ba tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Lazy-loading 'resources' on Instance uuid 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:47:36 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-1dc9789c-e05e-442b-9af1-5046eea154ba tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-18T11:41:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-483118733',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-483118733',id=2,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC3fbJwjpJcODvmNEbH6DkfTuq/vNmpKXMAj6M+n75XoLrJlu4RmlMCvM6O8dl0GccAxqeju8gdcGNftn2/SOycIsQwxsxoRPc57gtaDIUNq6QqcMtgCrFnzcW3Mp4Vp6A==',key_name='tempest-keypair-576336985',keypairs=<?>,launch_index=0,launched_at=2023-10-18T11:45:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='548640fa718f4fdfa21c1a7783519c9f',ramdisk_id='',reservation_id='r-2fa6tit7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-83921126',owner_user_name='tempest-AttachVolumeShelveTestJSON-83921126-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T11:45:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='829b310c15b54dc7836d0b9d7fd757ed',uuid=3c3cce66-9d7a-4f23-a92a-d10b3efd5e86,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9", "address": "fa:16:3e:93:46:f1", "network": {"id": "e6ae8edc-7014-4341-91b2-4c82d72c9bb9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-15434410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548640fa718f4fdfa21c1a7783519c9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d891e1d-9d", "ovs_interfaceid": "8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 11:47:36 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-1dc9789c-e05e-442b-9af1-5046eea154ba tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Converting VIF {"id": "8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9", "address": "fa:16:3e:93:46:f1", "network": {"id": "e6ae8edc-7014-4341-91b2-4c82d72c9bb9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-15434410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548640fa718f4fdfa21c1a7783519c9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d891e1d-9d", "ovs_interfaceid": "8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:47:36 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-1dc9789c-e05e-442b-9af1-5046eea154ba tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:46:f1,bridge_name='br-int',has_traffic_filtering=True,id=8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9,network=Network(e6ae8edc-7014-4341-91b2-4c82d72c9bb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d891e1d-9d') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:47:36 user nova-compute[74190]: DEBUG os_vif [None req-1dc9789c-e05e-442b-9af1-5046eea154ba tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:46:f1,bridge_name='br-int',has_traffic_filtering=True,id=8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9,network=Network(e6ae8edc-7014-4341-91b2-4c82d72c9bb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d891e1d-9d') {{(pid=74190) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 11:47:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:47:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8d891e1d-9d, bridge=br-int, if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:47:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:47:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:47:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:47:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f425f089-07d2-42a1-843f-e3f2def4cb74) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:47:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:47:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:47:36 user nova-compute[74190]: INFO os_vif [None req-1dc9789c-e05e-442b-9af1-5046eea154ba tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:46:f1,bridge_name='br-int',has_traffic_filtering=True,id=8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9,network=Network(e6ae8edc-7014-4341-91b2-4c82d72c9bb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d891e1d-9d')
Oct 18 11:47:36 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-1dc9789c-e05e-442b-9af1-5046eea154ba tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Deleting instance files /opt/stack/data/nova/instances/3c3cce66-9d7a-4f23-a92a-d10b3efd5e86_del
Oct 18 11:47:36 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-1dc9789c-e05e-442b-9af1-5046eea154ba tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Deletion of /opt/stack/data/nova/instances/3c3cce66-9d7a-4f23-a92a-d10b3efd5e86_del complete
Oct 18 11:47:37 user nova-compute[74190]: INFO nova.compute.manager [None req-1dc9789c-e05e-442b-9af1-5046eea154ba tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Took 0.90 seconds to destroy the instance on the hypervisor.
Oct 18 11:47:37 user nova-compute[74190]: DEBUG oslo.service.loopingcall [None req-1dc9789c-e05e-442b-9af1-5046eea154ba tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74190) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 11:47:37 user nova-compute[74190]: DEBUG nova.compute.manager [-] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Deallocating network for instance {{(pid=74190) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 11:47:37 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] deallocate_for_instance() {{(pid=74190) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 11:47:37 user nova-compute[74190]: DEBUG nova.compute.manager [req-5316a995-3669-4423-b861-51de2a5de1db req-77019aff-f528-4a68-8b4b-9f7c10f85067 service nova] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Received event network-vif-plugged-550e157d-7f82-41a1-b4ba-9dbb43037d8c {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:47:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-5316a995-3669-4423-b861-51de2a5de1db req-77019aff-f528-4a68-8b4b-9f7c10f85067 service nova] Acquiring lock "52d7b8e5-02cc-4148-86e2-ceb295e81afc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:47:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-5316a995-3669-4423-b861-51de2a5de1db req-77019aff-f528-4a68-8b4b-9f7c10f85067 service nova] Lock "52d7b8e5-02cc-4148-86e2-ceb295e81afc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:47:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-5316a995-3669-4423-b861-51de2a5de1db req-77019aff-f528-4a68-8b4b-9f7c10f85067 service nova] Lock "52d7b8e5-02cc-4148-86e2-ceb295e81afc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:47:37 user nova-compute[74190]: DEBUG nova.compute.manager [req-5316a995-3669-4423-b861-51de2a5de1db req-77019aff-f528-4a68-8b4b-9f7c10f85067 service nova] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] No waiting events found dispatching network-vif-plugged-550e157d-7f82-41a1-b4ba-9dbb43037d8c {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:47:37 user nova-compute[74190]: WARNING nova.compute.manager [req-5316a995-3669-4423-b861-51de2a5de1db req-77019aff-f528-4a68-8b4b-9f7c10f85067 service nova] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Received unexpected event network-vif-plugged-550e157d-7f82-41a1-b4ba-9dbb43037d8c for instance with vm_state active and task_state rebuild_spawning.
Oct 18 11:47:37 user nova-compute[74190]: DEBUG nova.compute.manager [req-5316a995-3669-4423-b861-51de2a5de1db req-77019aff-f528-4a68-8b4b-9f7c10f85067 service nova] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Received event network-vif-unplugged-8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:47:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-5316a995-3669-4423-b861-51de2a5de1db req-77019aff-f528-4a68-8b4b-9f7c10f85067 service nova] Acquiring lock "3c3cce66-9d7a-4f23-a92a-d10b3efd5e86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:47:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-5316a995-3669-4423-b861-51de2a5de1db req-77019aff-f528-4a68-8b4b-9f7c10f85067 service nova] Lock "3c3cce66-9d7a-4f23-a92a-d10b3efd5e86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:47:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-5316a995-3669-4423-b861-51de2a5de1db req-77019aff-f528-4a68-8b4b-9f7c10f85067 service nova] Lock "3c3cce66-9d7a-4f23-a92a-d10b3efd5e86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:47:37 user nova-compute[74190]: DEBUG nova.compute.manager [req-5316a995-3669-4423-b861-51de2a5de1db req-77019aff-f528-4a68-8b4b-9f7c10f85067 service nova] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] No waiting events found dispatching network-vif-unplugged-8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:47:37 user nova-compute[74190]: DEBUG nova.compute.manager [req-5316a995-3669-4423-b861-51de2a5de1db req-77019aff-f528-4a68-8b4b-9f7c10f85067 service nova] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Received event network-vif-unplugged-8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9 for instance with task_state deleting. {{(pid=74190) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 11:47:37 user nova-compute[74190]: DEBUG nova.compute.manager [req-5316a995-3669-4423-b861-51de2a5de1db req-77019aff-f528-4a68-8b4b-9f7c10f85067 service nova] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Received event network-vif-plugged-8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:47:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-5316a995-3669-4423-b861-51de2a5de1db req-77019aff-f528-4a68-8b4b-9f7c10f85067 service nova] Acquiring lock "3c3cce66-9d7a-4f23-a92a-d10b3efd5e86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:47:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-5316a995-3669-4423-b861-51de2a5de1db req-77019aff-f528-4a68-8b4b-9f7c10f85067 service nova] Lock "3c3cce66-9d7a-4f23-a92a-d10b3efd5e86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:47:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-5316a995-3669-4423-b861-51de2a5de1db req-77019aff-f528-4a68-8b4b-9f7c10f85067 service nova] Lock "3c3cce66-9d7a-4f23-a92a-d10b3efd5e86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:47:37 user nova-compute[74190]: DEBUG nova.compute.manager [req-5316a995-3669-4423-b861-51de2a5de1db req-77019aff-f528-4a68-8b4b-9f7c10f85067 service nova] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] No waiting events found dispatching network-vif-plugged-8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:47:37 user nova-compute[74190]: WARNING nova.compute.manager [req-5316a995-3669-4423-b861-51de2a5de1db req-77019aff-f528-4a68-8b4b-9f7c10f85067 service nova] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Received unexpected event network-vif-plugged-8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9 for instance with vm_state active and task_state deleting.
Oct 18 11:47:37 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Updating instance_info_cache with network_info: [] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:47:37 user nova-compute[74190]: INFO nova.compute.manager [-] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Took 0.86 seconds to deallocate network for instance.
Oct 18 11:47:38 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-1dc9789c-e05e-442b-9af1-5046eea154ba tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:47:38 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-1dc9789c-e05e-442b-9af1-5046eea154ba tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:47:38 user nova-compute[74190]: DEBUG nova.compute.manager [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Instance event wait completed in 0 seconds for  {{(pid=74190) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 11:47:38 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Guest created on hypervisor {{(pid=74190) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 11:47:38 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Instance spawned successfully.
Oct 18 11:47:38 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 11:47:38 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Found default for hw_cdrom_bus of ide {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:47:38 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Found default for hw_disk_bus of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:47:38 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Found default for hw_input_bus of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:47:38 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Found default for hw_pointer_model of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:47:38 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Found default for hw_video_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:47:38 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Found default for hw_vif_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:47:38 user nova-compute[74190]: DEBUG nova.compute.manager [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Checking state {{(pid=74190) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 11:47:38 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:47:38 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-1dc9789c-e05e-442b-9af1-5046eea154ba tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 11:47:38 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-1dc9789c-e05e-442b-9af1-5046eea154ba tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 11:47:38 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-1dc9789c-e05e-442b-9af1-5046eea154ba tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.363s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:47:38 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.103s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:47:38 user nova-compute[74190]: DEBUG nova.objects.instance [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74190) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1078}}
Oct 18 11:47:38 user nova-compute[74190]: INFO nova.scheduler.client.report [None req-1dc9789c-e05e-442b-9af1-5046eea154ba tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Deleted allocations for instance 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86
Oct 18 11:47:38 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-e6c6249d-6d7b-4660-b1be-2a2c1fb028f8 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.079s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:47:38 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-1dc9789c-e05e-442b-9af1-5046eea154ba tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Lock "3c3cce66-9d7a-4f23-a92a-d10b3efd5e86" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.388s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:47:39 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:47:39 user nova-compute[74190]: DEBUG nova.compute.manager [req-8375f785-72bc-4c9a-a3f2-602a431a620e req-bddabca5-313d-4695-9e01-2ee8727ffa40 service nova] [instance: 3c3cce66-9d7a-4f23-a92a-d10b3efd5e86] Received event network-vif-deleted-8d891e1d-9d47-4bb7-a463-d79ea5d9f5b9 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:47:40 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-ee16d7de-fbf8-4f63-80ae-2f4d54450ead tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Acquiring lock "c6130edd-eb98-491e-a0ba-6bd59199d9e1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:47:40 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-ee16d7de-fbf8-4f63-80ae-2f4d54450ead tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Lock "c6130edd-eb98-491e-a0ba-6bd59199d9e1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:47:40 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-ee16d7de-fbf8-4f63-80ae-2f4d54450ead tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Acquiring lock "c6130edd-eb98-491e-a0ba-6bd59199d9e1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:47:40 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-ee16d7de-fbf8-4f63-80ae-2f4d54450ead tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Lock "c6130edd-eb98-491e-a0ba-6bd59199d9e1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:47:40 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-ee16d7de-fbf8-4f63-80ae-2f4d54450ead tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Lock "c6130edd-eb98-491e-a0ba-6bd59199d9e1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:47:40 user nova-compute[74190]: INFO nova.compute.manager [None req-ee16d7de-fbf8-4f63-80ae-2f4d54450ead tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] [instance: c6130edd-eb98-491e-a0ba-6bd59199d9e1] Terminating instance
Oct 18 11:47:40 user nova-compute[74190]: DEBUG nova.compute.manager [None req-ee16d7de-fbf8-4f63-80ae-2f4d54450ead tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] [instance: c6130edd-eb98-491e-a0ba-6bd59199d9e1] Start destroying the instance on the hypervisor. {{(pid=74190) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 11:47:40 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:47:40 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:47:40 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:47:40 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:47:40 user nova-compute[74190]: DEBUG nova.compute.manager [req-832bb2b5-7d4f-44e2-bf2a-ed7b35c2cded req-88eb112f-cbed-4a64-a5b6-fba7cc928a65 service nova] [instance: c6130edd-eb98-491e-a0ba-6bd59199d9e1] Received event network-vif-unplugged-bd84fceb-8a04-45a0-8f05-7bc856ed1a36 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:47:40 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-832bb2b5-7d4f-44e2-bf2a-ed7b35c2cded req-88eb112f-cbed-4a64-a5b6-fba7cc928a65 service nova] Acquiring lock "c6130edd-eb98-491e-a0ba-6bd59199d9e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:47:40 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-832bb2b5-7d4f-44e2-bf2a-ed7b35c2cded req-88eb112f-cbed-4a64-a5b6-fba7cc928a65 service nova] Lock "c6130edd-eb98-491e-a0ba-6bd59199d9e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:47:40 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-832bb2b5-7d4f-44e2-bf2a-ed7b35c2cded req-88eb112f-cbed-4a64-a5b6-fba7cc928a65 service nova] Lock "c6130edd-eb98-491e-a0ba-6bd59199d9e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:47:40 user nova-compute[74190]: DEBUG nova.compute.manager [req-832bb2b5-7d4f-44e2-bf2a-ed7b35c2cded req-88eb112f-cbed-4a64-a5b6-fba7cc928a65 service nova] [instance: c6130edd-eb98-491e-a0ba-6bd59199d9e1] No waiting events found dispatching network-vif-unplugged-bd84fceb-8a04-45a0-8f05-7bc856ed1a36 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:47:40 user nova-compute[74190]: DEBUG nova.compute.manager [req-832bb2b5-7d4f-44e2-bf2a-ed7b35c2cded req-88eb112f-cbed-4a64-a5b6-fba7cc928a65 service nova] [instance: c6130edd-eb98-491e-a0ba-6bd59199d9e1] Received event network-vif-unplugged-bd84fceb-8a04-45a0-8f05-7bc856ed1a36 for instance with task_state deleting. {{(pid=74190) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 11:47:41 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: c6130edd-eb98-491e-a0ba-6bd59199d9e1] Instance destroyed successfully.
Oct 18 11:47:41 user nova-compute[74190]: DEBUG nova.objects.instance [None req-ee16d7de-fbf8-4f63-80ae-2f4d54450ead tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Lazy-loading 'resources' on Instance uuid c6130edd-eb98-491e-a0ba-6bd59199d9e1 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:47:41 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-ee16d7de-fbf8-4f63-80ae-2f4d54450ead tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:41:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2004469902',display_name='tempest-VolumesAdminNegativeTest-server-2004469902',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2004469902',id=4,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHSK4yZJ9nvU8rHQ1gwT+VM8d6Vhd755AOGrYLvTCGOs3cERsYjXJirr8z9QBzq5SLgzv50feVjknIasSnvucp7cLhZ4vJwgB+R1ic6JFgTICtrO0wwd+zbXWTuu7x+IoA==',key_name='tempest-keypair-1017531913',keypairs=<?>,launch_index=0,launched_at=2023-10-18T11:41:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6d83064382624b4d895b0d7bff463f4f',ramdisk_id='',reservation_id='r-9mdzy0a8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1125052526',owner_user_name='tempest-VolumesAdminNegativeTest-1125052526-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T11:41:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c68a9cb13814419a38413f9513d5a80',uuid=c6130edd-eb98-491e-a0ba-6bd59199d9e1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bd84fceb-8a04-45a0-8f05-7bc856ed1a36", "address": "fa:16:3e:ee:96:5d", "network": {"id": "c174814d-6217-4201-9af1-1575a8dcf751", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-981245321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d83064382624b4d895b0d7bff463f4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd84fceb-8a", "ovs_interfaceid": "bd84fceb-8a04-45a0-8f05-7bc856ed1a36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 11:47:41 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-ee16d7de-fbf8-4f63-80ae-2f4d54450ead tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Converting VIF {"id": "bd84fceb-8a04-45a0-8f05-7bc856ed1a36", "address": "fa:16:3e:ee:96:5d", "network": {"id": "c174814d-6217-4201-9af1-1575a8dcf751", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-981245321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d83064382624b4d895b0d7bff463f4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd84fceb-8a", "ovs_interfaceid": "bd84fceb-8a04-45a0-8f05-7bc856ed1a36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:47:41 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-ee16d7de-fbf8-4f63-80ae-2f4d54450ead tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ee:96:5d,bridge_name='br-int',has_traffic_filtering=True,id=bd84fceb-8a04-45a0-8f05-7bc856ed1a36,network=Network(c174814d-6217-4201-9af1-1575a8dcf751),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd84fceb-8a') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:47:41 user nova-compute[74190]: DEBUG os_vif [None req-ee16d7de-fbf8-4f63-80ae-2f4d54450ead tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:96:5d,bridge_name='br-int',has_traffic_filtering=True,id=bd84fceb-8a04-45a0-8f05-7bc856ed1a36,network=Network(c174814d-6217-4201-9af1-1575a8dcf751),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd84fceb-8a') {{(pid=74190) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 11:47:41 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:47:41 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbd84fceb-8a, bridge=br-int, if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:47:41 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:47:41 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:47:41 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:47:41 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4afeb585-7a10-4077-86c1-143b17f59afb) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:47:41 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:47:41 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:47:41 user nova-compute[74190]: INFO os_vif [None req-ee16d7de-fbf8-4f63-80ae-2f4d54450ead tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:96:5d,bridge_name='br-int',has_traffic_filtering=True,id=bd84fceb-8a04-45a0-8f05-7bc856ed1a36,network=Network(c174814d-6217-4201-9af1-1575a8dcf751),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd84fceb-8a')
Oct 18 11:47:41 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-ee16d7de-fbf8-4f63-80ae-2f4d54450ead tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] [instance: c6130edd-eb98-491e-a0ba-6bd59199d9e1] Deleting instance files /opt/stack/data/nova/instances/c6130edd-eb98-491e-a0ba-6bd59199d9e1_del
Oct 18 11:47:41 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-ee16d7de-fbf8-4f63-80ae-2f4d54450ead tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] [instance: c6130edd-eb98-491e-a0ba-6bd59199d9e1] Deletion of /opt/stack/data/nova/instances/c6130edd-eb98-491e-a0ba-6bd59199d9e1_del complete
Oct 18 11:47:41 user nova-compute[74190]: INFO nova.compute.manager [None req-ee16d7de-fbf8-4f63-80ae-2f4d54450ead tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] [instance: c6130edd-eb98-491e-a0ba-6bd59199d9e1] Took 0.89 seconds to destroy the instance on the hypervisor.
Oct 18 11:47:41 user nova-compute[74190]: DEBUG oslo.service.loopingcall [None req-ee16d7de-fbf8-4f63-80ae-2f4d54450ead tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74190) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 11:47:41 user nova-compute[74190]: DEBUG nova.compute.manager [-] [instance: c6130edd-eb98-491e-a0ba-6bd59199d9e1] Deallocating network for instance {{(pid=74190) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 11:47:41 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: c6130edd-eb98-491e-a0ba-6bd59199d9e1] deallocate_for_instance() {{(pid=74190) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 11:47:42 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: c6130edd-eb98-491e-a0ba-6bd59199d9e1] Updating instance_info_cache with network_info: [] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:47:42 user nova-compute[74190]: INFO nova.compute.manager [-] [instance: c6130edd-eb98-491e-a0ba-6bd59199d9e1] Took 0.93 seconds to deallocate network for instance.
Oct 18 11:47:42 user nova-compute[74190]: DEBUG nova.compute.manager [req-59944547-200b-4068-bfac-a2f548384a87 req-22977ed1-6b4d-4910-b5e7-363918c8f062 service nova] [instance: c6130edd-eb98-491e-a0ba-6bd59199d9e1] Received event network-vif-deleted-bd84fceb-8a04-45a0-8f05-7bc856ed1a36 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:47:42 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-ee16d7de-fbf8-4f63-80ae-2f4d54450ead tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:47:42 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-ee16d7de-fbf8-4f63-80ae-2f4d54450ead tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:47:42 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-440a51e1-571e-419f-bb49-ba9319c27357 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c280652c-ffde-40f8-a919-adb8be618db8 is timed out.
Oct 18 11:47:42 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-440a51e1-571e-419f-bb49-ba9319c27357 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Successfully detached device vdb from instance c280652c-ffde-40f8-a919-adb8be618db8 from the live domain config.
Oct 18 11:47:42 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-440a51e1-571e-419f-bb49-ba9319c27357 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: c280652c-ffde-40f8-a919-adb8be618db8] calling os-brick to detach iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 11:47:42 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-440a51e1-571e-419f-bb49-ba9319c27357 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, {'target_iqn': 'iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tNhfvoBT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:47:42 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-440a51e1-571e-419f-bb49-ba9319c27357 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:47:42 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-440a51e1-571e-419f-bb49-ba9319c27357 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:47:42 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-440a51e1-571e-419f-bb49-ba9319c27357 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:47:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:42 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-ee16d7de-fbf8-4f63-80ae-2f4d54450ead tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 11:47:42 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-ee16d7de-fbf8-4f63-80ae-2f4d54450ead tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 11:47:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:42 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e2a6d2-ad3c-4349-96f8-652683383c09]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:47:42 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-440a51e1-571e-419f-bb49-ba9319c27357 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 11:47:42 user nova-compute[74190]: No targets found.
Oct 18 11:47:42 user nova-compute[74190]: iSNS:
Oct 18 11:47:42 user nova-compute[74190]: No targets found.
Oct 18 11:47:42 user nova-compute[74190]: STATIC:
Oct 18 11:47:42 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a
Oct 18 11:47:42 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:47:42 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:47:42 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49
Oct 18 11:47:42 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:47:42 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:47:42 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb
Oct 18 11:47:42 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:47:42 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:47:42 user nova-compute[74190]: FIRMWARE:
Oct 18 11:47:42 user nova-compute[74190]: No targets found.
Oct 18 11:47:42 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:47:42 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-440a51e1-571e-419f-bb49-ba9319c27357 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 11:47:42 user nova-compute[74190]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 11:47:42 user nova-compute[74190]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74190) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 11:47:42 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-440a51e1-571e-419f-bb49-ba9319c27357 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb', 0)] {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 11:47:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:42 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[5babc34c-3643-4fe1-af10-72df014a2590]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:47:42 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-ee16d7de-fbf8-4f63-80ae-2f4d54450ead tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.314s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:47:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:42 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7497727-20a5-4145-ad70-b98b2668f7e5]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49 (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:47:42 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-440a51e1-571e-419f-bb49-ba9319c27357 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)
Oct 18 11:47:42 user nova-compute[74190]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)
Oct 18 11:47:42 user nova-compute[74190]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49 (non-flash)
Oct 18 11:47:42 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:47:42 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-440a51e1-571e-419f-bb49-ba9319c27357 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb (non-flash)
Oct 18 11:47:42 user nova-compute[74190]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)
Oct 18 11:47:42 user nova-compute[74190]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49 (non-flash)
Oct 18 11:47:42 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:47:42 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-440a51e1-571e-419f-bb49-ba9319c27357 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1f44599ab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb'): ({'sdd'}, set())}) {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 11:47:42 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-440a51e1-571e-419f-bb49-ba9319c27357 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Removing single pathed devices sdd {{(pid=74190) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 11:47:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:42 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e50f9b-c455-46f5-819a-cafbb6215764]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:47:42 user nova-compute[74190]: INFO nova.scheduler.client.report [None req-ee16d7de-fbf8-4f63-80ae-2f4d54450ead tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Deleted allocations for instance c6130edd-eb98-491e-a0ba-6bd59199d9e1
Oct 18 11:47:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:42 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[f736415e-44d8-460d-a8a9-b198180202f3]: (4, ('ok\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:47:42 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-440a51e1-571e-419f-bb49-ba9319c27357 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Flushing IO for device /dev/sdd {{(pid=74190) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 11:47:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:42 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c17eaf8-20d0-4a28-817e-0f25252482d9]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:47:42 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-440a51e1-571e-419f-bb49-ba9319c27357 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74190) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 11:47:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:42 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c838a73-204e-4cc2-bd6b-962741fafb61]: (4, ('1', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:47:42 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-440a51e1-571e-419f-bb49-ba9319c27357 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 11:47:42 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-440a51e1-571e-419f-bb49-ba9319c27357 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] SCSI volumes sdd have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 11:47:42 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-440a51e1-571e-419f-bb49-ba9319c27357 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb')] {{(pid=74190) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 11:47:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:42 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-ee16d7de-fbf8-4f63-80ae-2f4d54450ead tempest-VolumesAdminNegativeTest-1125052526 tempest-VolumesAdminNegativeTest-1125052526-project-member] Lock "c6130edd-eb98-491e-a0ba-6bd59199d9e1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.380s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:47:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:42 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[31fbc00c-9d54-4891-8479-11bfcd500a46]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:47:42 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-440a51e1-571e-419f-bb49-ba9319c27357 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:47:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb -p 172.16.0.220:3260 --logout {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:42 user nova-compute[74190]: DEBUG nova.compute.manager [req-44c97fba-5283-4c3e-ae8d-457e62a419cd req-2baa02d4-944f-41e8-8d00-3909b5f59e43 service nova] [instance: c6130edd-eb98-491e-a0ba-6bd59199d9e1] Received event network-vif-plugged-bd84fceb-8a04-45a0-8f05-7bc856ed1a36 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:47:42 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-44c97fba-5283-4c3e-ae8d-457e62a419cd req-2baa02d4-944f-41e8-8d00-3909b5f59e43 service nova] Acquiring lock "c6130edd-eb98-491e-a0ba-6bd59199d9e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:47:42 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-44c97fba-5283-4c3e-ae8d-457e62a419cd req-2baa02d4-944f-41e8-8d00-3909b5f59e43 service nova] Lock "c6130edd-eb98-491e-a0ba-6bd59199d9e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:47:42 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-44c97fba-5283-4c3e-ae8d-457e62a419cd req-2baa02d4-944f-41e8-8d00-3909b5f59e43 service nova] Lock "c6130edd-eb98-491e-a0ba-6bd59199d9e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:47:42 user nova-compute[74190]: DEBUG nova.compute.manager [req-44c97fba-5283-4c3e-ae8d-457e62a419cd req-2baa02d4-944f-41e8-8d00-3909b5f59e43 service nova] [instance: c6130edd-eb98-491e-a0ba-6bd59199d9e1] No waiting events found dispatching network-vif-plugged-bd84fceb-8a04-45a0-8f05-7bc856ed1a36 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:47:42 user nova-compute[74190]: WARNING nova.compute.manager [req-44c97fba-5283-4c3e-ae8d-457e62a419cd req-2baa02d4-944f-41e8-8d00-3909b5f59e43 service nova] [instance: c6130edd-eb98-491e-a0ba-6bd59199d9e1] Received unexpected event network-vif-plugged-bd84fceb-8a04-45a0-8f05-7bc856ed1a36 for instance with vm_state deleted and task_state None.
Oct 18 11:47:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:42 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f5a919-72a7-41cf-9e8a-b4a83d4bfbcd]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:47:42 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-440a51e1-571e-419f-bb49-ba9319c27357 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb, portal: 172.16.0.220,3260]
Oct 18 11:47:42 user nova-compute[74190]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb, portal: 172.16.0.220,3260] successful.
Oct 18 11:47:42 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:47:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb -p 172.16.0.220:3260 --op delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04ab732f-c6a7-459c-b856-68eeee8c77cb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:42 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[de05e211-6531-4cb7-8bf4-4cc5f5d524d3]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:47:42 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-440a51e1-571e-419f-bb49-ba9319c27357 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:47:42 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-440a51e1-571e-419f-bb49-ba9319c27357 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:47:42 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-440a51e1-571e-419f-bb49-ba9319c27357 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] <== disconnect_volume: return (353ms) None {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:47:42 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-440a51e1-571e-419f-bb49-ba9319c27357 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Disconnected iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 11:47:43 user nova-compute[74190]: DEBUG nova.objects.instance [None req-440a51e1-571e-419f-bb49-ba9319c27357 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lazy-loading 'flavor' on Instance uuid c280652c-ffde-40f8-a919-adb8be618db8 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:47:43 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-440a51e1-571e-419f-bb49-ba9319c27357 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lock "c280652c-ffde-40f8-a919-adb8be618db8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.109s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:47:44 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-7cf3c7bb-c0bd-4ac1-aab1-803c81a20b4c tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Acquiring lock "c280652c-ffde-40f8-a919-adb8be618db8" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:47:44 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-7cf3c7bb-c0bd-4ac1-aab1-803c81a20b4c tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lock "c280652c-ffde-40f8-a919-adb8be618db8" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:47:44 user nova-compute[74190]: DEBUG nova.compute.manager [None req-7cf3c7bb-c0bd-4ac1-aab1-803c81a20b4c tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Checking state {{(pid=74190) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 11:47:44 user nova-compute[74190]: DEBUG nova.compute.manager [None req-7cf3c7bb-c0bd-4ac1-aab1-803c81a20b4c tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74190) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Oct 18 11:47:44 user nova-compute[74190]: DEBUG nova.objects.instance [None req-7cf3c7bb-c0bd-4ac1-aab1-803c81a20b4c tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lazy-loading 'flavor' on Instance uuid c280652c-ffde-40f8-a919-adb8be618db8 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:47:44 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:47:44 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:47:44 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:47:44 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:47:45 user nova-compute[74190]: DEBUG nova.compute.manager [req-67a922a7-0182-490f-b9fa-d2949d9d8b89 req-d6259043-c3e3-46b8-8f8f-cec894eae90b service nova] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Received event network-vif-unplugged-80b77e2d-aa04-4996-a0c1-713054affac4 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:47:45 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-67a922a7-0182-490f-b9fa-d2949d9d8b89 req-d6259043-c3e3-46b8-8f8f-cec894eae90b service nova] Acquiring lock "c280652c-ffde-40f8-a919-adb8be618db8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:47:45 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-67a922a7-0182-490f-b9fa-d2949d9d8b89 req-d6259043-c3e3-46b8-8f8f-cec894eae90b service nova] Lock "c280652c-ffde-40f8-a919-adb8be618db8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:47:45 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-67a922a7-0182-490f-b9fa-d2949d9d8b89 req-d6259043-c3e3-46b8-8f8f-cec894eae90b service nova] Lock "c280652c-ffde-40f8-a919-adb8be618db8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:47:45 user nova-compute[74190]: DEBUG nova.compute.manager [req-67a922a7-0182-490f-b9fa-d2949d9d8b89 req-d6259043-c3e3-46b8-8f8f-cec894eae90b service nova] [instance: c280652c-ffde-40f8-a919-adb8be618db8] No waiting events found dispatching network-vif-unplugged-80b77e2d-aa04-4996-a0c1-713054affac4 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:47:45 user nova-compute[74190]: WARNING nova.compute.manager [req-67a922a7-0182-490f-b9fa-d2949d9d8b89 req-d6259043-c3e3-46b8-8f8f-cec894eae90b service nova] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Received unexpected event network-vif-unplugged-80b77e2d-aa04-4996-a0c1-713054affac4 for instance with vm_state active and task_state powering-off.
Oct 18 11:47:45 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:47:45 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:47:45 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Instance destroyed successfully.
Oct 18 11:47:45 user nova-compute[74190]: DEBUG nova.compute.manager [None req-7cf3c7bb-c0bd-4ac1-aab1-803c81a20b4c tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Checking state {{(pid=74190) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 11:47:45 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-7cf3c7bb-c0bd-4ac1-aab1-803c81a20b4c tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lock "c280652c-ffde-40f8-a919-adb8be618db8" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.178s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:47:46 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:47:47 user nova-compute[74190]: DEBUG nova.compute.manager [req-f725b8ed-cc5e-43e3-9ea2-916be1fcb98e req-260fd152-c862-4f1c-b79e-9a28308d17d6 service nova] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Received event network-vif-plugged-80b77e2d-aa04-4996-a0c1-713054affac4 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:47:47 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-f725b8ed-cc5e-43e3-9ea2-916be1fcb98e req-260fd152-c862-4f1c-b79e-9a28308d17d6 service nova] Acquiring lock "c280652c-ffde-40f8-a919-adb8be618db8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:47:47 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-f725b8ed-cc5e-43e3-9ea2-916be1fcb98e req-260fd152-c862-4f1c-b79e-9a28308d17d6 service nova] Lock "c280652c-ffde-40f8-a919-adb8be618db8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:47:47 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-f725b8ed-cc5e-43e3-9ea2-916be1fcb98e req-260fd152-c862-4f1c-b79e-9a28308d17d6 service nova] Lock "c280652c-ffde-40f8-a919-adb8be618db8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:47:47 user nova-compute[74190]: DEBUG nova.compute.manager [req-f725b8ed-cc5e-43e3-9ea2-916be1fcb98e req-260fd152-c862-4f1c-b79e-9a28308d17d6 service nova] [instance: c280652c-ffde-40f8-a919-adb8be618db8] No waiting events found dispatching network-vif-plugged-80b77e2d-aa04-4996-a0c1-713054affac4 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:47:47 user nova-compute[74190]: WARNING nova.compute.manager [req-f725b8ed-cc5e-43e3-9ea2-916be1fcb98e req-260fd152-c862-4f1c-b79e-9a28308d17d6 service nova] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Received unexpected event network-vif-plugged-80b77e2d-aa04-4996-a0c1-713054affac4 for instance with vm_state stopped and task_state None.
Oct 18 11:47:49 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:47:51 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:47:51 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:47:52 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:47:52 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:47:52 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:47:52 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74190) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 11:47:53 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:47:53 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:47:53 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:47:53 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:47:53 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Auditing locally available compute resources for user (node: user) {{(pid=74190) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 11:47:53 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d7b8e5-02cc-4148-86e2-ceb295e81afc/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:53 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d7b8e5-02cc-4148-86e2-ceb295e81afc/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:53 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d7b8e5-02cc-4148-86e2-ceb295e81afc/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:53 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d7b8e5-02cc-4148-86e2-ceb295e81afc/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:53 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 11:47:53 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0209c824-88a7-4976-83bf-8a72437f0cc2/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:53 user nova-compute[74190]: INFO nova.virt.block_device [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Booting with volume 555c71a2-d950-48cc-96fd-725e0df8ce78 at /dev/vdc
Oct 18 11:47:53 user nova-compute[74190]: DEBUG os_brick.utils [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:47:53 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:53 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:53 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[015cea3e-c8fc-4c9f-9c36-89bb1213ce57]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cff158e257e1\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:47:53 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:53 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:53 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c0c3c31-b520-46cd-aea3-ae788fec8de2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:47:53 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:53 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:53 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d25510d-faaf-407e-842e-808ecf168c80]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:47:53 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c9837f-09c4-4b4f-85e9-6441d266fad9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:47:53 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Running cmd (subprocess): nvme version {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:53 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] 'nvme version' failed. Not Retrying. {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 11:47:53 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] nvme not present on system {{(pid=74190) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 11:47:53 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0209c824-88a7-4976-83bf-8a72437f0cc2/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:53 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0209c824-88a7-4976-83bf-8a72437f0cc2/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:53 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:53 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 11:47:53 user nova-compute[74190]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 11:47:53 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ffa55d0-cdc8-4627-b418-f5329247caad]: (4, '') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:47:53 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74190) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 11:47:53 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 11:47:53 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] LIGHTOS: no hostnqn found. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 11:47:53 user nova-compute[74190]: DEBUG os_brick.utils [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cff158e257e1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:47:53 user nova-compute[74190]: DEBUG nova.virt.block_device [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Updating existing volume attachment record: 21eb0cb0-e1c5-41bf-94bc-6f0af8c9c705 {{(pid=74190) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 11:47:54 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0209c824-88a7-4976-83bf-8a72437f0cc2/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:54 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 11:47:54 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c280652c-ffde-40f8-a919-adb8be618db8/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:54 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:47:54 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c280652c-ffde-40f8-a919-adb8be618db8/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:54 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c280652c-ffde-40f8-a919-adb8be618db8/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:54 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c280652c-ffde-40f8-a919-adb8be618db8/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:54 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdfe420d-f46c-44ad-8773-b675f42e24ed/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:54 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdfe420d-f46c-44ad-8773-b675f42e24ed/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:54 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdfe420d-f46c-44ad-8773-b675f42e24ed/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:47:54 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdfe420d-f46c-44ad-8773-b675f42e24ed/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:47:55 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:47:55 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:47:55 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Hypervisor/Node resource view: name=user free_ram=8137MB free_disk=25.700016021728516GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74190) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 11:47:55 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:47:55 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:47:55 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance c280652c-ffde-40f8-a919-adb8be618db8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:47:55 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 0209c824-88a7-4976-83bf-8a72437f0cc2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:47:55 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 52d7b8e5-02cc-4148-86e2-ceb295e81afc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:47:55 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance bdfe420d-f46c-44ad-8773-b675f42e24ed actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:47:55 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 3bd2f6d6-9c07-42a0-869e-566d685cb025 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:47:55 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 738fc62c-293c-4fee-9943-45033e0f2602 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:47:55 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 11:47:55 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 11:47:55 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 11:47:55 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 11:47:55 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Compute_service record updated for user:user {{(pid=74190) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 11:47:55 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.361s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:47:56 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:47:56 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:47:58 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:47:58 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:47:58 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Starting heal instance info cache {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 11:47:58 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Rebuilding the list of instances to heal {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 18 11:47:58 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Skipping network cache update for instance because it is Building. {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 18 11:47:58 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "refresh_cache-c280652c-ffde-40f8-a919-adb8be618db8" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:47:58 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquired lock "refresh_cache-c280652c-ffde-40f8-a919-adb8be618db8" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:47:58 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Forcefully refreshing network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 18 11:47:58 user nova-compute[74190]: DEBUG nova.objects.instance [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lazy-loading 'info_cache' on Instance uuid c280652c-ffde-40f8-a919-adb8be618db8 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:47:59 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:47:59 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Updating instance_info_cache with network_info: [{"id": "80b77e2d-aa04-4996-a0c1-713054affac4", "address": "fa:16:3e:4f:00:ce", "network": {"id": "cf0a4705-3fff-4716-87ac-b0ca7700e11c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1739631852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cf8d4d4f504e82868ed295e054644c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80b77e2d-aa", "ovs_interfaceid": "80b77e2d-aa04-4996-a0c1-713054affac4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:47:59 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Releasing lock "refresh_cache-c280652c-ffde-40f8-a919-adb8be618db8" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:47:59 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Updated the network info_cache for instance {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 18 11:47:59 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:47:59 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:48:01 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:01 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:03 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:03 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:04 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:06 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:07 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-a37bc75d-ab2d-46a5-b056-fc2fc452fb1f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Acquiring lock "4e916d24-9f9d-4289-87ce-f65d2499fcd9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:48:07 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-a37bc75d-ab2d-46a5-b056-fc2fc452fb1f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Lock "4e916d24-9f9d-4289-87ce-f65d2499fcd9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:48:07 user nova-compute[74190]: DEBUG nova.compute.manager [None req-a37bc75d-ab2d-46a5-b056-fc2fc452fb1f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Starting instance... {{(pid=74190) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 11:48:07 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-a37bc75d-ab2d-46a5-b056-fc2fc452fb1f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:48:07 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-a37bc75d-ab2d-46a5-b056-fc2fc452fb1f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:48:07 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-a37bc75d-ab2d-46a5-b056-fc2fc452fb1f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74190) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 11:48:07 user nova-compute[74190]: INFO nova.compute.claims [None req-a37bc75d-ab2d-46a5-b056-fc2fc452fb1f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Claim successful on node user
Oct 18 11:48:07 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-a37bc75d-ab2d-46a5-b056-fc2fc452fb1f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 11:48:07 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-a37bc75d-ab2d-46a5-b056-fc2fc452fb1f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 11:48:07 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-a37bc75d-ab2d-46a5-b056-fc2fc452fb1f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.372s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:48:07 user nova-compute[74190]: DEBUG nova.compute.manager [None req-a37bc75d-ab2d-46a5-b056-fc2fc452fb1f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Start building networks asynchronously for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 11:48:07 user nova-compute[74190]: DEBUG nova.compute.manager [None req-a37bc75d-ab2d-46a5-b056-fc2fc452fb1f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Allocating IP information in the background. {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 11:48:07 user nova-compute[74190]: DEBUG nova.network.neutron [None req-a37bc75d-ab2d-46a5-b056-fc2fc452fb1f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] allocate_for_instance() {{(pid=74190) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 11:48:08 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-a37bc75d-ab2d-46a5-b056-fc2fc452fb1f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 11:48:08 user nova-compute[74190]: DEBUG nova.compute.manager [None req-a37bc75d-ab2d-46a5-b056-fc2fc452fb1f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Start building block device mappings for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 11:48:08 user nova-compute[74190]: DEBUG nova.policy [None req-a37bc75d-ab2d-46a5-b056-fc2fc452fb1f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0289211c145a424d8b9350aa69bc435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a4f041e58144d54a458a01074eb35a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74190) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 11:48:08 user nova-compute[74190]: DEBUG nova.compute.manager [None req-a37bc75d-ab2d-46a5-b056-fc2fc452fb1f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Start spawning the instance on the hypervisor. {{(pid=74190) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 11:48:08 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-a37bc75d-ab2d-46a5-b056-fc2fc452fb1f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Creating instance directory {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 11:48:08 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-a37bc75d-ab2d-46a5-b056-fc2fc452fb1f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Creating image(s)
Oct 18 11:48:08 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-a37bc75d-ab2d-46a5-b056-fc2fc452fb1f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Acquiring lock "/opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:48:08 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-a37bc75d-ab2d-46a5-b056-fc2fc452fb1f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Lock "/opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:48:08 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-a37bc75d-ab2d-46a5-b056-fc2fc452fb1f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Lock "/opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:48:08 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-a37bc75d-ab2d-46a5-b056-fc2fc452fb1f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:48:08 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-a37bc75d-ab2d-46a5-b056-fc2fc452fb1f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.180s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:48:08 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-a37bc75d-ab2d-46a5-b056-fc2fc452fb1f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Acquiring lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:48:08 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-a37bc75d-ab2d-46a5-b056-fc2fc452fb1f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:48:08 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-a37bc75d-ab2d-46a5-b056-fc2fc452fb1f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:48:08 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-a37bc75d-ab2d-46a5-b056-fc2fc452fb1f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.188s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:48:08 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-a37bc75d-ab2d-46a5-b056-fc2fc452fb1f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f,backing_fmt=raw /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk 1073741824 {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:48:08 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-a37bc75d-ab2d-46a5-b056-fc2fc452fb1f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f,backing_fmt=raw /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk 1073741824" returned: 0 in 0.055s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:48:08 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-a37bc75d-ab2d-46a5-b056-fc2fc452fb1f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:48:08 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-a37bc75d-ab2d-46a5-b056-fc2fc452fb1f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:48:08 user nova-compute[74190]: DEBUG nova.network.neutron [None req-a37bc75d-ab2d-46a5-b056-fc2fc452fb1f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Successfully created port: 7cee893b-5ac8-45f8-a1f8-5374b49cc3b5 {{(pid=74190) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 11:48:08 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-a37bc75d-ab2d-46a5-b056-fc2fc452fb1f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.208s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:48:08 user nova-compute[74190]: DEBUG nova.virt.disk.api [None req-a37bc75d-ab2d-46a5-b056-fc2fc452fb1f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk. size=1073741824 {{(pid=74190) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 18 11:48:08 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-a37bc75d-ab2d-46a5-b056-fc2fc452fb1f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:48:09 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-a37bc75d-ab2d-46a5-b056-fc2fc452fb1f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:48:09 user nova-compute[74190]: DEBUG nova.virt.disk.api [None req-a37bc75d-ab2d-46a5-b056-fc2fc452fb1f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Cannot resize image /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk to a smaller size. {{(pid=74190) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 18 11:48:09 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-a37bc75d-ab2d-46a5-b056-fc2fc452fb1f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Created local disks {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 11:48:09 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-a37bc75d-ab2d-46a5-b056-fc2fc452fb1f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Ensure instance console log exists: /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/console.log {{(pid=74190) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 11:48:09 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-a37bc75d-ab2d-46a5-b056-fc2fc452fb1f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:48:09 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-a37bc75d-ab2d-46a5-b056-fc2fc452fb1f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:48:09 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-a37bc75d-ab2d-46a5-b056-fc2fc452fb1f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:48:09 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:09 user nova-compute[74190]: DEBUG nova.network.neutron [None req-a37bc75d-ab2d-46a5-b056-fc2fc452fb1f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Successfully updated port: 7cee893b-5ac8-45f8-a1f8-5374b49cc3b5 {{(pid=74190) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 11:48:09 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-a37bc75d-ab2d-46a5-b056-fc2fc452fb1f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Acquiring lock "refresh_cache-4e916d24-9f9d-4289-87ce-f65d2499fcd9" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:48:09 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-a37bc75d-ab2d-46a5-b056-fc2fc452fb1f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Acquired lock "refresh_cache-4e916d24-9f9d-4289-87ce-f65d2499fcd9" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:48:09 user nova-compute[74190]: DEBUG nova.network.neutron [None req-a37bc75d-ab2d-46a5-b056-fc2fc452fb1f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Building network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 11:48:09 user nova-compute[74190]: DEBUG nova.compute.manager [req-259cddec-b82c-43ce-8cdd-9727ece3968b req-c240f501-313d-4e8a-acb6-3363e014e686 service nova] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Received event network-changed-7cee893b-5ac8-45f8-a1f8-5374b49cc3b5 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:48:09 user nova-compute[74190]: DEBUG nova.compute.manager [req-259cddec-b82c-43ce-8cdd-9727ece3968b req-c240f501-313d-4e8a-acb6-3363e014e686 service nova] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Refreshing instance network info cache due to event network-changed-7cee893b-5ac8-45f8-a1f8-5374b49cc3b5. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 11:48:09 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-259cddec-b82c-43ce-8cdd-9727ece3968b req-c240f501-313d-4e8a-acb6-3363e014e686 service nova] Acquiring lock "refresh_cache-4e916d24-9f9d-4289-87ce-f65d2499fcd9" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:48:09 user nova-compute[74190]: DEBUG nova.network.neutron [None req-a37bc75d-ab2d-46a5-b056-fc2fc452fb1f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Instance cache missing network info. {{(pid=74190) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 11:48:10 user nova-compute[74190]: DEBUG nova.network.neutron [None req-a37bc75d-ab2d-46a5-b056-fc2fc452fb1f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Updating instance_info_cache with network_info: [{"id": "7cee893b-5ac8-45f8-a1f8-5374b49cc3b5", "address": "fa:16:3e:15:15:1d", "network": {"id": "4609cfba-1e8b-4740-bdf6-642b196097a3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1019354168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a4f041e58144d54a458a01074eb35a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cee893b-5a", "ovs_interfaceid": "7cee893b-5ac8-45f8-a1f8-5374b49cc3b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:48:10 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-a37bc75d-ab2d-46a5-b056-fc2fc452fb1f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Releasing lock "refresh_cache-4e916d24-9f9d-4289-87ce-f65d2499fcd9" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:48:10 user nova-compute[74190]: DEBUG nova.compute.manager [None req-a37bc75d-ab2d-46a5-b056-fc2fc452fb1f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Instance network_info: |[{"id": "7cee893b-5ac8-45f8-a1f8-5374b49cc3b5", "address": "fa:16:3e:15:15:1d", "network": {"id": "4609cfba-1e8b-4740-bdf6-642b196097a3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1019354168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a4f041e58144d54a458a01074eb35a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cee893b-5a", "ovs_interfaceid": "7cee893b-5ac8-45f8-a1f8-5374b49cc3b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 11:48:10 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-259cddec-b82c-43ce-8cdd-9727ece3968b req-c240f501-313d-4e8a-acb6-3363e014e686 service nova] Acquired lock "refresh_cache-4e916d24-9f9d-4289-87ce-f65d2499fcd9" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:48:10 user nova-compute[74190]: DEBUG nova.network.neutron [req-259cddec-b82c-43ce-8cdd-9727ece3968b req-c240f501-313d-4e8a-acb6-3363e014e686 service nova] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Refreshing network info cache for port 7cee893b-5ac8-45f8-a1f8-5374b49cc3b5 {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 11:48:10 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-a37bc75d-ab2d-46a5-b056-fc2fc452fb1f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Start _get_guest_xml network_info=[{"id": "7cee893b-5ac8-45f8-a1f8-5374b49cc3b5", "address": "fa:16:3e:15:15:1d", "network": {"id": "4609cfba-1e8b-4740-bdf6-642b196097a3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1019354168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a4f041e58144d54a458a01074eb35a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cee893b-5a", "ovs_interfaceid": "7cee893b-5ac8-45f8-a1f8-5374b49cc3b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'image_id': '6e88bbf0-6e78-49a8-b3c5-9453d22a89df'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 11:48:10 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-a37bc75d-ab2d-46a5-b056-fc2fc452fb1f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:48:10 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-a37bc75d-ab2d-46a5-b056-fc2fc452fb1f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:48:10 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-a37bc75d-ab2d-46a5-b056-fc2fc452fb1f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 11:48:10 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-a37bc75d-ab2d-46a5-b056-fc2fc452fb1f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] CPU controller missing on host. {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 11:48:10 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-a37bc75d-ab2d-46a5-b056-fc2fc452fb1f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 11:48:10 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-a37bc75d-ab2d-46a5-b056-fc2fc452fb1f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] CPU controller found on host. {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 11:48:10 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-a37bc75d-ab2d-46a5-b056-fc2fc452fb1f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74190) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 11:48:10 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-a37bc75d-ab2d-46a5-b056-fc2fc452fb1f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T11:37:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 11:48:10 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-a37bc75d-ab2d-46a5-b056-fc2fc452fb1f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Flavor limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 11:48:10 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-a37bc75d-ab2d-46a5-b056-fc2fc452fb1f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Image limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 11:48:10 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-a37bc75d-ab2d-46a5-b056-fc2fc452fb1f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Flavor pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 11:48:10 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-a37bc75d-ab2d-46a5-b056-fc2fc452fb1f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Image pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 11:48:10 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-a37bc75d-ab2d-46a5-b056-fc2fc452fb1f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 11:48:10 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-a37bc75d-ab2d-46a5-b056-fc2fc452fb1f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 11:48:10 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-a37bc75d-ab2d-46a5-b056-fc2fc452fb1f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 11:48:10 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-a37bc75d-ab2d-46a5-b056-fc2fc452fb1f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Got 1 possible topologies {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 11:48:10 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-a37bc75d-ab2d-46a5-b056-fc2fc452fb1f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 11:48:10 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-a37bc75d-ab2d-46a5-b056-fc2fc452fb1f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 11:48:10 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-a37bc75d-ab2d-46a5-b056-fc2fc452fb1f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:48:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1239510214',display_name='tempest-ServerStableDeviceRescueTest-server-1239510214',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1239510214',id=15,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDzj5UAT4iUqANSvOBkAoJEwMfUM16idg1NibS//oAl0VdU9TP7e54hP2zexPvt5KYwy6IiTFUli5lpncFsKpJEn0+n2xJbrGOus7ZAEqg7XexOxHCi0AyMnjk7r++Fq+A==',key_name='tempest-keypair-1340095913',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8a4f041e58144d54a458a01074eb35a4',ramdisk_id='',reservation_id='r-4olb5240',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1127867733',owner_user_name='tempest-ServerStableDeviceRescueTest-1127867733-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:48:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0289211c145a424d8b9350aa69bc435d',uuid=4e916d24-9f9d-4289-87ce-f65d2499fcd9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7cee893b-5ac8-45f8-a1f8-5374b49cc3b5", "address": "fa:16:3e:15:15:1d", "network": {"id": "4609cfba-1e8b-4740-bdf6-642b196097a3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1019354168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a4f041e58144d54a458a01074eb35a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cee893b-5a", "ovs_interfaceid": "7cee893b-5ac8-45f8-a1f8-5374b49cc3b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74190) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 11:48:10 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-a37bc75d-ab2d-46a5-b056-fc2fc452fb1f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Converting VIF {"id": "7cee893b-5ac8-45f8-a1f8-5374b49cc3b5", "address": "fa:16:3e:15:15:1d", "network": {"id": "4609cfba-1e8b-4740-bdf6-642b196097a3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1019354168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a4f041e58144d54a458a01074eb35a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cee893b-5a", "ovs_interfaceid": "7cee893b-5ac8-45f8-a1f8-5374b49cc3b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:48:10 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-a37bc75d-ab2d-46a5-b056-fc2fc452fb1f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:15:1d,bridge_name='br-int',has_traffic_filtering=True,id=7cee893b-5ac8-45f8-a1f8-5374b49cc3b5,network=Network(4609cfba-1e8b-4740-bdf6-642b196097a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cee893b-5a') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:48:10 user nova-compute[74190]: DEBUG nova.objects.instance [None req-a37bc75d-ab2d-46a5-b056-fc2fc452fb1f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Lazy-loading 'pci_devices' on Instance uuid 4e916d24-9f9d-4289-87ce-f65d2499fcd9 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:48:10 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-a37bc75d-ab2d-46a5-b056-fc2fc452fb1f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] End _get_guest_xml xml=<domain type="kvm">
Oct 18 11:48:10 user nova-compute[74190]:   <uuid>4e916d24-9f9d-4289-87ce-f65d2499fcd9</uuid>
Oct 18 11:48:10 user nova-compute[74190]:   <name>instance-0000000f</name>
Oct 18 11:48:10 user nova-compute[74190]:   <memory>524288</memory>
Oct 18 11:48:10 user nova-compute[74190]:   <vcpu>1</vcpu>
Oct 18 11:48:10 user nova-compute[74190]:   <metadata>
Oct 18 11:48:10 user nova-compute[74190]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 11:48:10 user nova-compute[74190]:       <nova:package version="0.0.0"/>
Oct 18 11:48:10 user nova-compute[74190]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1239510214</nova:name>
Oct 18 11:48:10 user nova-compute[74190]:       <nova:creationTime>2023-10-18 11:48:10</nova:creationTime>
Oct 18 11:48:10 user nova-compute[74190]:       <nova:flavor name="m1.tiny">
Oct 18 11:48:10 user nova-compute[74190]:         <nova:memory>512</nova:memory>
Oct 18 11:48:10 user nova-compute[74190]:         <nova:disk>1</nova:disk>
Oct 18 11:48:10 user nova-compute[74190]:         <nova:swap>0</nova:swap>
Oct 18 11:48:10 user nova-compute[74190]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 11:48:10 user nova-compute[74190]:         <nova:vcpus>1</nova:vcpus>
Oct 18 11:48:10 user nova-compute[74190]:       </nova:flavor>
Oct 18 11:48:10 user nova-compute[74190]:       <nova:owner>
Oct 18 11:48:10 user nova-compute[74190]:         <nova:user uuid="0289211c145a424d8b9350aa69bc435d">tempest-ServerStableDeviceRescueTest-1127867733-project-member</nova:user>
Oct 18 11:48:10 user nova-compute[74190]:         <nova:project uuid="8a4f041e58144d54a458a01074eb35a4">tempest-ServerStableDeviceRescueTest-1127867733</nova:project>
Oct 18 11:48:10 user nova-compute[74190]:       </nova:owner>
Oct 18 11:48:10 user nova-compute[74190]:       <nova:root type="image" uuid="6e88bbf0-6e78-49a8-b3c5-9453d22a89df"/>
Oct 18 11:48:10 user nova-compute[74190]:       <nova:ports>
Oct 18 11:48:10 user nova-compute[74190]:         <nova:port uuid="7cee893b-5ac8-45f8-a1f8-5374b49cc3b5">
Oct 18 11:48:10 user nova-compute[74190]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 18 11:48:10 user nova-compute[74190]:         </nova:port>
Oct 18 11:48:10 user nova-compute[74190]:       </nova:ports>
Oct 18 11:48:10 user nova-compute[74190]:     </nova:instance>
Oct 18 11:48:10 user nova-compute[74190]:   </metadata>
Oct 18 11:48:10 user nova-compute[74190]:   <sysinfo type="smbios">
Oct 18 11:48:10 user nova-compute[74190]:     <system>
Oct 18 11:48:10 user nova-compute[74190]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 11:48:10 user nova-compute[74190]:       <entry name="product">OpenStack Nova</entry>
Oct 18 11:48:10 user nova-compute[74190]:       <entry name="version">0.0.0</entry>
Oct 18 11:48:10 user nova-compute[74190]:       <entry name="serial">4e916d24-9f9d-4289-87ce-f65d2499fcd9</entry>
Oct 18 11:48:10 user nova-compute[74190]:       <entry name="uuid">4e916d24-9f9d-4289-87ce-f65d2499fcd9</entry>
Oct 18 11:48:10 user nova-compute[74190]:       <entry name="family">Virtual Machine</entry>
Oct 18 11:48:10 user nova-compute[74190]:     </system>
Oct 18 11:48:10 user nova-compute[74190]:   </sysinfo>
Oct 18 11:48:10 user nova-compute[74190]:   <os>
Oct 18 11:48:10 user nova-compute[74190]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 11:48:10 user nova-compute[74190]:     <boot dev="hd"/>
Oct 18 11:48:10 user nova-compute[74190]:     <smbios mode="sysinfo"/>
Oct 18 11:48:10 user nova-compute[74190]:   </os>
Oct 18 11:48:10 user nova-compute[74190]:   <features>
Oct 18 11:48:10 user nova-compute[74190]:     <acpi/>
Oct 18 11:48:10 user nova-compute[74190]:     <apic/>
Oct 18 11:48:10 user nova-compute[74190]:     <vmcoreinfo/>
Oct 18 11:48:10 user nova-compute[74190]:   </features>
Oct 18 11:48:10 user nova-compute[74190]:   <clock offset="utc">
Oct 18 11:48:10 user nova-compute[74190]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 11:48:10 user nova-compute[74190]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 11:48:10 user nova-compute[74190]:     <timer name="hpet" present="no"/>
Oct 18 11:48:10 user nova-compute[74190]:   </clock>
Oct 18 11:48:10 user nova-compute[74190]:   <cpu mode="custom" match="exact">
Oct 18 11:48:10 user nova-compute[74190]:     <model>Nehalem</model>
Oct 18 11:48:10 user nova-compute[74190]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 11:48:10 user nova-compute[74190]:   </cpu>
Oct 18 11:48:10 user nova-compute[74190]:   <devices>
Oct 18 11:48:10 user nova-compute[74190]:     <disk type="file" device="disk">
Oct 18 11:48:10 user nova-compute[74190]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 11:48:10 user nova-compute[74190]:       <source file="/opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk"/>
Oct 18 11:48:10 user nova-compute[74190]:       <target dev="vda" bus="virtio"/>
Oct 18 11:48:10 user nova-compute[74190]:     </disk>
Oct 18 11:48:10 user nova-compute[74190]:     <interface type="ethernet">
Oct 18 11:48:10 user nova-compute[74190]:       <mac address="fa:16:3e:15:15:1d"/>
Oct 18 11:48:10 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:48:10 user nova-compute[74190]:       <mtu size="1442"/>
Oct 18 11:48:10 user nova-compute[74190]:       <target dev="tap7cee893b-5a"/>
Oct 18 11:48:10 user nova-compute[74190]:     </interface>
Oct 18 11:48:10 user nova-compute[74190]:     <serial type="pty">
Oct 18 11:48:10 user nova-compute[74190]:       <log file="/opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/console.log" append="off"/>
Oct 18 11:48:10 user nova-compute[74190]:     </serial>
Oct 18 11:48:10 user nova-compute[74190]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 11:48:10 user nova-compute[74190]:     <video>
Oct 18 11:48:10 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:48:10 user nova-compute[74190]:     </video>
Oct 18 11:48:10 user nova-compute[74190]:     <rng model="virtio">
Oct 18 11:48:10 user nova-compute[74190]:       <backend model="random">/dev/urandom</backend>
Oct 18 11:48:10 user nova-compute[74190]:     </rng>
Oct 18 11:48:10 user nova-compute[74190]:     <controller type="usb" index="0" model="none"/>
Oct 18 11:48:10 user nova-compute[74190]:     <memballoon model="virtio">
Oct 18 11:48:10 user nova-compute[74190]:       <stats period="10"/>
Oct 18 11:48:10 user nova-compute[74190]:     </memballoon>
Oct 18 11:48:10 user nova-compute[74190]:   </devices>
Oct 18 11:48:10 user nova-compute[74190]: </domain>
Oct 18 11:48:10 user nova-compute[74190]:  {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 11:48:10 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-a37bc75d-ab2d-46a5-b056-fc2fc452fb1f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:48:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1239510214',display_name='tempest-ServerStableDeviceRescueTest-server-1239510214',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1239510214',id=15,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDzj5UAT4iUqANSvOBkAoJEwMfUM16idg1NibS//oAl0VdU9TP7e54hP2zexPvt5KYwy6IiTFUli5lpncFsKpJEn0+n2xJbrGOus7ZAEqg7XexOxHCi0AyMnjk7r++Fq+A==',key_name='tempest-keypair-1340095913',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8a4f041e58144d54a458a01074eb35a4',ramdisk_id='',reservation_id='r-4olb5240',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1127867733',owner_user_name='tempest-ServerStableDeviceRescueTest-1127867733-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:48:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0289211c145a424d8b9350aa69bc435d',uuid=4e916d24-9f9d-4289-87ce-f65d2499fcd9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7cee893b-5ac8-45f8-a1f8-5374b49cc3b5", "address": "fa:16:3e:15:15:1d", "network": {"id": "4609cfba-1e8b-4740-bdf6-642b196097a3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1019354168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a4f041e58144d54a458a01074eb35a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cee893b-5a", "ovs_interfaceid": "7cee893b-5ac8-45f8-a1f8-5374b49cc3b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 11:48:10 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-a37bc75d-ab2d-46a5-b056-fc2fc452fb1f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Converting VIF {"id": "7cee893b-5ac8-45f8-a1f8-5374b49cc3b5", "address": "fa:16:3e:15:15:1d", "network": {"id": "4609cfba-1e8b-4740-bdf6-642b196097a3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1019354168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a4f041e58144d54a458a01074eb35a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cee893b-5a", "ovs_interfaceid": "7cee893b-5ac8-45f8-a1f8-5374b49cc3b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:48:10 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-a37bc75d-ab2d-46a5-b056-fc2fc452fb1f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:15:1d,bridge_name='br-int',has_traffic_filtering=True,id=7cee893b-5ac8-45f8-a1f8-5374b49cc3b5,network=Network(4609cfba-1e8b-4740-bdf6-642b196097a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cee893b-5a') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:48:10 user nova-compute[74190]: DEBUG os_vif [None req-a37bc75d-ab2d-46a5-b056-fc2fc452fb1f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:15:1d,bridge_name='br-int',has_traffic_filtering=True,id=7cee893b-5ac8-45f8-a1f8-5374b49cc3b5,network=Network(4609cfba-1e8b-4740-bdf6-642b196097a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cee893b-5a') {{(pid=74190) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 11:48:10 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:10 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:48:10 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 11:48:10 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:10 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b0621962-1d68-5e73-b6f0-963545da1adb', '_type': 'linux-noop'}}, row=False) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:48:10 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:10 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:48:10 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:10 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:10 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7cee893b-5a, may_exist=True, interface_attrs={}) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:48:10 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7cee893b-5a, col_values=(('qos', UUID('a7719be5-c466-4666-916c-56590f784586')),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:48:10 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7cee893b-5a, col_values=(('external_ids', {'iface-id': '7cee893b-5ac8-45f8-a1f8-5374b49cc3b5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:15:1d', 'vm-uuid': '4e916d24-9f9d-4289-87ce-f65d2499fcd9'}),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:48:10 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:10 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:48:10 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:10 user nova-compute[74190]: INFO os_vif [None req-a37bc75d-ab2d-46a5-b056-fc2fc452fb1f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:15:1d,bridge_name='br-int',has_traffic_filtering=True,id=7cee893b-5ac8-45f8-a1f8-5374b49cc3b5,network=Network(4609cfba-1e8b-4740-bdf6-642b196097a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cee893b-5a')
Oct 18 11:48:10 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-a37bc75d-ab2d-46a5-b056-fc2fc452fb1f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] No BDM found with device name vda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 11:48:10 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-a37bc75d-ab2d-46a5-b056-fc2fc452fb1f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] No VIF found with MAC fa:16:3e:15:15:1d, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 11:48:10 user nova-compute[74190]: DEBUG nova.network.neutron [req-259cddec-b82c-43ce-8cdd-9727ece3968b req-c240f501-313d-4e8a-acb6-3363e014e686 service nova] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Updated VIF entry in instance network info cache for port 7cee893b-5ac8-45f8-a1f8-5374b49cc3b5. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 11:48:10 user nova-compute[74190]: DEBUG nova.network.neutron [req-259cddec-b82c-43ce-8cdd-9727ece3968b req-c240f501-313d-4e8a-acb6-3363e014e686 service nova] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Updating instance_info_cache with network_info: [{"id": "7cee893b-5ac8-45f8-a1f8-5374b49cc3b5", "address": "fa:16:3e:15:15:1d", "network": {"id": "4609cfba-1e8b-4740-bdf6-642b196097a3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1019354168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a4f041e58144d54a458a01074eb35a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cee893b-5a", "ovs_interfaceid": "7cee893b-5ac8-45f8-a1f8-5374b49cc3b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:48:10 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-259cddec-b82c-43ce-8cdd-9727ece3968b req-c240f501-313d-4e8a-acb6-3363e014e686 service nova] Releasing lock "refresh_cache-4e916d24-9f9d-4289-87ce-f65d2499fcd9" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:48:11 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:11 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:11 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:11 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:12 user nova-compute[74190]: DEBUG nova.compute.manager [req-c4e817d1-3208-4dfe-b230-2f319be16347 req-7e6f5aa4-aa68-41e7-9bf1-b27b89d30e1b service nova] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Received event network-vif-plugged-7cee893b-5ac8-45f8-a1f8-5374b49cc3b5 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:48:12 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-c4e817d1-3208-4dfe-b230-2f319be16347 req-7e6f5aa4-aa68-41e7-9bf1-b27b89d30e1b service nova] Acquiring lock "4e916d24-9f9d-4289-87ce-f65d2499fcd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:48:12 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-c4e817d1-3208-4dfe-b230-2f319be16347 req-7e6f5aa4-aa68-41e7-9bf1-b27b89d30e1b service nova] Lock "4e916d24-9f9d-4289-87ce-f65d2499fcd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:48:12 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-c4e817d1-3208-4dfe-b230-2f319be16347 req-7e6f5aa4-aa68-41e7-9bf1-b27b89d30e1b service nova] Lock "4e916d24-9f9d-4289-87ce-f65d2499fcd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:48:12 user nova-compute[74190]: DEBUG nova.compute.manager [req-c4e817d1-3208-4dfe-b230-2f319be16347 req-7e6f5aa4-aa68-41e7-9bf1-b27b89d30e1b service nova] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] No waiting events found dispatching network-vif-plugged-7cee893b-5ac8-45f8-a1f8-5374b49cc3b5 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:48:12 user nova-compute[74190]: WARNING nova.compute.manager [req-c4e817d1-3208-4dfe-b230-2f319be16347 req-7e6f5aa4-aa68-41e7-9bf1-b27b89d30e1b service nova] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Received unexpected event network-vif-plugged-7cee893b-5ac8-45f8-a1f8-5374b49cc3b5 for instance with vm_state building and task_state spawning.
Oct 18 11:48:12 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:12 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:12 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:12 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:12 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:14 user nova-compute[74190]: DEBUG nova.compute.manager [None req-a37bc75d-ab2d-46a5-b056-fc2fc452fb1f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Instance event wait completed in 0 seconds for  {{(pid=74190) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 11:48:14 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-a37bc75d-ab2d-46a5-b056-fc2fc452fb1f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Guest created on hypervisor {{(pid=74190) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 11:48:14 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Instance spawned successfully.
Oct 18 11:48:14 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-a37bc75d-ab2d-46a5-b056-fc2fc452fb1f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 11:48:14 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-a37bc75d-ab2d-46a5-b056-fc2fc452fb1f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Found default for hw_cdrom_bus of ide {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:48:14 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-a37bc75d-ab2d-46a5-b056-fc2fc452fb1f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Found default for hw_disk_bus of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:48:14 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-a37bc75d-ab2d-46a5-b056-fc2fc452fb1f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Found default for hw_input_bus of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:48:14 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-a37bc75d-ab2d-46a5-b056-fc2fc452fb1f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Found default for hw_pointer_model of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:48:14 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-a37bc75d-ab2d-46a5-b056-fc2fc452fb1f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Found default for hw_video_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:48:14 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-a37bc75d-ab2d-46a5-b056-fc2fc452fb1f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Found default for hw_vif_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:48:14 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:14 user nova-compute[74190]: INFO nova.compute.manager [None req-a37bc75d-ab2d-46a5-b056-fc2fc452fb1f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Took 6.03 seconds to spawn the instance on the hypervisor.
Oct 18 11:48:14 user nova-compute[74190]: DEBUG nova.compute.manager [None req-a37bc75d-ab2d-46a5-b056-fc2fc452fb1f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Checking state {{(pid=74190) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 11:48:14 user nova-compute[74190]: INFO nova.compute.manager [None req-a37bc75d-ab2d-46a5-b056-fc2fc452fb1f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Took 6.79 seconds to build instance.
Oct 18 11:48:14 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-a37bc75d-ab2d-46a5-b056-fc2fc452fb1f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Lock "4e916d24-9f9d-4289-87ce-f65d2499fcd9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.913s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:48:14 user nova-compute[74190]: DEBUG nova.compute.manager [req-6a7aae58-2ee4-4e08-9c48-0cbcc6af434a req-fcb8f685-755f-4522-aace-0aa23641b9bb service nova] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Received event network-vif-plugged-7cee893b-5ac8-45f8-a1f8-5374b49cc3b5 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:48:14 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-6a7aae58-2ee4-4e08-9c48-0cbcc6af434a req-fcb8f685-755f-4522-aace-0aa23641b9bb service nova] Acquiring lock "4e916d24-9f9d-4289-87ce-f65d2499fcd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:48:14 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-6a7aae58-2ee4-4e08-9c48-0cbcc6af434a req-fcb8f685-755f-4522-aace-0aa23641b9bb service nova] Lock "4e916d24-9f9d-4289-87ce-f65d2499fcd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:48:14 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-6a7aae58-2ee4-4e08-9c48-0cbcc6af434a req-fcb8f685-755f-4522-aace-0aa23641b9bb service nova] Lock "4e916d24-9f9d-4289-87ce-f65d2499fcd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:48:14 user nova-compute[74190]: DEBUG nova.compute.manager [req-6a7aae58-2ee4-4e08-9c48-0cbcc6af434a req-fcb8f685-755f-4522-aace-0aa23641b9bb service nova] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] No waiting events found dispatching network-vif-plugged-7cee893b-5ac8-45f8-a1f8-5374b49cc3b5 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:48:14 user nova-compute[74190]: WARNING nova.compute.manager [req-6a7aae58-2ee4-4e08-9c48-0cbcc6af434a req-fcb8f685-755f-4522-aace-0aa23641b9bb service nova] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Received unexpected event network-vif-plugged-7cee893b-5ac8-45f8-a1f8-5374b49cc3b5 for instance with vm_state active and task_state None.
Oct 18 11:48:15 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:19 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:20 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:24 user nova-compute[74190]: DEBUG nova.compute.manager [req-fd854a17-2b2b-467a-8f41-8d822dca496c req-7fa9dcd6-7d06-4090-add0-a25729e5b1a8 service nova] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Received event network-changed-9eca4d9a-28f0-4818-beef-e65c22f351dd {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:48:24 user nova-compute[74190]: DEBUG nova.compute.manager [req-fd854a17-2b2b-467a-8f41-8d822dca496c req-7fa9dcd6-7d06-4090-add0-a25729e5b1a8 service nova] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Refreshing instance network info cache due to event network-changed-9eca4d9a-28f0-4818-beef-e65c22f351dd. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 11:48:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-fd854a17-2b2b-467a-8f41-8d822dca496c req-7fa9dcd6-7d06-4090-add0-a25729e5b1a8 service nova] Acquiring lock "refresh_cache-3bd2f6d6-9c07-42a0-869e-566d685cb025" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:48:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-fd854a17-2b2b-467a-8f41-8d822dca496c req-7fa9dcd6-7d06-4090-add0-a25729e5b1a8 service nova] Acquired lock "refresh_cache-3bd2f6d6-9c07-42a0-869e-566d685cb025" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:48:24 user nova-compute[74190]: DEBUG nova.network.neutron [req-fd854a17-2b2b-467a-8f41-8d822dca496c req-7fa9dcd6-7d06-4090-add0-a25729e5b1a8 service nova] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Refreshing network info cache for port 9eca4d9a-28f0-4818-beef-e65c22f351dd {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 11:48:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-924cb902-f3d9-488f-9139-be4407add54f tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Acquiring lock "3bd2f6d6-9c07-42a0-869e-566d685cb025" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:48:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-924cb902-f3d9-488f-9139-be4407add54f tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Lock "3bd2f6d6-9c07-42a0-869e-566d685cb025" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:48:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-924cb902-f3d9-488f-9139-be4407add54f tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Acquiring lock "3bd2f6d6-9c07-42a0-869e-566d685cb025-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:48:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-924cb902-f3d9-488f-9139-be4407add54f tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Lock "3bd2f6d6-9c07-42a0-869e-566d685cb025-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:48:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-924cb902-f3d9-488f-9139-be4407add54f tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Lock "3bd2f6d6-9c07-42a0-869e-566d685cb025-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:48:24 user nova-compute[74190]: INFO nova.compute.manager [None req-924cb902-f3d9-488f-9139-be4407add54f tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Terminating instance
Oct 18 11:48:24 user nova-compute[74190]: DEBUG nova.compute.manager [None req-924cb902-f3d9-488f-9139-be4407add54f tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Start destroying the instance on the hypervisor. {{(pid=74190) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 11:48:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:25 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:25 user nova-compute[74190]: DEBUG nova.compute.manager [req-9f713400-685f-429a-b440-ba2f47910b67 req-facd8c6f-fd21-4f90-b093-851b917580f8 service nova] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Received event network-vif-unplugged-9eca4d9a-28f0-4818-beef-e65c22f351dd {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:48:25 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-9f713400-685f-429a-b440-ba2f47910b67 req-facd8c6f-fd21-4f90-b093-851b917580f8 service nova] Acquiring lock "3bd2f6d6-9c07-42a0-869e-566d685cb025-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:48:25 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-9f713400-685f-429a-b440-ba2f47910b67 req-facd8c6f-fd21-4f90-b093-851b917580f8 service nova] Lock "3bd2f6d6-9c07-42a0-869e-566d685cb025-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:48:25 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-9f713400-685f-429a-b440-ba2f47910b67 req-facd8c6f-fd21-4f90-b093-851b917580f8 service nova] Lock "3bd2f6d6-9c07-42a0-869e-566d685cb025-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:48:25 user nova-compute[74190]: DEBUG nova.compute.manager [req-9f713400-685f-429a-b440-ba2f47910b67 req-facd8c6f-fd21-4f90-b093-851b917580f8 service nova] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] No waiting events found dispatching network-vif-unplugged-9eca4d9a-28f0-4818-beef-e65c22f351dd {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:48:25 user nova-compute[74190]: DEBUG nova.compute.manager [req-9f713400-685f-429a-b440-ba2f47910b67 req-facd8c6f-fd21-4f90-b093-851b917580f8 service nova] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Received event network-vif-unplugged-9eca4d9a-28f0-4818-beef-e65c22f351dd for instance with task_state deleting. {{(pid=74190) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 11:48:25 user nova-compute[74190]: DEBUG nova.network.neutron [req-fd854a17-2b2b-467a-8f41-8d822dca496c req-7fa9dcd6-7d06-4090-add0-a25729e5b1a8 service nova] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Updated VIF entry in instance network info cache for port 9eca4d9a-28f0-4818-beef-e65c22f351dd. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 11:48:25 user nova-compute[74190]: DEBUG nova.network.neutron [req-fd854a17-2b2b-467a-8f41-8d822dca496c req-7fa9dcd6-7d06-4090-add0-a25729e5b1a8 service nova] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Updating instance_info_cache with network_info: [{"id": "9eca4d9a-28f0-4818-beef-e65c22f351dd", "address": "fa:16:3e:f6:77:76", "network": {"id": "0c5cbb41-ba77-494a-904b-4c37e3205eb9", "bridge": "br-int", "label": "tempest-TestShelveInstance-1626181921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d3e15d2b7944cba9ed86eb5c01ec98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9eca4d9a-28", "ovs_interfaceid": "9eca4d9a-28f0-4818-beef-e65c22f351dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:48:25 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:25 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-fd854a17-2b2b-467a-8f41-8d822dca496c req-7fa9dcd6-7d06-4090-add0-a25729e5b1a8 service nova] Releasing lock "refresh_cache-3bd2f6d6-9c07-42a0-869e-566d685cb025" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:48:25 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:25 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:25 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:25 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Instance destroyed successfully.
Oct 18 11:48:25 user nova-compute[74190]: DEBUG nova.objects.instance [None req-924cb902-f3d9-488f-9139-be4407add54f tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Lazy-loading 'resources' on Instance uuid 3bd2f6d6-9c07-42a0-869e-566d685cb025 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:48:25 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-924cb902-f3d9-488f-9139-be4407add54f tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-18T11:42:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-750462458',display_name='tempest-TestShelveInstance-server-750462458',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-750462458',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNt8SmvdArTyzkvCUI1kam2NbMC+rHv9iOWZki8JEEHP7fMgDgi8kkk7jXIMVKa+sVcv9nkOeL15Uby8ToS2uWym1iteM771YGpKWzDAM0HogCtKby6MGktNG2smezvdMg==',key_name='tempest-TestShelveInstance-1292603838',keypairs=<?>,launch_index=0,launched_at=2023-10-18T11:47:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1d3e15d2b7944cba9ed86eb5c01ec98a',ramdisk_id='',reservation_id='r-n4ye783u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1202197307',owner_user_name='tempest-TestShelveInstance-1202197307-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T11:47:00Z,user_data=None,user_id='06661e802ad947d2a4e07e3d60a94d14',uuid=3bd2f6d6-9c07-42a0-869e-566d685cb025,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9eca4d9a-28f0-4818-beef-e65c22f351dd", "address": "fa:16:3e:f6:77:76", "network": {"id": "0c5cbb41-ba77-494a-904b-4c37e3205eb9", "bridge": "br-int", "label": "tempest-TestShelveInstance-1626181921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d3e15d2b7944cba9ed86eb5c01ec98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9eca4d9a-28", "ovs_interfaceid": "9eca4d9a-28f0-4818-beef-e65c22f351dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 11:48:25 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-924cb902-f3d9-488f-9139-be4407add54f tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Converting VIF {"id": "9eca4d9a-28f0-4818-beef-e65c22f351dd", "address": "fa:16:3e:f6:77:76", "network": {"id": "0c5cbb41-ba77-494a-904b-4c37e3205eb9", "bridge": "br-int", "label": "tempest-TestShelveInstance-1626181921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d3e15d2b7944cba9ed86eb5c01ec98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9eca4d9a-28", "ovs_interfaceid": "9eca4d9a-28f0-4818-beef-e65c22f351dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:48:25 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-924cb902-f3d9-488f-9139-be4407add54f tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:77:76,bridge_name='br-int',has_traffic_filtering=True,id=9eca4d9a-28f0-4818-beef-e65c22f351dd,network=Network(0c5cbb41-ba77-494a-904b-4c37e3205eb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9eca4d9a-28') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:48:25 user nova-compute[74190]: DEBUG os_vif [None req-924cb902-f3d9-488f-9139-be4407add54f tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:77:76,bridge_name='br-int',has_traffic_filtering=True,id=9eca4d9a-28f0-4818-beef-e65c22f351dd,network=Network(0c5cbb41-ba77-494a-904b-4c37e3205eb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9eca4d9a-28') {{(pid=74190) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 11:48:25 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:25 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9eca4d9a-28, bridge=br-int, if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:48:25 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:25 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:48:25 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:25 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:25 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5ed4b7a3-0518-40df-adf2-dff3811245b5) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:48:25 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:25 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:48:25 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:25 user nova-compute[74190]: INFO os_vif [None req-924cb902-f3d9-488f-9139-be4407add54f tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:77:76,bridge_name='br-int',has_traffic_filtering=True,id=9eca4d9a-28f0-4818-beef-e65c22f351dd,network=Network(0c5cbb41-ba77-494a-904b-4c37e3205eb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9eca4d9a-28')
Oct 18 11:48:25 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-924cb902-f3d9-488f-9139-be4407add54f tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] calling os-brick to detach iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 11:48:25 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-924cb902-f3d9-488f-9139-be4407add54f tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, {'target_iqn': 'iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bnWydGUY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:48:25 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-924cb902-f3d9-488f-9139-be4407add54f tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:48:25 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-924cb902-f3d9-488f-9139-be4407add54f tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:48:25 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-924cb902-f3d9-488f-9139-be4407add54f tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:48:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:48:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:48:25 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[23bca757-df1c-4778-accb-16c39f048c1f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:48:25 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-924cb902-f3d9-488f-9139-be4407add54f tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 11:48:25 user nova-compute[74190]: No targets found.
Oct 18 11:48:25 user nova-compute[74190]: iSNS:
Oct 18 11:48:25 user nova-compute[74190]: No targets found.
Oct 18 11:48:25 user nova-compute[74190]: STATIC:
Oct 18 11:48:25 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a
Oct 18 11:48:25 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:48:25 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:48:25 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49
Oct 18 11:48:25 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:48:25 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:48:25 user nova-compute[74190]: FIRMWARE:
Oct 18 11:48:25 user nova-compute[74190]: No targets found.
Oct 18 11:48:25 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:48:25 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-924cb902-f3d9-488f-9139-be4407add54f tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 11:48:25 user nova-compute[74190]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 11:48:25 user nova-compute[74190]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74190) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 11:48:25 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-924cb902-f3d9-488f-9139-be4407add54f tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a', 0)] {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 11:48:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:48:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:48:25 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[613b50c8-0f82-4f38-8ed3-b672e54703a3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:48:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:48:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:48:25 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[9498d8bb-8d2b-4354-aa83-f86c7e090175]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49 (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:48:25 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-924cb902-f3d9-488f-9139-be4407add54f tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)
Oct 18 11:48:25 user nova-compute[74190]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49 (non-flash)
Oct 18 11:48:25 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:48:25 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-924cb902-f3d9-488f-9139-be4407add54f tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a (non-flash)
Oct 18 11:48:25 user nova-compute[74190]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49 (non-flash)
Oct 18 11:48:25 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-924cb902-f3d9-488f-9139-be4407add54f tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1f247956c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a'): ({'sdf'}, set())}) {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-924cb902-f3d9-488f-9139-be4407add54f tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Removing single pathed devices sdf {{(pid=74190) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaeba9e3-2312-4dea-8989-83a8c0219d0d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG nova.compute.manager [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Start spawning the instance on the hypervisor. {{(pid=74190) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Creating instance directory {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 11:48:26 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Creating image(s)
Oct 18 11:48:26 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Did not create local disks {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Ensure instance console log exists: /opt/stack/data/nova/instances/738fc62c-293c-4fee-9943-45033e0f2602/console.log {{(pid=74190) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Start _get_guest_xml network_info=[{"id": "e00eb1ac-378c-4d70-9936-d90df4c9cfbb", "address": "fa:16:3e:8c:f3:0b", "network": {"id": "4abb382b-0dbd-4b6c-9403-85021fb1c43a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-328462262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53275b2e537640b59e1bb6bcb8368780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape00eb1ac-37", "ovs_interfaceid": "e00eb1ac-378c-4d70-9936-d90df4c9cfbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "906d428b-8be9-4ac1-ac30-4f48a5448c11", "address": "fa:16:3e:6d:e6:6e", "network": {"id": "991f3e6a-9513-4e2d-8ce6-e34c5a8e8d33", "bridge": "br-int", "label": "tempest-device-tagging-net1-1313342702", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "53275b2e537640b59e1bb6bcb8368780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap906d428b-8b", "ovs_interfaceid": "906d428b-8be9-4ac1-ac30-4f48a5448c11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "44bc05d9-08bc-49ab-80a4-ee736c201a4b", "address": "fa:16:3e:50:48:95", "network": {"id": "991f3e6a-9513-4e2d-8ce6-e34c5a8e8d33", "bridge": "br-int", "label": "tempest-device-tagging-net1-1313342702", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "53275b2e537640b59e1bb6bcb8368780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44bc05d9-08", "ovs_interfaceid": "44bc05d9-08bc-49ab-80a4-ee736c201a4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1a3a415f-eace-4edd-8643-565472342393", "address": "fa:16:3e:db:69:76", "network": {"id": "991f3e6a-9513-4e2d-8ce6-e34c5a8e8d33", "bridge": "br-int", "label": "tempest-device-tagging-net1-1313342702", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "53275b2e537640b59e1bb6bcb8368780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a3a415f-ea", "ovs_interfaceid": "1a3a415f-eace-4edd-8643-565472342393", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cfde954f-7659-43ce-a771-b817aef06692", "address": "fa:16:3e:da:06:44", "network": {"id": "991f3e6a-9513-4e2d-8ce6-e34c5a8e8d33", "bridge": "br-int", "label": "tempest-device-tagging-net1-1313342702", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "53275b2e537640b59e1bb6bcb8368780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfde954f-76", "ovs_interfaceid": "cfde954f-7659-43ce-a771-b817aef06692", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ce10d70d-8444-4bd5-adfd-3fc346977282", "address": "fa:16:3e:b3:96:2f", "network": {"id": "f58bb855-be1b-4895-bc60-5dfa56567d43", "bridge": "br-int", "label": "tempest-device-tagging-net2-1711719607", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "53275b2e537640b59e1bb6bcb8368780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce10d70d-84", "ovs_interfaceid": "ce10d70d-8444-4bd5-adfd-3fc346977282", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "644ec7e2-9907-4ecb-8d84-95b2ae66d866", "address": "fa:16:3e:c2:8f:71", "network": {"id": "f58bb855-be1b-4895-bc60-5dfa56567d43", "bridge": "br-int", "label": "tempest-device-tagging-net2-1711719607", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "53275b2e537640b59e1bb6bcb8368780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap644ec7e2-99", "ovs_interfaceid": "644ec7e2-9907-4ecb-8d84-95b2ae66d866", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2637fe23-3624-4fe8-954e-266b32cf18a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TPBNkelv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '738fc62c-293c-4fee-9943-45033e0f2602', 'attached_at': '', 'detached_at': '', 'volume_id': '2637fe23-3624-4fe8-954e-266b32cf18a9', 'serial': '2637fe23-3624-4fe8-954e-266b32cf18a9'}, 'delete_on_termination': False, 'guest_format': None, 'attachment_id': 'a51a8446-cd37-4a19-a963-eea79afd2f36', 'volume_type': None}, {'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'boot_index': 1, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:838cbbc1-303e-481f-a54c-ebb014989095', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OyMDBxch', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '738fc62c-293c-4fee-9943-45033e0f2602', 'attached_at': '', 'detached_at': '', 'volume_id': '838cbbc1-303e-481f-a54c-ebb014989095', 'serial': '838cbbc1-303e-481f-a54c-ebb014989095'}, 'delete_on_termination': False, 'guest_format': None, 'attachment_id': '69b1166c-bad1-4a33-a855-0993f771cb84', 'volume_type': None}, {'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'device_type': 'disk', 'boot_index': 2, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:555c71a2-d950-48cc-96fd-725e0df8ce78', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IaNUtisS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '738fc62c-293c-4fee-9943-45033e0f2602', 'attached_at': '', 'detached_at': '', 'volume_id': '555c71a2-d950-48cc-96fd-725e0df8ce78', 'serial': '555c71a2-d950-48cc-96fd-725e0df8ce78'}, 'delete_on_termination': False, 'guest_format': None, 'attachment_id': '21eb0cb0-e1c5-41bf-94bc-6f0af8c9c705', 'volume_type': None} {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.029s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[171bd07b-90ea-4f68-a4b0-3e69308cd543]: (4, ('ok\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-924cb902-f3d9-488f-9139-be4407add54f tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Flushing IO for device /dev/sdf {{(pid=74190) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:48:26 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:48:26 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:48:26 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] CPU controller missing on host. {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d5072d7-403c-4356-9fa3-468628c68c08]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-924cb902-f3d9-488f-9139-be4407add54f tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74190) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] CPU controller found on host. {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74190) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T11:37:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Flavor limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Image limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Flavor pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Image pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Got 1 possible topologies {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Calling os-brick to attach iSCSI Volume {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2637fe23-3624-4fe8-954e-266b32cf18a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TPBNkelv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:48:26 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:48:26 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.053s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[a822fe48-c99b-490a-b1a8-c9d056209c4a]: (4, ('1', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-924cb902-f3d9-488f-9139-be4407add54f tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-924cb902-f3d9-488f-9139-be4407add54f tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] SCSI volumes sdf have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23537653530323334', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_3d3af988', '/dev/disk/by-id/scsi-1SCST_BIO3d3af988-57e502346fe3ba30') {{(pid=85217) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac6742f4-753e-4564-9046-13c5330602c5]: (4, None) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-924cb902-f3d9-488f-9139-be4407add54f tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a')] {{(pid=74190) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1709e1a-be50-4672-bb6c-4281ab5b253e]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-924cb902-f3d9-488f-9139-be4407add54f tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a -p 172.16.0.220:3260 --logout {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3607435-7d58-450f-b4a2-9c88e585192e]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-924cb902-f3d9-488f-9139-be4407add54f tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a, portal: 172.16.0.220,3260]
Oct 18 11:48:26 user nova-compute[74190]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a, portal: 172.16.0.220,3260] successful.
Oct 18 11:48:26 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a -p 172.16.0.220:3260 --op delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d829820-7b5f-42f9-81ab-8efc923f288a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[436599dd-4849-4f8c-91b1-709487bdb08b]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-924cb902-f3d9-488f-9139-be4407add54f tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-924cb902-f3d9-488f-9139-be4407add54f tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.419s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-924cb902-f3d9-488f-9139-be4407add54f tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] <== disconnect_volume: return (421ms) None {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-924cb902-f3d9-488f-9139-be4407add54f tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Disconnected iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 11:48:26 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-924cb902-f3d9-488f-9139-be4407add54f tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Deleting instance files /opt/stack/data/nova/instances/3bd2f6d6-9c07-42a0-869e-566d685cb025_del
Oct 18 11:48:26 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-924cb902-f3d9-488f-9139-be4407add54f tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Deletion of /opt/stack/data/nova/instances/3bd2f6d6-9c07-42a0-869e-566d685cb025_del complete
Oct 18 11:48:26 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.160s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:48:26 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:48:26 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2637fe23-3624-4fe8-954e-266b32cf18a9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2637fe23-3624-4fe8-954e-266b32cf18a9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:48:26 user nova-compute[74190]: INFO os_brick.initiator.connectors.iscsi [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 11:48:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2637fe23-3624-4fe8-954e-266b32cf18a9 -p 172.16.0.220:3260 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2637fe23-3624-4fe8-954e-266b32cf18a9 -p 172.16.0.220:3260" returned: 21 in 0.033s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0aee4ba-f910-45ee-a22a-0c65b8ab56fc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 11:48:26 user nova-compute[74190]:  {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2637fe23-3624-4fe8-954e-266b32cf18a9 -p 172.16.0.220:3260 --interface default --op new {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:48:26 user nova-compute[74190]: INFO nova.compute.manager [None req-924cb902-f3d9-488f-9139-be4407add54f tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Took 1.55 seconds to destroy the instance on the hypervisor.
Oct 18 11:48:26 user nova-compute[74190]: DEBUG oslo.service.loopingcall [None req-924cb902-f3d9-488f-9139-be4407add54f tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74190) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2637fe23-3624-4fe8-954e-266b32cf18a9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb328c3-73e2-4f97-bb3c-a0c7a9ce67dd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2637fe23-3624-4fe8-954e-266b32cf18a9] added\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG nova.compute.manager [-] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Deallocating network for instance {{(pid=74190) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] deallocate_for_instance() {{(pid=74190) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2637fe23-3624-4fe8-954e-266b32cf18a9] added
Oct 18 11:48:26 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2637fe23-3624-4fe8-954e-266b32cf18a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2637fe23-3624-4fe8-954e-266b32cf18a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[04eba450-5385-43fd-bfd6-378b548b1e61]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2637fe23-3624-4fe8-954e-266b32cf18a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2637fe23-3624-4fe8-954e-266b32cf18a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf94c6c-8afb-4ae1-9045-317027b4b418]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2637fe23-3624-4fe8-954e-266b32cf18a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TPBNkelv {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2637fe23-3624-4fe8-954e-266b32cf18a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TPBNkelv" returned: 0 in 0.029s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff58f72a-7b78-44c0-90ac-1ae66e994c38]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TPBNkelv'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2637fe23-3624-4fe8-954e-266b32cf18a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2637fe23-3624-4fe8-954e-266b32cf18a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[5410cf9e-e2d3-4196-98de-9486f7025fb4]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7bc26bc-ecf7-412a-86ad-89aa2d75dcbb]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49 (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49 (non-flash)
Oct 18 11:48:26 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49 (non-flash)
Oct 18 11:48:26 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2637fe23-3624-4fe8-954e-266b32cf18a9 -p 172.16.0.220:3260 --login {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2637fe23-3624-4fe8-954e-266b32cf18a9 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[9477be2b-7dd1-42f5-b41d-02ca8773e99c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2637fe23-3624-4fe8-954e-266b32cf18a9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2637fe23-3624-4fe8-954e-266b32cf18a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2637fe23-3624-4fe8-954e-266b32cf18a9, portal: 172.16.0.220,3260]
Oct 18 11:48:26 user nova-compute[74190]: Login to [iface: default, target: iqn.2010-10.org.openstack:2637fe23-3624-4fe8-954e-266b32cf18a9, portal: 172.16.0.220,3260] successful.
Oct 18 11:48:26 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2637fe23-3624-4fe8-954e-266b32cf18a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2637fe23-3624-4fe8-954e-266b32cf18a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac1634f5-2cf9-4216-8643-2c69b66a7855]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[a96d8b85-5b9e-42dd-a9a5-348836934111]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2637fe23-3624-4fe8-954e-266b32cf18a9 (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49 (non-flash)
Oct 18 11:48:26 user nova-compute[74190]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2637fe23-3624-4fe8-954e-266b32cf18a9 (non-flash)
Oct 18 11:48:26 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49 (non-flash)
Oct 18 11:48:26 user nova-compute[74190]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2637fe23-3624-4fe8-954e-266b32cf18a9 (non-flash)
Oct 18 11:48:26 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2637fe23-3624-4fe8-954e-266b32cf18a9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.378s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Connected to 172.16.0.220:3260 {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] HCTL ('34', '-', '-', 0) found on session 18 with lun 0 {{(pid=74190) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74190) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b091219-8164-405f-b3b5-f48737defb37]: (4, ('- - 0', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Searching for a device in session 18 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74190) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:2637fe23-3624-4fe8-954e-266b32cf18a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TPBNkelv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 11:48:26 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Updating instance_info_cache with network_info: [] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:48:26 user nova-compute[74190]: INFO nova.compute.manager [-] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Took 0.51 seconds to deallocate network for instance.
Oct 18 11:48:26 user nova-compute[74190]: DEBUG nova.compute.manager [req-e6bef751-f9f4-4772-b7e4-2aec67738e84 req-02d8c7cf-383b-455b-afd0-f0941c7f04b0 service nova] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Received event network-vif-deleted-9eca4d9a-28f0-4818-beef-e65c22f351dd {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:48:27 user nova-compute[74190]: DEBUG nova.compute.manager [req-c1f87334-daf7-4f8b-8b52-1896d6509b3a req-9ad6ed72-730b-4906-b0fe-93dc5caaebea service nova] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Received event network-vif-plugged-9eca4d9a-28f0-4818-beef-e65c22f351dd {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:48:27 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-c1f87334-daf7-4f8b-8b52-1896d6509b3a req-9ad6ed72-730b-4906-b0fe-93dc5caaebea service nova] Acquiring lock "3bd2f6d6-9c07-42a0-869e-566d685cb025-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:48:27 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-c1f87334-daf7-4f8b-8b52-1896d6509b3a req-9ad6ed72-730b-4906-b0fe-93dc5caaebea service nova] Lock "3bd2f6d6-9c07-42a0-869e-566d685cb025-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:48:27 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-c1f87334-daf7-4f8b-8b52-1896d6509b3a req-9ad6ed72-730b-4906-b0fe-93dc5caaebea service nova] Lock "3bd2f6d6-9c07-42a0-869e-566d685cb025-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:48:27 user nova-compute[74190]: DEBUG nova.compute.manager [req-c1f87334-daf7-4f8b-8b52-1896d6509b3a req-9ad6ed72-730b-4906-b0fe-93dc5caaebea service nova] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] No waiting events found dispatching network-vif-plugged-9eca4d9a-28f0-4818-beef-e65c22f351dd {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:48:27 user nova-compute[74190]: WARNING nova.compute.manager [req-c1f87334-daf7-4f8b-8b52-1896d6509b3a req-9ad6ed72-730b-4906-b0fe-93dc5caaebea service nova] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Received unexpected event network-vif-plugged-9eca4d9a-28f0-4818-beef-e65c22f351dd for instance with vm_state active and task_state deleting.
Oct 18 11:48:27 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.421s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:48:27 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] <== connect_volume: return (1581ms) {'type': 'block', 'scsi_wwn': '23639653834626339', 'path': '/dev/sdc'} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:48:27 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23639653834626339', 'path': '/dev/sdc'} {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 11:48:27 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Calling os-brick to attach iSCSI Volume {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 11:48:27 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:838cbbc1-303e-481f-a54c-ebb014989095', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OyMDBxch', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:48:27 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:48:27 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:48:27 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:48:27 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:48:27 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:838cbbc1-303e-481f-a54c-ebb014989095" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:48:27 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:838cbbc1-303e-481f-a54c-ebb014989095" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:48:27 user nova-compute[74190]: INFO os_brick.initiator.connectors.iscsi [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 11:48:27 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:838cbbc1-303e-481f-a54c-ebb014989095 -p 172.16.0.220:3260 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:48:27 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:838cbbc1-303e-481f-a54c-ebb014989095 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:48:27 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f1f7c59-e58e-4e79-bbad-98259fe441cf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:48:27 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 11:48:27 user nova-compute[74190]:  {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:48:27 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:838cbbc1-303e-481f-a54c-ebb014989095 -p 172.16.0.220:3260 --interface default --op new {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:48:27 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:838cbbc1-303e-481f-a54c-ebb014989095 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:48:27 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec15f59-7baa-4e53-892e-d118e841266b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:838cbbc1-303e-481f-a54c-ebb014989095] added\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:48:27 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:838cbbc1-303e-481f-a54c-ebb014989095] added
Oct 18 11:48:27 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:48:27 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:838cbbc1-303e-481f-a54c-ebb014989095 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:48:27 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:838cbbc1-303e-481f-a54c-ebb014989095 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:48:27 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[3034b816-0027-4e8a-a7d5-86096bf7682c]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:48:27 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:48:27 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:838cbbc1-303e-481f-a54c-ebb014989095 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:48:27 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:838cbbc1-303e-481f-a54c-ebb014989095 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:48:27 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb5ca29e-be72-4bd0-999f-4d6175114580]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:48:27 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:48:27 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:838cbbc1-303e-481f-a54c-ebb014989095 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OyMDBxch {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:48:27 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:838cbbc1-303e-481f-a54c-ebb014989095 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OyMDBxch" returned: 0 in 0.026s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:48:27 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[75f9afb5-f4bd-477c-b122-c07c470ed6e1]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:48:27 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OyMDBxch'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:48:27 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:838cbbc1-303e-481f-a54c-ebb014989095 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:48:28 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:838cbbc1-303e-481f-a54c-ebb014989095 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:48:28 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e3edb29-bfcc-4dcb-aaf1-18f2e22082a6]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:48:28 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:48:28 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:48:28 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:48:28 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8d996a5-9b09-4926-a457-8aaf78c07e59]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2637fe23-3624-4fe8-954e-266b32cf18a9 (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:48:28 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49 (non-flash)
Oct 18 11:48:28 user nova-compute[74190]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2637fe23-3624-4fe8-954e-266b32cf18a9 (non-flash)
Oct 18 11:48:28 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:48:28 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49 (non-flash)
Oct 18 11:48:28 user nova-compute[74190]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2637fe23-3624-4fe8-954e-266b32cf18a9 (non-flash)
Oct 18 11:48:28 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:48:28 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:838cbbc1-303e-481f-a54c-ebb014989095 -p 172.16.0.220:3260 --login {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:48:28 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:838cbbc1-303e-481f-a54c-ebb014989095 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:48:28 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[3141a02d-6126-432f-80e8-f5e0571c41d4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:838cbbc1-303e-481f-a54c-ebb014989095, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:838cbbc1-303e-481f-a54c-ebb014989095, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:48:28 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:838cbbc1-303e-481f-a54c-ebb014989095, portal: 172.16.0.220,3260]
Oct 18 11:48:28 user nova-compute[74190]: Login to [iface: default, target: iqn.2010-10.org.openstack:838cbbc1-303e-481f-a54c-ebb014989095, portal: 172.16.0.220,3260] successful.
Oct 18 11:48:28 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:48:28 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:838cbbc1-303e-481f-a54c-ebb014989095 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:48:28 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:838cbbc1-303e-481f-a54c-ebb014989095 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:48:28 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3190032-51ed-4b46-9c36-8a3ddad7620b]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:48:28 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:48:28 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:48:28 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:48:28 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[c34e7898-d1d1-4924-8bc7-ee23f7021f5f]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2637fe23-3624-4fe8-954e-266b32cf18a9 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:838cbbc1-303e-481f-a54c-ebb014989095 (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:48:28 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49 (non-flash)
Oct 18 11:48:28 user nova-compute[74190]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2637fe23-3624-4fe8-954e-266b32cf18a9 (non-flash)
Oct 18 11:48:28 user nova-compute[74190]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:838cbbc1-303e-481f-a54c-ebb014989095 (non-flash)
Oct 18 11:48:28 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:48:28 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49 (non-flash)
Oct 18 11:48:28 user nova-compute[74190]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2637fe23-3624-4fe8-954e-266b32cf18a9 (non-flash)
Oct 18 11:48:28 user nova-compute[74190]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:838cbbc1-303e-481f-a54c-ebb014989095 (non-flash)
Oct 18 11:48:28 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:48:28 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:838cbbc1-303e-481f-a54c-ebb014989095" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.392s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:48:28 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Connected to 172.16.0.220:3260 {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 11:48:28 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] HCTL ('35', '-', '-', 0) found on session 19 with lun 0 {{(pid=74190) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 11:48:28 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74190) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 11:48:28 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:48:28 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:48:28 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[43374da6-f7f7-4605-9e72-15f0fec91794]: (4, ('- - 0', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:48:28 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Searching for a device in session 19 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74190) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 11:48:28 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:838cbbc1-303e-481f-a54c-ebb014989095', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OyMDBxch', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 11:48:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:29 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.434s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:48:29 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] <== connect_volume: return (1435ms) {'type': 'block', 'scsi_wwn': '26665346331313662', 'path': '/dev/sdd'} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:48:29 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26665346331313662', 'path': '/dev/sdd'} {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 11:48:29 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Calling os-brick to attach iSCSI Volume {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 11:48:29 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:555c71a2-d950-48cc-96fd-725e0df8ce78', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IaNUtisS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:48:29 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:48:29 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:48:29 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:48:29 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:48:29 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:555c71a2-d950-48cc-96fd-725e0df8ce78" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:48:29 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:555c71a2-d950-48cc-96fd-725e0df8ce78" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:48:29 user nova-compute[74190]: INFO os_brick.initiator.connectors.iscsi [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 11:48:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:555c71a2-d950-48cc-96fd-725e0df8ce78 -p 172.16.0.220:3260 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:48:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:555c71a2-d950-48cc-96fd-725e0df8ce78 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:48:29 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[d32300b5-728c-4f9b-a3a0-43e25f33afa4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:48:29 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 11:48:29 user nova-compute[74190]:  {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:48:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:555c71a2-d950-48cc-96fd-725e0df8ce78 -p 172.16.0.220:3260 --interface default --op new {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:48:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:555c71a2-d950-48cc-96fd-725e0df8ce78 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:48:29 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[0396fca5-dacc-4406-bce5-2045d9bd89cd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:555c71a2-d950-48cc-96fd-725e0df8ce78] added\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:48:29 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:555c71a2-d950-48cc-96fd-725e0df8ce78] added
Oct 18 11:48:29 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:48:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:555c71a2-d950-48cc-96fd-725e0df8ce78 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:48:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:555c71a2-d950-48cc-96fd-725e0df8ce78 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:48:29 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a22a9f-6faf-48db-ac33-d67b5fd1c996]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:48:29 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:48:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:555c71a2-d950-48cc-96fd-725e0df8ce78 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:48:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:555c71a2-d950-48cc-96fd-725e0df8ce78 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:48:29 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e15cac-fe86-456d-ada8-ca06502e32e4]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:48:29 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:48:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:555c71a2-d950-48cc-96fd-725e0df8ce78 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IaNUtisS {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:48:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:555c71a2-d950-48cc-96fd-725e0df8ce78 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IaNUtisS" returned: 0 in 0.022s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:48:29 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[9460e8e6-9fb7-496c-bc4e-27c0ccbf2339]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:48:29 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IaNUtisS'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:48:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:555c71a2-d950-48cc-96fd-725e0df8ce78 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:48:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:555c71a2-d950-48cc-96fd-725e0df8ce78 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:48:29 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df31dc6-101e-4f1e-b997-88658bbb484a]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:48:29 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:48:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:48:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:48:29 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[c08ae5cf-1aa9-49e5-b044-59072a5d0ad7]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2637fe23-3624-4fe8-954e-266b32cf18a9 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:838cbbc1-303e-481f-a54c-ebb014989095 (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:48:29 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49 (non-flash)
Oct 18 11:48:29 user nova-compute[74190]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2637fe23-3624-4fe8-954e-266b32cf18a9 (non-flash)
Oct 18 11:48:29 user nova-compute[74190]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:838cbbc1-303e-481f-a54c-ebb014989095 (non-flash)
Oct 18 11:48:29 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:48:29 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49 (non-flash)
Oct 18 11:48:29 user nova-compute[74190]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2637fe23-3624-4fe8-954e-266b32cf18a9 (non-flash)
Oct 18 11:48:29 user nova-compute[74190]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:838cbbc1-303e-481f-a54c-ebb014989095 (non-flash)
Oct 18 11:48:29 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:48:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:555c71a2-d950-48cc-96fd-725e0df8ce78 -p 172.16.0.220:3260 --login {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:48:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:555c71a2-d950-48cc-96fd-725e0df8ce78 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:48:29 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f8fbc6-66a1-426f-9725-0f552c98eca2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:555c71a2-d950-48cc-96fd-725e0df8ce78, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:555c71a2-d950-48cc-96fd-725e0df8ce78, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:48:29 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:555c71a2-d950-48cc-96fd-725e0df8ce78, portal: 172.16.0.220,3260]
Oct 18 11:48:29 user nova-compute[74190]: Login to [iface: default, target: iqn.2010-10.org.openstack:555c71a2-d950-48cc-96fd-725e0df8ce78, portal: 172.16.0.220,3260] successful.
Oct 18 11:48:29 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:48:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:555c71a2-d950-48cc-96fd-725e0df8ce78 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:48:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:555c71a2-d950-48cc-96fd-725e0df8ce78 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:48:29 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[d649387d-bd78-4b8a-95fe-de692bb2b838]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:48:29 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:48:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:48:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:48:29 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[762378c3-b8df-4b38-9843-3250453ba589]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2637fe23-3624-4fe8-954e-266b32cf18a9 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:838cbbc1-303e-481f-a54c-ebb014989095 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:555c71a2-d950-48cc-96fd-725e0df8ce78 (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:48:29 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49 (non-flash)
Oct 18 11:48:29 user nova-compute[74190]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2637fe23-3624-4fe8-954e-266b32cf18a9 (non-flash)
Oct 18 11:48:29 user nova-compute[74190]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:838cbbc1-303e-481f-a54c-ebb014989095 (non-flash)
Oct 18 11:48:29 user nova-compute[74190]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:555c71a2-d950-48cc-96fd-725e0df8ce78 (non-flash)
Oct 18 11:48:29 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:48:29 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49 (non-flash)
Oct 18 11:48:29 user nova-compute[74190]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2637fe23-3624-4fe8-954e-266b32cf18a9 (non-flash)
Oct 18 11:48:29 user nova-compute[74190]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:838cbbc1-303e-481f-a54c-ebb014989095 (non-flash)
Oct 18 11:48:29 user nova-compute[74190]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:555c71a2-d950-48cc-96fd-725e0df8ce78 (non-flash)
Oct 18 11:48:29 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:48:29 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:555c71a2-d950-48cc-96fd-725e0df8ce78" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:48:29 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Connected to 172.16.0.220:3260 {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 11:48:29 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] HCTL ('36', '-', '-', 0) found on session 20 with lun 0 {{(pid=74190) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 11:48:29 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74190) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 11:48:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:48:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:48:29 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[5541d84d-568d-4cd3-93df-4d5a5c015b13]: (4, ('- - 0', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:48:29 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Searching for a device in session 20 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74190) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 11:48:29 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:555c71a2-d950-48cc-96fd-725e0df8ce78', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IaNUtisS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.356s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] <== connect_volume: return (1357ms) {'type': 'block', 'scsi_wwn': '23234653562386634', 'path': '/dev/sde'} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23234653562386634', 'path': '/dev/sde'} {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T11:46:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-715503398',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-715503398',id=14,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMFpglyECgkSZCauSo+LpQ8kghak5rJ79yWsbPSUEUra2V1BlBnNGH3ZXW5cAirt4aWQbSHcbATh7XVRNu0y4Kp/t+Zl9kT2K9mylFwo4S9K+opZiH0NySN8uxFcXBdtwA==',key_name='tempest-keypair-1606519092',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='53275b2e537640b59e1bb6bcb8368780',ramdisk_id='',reservation_id='r-jnq2b4co',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-553106169',owner_user_name='tempest-TaggedBootDevicesTest_v242-553106169-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:47:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9a4dc36419840d2ae7eac09cbeeea9b',uuid=738fc62c-293c-4fee-9943-45033e0f2602,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e00eb1ac-378c-4d70-9936-d90df4c9cfbb", "address": "fa:16:3e:8c:f3:0b", "network": {"id": "4abb382b-0dbd-4b6c-9403-85021fb1c43a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-328462262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53275b2e537640b59e1bb6bcb8368780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape00eb1ac-37", "ovs_interfaceid": "e00eb1ac-378c-4d70-9936-d90df4c9cfbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74190) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Converting VIF {"id": "e00eb1ac-378c-4d70-9936-d90df4c9cfbb", "address": "fa:16:3e:8c:f3:0b", "network": {"id": "4abb382b-0dbd-4b6c-9403-85021fb1c43a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-328462262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53275b2e537640b59e1bb6bcb8368780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape00eb1ac-37", "ovs_interfaceid": "e00eb1ac-378c-4d70-9936-d90df4c9cfbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:f3:0b,bridge_name='br-int',has_traffic_filtering=True,id=e00eb1ac-378c-4d70-9936-d90df4c9cfbb,network=Network(4abb382b-0dbd-4b6c-9403-85021fb1c43a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape00eb1ac-37') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T11:46:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-715503398',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-715503398',id=14,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMFpglyECgkSZCauSo+LpQ8kghak5rJ79yWsbPSUEUra2V1BlBnNGH3ZXW5cAirt4aWQbSHcbATh7XVRNu0y4Kp/t+Zl9kT2K9mylFwo4S9K+opZiH0NySN8uxFcXBdtwA==',key_name='tempest-keypair-1606519092',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='53275b2e537640b59e1bb6bcb8368780',ramdisk_id='',reservation_id='r-jnq2b4co',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-553106169',owner_user_name='tempest-TaggedBootDevicesTest_v242-553106169-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:47:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9a4dc36419840d2ae7eac09cbeeea9b',uuid=738fc62c-293c-4fee-9943-45033e0f2602,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "906d428b-8be9-4ac1-ac30-4f48a5448c11", "address": "fa:16:3e:6d:e6:6e", "network": {"id": "991f3e6a-9513-4e2d-8ce6-e34c5a8e8d33", "bridge": "br-int", "label": "tempest-device-tagging-net1-1313342702", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "53275b2e537640b59e1bb6bcb8368780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap906d428b-8b", "ovs_interfaceid": "906d428b-8be9-4ac1-ac30-4f48a5448c11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74190) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Converting VIF {"id": "906d428b-8be9-4ac1-ac30-4f48a5448c11", "address": "fa:16:3e:6d:e6:6e", "network": {"id": "991f3e6a-9513-4e2d-8ce6-e34c5a8e8d33", "bridge": "br-int", "label": "tempest-device-tagging-net1-1313342702", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "53275b2e537640b59e1bb6bcb8368780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap906d428b-8b", "ovs_interfaceid": "906d428b-8be9-4ac1-ac30-4f48a5448c11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:e6:6e,bridge_name='br-int',has_traffic_filtering=True,id=906d428b-8be9-4ac1-ac30-4f48a5448c11,network=Network(991f3e6a-9513-4e2d-8ce6-e34c5a8e8d33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap906d428b-8b') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T11:46:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-715503398',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-715503398',id=14,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMFpglyECgkSZCauSo+LpQ8kghak5rJ79yWsbPSUEUra2V1BlBnNGH3ZXW5cAirt4aWQbSHcbATh7XVRNu0y4Kp/t+Zl9kT2K9mylFwo4S9K+opZiH0NySN8uxFcXBdtwA==',key_name='tempest-keypair-1606519092',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='53275b2e537640b59e1bb6bcb8368780',ramdisk_id='',reservation_id='r-jnq2b4co',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-553106169',owner_user_name='tempest-TaggedBootDevicesTest_v242-553106169-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:47:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9a4dc36419840d2ae7eac09cbeeea9b',uuid=738fc62c-293c-4fee-9943-45033e0f2602,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "44bc05d9-08bc-49ab-80a4-ee736c201a4b", "address": "fa:16:3e:50:48:95", "network": {"id": "991f3e6a-9513-4e2d-8ce6-e34c5a8e8d33", "bridge": "br-int", "label": "tempest-device-tagging-net1-1313342702", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "53275b2e537640b59e1bb6bcb8368780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44bc05d9-08", "ovs_interfaceid": "44bc05d9-08bc-49ab-80a4-ee736c201a4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74190) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Converting VIF {"id": "44bc05d9-08bc-49ab-80a4-ee736c201a4b", "address": "fa:16:3e:50:48:95", "network": {"id": "991f3e6a-9513-4e2d-8ce6-e34c5a8e8d33", "bridge": "br-int", "label": "tempest-device-tagging-net1-1313342702", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "53275b2e537640b59e1bb6bcb8368780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44bc05d9-08", "ovs_interfaceid": "44bc05d9-08bc-49ab-80a4-ee736c201a4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:48:95,bridge_name='br-int',has_traffic_filtering=True,id=44bc05d9-08bc-49ab-80a4-ee736c201a4b,network=Network(991f3e6a-9513-4e2d-8ce6-e34c5a8e8d33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap44bc05d9-08') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T11:46:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-715503398',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-715503398',id=14,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMFpglyECgkSZCauSo+LpQ8kghak5rJ79yWsbPSUEUra2V1BlBnNGH3ZXW5cAirt4aWQbSHcbATh7XVRNu0y4Kp/t+Zl9kT2K9mylFwo4S9K+opZiH0NySN8uxFcXBdtwA==',key_name='tempest-keypair-1606519092',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='53275b2e537640b59e1bb6bcb8368780',ramdisk_id='',reservation_id='r-jnq2b4co',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-553106169',owner_user_name='tempest-TaggedBootDevicesTest_v242-553106169-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:47:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9a4dc36419840d2ae7eac09cbeeea9b',uuid=738fc62c-293c-4fee-9943-45033e0f2602,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1a3a415f-eace-4edd-8643-565472342393", "address": "fa:16:3e:db:69:76", "network": {"id": "991f3e6a-9513-4e2d-8ce6-e34c5a8e8d33", "bridge": "br-int", "label": "tempest-device-tagging-net1-1313342702", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "53275b2e537640b59e1bb6bcb8368780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a3a415f-ea", "ovs_interfaceid": "1a3a415f-eace-4edd-8643-565472342393", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74190) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Converting VIF {"id": "1a3a415f-eace-4edd-8643-565472342393", "address": "fa:16:3e:db:69:76", "network": {"id": "991f3e6a-9513-4e2d-8ce6-e34c5a8e8d33", "bridge": "br-int", "label": "tempest-device-tagging-net1-1313342702", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "53275b2e537640b59e1bb6bcb8368780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a3a415f-ea", "ovs_interfaceid": "1a3a415f-eace-4edd-8643-565472342393", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:69:76,bridge_name='br-int',has_traffic_filtering=True,id=1a3a415f-eace-4edd-8643-565472342393,network=Network(991f3e6a-9513-4e2d-8ce6-e34c5a8e8d33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a3a415f-ea') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T11:46:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-715503398',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-715503398',id=14,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMFpglyECgkSZCauSo+LpQ8kghak5rJ79yWsbPSUEUra2V1BlBnNGH3ZXW5cAirt4aWQbSHcbATh7XVRNu0y4Kp/t+Zl9kT2K9mylFwo4S9K+opZiH0NySN8uxFcXBdtwA==',key_name='tempest-keypair-1606519092',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='53275b2e537640b59e1bb6bcb8368780',ramdisk_id='',reservation_id='r-jnq2b4co',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-553106169',owner_user_name='tempest-TaggedBootDevicesTest_v242-553106169-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:47:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9a4dc36419840d2ae7eac09cbeeea9b',uuid=738fc62c-293c-4fee-9943-45033e0f2602,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cfde954f-7659-43ce-a771-b817aef06692", "address": "fa:16:3e:da:06:44", "network": {"id": "991f3e6a-9513-4e2d-8ce6-e34c5a8e8d33", "bridge": "br-int", "label": "tempest-device-tagging-net1-1313342702", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "53275b2e537640b59e1bb6bcb8368780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfde954f-76", "ovs_interfaceid": "cfde954f-7659-43ce-a771-b817aef06692", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74190) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Converting VIF {"id": "cfde954f-7659-43ce-a771-b817aef06692", "address": "fa:16:3e:da:06:44", "network": {"id": "991f3e6a-9513-4e2d-8ce6-e34c5a8e8d33", "bridge": "br-int", "label": "tempest-device-tagging-net1-1313342702", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "53275b2e537640b59e1bb6bcb8368780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfde954f-76", "ovs_interfaceid": "cfde954f-7659-43ce-a771-b817aef06692", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:06:44,bridge_name='br-int',has_traffic_filtering=True,id=cfde954f-7659-43ce-a771-b817aef06692,network=Network(991f3e6a-9513-4e2d-8ce6-e34c5a8e8d33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfde954f-76') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T11:46:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-715503398',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-715503398',id=14,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMFpglyECgkSZCauSo+LpQ8kghak5rJ79yWsbPSUEUra2V1BlBnNGH3ZXW5cAirt4aWQbSHcbATh7XVRNu0y4Kp/t+Zl9kT2K9mylFwo4S9K+opZiH0NySN8uxFcXBdtwA==',key_name='tempest-keypair-1606519092',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='53275b2e537640b59e1bb6bcb8368780',ramdisk_id='',reservation_id='r-jnq2b4co',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-553106169',owner_user_name='tempest-TaggedBootDevicesTest_v242-553106169-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:47:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9a4dc36419840d2ae7eac09cbeeea9b',uuid=738fc62c-293c-4fee-9943-45033e0f2602,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ce10d70d-8444-4bd5-adfd-3fc346977282", "address": "fa:16:3e:b3:96:2f", "network": {"id": "f58bb855-be1b-4895-bc60-5dfa56567d43", "bridge": "br-int", "label": "tempest-device-tagging-net2-1711719607", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "53275b2e537640b59e1bb6bcb8368780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce10d70d-84", "ovs_interfaceid": "ce10d70d-8444-4bd5-adfd-3fc346977282", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74190) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Converting VIF {"id": "ce10d70d-8444-4bd5-adfd-3fc346977282", "address": "fa:16:3e:b3:96:2f", "network": {"id": "f58bb855-be1b-4895-bc60-5dfa56567d43", "bridge": "br-int", "label": "tempest-device-tagging-net2-1711719607", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "53275b2e537640b59e1bb6bcb8368780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce10d70d-84", "ovs_interfaceid": "ce10d70d-8444-4bd5-adfd-3fc346977282", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:96:2f,bridge_name='br-int',has_traffic_filtering=True,id=ce10d70d-8444-4bd5-adfd-3fc346977282,network=Network(f58bb855-be1b-4895-bc60-5dfa56567d43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce10d70d-84') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T11:46:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-715503398',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-715503398',id=14,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMFpglyECgkSZCauSo+LpQ8kghak5rJ79yWsbPSUEUra2V1BlBnNGH3ZXW5cAirt4aWQbSHcbATh7XVRNu0y4Kp/t+Zl9kT2K9mylFwo4S9K+opZiH0NySN8uxFcXBdtwA==',key_name='tempest-keypair-1606519092',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='53275b2e537640b59e1bb6bcb8368780',ramdisk_id='',reservation_id='r-jnq2b4co',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-553106169',owner_user_name='tempest-TaggedBootDevicesTest_v242-553106169-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:47:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9a4dc36419840d2ae7eac09cbeeea9b',uuid=738fc62c-293c-4fee-9943-45033e0f2602,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "644ec7e2-9907-4ecb-8d84-95b2ae66d866", "address": "fa:16:3e:c2:8f:71", "network": {"id": "f58bb855-be1b-4895-bc60-5dfa56567d43", "bridge": "br-int", "label": "tempest-device-tagging-net2-1711719607", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "53275b2e537640b59e1bb6bcb8368780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap644ec7e2-99", "ovs_interfaceid": "644ec7e2-9907-4ecb-8d84-95b2ae66d866", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74190) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Converting VIF {"id": "644ec7e2-9907-4ecb-8d84-95b2ae66d866", "address": "fa:16:3e:c2:8f:71", "network": {"id": "f58bb855-be1b-4895-bc60-5dfa56567d43", "bridge": "br-int", "label": "tempest-device-tagging-net2-1711719607", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "53275b2e537640b59e1bb6bcb8368780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap644ec7e2-99", "ovs_interfaceid": "644ec7e2-9907-4ecb-8d84-95b2ae66d866", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:8f:71,bridge_name='br-int',has_traffic_filtering=True,id=644ec7e2-9907-4ecb-8d84-95b2ae66d866,network=Network(f58bb855-be1b-4895-bc60-5dfa56567d43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap644ec7e2-99') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG nova.objects.instance [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Lazy-loading 'pci_devices' on Instance uuid 738fc62c-293c-4fee-9943-45033e0f2602 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-7301235c-74bd-4645-9e55-35d1592f02df tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Acquiring lock "d90a6ca0-19a6-4221-81b7-0cb05d67f38e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-7301235c-74bd-4645-9e55-35d1592f02df tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Lock "d90a6ca0-19a6-4221-81b7-0cb05d67f38e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] End _get_guest_xml xml=<domain type="kvm">
Oct 18 11:48:30 user nova-compute[74190]:   <uuid>738fc62c-293c-4fee-9943-45033e0f2602</uuid>
Oct 18 11:48:30 user nova-compute[74190]:   <name>instance-0000000e</name>
Oct 18 11:48:30 user nova-compute[74190]:   <memory>524288</memory>
Oct 18 11:48:30 user nova-compute[74190]:   <vcpu>1</vcpu>
Oct 18 11:48:30 user nova-compute[74190]:   <metadata>
Oct 18 11:48:30 user nova-compute[74190]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 11:48:30 user nova-compute[74190]:       <nova:package version="0.0.0"/>
Oct 18 11:48:30 user nova-compute[74190]:       <nova:name>tempest-device-tagging-server-715503398</nova:name>
Oct 18 11:48:30 user nova-compute[74190]:       <nova:creationTime>2023-10-18 11:48:26</nova:creationTime>
Oct 18 11:48:30 user nova-compute[74190]:       <nova:flavor name="m1.tiny">
Oct 18 11:48:30 user nova-compute[74190]:         <nova:memory>512</nova:memory>
Oct 18 11:48:30 user nova-compute[74190]:         <nova:disk>1</nova:disk>
Oct 18 11:48:30 user nova-compute[74190]:         <nova:swap>0</nova:swap>
Oct 18 11:48:30 user nova-compute[74190]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 11:48:30 user nova-compute[74190]:         <nova:vcpus>1</nova:vcpus>
Oct 18 11:48:30 user nova-compute[74190]:       </nova:flavor>
Oct 18 11:48:30 user nova-compute[74190]:       <nova:owner>
Oct 18 11:48:30 user nova-compute[74190]:         <nova:user uuid="f9a4dc36419840d2ae7eac09cbeeea9b">tempest-TaggedBootDevicesTest_v242-553106169-project-member</nova:user>
Oct 18 11:48:30 user nova-compute[74190]:         <nova:project uuid="53275b2e537640b59e1bb6bcb8368780">tempest-TaggedBootDevicesTest_v242-553106169</nova:project>
Oct 18 11:48:30 user nova-compute[74190]:       </nova:owner>
Oct 18 11:48:30 user nova-compute[74190]:       <nova:root type="image" uuid="6e88bbf0-6e78-49a8-b3c5-9453d22a89df"/>
Oct 18 11:48:30 user nova-compute[74190]:       <nova:ports>
Oct 18 11:48:30 user nova-compute[74190]:         <nova:port uuid="e00eb1ac-378c-4d70-9936-d90df4c9cfbb">
Oct 18 11:48:30 user nova-compute[74190]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 18 11:48:30 user nova-compute[74190]:         </nova:port>
Oct 18 11:48:30 user nova-compute[74190]:         <nova:port uuid="906d428b-8be9-4ac1-ac30-4f48a5448c11">
Oct 18 11:48:30 user nova-compute[74190]:           <nova:ip type="fixed" address="10.1.1.135" ipVersion="4"/>
Oct 18 11:48:30 user nova-compute[74190]:         </nova:port>
Oct 18 11:48:30 user nova-compute[74190]:         <nova:port uuid="44bc05d9-08bc-49ab-80a4-ee736c201a4b">
Oct 18 11:48:30 user nova-compute[74190]:           <nova:ip type="fixed" address="10.1.1.83" ipVersion="4"/>
Oct 18 11:48:30 user nova-compute[74190]:         </nova:port>
Oct 18 11:48:30 user nova-compute[74190]:         <nova:port uuid="1a3a415f-eace-4edd-8643-565472342393">
Oct 18 11:48:30 user nova-compute[74190]:           <nova:ip type="fixed" address="10.1.1.56" ipVersion="4"/>
Oct 18 11:48:30 user nova-compute[74190]:         </nova:port>
Oct 18 11:48:30 user nova-compute[74190]:         <nova:port uuid="cfde954f-7659-43ce-a771-b817aef06692">
Oct 18 11:48:30 user nova-compute[74190]:           <nova:ip type="fixed" address="10.1.1.70" ipVersion="4"/>
Oct 18 11:48:30 user nova-compute[74190]:         </nova:port>
Oct 18 11:48:30 user nova-compute[74190]:         <nova:port uuid="ce10d70d-8444-4bd5-adfd-3fc346977282">
Oct 18 11:48:30 user nova-compute[74190]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Oct 18 11:48:30 user nova-compute[74190]:         </nova:port>
Oct 18 11:48:30 user nova-compute[74190]:         <nova:port uuid="644ec7e2-9907-4ecb-8d84-95b2ae66d866">
Oct 18 11:48:30 user nova-compute[74190]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Oct 18 11:48:30 user nova-compute[74190]:         </nova:port>
Oct 18 11:48:30 user nova-compute[74190]:       </nova:ports>
Oct 18 11:48:30 user nova-compute[74190]:     </nova:instance>
Oct 18 11:48:30 user nova-compute[74190]:   </metadata>
Oct 18 11:48:30 user nova-compute[74190]:   <sysinfo type="smbios">
Oct 18 11:48:30 user nova-compute[74190]:     <system>
Oct 18 11:48:30 user nova-compute[74190]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 11:48:30 user nova-compute[74190]:       <entry name="product">OpenStack Nova</entry>
Oct 18 11:48:30 user nova-compute[74190]:       <entry name="version">0.0.0</entry>
Oct 18 11:48:30 user nova-compute[74190]:       <entry name="serial">738fc62c-293c-4fee-9943-45033e0f2602</entry>
Oct 18 11:48:30 user nova-compute[74190]:       <entry name="uuid">738fc62c-293c-4fee-9943-45033e0f2602</entry>
Oct 18 11:48:30 user nova-compute[74190]:       <entry name="family">Virtual Machine</entry>
Oct 18 11:48:30 user nova-compute[74190]:     </system>
Oct 18 11:48:30 user nova-compute[74190]:   </sysinfo>
Oct 18 11:48:30 user nova-compute[74190]:   <os>
Oct 18 11:48:30 user nova-compute[74190]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 11:48:30 user nova-compute[74190]:     <boot dev="hd"/>
Oct 18 11:48:30 user nova-compute[74190]:     <smbios mode="sysinfo"/>
Oct 18 11:48:30 user nova-compute[74190]:   </os>
Oct 18 11:48:30 user nova-compute[74190]:   <features>
Oct 18 11:48:30 user nova-compute[74190]:     <acpi/>
Oct 18 11:48:30 user nova-compute[74190]:     <apic/>
Oct 18 11:48:30 user nova-compute[74190]:     <vmcoreinfo/>
Oct 18 11:48:30 user nova-compute[74190]:   </features>
Oct 18 11:48:30 user nova-compute[74190]:   <clock offset="utc">
Oct 18 11:48:30 user nova-compute[74190]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 11:48:30 user nova-compute[74190]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 11:48:30 user nova-compute[74190]:     <timer name="hpet" present="no"/>
Oct 18 11:48:30 user nova-compute[74190]:   </clock>
Oct 18 11:48:30 user nova-compute[74190]:   <cpu mode="custom" match="exact">
Oct 18 11:48:30 user nova-compute[74190]:     <model>Nehalem</model>
Oct 18 11:48:30 user nova-compute[74190]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 11:48:30 user nova-compute[74190]:   </cpu>
Oct 18 11:48:30 user nova-compute[74190]:   <devices>
Oct 18 11:48:30 user nova-compute[74190]:     <disk type="file" device="cdrom">
Oct 18 11:48:30 user nova-compute[74190]:       <driver name="qemu" type="raw" cache="none"/>
Oct 18 11:48:30 user nova-compute[74190]:       <source file="/opt/stack/data/nova/instances/738fc62c-293c-4fee-9943-45033e0f2602/disk.config"/>
Oct 18 11:48:30 user nova-compute[74190]:       <target dev="hda" bus="ide"/>
Oct 18 11:48:30 user nova-compute[74190]:     </disk>
Oct 18 11:48:30 user nova-compute[74190]:     <disk type="block" device="disk">
Oct 18 11:48:30 user nova-compute[74190]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 11:48:30 user nova-compute[74190]:       <source dev="/dev/sdc"/>
Oct 18 11:48:30 user nova-compute[74190]:       <target dev="vda" bus="virtio"/>
Oct 18 11:48:30 user nova-compute[74190]:       <serial>2637fe23-3624-4fe8-954e-266b32cf18a9</serial>
Oct 18 11:48:30 user nova-compute[74190]:     </disk>
Oct 18 11:48:30 user nova-compute[74190]:     <disk type="block" device="disk">
Oct 18 11:48:30 user nova-compute[74190]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 11:48:30 user nova-compute[74190]:       <source dev="/dev/sdd"/>
Oct 18 11:48:30 user nova-compute[74190]:       <target dev="vdb" bus="virtio"/>
Oct 18 11:48:30 user nova-compute[74190]:       <serial>838cbbc1-303e-481f-a54c-ebb014989095</serial>
Oct 18 11:48:30 user nova-compute[74190]:     </disk>
Oct 18 11:48:30 user nova-compute[74190]:     <disk type="block" device="disk">
Oct 18 11:48:30 user nova-compute[74190]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 11:48:30 user nova-compute[74190]:       <source dev="/dev/sde"/>
Oct 18 11:48:30 user nova-compute[74190]:       <target dev="vdc" bus="virtio"/>
Oct 18 11:48:30 user nova-compute[74190]:       <serial>555c71a2-d950-48cc-96fd-725e0df8ce78</serial>
Oct 18 11:48:30 user nova-compute[74190]:     </disk>
Oct 18 11:48:30 user nova-compute[74190]:     <interface type="ethernet">
Oct 18 11:48:30 user nova-compute[74190]:       <mac address="fa:16:3e:8c:f3:0b"/>
Oct 18 11:48:30 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:48:30 user nova-compute[74190]:       <mtu size="1442"/>
Oct 18 11:48:30 user nova-compute[74190]:       <target dev="tape00eb1ac-37"/>
Oct 18 11:48:30 user nova-compute[74190]:     </interface>
Oct 18 11:48:30 user nova-compute[74190]:     <interface type="ethernet">
Oct 18 11:48:30 user nova-compute[74190]:       <mac address="fa:16:3e:6d:e6:6e"/>
Oct 18 11:48:30 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:48:30 user nova-compute[74190]:       <mtu size="1442"/>
Oct 18 11:48:30 user nova-compute[74190]:       <target dev="tap906d428b-8b"/>
Oct 18 11:48:30 user nova-compute[74190]:     </interface>
Oct 18 11:48:30 user nova-compute[74190]:     <interface type="ethernet">
Oct 18 11:48:30 user nova-compute[74190]:       <mac address="fa:16:3e:50:48:95"/>
Oct 18 11:48:30 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:48:30 user nova-compute[74190]:       <mtu size="1442"/>
Oct 18 11:48:30 user nova-compute[74190]:       <target dev="tap44bc05d9-08"/>
Oct 18 11:48:30 user nova-compute[74190]:     </interface>
Oct 18 11:48:30 user nova-compute[74190]:     <interface type="ethernet">
Oct 18 11:48:30 user nova-compute[74190]:       <mac address="fa:16:3e:db:69:76"/>
Oct 18 11:48:30 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:48:30 user nova-compute[74190]:       <mtu size="1442"/>
Oct 18 11:48:30 user nova-compute[74190]:       <target dev="tap1a3a415f-ea"/>
Oct 18 11:48:30 user nova-compute[74190]:     </interface>
Oct 18 11:48:30 user nova-compute[74190]:     <interface type="ethernet">
Oct 18 11:48:30 user nova-compute[74190]:       <mac address="fa:16:3e:da:06:44"/>
Oct 18 11:48:30 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:48:30 user nova-compute[74190]:       <mtu size="1442"/>
Oct 18 11:48:30 user nova-compute[74190]:       <target dev="tapcfde954f-76"/>
Oct 18 11:48:30 user nova-compute[74190]:     </interface>
Oct 18 11:48:30 user nova-compute[74190]:     <interface type="ethernet">
Oct 18 11:48:30 user nova-compute[74190]:       <mac address="fa:16:3e:b3:96:2f"/>
Oct 18 11:48:30 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:48:30 user nova-compute[74190]:       <mtu size="1442"/>
Oct 18 11:48:30 user nova-compute[74190]:       <target dev="tapce10d70d-84"/>
Oct 18 11:48:30 user nova-compute[74190]:     </interface>
Oct 18 11:48:30 user nova-compute[74190]:     <interface type="ethernet">
Oct 18 11:48:30 user nova-compute[74190]:       <mac address="fa:16:3e:c2:8f:71"/>
Oct 18 11:48:30 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:48:30 user nova-compute[74190]:       <mtu size="1442"/>
Oct 18 11:48:30 user nova-compute[74190]:       <target dev="tap644ec7e2-99"/>
Oct 18 11:48:30 user nova-compute[74190]:     </interface>
Oct 18 11:48:30 user nova-compute[74190]:     <serial type="pty">
Oct 18 11:48:30 user nova-compute[74190]:       <log file="/opt/stack/data/nova/instances/738fc62c-293c-4fee-9943-45033e0f2602/console.log" append="off"/>
Oct 18 11:48:30 user nova-compute[74190]:     </serial>
Oct 18 11:48:30 user nova-compute[74190]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 11:48:30 user nova-compute[74190]:     <video>
Oct 18 11:48:30 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:48:30 user nova-compute[74190]:     </video>
Oct 18 11:48:30 user nova-compute[74190]:     <rng model="virtio">
Oct 18 11:48:30 user nova-compute[74190]:       <backend model="random">/dev/urandom</backend>
Oct 18 11:48:30 user nova-compute[74190]:     </rng>
Oct 18 11:48:30 user nova-compute[74190]:     <controller type="usb" index="0" model="none"/>
Oct 18 11:48:30 user nova-compute[74190]:     <memballoon model="virtio">
Oct 18 11:48:30 user nova-compute[74190]:       <stats period="10"/>
Oct 18 11:48:30 user nova-compute[74190]:     </memballoon>
Oct 18 11:48:30 user nova-compute[74190]:   </devices>
Oct 18 11:48:30 user nova-compute[74190]: </domain>
Oct 18 11:48:30 user nova-compute[74190]:  {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T11:46:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-715503398',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-715503398',id=14,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMFpglyECgkSZCauSo+LpQ8kghak5rJ79yWsbPSUEUra2V1BlBnNGH3ZXW5cAirt4aWQbSHcbATh7XVRNu0y4Kp/t+Zl9kT2K9mylFwo4S9K+opZiH0NySN8uxFcXBdtwA==',key_name='tempest-keypair-1606519092',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='53275b2e537640b59e1bb6bcb8368780',ramdisk_id='',reservation_id='r-jnq2b4co',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-553106169',owner_user_name='tempest-TaggedBootDevicesTest_v242-553106169-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:47:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9a4dc36419840d2ae7eac09cbeeea9b',uuid=738fc62c-293c-4fee-9943-45033e0f2602,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e00eb1ac-378c-4d70-9936-d90df4c9cfbb", "address": "fa:16:3e:8c:f3:0b", "network": {"id": "4abb382b-0dbd-4b6c-9403-85021fb1c43a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-328462262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53275b2e537640b59e1bb6bcb8368780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape00eb1ac-37", "ovs_interfaceid": "e00eb1ac-378c-4d70-9936-d90df4c9cfbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Converting VIF {"id": "e00eb1ac-378c-4d70-9936-d90df4c9cfbb", "address": "fa:16:3e:8c:f3:0b", "network": {"id": "4abb382b-0dbd-4b6c-9403-85021fb1c43a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-328462262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53275b2e537640b59e1bb6bcb8368780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape00eb1ac-37", "ovs_interfaceid": "e00eb1ac-378c-4d70-9936-d90df4c9cfbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:f3:0b,bridge_name='br-int',has_traffic_filtering=True,id=e00eb1ac-378c-4d70-9936-d90df4c9cfbb,network=Network(4abb382b-0dbd-4b6c-9403-85021fb1c43a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape00eb1ac-37') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG os_vif [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:f3:0b,bridge_name='br-int',has_traffic_filtering=True,id=e00eb1ac-378c-4d70-9936-d90df4c9cfbb,network=Network(4abb382b-0dbd-4b6c-9403-85021fb1c43a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape00eb1ac-37') {{(pid=74190) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9e449356-21a7-573a-baa2-0ae4e318fb39', '_type': 'linux-noop'}}, row=False) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG nova.compute.manager [None req-7301235c-74bd-4645-9e55-35d1592f02df tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Starting instance... {{(pid=74190) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape00eb1ac-37, may_exist=True, interface_attrs={}) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape00eb1ac-37, col_values=(('qos', UUID('a3ef6f6d-296a-4aef-b11d-50fc6727bc7d')),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape00eb1ac-37, col_values=(('external_ids', {'iface-id': 'e00eb1ac-378c-4d70-9936-d90df4c9cfbb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8c:f3:0b', 'vm-uuid': '738fc62c-293c-4fee-9943-45033e0f2602'}),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:30 user nova-compute[74190]: INFO os_vif [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:f3:0b,bridge_name='br-int',has_traffic_filtering=True,id=e00eb1ac-378c-4d70-9936-d90df4c9cfbb,network=Network(4abb382b-0dbd-4b6c-9403-85021fb1c43a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape00eb1ac-37')
Oct 18 11:48:30 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T11:46:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-715503398',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-715503398',id=14,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMFpglyECgkSZCauSo+LpQ8kghak5rJ79yWsbPSUEUra2V1BlBnNGH3ZXW5cAirt4aWQbSHcbATh7XVRNu0y4Kp/t+Zl9kT2K9mylFwo4S9K+opZiH0NySN8uxFcXBdtwA==',key_name='tempest-keypair-1606519092',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='53275b2e537640b59e1bb6bcb8368780',ramdisk_id='',reservation_id='r-jnq2b4co',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-553106169',owner_user_name='tempest-TaggedBootDevicesTest_v242-553106169-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:47:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9a4dc36419840d2ae7eac09cbeeea9b',uuid=738fc62c-293c-4fee-9943-45033e0f2602,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "906d428b-8be9-4ac1-ac30-4f48a5448c11", "address": "fa:16:3e:6d:e6:6e", "network": {"id": "991f3e6a-9513-4e2d-8ce6-e34c5a8e8d33", "bridge": "br-int", "label": "tempest-device-tagging-net1-1313342702", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "53275b2e537640b59e1bb6bcb8368780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap906d428b-8b", "ovs_interfaceid": "906d428b-8be9-4ac1-ac30-4f48a5448c11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74190) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Converting VIF {"id": "906d428b-8be9-4ac1-ac30-4f48a5448c11", "address": "fa:16:3e:6d:e6:6e", "network": {"id": "991f3e6a-9513-4e2d-8ce6-e34c5a8e8d33", "bridge": "br-int", "label": "tempest-device-tagging-net1-1313342702", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "53275b2e537640b59e1bb6bcb8368780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap906d428b-8b", "ovs_interfaceid": "906d428b-8be9-4ac1-ac30-4f48a5448c11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:e6:6e,bridge_name='br-int',has_traffic_filtering=True,id=906d428b-8be9-4ac1-ac30-4f48a5448c11,network=Network(991f3e6a-9513-4e2d-8ce6-e34c5a8e8d33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap906d428b-8b') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG os_vif [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:e6:6e,bridge_name='br-int',has_traffic_filtering=True,id=906d428b-8be9-4ac1-ac30-4f48a5448c11,network=Network(991f3e6a-9513-4e2d-8ce6-e34c5a8e8d33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap906d428b-8b') {{(pid=74190) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a6f4f279-2e98-5bba-a9bc-2c0e7605f9fe', '_type': 'linux-noop'}}, row=False) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap906d428b-8b, may_exist=True, interface_attrs={}) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap906d428b-8b, col_values=(('qos', UUID('71ac5fae-10ac-4614-8f81-5909dc8a8b6c')),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap906d428b-8b, col_values=(('external_ids', {'iface-id': '906d428b-8be9-4ac1-ac30-4f48a5448c11', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:e6:6e', 'vm-uuid': '738fc62c-293c-4fee-9943-45033e0f2602'}),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:30 user nova-compute[74190]: INFO os_vif [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:e6:6e,bridge_name='br-int',has_traffic_filtering=True,id=906d428b-8be9-4ac1-ac30-4f48a5448c11,network=Network(991f3e6a-9513-4e2d-8ce6-e34c5a8e8d33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap906d428b-8b')
Oct 18 11:48:30 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T11:46:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-715503398',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-715503398',id=14,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMFpglyECgkSZCauSo+LpQ8kghak5rJ79yWsbPSUEUra2V1BlBnNGH3ZXW5cAirt4aWQbSHcbATh7XVRNu0y4Kp/t+Zl9kT2K9mylFwo4S9K+opZiH0NySN8uxFcXBdtwA==',key_name='tempest-keypair-1606519092',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='53275b2e537640b59e1bb6bcb8368780',ramdisk_id='',reservation_id='r-jnq2b4co',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-553106169',owner_user_name='tempest-TaggedBootDevicesTest_v242-553106169-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:47:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9a4dc36419840d2ae7eac09cbeeea9b',uuid=738fc62c-293c-4fee-9943-45033e0f2602,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "44bc05d9-08bc-49ab-80a4-ee736c201a4b", "address": "fa:16:3e:50:48:95", "network": {"id": "991f3e6a-9513-4e2d-8ce6-e34c5a8e8d33", "bridge": "br-int", "label": "tempest-device-tagging-net1-1313342702", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "53275b2e537640b59e1bb6bcb8368780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44bc05d9-08", "ovs_interfaceid": "44bc05d9-08bc-49ab-80a4-ee736c201a4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74190) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Converting VIF {"id": "44bc05d9-08bc-49ab-80a4-ee736c201a4b", "address": "fa:16:3e:50:48:95", "network": {"id": "991f3e6a-9513-4e2d-8ce6-e34c5a8e8d33", "bridge": "br-int", "label": "tempest-device-tagging-net1-1313342702", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "53275b2e537640b59e1bb6bcb8368780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44bc05d9-08", "ovs_interfaceid": "44bc05d9-08bc-49ab-80a4-ee736c201a4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:48:95,bridge_name='br-int',has_traffic_filtering=True,id=44bc05d9-08bc-49ab-80a4-ee736c201a4b,network=Network(991f3e6a-9513-4e2d-8ce6-e34c5a8e8d33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap44bc05d9-08') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG os_vif [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:48:95,bridge_name='br-int',has_traffic_filtering=True,id=44bc05d9-08bc-49ab-80a4-ee736c201a4b,network=Network(991f3e6a-9513-4e2d-8ce6-e34c5a8e8d33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap44bc05d9-08') {{(pid=74190) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-7301235c-74bd-4645-9e55-35d1592f02df tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-7301235c-74bd-4645-9e55-35d1592f02df tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '10442352-e7e6-57d5-9b9d-2303d83059e3', '_type': 'linux-noop'}}, row=False) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-7301235c-74bd-4645-9e55-35d1592f02df tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74190) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 11:48:30 user nova-compute[74190]: INFO nova.compute.claims [None req-7301235c-74bd-4645-9e55-35d1592f02df tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Claim successful on node user
Oct 18 11:48:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap44bc05d9-08, may_exist=True, interface_attrs={}) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap44bc05d9-08, col_values=(('qos', UUID('7f6520ca-4705-4729-bec9-7652814ade8b')),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap44bc05d9-08, col_values=(('external_ids', {'iface-id': '44bc05d9-08bc-49ab-80a4-ee736c201a4b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:50:48:95', 'vm-uuid': '738fc62c-293c-4fee-9943-45033e0f2602'}),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:30 user nova-compute[74190]: INFO os_vif [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:48:95,bridge_name='br-int',has_traffic_filtering=True,id=44bc05d9-08bc-49ab-80a4-ee736c201a4b,network=Network(991f3e6a-9513-4e2d-8ce6-e34c5a8e8d33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap44bc05d9-08')
Oct 18 11:48:30 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T11:46:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-715503398',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-715503398',id=14,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMFpglyECgkSZCauSo+LpQ8kghak5rJ79yWsbPSUEUra2V1BlBnNGH3ZXW5cAirt4aWQbSHcbATh7XVRNu0y4Kp/t+Zl9kT2K9mylFwo4S9K+opZiH0NySN8uxFcXBdtwA==',key_name='tempest-keypair-1606519092',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='53275b2e537640b59e1bb6bcb8368780',ramdisk_id='',reservation_id='r-jnq2b4co',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-553106169',owner_user_name='tempest-TaggedBootDevicesTest_v242-553106169-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:47:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9a4dc36419840d2ae7eac09cbeeea9b',uuid=738fc62c-293c-4fee-9943-45033e0f2602,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1a3a415f-eace-4edd-8643-565472342393", "address": "fa:16:3e:db:69:76", "network": {"id": "991f3e6a-9513-4e2d-8ce6-e34c5a8e8d33", "bridge": "br-int", "label": "tempest-device-tagging-net1-1313342702", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "53275b2e537640b59e1bb6bcb8368780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a3a415f-ea", "ovs_interfaceid": "1a3a415f-eace-4edd-8643-565472342393", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Converting VIF {"id": "1a3a415f-eace-4edd-8643-565472342393", "address": "fa:16:3e:db:69:76", "network": {"id": "991f3e6a-9513-4e2d-8ce6-e34c5a8e8d33", "bridge": "br-int", "label": "tempest-device-tagging-net1-1313342702", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "53275b2e537640b59e1bb6bcb8368780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a3a415f-ea", "ovs_interfaceid": "1a3a415f-eace-4edd-8643-565472342393", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:69:76,bridge_name='br-int',has_traffic_filtering=True,id=1a3a415f-eace-4edd-8643-565472342393,network=Network(991f3e6a-9513-4e2d-8ce6-e34c5a8e8d33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a3a415f-ea') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG os_vif [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:69:76,bridge_name='br-int',has_traffic_filtering=True,id=1a3a415f-eace-4edd-8643-565472342393,network=Network(991f3e6a-9513-4e2d-8ce6-e34c5a8e8d33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a3a415f-ea') {{(pid=74190) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '30807fb0-8d1b-5e38-b524-58ce775d5d32', '_type': 'linux-noop'}}, row=False) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1a3a415f-ea, may_exist=True, interface_attrs={}) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1a3a415f-ea, col_values=(('qos', UUID('b7b76cc8-023c-4b0f-8336-419ac5be0ce7')),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1a3a415f-ea, col_values=(('external_ids', {'iface-id': '1a3a415f-eace-4edd-8643-565472342393', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:db:69:76', 'vm-uuid': '738fc62c-293c-4fee-9943-45033e0f2602'}),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:30 user nova-compute[74190]: INFO os_vif [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:69:76,bridge_name='br-int',has_traffic_filtering=True,id=1a3a415f-eace-4edd-8643-565472342393,network=Network(991f3e6a-9513-4e2d-8ce6-e34c5a8e8d33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a3a415f-ea')
Oct 18 11:48:30 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T11:46:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-715503398',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-715503398',id=14,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMFpglyECgkSZCauSo+LpQ8kghak5rJ79yWsbPSUEUra2V1BlBnNGH3ZXW5cAirt4aWQbSHcbATh7XVRNu0y4Kp/t+Zl9kT2K9mylFwo4S9K+opZiH0NySN8uxFcXBdtwA==',key_name='tempest-keypair-1606519092',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='53275b2e537640b59e1bb6bcb8368780',ramdisk_id='',reservation_id='r-jnq2b4co',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-553106169',owner_user_name='tempest-TaggedBootDevicesTest_v242-553106169-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:47:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9a4dc36419840d2ae7eac09cbeeea9b',uuid=738fc62c-293c-4fee-9943-45033e0f2602,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cfde954f-7659-43ce-a771-b817aef06692", "address": "fa:16:3e:da:06:44", "network": {"id": "991f3e6a-9513-4e2d-8ce6-e34c5a8e8d33", "bridge": "br-int", "label": "tempest-device-tagging-net1-1313342702", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "53275b2e537640b59e1bb6bcb8368780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfde954f-76", "ovs_interfaceid": "cfde954f-7659-43ce-a771-b817aef06692", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Converting VIF {"id": "cfde954f-7659-43ce-a771-b817aef06692", "address": "fa:16:3e:da:06:44", "network": {"id": "991f3e6a-9513-4e2d-8ce6-e34c5a8e8d33", "bridge": "br-int", "label": "tempest-device-tagging-net1-1313342702", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "53275b2e537640b59e1bb6bcb8368780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfde954f-76", "ovs_interfaceid": "cfde954f-7659-43ce-a771-b817aef06692", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:06:44,bridge_name='br-int',has_traffic_filtering=True,id=cfde954f-7659-43ce-a771-b817aef06692,network=Network(991f3e6a-9513-4e2d-8ce6-e34c5a8e8d33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfde954f-76') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG os_vif [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:06:44,bridge_name='br-int',has_traffic_filtering=True,id=cfde954f-7659-43ce-a771-b817aef06692,network=Network(991f3e6a-9513-4e2d-8ce6-e34c5a8e8d33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfde954f-76') {{(pid=74190) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '960a9a69-0a9d-53a1-8885-9246760d918b', '_type': 'linux-noop'}}, row=False) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:48:31 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:31 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:31 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcfde954f-76, may_exist=True, interface_attrs={}) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:48:31 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcfde954f-76, col_values=(('qos', UUID('7cd00d23-54ad-4154-b3df-2eafaee06a2b')),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:48:31 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcfde954f-76, col_values=(('external_ids', {'iface-id': 'cfde954f-7659-43ce-a771-b817aef06692', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:da:06:44', 'vm-uuid': '738fc62c-293c-4fee-9943-45033e0f2602'}),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:48:31 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:31 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:48:31 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:31 user nova-compute[74190]: INFO os_vif [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:06:44,bridge_name='br-int',has_traffic_filtering=True,id=cfde954f-7659-43ce-a771-b817aef06692,network=Network(991f3e6a-9513-4e2d-8ce6-e34c5a8e8d33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfde954f-76')
Oct 18 11:48:31 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T11:46:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-715503398',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-715503398',id=14,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMFpglyECgkSZCauSo+LpQ8kghak5rJ79yWsbPSUEUra2V1BlBnNGH3ZXW5cAirt4aWQbSHcbATh7XVRNu0y4Kp/t+Zl9kT2K9mylFwo4S9K+opZiH0NySN8uxFcXBdtwA==',key_name='tempest-keypair-1606519092',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='53275b2e537640b59e1bb6bcb8368780',ramdisk_id='',reservation_id='r-jnq2b4co',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-553106169',owner_user_name='tempest-TaggedBootDevicesTest_v242-553106169-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:47:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9a4dc36419840d2ae7eac09cbeeea9b',uuid=738fc62c-293c-4fee-9943-45033e0f2602,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ce10d70d-8444-4bd5-adfd-3fc346977282", "address": "fa:16:3e:b3:96:2f", "network": {"id": "f58bb855-be1b-4895-bc60-5dfa56567d43", "bridge": "br-int", "label": "tempest-device-tagging-net2-1711719607", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "53275b2e537640b59e1bb6bcb8368780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce10d70d-84", "ovs_interfaceid": "ce10d70d-8444-4bd5-adfd-3fc346977282", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 11:48:31 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Converting VIF {"id": "ce10d70d-8444-4bd5-adfd-3fc346977282", "address": "fa:16:3e:b3:96:2f", "network": {"id": "f58bb855-be1b-4895-bc60-5dfa56567d43", "bridge": "br-int", "label": "tempest-device-tagging-net2-1711719607", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "53275b2e537640b59e1bb6bcb8368780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce10d70d-84", "ovs_interfaceid": "ce10d70d-8444-4bd5-adfd-3fc346977282", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:48:31 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:96:2f,bridge_name='br-int',has_traffic_filtering=True,id=ce10d70d-8444-4bd5-adfd-3fc346977282,network=Network(f58bb855-be1b-4895-bc60-5dfa56567d43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce10d70d-84') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:48:31 user nova-compute[74190]: DEBUG os_vif [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:96:2f,bridge_name='br-int',has_traffic_filtering=True,id=ce10d70d-8444-4bd5-adfd-3fc346977282,network=Network(f58bb855-be1b-4895-bc60-5dfa56567d43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce10d70d-84') {{(pid=74190) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 11:48:31 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:31 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:48:31 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 11:48:31 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:31 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'be27efb1-dd65-59f6-9126-bf4115a155e0', '_type': 'linux-noop'}}, row=False) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:48:31 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:31 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:48:31 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-7301235c-74bd-4645-9e55-35d1592f02df tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 11:48:31 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-7301235c-74bd-4645-9e55-35d1592f02df tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 11:48:31 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:31 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:31 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapce10d70d-84, may_exist=True, interface_attrs={}) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:48:31 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapce10d70d-84, col_values=(('qos', UUID('ad014424-cb67-45c2-b0c0-3d6b6e2d1b2b')),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:48:31 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapce10d70d-84, col_values=(('external_ids', {'iface-id': 'ce10d70d-8444-4bd5-adfd-3fc346977282', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:96:2f', 'vm-uuid': '738fc62c-293c-4fee-9943-45033e0f2602'}),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:48:31 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:31 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:48:31 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-7301235c-74bd-4645-9e55-35d1592f02df tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.401s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:48:31 user nova-compute[74190]: DEBUG nova.compute.manager [None req-7301235c-74bd-4645-9e55-35d1592f02df tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Start building networks asynchronously for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 11:48:31 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:31 user nova-compute[74190]: INFO os_vif [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:96:2f,bridge_name='br-int',has_traffic_filtering=True,id=ce10d70d-8444-4bd5-adfd-3fc346977282,network=Network(f58bb855-be1b-4895-bc60-5dfa56567d43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce10d70d-84')
Oct 18 11:48:31 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T11:46:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-715503398',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-715503398',id=14,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMFpglyECgkSZCauSo+LpQ8kghak5rJ79yWsbPSUEUra2V1BlBnNGH3ZXW5cAirt4aWQbSHcbATh7XVRNu0y4Kp/t+Zl9kT2K9mylFwo4S9K+opZiH0NySN8uxFcXBdtwA==',key_name='tempest-keypair-1606519092',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='53275b2e537640b59e1bb6bcb8368780',ramdisk_id='',reservation_id='r-jnq2b4co',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-553106169',owner_user_name='tempest-TaggedBootDevicesTest_v242-553106169-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:47:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9a4dc36419840d2ae7eac09cbeeea9b',uuid=738fc62c-293c-4fee-9943-45033e0f2602,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "644ec7e2-9907-4ecb-8d84-95b2ae66d866", "address": "fa:16:3e:c2:8f:71", "network": {"id": "f58bb855-be1b-4895-bc60-5dfa56567d43", "bridge": "br-int", "label": "tempest-device-tagging-net2-1711719607", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "53275b2e537640b59e1bb6bcb8368780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap644ec7e2-99", "ovs_interfaceid": "644ec7e2-9907-4ecb-8d84-95b2ae66d866", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 11:48:31 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Converting VIF {"id": "644ec7e2-9907-4ecb-8d84-95b2ae66d866", "address": "fa:16:3e:c2:8f:71", "network": {"id": "f58bb855-be1b-4895-bc60-5dfa56567d43", "bridge": "br-int", "label": "tempest-device-tagging-net2-1711719607", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "53275b2e537640b59e1bb6bcb8368780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap644ec7e2-99", "ovs_interfaceid": "644ec7e2-9907-4ecb-8d84-95b2ae66d866", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:48:31 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:8f:71,bridge_name='br-int',has_traffic_filtering=True,id=644ec7e2-9907-4ecb-8d84-95b2ae66d866,network=Network(f58bb855-be1b-4895-bc60-5dfa56567d43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap644ec7e2-99') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:48:31 user nova-compute[74190]: DEBUG os_vif [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:8f:71,bridge_name='br-int',has_traffic_filtering=True,id=644ec7e2-9907-4ecb-8d84-95b2ae66d866,network=Network(f58bb855-be1b-4895-bc60-5dfa56567d43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap644ec7e2-99') {{(pid=74190) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 11:48:31 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:31 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:48:31 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 11:48:31 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:31 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ad334578-1ed0-5a60-a757-33410b58b58f', '_type': 'linux-noop'}}, row=False) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:48:31 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:31 user nova-compute[74190]: DEBUG nova.compute.manager [None req-7301235c-74bd-4645-9e55-35d1592f02df tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Allocating IP information in the background. {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 11:48:31 user nova-compute[74190]: DEBUG nova.network.neutron [None req-7301235c-74bd-4645-9e55-35d1592f02df tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] allocate_for_instance() {{(pid=74190) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 11:48:31 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:48:31 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-7301235c-74bd-4645-9e55-35d1592f02df tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 11:48:31 user nova-compute[74190]: DEBUG nova.compute.manager [None req-7301235c-74bd-4645-9e55-35d1592f02df tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Start building block device mappings for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 11:48:31 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:31 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:31 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap644ec7e2-99, may_exist=True, interface_attrs={}) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:48:31 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap644ec7e2-99, col_values=(('qos', UUID('a7c71ab7-62aa-48a1-bba0-f9c078ec0556')),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:48:31 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap644ec7e2-99, col_values=(('external_ids', {'iface-id': '644ec7e2-9907-4ecb-8d84-95b2ae66d866', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c2:8f:71', 'vm-uuid': '738fc62c-293c-4fee-9943-45033e0f2602'}),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:48:31 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:31 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:48:31 user nova-compute[74190]: DEBUG nova.policy [None req-7301235c-74bd-4645-9e55-35d1592f02df tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '829b310c15b54dc7836d0b9d7fd757ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548640fa718f4fdfa21c1a7783519c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74190) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 11:48:31 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:31 user nova-compute[74190]: INFO os_vif [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:8f:71,bridge_name='br-int',has_traffic_filtering=True,id=644ec7e2-9907-4ecb-8d84-95b2ae66d866,network=Network(f58bb855-be1b-4895-bc60-5dfa56567d43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap644ec7e2-99')
Oct 18 11:48:31 user nova-compute[74190]: DEBUG nova.compute.manager [None req-7301235c-74bd-4645-9e55-35d1592f02df tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Start spawning the instance on the hypervisor. {{(pid=74190) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 11:48:31 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-7301235c-74bd-4645-9e55-35d1592f02df tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Creating instance directory {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 11:48:31 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-7301235c-74bd-4645-9e55-35d1592f02df tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Creating image(s)
Oct 18 11:48:31 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-7301235c-74bd-4645-9e55-35d1592f02df tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Acquiring lock "/opt/stack/data/nova/instances/d90a6ca0-19a6-4221-81b7-0cb05d67f38e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:48:31 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-7301235c-74bd-4645-9e55-35d1592f02df tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Lock "/opt/stack/data/nova/instances/d90a6ca0-19a6-4221-81b7-0cb05d67f38e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:48:31 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-7301235c-74bd-4645-9e55-35d1592f02df tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Lock "/opt/stack/data/nova/instances/d90a6ca0-19a6-4221-81b7-0cb05d67f38e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:48:31 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-7301235c-74bd-4645-9e55-35d1592f02df tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:48:31 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] No BDM found with device name hda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 11:48:31 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 11:48:31 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] No VIF found with MAC fa:16:3e:8c:f3:0b, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 11:48:31 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] No VIF found with MAC fa:16:3e:da:06:44, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 11:48:31 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Using config drive
Oct 18 11:48:31 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-7301235c-74bd-4645-9e55-35d1592f02df tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.225s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:48:31 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-7301235c-74bd-4645-9e55-35d1592f02df tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Acquiring lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:48:31 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-7301235c-74bd-4645-9e55-35d1592f02df tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:48:31 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-7301235c-74bd-4645-9e55-35d1592f02df tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:48:31 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Creating config drive at /opt/stack/data/nova/instances/738fc62c-293c-4fee-9943-45033e0f2602/disk.config
Oct 18 11:48:31 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/738fc62c-293c-4fee-9943-45033e0f2602/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpiblnpnpf {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:48:31 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-7301235c-74bd-4645-9e55-35d1592f02df tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.223s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:48:31 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-7301235c-74bd-4645-9e55-35d1592f02df tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f,backing_fmt=raw /opt/stack/data/nova/instances/d90a6ca0-19a6-4221-81b7-0cb05d67f38e/disk 1073741824 {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:48:31 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/738fc62c-293c-4fee-9943-45033e0f2602/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpiblnpnpf" returned: 0 in 0.076s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:48:31 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-7301235c-74bd-4645-9e55-35d1592f02df tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f,backing_fmt=raw /opt/stack/data/nova/instances/d90a6ca0-19a6-4221-81b7-0cb05d67f38e/disk 1073741824" returned: 0 in 0.056s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:48:31 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-7301235c-74bd-4645-9e55-35d1592f02df tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.285s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:48:31 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-7301235c-74bd-4645-9e55-35d1592f02df tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:48:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-7301235c-74bd-4645-9e55-35d1592f02df tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.204s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:48:32 user nova-compute[74190]: DEBUG nova.virt.disk.api [None req-7301235c-74bd-4645-9e55-35d1592f02df tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d90a6ca0-19a6-4221-81b7-0cb05d67f38e/disk. size=1073741824 {{(pid=74190) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 18 11:48:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-7301235c-74bd-4645-9e55-35d1592f02df tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d90a6ca0-19a6-4221-81b7-0cb05d67f38e/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:48:32 user nova-compute[74190]: DEBUG nova.network.neutron [None req-7301235c-74bd-4645-9e55-35d1592f02df tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Successfully created port: 2d8060bc-84e4-41e2-9e72-42b2159a1d1e {{(pid=74190) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 11:48:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-7301235c-74bd-4645-9e55-35d1592f02df tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d90a6ca0-19a6-4221-81b7-0cb05d67f38e/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:48:32 user nova-compute[74190]: DEBUG nova.virt.disk.api [None req-7301235c-74bd-4645-9e55-35d1592f02df tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Cannot resize image /opt/stack/data/nova/instances/d90a6ca0-19a6-4221-81b7-0cb05d67f38e/disk to a smaller size. {{(pid=74190) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 18 11:48:32 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-7301235c-74bd-4645-9e55-35d1592f02df tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Created local disks {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 11:48:32 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-7301235c-74bd-4645-9e55-35d1592f02df tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Ensure instance console log exists: /opt/stack/data/nova/instances/d90a6ca0-19a6-4221-81b7-0cb05d67f38e/console.log {{(pid=74190) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 11:48:32 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-7301235c-74bd-4645-9e55-35d1592f02df tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:48:32 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-7301235c-74bd-4645-9e55-35d1592f02df tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:48:32 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-7301235c-74bd-4645-9e55-35d1592f02df tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:48:32 user nova-compute[74190]: DEBUG nova.network.neutron [None req-7301235c-74bd-4645-9e55-35d1592f02df tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Successfully updated port: 2d8060bc-84e4-41e2-9e72-42b2159a1d1e {{(pid=74190) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 11:48:32 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-7301235c-74bd-4645-9e55-35d1592f02df tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Acquiring lock "refresh_cache-d90a6ca0-19a6-4221-81b7-0cb05d67f38e" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:48:32 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-7301235c-74bd-4645-9e55-35d1592f02df tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Acquired lock "refresh_cache-d90a6ca0-19a6-4221-81b7-0cb05d67f38e" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:48:32 user nova-compute[74190]: DEBUG nova.network.neutron [None req-7301235c-74bd-4645-9e55-35d1592f02df tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Building network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 11:48:33 user nova-compute[74190]: DEBUG nova.compute.manager [req-7072c747-f371-4ec4-afa9-2ed6a49604f0 req-267589a1-86d3-4236-a1b3-4e7ab137f246 service nova] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Received event network-changed-2d8060bc-84e4-41e2-9e72-42b2159a1d1e {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:48:33 user nova-compute[74190]: DEBUG nova.compute.manager [req-7072c747-f371-4ec4-afa9-2ed6a49604f0 req-267589a1-86d3-4236-a1b3-4e7ab137f246 service nova] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Refreshing instance network info cache due to event network-changed-2d8060bc-84e4-41e2-9e72-42b2159a1d1e. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 11:48:33 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-7072c747-f371-4ec4-afa9-2ed6a49604f0 req-267589a1-86d3-4236-a1b3-4e7ab137f246 service nova] Acquiring lock "refresh_cache-d90a6ca0-19a6-4221-81b7-0cb05d67f38e" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:48:33 user nova-compute[74190]: DEBUG nova.network.neutron [None req-7301235c-74bd-4645-9e55-35d1592f02df tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Instance cache missing network info. {{(pid=74190) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 11:48:33 user nova-compute[74190]: DEBUG nova.network.neutron [None req-7301235c-74bd-4645-9e55-35d1592f02df tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Updating instance_info_cache with network_info: [{"id": "2d8060bc-84e4-41e2-9e72-42b2159a1d1e", "address": "fa:16:3e:6c:a0:e2", "network": {"id": "e6ae8edc-7014-4341-91b2-4c82d72c9bb9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-15434410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548640fa718f4fdfa21c1a7783519c9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d8060bc-84", "ovs_interfaceid": "2d8060bc-84e4-41e2-9e72-42b2159a1d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:48:33 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-7301235c-74bd-4645-9e55-35d1592f02df tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Releasing lock "refresh_cache-d90a6ca0-19a6-4221-81b7-0cb05d67f38e" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:48:33 user nova-compute[74190]: DEBUG nova.compute.manager [None req-7301235c-74bd-4645-9e55-35d1592f02df tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Instance network_info: |[{"id": "2d8060bc-84e4-41e2-9e72-42b2159a1d1e", "address": "fa:16:3e:6c:a0:e2", "network": {"id": "e6ae8edc-7014-4341-91b2-4c82d72c9bb9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-15434410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548640fa718f4fdfa21c1a7783519c9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d8060bc-84", "ovs_interfaceid": "2d8060bc-84e4-41e2-9e72-42b2159a1d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 11:48:33 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-7072c747-f371-4ec4-afa9-2ed6a49604f0 req-267589a1-86d3-4236-a1b3-4e7ab137f246 service nova] Acquired lock "refresh_cache-d90a6ca0-19a6-4221-81b7-0cb05d67f38e" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:48:33 user nova-compute[74190]: DEBUG nova.network.neutron [req-7072c747-f371-4ec4-afa9-2ed6a49604f0 req-267589a1-86d3-4236-a1b3-4e7ab137f246 service nova] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Refreshing network info cache for port 2d8060bc-84e4-41e2-9e72-42b2159a1d1e {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 11:48:33 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-7301235c-74bd-4645-9e55-35d1592f02df tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Start _get_guest_xml network_info=[{"id": "2d8060bc-84e4-41e2-9e72-42b2159a1d1e", "address": "fa:16:3e:6c:a0:e2", "network": {"id": "e6ae8edc-7014-4341-91b2-4c82d72c9bb9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-15434410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548640fa718f4fdfa21c1a7783519c9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d8060bc-84", "ovs_interfaceid": "2d8060bc-84e4-41e2-9e72-42b2159a1d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'image_id': '6e88bbf0-6e78-49a8-b3c5-9453d22a89df'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 11:48:33 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-7301235c-74bd-4645-9e55-35d1592f02df tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:48:33 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-7301235c-74bd-4645-9e55-35d1592f02df tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:48:33 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-7301235c-74bd-4645-9e55-35d1592f02df tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 11:48:33 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-7301235c-74bd-4645-9e55-35d1592f02df tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] CPU controller missing on host. {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 11:48:33 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-7301235c-74bd-4645-9e55-35d1592f02df tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 11:48:33 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-7301235c-74bd-4645-9e55-35d1592f02df tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] CPU controller found on host. {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 11:48:33 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-7301235c-74bd-4645-9e55-35d1592f02df tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74190) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 11:48:33 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-7301235c-74bd-4645-9e55-35d1592f02df tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T11:37:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 11:48:33 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-7301235c-74bd-4645-9e55-35d1592f02df tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Flavor limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 11:48:33 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-7301235c-74bd-4645-9e55-35d1592f02df tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Image limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 11:48:33 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-7301235c-74bd-4645-9e55-35d1592f02df tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Flavor pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 11:48:33 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-7301235c-74bd-4645-9e55-35d1592f02df tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Image pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 11:48:33 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-7301235c-74bd-4645-9e55-35d1592f02df tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 11:48:33 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-7301235c-74bd-4645-9e55-35d1592f02df tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 11:48:33 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-7301235c-74bd-4645-9e55-35d1592f02df tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 11:48:33 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-7301235c-74bd-4645-9e55-35d1592f02df tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Got 1 possible topologies {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 11:48:33 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-7301235c-74bd-4645-9e55-35d1592f02df tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 11:48:33 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-7301235c-74bd-4645-9e55-35d1592f02df tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 11:48:33 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-7301235c-74bd-4645-9e55-35d1592f02df tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:48:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1378919830',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1378919830',id=16,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN/VyCpYe57sZza+zIcDL8lX6OOvHO+LrEprfV8DJYOtk4t8fMJlRU0klieaFBHD4cS9lGee5DWDaQGdYbzBF339L3I7vrfQc+lY8v5MadYTacmbDVCw1jMPM0jY/aL4cw==',key_name='tempest-keypair-1365040796',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='548640fa718f4fdfa21c1a7783519c9f',ramdisk_id='',reservation_id='r-eukfw0x8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-83921126',owner_user_name='tempest-AttachVolumeShelveTestJSON-83921126-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:48:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='829b310c15b54dc7836d0b9d7fd757ed',uuid=d90a6ca0-19a6-4221-81b7-0cb05d67f38e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d8060bc-84e4-41e2-9e72-42b2159a1d1e", "address": "fa:16:3e:6c:a0:e2", "network": {"id": "e6ae8edc-7014-4341-91b2-4c82d72c9bb9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-15434410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548640fa718f4fdfa21c1a7783519c9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d8060bc-84", "ovs_interfaceid": "2d8060bc-84e4-41e2-9e72-42b2159a1d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74190) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 11:48:33 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-7301235c-74bd-4645-9e55-35d1592f02df tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Converting VIF {"id": "2d8060bc-84e4-41e2-9e72-42b2159a1d1e", "address": "fa:16:3e:6c:a0:e2", "network": {"id": "e6ae8edc-7014-4341-91b2-4c82d72c9bb9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-15434410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548640fa718f4fdfa21c1a7783519c9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d8060bc-84", "ovs_interfaceid": "2d8060bc-84e4-41e2-9e72-42b2159a1d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:48:33 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-7301235c-74bd-4645-9e55-35d1592f02df tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:a0:e2,bridge_name='br-int',has_traffic_filtering=True,id=2d8060bc-84e4-41e2-9e72-42b2159a1d1e,network=Network(e6ae8edc-7014-4341-91b2-4c82d72c9bb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d8060bc-84') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:48:33 user nova-compute[74190]: DEBUG nova.objects.instance [None req-7301235c-74bd-4645-9e55-35d1592f02df tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Lazy-loading 'pci_devices' on Instance uuid d90a6ca0-19a6-4221-81b7-0cb05d67f38e {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:48:33 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-7301235c-74bd-4645-9e55-35d1592f02df tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] End _get_guest_xml xml=<domain type="kvm">
Oct 18 11:48:33 user nova-compute[74190]:   <uuid>d90a6ca0-19a6-4221-81b7-0cb05d67f38e</uuid>
Oct 18 11:48:33 user nova-compute[74190]:   <name>instance-00000010</name>
Oct 18 11:48:33 user nova-compute[74190]:   <memory>524288</memory>
Oct 18 11:48:33 user nova-compute[74190]:   <vcpu>1</vcpu>
Oct 18 11:48:33 user nova-compute[74190]:   <metadata>
Oct 18 11:48:33 user nova-compute[74190]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 11:48:33 user nova-compute[74190]:       <nova:package version="0.0.0"/>
Oct 18 11:48:33 user nova-compute[74190]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1378919830</nova:name>
Oct 18 11:48:33 user nova-compute[74190]:       <nova:creationTime>2023-10-18 11:48:33</nova:creationTime>
Oct 18 11:48:33 user nova-compute[74190]:       <nova:flavor name="m1.tiny">
Oct 18 11:48:33 user nova-compute[74190]:         <nova:memory>512</nova:memory>
Oct 18 11:48:33 user nova-compute[74190]:         <nova:disk>1</nova:disk>
Oct 18 11:48:33 user nova-compute[74190]:         <nova:swap>0</nova:swap>
Oct 18 11:48:33 user nova-compute[74190]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 11:48:33 user nova-compute[74190]:         <nova:vcpus>1</nova:vcpus>
Oct 18 11:48:33 user nova-compute[74190]:       </nova:flavor>
Oct 18 11:48:33 user nova-compute[74190]:       <nova:owner>
Oct 18 11:48:33 user nova-compute[74190]:         <nova:user uuid="829b310c15b54dc7836d0b9d7fd757ed">tempest-AttachVolumeShelveTestJSON-83921126-project-member</nova:user>
Oct 18 11:48:33 user nova-compute[74190]:         <nova:project uuid="548640fa718f4fdfa21c1a7783519c9f">tempest-AttachVolumeShelveTestJSON-83921126</nova:project>
Oct 18 11:48:33 user nova-compute[74190]:       </nova:owner>
Oct 18 11:48:33 user nova-compute[74190]:       <nova:root type="image" uuid="6e88bbf0-6e78-49a8-b3c5-9453d22a89df"/>
Oct 18 11:48:33 user nova-compute[74190]:       <nova:ports>
Oct 18 11:48:33 user nova-compute[74190]:         <nova:port uuid="2d8060bc-84e4-41e2-9e72-42b2159a1d1e">
Oct 18 11:48:33 user nova-compute[74190]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 18 11:48:33 user nova-compute[74190]:         </nova:port>
Oct 18 11:48:33 user nova-compute[74190]:       </nova:ports>
Oct 18 11:48:33 user nova-compute[74190]:     </nova:instance>
Oct 18 11:48:33 user nova-compute[74190]:   </metadata>
Oct 18 11:48:33 user nova-compute[74190]:   <sysinfo type="smbios">
Oct 18 11:48:33 user nova-compute[74190]:     <system>
Oct 18 11:48:33 user nova-compute[74190]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 11:48:33 user nova-compute[74190]:       <entry name="product">OpenStack Nova</entry>
Oct 18 11:48:33 user nova-compute[74190]:       <entry name="version">0.0.0</entry>
Oct 18 11:48:33 user nova-compute[74190]:       <entry name="serial">d90a6ca0-19a6-4221-81b7-0cb05d67f38e</entry>
Oct 18 11:48:33 user nova-compute[74190]:       <entry name="uuid">d90a6ca0-19a6-4221-81b7-0cb05d67f38e</entry>
Oct 18 11:48:33 user nova-compute[74190]:       <entry name="family">Virtual Machine</entry>
Oct 18 11:48:33 user nova-compute[74190]:     </system>
Oct 18 11:48:33 user nova-compute[74190]:   </sysinfo>
Oct 18 11:48:33 user nova-compute[74190]:   <os>
Oct 18 11:48:33 user nova-compute[74190]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 11:48:33 user nova-compute[74190]:     <boot dev="hd"/>
Oct 18 11:48:33 user nova-compute[74190]:     <smbios mode="sysinfo"/>
Oct 18 11:48:33 user nova-compute[74190]:   </os>
Oct 18 11:48:33 user nova-compute[74190]:   <features>
Oct 18 11:48:33 user nova-compute[74190]:     <acpi/>
Oct 18 11:48:33 user nova-compute[74190]:     <apic/>
Oct 18 11:48:33 user nova-compute[74190]:     <vmcoreinfo/>
Oct 18 11:48:33 user nova-compute[74190]:   </features>
Oct 18 11:48:33 user nova-compute[74190]:   <clock offset="utc">
Oct 18 11:48:33 user nova-compute[74190]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 11:48:33 user nova-compute[74190]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 11:48:33 user nova-compute[74190]:     <timer name="hpet" present="no"/>
Oct 18 11:48:33 user nova-compute[74190]:   </clock>
Oct 18 11:48:33 user nova-compute[74190]:   <cpu mode="custom" match="exact">
Oct 18 11:48:33 user nova-compute[74190]:     <model>Nehalem</model>
Oct 18 11:48:33 user nova-compute[74190]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 11:48:33 user nova-compute[74190]:   </cpu>
Oct 18 11:48:33 user nova-compute[74190]:   <devices>
Oct 18 11:48:33 user nova-compute[74190]:     <disk type="file" device="disk">
Oct 18 11:48:33 user nova-compute[74190]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 11:48:33 user nova-compute[74190]:       <source file="/opt/stack/data/nova/instances/d90a6ca0-19a6-4221-81b7-0cb05d67f38e/disk"/>
Oct 18 11:48:33 user nova-compute[74190]:       <target dev="vda" bus="virtio"/>
Oct 18 11:48:33 user nova-compute[74190]:     </disk>
Oct 18 11:48:33 user nova-compute[74190]:     <interface type="ethernet">
Oct 18 11:48:33 user nova-compute[74190]:       <mac address="fa:16:3e:6c:a0:e2"/>
Oct 18 11:48:33 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:48:33 user nova-compute[74190]:       <mtu size="1442"/>
Oct 18 11:48:33 user nova-compute[74190]:       <target dev="tap2d8060bc-84"/>
Oct 18 11:48:33 user nova-compute[74190]:     </interface>
Oct 18 11:48:33 user nova-compute[74190]:     <serial type="pty">
Oct 18 11:48:33 user nova-compute[74190]:       <log file="/opt/stack/data/nova/instances/d90a6ca0-19a6-4221-81b7-0cb05d67f38e/console.log" append="off"/>
Oct 18 11:48:33 user nova-compute[74190]:     </serial>
Oct 18 11:48:33 user nova-compute[74190]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 11:48:33 user nova-compute[74190]:     <video>
Oct 18 11:48:33 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:48:33 user nova-compute[74190]:     </video>
Oct 18 11:48:33 user nova-compute[74190]:     <rng model="virtio">
Oct 18 11:48:33 user nova-compute[74190]:       <backend model="random">/dev/urandom</backend>
Oct 18 11:48:33 user nova-compute[74190]:     </rng>
Oct 18 11:48:33 user nova-compute[74190]:     <controller type="usb" index="0" model="none"/>
Oct 18 11:48:33 user nova-compute[74190]:     <memballoon model="virtio">
Oct 18 11:48:33 user nova-compute[74190]:       <stats period="10"/>
Oct 18 11:48:33 user nova-compute[74190]:     </memballoon>
Oct 18 11:48:33 user nova-compute[74190]:   </devices>
Oct 18 11:48:33 user nova-compute[74190]: </domain>
Oct 18 11:48:33 user nova-compute[74190]:  {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 11:48:33 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-7301235c-74bd-4645-9e55-35d1592f02df tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:48:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1378919830',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1378919830',id=16,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN/VyCpYe57sZza+zIcDL8lX6OOvHO+LrEprfV8DJYOtk4t8fMJlRU0klieaFBHD4cS9lGee5DWDaQGdYbzBF339L3I7vrfQc+lY8v5MadYTacmbDVCw1jMPM0jY/aL4cw==',key_name='tempest-keypair-1365040796',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='548640fa718f4fdfa21c1a7783519c9f',ramdisk_id='',reservation_id='r-eukfw0x8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-83921126',owner_user_name='tempest-AttachVolumeShelveTestJSON-83921126-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:48:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='829b310c15b54dc7836d0b9d7fd757ed',uuid=d90a6ca0-19a6-4221-81b7-0cb05d67f38e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d8060bc-84e4-41e2-9e72-42b2159a1d1e", "address": "fa:16:3e:6c:a0:e2", "network": {"id": "e6ae8edc-7014-4341-91b2-4c82d72c9bb9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-15434410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548640fa718f4fdfa21c1a7783519c9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d8060bc-84", "ovs_interfaceid": "2d8060bc-84e4-41e2-9e72-42b2159a1d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 11:48:33 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-7301235c-74bd-4645-9e55-35d1592f02df tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Converting VIF {"id": "2d8060bc-84e4-41e2-9e72-42b2159a1d1e", "address": "fa:16:3e:6c:a0:e2", "network": {"id": "e6ae8edc-7014-4341-91b2-4c82d72c9bb9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-15434410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548640fa718f4fdfa21c1a7783519c9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d8060bc-84", "ovs_interfaceid": "2d8060bc-84e4-41e2-9e72-42b2159a1d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:48:33 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-7301235c-74bd-4645-9e55-35d1592f02df tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:a0:e2,bridge_name='br-int',has_traffic_filtering=True,id=2d8060bc-84e4-41e2-9e72-42b2159a1d1e,network=Network(e6ae8edc-7014-4341-91b2-4c82d72c9bb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d8060bc-84') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:48:33 user nova-compute[74190]: DEBUG os_vif [None req-7301235c-74bd-4645-9e55-35d1592f02df tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:a0:e2,bridge_name='br-int',has_traffic_filtering=True,id=2d8060bc-84e4-41e2-9e72-42b2159a1d1e,network=Network(e6ae8edc-7014-4341-91b2-4c82d72c9bb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d8060bc-84') {{(pid=74190) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 11:48:33 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:33 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:48:33 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 11:48:33 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:33 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ff472df0-1156-5a76-b5f5-151417eb2037', '_type': 'linux-noop'}}, row=False) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:48:33 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:33 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:48:33 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:33 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:33 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:33 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:33 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:33 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2d8060bc-84, may_exist=True, interface_attrs={}) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:48:33 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2d8060bc-84, col_values=(('qos', UUID('be660ebe-4072-4345-a96a-3f3f5b57bee4')),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:48:33 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2d8060bc-84, col_values=(('external_ids', {'iface-id': '2d8060bc-84e4-41e2-9e72-42b2159a1d1e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:a0:e2', 'vm-uuid': 'd90a6ca0-19a6-4221-81b7-0cb05d67f38e'}),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:48:33 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:33 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:48:33 user nova-compute[74190]: DEBUG nova.compute.manager [req-242b4703-6f75-47b8-86cb-cdc8d1af0e83 req-588820f2-37b5-4ddd-a2b2-dcee23761ba8 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Received event network-vif-plugged-e00eb1ac-378c-4d70-9936-d90df4c9cfbb {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:48:33 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-242b4703-6f75-47b8-86cb-cdc8d1af0e83 req-588820f2-37b5-4ddd-a2b2-dcee23761ba8 service nova] Acquiring lock "738fc62c-293c-4fee-9943-45033e0f2602-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:48:33 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-242b4703-6f75-47b8-86cb-cdc8d1af0e83 req-588820f2-37b5-4ddd-a2b2-dcee23761ba8 service nova] Lock "738fc62c-293c-4fee-9943-45033e0f2602-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:48:33 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-242b4703-6f75-47b8-86cb-cdc8d1af0e83 req-588820f2-37b5-4ddd-a2b2-dcee23761ba8 service nova] Lock "738fc62c-293c-4fee-9943-45033e0f2602-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:48:33 user nova-compute[74190]: DEBUG nova.compute.manager [req-242b4703-6f75-47b8-86cb-cdc8d1af0e83 req-588820f2-37b5-4ddd-a2b2-dcee23761ba8 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] No waiting events found dispatching network-vif-plugged-e00eb1ac-378c-4d70-9936-d90df4c9cfbb {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:48:33 user nova-compute[74190]: WARNING nova.compute.manager [req-242b4703-6f75-47b8-86cb-cdc8d1af0e83 req-588820f2-37b5-4ddd-a2b2-dcee23761ba8 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Received unexpected event network-vif-plugged-e00eb1ac-378c-4d70-9936-d90df4c9cfbb for instance with vm_state building and task_state spawning.
Oct 18 11:48:33 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:33 user nova-compute[74190]: INFO os_vif [None req-7301235c-74bd-4645-9e55-35d1592f02df tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:a0:e2,bridge_name='br-int',has_traffic_filtering=True,id=2d8060bc-84e4-41e2-9e72-42b2159a1d1e,network=Network(e6ae8edc-7014-4341-91b2-4c82d72c9bb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d8060bc-84')
Oct 18 11:48:33 user nova-compute[74190]: DEBUG nova.network.neutron [req-7072c747-f371-4ec4-afa9-2ed6a49604f0 req-267589a1-86d3-4236-a1b3-4e7ab137f246 service nova] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Updated VIF entry in instance network info cache for port 2d8060bc-84e4-41e2-9e72-42b2159a1d1e. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 11:48:33 user nova-compute[74190]: DEBUG nova.network.neutron [req-7072c747-f371-4ec4-afa9-2ed6a49604f0 req-267589a1-86d3-4236-a1b3-4e7ab137f246 service nova] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Updating instance_info_cache with network_info: [{"id": "2d8060bc-84e4-41e2-9e72-42b2159a1d1e", "address": "fa:16:3e:6c:a0:e2", "network": {"id": "e6ae8edc-7014-4341-91b2-4c82d72c9bb9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-15434410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548640fa718f4fdfa21c1a7783519c9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d8060bc-84", "ovs_interfaceid": "2d8060bc-84e4-41e2-9e72-42b2159a1d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:48:33 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-7072c747-f371-4ec4-afa9-2ed6a49604f0 req-267589a1-86d3-4236-a1b3-4e7ab137f246 service nova] Releasing lock "refresh_cache-d90a6ca0-19a6-4221-81b7-0cb05d67f38e" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:48:33 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-7301235c-74bd-4645-9e55-35d1592f02df tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] No BDM found with device name vda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 11:48:33 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-7301235c-74bd-4645-9e55-35d1592f02df tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] No VIF found with MAC fa:16:3e:6c:a0:e2, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 11:48:33 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:35 user nova-compute[74190]: DEBUG nova.compute.manager [req-421ab491-e02b-4868-b4f2-aa990a1dd6fd req-4d4a0b91-3261-4a58-a558-42583dc9d092 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Received event network-vif-plugged-44bc05d9-08bc-49ab-80a4-ee736c201a4b {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:48:35 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-421ab491-e02b-4868-b4f2-aa990a1dd6fd req-4d4a0b91-3261-4a58-a558-42583dc9d092 service nova] Acquiring lock "738fc62c-293c-4fee-9943-45033e0f2602-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:48:35 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-421ab491-e02b-4868-b4f2-aa990a1dd6fd req-4d4a0b91-3261-4a58-a558-42583dc9d092 service nova] Lock "738fc62c-293c-4fee-9943-45033e0f2602-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:48:35 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-421ab491-e02b-4868-b4f2-aa990a1dd6fd req-4d4a0b91-3261-4a58-a558-42583dc9d092 service nova] Lock "738fc62c-293c-4fee-9943-45033e0f2602-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:48:35 user nova-compute[74190]: DEBUG nova.compute.manager [req-421ab491-e02b-4868-b4f2-aa990a1dd6fd req-4d4a0b91-3261-4a58-a558-42583dc9d092 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] No waiting events found dispatching network-vif-plugged-44bc05d9-08bc-49ab-80a4-ee736c201a4b {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:48:35 user nova-compute[74190]: WARNING nova.compute.manager [req-421ab491-e02b-4868-b4f2-aa990a1dd6fd req-4d4a0b91-3261-4a58-a558-42583dc9d092 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Received unexpected event network-vif-plugged-44bc05d9-08bc-49ab-80a4-ee736c201a4b for instance with vm_state building and task_state spawning.
Oct 18 11:48:35 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:35 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:35 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:35 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:35 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:35 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:35 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:35 user nova-compute[74190]: DEBUG nova.compute.manager [req-abf135dc-e5fd-48f2-b478-7eb36143ae5d req-e06350ab-c2d4-4e8e-8404-32cc26d17791 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Received event network-vif-plugged-e00eb1ac-378c-4d70-9936-d90df4c9cfbb {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:48:35 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-abf135dc-e5fd-48f2-b478-7eb36143ae5d req-e06350ab-c2d4-4e8e-8404-32cc26d17791 service nova] Acquiring lock "738fc62c-293c-4fee-9943-45033e0f2602-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:48:35 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-abf135dc-e5fd-48f2-b478-7eb36143ae5d req-e06350ab-c2d4-4e8e-8404-32cc26d17791 service nova] Lock "738fc62c-293c-4fee-9943-45033e0f2602-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:48:35 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-abf135dc-e5fd-48f2-b478-7eb36143ae5d req-e06350ab-c2d4-4e8e-8404-32cc26d17791 service nova] Lock "738fc62c-293c-4fee-9943-45033e0f2602-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:48:35 user nova-compute[74190]: DEBUG nova.compute.manager [req-abf135dc-e5fd-48f2-b478-7eb36143ae5d req-e06350ab-c2d4-4e8e-8404-32cc26d17791 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] No waiting events found dispatching network-vif-plugged-e00eb1ac-378c-4d70-9936-d90df4c9cfbb {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:48:35 user nova-compute[74190]: WARNING nova.compute.manager [req-abf135dc-e5fd-48f2-b478-7eb36143ae5d req-e06350ab-c2d4-4e8e-8404-32cc26d17791 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Received unexpected event network-vif-plugged-e00eb1ac-378c-4d70-9936-d90df4c9cfbb for instance with vm_state building and task_state spawning.
Oct 18 11:48:35 user nova-compute[74190]: DEBUG nova.compute.manager [req-abf135dc-e5fd-48f2-b478-7eb36143ae5d req-e06350ab-c2d4-4e8e-8404-32cc26d17791 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Received event network-vif-plugged-906d428b-8be9-4ac1-ac30-4f48a5448c11 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:48:35 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-abf135dc-e5fd-48f2-b478-7eb36143ae5d req-e06350ab-c2d4-4e8e-8404-32cc26d17791 service nova] Acquiring lock "738fc62c-293c-4fee-9943-45033e0f2602-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:48:35 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-abf135dc-e5fd-48f2-b478-7eb36143ae5d req-e06350ab-c2d4-4e8e-8404-32cc26d17791 service nova] Lock "738fc62c-293c-4fee-9943-45033e0f2602-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:48:35 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-abf135dc-e5fd-48f2-b478-7eb36143ae5d req-e06350ab-c2d4-4e8e-8404-32cc26d17791 service nova] Lock "738fc62c-293c-4fee-9943-45033e0f2602-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:48:35 user nova-compute[74190]: DEBUG nova.compute.manager [req-abf135dc-e5fd-48f2-b478-7eb36143ae5d req-e06350ab-c2d4-4e8e-8404-32cc26d17791 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] No waiting events found dispatching network-vif-plugged-906d428b-8be9-4ac1-ac30-4f48a5448c11 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:48:35 user nova-compute[74190]: WARNING nova.compute.manager [req-abf135dc-e5fd-48f2-b478-7eb36143ae5d req-e06350ab-c2d4-4e8e-8404-32cc26d17791 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Received unexpected event network-vif-plugged-906d428b-8be9-4ac1-ac30-4f48a5448c11 for instance with vm_state building and task_state spawning.
Oct 18 11:48:35 user nova-compute[74190]: DEBUG nova.compute.manager [req-abf135dc-e5fd-48f2-b478-7eb36143ae5d req-e06350ab-c2d4-4e8e-8404-32cc26d17791 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Received event network-vif-plugged-906d428b-8be9-4ac1-ac30-4f48a5448c11 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:48:35 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-abf135dc-e5fd-48f2-b478-7eb36143ae5d req-e06350ab-c2d4-4e8e-8404-32cc26d17791 service nova] Acquiring lock "738fc62c-293c-4fee-9943-45033e0f2602-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:48:35 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-abf135dc-e5fd-48f2-b478-7eb36143ae5d req-e06350ab-c2d4-4e8e-8404-32cc26d17791 service nova] Lock "738fc62c-293c-4fee-9943-45033e0f2602-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:48:35 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-abf135dc-e5fd-48f2-b478-7eb36143ae5d req-e06350ab-c2d4-4e8e-8404-32cc26d17791 service nova] Lock "738fc62c-293c-4fee-9943-45033e0f2602-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:48:35 user nova-compute[74190]: DEBUG nova.compute.manager [req-abf135dc-e5fd-48f2-b478-7eb36143ae5d req-e06350ab-c2d4-4e8e-8404-32cc26d17791 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] No waiting events found dispatching network-vif-plugged-906d428b-8be9-4ac1-ac30-4f48a5448c11 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:48:35 user nova-compute[74190]: WARNING nova.compute.manager [req-abf135dc-e5fd-48f2-b478-7eb36143ae5d req-e06350ab-c2d4-4e8e-8404-32cc26d17791 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Received unexpected event network-vif-plugged-906d428b-8be9-4ac1-ac30-4f48a5448c11 for instance with vm_state building and task_state spawning.
Oct 18 11:48:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:36 user nova-compute[74190]: DEBUG nova.compute.manager [req-508d7020-12a1-4a46-8087-963e868e9573 req-41078624-d414-4e6b-aa23-afc10c305260 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Received event network-vif-plugged-cfde954f-7659-43ce-a771-b817aef06692 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:48:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-508d7020-12a1-4a46-8087-963e868e9573 req-41078624-d414-4e6b-aa23-afc10c305260 service nova] Acquiring lock "738fc62c-293c-4fee-9943-45033e0f2602-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:48:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-508d7020-12a1-4a46-8087-963e868e9573 req-41078624-d414-4e6b-aa23-afc10c305260 service nova] Lock "738fc62c-293c-4fee-9943-45033e0f2602-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:48:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-508d7020-12a1-4a46-8087-963e868e9573 req-41078624-d414-4e6b-aa23-afc10c305260 service nova] Lock "738fc62c-293c-4fee-9943-45033e0f2602-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:48:36 user nova-compute[74190]: DEBUG nova.compute.manager [req-508d7020-12a1-4a46-8087-963e868e9573 req-41078624-d414-4e6b-aa23-afc10c305260 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] No waiting events found dispatching network-vif-plugged-cfde954f-7659-43ce-a771-b817aef06692 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:48:36 user nova-compute[74190]: WARNING nova.compute.manager [req-508d7020-12a1-4a46-8087-963e868e9573 req-41078624-d414-4e6b-aa23-afc10c305260 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Received unexpected event network-vif-plugged-cfde954f-7659-43ce-a771-b817aef06692 for instance with vm_state building and task_state spawning.
Oct 18 11:48:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:37 user nova-compute[74190]: DEBUG nova.compute.manager [req-f974b764-5c77-4c53-a5e6-9378ad4a1693 req-f942a890-dd94-454e-93cf-3104e5a3fe82 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Received event network-vif-plugged-44bc05d9-08bc-49ab-80a4-ee736c201a4b {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:48:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-f974b764-5c77-4c53-a5e6-9378ad4a1693 req-f942a890-dd94-454e-93cf-3104e5a3fe82 service nova] Acquiring lock "738fc62c-293c-4fee-9943-45033e0f2602-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:48:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-f974b764-5c77-4c53-a5e6-9378ad4a1693 req-f942a890-dd94-454e-93cf-3104e5a3fe82 service nova] Lock "738fc62c-293c-4fee-9943-45033e0f2602-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:48:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-f974b764-5c77-4c53-a5e6-9378ad4a1693 req-f942a890-dd94-454e-93cf-3104e5a3fe82 service nova] Lock "738fc62c-293c-4fee-9943-45033e0f2602-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:48:37 user nova-compute[74190]: DEBUG nova.compute.manager [req-f974b764-5c77-4c53-a5e6-9378ad4a1693 req-f942a890-dd94-454e-93cf-3104e5a3fe82 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] No waiting events found dispatching network-vif-plugged-44bc05d9-08bc-49ab-80a4-ee736c201a4b {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:48:37 user nova-compute[74190]: WARNING nova.compute.manager [req-f974b764-5c77-4c53-a5e6-9378ad4a1693 req-f942a890-dd94-454e-93cf-3104e5a3fe82 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Received unexpected event network-vif-plugged-44bc05d9-08bc-49ab-80a4-ee736c201a4b for instance with vm_state building and task_state spawning.
Oct 18 11:48:37 user nova-compute[74190]: DEBUG nova.compute.manager [req-f974b764-5c77-4c53-a5e6-9378ad4a1693 req-f942a890-dd94-454e-93cf-3104e5a3fe82 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Received event network-vif-plugged-1a3a415f-eace-4edd-8643-565472342393 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:48:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-f974b764-5c77-4c53-a5e6-9378ad4a1693 req-f942a890-dd94-454e-93cf-3104e5a3fe82 service nova] Acquiring lock "738fc62c-293c-4fee-9943-45033e0f2602-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:48:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-f974b764-5c77-4c53-a5e6-9378ad4a1693 req-f942a890-dd94-454e-93cf-3104e5a3fe82 service nova] Lock "738fc62c-293c-4fee-9943-45033e0f2602-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:48:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-f974b764-5c77-4c53-a5e6-9378ad4a1693 req-f942a890-dd94-454e-93cf-3104e5a3fe82 service nova] Lock "738fc62c-293c-4fee-9943-45033e0f2602-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:48:37 user nova-compute[74190]: DEBUG nova.compute.manager [req-f974b764-5c77-4c53-a5e6-9378ad4a1693 req-f942a890-dd94-454e-93cf-3104e5a3fe82 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] No waiting events found dispatching network-vif-plugged-1a3a415f-eace-4edd-8643-565472342393 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:48:37 user nova-compute[74190]: WARNING nova.compute.manager [req-f974b764-5c77-4c53-a5e6-9378ad4a1693 req-f942a890-dd94-454e-93cf-3104e5a3fe82 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Received unexpected event network-vif-plugged-1a3a415f-eace-4edd-8643-565472342393 for instance with vm_state building and task_state spawning.
Oct 18 11:48:37 user nova-compute[74190]: DEBUG nova.compute.manager [req-f974b764-5c77-4c53-a5e6-9378ad4a1693 req-f942a890-dd94-454e-93cf-3104e5a3fe82 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Received event network-vif-plugged-1a3a415f-eace-4edd-8643-565472342393 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:48:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-f974b764-5c77-4c53-a5e6-9378ad4a1693 req-f942a890-dd94-454e-93cf-3104e5a3fe82 service nova] Acquiring lock "738fc62c-293c-4fee-9943-45033e0f2602-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:48:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-f974b764-5c77-4c53-a5e6-9378ad4a1693 req-f942a890-dd94-454e-93cf-3104e5a3fe82 service nova] Lock "738fc62c-293c-4fee-9943-45033e0f2602-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:48:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-f974b764-5c77-4c53-a5e6-9378ad4a1693 req-f942a890-dd94-454e-93cf-3104e5a3fe82 service nova] Lock "738fc62c-293c-4fee-9943-45033e0f2602-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:48:37 user nova-compute[74190]: DEBUG nova.compute.manager [req-f974b764-5c77-4c53-a5e6-9378ad4a1693 req-f942a890-dd94-454e-93cf-3104e5a3fe82 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] No waiting events found dispatching network-vif-plugged-1a3a415f-eace-4edd-8643-565472342393 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:48:37 user nova-compute[74190]: WARNING nova.compute.manager [req-f974b764-5c77-4c53-a5e6-9378ad4a1693 req-f942a890-dd94-454e-93cf-3104e5a3fe82 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Received unexpected event network-vif-plugged-1a3a415f-eace-4edd-8643-565472342393 for instance with vm_state building and task_state spawning.
Oct 18 11:48:37 user nova-compute[74190]: DEBUG nova.compute.manager [req-f974b764-5c77-4c53-a5e6-9378ad4a1693 req-f942a890-dd94-454e-93cf-3104e5a3fe82 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Received event network-vif-plugged-ce10d70d-8444-4bd5-adfd-3fc346977282 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:48:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-f974b764-5c77-4c53-a5e6-9378ad4a1693 req-f942a890-dd94-454e-93cf-3104e5a3fe82 service nova] Acquiring lock "738fc62c-293c-4fee-9943-45033e0f2602-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:48:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-f974b764-5c77-4c53-a5e6-9378ad4a1693 req-f942a890-dd94-454e-93cf-3104e5a3fe82 service nova] Lock "738fc62c-293c-4fee-9943-45033e0f2602-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:48:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-f974b764-5c77-4c53-a5e6-9378ad4a1693 req-f942a890-dd94-454e-93cf-3104e5a3fe82 service nova] Lock "738fc62c-293c-4fee-9943-45033e0f2602-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:48:37 user nova-compute[74190]: DEBUG nova.compute.manager [req-f974b764-5c77-4c53-a5e6-9378ad4a1693 req-f942a890-dd94-454e-93cf-3104e5a3fe82 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] No waiting events found dispatching network-vif-plugged-ce10d70d-8444-4bd5-adfd-3fc346977282 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:48:37 user nova-compute[74190]: WARNING nova.compute.manager [req-f974b764-5c77-4c53-a5e6-9378ad4a1693 req-f942a890-dd94-454e-93cf-3104e5a3fe82 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Received unexpected event network-vif-plugged-ce10d70d-8444-4bd5-adfd-3fc346977282 for instance with vm_state building and task_state spawning.
Oct 18 11:48:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:37 user nova-compute[74190]: INFO nova.compute.manager [None req-924cb902-f3d9-488f-9139-be4407add54f tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Took 10.44 seconds to detach 1 volumes for instance.
Oct 18 11:48:37 user nova-compute[74190]: DEBUG nova.compute.manager [None req-924cb902-f3d9-488f-9139-be4407add54f tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] [instance: 3bd2f6d6-9c07-42a0-869e-566d685cb025] Deleting volume: 2d829820-7b5f-42f9-81ab-8efc923f288a {{(pid=74190) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 18 11:48:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-924cb902-f3d9-488f-9139-be4407add54f tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:48:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-924cb902-f3d9-488f-9139-be4407add54f tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:48:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:38 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:38 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:38 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:38 user nova-compute[74190]: DEBUG nova.compute.manager [req-ae7994ff-79d4-4ee4-a3db-a80e046b759a req-3a186735-b950-4d7e-bb72-1c826ea6f6b0 service nova] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Received event network-vif-plugged-2d8060bc-84e4-41e2-9e72-42b2159a1d1e {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:48:38 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-ae7994ff-79d4-4ee4-a3db-a80e046b759a req-3a186735-b950-4d7e-bb72-1c826ea6f6b0 service nova] Acquiring lock "d90a6ca0-19a6-4221-81b7-0cb05d67f38e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:48:38 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-ae7994ff-79d4-4ee4-a3db-a80e046b759a req-3a186735-b950-4d7e-bb72-1c826ea6f6b0 service nova] Lock "d90a6ca0-19a6-4221-81b7-0cb05d67f38e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:48:38 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-ae7994ff-79d4-4ee4-a3db-a80e046b759a req-3a186735-b950-4d7e-bb72-1c826ea6f6b0 service nova] Lock "d90a6ca0-19a6-4221-81b7-0cb05d67f38e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:48:38 user nova-compute[74190]: DEBUG nova.compute.manager [req-ae7994ff-79d4-4ee4-a3db-a80e046b759a req-3a186735-b950-4d7e-bb72-1c826ea6f6b0 service nova] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] No waiting events found dispatching network-vif-plugged-2d8060bc-84e4-41e2-9e72-42b2159a1d1e {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:48:38 user nova-compute[74190]: WARNING nova.compute.manager [req-ae7994ff-79d4-4ee4-a3db-a80e046b759a req-3a186735-b950-4d7e-bb72-1c826ea6f6b0 service nova] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Received unexpected event network-vif-plugged-2d8060bc-84e4-41e2-9e72-42b2159a1d1e for instance with vm_state building and task_state spawning.
Oct 18 11:48:38 user nova-compute[74190]: DEBUG nova.compute.manager [req-ae7994ff-79d4-4ee4-a3db-a80e046b759a req-3a186735-b950-4d7e-bb72-1c826ea6f6b0 service nova] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Received event network-vif-plugged-2d8060bc-84e4-41e2-9e72-42b2159a1d1e {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:48:38 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-ae7994ff-79d4-4ee4-a3db-a80e046b759a req-3a186735-b950-4d7e-bb72-1c826ea6f6b0 service nova] Acquiring lock "d90a6ca0-19a6-4221-81b7-0cb05d67f38e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:48:38 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-ae7994ff-79d4-4ee4-a3db-a80e046b759a req-3a186735-b950-4d7e-bb72-1c826ea6f6b0 service nova] Lock "d90a6ca0-19a6-4221-81b7-0cb05d67f38e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:48:38 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-ae7994ff-79d4-4ee4-a3db-a80e046b759a req-3a186735-b950-4d7e-bb72-1c826ea6f6b0 service nova] Lock "d90a6ca0-19a6-4221-81b7-0cb05d67f38e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:48:38 user nova-compute[74190]: DEBUG nova.compute.manager [req-ae7994ff-79d4-4ee4-a3db-a80e046b759a req-3a186735-b950-4d7e-bb72-1c826ea6f6b0 service nova] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] No waiting events found dispatching network-vif-plugged-2d8060bc-84e4-41e2-9e72-42b2159a1d1e {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:48:38 user nova-compute[74190]: WARNING nova.compute.manager [req-ae7994ff-79d4-4ee4-a3db-a80e046b759a req-3a186735-b950-4d7e-bb72-1c826ea6f6b0 service nova] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Received unexpected event network-vif-plugged-2d8060bc-84e4-41e2-9e72-42b2159a1d1e for instance with vm_state building and task_state spawning.
Oct 18 11:48:38 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-924cb902-f3d9-488f-9139-be4407add54f tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 11:48:38 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-924cb902-f3d9-488f-9139-be4407add54f tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 11:48:38 user nova-compute[74190]: DEBUG nova.compute.manager [req-4e28daa1-9564-436a-a080-46a62fe344e9 req-34757e3a-d9de-4fdf-af96-f791fed236a1 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Received event network-vif-plugged-cfde954f-7659-43ce-a771-b817aef06692 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:48:38 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-4e28daa1-9564-436a-a080-46a62fe344e9 req-34757e3a-d9de-4fdf-af96-f791fed236a1 service nova] Acquiring lock "738fc62c-293c-4fee-9943-45033e0f2602-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:48:38 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-4e28daa1-9564-436a-a080-46a62fe344e9 req-34757e3a-d9de-4fdf-af96-f791fed236a1 service nova] Lock "738fc62c-293c-4fee-9943-45033e0f2602-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:48:38 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-4e28daa1-9564-436a-a080-46a62fe344e9 req-34757e3a-d9de-4fdf-af96-f791fed236a1 service nova] Lock "738fc62c-293c-4fee-9943-45033e0f2602-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:48:38 user nova-compute[74190]: DEBUG nova.compute.manager [req-4e28daa1-9564-436a-a080-46a62fe344e9 req-34757e3a-d9de-4fdf-af96-f791fed236a1 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] No waiting events found dispatching network-vif-plugged-cfde954f-7659-43ce-a771-b817aef06692 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:48:38 user nova-compute[74190]: WARNING nova.compute.manager [req-4e28daa1-9564-436a-a080-46a62fe344e9 req-34757e3a-d9de-4fdf-af96-f791fed236a1 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Received unexpected event network-vif-plugged-cfde954f-7659-43ce-a771-b817aef06692 for instance with vm_state building and task_state spawning.
Oct 18 11:48:38 user nova-compute[74190]: DEBUG nova.compute.manager [req-4e28daa1-9564-436a-a080-46a62fe344e9 req-34757e3a-d9de-4fdf-af96-f791fed236a1 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Received event network-vif-plugged-644ec7e2-9907-4ecb-8d84-95b2ae66d866 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:48:38 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-4e28daa1-9564-436a-a080-46a62fe344e9 req-34757e3a-d9de-4fdf-af96-f791fed236a1 service nova] Acquiring lock "738fc62c-293c-4fee-9943-45033e0f2602-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:48:38 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-4e28daa1-9564-436a-a080-46a62fe344e9 req-34757e3a-d9de-4fdf-af96-f791fed236a1 service nova] Lock "738fc62c-293c-4fee-9943-45033e0f2602-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:48:38 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-4e28daa1-9564-436a-a080-46a62fe344e9 req-34757e3a-d9de-4fdf-af96-f791fed236a1 service nova] Lock "738fc62c-293c-4fee-9943-45033e0f2602-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:48:38 user nova-compute[74190]: DEBUG nova.compute.manager [req-4e28daa1-9564-436a-a080-46a62fe344e9 req-34757e3a-d9de-4fdf-af96-f791fed236a1 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] No waiting events found dispatching network-vif-plugged-644ec7e2-9907-4ecb-8d84-95b2ae66d866 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:48:38 user nova-compute[74190]: WARNING nova.compute.manager [req-4e28daa1-9564-436a-a080-46a62fe344e9 req-34757e3a-d9de-4fdf-af96-f791fed236a1 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Received unexpected event network-vif-plugged-644ec7e2-9907-4ecb-8d84-95b2ae66d866 for instance with vm_state building and task_state spawning.
Oct 18 11:48:38 user nova-compute[74190]: DEBUG nova.compute.manager [req-4e28daa1-9564-436a-a080-46a62fe344e9 req-34757e3a-d9de-4fdf-af96-f791fed236a1 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Received event network-vif-plugged-644ec7e2-9907-4ecb-8d84-95b2ae66d866 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:48:38 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-4e28daa1-9564-436a-a080-46a62fe344e9 req-34757e3a-d9de-4fdf-af96-f791fed236a1 service nova] Acquiring lock "738fc62c-293c-4fee-9943-45033e0f2602-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:48:38 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-4e28daa1-9564-436a-a080-46a62fe344e9 req-34757e3a-d9de-4fdf-af96-f791fed236a1 service nova] Lock "738fc62c-293c-4fee-9943-45033e0f2602-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:48:38 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-4e28daa1-9564-436a-a080-46a62fe344e9 req-34757e3a-d9de-4fdf-af96-f791fed236a1 service nova] Lock "738fc62c-293c-4fee-9943-45033e0f2602-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:48:38 user nova-compute[74190]: DEBUG nova.compute.manager [req-4e28daa1-9564-436a-a080-46a62fe344e9 req-34757e3a-d9de-4fdf-af96-f791fed236a1 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] No waiting events found dispatching network-vif-plugged-644ec7e2-9907-4ecb-8d84-95b2ae66d866 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:48:38 user nova-compute[74190]: WARNING nova.compute.manager [req-4e28daa1-9564-436a-a080-46a62fe344e9 req-34757e3a-d9de-4fdf-af96-f791fed236a1 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Received unexpected event network-vif-plugged-644ec7e2-9907-4ecb-8d84-95b2ae66d866 for instance with vm_state building and task_state spawning.
Oct 18 11:48:38 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-924cb902-f3d9-488f-9139-be4407add54f tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.749s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:48:38 user nova-compute[74190]: INFO nova.scheduler.client.report [None req-924cb902-f3d9-488f-9139-be4407add54f tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Deleted allocations for instance 3bd2f6d6-9c07-42a0-869e-566d685cb025
Oct 18 11:48:38 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-924cb902-f3d9-488f-9139-be4407add54f tempest-TestShelveInstance-1202197307 tempest-TestShelveInstance-1202197307-project-member] Lock "3bd2f6d6-9c07-42a0-869e-566d685cb025" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 13.692s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:48:38 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:38 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:38 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:39 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:39 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:39 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:39 user nova-compute[74190]: DEBUG nova.compute.manager [req-fe8539b4-640b-486b-a89d-4e6857a45932 req-3cf33a23-56e3-4dcf-9f7c-ad07416d9969 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Received event network-vif-plugged-ce10d70d-8444-4bd5-adfd-3fc346977282 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:48:39 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-fe8539b4-640b-486b-a89d-4e6857a45932 req-3cf33a23-56e3-4dcf-9f7c-ad07416d9969 service nova] Acquiring lock "738fc62c-293c-4fee-9943-45033e0f2602-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:48:39 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-fe8539b4-640b-486b-a89d-4e6857a45932 req-3cf33a23-56e3-4dcf-9f7c-ad07416d9969 service nova] Lock "738fc62c-293c-4fee-9943-45033e0f2602-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:48:39 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-fe8539b4-640b-486b-a89d-4e6857a45932 req-3cf33a23-56e3-4dcf-9f7c-ad07416d9969 service nova] Lock "738fc62c-293c-4fee-9943-45033e0f2602-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:48:39 user nova-compute[74190]: DEBUG nova.compute.manager [req-fe8539b4-640b-486b-a89d-4e6857a45932 req-3cf33a23-56e3-4dcf-9f7c-ad07416d9969 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] No waiting events found dispatching network-vif-plugged-ce10d70d-8444-4bd5-adfd-3fc346977282 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:48:39 user nova-compute[74190]: WARNING nova.compute.manager [req-fe8539b4-640b-486b-a89d-4e6857a45932 req-3cf33a23-56e3-4dcf-9f7c-ad07416d9969 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Received unexpected event network-vif-plugged-ce10d70d-8444-4bd5-adfd-3fc346977282 for instance with vm_state building and task_state spawning.
Oct 18 11:48:39 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:39 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:39 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:40 user nova-compute[74190]: DEBUG nova.compute.manager [None req-7301235c-74bd-4645-9e55-35d1592f02df tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Instance event wait completed in 0 seconds for  {{(pid=74190) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 11:48:40 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-7301235c-74bd-4645-9e55-35d1592f02df tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Guest created on hypervisor {{(pid=74190) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 11:48:40 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Instance spawned successfully.
Oct 18 11:48:40 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-7301235c-74bd-4645-9e55-35d1592f02df tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 11:48:40 user nova-compute[74190]: DEBUG nova.compute.manager [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Instance event wait completed in 0 seconds for  {{(pid=74190) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 11:48:40 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Guest created on hypervisor {{(pid=74190) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 11:48:40 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Instance spawned successfully.
Oct 18 11:48:40 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 11:48:40 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-7301235c-74bd-4645-9e55-35d1592f02df tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Found default for hw_cdrom_bus of ide {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:48:40 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-7301235c-74bd-4645-9e55-35d1592f02df tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Found default for hw_disk_bus of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:48:40 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-7301235c-74bd-4645-9e55-35d1592f02df tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Found default for hw_input_bus of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:48:40 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-7301235c-74bd-4645-9e55-35d1592f02df tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Found default for hw_pointer_model of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:48:40 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-7301235c-74bd-4645-9e55-35d1592f02df tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Found default for hw_video_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:48:40 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-7301235c-74bd-4645-9e55-35d1592f02df tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Found default for hw_vif_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:48:40 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Found default for hw_cdrom_bus of ide {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:48:40 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Found default for hw_disk_bus of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:48:40 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Found default for hw_input_bus of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:48:40 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Found default for hw_pointer_model of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:48:40 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Found default for hw_video_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:48:40 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Found default for hw_vif_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:48:40 user nova-compute[74190]: INFO nova.compute.manager [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Took 14.35 seconds to spawn the instance on the hypervisor.
Oct 18 11:48:40 user nova-compute[74190]: DEBUG nova.compute.manager [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Checking state {{(pid=74190) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 11:48:40 user nova-compute[74190]: INFO nova.compute.manager [None req-7301235c-74bd-4645-9e55-35d1592f02df tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Took 8.99 seconds to spawn the instance on the hypervisor.
Oct 18 11:48:40 user nova-compute[74190]: DEBUG nova.compute.manager [None req-7301235c-74bd-4645-9e55-35d1592f02df tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Checking state {{(pid=74190) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 11:48:40 user nova-compute[74190]: INFO nova.compute.manager [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Took 101.39 seconds to build instance.
Oct 18 11:48:40 user nova-compute[74190]: INFO nova.compute.manager [None req-7301235c-74bd-4645-9e55-35d1592f02df tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Took 9.87 seconds to build instance.
Oct 18 11:48:40 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9d5cc28d-cb36-431e-ae21-df99d6718b7c tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Lock "738fc62c-293c-4fee-9943-45033e0f2602" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 101.557s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:48:40 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-7301235c-74bd-4645-9e55-35d1592f02df tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Lock "d90a6ca0-19a6-4221-81b7-0cb05d67f38e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.988s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:48:41 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:43 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:44 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:47 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:49 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:50 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:52 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:52 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:48:53 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:48:53 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:48:53 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74190) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 11:48:53 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:48:53 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:48:53 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:48:53 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:48:53 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Auditing locally available compute resources for user (node: user) {{(pid=74190) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 11:48:53 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d7b8e5-02cc-4148-86e2-ceb295e81afc/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:48:53 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d7b8e5-02cc-4148-86e2-ceb295e81afc/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:48:53 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d7b8e5-02cc-4148-86e2-ceb295e81afc/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:48:53 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:53 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d7b8e5-02cc-4148-86e2-ceb295e81afc/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:48:53 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 11:48:53 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0209c824-88a7-4976-83bf-8a72437f0cc2/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:48:53 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0209c824-88a7-4976-83bf-8a72437f0cc2/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:48:53 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0209c824-88a7-4976-83bf-8a72437f0cc2/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:48:54 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0209c824-88a7-4976-83bf-8a72437f0cc2/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:48:54 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 11:48:54 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 11:48:54 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 11:48:54 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c280652c-ffde-40f8-a919-adb8be618db8/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:48:54 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:54 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c280652c-ffde-40f8-a919-adb8be618db8/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:48:54 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c280652c-ffde-40f8-a919-adb8be618db8/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:48:54 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c280652c-ffde-40f8-a919-adb8be618db8/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:48:54 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:48:54 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk --force-share --output=json" returned: 0 in 0.328s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:48:54 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:48:55 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:48:55 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d90a6ca0-19a6-4221-81b7-0cb05d67f38e/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:48:55 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d90a6ca0-19a6-4221-81b7-0cb05d67f38e/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:48:55 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d90a6ca0-19a6-4221-81b7-0cb05d67f38e/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:48:55 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d90a6ca0-19a6-4221-81b7-0cb05d67f38e/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:48:55 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdfe420d-f46c-44ad-8773-b675f42e24ed/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:48:55 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdfe420d-f46c-44ad-8773-b675f42e24ed/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:48:55 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdfe420d-f46c-44ad-8773-b675f42e24ed/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:48:56 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdfe420d-f46c-44ad-8773-b675f42e24ed/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:48:56 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:48:56 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:48:56 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Hypervisor/Node resource view: name=user free_ram=8029MB free_disk=25.64590072631836GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74190) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 11:48:56 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:48:56 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:48:56 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance c280652c-ffde-40f8-a919-adb8be618db8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:48:56 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 0209c824-88a7-4976-83bf-8a72437f0cc2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:48:56 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 52d7b8e5-02cc-4148-86e2-ceb295e81afc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:48:56 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance bdfe420d-f46c-44ad-8773-b675f42e24ed actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:48:56 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 738fc62c-293c-4fee-9943-45033e0f2602 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:48:56 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 4e916d24-9f9d-4289-87ce-f65d2499fcd9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:48:56 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance d90a6ca0-19a6-4221-81b7-0cb05d67f38e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:48:56 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 11:48:56 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 11:48:56 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 11:48:56 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 11:48:56 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Compute_service record updated for user:user {{(pid=74190) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 11:48:56 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.445s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:48:57 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:57 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:48:57 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:48:57 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:48:57 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:48:58 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:48:58 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Starting heal instance info cache {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 11:48:58 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "refresh_cache-0209c824-88a7-4976-83bf-8a72437f0cc2" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:48:58 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquired lock "refresh_cache-0209c824-88a7-4976-83bf-8a72437f0cc2" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:48:58 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] Forcefully refreshing network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 18 11:48:58 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:48:58 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] Updating instance_info_cache with network_info: [{"id": "5e4eb783-7e7c-4501-bf99-33472454f4ac", "address": "fa:16:3e:7e:d2:03", "network": {"id": "f5ab7da4-2b07-4465-9a89-a07eb053ba91", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1315695374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08cf52ce927443158aa731367f08bd57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e4eb783-7e", "ovs_interfaceid": "5e4eb783-7e7c-4501-bf99-33472454f4ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:48:58 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Releasing lock "refresh_cache-0209c824-88a7-4976-83bf-8a72437f0cc2" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:48:58 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] Updated the network info_cache for instance {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 18 11:48:59 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:49:00 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:49:00 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:49:01 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:49:03 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-85f27cc0-8c05-40d5-89d1-c5d9f6759aa2 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Acquiring lock "0c11bc6b-303f-427e-a5d4-993acd74bb27" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:49:03 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-85f27cc0-8c05-40d5-89d1-c5d9f6759aa2 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Lock "0c11bc6b-303f-427e-a5d4-993acd74bb27" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:49:03 user nova-compute[74190]: DEBUG nova.compute.manager [None req-85f27cc0-8c05-40d5-89d1-c5d9f6759aa2 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] [instance: 0c11bc6b-303f-427e-a5d4-993acd74bb27] Starting instance... {{(pid=74190) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 11:49:03 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-85f27cc0-8c05-40d5-89d1-c5d9f6759aa2 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:49:03 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-85f27cc0-8c05-40d5-89d1-c5d9f6759aa2 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:49:03 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-85f27cc0-8c05-40d5-89d1-c5d9f6759aa2 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74190) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 11:49:03 user nova-compute[74190]: INFO nova.compute.claims [None req-85f27cc0-8c05-40d5-89d1-c5d9f6759aa2 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] [instance: 0c11bc6b-303f-427e-a5d4-993acd74bb27] Claim successful on node user
Oct 18 11:49:03 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:49:03 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-85f27cc0-8c05-40d5-89d1-c5d9f6759aa2 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 11:49:04 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-85f27cc0-8c05-40d5-89d1-c5d9f6759aa2 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 11:49:04 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-85f27cc0-8c05-40d5-89d1-c5d9f6759aa2 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.466s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:49:04 user nova-compute[74190]: DEBUG nova.compute.manager [None req-85f27cc0-8c05-40d5-89d1-c5d9f6759aa2 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] [instance: 0c11bc6b-303f-427e-a5d4-993acd74bb27] Start building networks asynchronously for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 11:49:04 user nova-compute[74190]: DEBUG nova.compute.manager [None req-85f27cc0-8c05-40d5-89d1-c5d9f6759aa2 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] [instance: 0c11bc6b-303f-427e-a5d4-993acd74bb27] Allocating IP information in the background. {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 11:49:04 user nova-compute[74190]: DEBUG nova.network.neutron [None req-85f27cc0-8c05-40d5-89d1-c5d9f6759aa2 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] [instance: 0c11bc6b-303f-427e-a5d4-993acd74bb27] allocate_for_instance() {{(pid=74190) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 11:49:04 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-85f27cc0-8c05-40d5-89d1-c5d9f6759aa2 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] [instance: 0c11bc6b-303f-427e-a5d4-993acd74bb27] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 11:49:04 user nova-compute[74190]: DEBUG nova.compute.manager [None req-85f27cc0-8c05-40d5-89d1-c5d9f6759aa2 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] [instance: 0c11bc6b-303f-427e-a5d4-993acd74bb27] Start building block device mappings for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 11:49:04 user nova-compute[74190]: DEBUG nova.policy [None req-85f27cc0-8c05-40d5-89d1-c5d9f6759aa2 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd098d8f1d4ad4bfe8b5a4ada891990de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7b038b65b84b819175fe34941d4909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74190) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 11:49:04 user nova-compute[74190]: DEBUG nova.compute.manager [None req-85f27cc0-8c05-40d5-89d1-c5d9f6759aa2 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] [instance: 0c11bc6b-303f-427e-a5d4-993acd74bb27] Start spawning the instance on the hypervisor. {{(pid=74190) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 11:49:04 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-85f27cc0-8c05-40d5-89d1-c5d9f6759aa2 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] [instance: 0c11bc6b-303f-427e-a5d4-993acd74bb27] Creating instance directory {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 11:49:04 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-85f27cc0-8c05-40d5-89d1-c5d9f6759aa2 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] [instance: 0c11bc6b-303f-427e-a5d4-993acd74bb27] Creating image(s)
Oct 18 11:49:04 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-85f27cc0-8c05-40d5-89d1-c5d9f6759aa2 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Acquiring lock "/opt/stack/data/nova/instances/0c11bc6b-303f-427e-a5d4-993acd74bb27/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:49:04 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-85f27cc0-8c05-40d5-89d1-c5d9f6759aa2 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Lock "/opt/stack/data/nova/instances/0c11bc6b-303f-427e-a5d4-993acd74bb27/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:49:04 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-85f27cc0-8c05-40d5-89d1-c5d9f6759aa2 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Lock "/opt/stack/data/nova/instances/0c11bc6b-303f-427e-a5d4-993acd74bb27/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:49:04 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-85f27cc0-8c05-40d5-89d1-c5d9f6759aa2 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:49:04 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:49:04 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:49:04 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-85f27cc0-8c05-40d5-89d1-c5d9f6759aa2 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.249s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:49:04 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-85f27cc0-8c05-40d5-89d1-c5d9f6759aa2 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Acquiring lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:49:04 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-85f27cc0-8c05-40d5-89d1-c5d9f6759aa2 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:49:04 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-85f27cc0-8c05-40d5-89d1-c5d9f6759aa2 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:49:04 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-85f27cc0-8c05-40d5-89d1-c5d9f6759aa2 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.204s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:49:04 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-85f27cc0-8c05-40d5-89d1-c5d9f6759aa2 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f,backing_fmt=raw /opt/stack/data/nova/instances/0c11bc6b-303f-427e-a5d4-993acd74bb27/disk 1073741824 {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:49:04 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-85f27cc0-8c05-40d5-89d1-c5d9f6759aa2 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f,backing_fmt=raw /opt/stack/data/nova/instances/0c11bc6b-303f-427e-a5d4-993acd74bb27/disk 1073741824" returned: 0 in 0.055s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:49:04 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-85f27cc0-8c05-40d5-89d1-c5d9f6759aa2 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:49:04 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-85f27cc0-8c05-40d5-89d1-c5d9f6759aa2 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:49:04 user nova-compute[74190]: DEBUG nova.network.neutron [None req-85f27cc0-8c05-40d5-89d1-c5d9f6759aa2 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] [instance: 0c11bc6b-303f-427e-a5d4-993acd74bb27] Successfully created port: 30366b5a-3e80-4fb4-be78-0fdff62dfcaa {{(pid=74190) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 11:49:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-85f27cc0-8c05-40d5-89d1-c5d9f6759aa2 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.212s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:49:05 user nova-compute[74190]: DEBUG nova.virt.disk.api [None req-85f27cc0-8c05-40d5-89d1-c5d9f6759aa2 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0c11bc6b-303f-427e-a5d4-993acd74bb27/disk. size=1073741824 {{(pid=74190) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 18 11:49:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-85f27cc0-8c05-40d5-89d1-c5d9f6759aa2 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c11bc6b-303f-427e-a5d4-993acd74bb27/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:49:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-85f27cc0-8c05-40d5-89d1-c5d9f6759aa2 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c11bc6b-303f-427e-a5d4-993acd74bb27/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:49:05 user nova-compute[74190]: DEBUG nova.virt.disk.api [None req-85f27cc0-8c05-40d5-89d1-c5d9f6759aa2 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Cannot resize image /opt/stack/data/nova/instances/0c11bc6b-303f-427e-a5d4-993acd74bb27/disk to a smaller size. {{(pid=74190) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 18 11:49:05 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-85f27cc0-8c05-40d5-89d1-c5d9f6759aa2 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] [instance: 0c11bc6b-303f-427e-a5d4-993acd74bb27] Created local disks {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 11:49:05 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-85f27cc0-8c05-40d5-89d1-c5d9f6759aa2 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] [instance: 0c11bc6b-303f-427e-a5d4-993acd74bb27] Ensure instance console log exists: /opt/stack/data/nova/instances/0c11bc6b-303f-427e-a5d4-993acd74bb27/console.log {{(pid=74190) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 11:49:05 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-85f27cc0-8c05-40d5-89d1-c5d9f6759aa2 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:49:05 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-85f27cc0-8c05-40d5-89d1-c5d9f6759aa2 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:49:05 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-85f27cc0-8c05-40d5-89d1-c5d9f6759aa2 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:49:05 user nova-compute[74190]: DEBUG nova.network.neutron [None req-85f27cc0-8c05-40d5-89d1-c5d9f6759aa2 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] [instance: 0c11bc6b-303f-427e-a5d4-993acd74bb27] Successfully updated port: 30366b5a-3e80-4fb4-be78-0fdff62dfcaa {{(pid=74190) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 11:49:05 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-85f27cc0-8c05-40d5-89d1-c5d9f6759aa2 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Acquiring lock "refresh_cache-0c11bc6b-303f-427e-a5d4-993acd74bb27" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:49:05 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-85f27cc0-8c05-40d5-89d1-c5d9f6759aa2 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Acquired lock "refresh_cache-0c11bc6b-303f-427e-a5d4-993acd74bb27" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:49:05 user nova-compute[74190]: DEBUG nova.network.neutron [None req-85f27cc0-8c05-40d5-89d1-c5d9f6759aa2 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] [instance: 0c11bc6b-303f-427e-a5d4-993acd74bb27] Building network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 11:49:05 user nova-compute[74190]: DEBUG nova.compute.manager [req-9adbd7ae-b8de-41e3-a0e4-ea3d83b3a916 req-3b158299-9cae-47f4-b38f-4fafdcf407f9 service nova] [instance: 0c11bc6b-303f-427e-a5d4-993acd74bb27] Received event network-changed-30366b5a-3e80-4fb4-be78-0fdff62dfcaa {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:49:05 user nova-compute[74190]: DEBUG nova.compute.manager [req-9adbd7ae-b8de-41e3-a0e4-ea3d83b3a916 req-3b158299-9cae-47f4-b38f-4fafdcf407f9 service nova] [instance: 0c11bc6b-303f-427e-a5d4-993acd74bb27] Refreshing instance network info cache due to event network-changed-30366b5a-3e80-4fb4-be78-0fdff62dfcaa. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 11:49:05 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-9adbd7ae-b8de-41e3-a0e4-ea3d83b3a916 req-3b158299-9cae-47f4-b38f-4fafdcf407f9 service nova] Acquiring lock "refresh_cache-0c11bc6b-303f-427e-a5d4-993acd74bb27" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:49:05 user nova-compute[74190]: DEBUG nova.network.neutron [None req-85f27cc0-8c05-40d5-89d1-c5d9f6759aa2 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] [instance: 0c11bc6b-303f-427e-a5d4-993acd74bb27] Instance cache missing network info. {{(pid=74190) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 11:49:06 user nova-compute[74190]: DEBUG nova.network.neutron [None req-85f27cc0-8c05-40d5-89d1-c5d9f6759aa2 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] [instance: 0c11bc6b-303f-427e-a5d4-993acd74bb27] Updating instance_info_cache with network_info: [{"id": "30366b5a-3e80-4fb4-be78-0fdff62dfcaa", "address": "fa:16:3e:25:67:c0", "network": {"id": "aeb25e9d-effa-4ae6-9e7e-61915593bb26", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-539764280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e7b038b65b84b819175fe34941d4909", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30366b5a-3e", "ovs_interfaceid": "30366b5a-3e80-4fb4-be78-0fdff62dfcaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:49:06 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-85f27cc0-8c05-40d5-89d1-c5d9f6759aa2 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Releasing lock "refresh_cache-0c11bc6b-303f-427e-a5d4-993acd74bb27" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:49:06 user nova-compute[74190]: DEBUG nova.compute.manager [None req-85f27cc0-8c05-40d5-89d1-c5d9f6759aa2 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] [instance: 0c11bc6b-303f-427e-a5d4-993acd74bb27] Instance network_info: |[{"id": "30366b5a-3e80-4fb4-be78-0fdff62dfcaa", "address": "fa:16:3e:25:67:c0", "network": {"id": "aeb25e9d-effa-4ae6-9e7e-61915593bb26", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-539764280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e7b038b65b84b819175fe34941d4909", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30366b5a-3e", "ovs_interfaceid": "30366b5a-3e80-4fb4-be78-0fdff62dfcaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 11:49:06 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-9adbd7ae-b8de-41e3-a0e4-ea3d83b3a916 req-3b158299-9cae-47f4-b38f-4fafdcf407f9 service nova] Acquired lock "refresh_cache-0c11bc6b-303f-427e-a5d4-993acd74bb27" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:49:06 user nova-compute[74190]: DEBUG nova.network.neutron [req-9adbd7ae-b8de-41e3-a0e4-ea3d83b3a916 req-3b158299-9cae-47f4-b38f-4fafdcf407f9 service nova] [instance: 0c11bc6b-303f-427e-a5d4-993acd74bb27] Refreshing network info cache for port 30366b5a-3e80-4fb4-be78-0fdff62dfcaa {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 11:49:06 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-85f27cc0-8c05-40d5-89d1-c5d9f6759aa2 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] [instance: 0c11bc6b-303f-427e-a5d4-993acd74bb27] Start _get_guest_xml network_info=[{"id": "30366b5a-3e80-4fb4-be78-0fdff62dfcaa", "address": "fa:16:3e:25:67:c0", "network": {"id": "aeb25e9d-effa-4ae6-9e7e-61915593bb26", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-539764280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e7b038b65b84b819175fe34941d4909", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30366b5a-3e", "ovs_interfaceid": "30366b5a-3e80-4fb4-be78-0fdff62dfcaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'image_id': '6e88bbf0-6e78-49a8-b3c5-9453d22a89df'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 11:49:06 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-85f27cc0-8c05-40d5-89d1-c5d9f6759aa2 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:49:06 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-85f27cc0-8c05-40d5-89d1-c5d9f6759aa2 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:49:06 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-85f27cc0-8c05-40d5-89d1-c5d9f6759aa2 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 11:49:06 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-85f27cc0-8c05-40d5-89d1-c5d9f6759aa2 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] CPU controller missing on host. {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 11:49:06 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-85f27cc0-8c05-40d5-89d1-c5d9f6759aa2 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 11:49:06 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-85f27cc0-8c05-40d5-89d1-c5d9f6759aa2 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] CPU controller found on host. {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 11:49:06 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-85f27cc0-8c05-40d5-89d1-c5d9f6759aa2 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74190) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 11:49:06 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-85f27cc0-8c05-40d5-89d1-c5d9f6759aa2 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T11:37:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 11:49:06 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-85f27cc0-8c05-40d5-89d1-c5d9f6759aa2 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Flavor limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 11:49:06 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-85f27cc0-8c05-40d5-89d1-c5d9f6759aa2 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Image limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 11:49:06 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-85f27cc0-8c05-40d5-89d1-c5d9f6759aa2 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Flavor pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 11:49:06 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-85f27cc0-8c05-40d5-89d1-c5d9f6759aa2 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Image pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 11:49:06 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-85f27cc0-8c05-40d5-89d1-c5d9f6759aa2 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 11:49:06 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-85f27cc0-8c05-40d5-89d1-c5d9f6759aa2 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 11:49:06 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-85f27cc0-8c05-40d5-89d1-c5d9f6759aa2 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 11:49:06 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-85f27cc0-8c05-40d5-89d1-c5d9f6759aa2 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Got 1 possible topologies {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 11:49:06 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-85f27cc0-8c05-40d5-89d1-c5d9f6759aa2 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 11:49:06 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-85f27cc0-8c05-40d5-89d1-c5d9f6759aa2 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 11:49:06 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-85f27cc0-8c05-40d5-89d1-c5d9f6759aa2 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:49:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-2119548194',display_name='tempest-DeleteServersTestJSON-server-2119548194',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-2119548194',id=17,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4e7b038b65b84b819175fe34941d4909',ramdisk_id='',reservation_id='r-nrvfuye2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1054813631',owner_user_name='tempest-DeleteServersTestJSON-1054813631-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:49:04Z,user_data=None,user_id='d098d8f1d4ad4bfe8b5a4ada891990de',uuid=0c11bc6b-303f-427e-a5d4-993acd74bb27,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "30366b5a-3e80-4fb4-be78-0fdff62dfcaa", "address": "fa:16:3e:25:67:c0", "network": {"id": "aeb25e9d-effa-4ae6-9e7e-61915593bb26", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-539764280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e7b038b65b84b819175fe34941d4909", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30366b5a-3e", "ovs_interfaceid": "30366b5a-3e80-4fb4-be78-0fdff62dfcaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74190) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 11:49:06 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-85f27cc0-8c05-40d5-89d1-c5d9f6759aa2 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Converting VIF {"id": "30366b5a-3e80-4fb4-be78-0fdff62dfcaa", "address": "fa:16:3e:25:67:c0", "network": {"id": "aeb25e9d-effa-4ae6-9e7e-61915593bb26", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-539764280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e7b038b65b84b819175fe34941d4909", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30366b5a-3e", "ovs_interfaceid": "30366b5a-3e80-4fb4-be78-0fdff62dfcaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:49:06 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-85f27cc0-8c05-40d5-89d1-c5d9f6759aa2 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:67:c0,bridge_name='br-int',has_traffic_filtering=True,id=30366b5a-3e80-4fb4-be78-0fdff62dfcaa,network=Network(aeb25e9d-effa-4ae6-9e7e-61915593bb26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30366b5a-3e') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:49:06 user nova-compute[74190]: DEBUG nova.objects.instance [None req-85f27cc0-8c05-40d5-89d1-c5d9f6759aa2 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Lazy-loading 'pci_devices' on Instance uuid 0c11bc6b-303f-427e-a5d4-993acd74bb27 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:49:06 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-85f27cc0-8c05-40d5-89d1-c5d9f6759aa2 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] [instance: 0c11bc6b-303f-427e-a5d4-993acd74bb27] End _get_guest_xml xml=<domain type="kvm">
Oct 18 11:49:06 user nova-compute[74190]:   <uuid>0c11bc6b-303f-427e-a5d4-993acd74bb27</uuid>
Oct 18 11:49:06 user nova-compute[74190]:   <name>instance-00000011</name>
Oct 18 11:49:06 user nova-compute[74190]:   <memory>524288</memory>
Oct 18 11:49:06 user nova-compute[74190]:   <vcpu>1</vcpu>
Oct 18 11:49:06 user nova-compute[74190]:   <metadata>
Oct 18 11:49:06 user nova-compute[74190]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 11:49:06 user nova-compute[74190]:       <nova:package version="0.0.0"/>
Oct 18 11:49:06 user nova-compute[74190]:       <nova:name>tempest-DeleteServersTestJSON-server-2119548194</nova:name>
Oct 18 11:49:06 user nova-compute[74190]:       <nova:creationTime>2023-10-18 11:49:06</nova:creationTime>
Oct 18 11:49:06 user nova-compute[74190]:       <nova:flavor name="m1.tiny">
Oct 18 11:49:06 user nova-compute[74190]:         <nova:memory>512</nova:memory>
Oct 18 11:49:06 user nova-compute[74190]:         <nova:disk>1</nova:disk>
Oct 18 11:49:06 user nova-compute[74190]:         <nova:swap>0</nova:swap>
Oct 18 11:49:06 user nova-compute[74190]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 11:49:06 user nova-compute[74190]:         <nova:vcpus>1</nova:vcpus>
Oct 18 11:49:06 user nova-compute[74190]:       </nova:flavor>
Oct 18 11:49:06 user nova-compute[74190]:       <nova:owner>
Oct 18 11:49:06 user nova-compute[74190]:         <nova:user uuid="d098d8f1d4ad4bfe8b5a4ada891990de">tempest-DeleteServersTestJSON-1054813631-project-member</nova:user>
Oct 18 11:49:06 user nova-compute[74190]:         <nova:project uuid="4e7b038b65b84b819175fe34941d4909">tempest-DeleteServersTestJSON-1054813631</nova:project>
Oct 18 11:49:06 user nova-compute[74190]:       </nova:owner>
Oct 18 11:49:06 user nova-compute[74190]:       <nova:root type="image" uuid="6e88bbf0-6e78-49a8-b3c5-9453d22a89df"/>
Oct 18 11:49:06 user nova-compute[74190]:       <nova:ports>
Oct 18 11:49:06 user nova-compute[74190]:         <nova:port uuid="30366b5a-3e80-4fb4-be78-0fdff62dfcaa">
Oct 18 11:49:06 user nova-compute[74190]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 18 11:49:06 user nova-compute[74190]:         </nova:port>
Oct 18 11:49:06 user nova-compute[74190]:       </nova:ports>
Oct 18 11:49:06 user nova-compute[74190]:     </nova:instance>
Oct 18 11:49:06 user nova-compute[74190]:   </metadata>
Oct 18 11:49:06 user nova-compute[74190]:   <sysinfo type="smbios">
Oct 18 11:49:06 user nova-compute[74190]:     <system>
Oct 18 11:49:06 user nova-compute[74190]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 11:49:06 user nova-compute[74190]:       <entry name="product">OpenStack Nova</entry>
Oct 18 11:49:06 user nova-compute[74190]:       <entry name="version">0.0.0</entry>
Oct 18 11:49:06 user nova-compute[74190]:       <entry name="serial">0c11bc6b-303f-427e-a5d4-993acd74bb27</entry>
Oct 18 11:49:06 user nova-compute[74190]:       <entry name="uuid">0c11bc6b-303f-427e-a5d4-993acd74bb27</entry>
Oct 18 11:49:06 user nova-compute[74190]:       <entry name="family">Virtual Machine</entry>
Oct 18 11:49:06 user nova-compute[74190]:     </system>
Oct 18 11:49:06 user nova-compute[74190]:   </sysinfo>
Oct 18 11:49:06 user nova-compute[74190]:   <os>
Oct 18 11:49:06 user nova-compute[74190]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 11:49:06 user nova-compute[74190]:     <boot dev="hd"/>
Oct 18 11:49:06 user nova-compute[74190]:     <smbios mode="sysinfo"/>
Oct 18 11:49:06 user nova-compute[74190]:   </os>
Oct 18 11:49:06 user nova-compute[74190]:   <features>
Oct 18 11:49:06 user nova-compute[74190]:     <acpi/>
Oct 18 11:49:06 user nova-compute[74190]:     <apic/>
Oct 18 11:49:06 user nova-compute[74190]:     <vmcoreinfo/>
Oct 18 11:49:06 user nova-compute[74190]:   </features>
Oct 18 11:49:06 user nova-compute[74190]:   <clock offset="utc">
Oct 18 11:49:06 user nova-compute[74190]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 11:49:06 user nova-compute[74190]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 11:49:06 user nova-compute[74190]:     <timer name="hpet" present="no"/>
Oct 18 11:49:06 user nova-compute[74190]:   </clock>
Oct 18 11:49:06 user nova-compute[74190]:   <cpu mode="custom" match="exact">
Oct 18 11:49:06 user nova-compute[74190]:     <model>Nehalem</model>
Oct 18 11:49:06 user nova-compute[74190]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 11:49:06 user nova-compute[74190]:   </cpu>
Oct 18 11:49:06 user nova-compute[74190]:   <devices>
Oct 18 11:49:06 user nova-compute[74190]:     <disk type="file" device="disk">
Oct 18 11:49:06 user nova-compute[74190]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 11:49:06 user nova-compute[74190]:       <source file="/opt/stack/data/nova/instances/0c11bc6b-303f-427e-a5d4-993acd74bb27/disk"/>
Oct 18 11:49:06 user nova-compute[74190]:       <target dev="vda" bus="virtio"/>
Oct 18 11:49:06 user nova-compute[74190]:     </disk>
Oct 18 11:49:06 user nova-compute[74190]:     <interface type="ethernet">
Oct 18 11:49:06 user nova-compute[74190]:       <mac address="fa:16:3e:25:67:c0"/>
Oct 18 11:49:06 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:49:06 user nova-compute[74190]:       <mtu size="1442"/>
Oct 18 11:49:06 user nova-compute[74190]:       <target dev="tap30366b5a-3e"/>
Oct 18 11:49:06 user nova-compute[74190]:     </interface>
Oct 18 11:49:06 user nova-compute[74190]:     <serial type="pty">
Oct 18 11:49:06 user nova-compute[74190]:       <log file="/opt/stack/data/nova/instances/0c11bc6b-303f-427e-a5d4-993acd74bb27/console.log" append="off"/>
Oct 18 11:49:06 user nova-compute[74190]:     </serial>
Oct 18 11:49:06 user nova-compute[74190]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 11:49:06 user nova-compute[74190]:     <video>
Oct 18 11:49:06 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:49:06 user nova-compute[74190]:     </video>
Oct 18 11:49:06 user nova-compute[74190]:     <rng model="virtio">
Oct 18 11:49:06 user nova-compute[74190]:       <backend model="random">/dev/urandom</backend>
Oct 18 11:49:06 user nova-compute[74190]:     </rng>
Oct 18 11:49:06 user nova-compute[74190]:     <controller type="usb" index="0" model="none"/>
Oct 18 11:49:06 user nova-compute[74190]:     <memballoon model="virtio">
Oct 18 11:49:06 user nova-compute[74190]:       <stats period="10"/>
Oct 18 11:49:06 user nova-compute[74190]:     </memballoon>
Oct 18 11:49:06 user nova-compute[74190]:   </devices>
Oct 18 11:49:06 user nova-compute[74190]: </domain>
Oct 18 11:49:06 user nova-compute[74190]:  {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 11:49:06 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-85f27cc0-8c05-40d5-89d1-c5d9f6759aa2 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:49:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-2119548194',display_name='tempest-DeleteServersTestJSON-server-2119548194',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-2119548194',id=17,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4e7b038b65b84b819175fe34941d4909',ramdisk_id='',reservation_id='r-nrvfuye2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1054813631',owner_user_name='tempest-DeleteServersTestJSON-1054813631-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:49:04Z,user_data=None,user_id='d098d8f1d4ad4bfe8b5a4ada891990de',uuid=0c11bc6b-303f-427e-a5d4-993acd74bb27,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "30366b5a-3e80-4fb4-be78-0fdff62dfcaa", "address": "fa:16:3e:25:67:c0", "network": {"id": "aeb25e9d-effa-4ae6-9e7e-61915593bb26", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-539764280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e7b038b65b84b819175fe34941d4909", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30366b5a-3e", "ovs_interfaceid": "30366b5a-3e80-4fb4-be78-0fdff62dfcaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 11:49:06 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-85f27cc0-8c05-40d5-89d1-c5d9f6759aa2 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Converting VIF {"id": "30366b5a-3e80-4fb4-be78-0fdff62dfcaa", "address": "fa:16:3e:25:67:c0", "network": {"id": "aeb25e9d-effa-4ae6-9e7e-61915593bb26", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-539764280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e7b038b65b84b819175fe34941d4909", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30366b5a-3e", "ovs_interfaceid": "30366b5a-3e80-4fb4-be78-0fdff62dfcaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:49:06 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-85f27cc0-8c05-40d5-89d1-c5d9f6759aa2 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:67:c0,bridge_name='br-int',has_traffic_filtering=True,id=30366b5a-3e80-4fb4-be78-0fdff62dfcaa,network=Network(aeb25e9d-effa-4ae6-9e7e-61915593bb26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30366b5a-3e') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:49:06 user nova-compute[74190]: DEBUG os_vif [None req-85f27cc0-8c05-40d5-89d1-c5d9f6759aa2 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:67:c0,bridge_name='br-int',has_traffic_filtering=True,id=30366b5a-3e80-4fb4-be78-0fdff62dfcaa,network=Network(aeb25e9d-effa-4ae6-9e7e-61915593bb26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30366b5a-3e') {{(pid=74190) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 11:49:06 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:49:06 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:49:06 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 11:49:06 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:49:06 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e0e3d26d-34a4-5005-ac51-0fc559a061ed', '_type': 'linux-noop'}}, row=False) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:49:06 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:49:06 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:49:06 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:49:06 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:49:06 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap30366b5a-3e, may_exist=True, interface_attrs={}) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:49:06 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap30366b5a-3e, col_values=(('qos', UUID('d40832fe-43cb-4f80-afa1-0e3c0bc3c099')),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:49:06 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap30366b5a-3e, col_values=(('external_ids', {'iface-id': '30366b5a-3e80-4fb4-be78-0fdff62dfcaa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:25:67:c0', 'vm-uuid': '0c11bc6b-303f-427e-a5d4-993acd74bb27'}),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:49:06 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:49:06 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:49:06 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:49:06 user nova-compute[74190]: INFO os_vif [None req-85f27cc0-8c05-40d5-89d1-c5d9f6759aa2 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:67:c0,bridge_name='br-int',has_traffic_filtering=True,id=30366b5a-3e80-4fb4-be78-0fdff62dfcaa,network=Network(aeb25e9d-effa-4ae6-9e7e-61915593bb26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30366b5a-3e')
Oct 18 11:49:06 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-85f27cc0-8c05-40d5-89d1-c5d9f6759aa2 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] No BDM found with device name vda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 11:49:06 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-85f27cc0-8c05-40d5-89d1-c5d9f6759aa2 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] No VIF found with MAC fa:16:3e:25:67:c0, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 11:49:06 user nova-compute[74190]: DEBUG nova.network.neutron [req-9adbd7ae-b8de-41e3-a0e4-ea3d83b3a916 req-3b158299-9cae-47f4-b38f-4fafdcf407f9 service nova] [instance: 0c11bc6b-303f-427e-a5d4-993acd74bb27] Updated VIF entry in instance network info cache for port 30366b5a-3e80-4fb4-be78-0fdff62dfcaa. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 11:49:06 user nova-compute[74190]: DEBUG nova.network.neutron [req-9adbd7ae-b8de-41e3-a0e4-ea3d83b3a916 req-3b158299-9cae-47f4-b38f-4fafdcf407f9 service nova] [instance: 0c11bc6b-303f-427e-a5d4-993acd74bb27] Updating instance_info_cache with network_info: [{"id": "30366b5a-3e80-4fb4-be78-0fdff62dfcaa", "address": "fa:16:3e:25:67:c0", "network": {"id": "aeb25e9d-effa-4ae6-9e7e-61915593bb26", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-539764280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e7b038b65b84b819175fe34941d4909", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30366b5a-3e", "ovs_interfaceid": "30366b5a-3e80-4fb4-be78-0fdff62dfcaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:49:06 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-9adbd7ae-b8de-41e3-a0e4-ea3d83b3a916 req-3b158299-9cae-47f4-b38f-4fafdcf407f9 service nova] Releasing lock "refresh_cache-0c11bc6b-303f-427e-a5d4-993acd74bb27" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:49:07 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:49:07 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:49:07 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:49:07 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:49:07 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:49:07 user nova-compute[74190]: DEBUG nova.compute.manager [req-68690721-e345-4bc7-8883-d5eaba1d400e req-f7a50e8f-8081-44af-acbd-38ad2d7cbfa1 service nova] [instance: 0c11bc6b-303f-427e-a5d4-993acd74bb27] Received event network-vif-plugged-30366b5a-3e80-4fb4-be78-0fdff62dfcaa {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:49:07 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-68690721-e345-4bc7-8883-d5eaba1d400e req-f7a50e8f-8081-44af-acbd-38ad2d7cbfa1 service nova] Acquiring lock "0c11bc6b-303f-427e-a5d4-993acd74bb27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:49:07 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-68690721-e345-4bc7-8883-d5eaba1d400e req-f7a50e8f-8081-44af-acbd-38ad2d7cbfa1 service nova] Lock "0c11bc6b-303f-427e-a5d4-993acd74bb27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:49:07 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-68690721-e345-4bc7-8883-d5eaba1d400e req-f7a50e8f-8081-44af-acbd-38ad2d7cbfa1 service nova] Lock "0c11bc6b-303f-427e-a5d4-993acd74bb27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:49:07 user nova-compute[74190]: DEBUG nova.compute.manager [req-68690721-e345-4bc7-8883-d5eaba1d400e req-f7a50e8f-8081-44af-acbd-38ad2d7cbfa1 service nova] [instance: 0c11bc6b-303f-427e-a5d4-993acd74bb27] No waiting events found dispatching network-vif-plugged-30366b5a-3e80-4fb4-be78-0fdff62dfcaa {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:49:07 user nova-compute[74190]: WARNING nova.compute.manager [req-68690721-e345-4bc7-8883-d5eaba1d400e req-f7a50e8f-8081-44af-acbd-38ad2d7cbfa1 service nova] [instance: 0c11bc6b-303f-427e-a5d4-993acd74bb27] Received unexpected event network-vif-plugged-30366b5a-3e80-4fb4-be78-0fdff62dfcaa for instance with vm_state building and task_state spawning.
Oct 18 11:49:08 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:49:08 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:49:08 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:49:08 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:49:08 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:49:09 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:49:09 user nova-compute[74190]: DEBUG nova.compute.manager [None req-85f27cc0-8c05-40d5-89d1-c5d9f6759aa2 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] [instance: 0c11bc6b-303f-427e-a5d4-993acd74bb27] Instance event wait completed in 0 seconds for  {{(pid=74190) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 11:49:09 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-85f27cc0-8c05-40d5-89d1-c5d9f6759aa2 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] [instance: 0c11bc6b-303f-427e-a5d4-993acd74bb27] Guest created on hypervisor {{(pid=74190) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 11:49:09 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 0c11bc6b-303f-427e-a5d4-993acd74bb27] Instance spawned successfully.
Oct 18 11:49:09 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-85f27cc0-8c05-40d5-89d1-c5d9f6759aa2 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] [instance: 0c11bc6b-303f-427e-a5d4-993acd74bb27] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 11:49:09 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-85f27cc0-8c05-40d5-89d1-c5d9f6759aa2 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] [instance: 0c11bc6b-303f-427e-a5d4-993acd74bb27] Found default for hw_cdrom_bus of ide {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:49:09 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-85f27cc0-8c05-40d5-89d1-c5d9f6759aa2 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] [instance: 0c11bc6b-303f-427e-a5d4-993acd74bb27] Found default for hw_disk_bus of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:49:09 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-85f27cc0-8c05-40d5-89d1-c5d9f6759aa2 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] [instance: 0c11bc6b-303f-427e-a5d4-993acd74bb27] Found default for hw_input_bus of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:49:09 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-85f27cc0-8c05-40d5-89d1-c5d9f6759aa2 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] [instance: 0c11bc6b-303f-427e-a5d4-993acd74bb27] Found default for hw_pointer_model of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:49:09 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-85f27cc0-8c05-40d5-89d1-c5d9f6759aa2 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] [instance: 0c11bc6b-303f-427e-a5d4-993acd74bb27] Found default for hw_video_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:49:09 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-85f27cc0-8c05-40d5-89d1-c5d9f6759aa2 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] [instance: 0c11bc6b-303f-427e-a5d4-993acd74bb27] Found default for hw_vif_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:49:10 user nova-compute[74190]: INFO nova.compute.manager [None req-85f27cc0-8c05-40d5-89d1-c5d9f6759aa2 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] [instance: 0c11bc6b-303f-427e-a5d4-993acd74bb27] Took 5.74 seconds to spawn the instance on the hypervisor.
Oct 18 11:49:10 user nova-compute[74190]: DEBUG nova.compute.manager [None req-85f27cc0-8c05-40d5-89d1-c5d9f6759aa2 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] [instance: 0c11bc6b-303f-427e-a5d4-993acd74bb27] Checking state {{(pid=74190) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 11:49:10 user nova-compute[74190]: DEBUG nova.compute.manager [req-a2e97526-758c-4e29-a703-a2268470da02 req-b6deda9a-0957-478c-a6df-bb7dd2aab002 service nova] [instance: 0c11bc6b-303f-427e-a5d4-993acd74bb27] Received event network-vif-plugged-30366b5a-3e80-4fb4-be78-0fdff62dfcaa {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:49:10 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-a2e97526-758c-4e29-a703-a2268470da02 req-b6deda9a-0957-478c-a6df-bb7dd2aab002 service nova] Acquiring lock "0c11bc6b-303f-427e-a5d4-993acd74bb27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:49:10 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-a2e97526-758c-4e29-a703-a2268470da02 req-b6deda9a-0957-478c-a6df-bb7dd2aab002 service nova] Lock "0c11bc6b-303f-427e-a5d4-993acd74bb27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:49:10 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-a2e97526-758c-4e29-a703-a2268470da02 req-b6deda9a-0957-478c-a6df-bb7dd2aab002 service nova] Lock "0c11bc6b-303f-427e-a5d4-993acd74bb27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:49:10 user nova-compute[74190]: DEBUG nova.compute.manager [req-a2e97526-758c-4e29-a703-a2268470da02 req-b6deda9a-0957-478c-a6df-bb7dd2aab002 service nova] [instance: 0c11bc6b-303f-427e-a5d4-993acd74bb27] No waiting events found dispatching network-vif-plugged-30366b5a-3e80-4fb4-be78-0fdff62dfcaa {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:49:10 user nova-compute[74190]: WARNING nova.compute.manager [req-a2e97526-758c-4e29-a703-a2268470da02 req-b6deda9a-0957-478c-a6df-bb7dd2aab002 service nova] [instance: 0c11bc6b-303f-427e-a5d4-993acd74bb27] Received unexpected event network-vif-plugged-30366b5a-3e80-4fb4-be78-0fdff62dfcaa for instance with vm_state building and task_state spawning.
Oct 18 11:49:10 user nova-compute[74190]: INFO nova.compute.manager [None req-85f27cc0-8c05-40d5-89d1-c5d9f6759aa2 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] [instance: 0c11bc6b-303f-427e-a5d4-993acd74bb27] Took 6.63 seconds to build instance.
Oct 18 11:49:10 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-85f27cc0-8c05-40d5-89d1-c5d9f6759aa2 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Lock "0c11bc6b-303f-427e-a5d4-993acd74bb27" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.738s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:49:11 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:49:14 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:49:16 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:49:18 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:49:21 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:49:21 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:49:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:49:26 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:49:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:49:30 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-2fa19fb3-5e51-4faa-8489-88e924b78a59 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Acquiring lock "bdfe420d-f46c-44ad-8773-b675f42e24ed" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:49:30 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-2fa19fb3-5e51-4faa-8489-88e924b78a59 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Lock "bdfe420d-f46c-44ad-8773-b675f42e24ed" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:49:30 user nova-compute[74190]: DEBUG nova.objects.instance [None req-2fa19fb3-5e51-4faa-8489-88e924b78a59 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Lazy-loading 'flavor' on Instance uuid bdfe420d-f46c-44ad-8773-b675f42e24ed {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:49:30 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-2fa19fb3-5e51-4faa-8489-88e924b78a59 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Lock "bdfe420d-f46c-44ad-8773-b675f42e24ed" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:49:30 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-2fa19fb3-5e51-4faa-8489-88e924b78a59 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Acquiring lock "bdfe420d-f46c-44ad-8773-b675f42e24ed" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:49:30 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-2fa19fb3-5e51-4faa-8489-88e924b78a59 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Lock "bdfe420d-f46c-44ad-8773-b675f42e24ed" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:49:30 user nova-compute[74190]: INFO nova.compute.manager [None req-2fa19fb3-5e51-4faa-8489-88e924b78a59 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Attaching volume 7316be11-03d9-47f3-bf3c-2563c3a92c71 to /dev/vdb
Oct 18 11:49:30 user nova-compute[74190]: DEBUG os_brick.utils [None req-2fa19fb3-5e51-4faa-8489-88e924b78a59 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:49:30 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:49:30 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:49:30 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[190ce988-6568-4d65-ae1c-0a59af52845c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cff158e257e1\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:49:30 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:49:30 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:49:30 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdd94d45-3a4d-4ec1-b4f7-6a05d773854d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:49:30 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:49:30 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:49:30 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[689f0a64-411f-41ab-a334-77fc481a2568]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:49:30 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3be2c7d-abd7-49ce-88c7-0e7d73337124]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:49:30 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-2fa19fb3-5e51-4faa-8489-88e924b78a59 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Running cmd (subprocess): nvme version {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:49:30 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-2fa19fb3-5e51-4faa-8489-88e924b78a59 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] 'nvme version' failed. Not Retrying. {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 11:49:30 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2fa19fb3-5e51-4faa-8489-88e924b78a59 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] nvme not present on system {{(pid=74190) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 11:49:30 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:49:30 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 11:49:30 user nova-compute[74190]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 11:49:30 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[89df6ddc-f248-4bf9-a242-508715cbff58]: (4, '') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:49:30 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-2fa19fb3-5e51-4faa-8489-88e924b78a59 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74190) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 11:49:30 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-2fa19fb3-5e51-4faa-8489-88e924b78a59 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 11:49:30 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-2fa19fb3-5e51-4faa-8489-88e924b78a59 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] LIGHTOS: no hostnqn found. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 11:49:30 user nova-compute[74190]: DEBUG os_brick.utils [None req-2fa19fb3-5e51-4faa-8489-88e924b78a59 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cff158e257e1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:49:30 user nova-compute[74190]: DEBUG nova.virt.block_device [None req-2fa19fb3-5e51-4faa-8489-88e924b78a59 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Updating existing volume attachment record: abfed22a-b47d-4528-a0da-bf7edbe45bba {{(pid=74190) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 11:49:31 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:49:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:49:35 user nova-compute[74190]: DEBUG nova.objects.instance [None req-30d58f71-8a45-4c4c-971e-c91109f948ec tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lazy-loading 'flavor' on Instance uuid c280652c-ffde-40f8-a919-adb8be618db8 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:49:35 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-30d58f71-8a45-4c4c-971e-c91109f948ec tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Acquiring lock "refresh_cache-c280652c-ffde-40f8-a919-adb8be618db8" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:49:35 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-30d58f71-8a45-4c4c-971e-c91109f948ec tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Acquired lock "refresh_cache-c280652c-ffde-40f8-a919-adb8be618db8" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:49:35 user nova-compute[74190]: DEBUG nova.network.neutron [None req-30d58f71-8a45-4c4c-971e-c91109f948ec tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Building network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 11:49:35 user nova-compute[74190]: DEBUG nova.objects.instance [None req-30d58f71-8a45-4c4c-971e-c91109f948ec tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lazy-loading 'info_cache' on Instance uuid c280652c-ffde-40f8-a919-adb8be618db8 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:49:36 user nova-compute[74190]: DEBUG nova.objects.base [None req-30d58f71-8a45-4c4c-971e-c91109f948ec tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Object Instance<c280652c-ffde-40f8-a919-adb8be618db8> lazy-loaded attributes: flavor,info_cache {{(pid=74190) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 11:49:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:49:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Acquiring lock "cd28be8d-847b-468c-860f-4f479740738d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:49:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Lock "cd28be8d-847b-468c-860f-4f479740738d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:49:36 user nova-compute[74190]: DEBUG nova.compute.manager [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] [instance: cd28be8d-847b-468c-860f-4f479740738d] Starting instance... {{(pid=74190) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 11:49:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:49:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:49:36 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74190) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 11:49:36 user nova-compute[74190]: INFO nova.compute.claims [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] [instance: cd28be8d-847b-468c-860f-4f479740738d] Claim successful on node user
Oct 18 11:49:36 user nova-compute[74190]: DEBUG nova.network.neutron [None req-30d58f71-8a45-4c4c-971e-c91109f948ec tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Updating instance_info_cache with network_info: [{"id": "80b77e2d-aa04-4996-a0c1-713054affac4", "address": "fa:16:3e:4f:00:ce", "network": {"id": "cf0a4705-3fff-4716-87ac-b0ca7700e11c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1739631852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cf8d4d4f504e82868ed295e054644c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80b77e2d-aa", "ovs_interfaceid": "80b77e2d-aa04-4996-a0c1-713054affac4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:49:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-30d58f71-8a45-4c4c-971e-c91109f948ec tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Releasing lock "refresh_cache-c280652c-ffde-40f8-a919-adb8be618db8" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:49:36 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Instance destroyed successfully.
Oct 18 11:49:36 user nova-compute[74190]: DEBUG nova.objects.instance [None req-30d58f71-8a45-4c4c-971e-c91109f948ec tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lazy-loading 'resources' on Instance uuid c280652c-ffde-40f8-a919-adb8be618db8 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:49:36 user nova-compute[74190]: DEBUG nova.objects.base [None req-30d58f71-8a45-4c4c-971e-c91109f948ec tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Object Instance<c280652c-ffde-40f8-a919-adb8be618db8> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74190) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 11:49:36 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-30d58f71-8a45-4c4c-971e-c91109f948ec tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:40:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-711461105',display_name='tempest-AttachVolumeTestJSON-server-711461105',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-711461105',id=1,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPnE2mtL+LbI3yVW2kYaN2Dxz5V1+PIccsOPxNaLovIe8VN7EUmA+C39USstHm9Yifnik7GFCenLhGnFytwIhcv6ox30HzhlwfaoDrZEfYtFLQ2I1/Og7nqCIt/6qIOiKA==',key_name='tempest-keypair-355856933',keypairs=<?>,launch_index=0,launched_at=2023-10-18T11:41:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='99cf8d4d4f504e82868ed295e054644c',ramdisk_id='',reservation_id='r-zf27bcaw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2125017306',owner_user_name='tempest-AttachVolumeTestJSON-2125017306-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T11:47:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='852309a19f1b4d49a4974c3be53f67cb',uuid=c280652c-ffde-40f8-a919-adb8be618db8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "80b77e2d-aa04-4996-a0c1-713054affac4", "address": "fa:16:3e:4f:00:ce", "network": {"id": "cf0a4705-3fff-4716-87ac-b0ca7700e11c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1739631852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cf8d4d4f504e82868ed295e054644c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80b77e2d-aa", "ovs_interfaceid": "80b77e2d-aa04-4996-a0c1-713054affac4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 11:49:36 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-30d58f71-8a45-4c4c-971e-c91109f948ec tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Converting VIF {"id": "80b77e2d-aa04-4996-a0c1-713054affac4", "address": "fa:16:3e:4f:00:ce", "network": {"id": "cf0a4705-3fff-4716-87ac-b0ca7700e11c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1739631852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cf8d4d4f504e82868ed295e054644c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80b77e2d-aa", "ovs_interfaceid": "80b77e2d-aa04-4996-a0c1-713054affac4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:49:36 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-30d58f71-8a45-4c4c-971e-c91109f948ec tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:00:ce,bridge_name='br-int',has_traffic_filtering=True,id=80b77e2d-aa04-4996-a0c1-713054affac4,network=Network(cf0a4705-3fff-4716-87ac-b0ca7700e11c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80b77e2d-aa') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:49:36 user nova-compute[74190]: DEBUG os_vif [None req-30d58f71-8a45-4c4c-971e-c91109f948ec tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:00:ce,bridge_name='br-int',has_traffic_filtering=True,id=80b77e2d-aa04-4996-a0c1-713054affac4,network=Network(cf0a4705-3fff-4716-87ac-b0ca7700e11c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80b77e2d-aa') {{(pid=74190) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 11:49:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:49:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap80b77e2d-aa, bridge=br-int, if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:49:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:49:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:49:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:49:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=23f05794-9183-472a-92b4-9ec6941f0c84) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:49:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:49:36 user nova-compute[74190]: INFO os_vif [None req-30d58f71-8a45-4c4c-971e-c91109f948ec tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:00:ce,bridge_name='br-int',has_traffic_filtering=True,id=80b77e2d-aa04-4996-a0c1-713054affac4,network=Network(cf0a4705-3fff-4716-87ac-b0ca7700e11c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80b77e2d-aa')
Oct 18 11:49:36 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-30d58f71-8a45-4c4c-971e-c91109f948ec tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Start _get_guest_xml network_info=[{"id": "80b77e2d-aa04-4996-a0c1-713054affac4", "address": "fa:16:3e:4f:00:ce", "network": {"id": "cf0a4705-3fff-4716-87ac-b0ca7700e11c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1739631852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cf8d4d4f504e82868ed295e054644c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80b77e2d-aa", "ovs_interfaceid": "80b77e2d-aa04-4996-a0c1-713054affac4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'image_id': '6e88bbf0-6e78-49a8-b3c5-9453d22a89df'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 11:49:36 user nova-compute[74190]: DEBUG nova.objects.instance [None req-30d58f71-8a45-4c4c-971e-c91109f948ec tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lazy-loading 'numa_topology' on Instance uuid c280652c-ffde-40f8-a919-adb8be618db8 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:49:36 user nova-compute[74190]: DEBUG nova.objects.base [None req-30d58f71-8a45-4c4c-971e-c91109f948ec tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Object Instance<c280652c-ffde-40f8-a919-adb8be618db8> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74190) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 11:49:36 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-30d58f71-8a45-4c4c-971e-c91109f948ec tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:49:36 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-30d58f71-8a45-4c4c-971e-c91109f948ec tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:49:36 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-30d58f71-8a45-4c4c-971e-c91109f948ec tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 11:49:36 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-30d58f71-8a45-4c4c-971e-c91109f948ec tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] CPU controller missing on host. {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 11:49:36 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-30d58f71-8a45-4c4c-971e-c91109f948ec tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 11:49:36 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-30d58f71-8a45-4c4c-971e-c91109f948ec tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] CPU controller found on host. {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 11:49:36 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-30d58f71-8a45-4c4c-971e-c91109f948ec tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74190) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 11:49:36 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-30d58f71-8a45-4c4c-971e-c91109f948ec tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T11:37:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 11:49:36 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-30d58f71-8a45-4c4c-971e-c91109f948ec tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Flavor limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 11:49:36 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-30d58f71-8a45-4c4c-971e-c91109f948ec tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Image limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 11:49:36 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-30d58f71-8a45-4c4c-971e-c91109f948ec tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Flavor pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 11:49:36 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-30d58f71-8a45-4c4c-971e-c91109f948ec tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Image pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 11:49:36 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-30d58f71-8a45-4c4c-971e-c91109f948ec tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 11:49:36 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-30d58f71-8a45-4c4c-971e-c91109f948ec tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 11:49:36 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-30d58f71-8a45-4c4c-971e-c91109f948ec tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 11:49:36 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-30d58f71-8a45-4c4c-971e-c91109f948ec tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Got 1 possible topologies {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 11:49:36 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-30d58f71-8a45-4c4c-971e-c91109f948ec tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 11:49:36 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-30d58f71-8a45-4c4c-971e-c91109f948ec tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 11:49:36 user nova-compute[74190]: DEBUG nova.objects.instance [None req-30d58f71-8a45-4c4c-971e-c91109f948ec tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lazy-loading 'vcpu_model' on Instance uuid c280652c-ffde-40f8-a919-adb8be618db8 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:49:36 user nova-compute[74190]: DEBUG nova.objects.base [None req-30d58f71-8a45-4c4c-971e-c91109f948ec tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Object Instance<c280652c-ffde-40f8-a919-adb8be618db8> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74190) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 11:49:36 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-30d58f71-8a45-4c4c-971e-c91109f948ec tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:40:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-711461105',display_name='tempest-AttachVolumeTestJSON-server-711461105',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-711461105',id=1,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPnE2mtL+LbI3yVW2kYaN2Dxz5V1+PIccsOPxNaLovIe8VN7EUmA+C39USstHm9Yifnik7GFCenLhGnFytwIhcv6ox30HzhlwfaoDrZEfYtFLQ2I1/Og7nqCIt/6qIOiKA==',key_name='tempest-keypair-355856933',keypairs=<?>,launch_index=0,launched_at=2023-10-18T11:41:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='99cf8d4d4f504e82868ed295e054644c',ramdisk_id='',reservation_id='r-zf27bcaw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2125017306',owner_user_name='tempest-AttachVolumeTestJSON-2125017306-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T11:47:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='852309a19f1b4d49a4974c3be53f67cb',uuid=c280652c-ffde-40f8-a919-adb8be618db8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "80b77e2d-aa04-4996-a0c1-713054affac4", "address": "fa:16:3e:4f:00:ce", "network": {"id": "cf0a4705-3fff-4716-87ac-b0ca7700e11c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1739631852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cf8d4d4f504e82868ed295e054644c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80b77e2d-aa", "ovs_interfaceid": "80b77e2d-aa04-4996-a0c1-713054affac4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74190) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 11:49:36 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-30d58f71-8a45-4c4c-971e-c91109f948ec tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Converting VIF {"id": "80b77e2d-aa04-4996-a0c1-713054affac4", "address": "fa:16:3e:4f:00:ce", "network": {"id": "cf0a4705-3fff-4716-87ac-b0ca7700e11c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1739631852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cf8d4d4f504e82868ed295e054644c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80b77e2d-aa", "ovs_interfaceid": "80b77e2d-aa04-4996-a0c1-713054affac4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:49:36 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-30d58f71-8a45-4c4c-971e-c91109f948ec tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:00:ce,bridge_name='br-int',has_traffic_filtering=True,id=80b77e2d-aa04-4996-a0c1-713054affac4,network=Network(cf0a4705-3fff-4716-87ac-b0ca7700e11c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80b77e2d-aa') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:49:36 user nova-compute[74190]: DEBUG nova.objects.instance [None req-30d58f71-8a45-4c4c-971e-c91109f948ec tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lazy-loading 'pci_devices' on Instance uuid c280652c-ffde-40f8-a919-adb8be618db8 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:49:36 user nova-compute[74190]: DEBUG nova.objects.base [None req-30d58f71-8a45-4c4c-971e-c91109f948ec tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Object Instance<c280652c-ffde-40f8-a919-adb8be618db8> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74190) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 11:49:36 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-30d58f71-8a45-4c4c-971e-c91109f948ec tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: c280652c-ffde-40f8-a919-adb8be618db8] End _get_guest_xml xml=<domain type="kvm">
Oct 18 11:49:36 user nova-compute[74190]:   <uuid>c280652c-ffde-40f8-a919-adb8be618db8</uuid>
Oct 18 11:49:36 user nova-compute[74190]:   <name>instance-00000001</name>
Oct 18 11:49:36 user nova-compute[74190]:   <memory>524288</memory>
Oct 18 11:49:36 user nova-compute[74190]:   <vcpu>1</vcpu>
Oct 18 11:49:36 user nova-compute[74190]:   <metadata>
Oct 18 11:49:36 user nova-compute[74190]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 11:49:36 user nova-compute[74190]:       <nova:package version="0.0.0"/>
Oct 18 11:49:36 user nova-compute[74190]:       <nova:name>tempest-AttachVolumeTestJSON-server-711461105</nova:name>
Oct 18 11:49:36 user nova-compute[74190]:       <nova:creationTime>2023-10-18 11:49:36</nova:creationTime>
Oct 18 11:49:36 user nova-compute[74190]:       <nova:flavor name="m1.tiny">
Oct 18 11:49:36 user nova-compute[74190]:         <nova:memory>512</nova:memory>
Oct 18 11:49:36 user nova-compute[74190]:         <nova:disk>1</nova:disk>
Oct 18 11:49:36 user nova-compute[74190]:         <nova:swap>0</nova:swap>
Oct 18 11:49:36 user nova-compute[74190]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 11:49:36 user nova-compute[74190]:         <nova:vcpus>1</nova:vcpus>
Oct 18 11:49:36 user nova-compute[74190]:       </nova:flavor>
Oct 18 11:49:36 user nova-compute[74190]:       <nova:owner>
Oct 18 11:49:36 user nova-compute[74190]:         <nova:user uuid="852309a19f1b4d49a4974c3be53f67cb">tempest-AttachVolumeTestJSON-2125017306-project-member</nova:user>
Oct 18 11:49:36 user nova-compute[74190]:         <nova:project uuid="99cf8d4d4f504e82868ed295e054644c">tempest-AttachVolumeTestJSON-2125017306</nova:project>
Oct 18 11:49:36 user nova-compute[74190]:       </nova:owner>
Oct 18 11:49:36 user nova-compute[74190]:       <nova:root type="image" uuid="6e88bbf0-6e78-49a8-b3c5-9453d22a89df"/>
Oct 18 11:49:36 user nova-compute[74190]:       <nova:ports>
Oct 18 11:49:36 user nova-compute[74190]:         <nova:port uuid="80b77e2d-aa04-4996-a0c1-713054affac4">
Oct 18 11:49:36 user nova-compute[74190]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 18 11:49:36 user nova-compute[74190]:         </nova:port>
Oct 18 11:49:36 user nova-compute[74190]:       </nova:ports>
Oct 18 11:49:36 user nova-compute[74190]:     </nova:instance>
Oct 18 11:49:36 user nova-compute[74190]:   </metadata>
Oct 18 11:49:36 user nova-compute[74190]:   <sysinfo type="smbios">
Oct 18 11:49:36 user nova-compute[74190]:     <system>
Oct 18 11:49:36 user nova-compute[74190]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 11:49:36 user nova-compute[74190]:       <entry name="product">OpenStack Nova</entry>
Oct 18 11:49:36 user nova-compute[74190]:       <entry name="version">0.0.0</entry>
Oct 18 11:49:36 user nova-compute[74190]:       <entry name="serial">c280652c-ffde-40f8-a919-adb8be618db8</entry>
Oct 18 11:49:36 user nova-compute[74190]:       <entry name="uuid">c280652c-ffde-40f8-a919-adb8be618db8</entry>
Oct 18 11:49:36 user nova-compute[74190]:       <entry name="family">Virtual Machine</entry>
Oct 18 11:49:36 user nova-compute[74190]:     </system>
Oct 18 11:49:36 user nova-compute[74190]:   </sysinfo>
Oct 18 11:49:36 user nova-compute[74190]:   <os>
Oct 18 11:49:36 user nova-compute[74190]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 11:49:36 user nova-compute[74190]:     <boot dev="hd"/>
Oct 18 11:49:36 user nova-compute[74190]:     <smbios mode="sysinfo"/>
Oct 18 11:49:36 user nova-compute[74190]:   </os>
Oct 18 11:49:36 user nova-compute[74190]:   <features>
Oct 18 11:49:36 user nova-compute[74190]:     <acpi/>
Oct 18 11:49:36 user nova-compute[74190]:     <apic/>
Oct 18 11:49:36 user nova-compute[74190]:     <vmcoreinfo/>
Oct 18 11:49:36 user nova-compute[74190]:   </features>
Oct 18 11:49:36 user nova-compute[74190]:   <clock offset="utc">
Oct 18 11:49:36 user nova-compute[74190]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 11:49:36 user nova-compute[74190]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 11:49:36 user nova-compute[74190]:     <timer name="hpet" present="no"/>
Oct 18 11:49:36 user nova-compute[74190]:   </clock>
Oct 18 11:49:36 user nova-compute[74190]:   <cpu mode="custom" match="exact">
Oct 18 11:49:36 user nova-compute[74190]:     <model>Nehalem</model>
Oct 18 11:49:36 user nova-compute[74190]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 11:49:36 user nova-compute[74190]:   </cpu>
Oct 18 11:49:36 user nova-compute[74190]:   <devices>
Oct 18 11:49:36 user nova-compute[74190]:     <disk type="file" device="disk">
Oct 18 11:49:36 user nova-compute[74190]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 11:49:36 user nova-compute[74190]:       <source file="/opt/stack/data/nova/instances/c280652c-ffde-40f8-a919-adb8be618db8/disk"/>
Oct 18 11:49:36 user nova-compute[74190]:       <target dev="vda" bus="virtio"/>
Oct 18 11:49:36 user nova-compute[74190]:     </disk>
Oct 18 11:49:36 user nova-compute[74190]:     <interface type="ethernet">
Oct 18 11:49:36 user nova-compute[74190]:       <mac address="fa:16:3e:4f:00:ce"/>
Oct 18 11:49:36 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:49:36 user nova-compute[74190]:       <mtu size="1442"/>
Oct 18 11:49:36 user nova-compute[74190]:       <target dev="tap80b77e2d-aa"/>
Oct 18 11:49:36 user nova-compute[74190]:     </interface>
Oct 18 11:49:36 user nova-compute[74190]:     <serial type="pty">
Oct 18 11:49:36 user nova-compute[74190]:       <log file="/opt/stack/data/nova/instances/c280652c-ffde-40f8-a919-adb8be618db8/console.log" append="off"/>
Oct 18 11:49:36 user nova-compute[74190]:     </serial>
Oct 18 11:49:36 user nova-compute[74190]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 11:49:36 user nova-compute[74190]:     <video>
Oct 18 11:49:36 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:49:36 user nova-compute[74190]:     </video>
Oct 18 11:49:36 user nova-compute[74190]:     <rng model="virtio">
Oct 18 11:49:36 user nova-compute[74190]:       <backend model="random">/dev/urandom</backend>
Oct 18 11:49:36 user nova-compute[74190]:     </rng>
Oct 18 11:49:36 user nova-compute[74190]:     <controller type="usb" index="0" model="none"/>
Oct 18 11:49:36 user nova-compute[74190]:     <memballoon model="virtio">
Oct 18 11:49:36 user nova-compute[74190]:       <stats period="10"/>
Oct 18 11:49:36 user nova-compute[74190]:     </memballoon>
Oct 18 11:49:36 user nova-compute[74190]:   </devices>
Oct 18 11:49:36 user nova-compute[74190]: </domain>
Oct 18 11:49:36 user nova-compute[74190]:  {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 11:49:36 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-30d58f71-8a45-4c4c-971e-c91109f948ec tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c280652c-ffde-40f8-a919-adb8be618db8/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:49:36 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 11:49:36 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-30d58f71-8a45-4c4c-971e-c91109f948ec tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c280652c-ffde-40f8-a919-adb8be618db8/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:49:36 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-30d58f71-8a45-4c4c-971e-c91109f948ec tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c280652c-ffde-40f8-a919-adb8be618db8/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:49:36 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 11:49:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.547s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:49:36 user nova-compute[74190]: DEBUG nova.compute.manager [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] [instance: cd28be8d-847b-468c-860f-4f479740738d] Start building networks asynchronously for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 11:49:37 user nova-compute[74190]: DEBUG nova.compute.manager [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] [instance: cd28be8d-847b-468c-860f-4f479740738d] Allocating IP information in the background. {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 11:49:37 user nova-compute[74190]: DEBUG nova.network.neutron [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] [instance: cd28be8d-847b-468c-860f-4f479740738d] allocate_for_instance() {{(pid=74190) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 11:49:37 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] [instance: cd28be8d-847b-468c-860f-4f479740738d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 11:49:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-30d58f71-8a45-4c4c-971e-c91109f948ec tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c280652c-ffde-40f8-a919-adb8be618db8/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:49:37 user nova-compute[74190]: DEBUG nova.objects.instance [None req-30d58f71-8a45-4c4c-971e-c91109f948ec tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lazy-loading 'trusted_certs' on Instance uuid c280652c-ffde-40f8-a919-adb8be618db8 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:49:37 user nova-compute[74190]: DEBUG nova.objects.base [None req-30d58f71-8a45-4c4c-971e-c91109f948ec tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Object Instance<c280652c-ffde-40f8-a919-adb8be618db8> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74190) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 11:49:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-30d58f71-8a45-4c4c-971e-c91109f948ec tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:49:37 user nova-compute[74190]: DEBUG nova.compute.manager [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] [instance: cd28be8d-847b-468c-860f-4f479740738d] Start building block device mappings for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 11:49:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-30d58f71-8a45-4c4c-971e-c91109f948ec tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.388s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:49:37 user nova-compute[74190]: DEBUG nova.virt.disk.api [None req-30d58f71-8a45-4c4c-971e-c91109f948ec tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c280652c-ffde-40f8-a919-adb8be618db8/disk. size=1073741824 {{(pid=74190) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 18 11:49:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-30d58f71-8a45-4c4c-971e-c91109f948ec tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c280652c-ffde-40f8-a919-adb8be618db8/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:49:37 user nova-compute[74190]: INFO nova.virt.block_device [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] [instance: cd28be8d-847b-468c-860f-4f479740738d] Booting with volume 40eb314e-5a7a-45f4-93f5-e67b23f6d02a at /dev/vda
Oct 18 11:49:37 user nova-compute[74190]: DEBUG os_brick.utils [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:49:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:49:37 user nova-compute[74190]: DEBUG nova.policy [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd8f517ba22b1494ca5700e014e7ab8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daccec0feffd445492c3ab4ff40bcde2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74190) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 11:49:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:49:37 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff80014f-4af9-4087-a2e4-339f61bc645a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cff158e257e1\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:49:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:49:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-30d58f71-8a45-4c4c-971e-c91109f948ec tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c280652c-ffde-40f8-a919-adb8be618db8/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:49:37 user nova-compute[74190]: DEBUG nova.virt.disk.api [None req-30d58f71-8a45-4c4c-971e-c91109f948ec tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Cannot resize image /opt/stack/data/nova/instances/c280652c-ffde-40f8-a919-adb8be618db8/disk to a smaller size. {{(pid=74190) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 18 11:49:37 user nova-compute[74190]: DEBUG nova.objects.instance [None req-30d58f71-8a45-4c4c-971e-c91109f948ec tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lazy-loading 'migration_context' on Instance uuid c280652c-ffde-40f8-a919-adb8be618db8 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:49:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:49:37 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f425e87-2f9d-4000-8540-765ed03d8fdc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:49:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:49:37 user nova-compute[74190]: DEBUG nova.objects.base [None req-30d58f71-8a45-4c4c-971e-c91109f948ec tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Object Instance<c280652c-ffde-40f8-a919-adb8be618db8> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74190) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 11:49:37 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-30d58f71-8a45-4c4c-971e-c91109f948ec tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:40:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-711461105',display_name='tempest-AttachVolumeTestJSON-server-711461105',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-711461105',id=1,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPnE2mtL+LbI3yVW2kYaN2Dxz5V1+PIccsOPxNaLovIe8VN7EUmA+C39USstHm9Yifnik7GFCenLhGnFytwIhcv6ox30HzhlwfaoDrZEfYtFLQ2I1/Og7nqCIt/6qIOiKA==',key_name='tempest-keypair-355856933',keypairs=<?>,launch_index=0,launched_at=2023-10-18T11:41:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='99cf8d4d4f504e82868ed295e054644c',ramdisk_id='',reservation_id='r-zf27bcaw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2125017306',owner_user_name='tempest-AttachVolumeTestJSON-2125017306-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:47:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='852309a19f1b4d49a4974c3be53f67cb',uuid=c280652c-ffde-40f8-a919-adb8be618db8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "80b77e2d-aa04-4996-a0c1-713054affac4", "address": "fa:16:3e:4f:00:ce", "network": {"id": "cf0a4705-3fff-4716-87ac-b0ca7700e11c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1739631852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cf8d4d4f504e82868ed295e054644c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80b77e2d-aa", "ovs_interfaceid": "80b77e2d-aa04-4996-a0c1-713054affac4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 11:49:37 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-30d58f71-8a45-4c4c-971e-c91109f948ec tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Converting VIF {"id": "80b77e2d-aa04-4996-a0c1-713054affac4", "address": "fa:16:3e:4f:00:ce", "network": {"id": "cf0a4705-3fff-4716-87ac-b0ca7700e11c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1739631852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cf8d4d4f504e82868ed295e054644c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80b77e2d-aa", "ovs_interfaceid": "80b77e2d-aa04-4996-a0c1-713054affac4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:49:37 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-30d58f71-8a45-4c4c-971e-c91109f948ec tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:00:ce,bridge_name='br-int',has_traffic_filtering=True,id=80b77e2d-aa04-4996-a0c1-713054affac4,network=Network(cf0a4705-3fff-4716-87ac-b0ca7700e11c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80b77e2d-aa') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:49:37 user nova-compute[74190]: DEBUG os_vif [None req-30d58f71-8a45-4c4c-971e-c91109f948ec tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:00:ce,bridge_name='br-int',has_traffic_filtering=True,id=80b77e2d-aa04-4996-a0c1-713054affac4,network=Network(cf0a4705-3fff-4716-87ac-b0ca7700e11c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80b77e2d-aa') {{(pid=74190) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 11:49:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:49:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:49:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 11:49:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:49:37 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c4e3a68-0627-4ca9-b3a4-a6a814d88faa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:49:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:49:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2576e2aa-e5b5-5773-b422-eed291832674', '_type': 'linux-noop'}}, row=False) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:49:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:49:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:49:37 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[58fbe8d9-21c9-4c59-ab27-dc2ede32c537]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:49:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Running cmd (subprocess): nvme version {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:49:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] 'nvme version' failed. Not Retrying. {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 11:49:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] nvme not present on system {{(pid=74190) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 11:49:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:49:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap80b77e2d-aa, may_exist=True, interface_attrs={}) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:49:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap80b77e2d-aa, col_values=(('qos', UUID('a73eced4-d94b-4742-96ef-ed15e581db6d')),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:49:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap80b77e2d-aa, col_values=(('external_ids', {'iface-id': '80b77e2d-aa04-4996-a0c1-713054affac4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:00:ce', 'vm-uuid': 'c280652c-ffde-40f8-a919-adb8be618db8'}),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:49:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:49:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:49:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:49:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 11:49:37 user nova-compute[74190]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 11:49:37 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a2111e-4572-40cd-9bb6-807f253385c0]: (4, '') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:49:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74190) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 11:49:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 11:49:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] LIGHTOS: no hostnqn found. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 11:49:37 user nova-compute[74190]: DEBUG os_brick.utils [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cff158e257e1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:49:37 user nova-compute[74190]: DEBUG nova.virt.block_device [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] [instance: cd28be8d-847b-468c-860f-4f479740738d] Updating existing volume attachment record: 4454359b-a19d-4476-8487-019a400646aa {{(pid=74190) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 11:49:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:49:37 user nova-compute[74190]: INFO os_vif [None req-30d58f71-8a45-4c4c-971e-c91109f948ec tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:00:ce,bridge_name='br-int',has_traffic_filtering=True,id=80b77e2d-aa04-4996-a0c1-713054affac4,network=Network(cf0a4705-3fff-4716-87ac-b0ca7700e11c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80b77e2d-aa')
Oct 18 11:49:38 user nova-compute[74190]: DEBUG nova.network.neutron [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] [instance: cd28be8d-847b-468c-860f-4f479740738d] Successfully created port: c2ed33ff-2096-4def-98c5-709db8bc0ea4 {{(pid=74190) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 11:49:38 user nova-compute[74190]: DEBUG nova.network.neutron [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] [instance: cd28be8d-847b-468c-860f-4f479740738d] Successfully created port: 0a00abcf-957e-4276-a975-522f8a42ad55 {{(pid=74190) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 11:49:39 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:49:39 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:49:39 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:49:39 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:49:39 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:49:39 user nova-compute[74190]: DEBUG nova.network.neutron [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] [instance: cd28be8d-847b-468c-860f-4f479740738d] Successfully created port: 11c7c4ff-db41-4231-8300-ee85a94619c1 {{(pid=74190) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 11:49:39 user nova-compute[74190]: DEBUG nova.compute.manager [req-eb57f189-46c0-42a9-ae36-a3123ef84b85 req-78dc404c-e262-4a95-9ba6-0e7d9900b5ba service nova] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Received event network-vif-plugged-80b77e2d-aa04-4996-a0c1-713054affac4 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:49:39 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-eb57f189-46c0-42a9-ae36-a3123ef84b85 req-78dc404c-e262-4a95-9ba6-0e7d9900b5ba service nova] Acquiring lock "c280652c-ffde-40f8-a919-adb8be618db8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:49:39 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-eb57f189-46c0-42a9-ae36-a3123ef84b85 req-78dc404c-e262-4a95-9ba6-0e7d9900b5ba service nova] Lock "c280652c-ffde-40f8-a919-adb8be618db8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:49:39 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-eb57f189-46c0-42a9-ae36-a3123ef84b85 req-78dc404c-e262-4a95-9ba6-0e7d9900b5ba service nova] Lock "c280652c-ffde-40f8-a919-adb8be618db8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:49:39 user nova-compute[74190]: DEBUG nova.compute.manager [req-eb57f189-46c0-42a9-ae36-a3123ef84b85 req-78dc404c-e262-4a95-9ba6-0e7d9900b5ba service nova] [instance: c280652c-ffde-40f8-a919-adb8be618db8] No waiting events found dispatching network-vif-plugged-80b77e2d-aa04-4996-a0c1-713054affac4 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:49:39 user nova-compute[74190]: WARNING nova.compute.manager [req-eb57f189-46c0-42a9-ae36-a3123ef84b85 req-78dc404c-e262-4a95-9ba6-0e7d9900b5ba service nova] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Received unexpected event network-vif-plugged-80b77e2d-aa04-4996-a0c1-713054affac4 for instance with vm_state stopped and task_state powering-on.
Oct 18 11:49:39 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:49:39 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:49:39 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:49:39 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:49:40 user nova-compute[74190]: DEBUG nova.network.neutron [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] [instance: cd28be8d-847b-468c-860f-4f479740738d] Successfully created port: dba85cc3-dd42-4fa4-96d3-bec15903344f {{(pid=74190) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 11:49:40 user nova-compute[74190]: DEBUG nova.network.neutron [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] [instance: cd28be8d-847b-468c-860f-4f479740738d] Successfully created port: 35f010df-56fb-4234-879b-19f86f36a2d3 {{(pid=74190) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 11:49:41 user nova-compute[74190]: DEBUG nova.network.neutron [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] [instance: cd28be8d-847b-468c-860f-4f479740738d] Successfully updated port: c2ed33ff-2096-4def-98c5-709db8bc0ea4 {{(pid=74190) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 11:49:41 user nova-compute[74190]: DEBUG nova.compute.manager [req-83cc8dea-5d05-4f7e-b6c2-fc643d06b1ca req-6be622d2-67da-465d-8957-8bd341a00e4c service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Received event network-changed-c2ed33ff-2096-4def-98c5-709db8bc0ea4 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:49:41 user nova-compute[74190]: DEBUG nova.compute.manager [req-83cc8dea-5d05-4f7e-b6c2-fc643d06b1ca req-6be622d2-67da-465d-8957-8bd341a00e4c service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Refreshing instance network info cache due to event network-changed-c2ed33ff-2096-4def-98c5-709db8bc0ea4. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 11:49:41 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-83cc8dea-5d05-4f7e-b6c2-fc643d06b1ca req-6be622d2-67da-465d-8957-8bd341a00e4c service nova] Acquiring lock "refresh_cache-cd28be8d-847b-468c-860f-4f479740738d" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:49:41 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-83cc8dea-5d05-4f7e-b6c2-fc643d06b1ca req-6be622d2-67da-465d-8957-8bd341a00e4c service nova] Acquired lock "refresh_cache-cd28be8d-847b-468c-860f-4f479740738d" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:49:41 user nova-compute[74190]: DEBUG nova.network.neutron [req-83cc8dea-5d05-4f7e-b6c2-fc643d06b1ca req-6be622d2-67da-465d-8957-8bd341a00e4c service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Refreshing network info cache for port c2ed33ff-2096-4def-98c5-709db8bc0ea4 {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 11:49:41 user nova-compute[74190]: DEBUG nova.network.neutron [req-83cc8dea-5d05-4f7e-b6c2-fc643d06b1ca req-6be622d2-67da-465d-8957-8bd341a00e4c service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Instance cache missing network info. {{(pid=74190) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 11:49:41 user nova-compute[74190]: DEBUG nova.network.neutron [req-83cc8dea-5d05-4f7e-b6c2-fc643d06b1ca req-6be622d2-67da-465d-8957-8bd341a00e4c service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Updating instance_info_cache with network_info: [] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:49:41 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-83cc8dea-5d05-4f7e-b6c2-fc643d06b1ca req-6be622d2-67da-465d-8957-8bd341a00e4c service nova] Releasing lock "refresh_cache-cd28be8d-847b-468c-860f-4f479740738d" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:49:41 user nova-compute[74190]: DEBUG nova.compute.manager [None req-30d58f71-8a45-4c4c-971e-c91109f948ec tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Instance event wait completed in 0 seconds for  {{(pid=74190) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 11:49:41 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Instance rebooted successfully.
Oct 18 11:49:41 user nova-compute[74190]: DEBUG nova.compute.manager [None req-30d58f71-8a45-4c4c-971e-c91109f948ec tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Checking state {{(pid=74190) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 11:49:41 user nova-compute[74190]: DEBUG nova.compute.manager [req-11260a3c-4447-47d3-befb-666a3399ab93 req-92fdb245-1cb1-45a3-a30b-f444cade40a4 service nova] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Received event network-vif-plugged-80b77e2d-aa04-4996-a0c1-713054affac4 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:49:41 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-11260a3c-4447-47d3-befb-666a3399ab93 req-92fdb245-1cb1-45a3-a30b-f444cade40a4 service nova] Acquiring lock "c280652c-ffde-40f8-a919-adb8be618db8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:49:41 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-11260a3c-4447-47d3-befb-666a3399ab93 req-92fdb245-1cb1-45a3-a30b-f444cade40a4 service nova] Lock "c280652c-ffde-40f8-a919-adb8be618db8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:49:41 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-11260a3c-4447-47d3-befb-666a3399ab93 req-92fdb245-1cb1-45a3-a30b-f444cade40a4 service nova] Lock "c280652c-ffde-40f8-a919-adb8be618db8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:49:41 user nova-compute[74190]: DEBUG nova.compute.manager [req-11260a3c-4447-47d3-befb-666a3399ab93 req-92fdb245-1cb1-45a3-a30b-f444cade40a4 service nova] [instance: c280652c-ffde-40f8-a919-adb8be618db8] No waiting events found dispatching network-vif-plugged-80b77e2d-aa04-4996-a0c1-713054affac4 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:49:41 user nova-compute[74190]: WARNING nova.compute.manager [req-11260a3c-4447-47d3-befb-666a3399ab93 req-92fdb245-1cb1-45a3-a30b-f444cade40a4 service nova] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Received unexpected event network-vif-plugged-80b77e2d-aa04-4996-a0c1-713054affac4 for instance with vm_state stopped and task_state powering-on.
Oct 18 11:49:42 user nova-compute[74190]: DEBUG nova.network.neutron [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] [instance: cd28be8d-847b-468c-860f-4f479740738d] Successfully updated port: aca29f48-4a6d-472a-ac70-7006b63b9996 {{(pid=74190) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 11:49:42 user nova-compute[74190]: DEBUG nova.network.neutron [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] [instance: cd28be8d-847b-468c-860f-4f479740738d] Successfully updated port: d5f803c0-bb6c-41be-8294-fb3565e03413 {{(pid=74190) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 11:49:42 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:49:43 user nova-compute[74190]: DEBUG nova.compute.manager [req-25baa92c-8777-47fe-a264-aa3bc7f3c775 req-86dcd8fa-01cd-4b2b-a6ac-66f5310db20f service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Received event network-changed-aca29f48-4a6d-472a-ac70-7006b63b9996 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:49:43 user nova-compute[74190]: DEBUG nova.compute.manager [req-25baa92c-8777-47fe-a264-aa3bc7f3c775 req-86dcd8fa-01cd-4b2b-a6ac-66f5310db20f service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Refreshing instance network info cache due to event network-changed-aca29f48-4a6d-472a-ac70-7006b63b9996. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 11:49:43 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-25baa92c-8777-47fe-a264-aa3bc7f3c775 req-86dcd8fa-01cd-4b2b-a6ac-66f5310db20f service nova] Acquiring lock "refresh_cache-cd28be8d-847b-468c-860f-4f479740738d" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:49:43 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-25baa92c-8777-47fe-a264-aa3bc7f3c775 req-86dcd8fa-01cd-4b2b-a6ac-66f5310db20f service nova] Acquired lock "refresh_cache-cd28be8d-847b-468c-860f-4f479740738d" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:49:43 user nova-compute[74190]: DEBUG nova.network.neutron [req-25baa92c-8777-47fe-a264-aa3bc7f3c775 req-86dcd8fa-01cd-4b2b-a6ac-66f5310db20f service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Refreshing network info cache for port aca29f48-4a6d-472a-ac70-7006b63b9996 {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 11:49:43 user nova-compute[74190]: DEBUG nova.network.neutron [req-25baa92c-8777-47fe-a264-aa3bc7f3c775 req-86dcd8fa-01cd-4b2b-a6ac-66f5310db20f service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Instance cache missing network info. {{(pid=74190) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 11:49:43 user nova-compute[74190]: DEBUG nova.network.neutron [req-25baa92c-8777-47fe-a264-aa3bc7f3c775 req-86dcd8fa-01cd-4b2b-a6ac-66f5310db20f service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Updating instance_info_cache with network_info: [] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:49:43 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-25baa92c-8777-47fe-a264-aa3bc7f3c775 req-86dcd8fa-01cd-4b2b-a6ac-66f5310db20f service nova] Releasing lock "refresh_cache-cd28be8d-847b-468c-860f-4f479740738d" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:49:43 user nova-compute[74190]: DEBUG nova.compute.manager [req-25baa92c-8777-47fe-a264-aa3bc7f3c775 req-86dcd8fa-01cd-4b2b-a6ac-66f5310db20f service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Received event network-changed-d5f803c0-bb6c-41be-8294-fb3565e03413 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:49:43 user nova-compute[74190]: DEBUG nova.compute.manager [req-25baa92c-8777-47fe-a264-aa3bc7f3c775 req-86dcd8fa-01cd-4b2b-a6ac-66f5310db20f service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Refreshing instance network info cache due to event network-changed-d5f803c0-bb6c-41be-8294-fb3565e03413. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 11:49:43 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-25baa92c-8777-47fe-a264-aa3bc7f3c775 req-86dcd8fa-01cd-4b2b-a6ac-66f5310db20f service nova] Acquiring lock "refresh_cache-cd28be8d-847b-468c-860f-4f479740738d" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:49:43 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-25baa92c-8777-47fe-a264-aa3bc7f3c775 req-86dcd8fa-01cd-4b2b-a6ac-66f5310db20f service nova] Acquired lock "refresh_cache-cd28be8d-847b-468c-860f-4f479740738d" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:49:43 user nova-compute[74190]: DEBUG nova.network.neutron [req-25baa92c-8777-47fe-a264-aa3bc7f3c775 req-86dcd8fa-01cd-4b2b-a6ac-66f5310db20f service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Refreshing network info cache for port d5f803c0-bb6c-41be-8294-fb3565e03413 {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 11:49:43 user nova-compute[74190]: DEBUG nova.network.neutron [req-25baa92c-8777-47fe-a264-aa3bc7f3c775 req-86dcd8fa-01cd-4b2b-a6ac-66f5310db20f service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Instance cache missing network info. {{(pid=74190) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 11:49:43 user nova-compute[74190]: DEBUG nova.network.neutron [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] [instance: cd28be8d-847b-468c-860f-4f479740738d] Successfully updated port: 0a00abcf-957e-4276-a975-522f8a42ad55 {{(pid=74190) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 11:49:43 user nova-compute[74190]: DEBUG nova.network.neutron [req-25baa92c-8777-47fe-a264-aa3bc7f3c775 req-86dcd8fa-01cd-4b2b-a6ac-66f5310db20f service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Updating instance_info_cache with network_info: [] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:49:43 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-25baa92c-8777-47fe-a264-aa3bc7f3c775 req-86dcd8fa-01cd-4b2b-a6ac-66f5310db20f service nova] Releasing lock "refresh_cache-cd28be8d-847b-468c-860f-4f479740738d" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:49:44 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:49:44 user nova-compute[74190]: DEBUG nova.network.neutron [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] [instance: cd28be8d-847b-468c-860f-4f479740738d] Successfully updated port: 11c7c4ff-db41-4231-8300-ee85a94619c1 {{(pid=74190) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 11:49:45 user nova-compute[74190]: DEBUG nova.network.neutron [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] [instance: cd28be8d-847b-468c-860f-4f479740738d] Successfully updated port: dba85cc3-dd42-4fa4-96d3-bec15903344f {{(pid=74190) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 11:49:45 user nova-compute[74190]: DEBUG nova.compute.manager [req-9d586e94-b54c-476b-a160-343b6dd1ede2 req-1ee20d3d-4c36-4767-86d1-914a56edaf3b service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Received event network-changed-0a00abcf-957e-4276-a975-522f8a42ad55 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:49:45 user nova-compute[74190]: DEBUG nova.compute.manager [req-9d586e94-b54c-476b-a160-343b6dd1ede2 req-1ee20d3d-4c36-4767-86d1-914a56edaf3b service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Refreshing instance network info cache due to event network-changed-0a00abcf-957e-4276-a975-522f8a42ad55. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 11:49:45 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-9d586e94-b54c-476b-a160-343b6dd1ede2 req-1ee20d3d-4c36-4767-86d1-914a56edaf3b service nova] Acquiring lock "refresh_cache-cd28be8d-847b-468c-860f-4f479740738d" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:49:45 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-9d586e94-b54c-476b-a160-343b6dd1ede2 req-1ee20d3d-4c36-4767-86d1-914a56edaf3b service nova] Acquired lock "refresh_cache-cd28be8d-847b-468c-860f-4f479740738d" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:49:45 user nova-compute[74190]: DEBUG nova.network.neutron [req-9d586e94-b54c-476b-a160-343b6dd1ede2 req-1ee20d3d-4c36-4767-86d1-914a56edaf3b service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Refreshing network info cache for port 0a00abcf-957e-4276-a975-522f8a42ad55 {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 11:49:45 user nova-compute[74190]: DEBUG nova.network.neutron [req-9d586e94-b54c-476b-a160-343b6dd1ede2 req-1ee20d3d-4c36-4767-86d1-914a56edaf3b service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Instance cache missing network info. {{(pid=74190) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 11:49:45 user nova-compute[74190]: DEBUG nova.network.neutron [req-9d586e94-b54c-476b-a160-343b6dd1ede2 req-1ee20d3d-4c36-4767-86d1-914a56edaf3b service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Updating instance_info_cache with network_info: [] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:49:45 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-9d586e94-b54c-476b-a160-343b6dd1ede2 req-1ee20d3d-4c36-4767-86d1-914a56edaf3b service nova] Releasing lock "refresh_cache-cd28be8d-847b-468c-860f-4f479740738d" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:49:45 user nova-compute[74190]: DEBUG nova.compute.manager [req-9d586e94-b54c-476b-a160-343b6dd1ede2 req-1ee20d3d-4c36-4767-86d1-914a56edaf3b service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Received event network-changed-11c7c4ff-db41-4231-8300-ee85a94619c1 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:49:45 user nova-compute[74190]: DEBUG nova.compute.manager [req-9d586e94-b54c-476b-a160-343b6dd1ede2 req-1ee20d3d-4c36-4767-86d1-914a56edaf3b service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Refreshing instance network info cache due to event network-changed-11c7c4ff-db41-4231-8300-ee85a94619c1. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 11:49:45 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-9d586e94-b54c-476b-a160-343b6dd1ede2 req-1ee20d3d-4c36-4767-86d1-914a56edaf3b service nova] Acquiring lock "refresh_cache-cd28be8d-847b-468c-860f-4f479740738d" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:49:45 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-9d586e94-b54c-476b-a160-343b6dd1ede2 req-1ee20d3d-4c36-4767-86d1-914a56edaf3b service nova] Acquired lock "refresh_cache-cd28be8d-847b-468c-860f-4f479740738d" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:49:45 user nova-compute[74190]: DEBUG nova.network.neutron [req-9d586e94-b54c-476b-a160-343b6dd1ede2 req-1ee20d3d-4c36-4767-86d1-914a56edaf3b service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Refreshing network info cache for port 11c7c4ff-db41-4231-8300-ee85a94619c1 {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 11:49:45 user nova-compute[74190]: DEBUG nova.network.neutron [req-9d586e94-b54c-476b-a160-343b6dd1ede2 req-1ee20d3d-4c36-4767-86d1-914a56edaf3b service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Instance cache missing network info. {{(pid=74190) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 11:49:45 user nova-compute[74190]: DEBUG nova.network.neutron [req-9d586e94-b54c-476b-a160-343b6dd1ede2 req-1ee20d3d-4c36-4767-86d1-914a56edaf3b service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Updating instance_info_cache with network_info: [] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:49:45 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-9d586e94-b54c-476b-a160-343b6dd1ede2 req-1ee20d3d-4c36-4767-86d1-914a56edaf3b service nova] Releasing lock "refresh_cache-cd28be8d-847b-468c-860f-4f479740738d" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:49:45 user nova-compute[74190]: DEBUG nova.compute.manager [req-9d586e94-b54c-476b-a160-343b6dd1ede2 req-1ee20d3d-4c36-4767-86d1-914a56edaf3b service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Received event network-changed-dba85cc3-dd42-4fa4-96d3-bec15903344f {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:49:45 user nova-compute[74190]: DEBUG nova.compute.manager [req-9d586e94-b54c-476b-a160-343b6dd1ede2 req-1ee20d3d-4c36-4767-86d1-914a56edaf3b service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Refreshing instance network info cache due to event network-changed-dba85cc3-dd42-4fa4-96d3-bec15903344f. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 11:49:45 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-9d586e94-b54c-476b-a160-343b6dd1ede2 req-1ee20d3d-4c36-4767-86d1-914a56edaf3b service nova] Acquiring lock "refresh_cache-cd28be8d-847b-468c-860f-4f479740738d" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:49:45 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-9d586e94-b54c-476b-a160-343b6dd1ede2 req-1ee20d3d-4c36-4767-86d1-914a56edaf3b service nova] Acquired lock "refresh_cache-cd28be8d-847b-468c-860f-4f479740738d" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:49:45 user nova-compute[74190]: DEBUG nova.network.neutron [req-9d586e94-b54c-476b-a160-343b6dd1ede2 req-1ee20d3d-4c36-4767-86d1-914a56edaf3b service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Refreshing network info cache for port dba85cc3-dd42-4fa4-96d3-bec15903344f {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 11:49:45 user nova-compute[74190]: DEBUG nova.network.neutron [req-9d586e94-b54c-476b-a160-343b6dd1ede2 req-1ee20d3d-4c36-4767-86d1-914a56edaf3b service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Instance cache missing network info. {{(pid=74190) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 11:49:46 user nova-compute[74190]: DEBUG nova.network.neutron [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] [instance: cd28be8d-847b-468c-860f-4f479740738d] Successfully updated port: 35f010df-56fb-4234-879b-19f86f36a2d3 {{(pid=74190) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 11:49:46 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Acquiring lock "refresh_cache-cd28be8d-847b-468c-860f-4f479740738d" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:49:46 user nova-compute[74190]: DEBUG nova.network.neutron [req-9d586e94-b54c-476b-a160-343b6dd1ede2 req-1ee20d3d-4c36-4767-86d1-914a56edaf3b service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Updating instance_info_cache with network_info: [] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:49:46 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-9d586e94-b54c-476b-a160-343b6dd1ede2 req-1ee20d3d-4c36-4767-86d1-914a56edaf3b service nova] Releasing lock "refresh_cache-cd28be8d-847b-468c-860f-4f479740738d" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:49:46 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Acquired lock "refresh_cache-cd28be8d-847b-468c-860f-4f479740738d" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:49:46 user nova-compute[74190]: DEBUG nova.network.neutron [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] [instance: cd28be8d-847b-468c-860f-4f479740738d] Building network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 11:49:46 user nova-compute[74190]: DEBUG nova.network.neutron [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] [instance: cd28be8d-847b-468c-860f-4f479740738d] Instance cache missing network info. {{(pid=74190) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 11:49:47 user nova-compute[74190]: DEBUG nova.compute.manager [req-50b83683-07fd-41c5-ae91-b3e056fcabd7 req-a18e86e1-2313-4b00-960c-4aa739c94219 service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Received event network-changed-35f010df-56fb-4234-879b-19f86f36a2d3 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:49:47 user nova-compute[74190]: DEBUG nova.compute.manager [req-50b83683-07fd-41c5-ae91-b3e056fcabd7 req-a18e86e1-2313-4b00-960c-4aa739c94219 service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Refreshing instance network info cache due to event network-changed-35f010df-56fb-4234-879b-19f86f36a2d3. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 11:49:47 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-50b83683-07fd-41c5-ae91-b3e056fcabd7 req-a18e86e1-2313-4b00-960c-4aa739c94219 service nova] Acquiring lock "refresh_cache-cd28be8d-847b-468c-860f-4f479740738d" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:49:47 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:49:48 user nova-compute[74190]: DEBUG nova.network.neutron [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] [instance: cd28be8d-847b-468c-860f-4f479740738d] Updating instance_info_cache with network_info: [{"id": "c2ed33ff-2096-4def-98c5-709db8bc0ea4", "address": "fa:16:3e:11:db:57", "network": {"id": "bef90182-e108-423e-842c-2037d5cc1a4b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-640378484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ed33ff-20", "ovs_interfaceid": "c2ed33ff-2096-4def-98c5-709db8bc0ea4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "aca29f48-4a6d-472a-ac70-7006b63b9996", "address": "fa:16:3e:71:0a:c4", "network": {"id": "50f9056b-d85d-4a43-8981-3c5c98e1bf52", "bridge": "br-int", "label": "tempest-device-tagging-net1-737454421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaca29f48-4a", "ovs_interfaceid": "aca29f48-4a6d-472a-ac70-7006b63b9996", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d5f803c0-bb6c-41be-8294-fb3565e03413", "address": "fa:16:3e:43:be:0d", "network": {"id": "50f9056b-d85d-4a43-8981-3c5c98e1bf52", "bridge": "br-int", "label": "tempest-device-tagging-net1-737454421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f803c0-bb", "ovs_interfaceid": "d5f803c0-bb6c-41be-8294-fb3565e03413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0a00abcf-957e-4276-a975-522f8a42ad55", "address": "fa:16:3e:c8:b9:46", "network": {"id": "50f9056b-d85d-4a43-8981-3c5c98e1bf52", "bridge": "br-int", "label": "tempest-device-tagging-net1-737454421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a00abcf-95", "ovs_interfaceid": "0a00abcf-957e-4276-a975-522f8a42ad55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "11c7c4ff-db41-4231-8300-ee85a94619c1", "address": "fa:16:3e:ca:c8:e5", "network": {"id": "50f9056b-d85d-4a43-8981-3c5c98e1bf52", "bridge": "br-int", "label": "tempest-device-tagging-net1-737454421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11c7c4ff-db", "ovs_interfaceid": "11c7c4ff-db41-4231-8300-ee85a94619c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dba85cc3-dd42-4fa4-96d3-bec15903344f", "address": "fa:16:3e:fb:32:89", "network": {"id": "1ba257ec-d104-413d-bbf9-d9702ed5a1b4", "bridge": "br-int", "label": "tempest-device-tagging-net2-445498545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdba85cc3-dd", "ovs_interfaceid": "dba85cc3-dd42-4fa4-96d3-bec15903344f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "35f010df-56fb-4234-879b-19f86f36a2d3", "address": "fa:16:3e:bf:a7:36", "network": {"id": "1ba257ec-d104-413d-bbf9-d9702ed5a1b4", "bridge": "br-int", "label": "tempest-device-tagging-net2-445498545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35f010df-56", "ovs_interfaceid": "35f010df-56fb-4234-879b-19f86f36a2d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:49:48 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Releasing lock "refresh_cache-cd28be8d-847b-468c-860f-4f479740738d" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:49:48 user nova-compute[74190]: DEBUG nova.compute.manager [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] [instance: cd28be8d-847b-468c-860f-4f479740738d] Instance network_info: |[{"id": "c2ed33ff-2096-4def-98c5-709db8bc0ea4", "address": "fa:16:3e:11:db:57", "network": {"id": "bef90182-e108-423e-842c-2037d5cc1a4b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-640378484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ed33ff-20", "ovs_interfaceid": "c2ed33ff-2096-4def-98c5-709db8bc0ea4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "aca29f48-4a6d-472a-ac70-7006b63b9996", "address": "fa:16:3e:71:0a:c4", "network": {"id": "50f9056b-d85d-4a43-8981-3c5c98e1bf52", "bridge": "br-int", "label": "tempest-device-tagging-net1-737454421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaca29f48-4a", "ovs_interfaceid": "aca29f48-4a6d-472a-ac70-7006b63b9996", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d5f803c0-bb6c-41be-8294-fb3565e03413", "address": "fa:16:3e:43:be:0d", "network": {"id": "50f9056b-d85d-4a43-8981-3c5c98e1bf52", "bridge": "br-int", "label": "tempest-device-tagging-net1-737454421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f803c0-bb", "ovs_interfaceid": "d5f803c0-bb6c-41be-8294-fb3565e03413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0a00abcf-957e-4276-a975-522f8a42ad55", "address": "fa:16:3e:c8:b9:46", "network": {"id": "50f9056b-d85d-4a43-8981-3c5c98e1bf52", "bridge": "br-int", "label": "tempest-device-tagging-net1-737454421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a00abcf-95", "ovs_interfaceid": "0a00abcf-957e-4276-a975-522f8a42ad55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "11c7c4ff-db41-4231-8300-ee85a94619c1", "address": "fa:16:3e:ca:c8:e5", "network": {"id": "50f9056b-d85d-4a43-8981-3c5c98e1bf52", "bridge": "br-int", "label": "tempest-device-tagging-net1-737454421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11c7c4ff-db", "ovs_interfaceid": "11c7c4ff-db41-4231-8300-ee85a94619c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dba85cc3-dd42-4fa4-96d3-bec15903344f", "address": "fa:16:3e:fb:32:89", "network": {"id": "1ba257ec-d104-413d-bbf9-d9702ed5a1b4", "bridge": "br-int", "label": "tempest-device-tagging-net2-445498545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdba85cc3-dd", "ovs_interfaceid": "dba85cc3-dd42-4fa4-96d3-bec15903344f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "35f010df-56fb-4234-879b-19f86f36a2d3", "address": "fa:16:3e:bf:a7:36", "network": {"id": "1ba257ec-d104-413d-bbf9-d9702ed5a1b4", "bridge": "br-int", "label": "tempest-device-tagging-net2-445498545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35f010df-56", "ovs_interfaceid": "35f010df-56fb-4234-879b-19f86f36a2d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 11:49:48 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-50b83683-07fd-41c5-ae91-b3e056fcabd7 req-a18e86e1-2313-4b00-960c-4aa739c94219 service nova] Acquired lock "refresh_cache-cd28be8d-847b-468c-860f-4f479740738d" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:49:48 user nova-compute[74190]: DEBUG nova.network.neutron [req-50b83683-07fd-41c5-ae91-b3e056fcabd7 req-a18e86e1-2313-4b00-960c-4aa739c94219 service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Refreshing network info cache for port 35f010df-56fb-4234-879b-19f86f36a2d3 {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 11:49:49 user nova-compute[74190]: DEBUG nova.network.neutron [req-50b83683-07fd-41c5-ae91-b3e056fcabd7 req-a18e86e1-2313-4b00-960c-4aa739c94219 service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Updated VIF entry in instance network info cache for port 35f010df-56fb-4234-879b-19f86f36a2d3. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 11:49:49 user nova-compute[74190]: DEBUG nova.network.neutron [req-50b83683-07fd-41c5-ae91-b3e056fcabd7 req-a18e86e1-2313-4b00-960c-4aa739c94219 service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Updating instance_info_cache with network_info: [{"id": "c2ed33ff-2096-4def-98c5-709db8bc0ea4", "address": "fa:16:3e:11:db:57", "network": {"id": "bef90182-e108-423e-842c-2037d5cc1a4b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-640378484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ed33ff-20", "ovs_interfaceid": "c2ed33ff-2096-4def-98c5-709db8bc0ea4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "aca29f48-4a6d-472a-ac70-7006b63b9996", "address": "fa:16:3e:71:0a:c4", "network": {"id": "50f9056b-d85d-4a43-8981-3c5c98e1bf52", "bridge": "br-int", "label": "tempest-device-tagging-net1-737454421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaca29f48-4a", "ovs_interfaceid": "aca29f48-4a6d-472a-ac70-7006b63b9996", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d5f803c0-bb6c-41be-8294-fb3565e03413", "address": "fa:16:3e:43:be:0d", "network": {"id": "50f9056b-d85d-4a43-8981-3c5c98e1bf52", "bridge": "br-int", "label": "tempest-device-tagging-net1-737454421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f803c0-bb", "ovs_interfaceid": "d5f803c0-bb6c-41be-8294-fb3565e03413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0a00abcf-957e-4276-a975-522f8a42ad55", "address": "fa:16:3e:c8:b9:46", "network": {"id": "50f9056b-d85d-4a43-8981-3c5c98e1bf52", "bridge": "br-int", "label": "tempest-device-tagging-net1-737454421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a00abcf-95", "ovs_interfaceid": "0a00abcf-957e-4276-a975-522f8a42ad55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "11c7c4ff-db41-4231-8300-ee85a94619c1", "address": "fa:16:3e:ca:c8:e5", "network": {"id": "50f9056b-d85d-4a43-8981-3c5c98e1bf52", "bridge": "br-int", "label": "tempest-device-tagging-net1-737454421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11c7c4ff-db", "ovs_interfaceid": "11c7c4ff-db41-4231-8300-ee85a94619c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dba85cc3-dd42-4fa4-96d3-bec15903344f", "address": "fa:16:3e:fb:32:89", "network": {"id": "1ba257ec-d104-413d-bbf9-d9702ed5a1b4", "bridge": "br-int", "label": "tempest-device-tagging-net2-445498545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdba85cc3-dd", "ovs_interfaceid": "dba85cc3-dd42-4fa4-96d3-bec15903344f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "35f010df-56fb-4234-879b-19f86f36a2d3", "address": "fa:16:3e:bf:a7:36", "network": {"id": "1ba257ec-d104-413d-bbf9-d9702ed5a1b4", "bridge": "br-int", "label": "tempest-device-tagging-net2-445498545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35f010df-56", "ovs_interfaceid": "35f010df-56fb-4234-879b-19f86f36a2d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:49:49 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-50b83683-07fd-41c5-ae91-b3e056fcabd7 req-a18e86e1-2313-4b00-960c-4aa739c94219 service nova] Releasing lock "refresh_cache-cd28be8d-847b-468c-860f-4f479740738d" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:49:52 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:49:53 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:49:53 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:49:53 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:49:53 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:49:53 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:49:53 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Auditing locally available compute resources for user (node: user) {{(pid=74190) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 11:49:53 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d7b8e5-02cc-4148-86e2-ceb295e81afc/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:49:53 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d7b8e5-02cc-4148-86e2-ceb295e81afc/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:49:53 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d7b8e5-02cc-4148-86e2-ceb295e81afc/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:49:53 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52d7b8e5-02cc-4148-86e2-ceb295e81afc/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:49:53 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 11:49:53 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0209c824-88a7-4976-83bf-8a72437f0cc2/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:49:53 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0209c824-88a7-4976-83bf-8a72437f0cc2/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:49:53 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0209c824-88a7-4976-83bf-8a72437f0cc2/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:49:54 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0209c824-88a7-4976-83bf-8a72437f0cc2/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:49:54 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 11:49:54 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 11:49:54 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 11:49:54 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c11bc6b-303f-427e-a5d4-993acd74bb27/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:49:54 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c11bc6b-303f-427e-a5d4-993acd74bb27/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:49:54 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c11bc6b-303f-427e-a5d4-993acd74bb27/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:49:54 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c11bc6b-303f-427e-a5d4-993acd74bb27/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:49:54 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c280652c-ffde-40f8-a919-adb8be618db8/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:49:54 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c280652c-ffde-40f8-a919-adb8be618db8/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:49:54 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c280652c-ffde-40f8-a919-adb8be618db8/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:49:54 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c280652c-ffde-40f8-a919-adb8be618db8/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:49:54 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:49:55 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:49:55 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:49:55 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:49:55 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d90a6ca0-19a6-4221-81b7-0cb05d67f38e/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:49:55 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d90a6ca0-19a6-4221-81b7-0cb05d67f38e/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:49:55 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d90a6ca0-19a6-4221-81b7-0cb05d67f38e/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:49:55 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d90a6ca0-19a6-4221-81b7-0cb05d67f38e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:49:55 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdfe420d-f46c-44ad-8773-b675f42e24ed/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:49:55 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdfe420d-f46c-44ad-8773-b675f42e24ed/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:49:55 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdfe420d-f46c-44ad-8773-b675f42e24ed/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:49:55 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdfe420d-f46c-44ad-8773-b675f42e24ed/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:49:56 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:49:56 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:49:56 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Hypervisor/Node resource view: name=user free_ram=7756MB free_disk=25.567138671875GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74190) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 11:49:56 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:49:56 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:49:56 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance c280652c-ffde-40f8-a919-adb8be618db8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:49:56 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 0209c824-88a7-4976-83bf-8a72437f0cc2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:49:56 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 52d7b8e5-02cc-4148-86e2-ceb295e81afc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:49:56 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance bdfe420d-f46c-44ad-8773-b675f42e24ed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:49:56 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 738fc62c-293c-4fee-9943-45033e0f2602 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:49:56 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 4e916d24-9f9d-4289-87ce-f65d2499fcd9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:49:56 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance d90a6ca0-19a6-4221-81b7-0cb05d67f38e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:49:56 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 0c11bc6b-303f-427e-a5d4-993acd74bb27 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:49:56 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance cd28be8d-847b-468c-860f-4f479740738d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:49:56 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 11:49:56 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 11:49:56 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 11:49:56 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 11:49:56 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Compute_service record updated for user:user {{(pid=74190) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 11:49:56 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.498s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:49:57 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:49:57 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:49:57 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:49:57 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:49:57 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74190) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 11:49:58 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:49:58 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Starting heal instance info cache {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 11:49:58 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "refresh_cache-52d7b8e5-02cc-4148-86e2-ceb295e81afc" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:49:58 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquired lock "refresh_cache-52d7b8e5-02cc-4148-86e2-ceb295e81afc" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:49:58 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Forcefully refreshing network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 18 11:49:58 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Updating instance_info_cache with network_info: [{"id": "550e157d-7f82-41a1-b4ba-9dbb43037d8c", "address": "fa:16:3e:88:36:f0", "network": {"id": "f5ab7da4-2b07-4465-9a89-a07eb053ba91", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1315695374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08cf52ce927443158aa731367f08bd57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap550e157d-7f", "ovs_interfaceid": "550e157d-7f82-41a1-b4ba-9dbb43037d8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:49:58 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Releasing lock "refresh_cache-52d7b8e5-02cc-4148-86e2-ceb295e81afc" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:49:58 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Updated the network info_cache for instance {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 18 11:49:58 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:49:58 user nova-compute[74190]: DEBUG nova.compute.manager [req-42209c64-ba90-4716-8110-7d763695bee1 req-37111b20-a76c-4c98-b72e-cd50218ab2d8 service nova] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Received event network-changed-7cee893b-5ac8-45f8-a1f8-5374b49cc3b5 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:49:58 user nova-compute[74190]: DEBUG nova.compute.manager [req-42209c64-ba90-4716-8110-7d763695bee1 req-37111b20-a76c-4c98-b72e-cd50218ab2d8 service nova] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Refreshing instance network info cache due to event network-changed-7cee893b-5ac8-45f8-a1f8-5374b49cc3b5. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 11:49:58 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-42209c64-ba90-4716-8110-7d763695bee1 req-37111b20-a76c-4c98-b72e-cd50218ab2d8 service nova] Acquiring lock "refresh_cache-4e916d24-9f9d-4289-87ce-f65d2499fcd9" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:49:58 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-42209c64-ba90-4716-8110-7d763695bee1 req-37111b20-a76c-4c98-b72e-cd50218ab2d8 service nova] Acquired lock "refresh_cache-4e916d24-9f9d-4289-87ce-f65d2499fcd9" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:49:58 user nova-compute[74190]: DEBUG nova.network.neutron [req-42209c64-ba90-4716-8110-7d763695bee1 req-37111b20-a76c-4c98-b72e-cd50218ab2d8 service nova] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Refreshing network info cache for port 7cee893b-5ac8-45f8-a1f8-5374b49cc3b5 {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 11:49:59 user nova-compute[74190]: DEBUG nova.network.neutron [req-42209c64-ba90-4716-8110-7d763695bee1 req-37111b20-a76c-4c98-b72e-cd50218ab2d8 service nova] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Updated VIF entry in instance network info cache for port 7cee893b-5ac8-45f8-a1f8-5374b49cc3b5. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 11:49:59 user nova-compute[74190]: DEBUG nova.network.neutron [req-42209c64-ba90-4716-8110-7d763695bee1 req-37111b20-a76c-4c98-b72e-cd50218ab2d8 service nova] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Updating instance_info_cache with network_info: [{"id": "7cee893b-5ac8-45f8-a1f8-5374b49cc3b5", "address": "fa:16:3e:15:15:1d", "network": {"id": "4609cfba-1e8b-4740-bdf6-642b196097a3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1019354168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a4f041e58144d54a458a01074eb35a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cee893b-5a", "ovs_interfaceid": "7cee893b-5ac8-45f8-a1f8-5374b49cc3b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:49:59 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-42209c64-ba90-4716-8110-7d763695bee1 req-37111b20-a76c-4c98-b72e-cd50218ab2d8 service nova] Releasing lock "refresh_cache-4e916d24-9f9d-4289-87ce-f65d2499fcd9" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:49:59 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:49:59 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:50:00 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:50:00 user nova-compute[74190]: DEBUG nova.compute.manager [None req-0d90a327-3bbe-404a-982b-d421d407cc8f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Checking state {{(pid=74190) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 11:50:00 user nova-compute[74190]: INFO nova.compute.manager [None req-0d90a327-3bbe-404a-982b-d421d407cc8f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] instance snapshotting
Oct 18 11:50:00 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-0d90a327-3bbe-404a-982b-d421d407cc8f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Beginning live snapshot process
Oct 18 11:50:00 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-0d90a327-3bbe-404a-982b-d421d407cc8f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk --force-share --output=json -f qcow2 {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:00 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-0d90a327-3bbe-404a-982b-d421d407cc8f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk --force-share --output=json -f qcow2" returned: 0 in 0.189s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:00 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-0d90a327-3bbe-404a-982b-d421d407cc8f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk --force-share --output=json -f qcow2 {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:00 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-cc33f43b-8b20-4f62-b212-fbad9e5ed81c tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Acquiring lock "52d7b8e5-02cc-4148-86e2-ceb295e81afc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:50:00 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-cc33f43b-8b20-4f62-b212-fbad9e5ed81c tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lock "52d7b8e5-02cc-4148-86e2-ceb295e81afc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:50:00 user nova-compute[74190]: INFO nova.compute.manager [None req-cc33f43b-8b20-4f62-b212-fbad9e5ed81c tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Detaching volume b46a9877-5222-479e-a581-dfc0618bfe49
Oct 18 11:50:00 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-0d90a327-3bbe-404a-982b-d421d407cc8f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk --force-share --output=json -f qcow2" returned: 0 in 0.205s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:00 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-0d90a327-3bbe-404a-982b-d421d407cc8f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:00 user nova-compute[74190]: INFO nova.virt.block_device [None req-cc33f43b-8b20-4f62-b212-fbad9e5ed81c tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Attempting to driver detach volume b46a9877-5222-479e-a581-dfc0618bfe49 from mountpoint /dev/vdb
Oct 18 11:50:01 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-cc33f43b-8b20-4f62-b212-fbad9e5ed81c tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Attempting to detach device vdb from instance 52d7b8e5-02cc-4148-86e2-ceb295e81afc from the persistent domain config. {{(pid=74190) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 18 11:50:01 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-cc33f43b-8b20-4f62-b212-fbad9e5ed81c tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 11:50:01 user nova-compute[74190]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 11:50:01 user nova-compute[74190]:   <source dev="/dev/sdb"/>
Oct 18 11:50:01 user nova-compute[74190]:   <target dev="vdb" bus="virtio"/>
Oct 18 11:50:01 user nova-compute[74190]:   <serial>b46a9877-5222-479e-a581-dfc0618bfe49</serial>
Oct 18 11:50:01 user nova-compute[74190]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 18 11:50:01 user nova-compute[74190]: </disk>
Oct 18 11:50:01 user nova-compute[74190]:  {{(pid=74190) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 11:50:01 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-cc33f43b-8b20-4f62-b212-fbad9e5ed81c tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Successfully detached device vdb from instance 52d7b8e5-02cc-4148-86e2-ceb295e81afc from the persistent domain config.
Oct 18 11:50:01 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-cc33f43b-8b20-4f62-b212-fbad9e5ed81c tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 52d7b8e5-02cc-4148-86e2-ceb295e81afc from the live domain config. {{(pid=74190) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 18 11:50:01 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-cc33f43b-8b20-4f62-b212-fbad9e5ed81c tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 11:50:01 user nova-compute[74190]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 11:50:01 user nova-compute[74190]:   <source dev="/dev/sdb"/>
Oct 18 11:50:01 user nova-compute[74190]:   <target dev="vdb" bus="virtio"/>
Oct 18 11:50:01 user nova-compute[74190]:   <serial>b46a9877-5222-479e-a581-dfc0618bfe49</serial>
Oct 18 11:50:01 user nova-compute[74190]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 18 11:50:01 user nova-compute[74190]: </disk>
Oct 18 11:50:01 user nova-compute[74190]:  {{(pid=74190) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 11:50:01 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-0d90a327-3bbe-404a-982b-d421d407cc8f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.197s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:01 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-0d90a327-3bbe-404a-982b-d421d407cc8f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpc21ahvxv/a0c7ed131be145b1aee88e0c9d65fdfe.delta 1073741824 {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:01 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-0d90a327-3bbe-404a-982b-d421d407cc8f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpc21ahvxv/a0c7ed131be145b1aee88e0c9d65fdfe.delta 1073741824" returned: 0 in 0.069s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:01 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-0d90a327-3bbe-404a-982b-d421d407cc8f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 18 11:50:01 user nova-compute[74190]: INFO nova.virt.block_device [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] [instance: cd28be8d-847b-468c-860f-4f479740738d] Booting with volume 011ac309-ad42-43cc-ab45-e09e022b6e56 at /dev/vdb
Oct 18 11:50:01 user nova-compute[74190]: DEBUG os_brick.utils [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:50:01 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:01 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:01 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a5bf24d-930c-4482-8b79-0a1d6bb1354b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cff158e257e1\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:01 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:01 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:01 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba36bd97-ecfd-4916-ac0b-1c0767172100]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:01 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-cc33f43b-8b20-4f62-b212-fbad9e5ed81c tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 52d7b8e5-02cc-4148-86e2-ceb295e81afc {{(pid=74190) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 18 11:50:01 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:01 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:01 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ddbceaf-d0c8-4d7e-8dcb-e1e77261affa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:01 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[9810d96a-04fb-439f-8c66-484a955579b2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:01 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Running cmd (subprocess): nvme version {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:01 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] 'nvme version' failed. Not Retrying. {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 11:50:01 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] nvme not present on system {{(pid=74190) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 11:50:01 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:01 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 11:50:01 user nova-compute[74190]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 11:50:01 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d7268a-3afd-44f1-aa96-fbf1de750883]: (4, '') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:01 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74190) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 11:50:01 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 11:50:01 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] LIGHTOS: no hostnqn found. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 11:50:01 user nova-compute[74190]: DEBUG os_brick.utils [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cff158e257e1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:50:01 user nova-compute[74190]: DEBUG nova.virt.block_device [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] [instance: cd28be8d-847b-468c-860f-4f479740738d] Updating existing volume attachment record: ea19d714-7699-494e-aad7-0fedd22ec98e {{(pid=74190) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 11:50:02 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-0d90a327-3bbe-404a-982b-d421d407cc8f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74190) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 18 11:50:02 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-0d90a327-3bbe-404a-982b-d421d407cc8f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74190) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 18 11:50:02 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-0d90a327-3bbe-404a-982b-d421d407cc8f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 18 11:50:02 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:02 user nova-compute[74190]: DEBUG nova.privsep.utils [None req-0d90a327-3bbe-404a-982b-d421d407cc8f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74190) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 18 11:50:02 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-0d90a327-3bbe-404a-982b-d421d407cc8f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpc21ahvxv/a0c7ed131be145b1aee88e0c9d65fdfe.delta /opt/stack/data/nova/instances/snapshots/tmpc21ahvxv/a0c7ed131be145b1aee88e0c9d65fdfe {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-0d90a327-3bbe-404a-982b-d421d407cc8f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpc21ahvxv/a0c7ed131be145b1aee88e0c9d65fdfe.delta /opt/stack/data/nova/instances/snapshots/tmpc21ahvxv/a0c7ed131be145b1aee88e0c9d65fdfe" returned: 0 in 0.605s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:03 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-0d90a327-3bbe-404a-982b-d421d407cc8f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Snapshot extracted, beginning image upload
Oct 18 11:50:04 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:06 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-0d90a327-3bbe-404a-982b-d421d407cc8f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Snapshot image upload complete
Oct 18 11:50:06 user nova-compute[74190]: INFO nova.compute.manager [None req-0d90a327-3bbe-404a-982b-d421d407cc8f tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Took 6.43 seconds to snapshot the instance on the hypervisor.
Oct 18 11:50:07 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:09 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:10 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2fa19fb3-5e51-4faa-8489-88e924b78a59 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Calling os-brick to attach iSCSI Volume {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 11:50:10 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fa19fb3-5e51-4faa-8489-88e924b78a59 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HmdgMSxP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:50:10 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-2fa19fb3-5e51-4faa-8489-88e924b78a59 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:50:10 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-2fa19fb3-5e51-4faa-8489-88e924b78a59 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:50:10 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-2fa19fb3-5e51-4faa-8489-88e924b78a59 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:50:10 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-2fa19fb3-5e51-4faa-8489-88e924b78a59 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:50:10 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-2fa19fb3-5e51-4faa-8489-88e924b78a59 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:50:10 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-2fa19fb3-5e51-4faa-8489-88e924b78a59 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:50:10 user nova-compute[74190]: INFO os_brick.initiator.connectors.iscsi [None req-2fa19fb3-5e51-4faa-8489-88e924b78a59 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 11:50:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 -p 172.16.0.220:3260 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:10 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[e297e9c9-5e54-4be6-8b6e-3affc5c87fde]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:10 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fa19fb3-5e51-4faa-8489-88e924b78a59 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 11:50:10 user nova-compute[74190]:  {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:50:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 -p 172.16.0.220:3260 --interface default --op new {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:10 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef8ba62f-67eb-4673-94d4-af22573551ab]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71] added\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:10 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fa19fb3-5e51-4faa-8489-88e924b78a59 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71] added
Oct 18 11:50:10 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:50:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:10 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a436ff-2ed1-49a6-b9d7-e1d8a1a9718b]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:10 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fa19fb3-5e51-4faa-8489-88e924b78a59 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:50:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:10 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba18bca-99d0-484b-a3b6-c05f420f4b6f]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:10 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fa19fb3-5e51-4faa-8489-88e924b78a59 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:50:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HmdgMSxP {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HmdgMSxP" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:10 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dc1b467-33ba-45d8-a30a-ebe57d3e4daa]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:10 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fa19fb3-5e51-4faa-8489-88e924b78a59 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HmdgMSxP'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:50:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:10 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[e89009a3-2464-44e7-be0a-e73d05312ae8]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:10 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fa19fb3-5e51-4faa-8489-88e924b78a59 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:50:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:10 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[3721df9f-085d-4680-b1c0-afa37df9bab6]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2637fe23-3624-4fe8-954e-266b32cf18a9 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:838cbbc1-303e-481f-a54c-ebb014989095 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:555c71a2-d950-48cc-96fd-725e0df8ce78 (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:10 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fa19fb3-5e51-4faa-8489-88e924b78a59 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49 (non-flash)
Oct 18 11:50:10 user nova-compute[74190]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2637fe23-3624-4fe8-954e-266b32cf18a9 (non-flash)
Oct 18 11:50:10 user nova-compute[74190]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:838cbbc1-303e-481f-a54c-ebb014989095 (non-flash)
Oct 18 11:50:10 user nova-compute[74190]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:555c71a2-d950-48cc-96fd-725e0df8ce78 (non-flash)
Oct 18 11:50:10 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:50:10 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fa19fb3-5e51-4faa-8489-88e924b78a59 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49 (non-flash)
Oct 18 11:50:10 user nova-compute[74190]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2637fe23-3624-4fe8-954e-266b32cf18a9 (non-flash)
Oct 18 11:50:10 user nova-compute[74190]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:838cbbc1-303e-481f-a54c-ebb014989095 (non-flash)
Oct 18 11:50:10 user nova-compute[74190]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:555c71a2-d950-48cc-96fd-725e0df8ce78 (non-flash)
Oct 18 11:50:10 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:50:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 -p 172.16.0.220:3260 --login {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:10 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[94109a31-eeb4-4660-b978-02690310e822]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:10 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fa19fb3-5e51-4faa-8489-88e924b78a59 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71, portal: 172.16.0.220,3260]
Oct 18 11:50:10 user nova-compute[74190]: Login to [iface: default, target: iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71, portal: 172.16.0.220,3260] successful.
Oct 18 11:50:10 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:50:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:10 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[996a3306-80a9-4b01-9ba3-92be61f83bdb]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:10 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fa19fb3-5e51-4faa-8489-88e924b78a59 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:50:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:10 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[df8950a4-2d63-4375-93dc-747f289d7bbd]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2637fe23-3624-4fe8-954e-266b32cf18a9 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:838cbbc1-303e-481f-a54c-ebb014989095 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:555c71a2-d950-48cc-96fd-725e0df8ce78 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:10 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fa19fb3-5e51-4faa-8489-88e924b78a59 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49 (non-flash)
Oct 18 11:50:10 user nova-compute[74190]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2637fe23-3624-4fe8-954e-266b32cf18a9 (non-flash)
Oct 18 11:50:10 user nova-compute[74190]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:838cbbc1-303e-481f-a54c-ebb014989095 (non-flash)
Oct 18 11:50:10 user nova-compute[74190]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:555c71a2-d950-48cc-96fd-725e0df8ce78 (non-flash)
Oct 18 11:50:10 user nova-compute[74190]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 (non-flash)
Oct 18 11:50:10 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:50:10 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fa19fb3-5e51-4faa-8489-88e924b78a59 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49 (non-flash)
Oct 18 11:50:10 user nova-compute[74190]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2637fe23-3624-4fe8-954e-266b32cf18a9 (non-flash)
Oct 18 11:50:10 user nova-compute[74190]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:838cbbc1-303e-481f-a54c-ebb014989095 (non-flash)
Oct 18 11:50:10 user nova-compute[74190]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:555c71a2-d950-48cc-96fd-725e0df8ce78 (non-flash)
Oct 18 11:50:10 user nova-compute[74190]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 (non-flash)
Oct 18 11:50:10 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:50:10 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-2fa19fb3-5e51-4faa-8489-88e924b78a59 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:50:10 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fa19fb3-5e51-4faa-8489-88e924b78a59 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Connected to 172.16.0.220:3260 {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 11:50:10 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-2fa19fb3-5e51-4faa-8489-88e924b78a59 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] HCTL ('37', '-', '-', 0) found on session 21 with lun 0 {{(pid=74190) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 11:50:10 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-2fa19fb3-5e51-4faa-8489-88e924b78a59 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74190) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 11:50:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.022s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:10 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a51fbac-6726-45cd-9524-4161eb09e41b]: (4, ('- - 0', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:10 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-2fa19fb3-5e51-4faa-8489-88e924b78a59 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Searching for a device in session 21 and hctl ['37', '*', '*', 0] yield: None {{(pid=74190) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 11:50:11 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-2fa19fb3-5e51-4faa-8489-88e924b78a59 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Searching for a device in session 21 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74190) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 11:50:11 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fa19fb3-5e51-4faa-8489-88e924b78a59 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HmdgMSxP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 11:50:11 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-2fa19fb3-5e51-4faa-8489-88e924b78a59 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:50:11 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fa19fb3-5e51-4faa-8489-88e924b78a59 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] <== connect_volume: return (1354ms) {'type': 'block', 'scsi_wwn': '26339373435386535', 'path': '/dev/sdf'} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:50:11 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2fa19fb3-5e51-4faa-8489-88e924b78a59 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26339373435386535', 'path': '/dev/sdf'} {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 11:50:11 user nova-compute[74190]: DEBUG nova.objects.instance [None req-2fa19fb3-5e51-4faa-8489-88e924b78a59 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Lazy-loading 'flavor' on Instance uuid bdfe420d-f46c-44ad-8773-b675f42e24ed {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:50:11 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-2fa19fb3-5e51-4faa-8489-88e924b78a59 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] attach device xml: <disk type="block" device="disk">
Oct 18 11:50:11 user nova-compute[74190]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 11:50:11 user nova-compute[74190]:   <source dev="/dev/sdf"/>
Oct 18 11:50:11 user nova-compute[74190]:   <target dev="vdb" bus="virtio"/>
Oct 18 11:50:11 user nova-compute[74190]:   <serial>7316be11-03d9-47f3-bf3c-2563c3a92c71</serial>
Oct 18 11:50:11 user nova-compute[74190]: </disk>
Oct 18 11:50:11 user nova-compute[74190]:  {{(pid=74190) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 18 11:50:12 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-2fa19fb3-5e51-4faa-8489-88e924b78a59 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] No BDM found with device name vda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 11:50:12 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-2fa19fb3-5e51-4faa-8489-88e924b78a59 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 11:50:12 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-2fa19fb3-5e51-4faa-8489-88e924b78a59 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] No VIF found with MAC fa:16:3e:cb:ff:0f, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 11:50:12 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-4b765f49-e872-4073-840e-954217243e4c tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] Acquiring lock "d0e52e79-ce1e-4a77-a189-b0b837165e68" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:50:12 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-4b765f49-e872-4073-840e-954217243e4c tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] Lock "d0e52e79-ce1e-4a77-a189-b0b837165e68" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:50:12 user nova-compute[74190]: DEBUG nova.compute.manager [None req-4b765f49-e872-4073-840e-954217243e4c tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] [instance: d0e52e79-ce1e-4a77-a189-b0b837165e68] Starting instance... {{(pid=74190) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 11:50:12 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-2fa19fb3-5e51-4faa-8489-88e924b78a59 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Lock "bdfe420d-f46c-44ad-8773-b675f42e24ed" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 42.091s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:50:12 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-4b765f49-e872-4073-840e-954217243e4c tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:50:12 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-4b765f49-e872-4073-840e-954217243e4c tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:50:12 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-4b765f49-e872-4073-840e-954217243e4c tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74190) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 11:50:12 user nova-compute[74190]: INFO nova.compute.claims [None req-4b765f49-e872-4073-840e-954217243e4c tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] [instance: d0e52e79-ce1e-4a77-a189-b0b837165e68] Claim successful on node user
Oct 18 11:50:12 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:13 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-4b765f49-e872-4073-840e-954217243e4c tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 11:50:13 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-4b765f49-e872-4073-840e-954217243e4c tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 11:50:13 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-4b765f49-e872-4073-840e-954217243e4c tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.494s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:50:13 user nova-compute[74190]: DEBUG nova.compute.manager [None req-4b765f49-e872-4073-840e-954217243e4c tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] [instance: d0e52e79-ce1e-4a77-a189-b0b837165e68] Start building networks asynchronously for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 11:50:13 user nova-compute[74190]: DEBUG nova.compute.manager [None req-4b765f49-e872-4073-840e-954217243e4c tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] [instance: d0e52e79-ce1e-4a77-a189-b0b837165e68] Allocating IP information in the background. {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 11:50:13 user nova-compute[74190]: DEBUG nova.network.neutron [None req-4b765f49-e872-4073-840e-954217243e4c tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] [instance: d0e52e79-ce1e-4a77-a189-b0b837165e68] allocate_for_instance() {{(pid=74190) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 11:50:13 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-4b765f49-e872-4073-840e-954217243e4c tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] [instance: d0e52e79-ce1e-4a77-a189-b0b837165e68] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 11:50:13 user nova-compute[74190]: DEBUG nova.compute.manager [None req-4b765f49-e872-4073-840e-954217243e4c tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] [instance: d0e52e79-ce1e-4a77-a189-b0b837165e68] Start building block device mappings for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 11:50:13 user nova-compute[74190]: DEBUG nova.compute.manager [None req-4b765f49-e872-4073-840e-954217243e4c tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] [instance: d0e52e79-ce1e-4a77-a189-b0b837165e68] Start spawning the instance on the hypervisor. {{(pid=74190) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 11:50:13 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-4b765f49-e872-4073-840e-954217243e4c tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] [instance: d0e52e79-ce1e-4a77-a189-b0b837165e68] Creating instance directory {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 11:50:13 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-4b765f49-e872-4073-840e-954217243e4c tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] [instance: d0e52e79-ce1e-4a77-a189-b0b837165e68] Creating image(s)
Oct 18 11:50:13 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-4b765f49-e872-4073-840e-954217243e4c tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] Acquiring lock "/opt/stack/data/nova/instances/d0e52e79-ce1e-4a77-a189-b0b837165e68/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:50:13 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-4b765f49-e872-4073-840e-954217243e4c tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] Lock "/opt/stack/data/nova/instances/d0e52e79-ce1e-4a77-a189-b0b837165e68/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:50:13 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-4b765f49-e872-4073-840e-954217243e4c tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] Lock "/opt/stack/data/nova/instances/d0e52e79-ce1e-4a77-a189-b0b837165e68/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:50:13 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-4b765f49-e872-4073-840e-954217243e4c tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:13 user nova-compute[74190]: DEBUG nova.policy [None req-4b765f49-e872-4073-840e-954217243e4c tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '957ea997ac634e3cb3065522f7df5ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80f77bf8a3c54482b45a9a37b4fb699d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74190) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 11:50:13 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-4b765f49-e872-4073-840e-954217243e4c tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.197s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:13 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-4b765f49-e872-4073-840e-954217243e4c tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] Acquiring lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:50:13 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-4b765f49-e872-4073-840e-954217243e4c tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] Lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:50:13 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-4b765f49-e872-4073-840e-954217243e4c tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:13 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-4b765f49-e872-4073-840e-954217243e4c tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.235s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:13 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-4b765f49-e872-4073-840e-954217243e4c tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f,backing_fmt=raw /opt/stack/data/nova/instances/d0e52e79-ce1e-4a77-a189-b0b837165e68/disk 1073741824 {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:13 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-4b765f49-e872-4073-840e-954217243e4c tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f,backing_fmt=raw /opt/stack/data/nova/instances/d0e52e79-ce1e-4a77-a189-b0b837165e68/disk 1073741824" returned: 0 in 0.061s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:13 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-4b765f49-e872-4073-840e-954217243e4c tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] Lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.304s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:50:13 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-4b765f49-e872-4073-840e-954217243e4c tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:14 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-4b765f49-e872-4073-840e-954217243e4c tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.186s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:14 user nova-compute[74190]: DEBUG nova.virt.disk.api [None req-4b765f49-e872-4073-840e-954217243e4c tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d0e52e79-ce1e-4a77-a189-b0b837165e68/disk. size=1073741824 {{(pid=74190) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 18 11:50:14 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-4b765f49-e872-4073-840e-954217243e4c tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0e52e79-ce1e-4a77-a189-b0b837165e68/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:14 user nova-compute[74190]: DEBUG nova.network.neutron [None req-4b765f49-e872-4073-840e-954217243e4c tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] [instance: d0e52e79-ce1e-4a77-a189-b0b837165e68] Successfully created port: 3ed3f9e7-9dab-435e-a54d-eea1ee04c15c {{(pid=74190) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 11:50:14 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-4b765f49-e872-4073-840e-954217243e4c tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0e52e79-ce1e-4a77-a189-b0b837165e68/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:14 user nova-compute[74190]: DEBUG nova.virt.disk.api [None req-4b765f49-e872-4073-840e-954217243e4c tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] Cannot resize image /opt/stack/data/nova/instances/d0e52e79-ce1e-4a77-a189-b0b837165e68/disk to a smaller size. {{(pid=74190) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 18 11:50:14 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-4b765f49-e872-4073-840e-954217243e4c tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] [instance: d0e52e79-ce1e-4a77-a189-b0b837165e68] Created local disks {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 11:50:14 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-4b765f49-e872-4073-840e-954217243e4c tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] [instance: d0e52e79-ce1e-4a77-a189-b0b837165e68] Ensure instance console log exists: /opt/stack/data/nova/instances/d0e52e79-ce1e-4a77-a189-b0b837165e68/console.log {{(pid=74190) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 11:50:14 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-4b765f49-e872-4073-840e-954217243e4c tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:50:14 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-4b765f49-e872-4073-840e-954217243e4c tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:50:14 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-4b765f49-e872-4073-840e-954217243e4c tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:50:14 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:14 user nova-compute[74190]: DEBUG nova.compute.manager [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Stashing vm_state: active {{(pid=74190) _prep_resize /opt/stack/nova/nova/compute/manager.py:5614}}
Oct 18 11:50:14 user nova-compute[74190]: DEBUG nova.network.neutron [None req-4b765f49-e872-4073-840e-954217243e4c tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] [instance: d0e52e79-ce1e-4a77-a189-b0b837165e68] Successfully updated port: 3ed3f9e7-9dab-435e-a54d-eea1ee04c15c {{(pid=74190) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 11:50:14 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-4b765f49-e872-4073-840e-954217243e4c tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] Acquiring lock "refresh_cache-d0e52e79-ce1e-4a77-a189-b0b837165e68" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:50:14 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-4b765f49-e872-4073-840e-954217243e4c tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] Acquired lock "refresh_cache-d0e52e79-ce1e-4a77-a189-b0b837165e68" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:50:14 user nova-compute[74190]: DEBUG nova.network.neutron [None req-4b765f49-e872-4073-840e-954217243e4c tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] [instance: d0e52e79-ce1e-4a77-a189-b0b837165e68] Building network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 11:50:14 user nova-compute[74190]: DEBUG nova.compute.manager [req-bcaefdb9-36f7-44c7-9d59-f58e67921e00 req-a2fac942-bc62-43e5-a243-a7fba06a8a1c service nova] [instance: d0e52e79-ce1e-4a77-a189-b0b837165e68] Received event network-changed-3ed3f9e7-9dab-435e-a54d-eea1ee04c15c {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:50:14 user nova-compute[74190]: DEBUG nova.compute.manager [req-bcaefdb9-36f7-44c7-9d59-f58e67921e00 req-a2fac942-bc62-43e5-a243-a7fba06a8a1c service nova] [instance: d0e52e79-ce1e-4a77-a189-b0b837165e68] Refreshing instance network info cache due to event network-changed-3ed3f9e7-9dab-435e-a54d-eea1ee04c15c. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 11:50:14 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-bcaefdb9-36f7-44c7-9d59-f58e67921e00 req-a2fac942-bc62-43e5-a243-a7fba06a8a1c service nova] Acquiring lock "refresh_cache-d0e52e79-ce1e-4a77-a189-b0b837165e68" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:50:15 user nova-compute[74190]: DEBUG nova.network.neutron [None req-4b765f49-e872-4073-840e-954217243e4c tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] [instance: d0e52e79-ce1e-4a77-a189-b0b837165e68] Instance cache missing network info. {{(pid=74190) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 11:50:15 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:50:15 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:50:15 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74190) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 11:50:15 user nova-compute[74190]: INFO nova.compute.claims [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Claim successful on node user
Oct 18 11:50:15 user nova-compute[74190]: INFO nova.compute.resource_tracker [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Updating resource usage from migration 794d7f84-f831-4a34-a773-e9b869d038ae
Oct 18 11:50:15 user nova-compute[74190]: DEBUG nova.network.neutron [None req-4b765f49-e872-4073-840e-954217243e4c tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] [instance: d0e52e79-ce1e-4a77-a189-b0b837165e68] Updating instance_info_cache with network_info: [{"id": "3ed3f9e7-9dab-435e-a54d-eea1ee04c15c", "address": "fa:16:3e:b1:dc:32", "network": {"id": "c9ed86bb-c34c-43c7-994f-ffd9d8c8e080", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "5b47e79bab9143e5acee2b7862cf2c49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ed3f9e7-9d", "ovs_interfaceid": "3ed3f9e7-9dab-435e-a54d-eea1ee04c15c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:50:15 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-4b765f49-e872-4073-840e-954217243e4c tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] Releasing lock "refresh_cache-d0e52e79-ce1e-4a77-a189-b0b837165e68" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:50:15 user nova-compute[74190]: DEBUG nova.compute.manager [None req-4b765f49-e872-4073-840e-954217243e4c tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] [instance: d0e52e79-ce1e-4a77-a189-b0b837165e68] Instance network_info: |[{"id": "3ed3f9e7-9dab-435e-a54d-eea1ee04c15c", "address": "fa:16:3e:b1:dc:32", "network": {"id": "c9ed86bb-c34c-43c7-994f-ffd9d8c8e080", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "5b47e79bab9143e5acee2b7862cf2c49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ed3f9e7-9d", "ovs_interfaceid": "3ed3f9e7-9dab-435e-a54d-eea1ee04c15c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 11:50:15 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-bcaefdb9-36f7-44c7-9d59-f58e67921e00 req-a2fac942-bc62-43e5-a243-a7fba06a8a1c service nova] Acquired lock "refresh_cache-d0e52e79-ce1e-4a77-a189-b0b837165e68" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:50:15 user nova-compute[74190]: DEBUG nova.network.neutron [req-bcaefdb9-36f7-44c7-9d59-f58e67921e00 req-a2fac942-bc62-43e5-a243-a7fba06a8a1c service nova] [instance: d0e52e79-ce1e-4a77-a189-b0b837165e68] Refreshing network info cache for port 3ed3f9e7-9dab-435e-a54d-eea1ee04c15c {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 11:50:15 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-4b765f49-e872-4073-840e-954217243e4c tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] [instance: d0e52e79-ce1e-4a77-a189-b0b837165e68] Start _get_guest_xml network_info=[{"id": "3ed3f9e7-9dab-435e-a54d-eea1ee04c15c", "address": "fa:16:3e:b1:dc:32", "network": {"id": "c9ed86bb-c34c-43c7-994f-ffd9d8c8e080", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "5b47e79bab9143e5acee2b7862cf2c49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ed3f9e7-9d", "ovs_interfaceid": "3ed3f9e7-9dab-435e-a54d-eea1ee04c15c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'image_id': '6e88bbf0-6e78-49a8-b3c5-9453d22a89df'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 11:50:15 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-4b765f49-e872-4073-840e-954217243e4c tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:50:15 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-4b765f49-e872-4073-840e-954217243e4c tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:50:15 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-4b765f49-e872-4073-840e-954217243e4c tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 11:50:15 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-4b765f49-e872-4073-840e-954217243e4c tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] CPU controller missing on host. {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 11:50:15 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-4b765f49-e872-4073-840e-954217243e4c tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 11:50:15 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-4b765f49-e872-4073-840e-954217243e4c tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] CPU controller found on host. {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 11:50:15 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-4b765f49-e872-4073-840e-954217243e4c tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74190) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 11:50:15 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-4b765f49-e872-4073-840e-954217243e4c tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T11:37:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 11:50:15 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-4b765f49-e872-4073-840e-954217243e4c tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] Flavor limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 11:50:15 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-4b765f49-e872-4073-840e-954217243e4c tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] Image limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 11:50:15 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-4b765f49-e872-4073-840e-954217243e4c tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] Flavor pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 11:50:15 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-4b765f49-e872-4073-840e-954217243e4c tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] Image pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 11:50:15 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-4b765f49-e872-4073-840e-954217243e4c tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 11:50:15 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-4b765f49-e872-4073-840e-954217243e4c tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 11:50:15 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-4b765f49-e872-4073-840e-954217243e4c tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 11:50:15 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-4b765f49-e872-4073-840e-954217243e4c tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] Got 1 possible topologies {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 11:50:15 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-4b765f49-e872-4073-840e-954217243e4c tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 11:50:15 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-4b765f49-e872-4073-840e-954217243e4c tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 11:50:15 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-4b765f49-e872-4073-840e-954217243e4c tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:50:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-210485289',display_name='tempest-VolumesNegativeTest-instance-210485289',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-210485289',id=19,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='80f77bf8a3c54482b45a9a37b4fb699d',ramdisk_id='',reservation_id='r-pu37qrxu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-70695717',owner_user_name='tempest-VolumesNegativeTest-70695717-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:50:13Z,user_data=None,user_id='957ea997ac634e3cb3065522f7df5ad7',uuid=d0e52e79-ce1e-4a77-a189-b0b837165e68,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ed3f9e7-9dab-435e-a54d-eea1ee04c15c", "address": "fa:16:3e:b1:dc:32", "network": {"id": "c9ed86bb-c34c-43c7-994f-ffd9d8c8e080", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "5b47e79bab9143e5acee2b7862cf2c49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ed3f9e7-9d", "ovs_interfaceid": "3ed3f9e7-9dab-435e-a54d-eea1ee04c15c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74190) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 11:50:15 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-4b765f49-e872-4073-840e-954217243e4c tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] Converting VIF {"id": "3ed3f9e7-9dab-435e-a54d-eea1ee04c15c", "address": "fa:16:3e:b1:dc:32", "network": {"id": "c9ed86bb-c34c-43c7-994f-ffd9d8c8e080", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "5b47e79bab9143e5acee2b7862cf2c49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ed3f9e7-9d", "ovs_interfaceid": "3ed3f9e7-9dab-435e-a54d-eea1ee04c15c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:50:15 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-4b765f49-e872-4073-840e-954217243e4c tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:dc:32,bridge_name='br-int',has_traffic_filtering=True,id=3ed3f9e7-9dab-435e-a54d-eea1ee04c15c,network=Network(c9ed86bb-c34c-43c7-994f-ffd9d8c8e080),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ed3f9e7-9d') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:50:15 user nova-compute[74190]: DEBUG nova.objects.instance [None req-4b765f49-e872-4073-840e-954217243e4c tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] Lazy-loading 'pci_devices' on Instance uuid d0e52e79-ce1e-4a77-a189-b0b837165e68 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:50:15 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-4b765f49-e872-4073-840e-954217243e4c tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] [instance: d0e52e79-ce1e-4a77-a189-b0b837165e68] End _get_guest_xml xml=<domain type="kvm">
Oct 18 11:50:15 user nova-compute[74190]:   <uuid>d0e52e79-ce1e-4a77-a189-b0b837165e68</uuid>
Oct 18 11:50:15 user nova-compute[74190]:   <name>instance-00000013</name>
Oct 18 11:50:15 user nova-compute[74190]:   <memory>524288</memory>
Oct 18 11:50:15 user nova-compute[74190]:   <vcpu>1</vcpu>
Oct 18 11:50:15 user nova-compute[74190]:   <metadata>
Oct 18 11:50:15 user nova-compute[74190]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 11:50:15 user nova-compute[74190]:       <nova:package version="0.0.0"/>
Oct 18 11:50:15 user nova-compute[74190]:       <nova:name>tempest-VolumesNegativeTest-instance-210485289</nova:name>
Oct 18 11:50:15 user nova-compute[74190]:       <nova:creationTime>2023-10-18 11:50:15</nova:creationTime>
Oct 18 11:50:15 user nova-compute[74190]:       <nova:flavor name="m1.tiny">
Oct 18 11:50:15 user nova-compute[74190]:         <nova:memory>512</nova:memory>
Oct 18 11:50:15 user nova-compute[74190]:         <nova:disk>1</nova:disk>
Oct 18 11:50:15 user nova-compute[74190]:         <nova:swap>0</nova:swap>
Oct 18 11:50:15 user nova-compute[74190]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 11:50:15 user nova-compute[74190]:         <nova:vcpus>1</nova:vcpus>
Oct 18 11:50:15 user nova-compute[74190]:       </nova:flavor>
Oct 18 11:50:15 user nova-compute[74190]:       <nova:owner>
Oct 18 11:50:15 user nova-compute[74190]:         <nova:user uuid="957ea997ac634e3cb3065522f7df5ad7">tempest-VolumesNegativeTest-70695717-project-member</nova:user>
Oct 18 11:50:15 user nova-compute[74190]:         <nova:project uuid="80f77bf8a3c54482b45a9a37b4fb699d">tempest-VolumesNegativeTest-70695717</nova:project>
Oct 18 11:50:15 user nova-compute[74190]:       </nova:owner>
Oct 18 11:50:15 user nova-compute[74190]:       <nova:root type="image" uuid="6e88bbf0-6e78-49a8-b3c5-9453d22a89df"/>
Oct 18 11:50:15 user nova-compute[74190]:       <nova:ports>
Oct 18 11:50:15 user nova-compute[74190]:         <nova:port uuid="3ed3f9e7-9dab-435e-a54d-eea1ee04c15c">
Oct 18 11:50:15 user nova-compute[74190]:           <nova:ip type="fixed" address="192.168.233.129" ipVersion="4"/>
Oct 18 11:50:15 user nova-compute[74190]:         </nova:port>
Oct 18 11:50:15 user nova-compute[74190]:       </nova:ports>
Oct 18 11:50:15 user nova-compute[74190]:     </nova:instance>
Oct 18 11:50:15 user nova-compute[74190]:   </metadata>
Oct 18 11:50:15 user nova-compute[74190]:   <sysinfo type="smbios">
Oct 18 11:50:15 user nova-compute[74190]:     <system>
Oct 18 11:50:15 user nova-compute[74190]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 11:50:15 user nova-compute[74190]:       <entry name="product">OpenStack Nova</entry>
Oct 18 11:50:15 user nova-compute[74190]:       <entry name="version">0.0.0</entry>
Oct 18 11:50:15 user nova-compute[74190]:       <entry name="serial">d0e52e79-ce1e-4a77-a189-b0b837165e68</entry>
Oct 18 11:50:15 user nova-compute[74190]:       <entry name="uuid">d0e52e79-ce1e-4a77-a189-b0b837165e68</entry>
Oct 18 11:50:15 user nova-compute[74190]:       <entry name="family">Virtual Machine</entry>
Oct 18 11:50:15 user nova-compute[74190]:     </system>
Oct 18 11:50:15 user nova-compute[74190]:   </sysinfo>
Oct 18 11:50:15 user nova-compute[74190]:   <os>
Oct 18 11:50:15 user nova-compute[74190]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 11:50:15 user nova-compute[74190]:     <boot dev="hd"/>
Oct 18 11:50:15 user nova-compute[74190]:     <smbios mode="sysinfo"/>
Oct 18 11:50:15 user nova-compute[74190]:   </os>
Oct 18 11:50:15 user nova-compute[74190]:   <features>
Oct 18 11:50:15 user nova-compute[74190]:     <acpi/>
Oct 18 11:50:15 user nova-compute[74190]:     <apic/>
Oct 18 11:50:15 user nova-compute[74190]:     <vmcoreinfo/>
Oct 18 11:50:15 user nova-compute[74190]:   </features>
Oct 18 11:50:15 user nova-compute[74190]:   <clock offset="utc">
Oct 18 11:50:15 user nova-compute[74190]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 11:50:15 user nova-compute[74190]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 11:50:15 user nova-compute[74190]:     <timer name="hpet" present="no"/>
Oct 18 11:50:15 user nova-compute[74190]:   </clock>
Oct 18 11:50:15 user nova-compute[74190]:   <cpu mode="custom" match="exact">
Oct 18 11:50:15 user nova-compute[74190]:     <model>Nehalem</model>
Oct 18 11:50:15 user nova-compute[74190]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 11:50:15 user nova-compute[74190]:   </cpu>
Oct 18 11:50:15 user nova-compute[74190]:   <devices>
Oct 18 11:50:15 user nova-compute[74190]:     <disk type="file" device="disk">
Oct 18 11:50:15 user nova-compute[74190]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 11:50:15 user nova-compute[74190]:       <source file="/opt/stack/data/nova/instances/d0e52e79-ce1e-4a77-a189-b0b837165e68/disk"/>
Oct 18 11:50:15 user nova-compute[74190]:       <target dev="vda" bus="virtio"/>
Oct 18 11:50:15 user nova-compute[74190]:     </disk>
Oct 18 11:50:15 user nova-compute[74190]:     <interface type="ethernet">
Oct 18 11:50:15 user nova-compute[74190]:       <mac address="fa:16:3e:b1:dc:32"/>
Oct 18 11:50:15 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:50:15 user nova-compute[74190]:       <mtu size="1442"/>
Oct 18 11:50:15 user nova-compute[74190]:       <target dev="tap3ed3f9e7-9d"/>
Oct 18 11:50:15 user nova-compute[74190]:     </interface>
Oct 18 11:50:15 user nova-compute[74190]:     <serial type="pty">
Oct 18 11:50:15 user nova-compute[74190]:       <log file="/opt/stack/data/nova/instances/d0e52e79-ce1e-4a77-a189-b0b837165e68/console.log" append="off"/>
Oct 18 11:50:15 user nova-compute[74190]:     </serial>
Oct 18 11:50:15 user nova-compute[74190]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 11:50:15 user nova-compute[74190]:     <video>
Oct 18 11:50:15 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:50:15 user nova-compute[74190]:     </video>
Oct 18 11:50:15 user nova-compute[74190]:     <rng model="virtio">
Oct 18 11:50:15 user nova-compute[74190]:       <backend model="random">/dev/urandom</backend>
Oct 18 11:50:15 user nova-compute[74190]:     </rng>
Oct 18 11:50:15 user nova-compute[74190]:     <controller type="usb" index="0" model="none"/>
Oct 18 11:50:15 user nova-compute[74190]:     <memballoon model="virtio">
Oct 18 11:50:15 user nova-compute[74190]:       <stats period="10"/>
Oct 18 11:50:15 user nova-compute[74190]:     </memballoon>
Oct 18 11:50:15 user nova-compute[74190]:   </devices>
Oct 18 11:50:15 user nova-compute[74190]: </domain>
Oct 18 11:50:15 user nova-compute[74190]:  {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 11:50:15 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-4b765f49-e872-4073-840e-954217243e4c tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:50:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-210485289',display_name='tempest-VolumesNegativeTest-instance-210485289',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-210485289',id=19,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='80f77bf8a3c54482b45a9a37b4fb699d',ramdisk_id='',reservation_id='r-pu37qrxu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-70695717',owner_user_name='tempest-VolumesNegativeTest-70695717-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:50:13Z,user_data=None,user_id='957ea997ac634e3cb3065522f7df5ad7',uuid=d0e52e79-ce1e-4a77-a189-b0b837165e68,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ed3f9e7-9dab-435e-a54d-eea1ee04c15c", "address": "fa:16:3e:b1:dc:32", "network": {"id": "c9ed86bb-c34c-43c7-994f-ffd9d8c8e080", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "5b47e79bab9143e5acee2b7862cf2c49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ed3f9e7-9d", "ovs_interfaceid": "3ed3f9e7-9dab-435e-a54d-eea1ee04c15c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 11:50:15 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-4b765f49-e872-4073-840e-954217243e4c tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] Converting VIF {"id": "3ed3f9e7-9dab-435e-a54d-eea1ee04c15c", "address": "fa:16:3e:b1:dc:32", "network": {"id": "c9ed86bb-c34c-43c7-994f-ffd9d8c8e080", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "5b47e79bab9143e5acee2b7862cf2c49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ed3f9e7-9d", "ovs_interfaceid": "3ed3f9e7-9dab-435e-a54d-eea1ee04c15c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:50:15 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-4b765f49-e872-4073-840e-954217243e4c tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:dc:32,bridge_name='br-int',has_traffic_filtering=True,id=3ed3f9e7-9dab-435e-a54d-eea1ee04c15c,network=Network(c9ed86bb-c34c-43c7-994f-ffd9d8c8e080),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ed3f9e7-9d') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:50:15 user nova-compute[74190]: DEBUG os_vif [None req-4b765f49-e872-4073-840e-954217243e4c tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:dc:32,bridge_name='br-int',has_traffic_filtering=True,id=3ed3f9e7-9dab-435e-a54d-eea1ee04c15c,network=Network(c9ed86bb-c34c-43c7-994f-ffd9d8c8e080),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ed3f9e7-9d') {{(pid=74190) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 11:50:15 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:15 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:50:15 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 11:50:15 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:15 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cd1fe406-5a48-572d-acfd-eec98ed73ec2', '_type': 'linux-noop'}}, row=False) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:50:15 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:15 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:50:15 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:15 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3ed3f9e7-9d, may_exist=True, interface_attrs={}) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:50:15 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3ed3f9e7-9d, col_values=(('qos', UUID('8aa697c1-c7f1-49de-934c-4c8d57417c87')),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:50:15 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3ed3f9e7-9d, col_values=(('external_ids', {'iface-id': '3ed3f9e7-9dab-435e-a54d-eea1ee04c15c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b1:dc:32', 'vm-uuid': 'd0e52e79-ce1e-4a77-a189-b0b837165e68'}),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:50:15 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:15 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:50:15 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:15 user nova-compute[74190]: INFO os_vif [None req-4b765f49-e872-4073-840e-954217243e4c tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:dc:32,bridge_name='br-int',has_traffic_filtering=True,id=3ed3f9e7-9dab-435e-a54d-eea1ee04c15c,network=Network(c9ed86bb-c34c-43c7-994f-ffd9d8c8e080),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ed3f9e7-9d')
Oct 18 11:50:15 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-4b765f49-e872-4073-840e-954217243e4c tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] No BDM found with device name vda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 11:50:15 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-4b765f49-e872-4073-840e-954217243e4c tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] No VIF found with MAC fa:16:3e:b1:dc:32, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 11:50:15 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 11:50:15 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 11:50:15 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.650s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:50:15 user nova-compute[74190]: INFO nova.compute.manager [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Migrating
Oct 18 11:50:15 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:50:15 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Acquired lock "compute-rpcapi-router" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:50:15 user nova-compute[74190]: INFO nova.compute.rpcapi [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Oct 18 11:50:15 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Releasing lock "compute-rpcapi-router" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:50:15 user nova-compute[74190]: DEBUG nova.network.neutron [req-bcaefdb9-36f7-44c7-9d59-f58e67921e00 req-a2fac942-bc62-43e5-a243-a7fba06a8a1c service nova] [instance: d0e52e79-ce1e-4a77-a189-b0b837165e68] Updated VIF entry in instance network info cache for port 3ed3f9e7-9dab-435e-a54d-eea1ee04c15c. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 11:50:15 user nova-compute[74190]: DEBUG nova.network.neutron [req-bcaefdb9-36f7-44c7-9d59-f58e67921e00 req-a2fac942-bc62-43e5-a243-a7fba06a8a1c service nova] [instance: d0e52e79-ce1e-4a77-a189-b0b837165e68] Updating instance_info_cache with network_info: [{"id": "3ed3f9e7-9dab-435e-a54d-eea1ee04c15c", "address": "fa:16:3e:b1:dc:32", "network": {"id": "c9ed86bb-c34c-43c7-994f-ffd9d8c8e080", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "5b47e79bab9143e5acee2b7862cf2c49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ed3f9e7-9d", "ovs_interfaceid": "3ed3f9e7-9dab-435e-a54d-eea1ee04c15c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:50:15 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-bcaefdb9-36f7-44c7-9d59-f58e67921e00 req-a2fac942-bc62-43e5-a243-a7fba06a8a1c service nova] Releasing lock "refresh_cache-d0e52e79-ce1e-4a77-a189-b0b837165e68" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:50:15 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Acquiring lock "refresh_cache-bdfe420d-f46c-44ad-8773-b675f42e24ed" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:50:15 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Acquired lock "refresh_cache-bdfe420d-f46c-44ad-8773-b675f42e24ed" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:50:15 user nova-compute[74190]: DEBUG nova.network.neutron [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Building network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 11:50:16 user nova-compute[74190]: DEBUG nova.network.neutron [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Updating instance_info_cache with network_info: [{"id": "5f5b65f1-7748-4422-8b45-e1b88476716d", "address": "fa:16:3e:cb:ff:0f", "network": {"id": "7be8675d-326a-4184-9b3e-fbaa02a4e1fc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-468552750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce179d9f22684865b577bd91bc841400", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5b65f1-77", "ovs_interfaceid": "5f5b65f1-7748-4422-8b45-e1b88476716d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:50:16 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Releasing lock "refresh_cache-bdfe420d-f46c-44ad-8773-b675f42e24ed" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:50:16 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Starting migrate_disk_and_power_off {{(pid=74190) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Oct 18 11:50:16 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:16 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:16 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:16 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:16 user nova-compute[74190]: DEBUG nova.compute.manager [req-077f6aee-8493-4211-916f-883a214e1a06 req-ed524938-ad59-494a-8e8e-1fc8974f9b76 service nova] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Received event network-vif-unplugged-5f5b65f1-7748-4422-8b45-e1b88476716d {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:50:16 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-077f6aee-8493-4211-916f-883a214e1a06 req-ed524938-ad59-494a-8e8e-1fc8974f9b76 service nova] Acquiring lock "bdfe420d-f46c-44ad-8773-b675f42e24ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:50:16 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-077f6aee-8493-4211-916f-883a214e1a06 req-ed524938-ad59-494a-8e8e-1fc8974f9b76 service nova] Lock "bdfe420d-f46c-44ad-8773-b675f42e24ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:50:16 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-077f6aee-8493-4211-916f-883a214e1a06 req-ed524938-ad59-494a-8e8e-1fc8974f9b76 service nova] Lock "bdfe420d-f46c-44ad-8773-b675f42e24ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:50:16 user nova-compute[74190]: DEBUG nova.compute.manager [req-077f6aee-8493-4211-916f-883a214e1a06 req-ed524938-ad59-494a-8e8e-1fc8974f9b76 service nova] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] No waiting events found dispatching network-vif-unplugged-5f5b65f1-7748-4422-8b45-e1b88476716d {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:50:16 user nova-compute[74190]: WARNING nova.compute.manager [req-077f6aee-8493-4211-916f-883a214e1a06 req-ed524938-ad59-494a-8e8e-1fc8974f9b76 service nova] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Received unexpected event network-vif-unplugged-5f5b65f1-7748-4422-8b45-e1b88476716d for instance with vm_state active and task_state resize_migrating.
Oct 18 11:50:16 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:16 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:16 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:16 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:17 user nova-compute[74190]: DEBUG nova.compute.manager [req-3058322e-1c44-48a8-883d-ebdaff38f25a req-801b2d2e-c08f-46b8-ab46-b22c3fe2441e service nova] [instance: d0e52e79-ce1e-4a77-a189-b0b837165e68] Received event network-vif-plugged-3ed3f9e7-9dab-435e-a54d-eea1ee04c15c {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:50:17 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-3058322e-1c44-48a8-883d-ebdaff38f25a req-801b2d2e-c08f-46b8-ab46-b22c3fe2441e service nova] Acquiring lock "d0e52e79-ce1e-4a77-a189-b0b837165e68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:50:17 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-3058322e-1c44-48a8-883d-ebdaff38f25a req-801b2d2e-c08f-46b8-ab46-b22c3fe2441e service nova] Lock "d0e52e79-ce1e-4a77-a189-b0b837165e68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:50:17 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-3058322e-1c44-48a8-883d-ebdaff38f25a req-801b2d2e-c08f-46b8-ab46-b22c3fe2441e service nova] Lock "d0e52e79-ce1e-4a77-a189-b0b837165e68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:50:17 user nova-compute[74190]: DEBUG nova.compute.manager [req-3058322e-1c44-48a8-883d-ebdaff38f25a req-801b2d2e-c08f-46b8-ab46-b22c3fe2441e service nova] [instance: d0e52e79-ce1e-4a77-a189-b0b837165e68] No waiting events found dispatching network-vif-plugged-3ed3f9e7-9dab-435e-a54d-eea1ee04c15c {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:50:17 user nova-compute[74190]: WARNING nova.compute.manager [req-3058322e-1c44-48a8-883d-ebdaff38f25a req-801b2d2e-c08f-46b8-ab46-b22c3fe2441e service nova] [instance: d0e52e79-ce1e-4a77-a189-b0b837165e68] Received unexpected event network-vif-plugged-3ed3f9e7-9dab-435e-a54d-eea1ee04c15c for instance with vm_state building and task_state spawning.
Oct 18 11:50:17 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:17 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:17 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:17 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:17 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:17 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Instance destroyed successfully.
Oct 18 11:50:17 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:45:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1652011593',display_name='tempest-ServerActionsTestOtherB-server-1652011593',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1652011593',id=13,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJf2+oC1LymyOUKrd79qlp9w/sLNNXOE0jNeE016Gw/qD1l2yX0bGo5VP+iKF1MHpeTJ2Ix6czkMyFuUdVqQvcY91kItew2KCNk3ZYu6m5FRy6Ycq3v+bQ+PiA7mcNgHFg==',key_name='tempest-keypair-1546248338',keypairs=<?>,launch_index=0,launched_at=2023-10-18T11:45:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ce179d9f22684865b577bd91bc841400',ramdisk_id='',reservation_id='r-iuitp9n6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1277618284',owner_user_name='tempest-ServerActionsTestOtherB-1277618284-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:50:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c5f5ddf3c4174afcbe7075b7f89b4f05',uuid=bdfe420d-f46c-44ad-8773-b675f42e24ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5f5b65f1-7748-4422-8b45-e1b88476716d", "address": "fa:16:3e:cb:ff:0f", "network": {"id": "7be8675d-326a-4184-9b3e-fbaa02a4e1fc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-468552750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-468552750-network", "vif_mac": "fa:16:3e:cb:ff:0f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce179d9f22684865b577bd91bc841400", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5b65f1-77", "ovs_interfaceid": "5f5b65f1-7748-4422-8b45-e1b88476716d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 11:50:17 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Converting VIF {"id": "5f5b65f1-7748-4422-8b45-e1b88476716d", "address": "fa:16:3e:cb:ff:0f", "network": {"id": "7be8675d-326a-4184-9b3e-fbaa02a4e1fc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-468552750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-468552750-network", "vif_mac": "fa:16:3e:cb:ff:0f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce179d9f22684865b577bd91bc841400", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5b65f1-77", "ovs_interfaceid": "5f5b65f1-7748-4422-8b45-e1b88476716d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:50:17 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cb:ff:0f,bridge_name='br-int',has_traffic_filtering=True,id=5f5b65f1-7748-4422-8b45-e1b88476716d,network=Network(7be8675d-326a-4184-9b3e-fbaa02a4e1fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f5b65f1-77') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:50:17 user nova-compute[74190]: DEBUG os_vif [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cb:ff:0f,bridge_name='br-int',has_traffic_filtering=True,id=5f5b65f1-7748-4422-8b45-e1b88476716d,network=Network(7be8675d-326a-4184-9b3e-fbaa02a4e1fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f5b65f1-77') {{(pid=74190) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 11:50:17 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:17 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5f5b65f1-77, bridge=br-int, if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:50:17 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:17 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:17 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:17 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6c9f3f82-84f1-4012-b122-774794b36ee2) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:50:17 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:17 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:50:17 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:17 user nova-compute[74190]: INFO os_vif [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cb:ff:0f,bridge_name='br-int',has_traffic_filtering=True,id=5f5b65f1-7748-4422-8b45-e1b88476716d,network=Network(7be8675d-326a-4184-9b3e-fbaa02a4e1fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f5b65f1-77')
Oct 18 11:50:17 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] calling os-brick to detach iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 11:50:17 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, {'target_iqn': 'iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HmdgMSxP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:50:17 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:50:17 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:50:17 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:50:17 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:17 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:17 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[af12972c-056f-439a-b709-947179eea097]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:555c71a2-d950-48cc-96fd-725e0df8ce78\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:838cbbc1-303e-481f-a54c-ebb014989095\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2637fe23-3624-4fe8-954e-266b32cf18a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:17 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 11:50:17 user nova-compute[74190]: No targets found.
Oct 18 11:50:17 user nova-compute[74190]: iSNS:
Oct 18 11:50:17 user nova-compute[74190]: No targets found.
Oct 18 11:50:17 user nova-compute[74190]: STATIC:
Oct 18 11:50:17 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:555c71a2-d950-48cc-96fd-725e0df8ce78
Oct 18 11:50:17 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:50:17 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:50:17 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49
Oct 18 11:50:17 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:50:17 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:50:17 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:838cbbc1-303e-481f-a54c-ebb014989095
Oct 18 11:50:17 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:50:17 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:50:17 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:2637fe23-3624-4fe8-954e-266b32cf18a9
Oct 18 11:50:17 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:50:17 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:50:17 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71
Oct 18 11:50:17 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:50:17 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:50:17 user nova-compute[74190]: FIRMWARE:
Oct 18 11:50:17 user nova-compute[74190]: No targets found.
Oct 18 11:50:17 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:50:17 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 11:50:17 user nova-compute[74190]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 11:50:17 user nova-compute[74190]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74190) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 11:50:17 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71', 0)] {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 11:50:17 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:17 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:17 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[083071dc-60a6-44fc-9e94-79364b794bff]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2637fe23-3624-4fe8-954e-266b32cf18a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:555c71a2-d950-48cc-96fd-725e0df8ce78\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:838cbbc1-303e-481f-a54c-ebb014989095\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:17 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:17 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:17 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[b92dac61-ca4d-4dd3-9121-9470ba5f1656]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2637fe23-3624-4fe8-954e-266b32cf18a9 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:838cbbc1-303e-481f-a54c-ebb014989095 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:555c71a2-d950-48cc-96fd-725e0df8ce78 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:17 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49 (non-flash)
Oct 18 11:50:17 user nova-compute[74190]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2637fe23-3624-4fe8-954e-266b32cf18a9 (non-flash)
Oct 18 11:50:17 user nova-compute[74190]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:838cbbc1-303e-481f-a54c-ebb014989095 (non-flash)
Oct 18 11:50:17 user nova-compute[74190]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:555c71a2-d950-48cc-96fd-725e0df8ce78 (non-flash)
Oct 18 11:50:17 user nova-compute[74190]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 (non-flash)
Oct 18 11:50:17 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:50:17 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49 (non-flash)
Oct 18 11:50:17 user nova-compute[74190]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2637fe23-3624-4fe8-954e-266b32cf18a9 (non-flash)
Oct 18 11:50:17 user nova-compute[74190]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:838cbbc1-303e-481f-a54c-ebb014989095 (non-flash)
Oct 18 11:50:17 user nova-compute[74190]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:555c71a2-d950-48cc-96fd-725e0df8ce78 (non-flash)
Oct 18 11:50:17 user nova-compute[74190]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 (non-flash)
Oct 18 11:50:17 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:50:17 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1f44692ef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71'): ({'sdf'}, set())}) {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 11:50:17 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Removing single pathed devices sdf {{(pid=74190) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 11:50:17 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:17 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:17 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e3b852-5d94-4754-9a6a-2619938ad091]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:17 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:17 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:17 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf273261-94aa-4630-9da9-0109215e0671]: (4, ('ok\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:17 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Flushing IO for device /dev/sdf {{(pid=74190) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 11:50:17 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:17 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:17 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[7790bcc5-b5c1-4e83-8337-0cf3a2b1528d]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:17 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74190) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 11:50:17 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:17 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.048s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:17 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[835ade84-dcea-41b9-951f-9a90ffbd0c36]: (4, ('1', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:17 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 11:50:17 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] SCSI volumes sdf have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 11:50:17 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71')] {{(pid=74190) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 11:50:17 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:17 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:17 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[97bba3b4-f464-4978-974b-dcd2a44f97b2]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:17 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:50:17 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 -p 172.16.0.220:3260 --logout {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:17 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:17 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[834020b4-a2f9-47cc-8766-5a52b0de855a]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:17 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71, portal: 172.16.0.220,3260]
Oct 18 11:50:17 user nova-compute[74190]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71, portal: 172.16.0.220,3260] successful.
Oct 18 11:50:17 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:50:17 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 -p 172.16.0.220:3260 --op delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:17 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:17 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[babd700b-51e6-4b0b-b191-c6fc3e9341d2]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:17 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:50:17 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:50:17 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] <== disconnect_volume: return (319ms) None {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:50:17 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Disconnected iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 11:50:17 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdfe420d-f46c-44ad-8773-b675f42e24ed/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdfe420d-f46c-44ad-8773-b675f42e24ed/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdfe420d-f46c-44ad-8773-b675f42e24ed/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdfe420d-f46c-44ad-8773-b675f42e24ed/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:18 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 11:50:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/bdfe420d-f46c-44ad-8773-b675f42e24ed_resize/disk /opt/stack/data/nova/instances/bdfe420d-f46c-44ad-8773-b675f42e24ed/disk {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] CMD "cp -r /opt/stack/data/nova/instances/bdfe420d-f46c-44ad-8773-b675f42e24ed_resize/disk /opt/stack/data/nova/instances/bdfe420d-f46c-44ad-8773-b675f42e24ed/disk" returned: 0 in 0.368s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/bdfe420d-f46c-44ad-8773-b675f42e24ed_resize/disk.info /opt/stack/data/nova/instances/bdfe420d-f46c-44ad-8773-b675f42e24ed/disk.info {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] CMD "cp -r /opt/stack/data/nova/instances/bdfe420d-f46c-44ad-8773-b675f42e24ed_resize/disk.info /opt/stack/data/nova/instances/bdfe420d-f46c-44ad-8773-b675f42e24ed/disk.info" returned: 0 in 0.042s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:18 user nova-compute[74190]: DEBUG nova.compute.manager [req-53760256-5000-420f-a7f0-b5dff12db598 req-b4c5313f-fecf-4437-9c4a-ad0bd1478d8d service nova] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Received event network-vif-plugged-5f5b65f1-7748-4422-8b45-e1b88476716d {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:50:18 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-53760256-5000-420f-a7f0-b5dff12db598 req-b4c5313f-fecf-4437-9c4a-ad0bd1478d8d service nova] Acquiring lock "bdfe420d-f46c-44ad-8773-b675f42e24ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:50:18 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-53760256-5000-420f-a7f0-b5dff12db598 req-b4c5313f-fecf-4437-9c4a-ad0bd1478d8d service nova] Lock "bdfe420d-f46c-44ad-8773-b675f42e24ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:50:18 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-53760256-5000-420f-a7f0-b5dff12db598 req-b4c5313f-fecf-4437-9c4a-ad0bd1478d8d service nova] Lock "bdfe420d-f46c-44ad-8773-b675f42e24ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:50:18 user nova-compute[74190]: DEBUG nova.compute.manager [req-53760256-5000-420f-a7f0-b5dff12db598 req-b4c5313f-fecf-4437-9c4a-ad0bd1478d8d service nova] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] No waiting events found dispatching network-vif-plugged-5f5b65f1-7748-4422-8b45-e1b88476716d {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:50:18 user nova-compute[74190]: WARNING nova.compute.manager [req-53760256-5000-420f-a7f0-b5dff12db598 req-b4c5313f-fecf-4437-9c4a-ad0bd1478d8d service nova] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Received unexpected event network-vif-plugged-5f5b65f1-7748-4422-8b45-e1b88476716d for instance with vm_state active and task_state resize_migrating.
Oct 18 11:50:19 user nova-compute[74190]: DEBUG nova.compute.manager [req-63274f3b-88a0-47e6-a766-40e7784d7605 req-b7a20e45-0785-431f-99fa-f4df41345988 service nova] [instance: d0e52e79-ce1e-4a77-a189-b0b837165e68] Received event network-vif-plugged-3ed3f9e7-9dab-435e-a54d-eea1ee04c15c {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:50:19 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-63274f3b-88a0-47e6-a766-40e7784d7605 req-b7a20e45-0785-431f-99fa-f4df41345988 service nova] Acquiring lock "d0e52e79-ce1e-4a77-a189-b0b837165e68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:50:19 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-63274f3b-88a0-47e6-a766-40e7784d7605 req-b7a20e45-0785-431f-99fa-f4df41345988 service nova] Lock "d0e52e79-ce1e-4a77-a189-b0b837165e68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:50:19 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-63274f3b-88a0-47e6-a766-40e7784d7605 req-b7a20e45-0785-431f-99fa-f4df41345988 service nova] Lock "d0e52e79-ce1e-4a77-a189-b0b837165e68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:50:19 user nova-compute[74190]: DEBUG nova.compute.manager [req-63274f3b-88a0-47e6-a766-40e7784d7605 req-b7a20e45-0785-431f-99fa-f4df41345988 service nova] [instance: d0e52e79-ce1e-4a77-a189-b0b837165e68] No waiting events found dispatching network-vif-plugged-3ed3f9e7-9dab-435e-a54d-eea1ee04c15c {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:50:19 user nova-compute[74190]: WARNING nova.compute.manager [req-63274f3b-88a0-47e6-a766-40e7784d7605 req-b7a20e45-0785-431f-99fa-f4df41345988 service nova] [instance: d0e52e79-ce1e-4a77-a189-b0b837165e68] Received unexpected event network-vif-plugged-3ed3f9e7-9dab-435e-a54d-eea1ee04c15c for instance with vm_state building and task_state spawning.
Oct 18 11:50:19 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:19 user nova-compute[74190]: DEBUG nova.compute.manager [None req-4b765f49-e872-4073-840e-954217243e4c tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] [instance: d0e52e79-ce1e-4a77-a189-b0b837165e68] Instance event wait completed in 0 seconds for  {{(pid=74190) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 11:50:19 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-4b765f49-e872-4073-840e-954217243e4c tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] [instance: d0e52e79-ce1e-4a77-a189-b0b837165e68] Guest created on hypervisor {{(pid=74190) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 11:50:19 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: d0e52e79-ce1e-4a77-a189-b0b837165e68] Instance spawned successfully.
Oct 18 11:50:19 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-4b765f49-e872-4073-840e-954217243e4c tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] [instance: d0e52e79-ce1e-4a77-a189-b0b837165e68] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 11:50:19 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-4b765f49-e872-4073-840e-954217243e4c tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] [instance: d0e52e79-ce1e-4a77-a189-b0b837165e68] Found default for hw_cdrom_bus of ide {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:50:19 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-4b765f49-e872-4073-840e-954217243e4c tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] [instance: d0e52e79-ce1e-4a77-a189-b0b837165e68] Found default for hw_disk_bus of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:50:19 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-4b765f49-e872-4073-840e-954217243e4c tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] [instance: d0e52e79-ce1e-4a77-a189-b0b837165e68] Found default for hw_input_bus of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:50:19 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-4b765f49-e872-4073-840e-954217243e4c tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] [instance: d0e52e79-ce1e-4a77-a189-b0b837165e68] Found default for hw_pointer_model of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:50:19 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-4b765f49-e872-4073-840e-954217243e4c tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] [instance: d0e52e79-ce1e-4a77-a189-b0b837165e68] Found default for hw_video_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:50:19 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-4b765f49-e872-4073-840e-954217243e4c tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] [instance: d0e52e79-ce1e-4a77-a189-b0b837165e68] Found default for hw_vif_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:50:19 user nova-compute[74190]: INFO nova.compute.manager [None req-4b765f49-e872-4073-840e-954217243e4c tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] [instance: d0e52e79-ce1e-4a77-a189-b0b837165e68] Took 6.10 seconds to spawn the instance on the hypervisor.
Oct 18 11:50:19 user nova-compute[74190]: DEBUG nova.compute.manager [None req-4b765f49-e872-4073-840e-954217243e4c tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] [instance: d0e52e79-ce1e-4a77-a189-b0b837165e68] Checking state {{(pid=74190) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 11:50:19 user nova-compute[74190]: INFO nova.compute.manager [None req-4b765f49-e872-4073-840e-954217243e4c tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] [instance: d0e52e79-ce1e-4a77-a189-b0b837165e68] Took 7.01 seconds to build instance.
Oct 18 11:50:19 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-4b765f49-e872-4073-840e-954217243e4c tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] Lock "d0e52e79-ce1e-4a77-a189-b0b837165e68" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.210s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:50:21 user nova-compute[74190]: DEBUG nova.network.neutron [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Port 5f5b65f1-7748-4422-8b45-e1b88476716d binding to destination host user is already ACTIVE {{(pid=74190) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Oct 18 11:50:21 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-cc33f43b-8b20-4f62-b212-fbad9e5ed81c tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 52d7b8e5-02cc-4148-86e2-ceb295e81afc is timed out.
Oct 18 11:50:21 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-cc33f43b-8b20-4f62-b212-fbad9e5ed81c tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Successfully detached device vdb from instance 52d7b8e5-02cc-4148-86e2-ceb295e81afc from the live domain config.
Oct 18 11:50:21 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc33f43b-8b20-4f62-b212-fbad9e5ed81c tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] calling os-brick to detach iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 11:50:21 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc33f43b-8b20-4f62-b212-fbad9e5ed81c tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, {'target_iqn': 'iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RNGiwTkM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:50:21 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-cc33f43b-8b20-4f62-b212-fbad9e5ed81c tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:50:21 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-cc33f43b-8b20-4f62-b212-fbad9e5ed81c tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:50:21 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-cc33f43b-8b20-4f62-b212-fbad9e5ed81c tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:50:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:21 user nova-compute[74190]: INFO nova.virt.block_device [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] [instance: cd28be8d-847b-468c-860f-4f479740738d] Booting with volume 17a1c8f7-ad7d-4b2a-863f-561e1c18768a at /dev/vdc
Oct 18 11:50:21 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa08397d-f6ea-4acb-af77-7695657bd6ec]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:555c71a2-d950-48cc-96fd-725e0df8ce78\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:838cbbc1-303e-481f-a54c-ebb014989095\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2637fe23-3624-4fe8-954e-266b32cf18a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:21 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc33f43b-8b20-4f62-b212-fbad9e5ed81c tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 11:50:21 user nova-compute[74190]: No targets found.
Oct 18 11:50:21 user nova-compute[74190]: iSNS:
Oct 18 11:50:21 user nova-compute[74190]: No targets found.
Oct 18 11:50:21 user nova-compute[74190]: STATIC:
Oct 18 11:50:21 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:555c71a2-d950-48cc-96fd-725e0df8ce78
Oct 18 11:50:21 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:50:21 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:50:21 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49
Oct 18 11:50:21 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:50:21 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:50:21 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:838cbbc1-303e-481f-a54c-ebb014989095
Oct 18 11:50:21 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:50:21 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:50:21 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:2637fe23-3624-4fe8-954e-266b32cf18a9
Oct 18 11:50:21 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:50:21 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:50:21 user nova-compute[74190]: FIRMWARE:
Oct 18 11:50:21 user nova-compute[74190]: No targets found.
Oct 18 11:50:21 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:50:21 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc33f43b-8b20-4f62-b212-fbad9e5ed81c tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 11:50:21 user nova-compute[74190]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 11:50:21 user nova-compute[74190]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74190) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 11:50:21 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc33f43b-8b20-4f62-b212-fbad9e5ed81c tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49', 0)] {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 11:50:21 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Acquiring lock "bdfe420d-f46c-44ad-8773-b675f42e24ed-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:50:21 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Lock "bdfe420d-f46c-44ad-8773-b675f42e24ed-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:50:21 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Lock "bdfe420d-f46c-44ad-8773-b675f42e24ed-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:50:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:21 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a7f09e-42ed-4d1a-95ea-0b0a3758ce09]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2637fe23-3624-4fe8-954e-266b32cf18a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:555c71a2-d950-48cc-96fd-725e0df8ce78\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:838cbbc1-303e-481f-a54c-ebb014989095\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:21 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[095a2dd7-e982-4a14-a0f5-2d5ebbb40582]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2637fe23-3624-4fe8-954e-266b32cf18a9 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:838cbbc1-303e-481f-a54c-ebb014989095 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:555c71a2-d950-48cc-96fd-725e0df8ce78 (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:21 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc33f43b-8b20-4f62-b212-fbad9e5ed81c tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49 (non-flash)
Oct 18 11:50:21 user nova-compute[74190]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2637fe23-3624-4fe8-954e-266b32cf18a9 (non-flash)
Oct 18 11:50:21 user nova-compute[74190]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:838cbbc1-303e-481f-a54c-ebb014989095 (non-flash)
Oct 18 11:50:21 user nova-compute[74190]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:555c71a2-d950-48cc-96fd-725e0df8ce78 (non-flash)
Oct 18 11:50:21 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:50:21 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc33f43b-8b20-4f62-b212-fbad9e5ed81c tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49 (non-flash)
Oct 18 11:50:21 user nova-compute[74190]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2637fe23-3624-4fe8-954e-266b32cf18a9 (non-flash)
Oct 18 11:50:21 user nova-compute[74190]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:838cbbc1-303e-481f-a54c-ebb014989095 (non-flash)
Oct 18 11:50:21 user nova-compute[74190]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:555c71a2-d950-48cc-96fd-725e0df8ce78 (non-flash)
Oct 18 11:50:21 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:50:21 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc33f43b-8b20-4f62-b212-fbad9e5ed81c tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1f44693e20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49'): ({'sdb'}, set())}) {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 11:50:21 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-cc33f43b-8b20-4f62-b212-fbad9e5ed81c tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Removing single pathed devices sdb {{(pid=74190) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 11:50:21 user nova-compute[74190]: DEBUG os_brick.utils [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:50:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:21 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Acquiring lock "refresh_cache-bdfe420d-f46c-44ad-8773-b675f42e24ed" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:50:21 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Acquired lock "refresh_cache-bdfe420d-f46c-44ad-8773-b675f42e24ed" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:50:21 user nova-compute[74190]: DEBUG nova.network.neutron [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Building network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 11:50:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:21 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab53d9a-99cc-440b-b204-8fb1a0ba21fb]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:21 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b0c5390-3ed0-421e-a0e6-335e868d69b6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cff158e257e1\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:21 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[887b0185-23a2-4f61-aa7d-7576c4a681fd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.037s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:21 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[48de50b3-d1ab-454e-8106-4717fe10dc73]: (4, ('ok\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:21 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-cc33f43b-8b20-4f62-b212-fbad9e5ed81c tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Flushing IO for device /dev/sdb {{(pid=74190) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 11:50:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.027s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:21 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c234bf-043f-4206-b212-b5c213b8142b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:21 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c57b97-721e-4ae5-b318-e46538595b7a]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:21 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-cc33f43b-8b20-4f62-b212-fbad9e5ed81c tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74190) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 11:50:21 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1273ef8-464c-4330-b84d-9e751e611dba]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Running cmd (subprocess): nvme version {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] 'nvme version' failed. Not Retrying. {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 11:50:21 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] nvme not present on system {{(pid=74190) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 11:50:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:21 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[9578826e-5e95-4e68-bb2c-ec6d55cdd89c]: (4, ('1', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:21 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-cc33f43b-8b20-4f62-b212-fbad9e5ed81c tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 11:50:21 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-cc33f43b-8b20-4f62-b212-fbad9e5ed81c tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] SCSI volumes sdb have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 11:50:21 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc33f43b-8b20-4f62-b212-fbad9e5ed81c tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49')] {{(pid=74190) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 11:50:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 11:50:21 user nova-compute[74190]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 11:50:21 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed25ad77-76b5-4ee9-a2b8-da567e42306f]: (4, '') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:21 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74190) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 11:50:21 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 11:50:21 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] LIGHTOS: no hostnqn found. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 11:50:21 user nova-compute[74190]: DEBUG os_brick.utils [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] <== get_connector_properties: return (169ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cff158e257e1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:50:21 user nova-compute[74190]: DEBUG nova.virt.block_device [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] [instance: cd28be8d-847b-468c-860f-4f479740738d] Updating existing volume attachment record: 33b60093-b41c-4e30-9555-550dd670b415 {{(pid=74190) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 11:50:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:21 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb4d5e46-2afb-4324-bc6c-0b820f35791f]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:21 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc33f43b-8b20-4f62-b212-fbad9e5ed81c tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:50:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49 -p 172.16.0.220:3260 --logout {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:21 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2f00d3-879a-4d7f-b6ab-e7b2dac988d5]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:21 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc33f43b-8b20-4f62-b212-fbad9e5ed81c tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49, portal: 172.16.0.220,3260]
Oct 18 11:50:21 user nova-compute[74190]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49, portal: 172.16.0.220,3260] successful.
Oct 18 11:50:21 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:50:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49 -p 172.16.0.220:3260 --op delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b46a9877-5222-479e-a581-dfc0618bfe49 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:21 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc50691b-a353-475f-8986-71c3b7c9b8eb]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:21 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc33f43b-8b20-4f62-b212-fbad9e5ed81c tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:50:21 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-cc33f43b-8b20-4f62-b212-fbad9e5ed81c tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.451s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:50:21 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc33f43b-8b20-4f62-b212-fbad9e5ed81c tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] <== disconnect_volume: return (452ms) None {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:50:21 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc33f43b-8b20-4f62-b212-fbad9e5ed81c tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Disconnected iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 11:50:22 user nova-compute[74190]: DEBUG nova.compute.manager [req-c27b8b32-d13b-47ca-b55e-98b3a948933d req-ad7e2e48-7c85-4e5f-aab9-2c8f2af90eb1 service nova] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Received event network-changed-2d8060bc-84e4-41e2-9e72-42b2159a1d1e {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:50:22 user nova-compute[74190]: DEBUG nova.compute.manager [req-c27b8b32-d13b-47ca-b55e-98b3a948933d req-ad7e2e48-7c85-4e5f-aab9-2c8f2af90eb1 service nova] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Refreshing instance network info cache due to event network-changed-2d8060bc-84e4-41e2-9e72-42b2159a1d1e. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 11:50:22 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-c27b8b32-d13b-47ca-b55e-98b3a948933d req-ad7e2e48-7c85-4e5f-aab9-2c8f2af90eb1 service nova] Acquiring lock "refresh_cache-d90a6ca0-19a6-4221-81b7-0cb05d67f38e" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:50:22 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-c27b8b32-d13b-47ca-b55e-98b3a948933d req-ad7e2e48-7c85-4e5f-aab9-2c8f2af90eb1 service nova] Acquired lock "refresh_cache-d90a6ca0-19a6-4221-81b7-0cb05d67f38e" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:50:22 user nova-compute[74190]: DEBUG nova.network.neutron [req-c27b8b32-d13b-47ca-b55e-98b3a948933d req-ad7e2e48-7c85-4e5f-aab9-2c8f2af90eb1 service nova] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Refreshing network info cache for port 2d8060bc-84e4-41e2-9e72-42b2159a1d1e {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 11:50:22 user nova-compute[74190]: DEBUG nova.network.neutron [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Updating instance_info_cache with network_info: [{"id": "5f5b65f1-7748-4422-8b45-e1b88476716d", "address": "fa:16:3e:cb:ff:0f", "network": {"id": "7be8675d-326a-4184-9b3e-fbaa02a4e1fc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-468552750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce179d9f22684865b577bd91bc841400", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5b65f1-77", "ovs_interfaceid": "5f5b65f1-7748-4422-8b45-e1b88476716d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:50:22 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Releasing lock "refresh_cache-bdfe420d-f46c-44ad-8773-b675f42e24ed" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:50:22 user nova-compute[74190]: DEBUG os_brick.utils [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:50:22 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:22 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:22 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b7389c2-8388-425c-9c0d-df334afd61ef]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cff158e257e1\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:22 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:22 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:22 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[708d5509-580d-4bc8-ae4b-586886f74196]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:22 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:22 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:22 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cdd3008-32d2-453c-8fca-01c4b09939b8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:22 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[a55b2839-63c4-4790-9d7b-0d65560822fb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:22 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Running cmd (subprocess): nvme version {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:22 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] 'nvme version' failed. Not Retrying. {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 11:50:22 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.nvmeof [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] nvme not present on system {{(pid=74190) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 11:50:22 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:22 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 11:50:22 user nova-compute[74190]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 11:50:22 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[46317da7-71fa-44e7-8714-5c77db1389af]: (4, '') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:22 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74190) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 11:50:22 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 11:50:22 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] LIGHTOS: no hostnqn found. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 11:50:22 user nova-compute[74190]: DEBUG os_brick.utils [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cff158e257e1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:50:22 user nova-compute[74190]: DEBUG nova.network.neutron [req-c27b8b32-d13b-47ca-b55e-98b3a948933d req-ad7e2e48-7c85-4e5f-aab9-2c8f2af90eb1 service nova] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Updated VIF entry in instance network info cache for port 2d8060bc-84e4-41e2-9e72-42b2159a1d1e. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 11:50:22 user nova-compute[74190]: DEBUG nova.network.neutron [req-c27b8b32-d13b-47ca-b55e-98b3a948933d req-ad7e2e48-7c85-4e5f-aab9-2c8f2af90eb1 service nova] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Updating instance_info_cache with network_info: [{"id": "2d8060bc-84e4-41e2-9e72-42b2159a1d1e", "address": "fa:16:3e:6c:a0:e2", "network": {"id": "e6ae8edc-7014-4341-91b2-4c82d72c9bb9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-15434410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548640fa718f4fdfa21c1a7783519c9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d8060bc-84", "ovs_interfaceid": "2d8060bc-84e4-41e2-9e72-42b2159a1d1e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:50:22 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-c27b8b32-d13b-47ca-b55e-98b3a948933d req-ad7e2e48-7c85-4e5f-aab9-2c8f2af90eb1 service nova] Releasing lock "refresh_cache-d90a6ca0-19a6-4221-81b7-0cb05d67f38e" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:50:22 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:31 user nova-compute[74190]: DEBUG nova.compute.manager [req-d92a4e5c-a8c0-4e20-b567-d570ceecc04c req-54783df4-1945-4ccf-bee6-bdd83b97113c service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Received event network-changed-e00eb1ac-378c-4d70-9936-d90df4c9cfbb {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:50:31 user nova-compute[74190]: DEBUG nova.compute.manager [req-d92a4e5c-a8c0-4e20-b567-d570ceecc04c req-54783df4-1945-4ccf-bee6-bdd83b97113c service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Refreshing instance network info cache due to event network-changed-e00eb1ac-378c-4d70-9936-d90df4c9cfbb. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 11:50:31 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d92a4e5c-a8c0-4e20-b567-d570ceecc04c req-54783df4-1945-4ccf-bee6-bdd83b97113c service nova] Acquiring lock "refresh_cache-738fc62c-293c-4fee-9943-45033e0f2602" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:50:31 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d92a4e5c-a8c0-4e20-b567-d570ceecc04c req-54783df4-1945-4ccf-bee6-bdd83b97113c service nova] Acquired lock "refresh_cache-738fc62c-293c-4fee-9943-45033e0f2602" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:50:31 user nova-compute[74190]: DEBUG nova.network.neutron [req-d92a4e5c-a8c0-4e20-b567-d570ceecc04c req-54783df4-1945-4ccf-bee6-bdd83b97113c service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Refreshing network info cache for port e00eb1ac-378c-4d70-9936-d90df4c9cfbb {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 11:50:31 user nova-compute[74190]: DEBUG nova.network.neutron [req-d92a4e5c-a8c0-4e20-b567-d570ceecc04c req-54783df4-1945-4ccf-bee6-bdd83b97113c service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Updated VIF entry in instance network info cache for port e00eb1ac-378c-4d70-9936-d90df4c9cfbb. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 11:50:31 user nova-compute[74190]: DEBUG nova.network.neutron [req-d92a4e5c-a8c0-4e20-b567-d570ceecc04c req-54783df4-1945-4ccf-bee6-bdd83b97113c service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Updating instance_info_cache with network_info: [{"id": "e00eb1ac-378c-4d70-9936-d90df4c9cfbb", "address": "fa:16:3e:8c:f3:0b", "network": {"id": "4abb382b-0dbd-4b6c-9403-85021fb1c43a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-328462262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53275b2e537640b59e1bb6bcb8368780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape00eb1ac-37", "ovs_interfaceid": "e00eb1ac-378c-4d70-9936-d90df4c9cfbb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "906d428b-8be9-4ac1-ac30-4f48a5448c11", "address": "fa:16:3e:6d:e6:6e", "network": {"id": "991f3e6a-9513-4e2d-8ce6-e34c5a8e8d33", "bridge": "br-int", "label": "tempest-device-tagging-net1-1313342702", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "53275b2e537640b59e1bb6bcb8368780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap906d428b-8b", "ovs_interfaceid": "906d428b-8be9-4ac1-ac30-4f48a5448c11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "44bc05d9-08bc-49ab-80a4-ee736c201a4b", "address": "fa:16:3e:50:48:95", "network": {"id": "991f3e6a-9513-4e2d-8ce6-e34c5a8e8d33", "bridge": "br-int", "label": "tempest-device-tagging-net1-1313342702", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "53275b2e537640b59e1bb6bcb8368780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44bc05d9-08", "ovs_interfaceid": "44bc05d9-08bc-49ab-80a4-ee736c201a4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1a3a415f-eace-4edd-8643-565472342393", "address": "fa:16:3e:db:69:76", "network": {"id": "991f3e6a-9513-4e2d-8ce6-e34c5a8e8d33", "bridge": "br-int", "label": "tempest-device-tagging-net1-1313342702", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "53275b2e537640b59e1bb6bcb8368780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a3a415f-ea", "ovs_interfaceid": "1a3a415f-eace-4edd-8643-565472342393", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cfde954f-7659-43ce-a771-b817aef06692", "address": "fa:16:3e:da:06:44", "network": {"id": "991f3e6a-9513-4e2d-8ce6-e34c5a8e8d33", "bridge": "br-int", "label": "tempest-device-tagging-net1-1313342702", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "53275b2e537640b59e1bb6bcb8368780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfde954f-76", "ovs_interfaceid": "cfde954f-7659-43ce-a771-b817aef06692", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ce10d70d-8444-4bd5-adfd-3fc346977282", "address": "fa:16:3e:b3:96:2f", "network": {"id": "f58bb855-be1b-4895-bc60-5dfa56567d43", "bridge": "br-int", "label": "tempest-device-tagging-net2-1711719607", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "53275b2e537640b59e1bb6bcb8368780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce10d70d-84", "ovs_interfaceid": "ce10d70d-8444-4bd5-adfd-3fc346977282", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "644ec7e2-9907-4ecb-8d84-95b2ae66d866", "address": "fa:16:3e:c2:8f:71", "network": {"id": "f58bb855-be1b-4895-bc60-5dfa56567d43", "bridge": "br-int", "label": "tempest-device-tagging-net2-1711719607", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "53275b2e537640b59e1bb6bcb8368780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap644ec7e2-99", "ovs_interfaceid": "644ec7e2-9907-4ecb-8d84-95b2ae66d866", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:50:31 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d92a4e5c-a8c0-4e20-b567-d570ceecc04c req-54783df4-1945-4ccf-bee6-bdd83b97113c service nova] Releasing lock "refresh_cache-738fc62c-293c-4fee-9943-45033e0f2602" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:50:32 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Acquiring lock "738fc62c-293c-4fee-9943-45033e0f2602" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:50:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Lock "738fc62c-293c-4fee-9943-45033e0f2602" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:50:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Acquiring lock "738fc62c-293c-4fee-9943-45033e0f2602-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:50:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Lock "738fc62c-293c-4fee-9943-45033e0f2602-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:50:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Lock "738fc62c-293c-4fee-9943-45033e0f2602-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:50:34 user nova-compute[74190]: INFO nova.compute.manager [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Terminating instance
Oct 18 11:50:34 user nova-compute[74190]: DEBUG nova.compute.manager [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Start destroying the instance on the hypervisor. {{(pid=74190) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 11:50:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:34 user nova-compute[74190]: DEBUG nova.compute.manager [req-e2232fe3-6d9d-4fa8-9fbc-074e443cccde req-14aec99a-3d56-4c2a-ad90-f35177123887 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Received event network-vif-unplugged-e00eb1ac-378c-4d70-9936-d90df4c9cfbb {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:50:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-e2232fe3-6d9d-4fa8-9fbc-074e443cccde req-14aec99a-3d56-4c2a-ad90-f35177123887 service nova] Acquiring lock "738fc62c-293c-4fee-9943-45033e0f2602-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:50:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-e2232fe3-6d9d-4fa8-9fbc-074e443cccde req-14aec99a-3d56-4c2a-ad90-f35177123887 service nova] Lock "738fc62c-293c-4fee-9943-45033e0f2602-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:50:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-e2232fe3-6d9d-4fa8-9fbc-074e443cccde req-14aec99a-3d56-4c2a-ad90-f35177123887 service nova] Lock "738fc62c-293c-4fee-9943-45033e0f2602-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:50:34 user nova-compute[74190]: DEBUG nova.compute.manager [req-e2232fe3-6d9d-4fa8-9fbc-074e443cccde req-14aec99a-3d56-4c2a-ad90-f35177123887 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] No waiting events found dispatching network-vif-unplugged-e00eb1ac-378c-4d70-9936-d90df4c9cfbb {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:50:34 user nova-compute[74190]: DEBUG nova.compute.manager [req-e2232fe3-6d9d-4fa8-9fbc-074e443cccde req-14aec99a-3d56-4c2a-ad90-f35177123887 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Received event network-vif-unplugged-e00eb1ac-378c-4d70-9936-d90df4c9cfbb for instance with task_state deleting. {{(pid=74190) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 11:50:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:34 user nova-compute[74190]: DEBUG nova.compute.manager [req-846e1cf8-e36e-426c-86f3-1647ec21645f req-298ec0bb-381c-4c4e-92a7-a046562dea16 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Received event network-vif-unplugged-44bc05d9-08bc-49ab-80a4-ee736c201a4b {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:50:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-846e1cf8-e36e-426c-86f3-1647ec21645f req-298ec0bb-381c-4c4e-92a7-a046562dea16 service nova] Acquiring lock "738fc62c-293c-4fee-9943-45033e0f2602-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:50:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-846e1cf8-e36e-426c-86f3-1647ec21645f req-298ec0bb-381c-4c4e-92a7-a046562dea16 service nova] Lock "738fc62c-293c-4fee-9943-45033e0f2602-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:50:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-846e1cf8-e36e-426c-86f3-1647ec21645f req-298ec0bb-381c-4c4e-92a7-a046562dea16 service nova] Lock "738fc62c-293c-4fee-9943-45033e0f2602-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:50:34 user nova-compute[74190]: DEBUG nova.compute.manager [req-846e1cf8-e36e-426c-86f3-1647ec21645f req-298ec0bb-381c-4c4e-92a7-a046562dea16 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] No waiting events found dispatching network-vif-unplugged-44bc05d9-08bc-49ab-80a4-ee736c201a4b {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:50:34 user nova-compute[74190]: DEBUG nova.compute.manager [req-846e1cf8-e36e-426c-86f3-1647ec21645f req-298ec0bb-381c-4c4e-92a7-a046562dea16 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Received event network-vif-unplugged-44bc05d9-08bc-49ab-80a4-ee736c201a4b for instance with task_state deleting. {{(pid=74190) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 11:50:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:35 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:35 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:35 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:35 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:35 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:35 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:35 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:35 user nova-compute[74190]: DEBUG nova.compute.manager [req-49d5e0e3-e02e-453a-8ec2-f18d2e33cce0 req-d480f0d0-1cad-4b01-b50d-c3857769b6da service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Received event network-vif-unplugged-cfde954f-7659-43ce-a771-b817aef06692 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:50:35 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-49d5e0e3-e02e-453a-8ec2-f18d2e33cce0 req-d480f0d0-1cad-4b01-b50d-c3857769b6da service nova] Acquiring lock "738fc62c-293c-4fee-9943-45033e0f2602-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:50:35 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-49d5e0e3-e02e-453a-8ec2-f18d2e33cce0 req-d480f0d0-1cad-4b01-b50d-c3857769b6da service nova] Lock "738fc62c-293c-4fee-9943-45033e0f2602-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:50:35 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-49d5e0e3-e02e-453a-8ec2-f18d2e33cce0 req-d480f0d0-1cad-4b01-b50d-c3857769b6da service nova] Lock "738fc62c-293c-4fee-9943-45033e0f2602-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:50:35 user nova-compute[74190]: DEBUG nova.compute.manager [req-49d5e0e3-e02e-453a-8ec2-f18d2e33cce0 req-d480f0d0-1cad-4b01-b50d-c3857769b6da service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] No waiting events found dispatching network-vif-unplugged-cfde954f-7659-43ce-a771-b817aef06692 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:50:35 user nova-compute[74190]: DEBUG nova.compute.manager [req-49d5e0e3-e02e-453a-8ec2-f18d2e33cce0 req-d480f0d0-1cad-4b01-b50d-c3857769b6da service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Received event network-vif-unplugged-cfde954f-7659-43ce-a771-b817aef06692 for instance with task_state deleting. {{(pid=74190) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 11:50:35 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:35 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:35 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:35 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:35 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:35 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:35 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:35 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:36 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Instance destroyed successfully.
Oct 18 11:50:36 user nova-compute[74190]: DEBUG nova.objects.instance [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Lazy-loading 'resources' on Instance uuid 738fc62c-293c-4fee-9943-45033e0f2602 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T11:46:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-715503398',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-715503398',id=14,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMFpglyECgkSZCauSo+LpQ8kghak5rJ79yWsbPSUEUra2V1BlBnNGH3ZXW5cAirt4aWQbSHcbATh7XVRNu0y4Kp/t+Zl9kT2K9mylFwo4S9K+opZiH0NySN8uxFcXBdtwA==',key_name='tempest-keypair-1606519092',keypairs=<?>,launch_index=0,launched_at=2023-10-18T11:48:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='53275b2e537640b59e1bb6bcb8368780',ramdisk_id='',reservation_id='r-jnq2b4co',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-553106169',owner_user_name='tempest-TaggedBootDevicesTest_v242-553106169-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T11:48:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9a4dc36419840d2ae7eac09cbeeea9b',uuid=738fc62c-293c-4fee-9943-45033e0f2602,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e00eb1ac-378c-4d70-9936-d90df4c9cfbb", "address": "fa:16:3e:8c:f3:0b", "network": {"id": "4abb382b-0dbd-4b6c-9403-85021fb1c43a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-328462262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53275b2e537640b59e1bb6bcb8368780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape00eb1ac-37", "ovs_interfaceid": "e00eb1ac-378c-4d70-9936-d90df4c9cfbb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Converting VIF {"id": "e00eb1ac-378c-4d70-9936-d90df4c9cfbb", "address": "fa:16:3e:8c:f3:0b", "network": {"id": "4abb382b-0dbd-4b6c-9403-85021fb1c43a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-328462262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53275b2e537640b59e1bb6bcb8368780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape00eb1ac-37", "ovs_interfaceid": "e00eb1ac-378c-4d70-9936-d90df4c9cfbb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8c:f3:0b,bridge_name='br-int',has_traffic_filtering=True,id=e00eb1ac-378c-4d70-9936-d90df4c9cfbb,network=Network(4abb382b-0dbd-4b6c-9403-85021fb1c43a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape00eb1ac-37') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG os_vif [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:f3:0b,bridge_name='br-int',has_traffic_filtering=True,id=e00eb1ac-378c-4d70-9936-d90df4c9cfbb,network=Network(4abb382b-0dbd-4b6c-9403-85021fb1c43a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape00eb1ac-37') {{(pid=74190) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape00eb1ac-37, bridge=br-int, if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a3ef6f6d-296a-4aef-b11d-50fc6727bc7d) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:36 user nova-compute[74190]: INFO os_vif [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:f3:0b,bridge_name='br-int',has_traffic_filtering=True,id=e00eb1ac-378c-4d70-9936-d90df4c9cfbb,network=Network(4abb382b-0dbd-4b6c-9403-85021fb1c43a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape00eb1ac-37')
Oct 18 11:50:36 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T11:46:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-715503398',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-715503398',id=14,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMFpglyECgkSZCauSo+LpQ8kghak5rJ79yWsbPSUEUra2V1BlBnNGH3ZXW5cAirt4aWQbSHcbATh7XVRNu0y4Kp/t+Zl9kT2K9mylFwo4S9K+opZiH0NySN8uxFcXBdtwA==',key_name='tempest-keypair-1606519092',keypairs=<?>,launch_index=0,launched_at=2023-10-18T11:48:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='53275b2e537640b59e1bb6bcb8368780',ramdisk_id='',reservation_id='r-jnq2b4co',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-553106169',owner_user_name='tempest-TaggedBootDevicesTest_v242-553106169-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T11:48:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9a4dc36419840d2ae7eac09cbeeea9b',uuid=738fc62c-293c-4fee-9943-45033e0f2602,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "906d428b-8be9-4ac1-ac30-4f48a5448c11", "address": "fa:16:3e:6d:e6:6e", "network": {"id": "991f3e6a-9513-4e2d-8ce6-e34c5a8e8d33", "bridge": "br-int", "label": "tempest-device-tagging-net1-1313342702", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "53275b2e537640b59e1bb6bcb8368780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap906d428b-8b", "ovs_interfaceid": "906d428b-8be9-4ac1-ac30-4f48a5448c11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74190) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Converting VIF {"id": "906d428b-8be9-4ac1-ac30-4f48a5448c11", "address": "fa:16:3e:6d:e6:6e", "network": {"id": "991f3e6a-9513-4e2d-8ce6-e34c5a8e8d33", "bridge": "br-int", "label": "tempest-device-tagging-net1-1313342702", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "53275b2e537640b59e1bb6bcb8368780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap906d428b-8b", "ovs_interfaceid": "906d428b-8be9-4ac1-ac30-4f48a5448c11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:e6:6e,bridge_name='br-int',has_traffic_filtering=True,id=906d428b-8be9-4ac1-ac30-4f48a5448c11,network=Network(991f3e6a-9513-4e2d-8ce6-e34c5a8e8d33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap906d428b-8b') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG os_vif [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:e6:6e,bridge_name='br-int',has_traffic_filtering=True,id=906d428b-8be9-4ac1-ac30-4f48a5448c11,network=Network(991f3e6a-9513-4e2d-8ce6-e34c5a8e8d33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap906d428b-8b') {{(pid=74190) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap906d428b-8b, bridge=br-int, if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=71ac5fae-10ac-4614-8f81-5909dc8a8b6c) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:36 user nova-compute[74190]: INFO os_vif [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:e6:6e,bridge_name='br-int',has_traffic_filtering=True,id=906d428b-8be9-4ac1-ac30-4f48a5448c11,network=Network(991f3e6a-9513-4e2d-8ce6-e34c5a8e8d33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap906d428b-8b')
Oct 18 11:50:36 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T11:46:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-715503398',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-715503398',id=14,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMFpglyECgkSZCauSo+LpQ8kghak5rJ79yWsbPSUEUra2V1BlBnNGH3ZXW5cAirt4aWQbSHcbATh7XVRNu0y4Kp/t+Zl9kT2K9mylFwo4S9K+opZiH0NySN8uxFcXBdtwA==',key_name='tempest-keypair-1606519092',keypairs=<?>,launch_index=0,launched_at=2023-10-18T11:48:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='53275b2e537640b59e1bb6bcb8368780',ramdisk_id='',reservation_id='r-jnq2b4co',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-553106169',owner_user_name='tempest-TaggedBootDevicesTest_v242-553106169-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T11:48:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9a4dc36419840d2ae7eac09cbeeea9b',uuid=738fc62c-293c-4fee-9943-45033e0f2602,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "44bc05d9-08bc-49ab-80a4-ee736c201a4b", "address": "fa:16:3e:50:48:95", "network": {"id": "991f3e6a-9513-4e2d-8ce6-e34c5a8e8d33", "bridge": "br-int", "label": "tempest-device-tagging-net1-1313342702", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "53275b2e537640b59e1bb6bcb8368780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44bc05d9-08", "ovs_interfaceid": "44bc05d9-08bc-49ab-80a4-ee736c201a4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74190) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Converting VIF {"id": "44bc05d9-08bc-49ab-80a4-ee736c201a4b", "address": "fa:16:3e:50:48:95", "network": {"id": "991f3e6a-9513-4e2d-8ce6-e34c5a8e8d33", "bridge": "br-int", "label": "tempest-device-tagging-net1-1313342702", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "53275b2e537640b59e1bb6bcb8368780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44bc05d9-08", "ovs_interfaceid": "44bc05d9-08bc-49ab-80a4-ee736c201a4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:48:95,bridge_name='br-int',has_traffic_filtering=True,id=44bc05d9-08bc-49ab-80a4-ee736c201a4b,network=Network(991f3e6a-9513-4e2d-8ce6-e34c5a8e8d33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap44bc05d9-08') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG os_vif [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:48:95,bridge_name='br-int',has_traffic_filtering=True,id=44bc05d9-08bc-49ab-80a4-ee736c201a4b,network=Network(991f3e6a-9513-4e2d-8ce6-e34c5a8e8d33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap44bc05d9-08') {{(pid=74190) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap44bc05d9-08, bridge=br-int, if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7f6520ca-4705-4729-bec9-7652814ade8b) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:36 user nova-compute[74190]: INFO os_vif [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:48:95,bridge_name='br-int',has_traffic_filtering=True,id=44bc05d9-08bc-49ab-80a4-ee736c201a4b,network=Network(991f3e6a-9513-4e2d-8ce6-e34c5a8e8d33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap44bc05d9-08')
Oct 18 11:50:36 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T11:46:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-715503398',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-715503398',id=14,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMFpglyECgkSZCauSo+LpQ8kghak5rJ79yWsbPSUEUra2V1BlBnNGH3ZXW5cAirt4aWQbSHcbATh7XVRNu0y4Kp/t+Zl9kT2K9mylFwo4S9K+opZiH0NySN8uxFcXBdtwA==',key_name='tempest-keypair-1606519092',keypairs=<?>,launch_index=0,launched_at=2023-10-18T11:48:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='53275b2e537640b59e1bb6bcb8368780',ramdisk_id='',reservation_id='r-jnq2b4co',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-553106169',owner_user_name='tempest-TaggedBootDevicesTest_v242-553106169-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T11:48:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9a4dc36419840d2ae7eac09cbeeea9b',uuid=738fc62c-293c-4fee-9943-45033e0f2602,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1a3a415f-eace-4edd-8643-565472342393", "address": "fa:16:3e:db:69:76", "network": {"id": "991f3e6a-9513-4e2d-8ce6-e34c5a8e8d33", "bridge": "br-int", "label": "tempest-device-tagging-net1-1313342702", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "53275b2e537640b59e1bb6bcb8368780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a3a415f-ea", "ovs_interfaceid": "1a3a415f-eace-4edd-8643-565472342393", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Converting VIF {"id": "1a3a415f-eace-4edd-8643-565472342393", "address": "fa:16:3e:db:69:76", "network": {"id": "991f3e6a-9513-4e2d-8ce6-e34c5a8e8d33", "bridge": "br-int", "label": "tempest-device-tagging-net1-1313342702", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "53275b2e537640b59e1bb6bcb8368780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a3a415f-ea", "ovs_interfaceid": "1a3a415f-eace-4edd-8643-565472342393", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:69:76,bridge_name='br-int',has_traffic_filtering=True,id=1a3a415f-eace-4edd-8643-565472342393,network=Network(991f3e6a-9513-4e2d-8ce6-e34c5a8e8d33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a3a415f-ea') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG os_vif [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:69:76,bridge_name='br-int',has_traffic_filtering=True,id=1a3a415f-eace-4edd-8643-565472342393,network=Network(991f3e6a-9513-4e2d-8ce6-e34c5a8e8d33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a3a415f-ea') {{(pid=74190) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1a3a415f-ea, bridge=br-int, if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b7b76cc8-023c-4b0f-8336-419ac5be0ce7) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:36 user nova-compute[74190]: INFO os_vif [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:69:76,bridge_name='br-int',has_traffic_filtering=True,id=1a3a415f-eace-4edd-8643-565472342393,network=Network(991f3e6a-9513-4e2d-8ce6-e34c5a8e8d33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a3a415f-ea')
Oct 18 11:50:36 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T11:46:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-715503398',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-715503398',id=14,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMFpglyECgkSZCauSo+LpQ8kghak5rJ79yWsbPSUEUra2V1BlBnNGH3ZXW5cAirt4aWQbSHcbATh7XVRNu0y4Kp/t+Zl9kT2K9mylFwo4S9K+opZiH0NySN8uxFcXBdtwA==',key_name='tempest-keypair-1606519092',keypairs=<?>,launch_index=0,launched_at=2023-10-18T11:48:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='53275b2e537640b59e1bb6bcb8368780',ramdisk_id='',reservation_id='r-jnq2b4co',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-553106169',owner_user_name='tempest-TaggedBootDevicesTest_v242-553106169-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T11:48:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9a4dc36419840d2ae7eac09cbeeea9b',uuid=738fc62c-293c-4fee-9943-45033e0f2602,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cfde954f-7659-43ce-a771-b817aef06692", "address": "fa:16:3e:da:06:44", "network": {"id": "991f3e6a-9513-4e2d-8ce6-e34c5a8e8d33", "bridge": "br-int", "label": "tempest-device-tagging-net1-1313342702", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "53275b2e537640b59e1bb6bcb8368780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfde954f-76", "ovs_interfaceid": "cfde954f-7659-43ce-a771-b817aef06692", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Converting VIF {"id": "cfde954f-7659-43ce-a771-b817aef06692", "address": "fa:16:3e:da:06:44", "network": {"id": "991f3e6a-9513-4e2d-8ce6-e34c5a8e8d33", "bridge": "br-int", "label": "tempest-device-tagging-net1-1313342702", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "53275b2e537640b59e1bb6bcb8368780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfde954f-76", "ovs_interfaceid": "cfde954f-7659-43ce-a771-b817aef06692", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:06:44,bridge_name='br-int',has_traffic_filtering=True,id=cfde954f-7659-43ce-a771-b817aef06692,network=Network(991f3e6a-9513-4e2d-8ce6-e34c5a8e8d33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfde954f-76') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG os_vif [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:06:44,bridge_name='br-int',has_traffic_filtering=True,id=cfde954f-7659-43ce-a771-b817aef06692,network=Network(991f3e6a-9513-4e2d-8ce6-e34c5a8e8d33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfde954f-76') {{(pid=74190) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcfde954f-76, bridge=br-int, if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7cd00d23-54ad-4154-b3df-2eafaee06a2b) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:36 user nova-compute[74190]: INFO os_vif [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:06:44,bridge_name='br-int',has_traffic_filtering=True,id=cfde954f-7659-43ce-a771-b817aef06692,network=Network(991f3e6a-9513-4e2d-8ce6-e34c5a8e8d33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfde954f-76')
Oct 18 11:50:36 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T11:46:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-715503398',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-715503398',id=14,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMFpglyECgkSZCauSo+LpQ8kghak5rJ79yWsbPSUEUra2V1BlBnNGH3ZXW5cAirt4aWQbSHcbATh7XVRNu0y4Kp/t+Zl9kT2K9mylFwo4S9K+opZiH0NySN8uxFcXBdtwA==',key_name='tempest-keypair-1606519092',keypairs=<?>,launch_index=0,launched_at=2023-10-18T11:48:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='53275b2e537640b59e1bb6bcb8368780',ramdisk_id='',reservation_id='r-jnq2b4co',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-553106169',owner_user_name='tempest-TaggedBootDevicesTest_v242-553106169-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T11:48:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9a4dc36419840d2ae7eac09cbeeea9b',uuid=738fc62c-293c-4fee-9943-45033e0f2602,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ce10d70d-8444-4bd5-adfd-3fc346977282", "address": "fa:16:3e:b3:96:2f", "network": {"id": "f58bb855-be1b-4895-bc60-5dfa56567d43", "bridge": "br-int", "label": "tempest-device-tagging-net2-1711719607", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "53275b2e537640b59e1bb6bcb8368780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce10d70d-84", "ovs_interfaceid": "ce10d70d-8444-4bd5-adfd-3fc346977282", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Converting VIF {"id": "ce10d70d-8444-4bd5-adfd-3fc346977282", "address": "fa:16:3e:b3:96:2f", "network": {"id": "f58bb855-be1b-4895-bc60-5dfa56567d43", "bridge": "br-int", "label": "tempest-device-tagging-net2-1711719607", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "53275b2e537640b59e1bb6bcb8368780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce10d70d-84", "ovs_interfaceid": "ce10d70d-8444-4bd5-adfd-3fc346977282", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:96:2f,bridge_name='br-int',has_traffic_filtering=True,id=ce10d70d-8444-4bd5-adfd-3fc346977282,network=Network(f58bb855-be1b-4895-bc60-5dfa56567d43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce10d70d-84') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG os_vif [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:96:2f,bridge_name='br-int',has_traffic_filtering=True,id=ce10d70d-8444-4bd5-adfd-3fc346977282,network=Network(f58bb855-be1b-4895-bc60-5dfa56567d43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce10d70d-84') {{(pid=74190) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapce10d70d-84, bridge=br-int, if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ad014424-cb67-45c2-b0c0-3d6b6e2d1b2b) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG nova.compute.manager [req-4d24deff-2faa-4404-9988-c8dcc444a62d req-713fb187-c55c-4696-b340-27424f343936 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Received event network-vif-plugged-e00eb1ac-378c-4d70-9936-d90df4c9cfbb {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-4d24deff-2faa-4404-9988-c8dcc444a62d req-713fb187-c55c-4696-b340-27424f343936 service nova] Acquiring lock "738fc62c-293c-4fee-9943-45033e0f2602-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-4d24deff-2faa-4404-9988-c8dcc444a62d req-713fb187-c55c-4696-b340-27424f343936 service nova] Lock "738fc62c-293c-4fee-9943-45033e0f2602-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-4d24deff-2faa-4404-9988-c8dcc444a62d req-713fb187-c55c-4696-b340-27424f343936 service nova] Lock "738fc62c-293c-4fee-9943-45033e0f2602-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG nova.compute.manager [req-4d24deff-2faa-4404-9988-c8dcc444a62d req-713fb187-c55c-4696-b340-27424f343936 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] No waiting events found dispatching network-vif-plugged-e00eb1ac-378c-4d70-9936-d90df4c9cfbb {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:50:36 user nova-compute[74190]: WARNING nova.compute.manager [req-4d24deff-2faa-4404-9988-c8dcc444a62d req-713fb187-c55c-4696-b340-27424f343936 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Received unexpected event network-vif-plugged-e00eb1ac-378c-4d70-9936-d90df4c9cfbb for instance with vm_state active and task_state deleting.
Oct 18 11:50:36 user nova-compute[74190]: DEBUG nova.compute.manager [req-4d24deff-2faa-4404-9988-c8dcc444a62d req-713fb187-c55c-4696-b340-27424f343936 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Received event network-vif-unplugged-906d428b-8be9-4ac1-ac30-4f48a5448c11 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-4d24deff-2faa-4404-9988-c8dcc444a62d req-713fb187-c55c-4696-b340-27424f343936 service nova] Acquiring lock "738fc62c-293c-4fee-9943-45033e0f2602-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-4d24deff-2faa-4404-9988-c8dcc444a62d req-713fb187-c55c-4696-b340-27424f343936 service nova] Lock "738fc62c-293c-4fee-9943-45033e0f2602-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-4d24deff-2faa-4404-9988-c8dcc444a62d req-713fb187-c55c-4696-b340-27424f343936 service nova] Lock "738fc62c-293c-4fee-9943-45033e0f2602-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG nova.compute.manager [req-4d24deff-2faa-4404-9988-c8dcc444a62d req-713fb187-c55c-4696-b340-27424f343936 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] No waiting events found dispatching network-vif-unplugged-906d428b-8be9-4ac1-ac30-4f48a5448c11 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG nova.compute.manager [req-4d24deff-2faa-4404-9988-c8dcc444a62d req-713fb187-c55c-4696-b340-27424f343936 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Received event network-vif-unplugged-906d428b-8be9-4ac1-ac30-4f48a5448c11 for instance with task_state deleting. {{(pid=74190) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG nova.compute.manager [req-4d24deff-2faa-4404-9988-c8dcc444a62d req-713fb187-c55c-4696-b340-27424f343936 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Received event network-vif-plugged-906d428b-8be9-4ac1-ac30-4f48a5448c11 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-4d24deff-2faa-4404-9988-c8dcc444a62d req-713fb187-c55c-4696-b340-27424f343936 service nova] Acquiring lock "738fc62c-293c-4fee-9943-45033e0f2602-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-4d24deff-2faa-4404-9988-c8dcc444a62d req-713fb187-c55c-4696-b340-27424f343936 service nova] Lock "738fc62c-293c-4fee-9943-45033e0f2602-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-4d24deff-2faa-4404-9988-c8dcc444a62d req-713fb187-c55c-4696-b340-27424f343936 service nova] Lock "738fc62c-293c-4fee-9943-45033e0f2602-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG nova.compute.manager [req-4d24deff-2faa-4404-9988-c8dcc444a62d req-713fb187-c55c-4696-b340-27424f343936 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] No waiting events found dispatching network-vif-plugged-906d428b-8be9-4ac1-ac30-4f48a5448c11 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:50:36 user nova-compute[74190]: WARNING nova.compute.manager [req-4d24deff-2faa-4404-9988-c8dcc444a62d req-713fb187-c55c-4696-b340-27424f343936 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Received unexpected event network-vif-plugged-906d428b-8be9-4ac1-ac30-4f48a5448c11 for instance with vm_state active and task_state deleting.
Oct 18 11:50:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:36 user nova-compute[74190]: INFO os_vif [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:96:2f,bridge_name='br-int',has_traffic_filtering=True,id=ce10d70d-8444-4bd5-adfd-3fc346977282,network=Network(f58bb855-be1b-4895-bc60-5dfa56567d43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce10d70d-84')
Oct 18 11:50:36 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T11:46:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-715503398',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-715503398',id=14,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMFpglyECgkSZCauSo+LpQ8kghak5rJ79yWsbPSUEUra2V1BlBnNGH3ZXW5cAirt4aWQbSHcbATh7XVRNu0y4Kp/t+Zl9kT2K9mylFwo4S9K+opZiH0NySN8uxFcXBdtwA==',key_name='tempest-keypair-1606519092',keypairs=<?>,launch_index=0,launched_at=2023-10-18T11:48:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='53275b2e537640b59e1bb6bcb8368780',ramdisk_id='',reservation_id='r-jnq2b4co',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-553106169',owner_user_name='tempest-TaggedBootDevicesTest_v242-553106169-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T11:48:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9a4dc36419840d2ae7eac09cbeeea9b',uuid=738fc62c-293c-4fee-9943-45033e0f2602,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "644ec7e2-9907-4ecb-8d84-95b2ae66d866", "address": "fa:16:3e:c2:8f:71", "network": {"id": "f58bb855-be1b-4895-bc60-5dfa56567d43", "bridge": "br-int", "label": "tempest-device-tagging-net2-1711719607", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "53275b2e537640b59e1bb6bcb8368780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap644ec7e2-99", "ovs_interfaceid": "644ec7e2-9907-4ecb-8d84-95b2ae66d866", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Converting VIF {"id": "644ec7e2-9907-4ecb-8d84-95b2ae66d866", "address": "fa:16:3e:c2:8f:71", "network": {"id": "f58bb855-be1b-4895-bc60-5dfa56567d43", "bridge": "br-int", "label": "tempest-device-tagging-net2-1711719607", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "53275b2e537640b59e1bb6bcb8368780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap644ec7e2-99", "ovs_interfaceid": "644ec7e2-9907-4ecb-8d84-95b2ae66d866", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:8f:71,bridge_name='br-int',has_traffic_filtering=True,id=644ec7e2-9907-4ecb-8d84-95b2ae66d866,network=Network(f58bb855-be1b-4895-bc60-5dfa56567d43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap644ec7e2-99') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG os_vif [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:8f:71,bridge_name='br-int',has_traffic_filtering=True,id=644ec7e2-9907-4ecb-8d84-95b2ae66d866,network=Network(f58bb855-be1b-4895-bc60-5dfa56567d43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap644ec7e2-99') {{(pid=74190) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap644ec7e2-99, bridge=br-int, if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG nova.compute.manager [req-c8dbd1cd-45cf-47e4-a3fa-5d8a531776a3 req-1742ab52-2ed0-4eb1-b086-97bd7f884f0b service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Received event network-vif-plugged-44bc05d9-08bc-49ab-80a4-ee736c201a4b {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-c8dbd1cd-45cf-47e4-a3fa-5d8a531776a3 req-1742ab52-2ed0-4eb1-b086-97bd7f884f0b service nova] Acquiring lock "738fc62c-293c-4fee-9943-45033e0f2602-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-c8dbd1cd-45cf-47e4-a3fa-5d8a531776a3 req-1742ab52-2ed0-4eb1-b086-97bd7f884f0b service nova] Lock "738fc62c-293c-4fee-9943-45033e0f2602-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-c8dbd1cd-45cf-47e4-a3fa-5d8a531776a3 req-1742ab52-2ed0-4eb1-b086-97bd7f884f0b service nova] Lock "738fc62c-293c-4fee-9943-45033e0f2602-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:50:36 user nova-compute[74190]: DEBUG nova.compute.manager [req-c8dbd1cd-45cf-47e4-a3fa-5d8a531776a3 req-1742ab52-2ed0-4eb1-b086-97bd7f884f0b service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] No waiting events found dispatching network-vif-plugged-44bc05d9-08bc-49ab-80a4-ee736c201a4b {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:50:36 user nova-compute[74190]: WARNING nova.compute.manager [req-c8dbd1cd-45cf-47e4-a3fa-5d8a531776a3 req-1742ab52-2ed0-4eb1-b086-97bd7f884f0b service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Received unexpected event network-vif-plugged-44bc05d9-08bc-49ab-80a4-ee736c201a4b for instance with vm_state active and task_state deleting.
Oct 18 11:50:37 user nova-compute[74190]: DEBUG nova.compute.manager [req-c8dbd1cd-45cf-47e4-a3fa-5d8a531776a3 req-1742ab52-2ed0-4eb1-b086-97bd7f884f0b service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Received event network-vif-unplugged-1a3a415f-eace-4edd-8643-565472342393 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-c8dbd1cd-45cf-47e4-a3fa-5d8a531776a3 req-1742ab52-2ed0-4eb1-b086-97bd7f884f0b service nova] Acquiring lock "738fc62c-293c-4fee-9943-45033e0f2602-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-c8dbd1cd-45cf-47e4-a3fa-5d8a531776a3 req-1742ab52-2ed0-4eb1-b086-97bd7f884f0b service nova] Lock "738fc62c-293c-4fee-9943-45033e0f2602-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-c8dbd1cd-45cf-47e4-a3fa-5d8a531776a3 req-1742ab52-2ed0-4eb1-b086-97bd7f884f0b service nova] Lock "738fc62c-293c-4fee-9943-45033e0f2602-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG nova.compute.manager [req-c8dbd1cd-45cf-47e4-a3fa-5d8a531776a3 req-1742ab52-2ed0-4eb1-b086-97bd7f884f0b service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] No waiting events found dispatching network-vif-unplugged-1a3a415f-eace-4edd-8643-565472342393 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG nova.compute.manager [req-c8dbd1cd-45cf-47e4-a3fa-5d8a531776a3 req-1742ab52-2ed0-4eb1-b086-97bd7f884f0b service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Received event network-vif-unplugged-1a3a415f-eace-4edd-8643-565472342393 for instance with task_state deleting. {{(pid=74190) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG nova.compute.manager [req-c8dbd1cd-45cf-47e4-a3fa-5d8a531776a3 req-1742ab52-2ed0-4eb1-b086-97bd7f884f0b service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Received event network-vif-plugged-1a3a415f-eace-4edd-8643-565472342393 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-c8dbd1cd-45cf-47e4-a3fa-5d8a531776a3 req-1742ab52-2ed0-4eb1-b086-97bd7f884f0b service nova] Acquiring lock "738fc62c-293c-4fee-9943-45033e0f2602-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-c8dbd1cd-45cf-47e4-a3fa-5d8a531776a3 req-1742ab52-2ed0-4eb1-b086-97bd7f884f0b service nova] Lock "738fc62c-293c-4fee-9943-45033e0f2602-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-c8dbd1cd-45cf-47e4-a3fa-5d8a531776a3 req-1742ab52-2ed0-4eb1-b086-97bd7f884f0b service nova] Lock "738fc62c-293c-4fee-9943-45033e0f2602-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG nova.compute.manager [req-c8dbd1cd-45cf-47e4-a3fa-5d8a531776a3 req-1742ab52-2ed0-4eb1-b086-97bd7f884f0b service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] No waiting events found dispatching network-vif-plugged-1a3a415f-eace-4edd-8643-565472342393 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:50:37 user nova-compute[74190]: WARNING nova.compute.manager [req-c8dbd1cd-45cf-47e4-a3fa-5d8a531776a3 req-1742ab52-2ed0-4eb1-b086-97bd7f884f0b service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Received unexpected event network-vif-plugged-1a3a415f-eace-4edd-8643-565472342393 for instance with vm_state active and task_state deleting.
Oct 18 11:50:37 user nova-compute[74190]: DEBUG nova.compute.manager [req-c8dbd1cd-45cf-47e4-a3fa-5d8a531776a3 req-1742ab52-2ed0-4eb1-b086-97bd7f884f0b service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Received event network-vif-unplugged-ce10d70d-8444-4bd5-adfd-3fc346977282 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-c8dbd1cd-45cf-47e4-a3fa-5d8a531776a3 req-1742ab52-2ed0-4eb1-b086-97bd7f884f0b service nova] Acquiring lock "738fc62c-293c-4fee-9943-45033e0f2602-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-c8dbd1cd-45cf-47e4-a3fa-5d8a531776a3 req-1742ab52-2ed0-4eb1-b086-97bd7f884f0b service nova] Lock "738fc62c-293c-4fee-9943-45033e0f2602-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-c8dbd1cd-45cf-47e4-a3fa-5d8a531776a3 req-1742ab52-2ed0-4eb1-b086-97bd7f884f0b service nova] Lock "738fc62c-293c-4fee-9943-45033e0f2602-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG nova.compute.manager [req-c8dbd1cd-45cf-47e4-a3fa-5d8a531776a3 req-1742ab52-2ed0-4eb1-b086-97bd7f884f0b service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] No waiting events found dispatching network-vif-unplugged-ce10d70d-8444-4bd5-adfd-3fc346977282 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG nova.compute.manager [req-c8dbd1cd-45cf-47e4-a3fa-5d8a531776a3 req-1742ab52-2ed0-4eb1-b086-97bd7f884f0b service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Received event network-vif-unplugged-ce10d70d-8444-4bd5-adfd-3fc346977282 for instance with task_state deleting. {{(pid=74190) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG nova.compute.manager [req-c8dbd1cd-45cf-47e4-a3fa-5d8a531776a3 req-1742ab52-2ed0-4eb1-b086-97bd7f884f0b service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Received event network-vif-plugged-ce10d70d-8444-4bd5-adfd-3fc346977282 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-c8dbd1cd-45cf-47e4-a3fa-5d8a531776a3 req-1742ab52-2ed0-4eb1-b086-97bd7f884f0b service nova] Acquiring lock "738fc62c-293c-4fee-9943-45033e0f2602-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-c8dbd1cd-45cf-47e4-a3fa-5d8a531776a3 req-1742ab52-2ed0-4eb1-b086-97bd7f884f0b service nova] Lock "738fc62c-293c-4fee-9943-45033e0f2602-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-c8dbd1cd-45cf-47e4-a3fa-5d8a531776a3 req-1742ab52-2ed0-4eb1-b086-97bd7f884f0b service nova] Lock "738fc62c-293c-4fee-9943-45033e0f2602-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG nova.compute.manager [req-c8dbd1cd-45cf-47e4-a3fa-5d8a531776a3 req-1742ab52-2ed0-4eb1-b086-97bd7f884f0b service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] No waiting events found dispatching network-vif-plugged-ce10d70d-8444-4bd5-adfd-3fc346977282 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:50:37 user nova-compute[74190]: WARNING nova.compute.manager [req-c8dbd1cd-45cf-47e4-a3fa-5d8a531776a3 req-1742ab52-2ed0-4eb1-b086-97bd7f884f0b service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Received unexpected event network-vif-plugged-ce10d70d-8444-4bd5-adfd-3fc346977282 for instance with vm_state active and task_state deleting.
Oct 18 11:50:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a7c71ab7-62aa-48a1-bba0-f9c078ec0556) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:37 user nova-compute[74190]: INFO os_vif [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:8f:71,bridge_name='br-int',has_traffic_filtering=True,id=644ec7e2-9907-4ecb-8d84-95b2ae66d866,network=Network(f58bb855-be1b-4895-bc60-5dfa56567d43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap644ec7e2-99')
Oct 18 11:50:37 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] calling os-brick to detach iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, {'target_iqn': 'iqn.2010-10.org.openstack:2637fe23-3624-4fe8-954e-266b32cf18a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TPBNkelv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:50:37 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:50:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2d56bf4-963a-44e8-9858-3dfb3e9b30fc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:555c71a2-d950-48cc-96fd-725e0df8ce78\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:838cbbc1-303e-481f-a54c-ebb014989095\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2637fe23-3624-4fe8-954e-266b32cf18a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 11:50:37 user nova-compute[74190]: No targets found.
Oct 18 11:50:37 user nova-compute[74190]: iSNS:
Oct 18 11:50:37 user nova-compute[74190]: No targets found.
Oct 18 11:50:37 user nova-compute[74190]: STATIC:
Oct 18 11:50:37 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:555c71a2-d950-48cc-96fd-725e0df8ce78
Oct 18 11:50:37 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:50:37 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:50:37 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:838cbbc1-303e-481f-a54c-ebb014989095
Oct 18 11:50:37 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:50:37 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:50:37 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:2637fe23-3624-4fe8-954e-266b32cf18a9
Oct 18 11:50:37 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:50:37 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:50:37 user nova-compute[74190]: FIRMWARE:
Oct 18 11:50:37 user nova-compute[74190]: No targets found.
Oct 18 11:50:37 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 11:50:37 user nova-compute[74190]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 11:50:37 user nova-compute[74190]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74190) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2637fe23-3624-4fe8-954e-266b32cf18a9', 0)] {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4918b1b-5cfa-496a-9060-57e00cd30f9e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2637fe23-3624-4fe8-954e-266b32cf18a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:555c71a2-d950-48cc-96fd-725e0df8ce78\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:838cbbc1-303e-481f-a54c-ebb014989095\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[d695fde2-02c7-45f6-8672-da708d7a842e]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2637fe23-3624-4fe8-954e-266b32cf18a9 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:838cbbc1-303e-481f-a54c-ebb014989095 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:555c71a2-d950-48cc-96fd-725e0df8ce78 (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2637fe23-3624-4fe8-954e-266b32cf18a9 (non-flash)
Oct 18 11:50:37 user nova-compute[74190]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:838cbbc1-303e-481f-a54c-ebb014989095 (non-flash)
Oct 18 11:50:37 user nova-compute[74190]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:555c71a2-d950-48cc-96fd-725e0df8ce78 (non-flash)
Oct 18 11:50:37 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2637fe23-3624-4fe8-954e-266b32cf18a9 (non-flash)
Oct 18 11:50:37 user nova-compute[74190]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:838cbbc1-303e-481f-a54c-ebb014989095 (non-flash)
Oct 18 11:50:37 user nova-compute[74190]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:555c71a2-d950-48cc-96fd-725e0df8ce78 (non-flash)
Oct 18 11:50:37 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1f44690a60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2637fe23-3624-4fe8-954e-266b32cf18a9'): ({'sdc'}, set())}) {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Removing single pathed devices sdc {{(pid=74190) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c98bbd-53a2-496c-adfe-284512b25ef6]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[72952214-a987-408b-8657-73b319ddddac]: (4, ('ok\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Flushing IO for device /dev/sdc {{(pid=74190) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[f042da0e-51a4-441c-ad68-ff53cca273c3]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74190) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[07498e11-ede6-4480-9253-fac3c459dab3]: (4, ('1', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] SCSI volumes sdc have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2637fe23-3624-4fe8-954e-266b32cf18a9')] {{(pid=74190) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2637fe23-3624-4fe8-954e-266b32cf18a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2637fe23-3624-4fe8-954e-266b32cf18a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ccc642-8fad-486f-93b0-05eca8c613f9]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2637fe23-3624-4fe8-954e-266b32cf18a9 -p 172.16.0.220:3260 --logout {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2637fe23-3624-4fe8-954e-266b32cf18a9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[48bc1a00-02a0-4522-a341-ba854447d9e5]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:2637fe23-3624-4fe8-954e-266b32cf18a9, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:2637fe23-3624-4fe8-954e-266b32cf18a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:2637fe23-3624-4fe8-954e-266b32cf18a9, portal: 172.16.0.220,3260]
Oct 18 11:50:37 user nova-compute[74190]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:2637fe23-3624-4fe8-954e-266b32cf18a9, portal: 172.16.0.220,3260] successful.
Oct 18 11:50:37 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2637fe23-3624-4fe8-954e-266b32cf18a9 -p 172.16.0.220:3260 --op delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2637fe23-3624-4fe8-954e-266b32cf18a9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eda71b0-18b7-4551-ac51-6e81e79759ec]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] <== disconnect_volume: return (298ms) None {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Disconnected iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] calling os-brick to detach iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, {'target_iqn': 'iqn.2010-10.org.openstack:838cbbc1-303e-481f-a54c-ebb014989095', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OyMDBxch', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:50:37 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:50:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdefdcdd-a48b-4b7d-881d-bf6f45148461]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:555c71a2-d950-48cc-96fd-725e0df8ce78\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:838cbbc1-303e-481f-a54c-ebb014989095\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 11:50:37 user nova-compute[74190]: No targets found.
Oct 18 11:50:37 user nova-compute[74190]: iSNS:
Oct 18 11:50:37 user nova-compute[74190]: No targets found.
Oct 18 11:50:37 user nova-compute[74190]: STATIC:
Oct 18 11:50:37 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:555c71a2-d950-48cc-96fd-725e0df8ce78
Oct 18 11:50:37 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:50:37 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:50:37 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:838cbbc1-303e-481f-a54c-ebb014989095
Oct 18 11:50:37 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:50:37 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:50:37 user nova-compute[74190]: FIRMWARE:
Oct 18 11:50:37 user nova-compute[74190]: No targets found.
Oct 18 11:50:37 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 11:50:37 user nova-compute[74190]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 11:50:37 user nova-compute[74190]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74190) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:838cbbc1-303e-481f-a54c-ebb014989095', 0)] {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b6ce1a2-e1ed-4e21-8196-5f8dd7807f4c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:555c71a2-d950-48cc-96fd-725e0df8ce78\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:838cbbc1-303e-481f-a54c-ebb014989095\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[4979e2ef-4699-4b76-8640-70982c7e9e1a]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:838cbbc1-303e-481f-a54c-ebb014989095 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:555c71a2-d950-48cc-96fd-725e0df8ce78 (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:838cbbc1-303e-481f-a54c-ebb014989095 (non-flash)
Oct 18 11:50:37 user nova-compute[74190]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:555c71a2-d950-48cc-96fd-725e0df8ce78 (non-flash)
Oct 18 11:50:37 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:838cbbc1-303e-481f-a54c-ebb014989095 (non-flash)
Oct 18 11:50:37 user nova-compute[74190]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:555c71a2-d950-48cc-96fd-725e0df8ce78 (non-flash)
Oct 18 11:50:37 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1f44690a60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:838cbbc1-303e-481f-a54c-ebb014989095'): ({'sdd'}, set())}) {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Removing single pathed devices sdd {{(pid=74190) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[339cee33-6ebf-4b55-8438-c86f2a69b0bd]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.038s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[24aedcad-2121-4c63-aaaa-8821b9ce32a7]: (4, ('ok\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Flushing IO for device /dev/sdd {{(pid=74190) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[6859177e-cbde-42b0-9a0f-7a0c3b866ddb]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74190) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe25a451-1331-4c5e-9b13-14c7a09e5fa2]: (4, ('1', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] SCSI volumes sdd have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:838cbbc1-303e-481f-a54c-ebb014989095')] {{(pid=74190) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:838cbbc1-303e-481f-a54c-ebb014989095 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG nova.compute.manager [req-d685af8b-53ac-459a-b42b-251874f7db7d req-d29a2d4b-cc2b-4d8e-8b34-f8414e54a0b4 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Received event network-vif-plugged-cfde954f-7659-43ce-a771-b817aef06692 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d685af8b-53ac-459a-b42b-251874f7db7d req-d29a2d4b-cc2b-4d8e-8b34-f8414e54a0b4 service nova] Acquiring lock "738fc62c-293c-4fee-9943-45033e0f2602-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d685af8b-53ac-459a-b42b-251874f7db7d req-d29a2d4b-cc2b-4d8e-8b34-f8414e54a0b4 service nova] Lock "738fc62c-293c-4fee-9943-45033e0f2602-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d685af8b-53ac-459a-b42b-251874f7db7d req-d29a2d4b-cc2b-4d8e-8b34-f8414e54a0b4 service nova] Lock "738fc62c-293c-4fee-9943-45033e0f2602-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG nova.compute.manager [req-d685af8b-53ac-459a-b42b-251874f7db7d req-d29a2d4b-cc2b-4d8e-8b34-f8414e54a0b4 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] No waiting events found dispatching network-vif-plugged-cfde954f-7659-43ce-a771-b817aef06692 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:50:37 user nova-compute[74190]: WARNING nova.compute.manager [req-d685af8b-53ac-459a-b42b-251874f7db7d req-d29a2d4b-cc2b-4d8e-8b34-f8414e54a0b4 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Received unexpected event network-vif-plugged-cfde954f-7659-43ce-a771-b817aef06692 for instance with vm_state active and task_state deleting.
Oct 18 11:50:37 user nova-compute[74190]: DEBUG nova.compute.manager [req-d685af8b-53ac-459a-b42b-251874f7db7d req-d29a2d4b-cc2b-4d8e-8b34-f8414e54a0b4 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Received event network-vif-unplugged-644ec7e2-9907-4ecb-8d84-95b2ae66d866 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d685af8b-53ac-459a-b42b-251874f7db7d req-d29a2d4b-cc2b-4d8e-8b34-f8414e54a0b4 service nova] Acquiring lock "738fc62c-293c-4fee-9943-45033e0f2602-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d685af8b-53ac-459a-b42b-251874f7db7d req-d29a2d4b-cc2b-4d8e-8b34-f8414e54a0b4 service nova] Lock "738fc62c-293c-4fee-9943-45033e0f2602-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d685af8b-53ac-459a-b42b-251874f7db7d req-d29a2d4b-cc2b-4d8e-8b34-f8414e54a0b4 service nova] Lock "738fc62c-293c-4fee-9943-45033e0f2602-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG nova.compute.manager [req-d685af8b-53ac-459a-b42b-251874f7db7d req-d29a2d4b-cc2b-4d8e-8b34-f8414e54a0b4 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] No waiting events found dispatching network-vif-unplugged-644ec7e2-9907-4ecb-8d84-95b2ae66d866 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG nova.compute.manager [req-d685af8b-53ac-459a-b42b-251874f7db7d req-d29a2d4b-cc2b-4d8e-8b34-f8414e54a0b4 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Received event network-vif-unplugged-644ec7e2-9907-4ecb-8d84-95b2ae66d866 for instance with task_state deleting. {{(pid=74190) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG nova.compute.manager [req-d685af8b-53ac-459a-b42b-251874f7db7d req-d29a2d4b-cc2b-4d8e-8b34-f8414e54a0b4 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Received event network-vif-plugged-644ec7e2-9907-4ecb-8d84-95b2ae66d866 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d685af8b-53ac-459a-b42b-251874f7db7d req-d29a2d4b-cc2b-4d8e-8b34-f8414e54a0b4 service nova] Acquiring lock "738fc62c-293c-4fee-9943-45033e0f2602-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d685af8b-53ac-459a-b42b-251874f7db7d req-d29a2d4b-cc2b-4d8e-8b34-f8414e54a0b4 service nova] Lock "738fc62c-293c-4fee-9943-45033e0f2602-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d685af8b-53ac-459a-b42b-251874f7db7d req-d29a2d4b-cc2b-4d8e-8b34-f8414e54a0b4 service nova] Lock "738fc62c-293c-4fee-9943-45033e0f2602-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG nova.compute.manager [req-d685af8b-53ac-459a-b42b-251874f7db7d req-d29a2d4b-cc2b-4d8e-8b34-f8414e54a0b4 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] No waiting events found dispatching network-vif-plugged-644ec7e2-9907-4ecb-8d84-95b2ae66d866 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:50:37 user nova-compute[74190]: WARNING nova.compute.manager [req-d685af8b-53ac-459a-b42b-251874f7db7d req-d29a2d4b-cc2b-4d8e-8b34-f8414e54a0b4 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Received unexpected event network-vif-plugged-644ec7e2-9907-4ecb-8d84-95b2ae66d866 for instance with vm_state active and task_state deleting.
Oct 18 11:50:37 user nova-compute[74190]: DEBUG nova.compute.manager [req-d685af8b-53ac-459a-b42b-251874f7db7d req-d29a2d4b-cc2b-4d8e-8b34-f8414e54a0b4 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Received event network-vif-plugged-cfde954f-7659-43ce-a771-b817aef06692 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d685af8b-53ac-459a-b42b-251874f7db7d req-d29a2d4b-cc2b-4d8e-8b34-f8414e54a0b4 service nova] Acquiring lock "738fc62c-293c-4fee-9943-45033e0f2602-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d685af8b-53ac-459a-b42b-251874f7db7d req-d29a2d4b-cc2b-4d8e-8b34-f8414e54a0b4 service nova] Lock "738fc62c-293c-4fee-9943-45033e0f2602-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d685af8b-53ac-459a-b42b-251874f7db7d req-d29a2d4b-cc2b-4d8e-8b34-f8414e54a0b4 service nova] Lock "738fc62c-293c-4fee-9943-45033e0f2602-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG nova.compute.manager [req-d685af8b-53ac-459a-b42b-251874f7db7d req-d29a2d4b-cc2b-4d8e-8b34-f8414e54a0b4 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] No waiting events found dispatching network-vif-plugged-cfde954f-7659-43ce-a771-b817aef06692 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:50:37 user nova-compute[74190]: WARNING nova.compute.manager [req-d685af8b-53ac-459a-b42b-251874f7db7d req-d29a2d4b-cc2b-4d8e-8b34-f8414e54a0b4 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Received unexpected event network-vif-plugged-cfde954f-7659-43ce-a771-b817aef06692 for instance with vm_state active and task_state deleting.
Oct 18 11:50:37 user nova-compute[74190]: DEBUG nova.compute.manager [req-d685af8b-53ac-459a-b42b-251874f7db7d req-d29a2d4b-cc2b-4d8e-8b34-f8414e54a0b4 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Received event network-vif-plugged-cfde954f-7659-43ce-a771-b817aef06692 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d685af8b-53ac-459a-b42b-251874f7db7d req-d29a2d4b-cc2b-4d8e-8b34-f8414e54a0b4 service nova] Acquiring lock "738fc62c-293c-4fee-9943-45033e0f2602-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d685af8b-53ac-459a-b42b-251874f7db7d req-d29a2d4b-cc2b-4d8e-8b34-f8414e54a0b4 service nova] Lock "738fc62c-293c-4fee-9943-45033e0f2602-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d685af8b-53ac-459a-b42b-251874f7db7d req-d29a2d4b-cc2b-4d8e-8b34-f8414e54a0b4 service nova] Lock "738fc62c-293c-4fee-9943-45033e0f2602-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG nova.compute.manager [req-d685af8b-53ac-459a-b42b-251874f7db7d req-d29a2d4b-cc2b-4d8e-8b34-f8414e54a0b4 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] No waiting events found dispatching network-vif-plugged-cfde954f-7659-43ce-a771-b817aef06692 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:50:37 user nova-compute[74190]: WARNING nova.compute.manager [req-d685af8b-53ac-459a-b42b-251874f7db7d req-d29a2d4b-cc2b-4d8e-8b34-f8414e54a0b4 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Received unexpected event network-vif-plugged-cfde954f-7659-43ce-a771-b817aef06692 for instance with vm_state active and task_state deleting.
Oct 18 11:50:37 user nova-compute[74190]: DEBUG nova.compute.manager [req-d685af8b-53ac-459a-b42b-251874f7db7d req-d29a2d4b-cc2b-4d8e-8b34-f8414e54a0b4 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Received event network-vif-unplugged-cfde954f-7659-43ce-a771-b817aef06692 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d685af8b-53ac-459a-b42b-251874f7db7d req-d29a2d4b-cc2b-4d8e-8b34-f8414e54a0b4 service nova] Acquiring lock "738fc62c-293c-4fee-9943-45033e0f2602-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d685af8b-53ac-459a-b42b-251874f7db7d req-d29a2d4b-cc2b-4d8e-8b34-f8414e54a0b4 service nova] Lock "738fc62c-293c-4fee-9943-45033e0f2602-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d685af8b-53ac-459a-b42b-251874f7db7d req-d29a2d4b-cc2b-4d8e-8b34-f8414e54a0b4 service nova] Lock "738fc62c-293c-4fee-9943-45033e0f2602-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG nova.compute.manager [req-d685af8b-53ac-459a-b42b-251874f7db7d req-d29a2d4b-cc2b-4d8e-8b34-f8414e54a0b4 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] No waiting events found dispatching network-vif-unplugged-cfde954f-7659-43ce-a771-b817aef06692 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG nova.compute.manager [req-d685af8b-53ac-459a-b42b-251874f7db7d req-d29a2d4b-cc2b-4d8e-8b34-f8414e54a0b4 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Received event network-vif-unplugged-cfde954f-7659-43ce-a771-b817aef06692 for instance with task_state deleting. {{(pid=74190) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG nova.compute.manager [req-d685af8b-53ac-459a-b42b-251874f7db7d req-d29a2d4b-cc2b-4d8e-8b34-f8414e54a0b4 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Received event network-vif-plugged-cfde954f-7659-43ce-a771-b817aef06692 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d685af8b-53ac-459a-b42b-251874f7db7d req-d29a2d4b-cc2b-4d8e-8b34-f8414e54a0b4 service nova] Acquiring lock "738fc62c-293c-4fee-9943-45033e0f2602-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d685af8b-53ac-459a-b42b-251874f7db7d req-d29a2d4b-cc2b-4d8e-8b34-f8414e54a0b4 service nova] Lock "738fc62c-293c-4fee-9943-45033e0f2602-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d685af8b-53ac-459a-b42b-251874f7db7d req-d29a2d4b-cc2b-4d8e-8b34-f8414e54a0b4 service nova] Lock "738fc62c-293c-4fee-9943-45033e0f2602-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG nova.compute.manager [req-d685af8b-53ac-459a-b42b-251874f7db7d req-d29a2d4b-cc2b-4d8e-8b34-f8414e54a0b4 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] No waiting events found dispatching network-vif-plugged-cfde954f-7659-43ce-a771-b817aef06692 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:50:37 user nova-compute[74190]: WARNING nova.compute.manager [req-d685af8b-53ac-459a-b42b-251874f7db7d req-d29a2d4b-cc2b-4d8e-8b34-f8414e54a0b4 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Received unexpected event network-vif-plugged-cfde954f-7659-43ce-a771-b817aef06692 for instance with vm_state active and task_state deleting.
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:838cbbc1-303e-481f-a54c-ebb014989095 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e8b4fc1-a473-4089-95bb-31be6db68c6b]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:838cbbc1-303e-481f-a54c-ebb014989095 -p 172.16.0.220:3260 --logout {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:838cbbc1-303e-481f-a54c-ebb014989095 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[11b405fb-3f49-4b19-ad47-23115f925242]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:838cbbc1-303e-481f-a54c-ebb014989095, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:838cbbc1-303e-481f-a54c-ebb014989095, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:838cbbc1-303e-481f-a54c-ebb014989095, portal: 172.16.0.220,3260]
Oct 18 11:50:37 user nova-compute[74190]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:838cbbc1-303e-481f-a54c-ebb014989095, portal: 172.16.0.220,3260] successful.
Oct 18 11:50:37 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:838cbbc1-303e-481f-a54c-ebb014989095 -p 172.16.0.220:3260 --op delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:838cbbc1-303e-481f-a54c-ebb014989095 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf68c16b-f9ae-4c09-84b8-47edb4f494c7]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] <== disconnect_volume: return (338ms) None {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Disconnected iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] calling os-brick to detach iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, {'target_iqn': 'iqn.2010-10.org.openstack:555c71a2-d950-48cc-96fd-725e0df8ce78', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IaNUtisS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:50:37 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:50:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f26e32-43ea-4d52-b06e-32248d8609db]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:555c71a2-d950-48cc-96fd-725e0df8ce78\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 11:50:37 user nova-compute[74190]: No targets found.
Oct 18 11:50:37 user nova-compute[74190]: iSNS:
Oct 18 11:50:37 user nova-compute[74190]: No targets found.
Oct 18 11:50:37 user nova-compute[74190]: STATIC:
Oct 18 11:50:37 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:555c71a2-d950-48cc-96fd-725e0df8ce78
Oct 18 11:50:37 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:50:37 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:50:37 user nova-compute[74190]: FIRMWARE:
Oct 18 11:50:37 user nova-compute[74190]: No targets found.
Oct 18 11:50:37 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 11:50:37 user nova-compute[74190]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 11:50:37 user nova-compute[74190]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74190) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:555c71a2-d950-48cc-96fd-725e0df8ce78', 0)] {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e964d99-753d-4763-9344-2ef83d80418c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:555c71a2-d950-48cc-96fd-725e0df8ce78\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[15cb14ed-bea5-428b-be52-5c4cf76feec5]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:555c71a2-d950-48cc-96fd-725e0df8ce78 (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:555c71a2-d950-48cc-96fd-725e0df8ce78 (non-flash)
Oct 18 11:50:37 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:555c71a2-d950-48cc-96fd-725e0df8ce78 (non-flash)
Oct 18 11:50:37 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1f44690a60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:555c71a2-d950-48cc-96fd-725e0df8ce78'): ({'sde'}, set())}) {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Removing single pathed devices sde {{(pid=74190) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[db27196f-c618-49d1-b94e-04f385efecdc]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[89de3ed8-223b-45f5-b109-e9ff78809d58]: (4, ('ok\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Flushing IO for device /dev/sde {{(pid=74190) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[6383a5b1-3dd0-413c-bba4-da7d7f5b8a69]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74190) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.039s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f79c11-c5b2-46d3-a6f1-69b7b62c5577]: (4, ('1', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] SCSI volumes sde have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:555c71a2-d950-48cc-96fd-725e0df8ce78')] {{(pid=74190) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:555c71a2-d950-48cc-96fd-725e0df8ce78 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:555c71a2-d950-48cc-96fd-725e0df8ce78 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[c87a5785-353c-44ef-ab16-658595c7e930]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:555c71a2-d950-48cc-96fd-725e0df8ce78 -p 172.16.0.220:3260 --logout {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:555c71a2-d950-48cc-96fd-725e0df8ce78 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[78bc32c2-8f1d-4067-bc85-9205513dc259]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:555c71a2-d950-48cc-96fd-725e0df8ce78, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:555c71a2-d950-48cc-96fd-725e0df8ce78, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:555c71a2-d950-48cc-96fd-725e0df8ce78, portal: 172.16.0.220,3260]
Oct 18 11:50:37 user nova-compute[74190]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:555c71a2-d950-48cc-96fd-725e0df8ce78, portal: 172.16.0.220,3260] successful.
Oct 18 11:50:37 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:555c71a2-d950-48cc-96fd-725e0df8ce78 -p 172.16.0.220:3260 --op delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:555c71a2-d950-48cc-96fd-725e0df8ce78 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ed68eb-de38-4d19-a803-4e36fb699d10]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.273s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] <== disconnect_volume: return (274ms) None {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:50:37 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Disconnected iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 11:50:37 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Deleting instance files /opt/stack/data/nova/instances/738fc62c-293c-4fee-9943-45033e0f2602_del
Oct 18 11:50:37 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Deletion of /opt/stack/data/nova/instances/738fc62c-293c-4fee-9943-45033e0f2602_del complete
Oct 18 11:50:38 user nova-compute[74190]: INFO nova.compute.manager [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Took 3.70 seconds to destroy the instance on the hypervisor.
Oct 18 11:50:38 user nova-compute[74190]: DEBUG oslo.service.loopingcall [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74190) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 11:50:38 user nova-compute[74190]: DEBUG nova.compute.manager [-] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Deallocating network for instance {{(pid=74190) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 11:50:38 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] deallocate_for_instance() {{(pid=74190) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 11:50:39 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:39 user nova-compute[74190]: DEBUG nova.compute.manager [req-fb872855-7d3c-4f17-a28a-637370efb6dd req-9886b5fc-a76a-4871-84c7-c2fa9db81817 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Received event network-vif-deleted-ce10d70d-8444-4bd5-adfd-3fc346977282 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:50:39 user nova-compute[74190]: INFO nova.compute.manager [req-fb872855-7d3c-4f17-a28a-637370efb6dd req-9886b5fc-a76a-4871-84c7-c2fa9db81817 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Neutron deleted interface ce10d70d-8444-4bd5-adfd-3fc346977282; detaching it from the instance and deleting it from the info cache
Oct 18 11:50:39 user nova-compute[74190]: DEBUG nova.network.neutron [req-fb872855-7d3c-4f17-a28a-637370efb6dd req-9886b5fc-a76a-4871-84c7-c2fa9db81817 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Updating instance_info_cache with network_info: [{"id": "e00eb1ac-378c-4d70-9936-d90df4c9cfbb", "address": "fa:16:3e:8c:f3:0b", "network": {"id": "4abb382b-0dbd-4b6c-9403-85021fb1c43a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-328462262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53275b2e537640b59e1bb6bcb8368780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape00eb1ac-37", "ovs_interfaceid": "e00eb1ac-378c-4d70-9936-d90df4c9cfbb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "906d428b-8be9-4ac1-ac30-4f48a5448c11", "address": "fa:16:3e:6d:e6:6e", "network": {"id": "991f3e6a-9513-4e2d-8ce6-e34c5a8e8d33", "bridge": "br-int", "label": "tempest-device-tagging-net1-1313342702", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "53275b2e537640b59e1bb6bcb8368780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap906d428b-8b", "ovs_interfaceid": "906d428b-8be9-4ac1-ac30-4f48a5448c11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "44bc05d9-08bc-49ab-80a4-ee736c201a4b", "address": "fa:16:3e:50:48:95", "network": {"id": "991f3e6a-9513-4e2d-8ce6-e34c5a8e8d33", "bridge": "br-int", "label": "tempest-device-tagging-net1-1313342702", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "53275b2e537640b59e1bb6bcb8368780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44bc05d9-08", "ovs_interfaceid": "44bc05d9-08bc-49ab-80a4-ee736c201a4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1a3a415f-eace-4edd-8643-565472342393", "address": "fa:16:3e:db:69:76", "network": {"id": "991f3e6a-9513-4e2d-8ce6-e34c5a8e8d33", "bridge": "br-int", "label": "tempest-device-tagging-net1-1313342702", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "53275b2e537640b59e1bb6bcb8368780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a3a415f-ea", "ovs_interfaceid": "1a3a415f-eace-4edd-8643-565472342393", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cfde954f-7659-43ce-a771-b817aef06692", "address": "fa:16:3e:da:06:44", "network": {"id": "991f3e6a-9513-4e2d-8ce6-e34c5a8e8d33", "bridge": "br-int", "label": "tempest-device-tagging-net1-1313342702", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "53275b2e537640b59e1bb6bcb8368780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfde954f-76", "ovs_interfaceid": "cfde954f-7659-43ce-a771-b817aef06692", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "644ec7e2-9907-4ecb-8d84-95b2ae66d866", "address": "fa:16:3e:c2:8f:71", "network": {"id": "f58bb855-be1b-4895-bc60-5dfa56567d43", "bridge": "br-int", "label": "tempest-device-tagging-net2-1711719607", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "53275b2e537640b59e1bb6bcb8368780", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap644ec7e2-99", "ovs_interfaceid": "644ec7e2-9907-4ecb-8d84-95b2ae66d866", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:50:39 user nova-compute[74190]: DEBUG nova.compute.manager [req-fb872855-7d3c-4f17-a28a-637370efb6dd req-9886b5fc-a76a-4871-84c7-c2fa9db81817 service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Detach interface failed, port_id=ce10d70d-8444-4bd5-adfd-3fc346977282, reason: Instance 738fc62c-293c-4fee-9943-45033e0f2602 could not be found. {{(pid=74190) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 18 11:50:41 user nova-compute[74190]: DEBUG nova.objects.instance [None req-cc33f43b-8b20-4f62-b212-fbad9e5ed81c tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lazy-loading 'flavor' on Instance uuid 52d7b8e5-02cc-4148-86e2-ceb295e81afc {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:50:41 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-cc33f43b-8b20-4f62-b212-fbad9e5ed81c tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lock "52d7b8e5-02cc-4148-86e2-ceb295e81afc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 40.621s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:50:41 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Updating instance_info_cache with network_info: [] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:50:41 user nova-compute[74190]: INFO nova.compute.manager [-] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Took 3.49 seconds to deallocate network for instance.
Oct 18 11:50:42 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG nova.compute.manager [req-7d603f1c-3a34-40b3-8517-527d8f57b4e8 req-47f5d96a-f62d-469f-89f5-ca2c69b01f7b service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Received event network-vif-deleted-cfde954f-7659-43ce-a771-b817aef06692 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG nova.compute.manager [req-7d603f1c-3a34-40b3-8517-527d8f57b4e8 req-47f5d96a-f62d-469f-89f5-ca2c69b01f7b service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Received event network-vif-deleted-644ec7e2-9907-4ecb-8d84-95b2ae66d866 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG nova.compute.manager [req-7d603f1c-3a34-40b3-8517-527d8f57b4e8 req-47f5d96a-f62d-469f-89f5-ca2c69b01f7b service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Received event network-vif-deleted-e00eb1ac-378c-4d70-9936-d90df4c9cfbb {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG nova.compute.manager [req-7d603f1c-3a34-40b3-8517-527d8f57b4e8 req-47f5d96a-f62d-469f-89f5-ca2c69b01f7b service nova] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Received event network-vif-deleted-1a3a415f-eace-4edd-8643-565472342393 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Starting finish_migration {{(pid=74190) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Instance directory exists: not creating {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 18 11:50:42 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Creating image(s)
Oct 18 11:50:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG nova.compute.manager [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] [instance: cd28be8d-847b-468c-860f-4f479740738d] Start spawning the instance on the hypervisor. {{(pid=74190) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] [instance: cd28be8d-847b-468c-860f-4f479740738d] Creating instance directory {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 11:50:42 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] [instance: cd28be8d-847b-468c-860f-4f479740738d] Creating image(s)
Oct 18 11:50:42 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] [instance: cd28be8d-847b-468c-860f-4f479740738d] Did not create local disks {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] [instance: cd28be8d-847b-468c-860f-4f479740738d] Ensure instance console log exists: /opt/stack/data/nova/instances/cd28be8d-847b-468c-860f-4f479740738d/console.log {{(pid=74190) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] [instance: cd28be8d-847b-468c-860f-4f479740738d] Start _get_guest_xml network_info=[{"id": "c2ed33ff-2096-4def-98c5-709db8bc0ea4", "address": "fa:16:3e:11:db:57", "network": {"id": "bef90182-e108-423e-842c-2037d5cc1a4b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-640378484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ed33ff-20", "ovs_interfaceid": "c2ed33ff-2096-4def-98c5-709db8bc0ea4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "aca29f48-4a6d-472a-ac70-7006b63b9996", "address": "fa:16:3e:71:0a:c4", "network": {"id": "50f9056b-d85d-4a43-8981-3c5c98e1bf52", "bridge": "br-int", "label": "tempest-device-tagging-net1-737454421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaca29f48-4a", "ovs_interfaceid": "aca29f48-4a6d-472a-ac70-7006b63b9996", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d5f803c0-bb6c-41be-8294-fb3565e03413", "address": "fa:16:3e:43:be:0d", "network": {"id": "50f9056b-d85d-4a43-8981-3c5c98e1bf52", "bridge": "br-int", "label": "tempest-device-tagging-net1-737454421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f803c0-bb", "ovs_interfaceid": "d5f803c0-bb6c-41be-8294-fb3565e03413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0a00abcf-957e-4276-a975-522f8a42ad55", "address": "fa:16:3e:c8:b9:46", "network": {"id": "50f9056b-d85d-4a43-8981-3c5c98e1bf52", "bridge": "br-int", "label": "tempest-device-tagging-net1-737454421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a00abcf-95", "ovs_interfaceid": "0a00abcf-957e-4276-a975-522f8a42ad55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "11c7c4ff-db41-4231-8300-ee85a94619c1", "address": "fa:16:3e:ca:c8:e5", "network": {"id": "50f9056b-d85d-4a43-8981-3c5c98e1bf52", "bridge": "br-int", "label": "tempest-device-tagging-net1-737454421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11c7c4ff-db", "ovs_interfaceid": "11c7c4ff-db41-4231-8300-ee85a94619c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dba85cc3-dd42-4fa4-96d3-bec15903344f", "address": "fa:16:3e:fb:32:89", "network": {"id": "1ba257ec-d104-413d-bbf9-d9702ed5a1b4", "bridge": "br-int", "label": "tempest-device-tagging-net2-445498545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdba85cc3-dd", "ovs_interfaceid": "dba85cc3-dd42-4fa4-96d3-bec15903344f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "35f010df-56fb-4234-879b-19f86f36a2d3", "address": "fa:16:3e:bf:a7:36", "network": {"id": "1ba257ec-d104-413d-bbf9-d9702ed5a1b4", "bridge": "br-int", "label": "tempest-device-tagging-net2-445498545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35f010df-56", "ovs_interfaceid": "35f010df-56fb-4234-879b-19f86f36a2d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aciJuZkM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'cd28be8d-847b-468c-860f-4f479740738d', 'attached_at': '', 'detached_at': '', 'volume_id': '40eb314e-5a7a-45f4-93f5-e67b23f6d02a', 'serial': '40eb314e-5a7a-45f4-93f5-e67b23f6d02a'}, 'delete_on_termination': False, 'guest_format': None, 'attachment_id': '4454359b-a19d-4476-8487-019a400646aa', 'volume_type': None}, {'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'boot_index': 1, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:011ac309-ad42-43cc-ab45-e09e022b6e56', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tAxbldQM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'cd28be8d-847b-468c-860f-4f479740738d', 'attached_at': '', 'detached_at': '', 'volume_id': '011ac309-ad42-43cc-ab45-e09e022b6e56', 'serial': '011ac309-ad42-43cc-ab45-e09e022b6e56'}, 'delete_on_termination': False, 'guest_format': None, 'attachment_id': 'ea19d714-7699-494e-aad7-0fedd22ec98e', 'volume_type': None}, {'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'device_type': 'disk', 'boot_index': 2, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:17a1c8f7-ad7d-4b2a-863f-561e1c18768a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZJKGlEXu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'cd28be8d-847b-468c-860f-4f479740738d', 'attached_at': '', 'detached_at': '', 'volume_id': '17a1c8f7-ad7d-4b2a-863f-561e1c18768a', 'serial': '17a1c8f7-ad7d-4b2a-863f-561e1c18768a'}, 'delete_on_termination': False, 'guest_format': None, 'attachment_id': '33b60093-b41c-4e30-9555-550dd670b415', 'volume_type': None} {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.194s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG nova.virt.disk.api [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bdfe420d-f46c-44ad-8773-b675f42e24ed/disk. size=21474836480 {{(pid=74190) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdfe420d-f46c-44ad-8773-b675f42e24ed/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:42 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:50:42 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:50:42 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] CPU controller missing on host. {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] CPU controller found on host. {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74190) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T11:37:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Flavor limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Image limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Flavor pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Image pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Got 1 possible topologies {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] [instance: cd28be8d-847b-468c-860f-4f479740738d] Calling os-brick to attach iSCSI Volume {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aciJuZkM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:50:42 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:50:42 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:50:42 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:50:42 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:50:42 user nova-compute[74190]: INFO os_brick.initiator.connectors.iscsi [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 11:50:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a -p 172.16.0.220:3260 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffaaed5e-5524-42b4-9095-004021c78811]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 11:50:42 user nova-compute[74190]:  {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a -p 172.16.0.220:3260 --interface default --op new {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6e3ffda-73bf-4970-82da-b78a8e1ab14a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a] added\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a] added
Oct 18 11:50:42 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f197d01-e4d9-4b83-bee1-757799f3e159]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdfe420d-f46c-44ad-8773-b675f42e24ed/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/bdfe420d-f46c-44ad-8773-b675f42e24ed/disk 21474836480 {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a46516-faa2-4c19-b099-59223f906bda]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aciJuZkM {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/bdfe420d-f46c-44ad-8773-b675f42e24ed/disk 21474836480" returned: 0 in 0.052s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aciJuZkM" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ef1e5e4-32ef-4ba7-8e73-56f16e3dd979]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aciJuZkM'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Did not create local disks {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Ensure instance console log exists: /opt/stack/data/nova/instances/bdfe420d-f46c-44ad-8773-b675f42e24ed/console.log {{(pid=74190) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Start _get_guest_xml network_info=[{"id": "5f5b65f1-7748-4422-8b45-e1b88476716d", "address": "fa:16:3e:cb:ff:0f", "network": {"id": "7be8675d-326a-4184-9b3e-fbaa02a4e1fc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-468552750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-468552750-network", "vif_mac": "fa:16:3e:cb:ff:0f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce179d9f22684865b577bd91bc841400", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5b65f1-77", "ovs_interfaceid": "5f5b65f1-7748-4422-8b45-e1b88476716d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'image_id': '6e88bbf0-6e78-49a8-b3c5-9453d22a89df'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HmdgMSxP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'bdfe420d-f46c-44ad-8773-b675f42e24ed', 'attached_at': '2023-10-18T11:50:42.000000', 'detached_at': '', 'volume_id': '7316be11-03d9-47f3-bf3c-2563c3a92c71', 'serial': '7316be11-03d9-47f3-bf3c-2563c3a92c71'}, 'delete_on_termination': False, 'guest_format': None, 'attachment_id': 'a28ac656-ac87-4f59-b9d2-7d3d2ff279c2', 'volume_type': None} {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[034b048c-8dfc-4e08-bd99-7763f0def09c]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:42 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:50:42 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:50:42 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] CPU controller missing on host. {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] CPU controller found on host. {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74190) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T11:37:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Flavor limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Image limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Flavor pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Image pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Got 1 possible topologies {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Calling os-brick to attach iSCSI Volume {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HmdgMSxP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:50:42 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:50:42 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.022s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb837ad-f964-4810-b77f-7821ad7cc48b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 18 11:50:42 user nova-compute[74190]:  {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 18 11:50:42 user nova-compute[74190]:  {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:50:42 user nova-compute[74190]: WARNING os_brick.initiator.connectors.iscsi [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 18 11:50:42 user nova-compute[74190]: 
Oct 18 11:50:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a -p 172.16.0.220:3260 --login {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ef1d5d-4b5e-43e6-aea7-a4b32d211248]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a, portal: 172.16.0.220,3260]
Oct 18 11:50:42 user nova-compute[74190]: Login to [iface: default, target: iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a, portal: 172.16.0.220,3260] successful.
Oct 18 11:50:42 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[f326ff43-3d4c-4345-9ee2-47e0c44cf6fe]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7122d82-15f4-41fb-a9f9-e69228cefcfc]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a (non-flash)
Oct 18 11:50:42 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a (non-flash)
Oct 18 11:50:42 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.339s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Connected to 172.16.0.220:3260 {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] HCTL ('33', '-', '-', 0) found on session 22 with lun 0 {{(pid=74190) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74190) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[701aef2c-43c4-4203-9cc5-d298a9f077a7]: (4, ('- - 0', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Searching for a device in session 22 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74190) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 11:50:42 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aciJuZkM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 11:50:43 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b204d274-93da-4606-a6e4-f17ffd0445e8 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Acquiring lock "d90a6ca0-19a6-4221-81b7-0cb05d67f38e" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:50:43 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b204d274-93da-4606-a6e4-f17ffd0445e8 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Lock "d90a6ca0-19a6-4221-81b7-0cb05d67f38e" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:50:43 user nova-compute[74190]: INFO nova.compute.manager [None req-b204d274-93da-4606-a6e4-f17ffd0445e8 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Shelving
Oct 18 11:50:43 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:43 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:43 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:43 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:43 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:43 user nova-compute[74190]: DEBUG nova.compute.manager [req-9534b7b8-2b72-49e1-9382-48910dfd5298 req-b2d0a9e0-6a61-401d-80a6-29824f123a49 service nova] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Received event network-vif-unplugged-2d8060bc-84e4-41e2-9e72-42b2159a1d1e {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:50:43 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-9534b7b8-2b72-49e1-9382-48910dfd5298 req-b2d0a9e0-6a61-401d-80a6-29824f123a49 service nova] Acquiring lock "d90a6ca0-19a6-4221-81b7-0cb05d67f38e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:50:43 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-9534b7b8-2b72-49e1-9382-48910dfd5298 req-b2d0a9e0-6a61-401d-80a6-29824f123a49 service nova] Lock "d90a6ca0-19a6-4221-81b7-0cb05d67f38e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:50:43 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-9534b7b8-2b72-49e1-9382-48910dfd5298 req-b2d0a9e0-6a61-401d-80a6-29824f123a49 service nova] Lock "d90a6ca0-19a6-4221-81b7-0cb05d67f38e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:50:43 user nova-compute[74190]: DEBUG nova.compute.manager [req-9534b7b8-2b72-49e1-9382-48910dfd5298 req-b2d0a9e0-6a61-401d-80a6-29824f123a49 service nova] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] No waiting events found dispatching network-vif-unplugged-2d8060bc-84e4-41e2-9e72-42b2159a1d1e {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:50:43 user nova-compute[74190]: WARNING nova.compute.manager [req-9534b7b8-2b72-49e1-9382-48910dfd5298 req-b2d0a9e0-6a61-401d-80a6-29824f123a49 service nova] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Received unexpected event network-vif-unplugged-2d8060bc-84e4-41e2-9e72-42b2159a1d1e for instance with vm_state active and task_state shelving.
Oct 18 11:50:43 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.371s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:50:43 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] <== connect_volume: return (1374ms) {'type': 'block', 'scsi_wwn': '26662376264333663', 'path': '/dev/sdb'} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:50:43 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] [instance: cd28be8d-847b-468c-860f-4f479740738d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26662376264333663', 'path': '/dev/sdb'} {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 11:50:43 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.136s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:50:43 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:50:43 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:50:43 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:50:43 user nova-compute[74190]: INFO os_brick.initiator.connectors.iscsi [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 11:50:43 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 -p 172.16.0.220:3260 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:43 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:43 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ff0265-dd0a-4b0c-832f-4a77e820057c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:43 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 11:50:43 user nova-compute[74190]:  {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:50:43 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 -p 172.16.0.220:3260 --interface default --op new {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:43 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] [instance: cd28be8d-847b-468c-860f-4f479740738d] Calling os-brick to attach iSCSI Volume {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 11:50:43 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:011ac309-ad42-43cc-ab45-e09e022b6e56', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tAxbldQM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:50:43 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:50:43 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:50:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.033s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:44 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[5747aca5-8cbf-457d-9e9d-b1a352133582]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71] added\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:44 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71] added
Oct 18 11:50:44 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:50:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:44 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Instance destroyed successfully.
Oct 18 11:50:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:44 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e958dd-1fec-43fe-baac-a436206e1487]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:44 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:50:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:44 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[969c0cd5-291e-47cb-98ed-b165a34ad5b4]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:44 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:50:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HmdgMSxP {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:44 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-b204d274-93da-4606-a6e4-f17ffd0445e8 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Beginning cold snapshot process
Oct 18 11:50:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HmdgMSxP" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:44 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac731dcd-27f8-43db-b850-4cd63dd1f03e]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:44 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HmdgMSxP'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:50:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:44 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c430a34-0232-481e-85f1-3f5f8832d043]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:44 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:50:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:44 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[64d4ffc4-8fff-40c2-8fee-a063f64bd419]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:44 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a (non-flash)
Oct 18 11:50:44 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:50:44 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a (non-flash)
Oct 18 11:50:44 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:50:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 -p 172.16.0.220:3260 --login {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:44 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e8b1a7f-2c68-4b07-bb14-cba01e208159]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:44 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71, portal: 172.16.0.220,3260]
Oct 18 11:50:44 user nova-compute[74190]: Login to [iface: default, target: iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71, portal: 172.16.0.220,3260] successful.
Oct 18 11:50:44 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:50:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:44 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f03a1b3-8587-4298-9da9-81eed64e73d8]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:44 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:50:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:44 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[b68a9edf-697a-4e8a-8530-6ad52da9f9cc]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:44 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a (non-flash)
Oct 18 11:50:44 user nova-compute[74190]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 (non-flash)
Oct 18 11:50:44 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:50:44 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a (non-flash)
Oct 18 11:50:44 user nova-compute[74190]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 (non-flash)
Oct 18 11:50:44 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:50:44 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:50:44 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Connected to 172.16.0.220:3260 {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 11:50:44 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] HCTL ('34', '-', '-', 0) found on session 23 with lun 0 {{(pid=74190) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 11:50:44 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74190) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 11:50:44 user nova-compute[74190]: DEBUG nova.privsep.utils [None req-b204d274-93da-4606-a6e4-f17ffd0445e8 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74190) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 18 11:50:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b204d274-93da-4606-a6e4-f17ffd0445e8 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/d90a6ca0-19a6-4221-81b7-0cb05d67f38e/disk /opt/stack/data/nova/instances/snapshots/tmpk5y03u3n/710571c757a844cc91d61b086a738425 {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:44 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[5520ec87-44a1-425d-ba9f-7cbe701e0cd0]: (4, ('- - 0', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:44 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Searching for a device in session 23 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74190) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 11:50:44 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HmdgMSxP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 11:50:44 user nova-compute[74190]: INFO nova.compute.manager [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] [instance: 738fc62c-293c-4fee-9943-45033e0f2602] Took 3.01 seconds to detach 3 volumes for instance.
Oct 18 11:50:44 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:44 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:50:44 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:50:45 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 11:50:45 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 11:50:45 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.454s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:50:45 user nova-compute[74190]: INFO nova.scheduler.client.report [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Deleted allocations for instance 738fc62c-293c-4fee-9943-45033e0f2602
Oct 18 11:50:45 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b204d274-93da-4606-a6e4-f17ffd0445e8 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/d90a6ca0-19a6-4221-81b7-0cb05d67f38e/disk /opt/stack/data/nova/instances/snapshots/tmpk5y03u3n/710571c757a844cc91d61b086a738425" returned: 0 in 0.896s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:45 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-b204d274-93da-4606-a6e4-f17ffd0445e8 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Snapshot extracted, beginning image upload
Oct 18 11:50:45 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-479f94fd-6d81-49c2-9840-531684426abd tempest-TaggedBootDevicesTest_v242-553106169 tempest-TaggedBootDevicesTest_v242-553106169-project-member] Lock "738fc62c-293c-4fee-9943-45033e0f2602" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.887s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:50:45 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.384s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:50:45 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] <== connect_volume: return (2519ms) {'type': 'block', 'scsi_wwn': '26339373435386535', 'path': '/dev/sdc'} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:50:45 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26339373435386535', 'path': '/dev/sdc'} {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 11:50:45 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.350s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:50:45 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:50:45 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:011ac309-ad42-43cc-ab45-e09e022b6e56" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:50:45 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:011ac309-ad42-43cc-ab45-e09e022b6e56" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:50:45 user nova-compute[74190]: INFO os_brick.initiator.connectors.iscsi [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 11:50:45 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:011ac309-ad42-43cc-ab45-e09e022b6e56 -p 172.16.0.220:3260 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:45 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:011ac309-ad42-43cc-ab45-e09e022b6e56 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:45 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[181d38ab-8dd1-4e90-8a81-cb674cad8a25]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:45 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 11:50:45 user nova-compute[74190]:  {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:50:45 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:011ac309-ad42-43cc-ab45-e09e022b6e56 -p 172.16.0.220:3260 --interface default --op new {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:45 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:45:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1652011593',display_name='tempest-ServerActionsTestOtherB-server-1652011593',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1652011593',id=13,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJf2+oC1LymyOUKrd79qlp9w/sLNNXOE0jNeE016Gw/qD1l2yX0bGo5VP+iKF1MHpeTJ2Ix6czkMyFuUdVqQvcY91kItew2KCNk3ZYu6m5FRy6Ycq3v+bQ+PiA7mcNgHFg==',key_name='tempest-keypair-1546248338',keypairs=<?>,launch_index=0,launched_at=2023-10-18T11:45:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ce179d9f22684865b577bd91bc841400',ramdisk_id='',reservation_id='r-iuitp9n6',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1277618284',owner_user_name='tempest-ServerActionsTestOtherB-1277618284-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:50:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c5f5ddf3c4174afcbe7075b7f89b4f05',uuid=bdfe420d-f46c-44ad-8773-b675f42e24ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5f5b65f1-7748-4422-8b45-e1b88476716d", "address": "fa:16:3e:cb:ff:0f", "network": {"id": "7be8675d-326a-4184-9b3e-fbaa02a4e1fc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-468552750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-468552750-network", "vif_mac": "fa:16:3e:cb:ff:0f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce179d9f22684865b577bd91bc841400", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5b65f1-77", "ovs_interfaceid": "5f5b65f1-7748-4422-8b45-e1b88476716d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74190) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 11:50:45 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Converting VIF {"id": "5f5b65f1-7748-4422-8b45-e1b88476716d", "address": "fa:16:3e:cb:ff:0f", "network": {"id": "7be8675d-326a-4184-9b3e-fbaa02a4e1fc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-468552750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-468552750-network", "vif_mac": "fa:16:3e:cb:ff:0f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce179d9f22684865b577bd91bc841400", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5b65f1-77", "ovs_interfaceid": "5f5b65f1-7748-4422-8b45-e1b88476716d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:50:45 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:ff:0f,bridge_name='br-int',has_traffic_filtering=True,id=5f5b65f1-7748-4422-8b45-e1b88476716d,network=Network(7be8675d-326a-4184-9b3e-fbaa02a4e1fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f5b65f1-77') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:50:45 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] End _get_guest_xml xml=<domain type="kvm">
Oct 18 11:50:45 user nova-compute[74190]:   <uuid>bdfe420d-f46c-44ad-8773-b675f42e24ed</uuid>
Oct 18 11:50:45 user nova-compute[74190]:   <name>instance-0000000d</name>
Oct 18 11:50:45 user nova-compute[74190]:   <memory>2097152</memory>
Oct 18 11:50:45 user nova-compute[74190]:   <vcpu>1</vcpu>
Oct 18 11:50:45 user nova-compute[74190]:   <metadata>
Oct 18 11:50:45 user nova-compute[74190]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 11:50:45 user nova-compute[74190]:       <nova:package version="0.0.0"/>
Oct 18 11:50:45 user nova-compute[74190]:       <nova:name>tempest-ServerActionsTestOtherB-server-1652011593</nova:name>
Oct 18 11:50:45 user nova-compute[74190]:       <nova:creationTime>2023-10-18 11:50:42</nova:creationTime>
Oct 18 11:50:45 user nova-compute[74190]:       <nova:flavor name="m1.small">
Oct 18 11:50:45 user nova-compute[74190]:         <nova:memory>2048</nova:memory>
Oct 18 11:50:45 user nova-compute[74190]:         <nova:disk>20</nova:disk>
Oct 18 11:50:45 user nova-compute[74190]:         <nova:swap>0</nova:swap>
Oct 18 11:50:45 user nova-compute[74190]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 11:50:45 user nova-compute[74190]:         <nova:vcpus>1</nova:vcpus>
Oct 18 11:50:45 user nova-compute[74190]:       </nova:flavor>
Oct 18 11:50:45 user nova-compute[74190]:       <nova:owner>
Oct 18 11:50:45 user nova-compute[74190]:         <nova:user uuid="c5f5ddf3c4174afcbe7075b7f89b4f05">tempest-ServerActionsTestOtherB-1277618284-project-member</nova:user>
Oct 18 11:50:45 user nova-compute[74190]:         <nova:project uuid="ce179d9f22684865b577bd91bc841400">tempest-ServerActionsTestOtherB-1277618284</nova:project>
Oct 18 11:50:45 user nova-compute[74190]:       </nova:owner>
Oct 18 11:50:45 user nova-compute[74190]:       <nova:root type="image" uuid="6e88bbf0-6e78-49a8-b3c5-9453d22a89df"/>
Oct 18 11:50:45 user nova-compute[74190]:       <nova:ports>
Oct 18 11:50:45 user nova-compute[74190]:         <nova:port uuid="5f5b65f1-7748-4422-8b45-e1b88476716d">
Oct 18 11:50:45 user nova-compute[74190]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 18 11:50:45 user nova-compute[74190]:         </nova:port>
Oct 18 11:50:45 user nova-compute[74190]:       </nova:ports>
Oct 18 11:50:45 user nova-compute[74190]:     </nova:instance>
Oct 18 11:50:45 user nova-compute[74190]:   </metadata>
Oct 18 11:50:45 user nova-compute[74190]:   <sysinfo type="smbios">
Oct 18 11:50:45 user nova-compute[74190]:     <system>
Oct 18 11:50:45 user nova-compute[74190]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 11:50:45 user nova-compute[74190]:       <entry name="product">OpenStack Nova</entry>
Oct 18 11:50:45 user nova-compute[74190]:       <entry name="version">0.0.0</entry>
Oct 18 11:50:45 user nova-compute[74190]:       <entry name="serial">bdfe420d-f46c-44ad-8773-b675f42e24ed</entry>
Oct 18 11:50:45 user nova-compute[74190]:       <entry name="uuid">bdfe420d-f46c-44ad-8773-b675f42e24ed</entry>
Oct 18 11:50:45 user nova-compute[74190]:       <entry name="family">Virtual Machine</entry>
Oct 18 11:50:45 user nova-compute[74190]:     </system>
Oct 18 11:50:45 user nova-compute[74190]:   </sysinfo>
Oct 18 11:50:45 user nova-compute[74190]:   <os>
Oct 18 11:50:45 user nova-compute[74190]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 11:50:45 user nova-compute[74190]:     <boot dev="hd"/>
Oct 18 11:50:45 user nova-compute[74190]:     <smbios mode="sysinfo"/>
Oct 18 11:50:45 user nova-compute[74190]:   </os>
Oct 18 11:50:45 user nova-compute[74190]:   <features>
Oct 18 11:50:45 user nova-compute[74190]:     <acpi/>
Oct 18 11:50:45 user nova-compute[74190]:     <apic/>
Oct 18 11:50:45 user nova-compute[74190]:     <vmcoreinfo/>
Oct 18 11:50:45 user nova-compute[74190]:   </features>
Oct 18 11:50:45 user nova-compute[74190]:   <clock offset="utc">
Oct 18 11:50:45 user nova-compute[74190]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 11:50:45 user nova-compute[74190]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 11:50:45 user nova-compute[74190]:     <timer name="hpet" present="no"/>
Oct 18 11:50:45 user nova-compute[74190]:   </clock>
Oct 18 11:50:45 user nova-compute[74190]:   <cpu mode="custom" match="exact">
Oct 18 11:50:45 user nova-compute[74190]:     <model>Nehalem</model>
Oct 18 11:50:45 user nova-compute[74190]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 11:50:45 user nova-compute[74190]:   </cpu>
Oct 18 11:50:45 user nova-compute[74190]:   <devices>
Oct 18 11:50:45 user nova-compute[74190]:     <disk type="file" device="disk">
Oct 18 11:50:45 user nova-compute[74190]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 11:50:45 user nova-compute[74190]:       <source file="/opt/stack/data/nova/instances/bdfe420d-f46c-44ad-8773-b675f42e24ed/disk"/>
Oct 18 11:50:45 user nova-compute[74190]:       <target dev="vda" bus="virtio"/>
Oct 18 11:50:45 user nova-compute[74190]:     </disk>
Oct 18 11:50:45 user nova-compute[74190]:     <disk type="block" device="disk">
Oct 18 11:50:45 user nova-compute[74190]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 11:50:45 user nova-compute[74190]:       <source dev="/dev/sdc"/>
Oct 18 11:50:45 user nova-compute[74190]:       <target dev="vdb" bus="virtio"/>
Oct 18 11:50:45 user nova-compute[74190]:       <serial>7316be11-03d9-47f3-bf3c-2563c3a92c71</serial>
Oct 18 11:50:45 user nova-compute[74190]:     </disk>
Oct 18 11:50:45 user nova-compute[74190]:     <interface type="ethernet">
Oct 18 11:50:45 user nova-compute[74190]:       <mac address="fa:16:3e:cb:ff:0f"/>
Oct 18 11:50:45 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:50:45 user nova-compute[74190]:       <mtu size="1442"/>
Oct 18 11:50:45 user nova-compute[74190]:       <target dev="tap5f5b65f1-77"/>
Oct 18 11:50:45 user nova-compute[74190]:     </interface>
Oct 18 11:50:45 user nova-compute[74190]:     <serial type="pty">
Oct 18 11:50:45 user nova-compute[74190]:       <log file="/opt/stack/data/nova/instances/bdfe420d-f46c-44ad-8773-b675f42e24ed/console.log" append="off"/>
Oct 18 11:50:45 user nova-compute[74190]:     </serial>
Oct 18 11:50:45 user nova-compute[74190]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 11:50:45 user nova-compute[74190]:     <video>
Oct 18 11:50:45 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:50:45 user nova-compute[74190]:     </video>
Oct 18 11:50:45 user nova-compute[74190]:     <rng model="virtio">
Oct 18 11:50:45 user nova-compute[74190]:       <backend model="random">/dev/urandom</backend>
Oct 18 11:50:45 user nova-compute[74190]:     </rng>
Oct 18 11:50:45 user nova-compute[74190]:     <controller type="usb" index="0" model="none"/>
Oct 18 11:50:45 user nova-compute[74190]:     <memballoon model="virtio">
Oct 18 11:50:45 user nova-compute[74190]:       <stats period="10"/>
Oct 18 11:50:45 user nova-compute[74190]:     </memballoon>
Oct 18 11:50:45 user nova-compute[74190]:   </devices>
Oct 18 11:50:45 user nova-compute[74190]: </domain>
Oct 18 11:50:45 user nova-compute[74190]:  {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 11:50:45 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:45:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1652011593',display_name='tempest-ServerActionsTestOtherB-server-1652011593',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1652011593',id=13,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJf2+oC1LymyOUKrd79qlp9w/sLNNXOE0jNeE016Gw/qD1l2yX0bGo5VP+iKF1MHpeTJ2Ix6czkMyFuUdVqQvcY91kItew2KCNk3ZYu6m5FRy6Ycq3v+bQ+PiA7mcNgHFg==',key_name='tempest-keypair-1546248338',keypairs=<?>,launch_index=0,launched_at=2023-10-18T11:45:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ce179d9f22684865b577bd91bc841400',ramdisk_id='',reservation_id='r-iuitp9n6',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1277618284',owner_user_name='tempest-ServerActionsTestOtherB-1277618284-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:50:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c5f5ddf3c4174afcbe7075b7f89b4f05',uuid=bdfe420d-f46c-44ad-8773-b675f42e24ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5f5b65f1-7748-4422-8b45-e1b88476716d", "address": "fa:16:3e:cb:ff:0f", "network": {"id": "7be8675d-326a-4184-9b3e-fbaa02a4e1fc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-468552750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-468552750-network", "vif_mac": "fa:16:3e:cb:ff:0f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce179d9f22684865b577bd91bc841400", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5b65f1-77", "ovs_interfaceid": "5f5b65f1-7748-4422-8b45-e1b88476716d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 11:50:45 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Converting VIF {"id": "5f5b65f1-7748-4422-8b45-e1b88476716d", "address": "fa:16:3e:cb:ff:0f", "network": {"id": "7be8675d-326a-4184-9b3e-fbaa02a4e1fc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-468552750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-468552750-network", "vif_mac": "fa:16:3e:cb:ff:0f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce179d9f22684865b577bd91bc841400", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5b65f1-77", "ovs_interfaceid": "5f5b65f1-7748-4422-8b45-e1b88476716d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:50:45 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:ff:0f,bridge_name='br-int',has_traffic_filtering=True,id=5f5b65f1-7748-4422-8b45-e1b88476716d,network=Network(7be8675d-326a-4184-9b3e-fbaa02a4e1fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f5b65f1-77') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:50:45 user nova-compute[74190]: DEBUG os_vif [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:ff:0f,bridge_name='br-int',has_traffic_filtering=True,id=5f5b65f1-7748-4422-8b45-e1b88476716d,network=Network(7be8675d-326a-4184-9b3e-fbaa02a4e1fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f5b65f1-77') {{(pid=74190) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 11:50:45 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:45 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:50:45 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 11:50:45 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:45 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3fd0ec1e-344b-5167-9f79-aed34c0ad165', '_type': 'linux-noop'}}, row=False) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:50:45 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:45 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:50:45 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:011ac309-ad42-43cc-ab45-e09e022b6e56 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:45 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca4021b-681a-47f9-baac-8668a98cb33e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:011ac309-ad42-43cc-ab45-e09e022b6e56] added\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:45 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:011ac309-ad42-43cc-ab45-e09e022b6e56] added
Oct 18 11:50:45 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:50:45 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:45 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:011ac309-ad42-43cc-ab45-e09e022b6e56 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:45 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:45 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5f5b65f1-77, may_exist=True, interface_attrs={}) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:50:45 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5f5b65f1-77, col_values=(('qos', UUID('6c4e1f7a-87fc-4bae-937f-75e82b56a667')),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:50:45 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5f5b65f1-77, col_values=(('external_ids', {'iface-id': '5f5b65f1-7748-4422-8b45-e1b88476716d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cb:ff:0f', 'vm-uuid': 'bdfe420d-f46c-44ad-8773-b675f42e24ed'}),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:50:45 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:45 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:50:45 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:011ac309-ad42-43cc-ab45-e09e022b6e56 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:45 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[42dd114f-d5bc-47d7-8985-fba859e8aa47]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:45 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:50:45 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:011ac309-ad42-43cc-ab45-e09e022b6e56 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:45 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:45 user nova-compute[74190]: INFO os_vif [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:ff:0f,bridge_name='br-int',has_traffic_filtering=True,id=5f5b65f1-7748-4422-8b45-e1b88476716d,network=Network(7be8675d-326a-4184-9b3e-fbaa02a4e1fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f5b65f1-77')
Oct 18 11:50:45 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:011ac309-ad42-43cc-ab45-e09e022b6e56 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:45 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f40a7a-e51d-4f38-b7c4-861677f04cb6]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:45 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:50:45 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:011ac309-ad42-43cc-ab45-e09e022b6e56 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tAxbldQM {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:45 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:011ac309-ad42-43cc-ab45-e09e022b6e56 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tAxbldQM" returned: 0 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:45 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc1cac5-2d95-49c8-8e16-f12b699a38e1]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:45 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tAxbldQM'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:50:45 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:011ac309-ad42-43cc-ab45-e09e022b6e56 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:45 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:011ac309-ad42-43cc-ab45-e09e022b6e56 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:45 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c8e1e03-7f63-48c4-93be-54e3928651e2]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:45 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:50:45 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:45 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] No BDM found with device name vda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 11:50:45 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 11:50:45 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] No VIF found with MAC fa:16:3e:cb:ff:0f, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 11:50:45 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:45 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc11e6a5-866a-46ea-b72b-91892eb23a67]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:45 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a (non-flash)
Oct 18 11:50:45 user nova-compute[74190]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 (non-flash)
Oct 18 11:50:45 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:50:45 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a (non-flash)
Oct 18 11:50:45 user nova-compute[74190]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 (non-flash)
Oct 18 11:50:45 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:50:45 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:011ac309-ad42-43cc-ab45-e09e022b6e56 -p 172.16.0.220:3260 --login {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:45 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:011ac309-ad42-43cc-ab45-e09e022b6e56 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:45 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[be1b2fed-e1db-4a08-a717-6a5d4c974ebe]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:011ac309-ad42-43cc-ab45-e09e022b6e56, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:011ac309-ad42-43cc-ab45-e09e022b6e56, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:45 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:011ac309-ad42-43cc-ab45-e09e022b6e56, portal: 172.16.0.220,3260]
Oct 18 11:50:45 user nova-compute[74190]: Login to [iface: default, target: iqn.2010-10.org.openstack:011ac309-ad42-43cc-ab45-e09e022b6e56, portal: 172.16.0.220,3260] successful.
Oct 18 11:50:45 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:50:45 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:011ac309-ad42-43cc-ab45-e09e022b6e56 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:45 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:011ac309-ad42-43cc-ab45-e09e022b6e56 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:45 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[412b920b-fbac-4e34-bb66-278328783a4a]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:45 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:50:45 user nova-compute[74190]: DEBUG nova.compute.manager [req-4d5a7a13-412f-4a63-9c4b-13b765e8c316 req-8704cbf8-f1e7-44e7-bc58-4c66724f9af0 service nova] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Received event network-vif-plugged-2d8060bc-84e4-41e2-9e72-42b2159a1d1e {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:50:45 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-4d5a7a13-412f-4a63-9c4b-13b765e8c316 req-8704cbf8-f1e7-44e7-bc58-4c66724f9af0 service nova] Acquiring lock "d90a6ca0-19a6-4221-81b7-0cb05d67f38e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:50:45 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-4d5a7a13-412f-4a63-9c4b-13b765e8c316 req-8704cbf8-f1e7-44e7-bc58-4c66724f9af0 service nova] Lock "d90a6ca0-19a6-4221-81b7-0cb05d67f38e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:50:45 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-4d5a7a13-412f-4a63-9c4b-13b765e8c316 req-8704cbf8-f1e7-44e7-bc58-4c66724f9af0 service nova] Lock "d90a6ca0-19a6-4221-81b7-0cb05d67f38e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:50:45 user nova-compute[74190]: DEBUG nova.compute.manager [req-4d5a7a13-412f-4a63-9c4b-13b765e8c316 req-8704cbf8-f1e7-44e7-bc58-4c66724f9af0 service nova] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] No waiting events found dispatching network-vif-plugged-2d8060bc-84e4-41e2-9e72-42b2159a1d1e {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:50:45 user nova-compute[74190]: WARNING nova.compute.manager [req-4d5a7a13-412f-4a63-9c4b-13b765e8c316 req-8704cbf8-f1e7-44e7-bc58-4c66724f9af0 service nova] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Received unexpected event network-vif-plugged-2d8060bc-84e4-41e2-9e72-42b2159a1d1e for instance with vm_state active and task_state shelving_image_uploading.
Oct 18 11:50:45 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:45 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:45 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[16fdd938-2b4f-40d2-86d0-199a41e57e13]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:011ac309-ad42-43cc-ab45-e09e022b6e56 (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:45 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a (non-flash)
Oct 18 11:50:45 user nova-compute[74190]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 (non-flash)
Oct 18 11:50:45 user nova-compute[74190]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:011ac309-ad42-43cc-ab45-e09e022b6e56 (non-flash)
Oct 18 11:50:45 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:50:45 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a (non-flash)
Oct 18 11:50:45 user nova-compute[74190]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 (non-flash)
Oct 18 11:50:45 user nova-compute[74190]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:011ac309-ad42-43cc-ab45-e09e022b6e56 (non-flash)
Oct 18 11:50:45 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:50:45 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:011ac309-ad42-43cc-ab45-e09e022b6e56" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:50:45 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Connected to 172.16.0.220:3260 {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 11:50:45 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] HCTL ('35', '-', '-', 0) found on session 24 with lun 0 {{(pid=74190) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 11:50:45 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74190) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 11:50:45 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:45 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.027s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:45 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e0668f1-a651-4bcf-a274-6ee4651c788e]: (4, ('- - 0', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:45 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Searching for a device in session 24 and hctl ['35', '*', '*', 0] yield: None {{(pid=74190) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 11:50:46 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Searching for a device in session 24 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74190) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 11:50:46 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:011ac309-ad42-43cc-ab45-e09e022b6e56', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tAxbldQM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 11:50:46 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.359s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:50:46 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] <== connect_volume: return (2709ms) {'type': 'block', 'scsi_wwn': '23965393535656565', 'path': '/dev/sdd'} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:50:46 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] [instance: cd28be8d-847b-468c-860f-4f479740738d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23965393535656565', 'path': '/dev/sdd'} {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 11:50:46 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] [instance: cd28be8d-847b-468c-860f-4f479740738d] Calling os-brick to attach iSCSI Volume {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 11:50:46 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:17a1c8f7-ad7d-4b2a-863f-561e1c18768a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZJKGlEXu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:50:46 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:50:46 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:50:46 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:50:46 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:50:46 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:17a1c8f7-ad7d-4b2a-863f-561e1c18768a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:50:46 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:17a1c8f7-ad7d-4b2a-863f-561e1c18768a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:50:46 user nova-compute[74190]: INFO os_brick.initiator.connectors.iscsi [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 11:50:46 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17a1c8f7-ad7d-4b2a-863f-561e1c18768a -p 172.16.0.220:3260 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:46 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17a1c8f7-ad7d-4b2a-863f-561e1c18768a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:46 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[4551c0c5-1421-4a8d-8e03-d3f00b1fc102]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:46 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 11:50:46 user nova-compute[74190]:  {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:50:46 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17a1c8f7-ad7d-4b2a-863f-561e1c18768a -p 172.16.0.220:3260 --interface default --op new {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:46 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:46 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17a1c8f7-ad7d-4b2a-863f-561e1c18768a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:46 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[0de5c31c-0a2b-4dc3-9ffa-64cb60ed7cb9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:17a1c8f7-ad7d-4b2a-863f-561e1c18768a] added\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:46 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:17a1c8f7-ad7d-4b2a-863f-561e1c18768a] added
Oct 18 11:50:46 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:50:46 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17a1c8f7-ad7d-4b2a-863f-561e1c18768a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:46 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17a1c8f7-ad7d-4b2a-863f-561e1c18768a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:46 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c967069-46eb-4fff-ac4f-b754085f7c62]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:46 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:50:46 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17a1c8f7-ad7d-4b2a-863f-561e1c18768a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:46 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:46 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:46 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:46 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17a1c8f7-ad7d-4b2a-863f-561e1c18768a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:46 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[40bbbd77-2007-4b55-acb4-dd8cc25a8f34]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:46 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:50:46 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17a1c8f7-ad7d-4b2a-863f-561e1c18768a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZJKGlEXu {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:46 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17a1c8f7-ad7d-4b2a-863f-561e1c18768a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZJKGlEXu" returned: 0 in 0.027s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:46 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb772654-a723-4834-b09a-9247ce830f41]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:46 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZJKGlEXu'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:50:46 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17a1c8f7-ad7d-4b2a-863f-561e1c18768a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:46 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17a1c8f7-ad7d-4b2a-863f-561e1c18768a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:46 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ab6b01-d175-45c8-9352-1ee6afe9835a]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:46 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:50:46 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:46 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:46 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[675072c9-6655-4814-954c-7b927b6dff43]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:011ac309-ad42-43cc-ab45-e09e022b6e56 (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:46 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a (non-flash)
Oct 18 11:50:46 user nova-compute[74190]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 (non-flash)
Oct 18 11:50:46 user nova-compute[74190]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:011ac309-ad42-43cc-ab45-e09e022b6e56 (non-flash)
Oct 18 11:50:46 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:50:46 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a (non-flash)
Oct 18 11:50:46 user nova-compute[74190]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 (non-flash)
Oct 18 11:50:46 user nova-compute[74190]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:011ac309-ad42-43cc-ab45-e09e022b6e56 (non-flash)
Oct 18 11:50:46 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:50:46 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17a1c8f7-ad7d-4b2a-863f-561e1c18768a -p 172.16.0.220:3260 --login {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:47 user nova-compute[74190]: DEBUG nova.compute.manager [req-eef70166-7bc3-4f71-99f7-b3aa83a80f29 req-46582a84-46e5-4aaa-89c5-09089b48bebf service nova] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Received event network-vif-plugged-5f5b65f1-7748-4422-8b45-e1b88476716d {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:50:47 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-eef70166-7bc3-4f71-99f7-b3aa83a80f29 req-46582a84-46e5-4aaa-89c5-09089b48bebf service nova] Acquiring lock "bdfe420d-f46c-44ad-8773-b675f42e24ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:50:47 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-eef70166-7bc3-4f71-99f7-b3aa83a80f29 req-46582a84-46e5-4aaa-89c5-09089b48bebf service nova] Lock "bdfe420d-f46c-44ad-8773-b675f42e24ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:50:47 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-eef70166-7bc3-4f71-99f7-b3aa83a80f29 req-46582a84-46e5-4aaa-89c5-09089b48bebf service nova] Lock "bdfe420d-f46c-44ad-8773-b675f42e24ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:50:47 user nova-compute[74190]: DEBUG nova.compute.manager [req-eef70166-7bc3-4f71-99f7-b3aa83a80f29 req-46582a84-46e5-4aaa-89c5-09089b48bebf service nova] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] No waiting events found dispatching network-vif-plugged-5f5b65f1-7748-4422-8b45-e1b88476716d {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:50:47 user nova-compute[74190]: WARNING nova.compute.manager [req-eef70166-7bc3-4f71-99f7-b3aa83a80f29 req-46582a84-46e5-4aaa-89c5-09089b48bebf service nova] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Received unexpected event network-vif-plugged-5f5b65f1-7748-4422-8b45-e1b88476716d for instance with vm_state active and task_state resize_finish.
Oct 18 11:50:47 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17a1c8f7-ad7d-4b2a-863f-561e1c18768a -p 172.16.0.220:3260 --login" returned: 0 in 0.156s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:47 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdac63d0-e84d-4e8b-94b0-1c06d8e97a6d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:17a1c8f7-ad7d-4b2a-863f-561e1c18768a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:17a1c8f7-ad7d-4b2a-863f-561e1c18768a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:47 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:17a1c8f7-ad7d-4b2a-863f-561e1c18768a, portal: 172.16.0.220,3260]
Oct 18 11:50:47 user nova-compute[74190]: Login to [iface: default, target: iqn.2010-10.org.openstack:17a1c8f7-ad7d-4b2a-863f-561e1c18768a, portal: 172.16.0.220,3260] successful.
Oct 18 11:50:47 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:50:47 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17a1c8f7-ad7d-4b2a-863f-561e1c18768a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:47 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17a1c8f7-ad7d-4b2a-863f-561e1c18768a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:47 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[d794b318-e30a-46a6-a074-e82b820f384b]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:47 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:50:47 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:47 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:47 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e41ebc-bf72-42db-9572-d442a8403275]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:011ac309-ad42-43cc-ab45-e09e022b6e56 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17a1c8f7-ad7d-4b2a-863f-561e1c18768a (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:47 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a (non-flash)
Oct 18 11:50:47 user nova-compute[74190]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 (non-flash)
Oct 18 11:50:47 user nova-compute[74190]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:011ac309-ad42-43cc-ab45-e09e022b6e56 (non-flash)
Oct 18 11:50:47 user nova-compute[74190]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17a1c8f7-ad7d-4b2a-863f-561e1c18768a (non-flash)
Oct 18 11:50:47 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:50:47 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a (non-flash)
Oct 18 11:50:47 user nova-compute[74190]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 (non-flash)
Oct 18 11:50:47 user nova-compute[74190]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:011ac309-ad42-43cc-ab45-e09e022b6e56 (non-flash)
Oct 18 11:50:47 user nova-compute[74190]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17a1c8f7-ad7d-4b2a-863f-561e1c18768a (non-flash)
Oct 18 11:50:47 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:50:47 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:17a1c8f7-ad7d-4b2a-863f-561e1c18768a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.415s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:50:47 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Connected to 172.16.0.220:3260 {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 11:50:47 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] HCTL ('36', '-', '-', 0) found on session 25 with lun 0 {{(pid=74190) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 11:50:47 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74190) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 11:50:47 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:47 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:47 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba4f563-1ce5-4432-b12f-8cf267cd57d1]: (4, ('- - 0', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:47 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Searching for a device in session 25 and hctl ['36', '*', '*', 0] yield: None {{(pid=74190) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 11:50:47 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:47 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:47 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:47 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:47 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:47 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-b204d274-93da-4606-a6e4-f17ffd0445e8 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Snapshot image upload complete
Oct 18 11:50:47 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b204d274-93da-4606-a6e4-f17ffd0445e8 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Checking state {{(pid=74190) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 11:50:47 user nova-compute[74190]: INFO nova.compute.manager [None req-b204d274-93da-4606-a6e4-f17ffd0445e8 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Shelve offloading
Oct 18 11:50:47 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Instance destroyed successfully.
Oct 18 11:50:47 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b204d274-93da-4606-a6e4-f17ffd0445e8 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Checking state {{(pid=74190) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 11:50:47 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b204d274-93da-4606-a6e4-f17ffd0445e8 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Acquiring lock "refresh_cache-d90a6ca0-19a6-4221-81b7-0cb05d67f38e" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:50:47 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b204d274-93da-4606-a6e4-f17ffd0445e8 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Acquired lock "refresh_cache-d90a6ca0-19a6-4221-81b7-0cb05d67f38e" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:50:47 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b204d274-93da-4606-a6e4-f17ffd0445e8 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Building network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Searching for a device in session 25 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74190) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:17a1c8f7-ad7d-4b2a-863f-561e1c18768a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZJKGlEXu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.446s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] <== connect_volume: return (1447ms) {'type': 'block', 'scsi_wwn': '23062653131313964', 'path': '/dev/sde'} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] [instance: cd28be8d-847b-468c-860f-4f479740738d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23062653131313964', 'path': '/dev/sde'} {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T11:49:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1070511893',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1070511893',id=18,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKBVslbZEBCyddD78nfODxLMQOA10HLdeoyHJpwL0LX2DVFby+C6OMMAsTj4P/vGPT3eFNKVrplFcT2qxWYSTR79oTFsUZwl238caZpIs58KdEidArGj0m+IHMu+D/m5Dg==',key_name='tempest-keypair-232390733',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='daccec0feffd445492c3ab4ff40bcde2',ramdisk_id='',reservation_id='r-ugx6bgpm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1710887731',owner_user_name='tempest-TaggedBootDevicesTest-1710887731-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:49:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8f517ba22b1494ca5700e014e7ab8b9',uuid=cd28be8d-847b-468c-860f-4f479740738d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2ed33ff-2096-4def-98c5-709db8bc0ea4", "address": "fa:16:3e:11:db:57", "network": {"id": "bef90182-e108-423e-842c-2037d5cc1a4b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-640378484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ed33ff-20", "ovs_interfaceid": "c2ed33ff-2096-4def-98c5-709db8bc0ea4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74190) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Converting VIF {"id": "c2ed33ff-2096-4def-98c5-709db8bc0ea4", "address": "fa:16:3e:11:db:57", "network": {"id": "bef90182-e108-423e-842c-2037d5cc1a4b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-640378484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ed33ff-20", "ovs_interfaceid": "c2ed33ff-2096-4def-98c5-709db8bc0ea4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:db:57,bridge_name='br-int',has_traffic_filtering=True,id=c2ed33ff-2096-4def-98c5-709db8bc0ea4,network=Network(bef90182-e108-423e-842c-2037d5cc1a4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2ed33ff-20') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T11:49:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1070511893',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1070511893',id=18,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKBVslbZEBCyddD78nfODxLMQOA10HLdeoyHJpwL0LX2DVFby+C6OMMAsTj4P/vGPT3eFNKVrplFcT2qxWYSTR79oTFsUZwl238caZpIs58KdEidArGj0m+IHMu+D/m5Dg==',key_name='tempest-keypair-232390733',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='daccec0feffd445492c3ab4ff40bcde2',ramdisk_id='',reservation_id='r-ugx6bgpm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1710887731',owner_user_name='tempest-TaggedBootDevicesTest-1710887731-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:49:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8f517ba22b1494ca5700e014e7ab8b9',uuid=cd28be8d-847b-468c-860f-4f479740738d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aca29f48-4a6d-472a-ac70-7006b63b9996", "address": "fa:16:3e:71:0a:c4", "network": {"id": "50f9056b-d85d-4a43-8981-3c5c98e1bf52", "bridge": "br-int", "label": "tempest-device-tagging-net1-737454421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaca29f48-4a", "ovs_interfaceid": "aca29f48-4a6d-472a-ac70-7006b63b9996", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74190) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Converting VIF {"id": "aca29f48-4a6d-472a-ac70-7006b63b9996", "address": "fa:16:3e:71:0a:c4", "network": {"id": "50f9056b-d85d-4a43-8981-3c5c98e1bf52", "bridge": "br-int", "label": "tempest-device-tagging-net1-737454421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaca29f48-4a", "ovs_interfaceid": "aca29f48-4a6d-472a-ac70-7006b63b9996", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:0a:c4,bridge_name='br-int',has_traffic_filtering=True,id=aca29f48-4a6d-472a-ac70-7006b63b9996,network=Network(50f9056b-d85d-4a43-8981-3c5c98e1bf52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapaca29f48-4a') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T11:49:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1070511893',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1070511893',id=18,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKBVslbZEBCyddD78nfODxLMQOA10HLdeoyHJpwL0LX2DVFby+C6OMMAsTj4P/vGPT3eFNKVrplFcT2qxWYSTR79oTFsUZwl238caZpIs58KdEidArGj0m+IHMu+D/m5Dg==',key_name='tempest-keypair-232390733',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='daccec0feffd445492c3ab4ff40bcde2',ramdisk_id='',reservation_id='r-ugx6bgpm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1710887731',owner_user_name='tempest-TaggedBootDevicesTest-1710887731-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:49:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8f517ba22b1494ca5700e014e7ab8b9',uuid=cd28be8d-847b-468c-860f-4f479740738d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d5f803c0-bb6c-41be-8294-fb3565e03413", "address": "fa:16:3e:43:be:0d", "network": {"id": "50f9056b-d85d-4a43-8981-3c5c98e1bf52", "bridge": "br-int", "label": "tempest-device-tagging-net1-737454421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f803c0-bb", "ovs_interfaceid": "d5f803c0-bb6c-41be-8294-fb3565e03413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74190) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Converting VIF {"id": "d5f803c0-bb6c-41be-8294-fb3565e03413", "address": "fa:16:3e:43:be:0d", "network": {"id": "50f9056b-d85d-4a43-8981-3c5c98e1bf52", "bridge": "br-int", "label": "tempest-device-tagging-net1-737454421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f803c0-bb", "ovs_interfaceid": "d5f803c0-bb6c-41be-8294-fb3565e03413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:be:0d,bridge_name='br-int',has_traffic_filtering=True,id=d5f803c0-bb6c-41be-8294-fb3565e03413,network=Network(50f9056b-d85d-4a43-8981-3c5c98e1bf52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd5f803c0-bb') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T11:49:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1070511893',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1070511893',id=18,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKBVslbZEBCyddD78nfODxLMQOA10HLdeoyHJpwL0LX2DVFby+C6OMMAsTj4P/vGPT3eFNKVrplFcT2qxWYSTR79oTFsUZwl238caZpIs58KdEidArGj0m+IHMu+D/m5Dg==',key_name='tempest-keypair-232390733',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='daccec0feffd445492c3ab4ff40bcde2',ramdisk_id='',reservation_id='r-ugx6bgpm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1710887731',owner_user_name='tempest-TaggedBootDevicesTest-1710887731-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:49:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8f517ba22b1494ca5700e014e7ab8b9',uuid=cd28be8d-847b-468c-860f-4f479740738d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a00abcf-957e-4276-a975-522f8a42ad55", "address": "fa:16:3e:c8:b9:46", "network": {"id": "50f9056b-d85d-4a43-8981-3c5c98e1bf52", "bridge": "br-int", "label": "tempest-device-tagging-net1-737454421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a00abcf-95", "ovs_interfaceid": "0a00abcf-957e-4276-a975-522f8a42ad55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74190) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Converting VIF {"id": "0a00abcf-957e-4276-a975-522f8a42ad55", "address": "fa:16:3e:c8:b9:46", "network": {"id": "50f9056b-d85d-4a43-8981-3c5c98e1bf52", "bridge": "br-int", "label": "tempest-device-tagging-net1-737454421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a00abcf-95", "ovs_interfaceid": "0a00abcf-957e-4276-a975-522f8a42ad55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:b9:46,bridge_name='br-int',has_traffic_filtering=True,id=0a00abcf-957e-4276-a975-522f8a42ad55,network=Network(50f9056b-d85d-4a43-8981-3c5c98e1bf52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a00abcf-95') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T11:49:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1070511893',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1070511893',id=18,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKBVslbZEBCyddD78nfODxLMQOA10HLdeoyHJpwL0LX2DVFby+C6OMMAsTj4P/vGPT3eFNKVrplFcT2qxWYSTR79oTFsUZwl238caZpIs58KdEidArGj0m+IHMu+D/m5Dg==',key_name='tempest-keypair-232390733',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='daccec0feffd445492c3ab4ff40bcde2',ramdisk_id='',reservation_id='r-ugx6bgpm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1710887731',owner_user_name='tempest-TaggedBootDevicesTest-1710887731-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:49:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8f517ba22b1494ca5700e014e7ab8b9',uuid=cd28be8d-847b-468c-860f-4f479740738d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "11c7c4ff-db41-4231-8300-ee85a94619c1", "address": "fa:16:3e:ca:c8:e5", "network": {"id": "50f9056b-d85d-4a43-8981-3c5c98e1bf52", "bridge": "br-int", "label": "tempest-device-tagging-net1-737454421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11c7c4ff-db", "ovs_interfaceid": "11c7c4ff-db41-4231-8300-ee85a94619c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74190) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Converting VIF {"id": "11c7c4ff-db41-4231-8300-ee85a94619c1", "address": "fa:16:3e:ca:c8:e5", "network": {"id": "50f9056b-d85d-4a43-8981-3c5c98e1bf52", "bridge": "br-int", "label": "tempest-device-tagging-net1-737454421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11c7c4ff-db", "ovs_interfaceid": "11c7c4ff-db41-4231-8300-ee85a94619c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:c8:e5,bridge_name='br-int',has_traffic_filtering=True,id=11c7c4ff-db41-4231-8300-ee85a94619c1,network=Network(50f9056b-d85d-4a43-8981-3c5c98e1bf52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11c7c4ff-db') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T11:49:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1070511893',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1070511893',id=18,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKBVslbZEBCyddD78nfODxLMQOA10HLdeoyHJpwL0LX2DVFby+C6OMMAsTj4P/vGPT3eFNKVrplFcT2qxWYSTR79oTFsUZwl238caZpIs58KdEidArGj0m+IHMu+D/m5Dg==',key_name='tempest-keypair-232390733',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='daccec0feffd445492c3ab4ff40bcde2',ramdisk_id='',reservation_id='r-ugx6bgpm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1710887731',owner_user_name='tempest-TaggedBootDevicesTest-1710887731-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:49:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8f517ba22b1494ca5700e014e7ab8b9',uuid=cd28be8d-847b-468c-860f-4f479740738d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dba85cc3-dd42-4fa4-96d3-bec15903344f", "address": "fa:16:3e:fb:32:89", "network": {"id": "1ba257ec-d104-413d-bbf9-d9702ed5a1b4", "bridge": "br-int", "label": "tempest-device-tagging-net2-445498545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdba85cc3-dd", "ovs_interfaceid": "dba85cc3-dd42-4fa4-96d3-bec15903344f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74190) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Converting VIF {"id": "dba85cc3-dd42-4fa4-96d3-bec15903344f", "address": "fa:16:3e:fb:32:89", "network": {"id": "1ba257ec-d104-413d-bbf9-d9702ed5a1b4", "bridge": "br-int", "label": "tempest-device-tagging-net2-445498545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdba85cc3-dd", "ovs_interfaceid": "dba85cc3-dd42-4fa4-96d3-bec15903344f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:32:89,bridge_name='br-int',has_traffic_filtering=True,id=dba85cc3-dd42-4fa4-96d3-bec15903344f,network=Network(1ba257ec-d104-413d-bbf9-d9702ed5a1b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdba85cc3-dd') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T11:49:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1070511893',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1070511893',id=18,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKBVslbZEBCyddD78nfODxLMQOA10HLdeoyHJpwL0LX2DVFby+C6OMMAsTj4P/vGPT3eFNKVrplFcT2qxWYSTR79oTFsUZwl238caZpIs58KdEidArGj0m+IHMu+D/m5Dg==',key_name='tempest-keypair-232390733',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='daccec0feffd445492c3ab4ff40bcde2',ramdisk_id='',reservation_id='r-ugx6bgpm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1710887731',owner_user_name='tempest-TaggedBootDevicesTest-1710887731-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:49:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8f517ba22b1494ca5700e014e7ab8b9',uuid=cd28be8d-847b-468c-860f-4f479740738d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "35f010df-56fb-4234-879b-19f86f36a2d3", "address": "fa:16:3e:bf:a7:36", "network": {"id": "1ba257ec-d104-413d-bbf9-d9702ed5a1b4", "bridge": "br-int", "label": "tempest-device-tagging-net2-445498545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35f010df-56", "ovs_interfaceid": "35f010df-56fb-4234-879b-19f86f36a2d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74190) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Converting VIF {"id": "35f010df-56fb-4234-879b-19f86f36a2d3", "address": "fa:16:3e:bf:a7:36", "network": {"id": "1ba257ec-d104-413d-bbf9-d9702ed5a1b4", "bridge": "br-int", "label": "tempest-device-tagging-net2-445498545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35f010df-56", "ovs_interfaceid": "35f010df-56fb-4234-879b-19f86f36a2d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:a7:36,bridge_name='br-int',has_traffic_filtering=True,id=35f010df-56fb-4234-879b-19f86f36a2d3,network=Network(1ba257ec-d104-413d-bbf9-d9702ed5a1b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35f010df-56') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG nova.objects.instance [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Lazy-loading 'pci_devices' on Instance uuid cd28be8d-847b-468c-860f-4f479740738d {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] [instance: cd28be8d-847b-468c-860f-4f479740738d] End _get_guest_xml xml=<domain type="kvm">
Oct 18 11:50:48 user nova-compute[74190]:   <uuid>cd28be8d-847b-468c-860f-4f479740738d</uuid>
Oct 18 11:50:48 user nova-compute[74190]:   <name>instance-00000012</name>
Oct 18 11:50:48 user nova-compute[74190]:   <memory>524288</memory>
Oct 18 11:50:48 user nova-compute[74190]:   <vcpu>1</vcpu>
Oct 18 11:50:48 user nova-compute[74190]:   <metadata>
Oct 18 11:50:48 user nova-compute[74190]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 11:50:48 user nova-compute[74190]:       <nova:package version="0.0.0"/>
Oct 18 11:50:48 user nova-compute[74190]:       <nova:name>tempest-device-tagging-server-1070511893</nova:name>
Oct 18 11:50:48 user nova-compute[74190]:       <nova:creationTime>2023-10-18 11:50:42</nova:creationTime>
Oct 18 11:50:48 user nova-compute[74190]:       <nova:flavor name="m1.tiny">
Oct 18 11:50:48 user nova-compute[74190]:         <nova:memory>512</nova:memory>
Oct 18 11:50:48 user nova-compute[74190]:         <nova:disk>1</nova:disk>
Oct 18 11:50:48 user nova-compute[74190]:         <nova:swap>0</nova:swap>
Oct 18 11:50:48 user nova-compute[74190]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 11:50:48 user nova-compute[74190]:         <nova:vcpus>1</nova:vcpus>
Oct 18 11:50:48 user nova-compute[74190]:       </nova:flavor>
Oct 18 11:50:48 user nova-compute[74190]:       <nova:owner>
Oct 18 11:50:48 user nova-compute[74190]:         <nova:user uuid="d8f517ba22b1494ca5700e014e7ab8b9">tempest-TaggedBootDevicesTest-1710887731-project-member</nova:user>
Oct 18 11:50:48 user nova-compute[74190]:         <nova:project uuid="daccec0feffd445492c3ab4ff40bcde2">tempest-TaggedBootDevicesTest-1710887731</nova:project>
Oct 18 11:50:48 user nova-compute[74190]:       </nova:owner>
Oct 18 11:50:48 user nova-compute[74190]:       <nova:root type="image" uuid="6e88bbf0-6e78-49a8-b3c5-9453d22a89df"/>
Oct 18 11:50:48 user nova-compute[74190]:       <nova:ports>
Oct 18 11:50:48 user nova-compute[74190]:         <nova:port uuid="c2ed33ff-2096-4def-98c5-709db8bc0ea4">
Oct 18 11:50:48 user nova-compute[74190]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 18 11:50:48 user nova-compute[74190]:         </nova:port>
Oct 18 11:50:48 user nova-compute[74190]:         <nova:port uuid="aca29f48-4a6d-472a-ac70-7006b63b9996">
Oct 18 11:50:48 user nova-compute[74190]:           <nova:ip type="fixed" address="10.1.1.90" ipVersion="4"/>
Oct 18 11:50:48 user nova-compute[74190]:         </nova:port>
Oct 18 11:50:48 user nova-compute[74190]:         <nova:port uuid="d5f803c0-bb6c-41be-8294-fb3565e03413">
Oct 18 11:50:48 user nova-compute[74190]:           <nova:ip type="fixed" address="10.1.1.138" ipVersion="4"/>
Oct 18 11:50:48 user nova-compute[74190]:         </nova:port>
Oct 18 11:50:48 user nova-compute[74190]:         <nova:port uuid="0a00abcf-957e-4276-a975-522f8a42ad55">
Oct 18 11:50:48 user nova-compute[74190]:           <nova:ip type="fixed" address="10.1.1.75" ipVersion="4"/>
Oct 18 11:50:48 user nova-compute[74190]:         </nova:port>
Oct 18 11:50:48 user nova-compute[74190]:         <nova:port uuid="11c7c4ff-db41-4231-8300-ee85a94619c1">
Oct 18 11:50:48 user nova-compute[74190]:           <nova:ip type="fixed" address="10.1.1.65" ipVersion="4"/>
Oct 18 11:50:48 user nova-compute[74190]:         </nova:port>
Oct 18 11:50:48 user nova-compute[74190]:         <nova:port uuid="dba85cc3-dd42-4fa4-96d3-bec15903344f">
Oct 18 11:50:48 user nova-compute[74190]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Oct 18 11:50:48 user nova-compute[74190]:         </nova:port>
Oct 18 11:50:48 user nova-compute[74190]:         <nova:port uuid="35f010df-56fb-4234-879b-19f86f36a2d3">
Oct 18 11:50:48 user nova-compute[74190]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Oct 18 11:50:48 user nova-compute[74190]:         </nova:port>
Oct 18 11:50:48 user nova-compute[74190]:       </nova:ports>
Oct 18 11:50:48 user nova-compute[74190]:     </nova:instance>
Oct 18 11:50:48 user nova-compute[74190]:   </metadata>
Oct 18 11:50:48 user nova-compute[74190]:   <sysinfo type="smbios">
Oct 18 11:50:48 user nova-compute[74190]:     <system>
Oct 18 11:50:48 user nova-compute[74190]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 11:50:48 user nova-compute[74190]:       <entry name="product">OpenStack Nova</entry>
Oct 18 11:50:48 user nova-compute[74190]:       <entry name="version">0.0.0</entry>
Oct 18 11:50:48 user nova-compute[74190]:       <entry name="serial">cd28be8d-847b-468c-860f-4f479740738d</entry>
Oct 18 11:50:48 user nova-compute[74190]:       <entry name="uuid">cd28be8d-847b-468c-860f-4f479740738d</entry>
Oct 18 11:50:48 user nova-compute[74190]:       <entry name="family">Virtual Machine</entry>
Oct 18 11:50:48 user nova-compute[74190]:     </system>
Oct 18 11:50:48 user nova-compute[74190]:   </sysinfo>
Oct 18 11:50:48 user nova-compute[74190]:   <os>
Oct 18 11:50:48 user nova-compute[74190]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 11:50:48 user nova-compute[74190]:     <boot dev="hd"/>
Oct 18 11:50:48 user nova-compute[74190]:     <smbios mode="sysinfo"/>
Oct 18 11:50:48 user nova-compute[74190]:   </os>
Oct 18 11:50:48 user nova-compute[74190]:   <features>
Oct 18 11:50:48 user nova-compute[74190]:     <acpi/>
Oct 18 11:50:48 user nova-compute[74190]:     <apic/>
Oct 18 11:50:48 user nova-compute[74190]:     <vmcoreinfo/>
Oct 18 11:50:48 user nova-compute[74190]:   </features>
Oct 18 11:50:48 user nova-compute[74190]:   <clock offset="utc">
Oct 18 11:50:48 user nova-compute[74190]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 11:50:48 user nova-compute[74190]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 11:50:48 user nova-compute[74190]:     <timer name="hpet" present="no"/>
Oct 18 11:50:48 user nova-compute[74190]:   </clock>
Oct 18 11:50:48 user nova-compute[74190]:   <cpu mode="custom" match="exact">
Oct 18 11:50:48 user nova-compute[74190]:     <model>Nehalem</model>
Oct 18 11:50:48 user nova-compute[74190]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 11:50:48 user nova-compute[74190]:   </cpu>
Oct 18 11:50:48 user nova-compute[74190]:   <devices>
Oct 18 11:50:48 user nova-compute[74190]:     <disk type="file" device="cdrom">
Oct 18 11:50:48 user nova-compute[74190]:       <driver name="qemu" type="raw" cache="none"/>
Oct 18 11:50:48 user nova-compute[74190]:       <source file="/opt/stack/data/nova/instances/cd28be8d-847b-468c-860f-4f479740738d/disk.config"/>
Oct 18 11:50:48 user nova-compute[74190]:       <target dev="hda" bus="ide"/>
Oct 18 11:50:48 user nova-compute[74190]:     </disk>
Oct 18 11:50:48 user nova-compute[74190]:     <disk type="block" device="disk">
Oct 18 11:50:48 user nova-compute[74190]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 11:50:48 user nova-compute[74190]:       <source dev="/dev/sdb"/>
Oct 18 11:50:48 user nova-compute[74190]:       <target dev="vda" bus="virtio"/>
Oct 18 11:50:48 user nova-compute[74190]:       <serial>40eb314e-5a7a-45f4-93f5-e67b23f6d02a</serial>
Oct 18 11:50:48 user nova-compute[74190]:     </disk>
Oct 18 11:50:48 user nova-compute[74190]:     <disk type="block" device="disk">
Oct 18 11:50:48 user nova-compute[74190]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 11:50:48 user nova-compute[74190]:       <source dev="/dev/sdd"/>
Oct 18 11:50:48 user nova-compute[74190]:       <target dev="vdb" bus="virtio"/>
Oct 18 11:50:48 user nova-compute[74190]:       <serial>011ac309-ad42-43cc-ab45-e09e022b6e56</serial>
Oct 18 11:50:48 user nova-compute[74190]:     </disk>
Oct 18 11:50:48 user nova-compute[74190]:     <disk type="block" device="disk">
Oct 18 11:50:48 user nova-compute[74190]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 11:50:48 user nova-compute[74190]:       <source dev="/dev/sde"/>
Oct 18 11:50:48 user nova-compute[74190]:       <target dev="vdc" bus="virtio"/>
Oct 18 11:50:48 user nova-compute[74190]:       <serial>17a1c8f7-ad7d-4b2a-863f-561e1c18768a</serial>
Oct 18 11:50:48 user nova-compute[74190]:     </disk>
Oct 18 11:50:48 user nova-compute[74190]:     <interface type="ethernet">
Oct 18 11:50:48 user nova-compute[74190]:       <mac address="fa:16:3e:11:db:57"/>
Oct 18 11:50:48 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:50:48 user nova-compute[74190]:       <mtu size="1442"/>
Oct 18 11:50:48 user nova-compute[74190]:       <target dev="tapc2ed33ff-20"/>
Oct 18 11:50:48 user nova-compute[74190]:     </interface>
Oct 18 11:50:48 user nova-compute[74190]:     <interface type="ethernet">
Oct 18 11:50:48 user nova-compute[74190]:       <mac address="fa:16:3e:71:0a:c4"/>
Oct 18 11:50:48 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:50:48 user nova-compute[74190]:       <mtu size="1442"/>
Oct 18 11:50:48 user nova-compute[74190]:       <target dev="tapaca29f48-4a"/>
Oct 18 11:50:48 user nova-compute[74190]:     </interface>
Oct 18 11:50:48 user nova-compute[74190]:     <interface type="ethernet">
Oct 18 11:50:48 user nova-compute[74190]:       <mac address="fa:16:3e:43:be:0d"/>
Oct 18 11:50:48 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:50:48 user nova-compute[74190]:       <mtu size="1442"/>
Oct 18 11:50:48 user nova-compute[74190]:       <target dev="tapd5f803c0-bb"/>
Oct 18 11:50:48 user nova-compute[74190]:     </interface>
Oct 18 11:50:48 user nova-compute[74190]:     <interface type="ethernet">
Oct 18 11:50:48 user nova-compute[74190]:       <mac address="fa:16:3e:c8:b9:46"/>
Oct 18 11:50:48 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:50:48 user nova-compute[74190]:       <mtu size="1442"/>
Oct 18 11:50:48 user nova-compute[74190]:       <target dev="tap0a00abcf-95"/>
Oct 18 11:50:48 user nova-compute[74190]:     </interface>
Oct 18 11:50:48 user nova-compute[74190]:     <interface type="ethernet">
Oct 18 11:50:48 user nova-compute[74190]:       <mac address="fa:16:3e:ca:c8:e5"/>
Oct 18 11:50:48 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:50:48 user nova-compute[74190]:       <mtu size="1442"/>
Oct 18 11:50:48 user nova-compute[74190]:       <target dev="tap11c7c4ff-db"/>
Oct 18 11:50:48 user nova-compute[74190]:     </interface>
Oct 18 11:50:48 user nova-compute[74190]:     <interface type="ethernet">
Oct 18 11:50:48 user nova-compute[74190]:       <mac address="fa:16:3e:fb:32:89"/>
Oct 18 11:50:48 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:50:48 user nova-compute[74190]:       <mtu size="1442"/>
Oct 18 11:50:48 user nova-compute[74190]:       <target dev="tapdba85cc3-dd"/>
Oct 18 11:50:48 user nova-compute[74190]:     </interface>
Oct 18 11:50:48 user nova-compute[74190]:     <interface type="ethernet">
Oct 18 11:50:48 user nova-compute[74190]:       <mac address="fa:16:3e:bf:a7:36"/>
Oct 18 11:50:48 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:50:48 user nova-compute[74190]:       <mtu size="1442"/>
Oct 18 11:50:48 user nova-compute[74190]:       <target dev="tap35f010df-56"/>
Oct 18 11:50:48 user nova-compute[74190]:     </interface>
Oct 18 11:50:48 user nova-compute[74190]:     <serial type="pty">
Oct 18 11:50:48 user nova-compute[74190]:       <log file="/opt/stack/data/nova/instances/cd28be8d-847b-468c-860f-4f479740738d/console.log" append="off"/>
Oct 18 11:50:48 user nova-compute[74190]:     </serial>
Oct 18 11:50:48 user nova-compute[74190]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 11:50:48 user nova-compute[74190]:     <video>
Oct 18 11:50:48 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:50:48 user nova-compute[74190]:     </video>
Oct 18 11:50:48 user nova-compute[74190]:     <rng model="virtio">
Oct 18 11:50:48 user nova-compute[74190]:       <backend model="random">/dev/urandom</backend>
Oct 18 11:50:48 user nova-compute[74190]:     </rng>
Oct 18 11:50:48 user nova-compute[74190]:     <controller type="usb" index="0" model="none"/>
Oct 18 11:50:48 user nova-compute[74190]:     <memballoon model="virtio">
Oct 18 11:50:48 user nova-compute[74190]:       <stats period="10"/>
Oct 18 11:50:48 user nova-compute[74190]:     </memballoon>
Oct 18 11:50:48 user nova-compute[74190]:   </devices>
Oct 18 11:50:48 user nova-compute[74190]: </domain>
Oct 18 11:50:48 user nova-compute[74190]:  {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T11:49:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1070511893',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1070511893',id=18,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKBVslbZEBCyddD78nfODxLMQOA10HLdeoyHJpwL0LX2DVFby+C6OMMAsTj4P/vGPT3eFNKVrplFcT2qxWYSTR79oTFsUZwl238caZpIs58KdEidArGj0m+IHMu+D/m5Dg==',key_name='tempest-keypair-232390733',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='daccec0feffd445492c3ab4ff40bcde2',ramdisk_id='',reservation_id='r-ugx6bgpm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1710887731',owner_user_name='tempest-TaggedBootDevicesTest-1710887731-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:49:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8f517ba22b1494ca5700e014e7ab8b9',uuid=cd28be8d-847b-468c-860f-4f479740738d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2ed33ff-2096-4def-98c5-709db8bc0ea4", "address": "fa:16:3e:11:db:57", "network": {"id": "bef90182-e108-423e-842c-2037d5cc1a4b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-640378484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ed33ff-20", "ovs_interfaceid": "c2ed33ff-2096-4def-98c5-709db8bc0ea4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Converting VIF {"id": "c2ed33ff-2096-4def-98c5-709db8bc0ea4", "address": "fa:16:3e:11:db:57", "network": {"id": "bef90182-e108-423e-842c-2037d5cc1a4b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-640378484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ed33ff-20", "ovs_interfaceid": "c2ed33ff-2096-4def-98c5-709db8bc0ea4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:db:57,bridge_name='br-int',has_traffic_filtering=True,id=c2ed33ff-2096-4def-98c5-709db8bc0ea4,network=Network(bef90182-e108-423e-842c-2037d5cc1a4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2ed33ff-20') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG os_vif [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:db:57,bridge_name='br-int',has_traffic_filtering=True,id=c2ed33ff-2096-4def-98c5-709db8bc0ea4,network=Network(bef90182-e108-423e-842c-2037d5cc1a4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2ed33ff-20') {{(pid=74190) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'acd536d4-cc73-59bd-994d-aa28e94beccd', '_type': 'linux-noop'}}, row=False) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc2ed33ff-20, may_exist=True, interface_attrs={}) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc2ed33ff-20, col_values=(('qos', UUID('c59a1851-6149-4db2-9645-c682645eeba1')),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc2ed33ff-20, col_values=(('external_ids', {'iface-id': 'c2ed33ff-2096-4def-98c5-709db8bc0ea4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:11:db:57', 'vm-uuid': 'cd28be8d-847b-468c-860f-4f479740738d'}),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:48 user nova-compute[74190]: INFO os_vif [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:db:57,bridge_name='br-int',has_traffic_filtering=True,id=c2ed33ff-2096-4def-98c5-709db8bc0ea4,network=Network(bef90182-e108-423e-842c-2037d5cc1a4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2ed33ff-20')
Oct 18 11:50:48 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T11:49:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1070511893',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1070511893',id=18,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKBVslbZEBCyddD78nfODxLMQOA10HLdeoyHJpwL0LX2DVFby+C6OMMAsTj4P/vGPT3eFNKVrplFcT2qxWYSTR79oTFsUZwl238caZpIs58KdEidArGj0m+IHMu+D/m5Dg==',key_name='tempest-keypair-232390733',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='daccec0feffd445492c3ab4ff40bcde2',ramdisk_id='',reservation_id='r-ugx6bgpm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1710887731',owner_user_name='tempest-TaggedBootDevicesTest-1710887731-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:49:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8f517ba22b1494ca5700e014e7ab8b9',uuid=cd28be8d-847b-468c-860f-4f479740738d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aca29f48-4a6d-472a-ac70-7006b63b9996", "address": "fa:16:3e:71:0a:c4", "network": {"id": "50f9056b-d85d-4a43-8981-3c5c98e1bf52", "bridge": "br-int", "label": "tempest-device-tagging-net1-737454421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaca29f48-4a", "ovs_interfaceid": "aca29f48-4a6d-472a-ac70-7006b63b9996", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74190) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Converting VIF {"id": "aca29f48-4a6d-472a-ac70-7006b63b9996", "address": "fa:16:3e:71:0a:c4", "network": {"id": "50f9056b-d85d-4a43-8981-3c5c98e1bf52", "bridge": "br-int", "label": "tempest-device-tagging-net1-737454421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaca29f48-4a", "ovs_interfaceid": "aca29f48-4a6d-472a-ac70-7006b63b9996", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:0a:c4,bridge_name='br-int',has_traffic_filtering=True,id=aca29f48-4a6d-472a-ac70-7006b63b9996,network=Network(50f9056b-d85d-4a43-8981-3c5c98e1bf52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapaca29f48-4a') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG os_vif [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:0a:c4,bridge_name='br-int',has_traffic_filtering=True,id=aca29f48-4a6d-472a-ac70-7006b63b9996,network=Network(50f9056b-d85d-4a43-8981-3c5c98e1bf52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapaca29f48-4a') {{(pid=74190) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7dd136c4-0070-53e6-901a-756f89990fd2', '_type': 'linux-noop'}}, row=False) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaca29f48-4a, may_exist=True, interface_attrs={}) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaca29f48-4a, col_values=(('qos', UUID('5c9c0ee7-db49-45a0-9fe0-1e6d382096c5')),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaca29f48-4a, col_values=(('external_ids', {'iface-id': 'aca29f48-4a6d-472a-ac70-7006b63b9996', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:71:0a:c4', 'vm-uuid': 'cd28be8d-847b-468c-860f-4f479740738d'}),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:48 user nova-compute[74190]: INFO os_vif [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:0a:c4,bridge_name='br-int',has_traffic_filtering=True,id=aca29f48-4a6d-472a-ac70-7006b63b9996,network=Network(50f9056b-d85d-4a43-8981-3c5c98e1bf52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapaca29f48-4a')
Oct 18 11:50:48 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T11:49:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1070511893',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1070511893',id=18,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKBVslbZEBCyddD78nfODxLMQOA10HLdeoyHJpwL0LX2DVFby+C6OMMAsTj4P/vGPT3eFNKVrplFcT2qxWYSTR79oTFsUZwl238caZpIs58KdEidArGj0m+IHMu+D/m5Dg==',key_name='tempest-keypair-232390733',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='daccec0feffd445492c3ab4ff40bcde2',ramdisk_id='',reservation_id='r-ugx6bgpm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1710887731',owner_user_name='tempest-TaggedBootDevicesTest-1710887731-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:49:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8f517ba22b1494ca5700e014e7ab8b9',uuid=cd28be8d-847b-468c-860f-4f479740738d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d5f803c0-bb6c-41be-8294-fb3565e03413", "address": "fa:16:3e:43:be:0d", "network": {"id": "50f9056b-d85d-4a43-8981-3c5c98e1bf52", "bridge": "br-int", "label": "tempest-device-tagging-net1-737454421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f803c0-bb", "ovs_interfaceid": "d5f803c0-bb6c-41be-8294-fb3565e03413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74190) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Converting VIF {"id": "d5f803c0-bb6c-41be-8294-fb3565e03413", "address": "fa:16:3e:43:be:0d", "network": {"id": "50f9056b-d85d-4a43-8981-3c5c98e1bf52", "bridge": "br-int", "label": "tempest-device-tagging-net1-737454421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f803c0-bb", "ovs_interfaceid": "d5f803c0-bb6c-41be-8294-fb3565e03413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:be:0d,bridge_name='br-int',has_traffic_filtering=True,id=d5f803c0-bb6c-41be-8294-fb3565e03413,network=Network(50f9056b-d85d-4a43-8981-3c5c98e1bf52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd5f803c0-bb') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG os_vif [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:be:0d,bridge_name='br-int',has_traffic_filtering=True,id=d5f803c0-bb6c-41be-8294-fb3565e03413,network=Network(50f9056b-d85d-4a43-8981-3c5c98e1bf52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd5f803c0-bb') {{(pid=74190) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '678bed35-9cda-5ce3-9d57-6339f16f0af3', '_type': 'linux-noop'}}, row=False) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b204d274-93da-4606-a6e4-f17ffd0445e8 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Updating instance_info_cache with network_info: [{"id": "2d8060bc-84e4-41e2-9e72-42b2159a1d1e", "address": "fa:16:3e:6c:a0:e2", "network": {"id": "e6ae8edc-7014-4341-91b2-4c82d72c9bb9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-15434410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548640fa718f4fdfa21c1a7783519c9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d8060bc-84", "ovs_interfaceid": "2d8060bc-84e4-41e2-9e72-42b2159a1d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd5f803c0-bb, may_exist=True, interface_attrs={}) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd5f803c0-bb, col_values=(('qos', UUID('5ca566b3-c46b-48ec-aebd-e4c14a30a8fb')),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd5f803c0-bb, col_values=(('external_ids', {'iface-id': 'd5f803c0-bb6c-41be-8294-fb3565e03413', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:43:be:0d', 'vm-uuid': 'cd28be8d-847b-468c-860f-4f479740738d'}),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b204d274-93da-4606-a6e4-f17ffd0445e8 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Releasing lock "refresh_cache-d90a6ca0-19a6-4221-81b7-0cb05d67f38e" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:48 user nova-compute[74190]: INFO os_vif [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:be:0d,bridge_name='br-int',has_traffic_filtering=True,id=d5f803c0-bb6c-41be-8294-fb3565e03413,network=Network(50f9056b-d85d-4a43-8981-3c5c98e1bf52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd5f803c0-bb')
Oct 18 11:50:48 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T11:49:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1070511893',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1070511893',id=18,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKBVslbZEBCyddD78nfODxLMQOA10HLdeoyHJpwL0LX2DVFby+C6OMMAsTj4P/vGPT3eFNKVrplFcT2qxWYSTR79oTFsUZwl238caZpIs58KdEidArGj0m+IHMu+D/m5Dg==',key_name='tempest-keypair-232390733',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='daccec0feffd445492c3ab4ff40bcde2',ramdisk_id='',reservation_id='r-ugx6bgpm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1710887731',owner_user_name='tempest-TaggedBootDevicesTest-1710887731-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:49:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8f517ba22b1494ca5700e014e7ab8b9',uuid=cd28be8d-847b-468c-860f-4f479740738d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a00abcf-957e-4276-a975-522f8a42ad55", "address": "fa:16:3e:c8:b9:46", "network": {"id": "50f9056b-d85d-4a43-8981-3c5c98e1bf52", "bridge": "br-int", "label": "tempest-device-tagging-net1-737454421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a00abcf-95", "ovs_interfaceid": "0a00abcf-957e-4276-a975-522f8a42ad55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Converting VIF {"id": "0a00abcf-957e-4276-a975-522f8a42ad55", "address": "fa:16:3e:c8:b9:46", "network": {"id": "50f9056b-d85d-4a43-8981-3c5c98e1bf52", "bridge": "br-int", "label": "tempest-device-tagging-net1-737454421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a00abcf-95", "ovs_interfaceid": "0a00abcf-957e-4276-a975-522f8a42ad55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:b9:46,bridge_name='br-int',has_traffic_filtering=True,id=0a00abcf-957e-4276-a975-522f8a42ad55,network=Network(50f9056b-d85d-4a43-8981-3c5c98e1bf52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a00abcf-95') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG os_vif [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:b9:46,bridge_name='br-int',has_traffic_filtering=True,id=0a00abcf-957e-4276-a975-522f8a42ad55,network=Network(50f9056b-d85d-4a43-8981-3c5c98e1bf52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a00abcf-95') {{(pid=74190) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ac31018f-8ab7-5d1e-bdaf-e5e9e5b70f47', '_type': 'linux-noop'}}, row=False) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0a00abcf-95, may_exist=True, interface_attrs={}) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0a00abcf-95, col_values=(('qos', UUID('78362c57-e798-41c3-ac38-cc7fdb3bbf48')),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0a00abcf-95, col_values=(('external_ids', {'iface-id': '0a00abcf-957e-4276-a975-522f8a42ad55', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c8:b9:46', 'vm-uuid': 'cd28be8d-847b-468c-860f-4f479740738d'}),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:48 user nova-compute[74190]: INFO os_vif [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:b9:46,bridge_name='br-int',has_traffic_filtering=True,id=0a00abcf-957e-4276-a975-522f8a42ad55,network=Network(50f9056b-d85d-4a43-8981-3c5c98e1bf52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a00abcf-95')
Oct 18 11:50:48 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T11:49:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1070511893',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1070511893',id=18,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKBVslbZEBCyddD78nfODxLMQOA10HLdeoyHJpwL0LX2DVFby+C6OMMAsTj4P/vGPT3eFNKVrplFcT2qxWYSTR79oTFsUZwl238caZpIs58KdEidArGj0m+IHMu+D/m5Dg==',key_name='tempest-keypair-232390733',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='daccec0feffd445492c3ab4ff40bcde2',ramdisk_id='',reservation_id='r-ugx6bgpm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1710887731',owner_user_name='tempest-TaggedBootDevicesTest-1710887731-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:49:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8f517ba22b1494ca5700e014e7ab8b9',uuid=cd28be8d-847b-468c-860f-4f479740738d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "11c7c4ff-db41-4231-8300-ee85a94619c1", "address": "fa:16:3e:ca:c8:e5", "network": {"id": "50f9056b-d85d-4a43-8981-3c5c98e1bf52", "bridge": "br-int", "label": "tempest-device-tagging-net1-737454421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11c7c4ff-db", "ovs_interfaceid": "11c7c4ff-db41-4231-8300-ee85a94619c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Converting VIF {"id": "11c7c4ff-db41-4231-8300-ee85a94619c1", "address": "fa:16:3e:ca:c8:e5", "network": {"id": "50f9056b-d85d-4a43-8981-3c5c98e1bf52", "bridge": "br-int", "label": "tempest-device-tagging-net1-737454421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11c7c4ff-db", "ovs_interfaceid": "11c7c4ff-db41-4231-8300-ee85a94619c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:c8:e5,bridge_name='br-int',has_traffic_filtering=True,id=11c7c4ff-db41-4231-8300-ee85a94619c1,network=Network(50f9056b-d85d-4a43-8981-3c5c98e1bf52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11c7c4ff-db') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG os_vif [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:c8:e5,bridge_name='br-int',has_traffic_filtering=True,id=11c7c4ff-db41-4231-8300-ee85a94619c1,network=Network(50f9056b-d85d-4a43-8981-3c5c98e1bf52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11c7c4ff-db') {{(pid=74190) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0ac76a12-6f52-575c-a21c-37eb843a7675', '_type': 'linux-noop'}}, row=False) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap11c7c4ff-db, may_exist=True, interface_attrs={}) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap11c7c4ff-db, col_values=(('qos', UUID('d4eb7dc0-91fd-4b4a-8ef5-25123623de8a')),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap11c7c4ff-db, col_values=(('external_ids', {'iface-id': '11c7c4ff-db41-4231-8300-ee85a94619c1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ca:c8:e5', 'vm-uuid': 'cd28be8d-847b-468c-860f-4f479740738d'}),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:48 user nova-compute[74190]: INFO os_vif [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:c8:e5,bridge_name='br-int',has_traffic_filtering=True,id=11c7c4ff-db41-4231-8300-ee85a94619c1,network=Network(50f9056b-d85d-4a43-8981-3c5c98e1bf52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11c7c4ff-db')
Oct 18 11:50:48 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T11:49:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1070511893',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1070511893',id=18,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKBVslbZEBCyddD78nfODxLMQOA10HLdeoyHJpwL0LX2DVFby+C6OMMAsTj4P/vGPT3eFNKVrplFcT2qxWYSTR79oTFsUZwl238caZpIs58KdEidArGj0m+IHMu+D/m5Dg==',key_name='tempest-keypair-232390733',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='daccec0feffd445492c3ab4ff40bcde2',ramdisk_id='',reservation_id='r-ugx6bgpm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1710887731',owner_user_name='tempest-TaggedBootDevicesTest-1710887731-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:49:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8f517ba22b1494ca5700e014e7ab8b9',uuid=cd28be8d-847b-468c-860f-4f479740738d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dba85cc3-dd42-4fa4-96d3-bec15903344f", "address": "fa:16:3e:fb:32:89", "network": {"id": "1ba257ec-d104-413d-bbf9-d9702ed5a1b4", "bridge": "br-int", "label": "tempest-device-tagging-net2-445498545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdba85cc3-dd", "ovs_interfaceid": "dba85cc3-dd42-4fa4-96d3-bec15903344f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Converting VIF {"id": "dba85cc3-dd42-4fa4-96d3-bec15903344f", "address": "fa:16:3e:fb:32:89", "network": {"id": "1ba257ec-d104-413d-bbf9-d9702ed5a1b4", "bridge": "br-int", "label": "tempest-device-tagging-net2-445498545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdba85cc3-dd", "ovs_interfaceid": "dba85cc3-dd42-4fa4-96d3-bec15903344f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:32:89,bridge_name='br-int',has_traffic_filtering=True,id=dba85cc3-dd42-4fa4-96d3-bec15903344f,network=Network(1ba257ec-d104-413d-bbf9-d9702ed5a1b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdba85cc3-dd') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG os_vif [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:32:89,bridge_name='br-int',has_traffic_filtering=True,id=dba85cc3-dd42-4fa4-96d3-bec15903344f,network=Network(1ba257ec-d104-413d-bbf9-d9702ed5a1b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdba85cc3-dd') {{(pid=74190) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5b282290-0fab-52cc-bf7a-147d73c30ff0', '_type': 'linux-noop'}}, row=False) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdba85cc3-dd, may_exist=True, interface_attrs={}) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdba85cc3-dd, col_values=(('qos', UUID('2b887a4c-74fa-408d-a5af-6144bdf14e6c')),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdba85cc3-dd, col_values=(('external_ids', {'iface-id': 'dba85cc3-dd42-4fa4-96d3-bec15903344f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fb:32:89', 'vm-uuid': 'cd28be8d-847b-468c-860f-4f479740738d'}),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:48 user nova-compute[74190]: INFO os_vif [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:32:89,bridge_name='br-int',has_traffic_filtering=True,id=dba85cc3-dd42-4fa4-96d3-bec15903344f,network=Network(1ba257ec-d104-413d-bbf9-d9702ed5a1b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdba85cc3-dd')
Oct 18 11:50:48 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T11:49:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1070511893',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1070511893',id=18,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKBVslbZEBCyddD78nfODxLMQOA10HLdeoyHJpwL0LX2DVFby+C6OMMAsTj4P/vGPT3eFNKVrplFcT2qxWYSTR79oTFsUZwl238caZpIs58KdEidArGj0m+IHMu+D/m5Dg==',key_name='tempest-keypair-232390733',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='daccec0feffd445492c3ab4ff40bcde2',ramdisk_id='',reservation_id='r-ugx6bgpm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1710887731',owner_user_name='tempest-TaggedBootDevicesTest-1710887731-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:49:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8f517ba22b1494ca5700e014e7ab8b9',uuid=cd28be8d-847b-468c-860f-4f479740738d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "35f010df-56fb-4234-879b-19f86f36a2d3", "address": "fa:16:3e:bf:a7:36", "network": {"id": "1ba257ec-d104-413d-bbf9-d9702ed5a1b4", "bridge": "br-int", "label": "tempest-device-tagging-net2-445498545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35f010df-56", "ovs_interfaceid": "35f010df-56fb-4234-879b-19f86f36a2d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Converting VIF {"id": "35f010df-56fb-4234-879b-19f86f36a2d3", "address": "fa:16:3e:bf:a7:36", "network": {"id": "1ba257ec-d104-413d-bbf9-d9702ed5a1b4", "bridge": "br-int", "label": "tempest-device-tagging-net2-445498545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35f010df-56", "ovs_interfaceid": "35f010df-56fb-4234-879b-19f86f36a2d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:a7:36,bridge_name='br-int',has_traffic_filtering=True,id=35f010df-56fb-4234-879b-19f86f36a2d3,network=Network(1ba257ec-d104-413d-bbf9-d9702ed5a1b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35f010df-56') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG os_vif [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:a7:36,bridge_name='br-int',has_traffic_filtering=True,id=35f010df-56fb-4234-879b-19f86f36a2d3,network=Network(1ba257ec-d104-413d-bbf9-d9702ed5a1b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35f010df-56') {{(pid=74190) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1fc81083-85f2-5a72-9ae5-03d3163450e5', '_type': 'linux-noop'}}, row=False) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap35f010df-56, may_exist=True, interface_attrs={}) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap35f010df-56, col_values=(('qos', UUID('1fdb2525-cb29-44a3-b65b-d1aae0d5e4e1')),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap35f010df-56, col_values=(('external_ids', {'iface-id': '35f010df-56fb-4234-879b-19f86f36a2d3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bf:a7:36', 'vm-uuid': 'cd28be8d-847b-468c-860f-4f479740738d'}),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:50:48 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Instance destroyed successfully.
Oct 18 11:50:48 user nova-compute[74190]: DEBUG nova.objects.instance [None req-b204d274-93da-4606-a6e4-f17ffd0445e8 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Lazy-loading 'resources' on Instance uuid d90a6ca0-19a6-4221-81b7-0cb05d67f38e {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-b204d274-93da-4606-a6e4-f17ffd0445e8 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:48:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1378919830',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1378919830',id=16,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN/VyCpYe57sZza+zIcDL8lX6OOvHO+LrEprfV8DJYOtk4t8fMJlRU0klieaFBHD4cS9lGee5DWDaQGdYbzBF339L3I7vrfQc+lY8v5MadYTacmbDVCw1jMPM0jY/aL4cw==',key_name='tempest-keypair-1365040796',keypairs=<?>,launch_index=0,launched_at=2023-10-18T11:48:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='548640fa718f4fdfa21c1a7783519c9f',ramdisk_id='',reservation_id='r-eukfw0x8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-83921126',owner_user_name='tempest-AttachVolumeShelveTestJSON-83921126-project-member',shelved_at='2023-10-18T11:50:47.885613',shelved_host='user',shelved_image_id='5dad9d13-4172-4aa2-80cc-d43ceb28bb72'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T11:50:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='829b310c15b54dc7836d0b9d7fd757ed',uuid=d90a6ca0-19a6-4221-81b7-0cb05d67f38e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "2d8060bc-84e4-41e2-9e72-42b2159a1d1e", "address": "fa:16:3e:6c:a0:e2", "network": {"id": "e6ae8edc-7014-4341-91b2-4c82d72c9bb9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-15434410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548640fa718f4fdfa21c1a7783519c9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d8060bc-84", "ovs_interfaceid": "2d8060bc-84e4-41e2-9e72-42b2159a1d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-b204d274-93da-4606-a6e4-f17ffd0445e8 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Converting VIF {"id": "2d8060bc-84e4-41e2-9e72-42b2159a1d1e", "address": "fa:16:3e:6c:a0:e2", "network": {"id": "e6ae8edc-7014-4341-91b2-4c82d72c9bb9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-15434410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548640fa718f4fdfa21c1a7783519c9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d8060bc-84", "ovs_interfaceid": "2d8060bc-84e4-41e2-9e72-42b2159a1d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-b204d274-93da-4606-a6e4-f17ffd0445e8 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:a0:e2,bridge_name='br-int',has_traffic_filtering=True,id=2d8060bc-84e4-41e2-9e72-42b2159a1d1e,network=Network(e6ae8edc-7014-4341-91b2-4c82d72c9bb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d8060bc-84') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG os_vif [None req-b204d274-93da-4606-a6e4-f17ffd0445e8 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:a0:e2,bridge_name='br-int',has_traffic_filtering=True,id=2d8060bc-84e4-41e2-9e72-42b2159a1d1e,network=Network(e6ae8edc-7014-4341-91b2-4c82d72c9bb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d8060bc-84') {{(pid=74190) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG nova.compute.manager [req-45ffb81c-6999-4b5e-88b2-9dc2cfd664e1 req-a09af3be-f2c7-4dcc-b89f-20ab240ec669 service nova] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Received event network-changed-2d8060bc-84e4-41e2-9e72-42b2159a1d1e {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG nova.compute.manager [req-45ffb81c-6999-4b5e-88b2-9dc2cfd664e1 req-a09af3be-f2c7-4dcc-b89f-20ab240ec669 service nova] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Refreshing instance network info cache due to event network-changed-2d8060bc-84e4-41e2-9e72-42b2159a1d1e. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-45ffb81c-6999-4b5e-88b2-9dc2cfd664e1 req-a09af3be-f2c7-4dcc-b89f-20ab240ec669 service nova] Acquiring lock "refresh_cache-d90a6ca0-19a6-4221-81b7-0cb05d67f38e" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-45ffb81c-6999-4b5e-88b2-9dc2cfd664e1 req-a09af3be-f2c7-4dcc-b89f-20ab240ec669 service nova] Acquired lock "refresh_cache-d90a6ca0-19a6-4221-81b7-0cb05d67f38e" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG nova.network.neutron [req-45ffb81c-6999-4b5e-88b2-9dc2cfd664e1 req-a09af3be-f2c7-4dcc-b89f-20ab240ec669 service nova] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Refreshing network info cache for port 2d8060bc-84e4-41e2-9e72-42b2159a1d1e {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:48 user nova-compute[74190]: INFO os_vif [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:a7:36,bridge_name='br-int',has_traffic_filtering=True,id=35f010df-56fb-4234-879b-19f86f36a2d3,network=Network(1ba257ec-d104-413d-bbf9-d9702ed5a1b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35f010df-56')
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2d8060bc-84, bridge=br-int, if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:50:49 user nova-compute[74190]: DEBUG nova.compute.manager [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Instance event wait completed in 0 seconds for  {{(pid=74190) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 11:50:49 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Instance running successfully.
Oct 18 11:50:49 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:49 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:49 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=be660ebe-4072-4345-a96a-3f3f5b57bee4) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:50:49 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:49 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Failed to set time: agent not configured {{(pid=74190) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Oct 18 11:50:49 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-728a95be-dde4-411b-af8d-3601de686d0e tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] finish_migration finished successfully. {{(pid=74190) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Oct 18 11:50:49 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:50:49 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] No BDM found with device name hda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 11:50:49 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 11:50:49 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] No VIF found with MAC fa:16:3e:11:db:57, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 11:50:49 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] No VIF found with MAC fa:16:3e:ca:c8:e5, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 11:50:49 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] [instance: cd28be8d-847b-468c-860f-4f479740738d] Using config drive
Oct 18 11:50:49 user nova-compute[74190]: DEBUG nova.compute.manager [req-2d43f69d-5429-4a49-ac5f-c0e004673b43 req-4f78635e-8b72-4639-8ebc-6a39396314c3 service nova] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Received event network-vif-plugged-5f5b65f1-7748-4422-8b45-e1b88476716d {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:50:49 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-2d43f69d-5429-4a49-ac5f-c0e004673b43 req-4f78635e-8b72-4639-8ebc-6a39396314c3 service nova] Acquiring lock "bdfe420d-f46c-44ad-8773-b675f42e24ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:50:49 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-2d43f69d-5429-4a49-ac5f-c0e004673b43 req-4f78635e-8b72-4639-8ebc-6a39396314c3 service nova] Lock "bdfe420d-f46c-44ad-8773-b675f42e24ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:50:49 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-2d43f69d-5429-4a49-ac5f-c0e004673b43 req-4f78635e-8b72-4639-8ebc-6a39396314c3 service nova] Lock "bdfe420d-f46c-44ad-8773-b675f42e24ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:50:49 user nova-compute[74190]: DEBUG nova.compute.manager [req-2d43f69d-5429-4a49-ac5f-c0e004673b43 req-4f78635e-8b72-4639-8ebc-6a39396314c3 service nova] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] No waiting events found dispatching network-vif-plugged-5f5b65f1-7748-4422-8b45-e1b88476716d {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:50:49 user nova-compute[74190]: WARNING nova.compute.manager [req-2d43f69d-5429-4a49-ac5f-c0e004673b43 req-4f78635e-8b72-4639-8ebc-6a39396314c3 service nova] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Received unexpected event network-vif-plugged-5f5b65f1-7748-4422-8b45-e1b88476716d for instance with vm_state active and task_state resize_finish.
Oct 18 11:50:49 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:49 user nova-compute[74190]: INFO os_vif [None req-b204d274-93da-4606-a6e4-f17ffd0445e8 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:a0:e2,bridge_name='br-int',has_traffic_filtering=True,id=2d8060bc-84e4-41e2-9e72-42b2159a1d1e,network=Network(e6ae8edc-7014-4341-91b2-4c82d72c9bb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d8060bc-84')
Oct 18 11:50:49 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-b204d274-93da-4606-a6e4-f17ffd0445e8 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Deleting instance files /opt/stack/data/nova/instances/d90a6ca0-19a6-4221-81b7-0cb05d67f38e_del
Oct 18 11:50:49 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-b204d274-93da-4606-a6e4-f17ffd0445e8 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Deletion of /opt/stack/data/nova/instances/d90a6ca0-19a6-4221-81b7-0cb05d67f38e_del complete
Oct 18 11:50:49 user nova-compute[74190]: INFO nova.scheduler.client.report [None req-b204d274-93da-4606-a6e4-f17ffd0445e8 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Deleted allocations for instance d90a6ca0-19a6-4221-81b7-0cb05d67f38e
Oct 18 11:50:49 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] [instance: cd28be8d-847b-468c-860f-4f479740738d] Creating config drive at /opt/stack/data/nova/instances/cd28be8d-847b-468c-860f-4f479740738d/disk.config
Oct 18 11:50:49 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/cd28be8d-847b-468c-860f-4f479740738d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpgucwuzsv {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:49 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b204d274-93da-4606-a6e4-f17ffd0445e8 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:50:49 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b204d274-93da-4606-a6e4-f17ffd0445e8 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:50:49 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/cd28be8d-847b-468c-860f-4f479740738d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpgucwuzsv" returned: 0 in 0.061s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:49 user nova-compute[74190]: DEBUG nova.objects.instance [None req-b204d274-93da-4606-a6e4-f17ffd0445e8 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Lazy-loading 'numa_topology' on Instance uuid d90a6ca0-19a6-4221-81b7-0cb05d67f38e {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:50:49 user nova-compute[74190]: DEBUG nova.objects.base [None req-b204d274-93da-4606-a6e4-f17ffd0445e8 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Object Instance<d90a6ca0-19a6-4221-81b7-0cb05d67f38e> lazy-loaded attributes: resources,numa_topology {{(pid=74190) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 11:50:49 user nova-compute[74190]: DEBUG nova.network.neutron [req-45ffb81c-6999-4b5e-88b2-9dc2cfd664e1 req-a09af3be-f2c7-4dcc-b89f-20ab240ec669 service nova] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Updated VIF entry in instance network info cache for port 2d8060bc-84e4-41e2-9e72-42b2159a1d1e. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 11:50:49 user nova-compute[74190]: DEBUG nova.network.neutron [req-45ffb81c-6999-4b5e-88b2-9dc2cfd664e1 req-a09af3be-f2c7-4dcc-b89f-20ab240ec669 service nova] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Updating instance_info_cache with network_info: [{"id": "2d8060bc-84e4-41e2-9e72-42b2159a1d1e", "address": "fa:16:3e:6c:a0:e2", "network": {"id": "e6ae8edc-7014-4341-91b2-4c82d72c9bb9", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-15434410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548640fa718f4fdfa21c1a7783519c9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap2d8060bc-84", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:50:49 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-45ffb81c-6999-4b5e-88b2-9dc2cfd664e1 req-a09af3be-f2c7-4dcc-b89f-20ab240ec669 service nova] Releasing lock "refresh_cache-d90a6ca0-19a6-4221-81b7-0cb05d67f38e" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:50:49 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:49 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-b204d274-93da-4606-a6e4-f17ffd0445e8 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 11:50:49 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-b204d274-93da-4606-a6e4-f17ffd0445e8 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 11:50:49 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b204d274-93da-4606-a6e4-f17ffd0445e8 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.439s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:50:49 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b204d274-93da-4606-a6e4-f17ffd0445e8 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Lock "d90a6ca0-19a6-4221-81b7-0cb05d67f38e" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.600s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:50:50 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:50 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:50 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:50 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:51 user nova-compute[74190]: DEBUG nova.compute.manager [req-92f9fb5d-751e-4ac1-9f85-f42001b2fa10 req-130f7ac2-06df-479e-94ad-4cb9dd63e120 service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Received event network-vif-plugged-c2ed33ff-2096-4def-98c5-709db8bc0ea4 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:50:51 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-92f9fb5d-751e-4ac1-9f85-f42001b2fa10 req-130f7ac2-06df-479e-94ad-4cb9dd63e120 service nova] Acquiring lock "cd28be8d-847b-468c-860f-4f479740738d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:50:51 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-92f9fb5d-751e-4ac1-9f85-f42001b2fa10 req-130f7ac2-06df-479e-94ad-4cb9dd63e120 service nova] Lock "cd28be8d-847b-468c-860f-4f479740738d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:50:51 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-92f9fb5d-751e-4ac1-9f85-f42001b2fa10 req-130f7ac2-06df-479e-94ad-4cb9dd63e120 service nova] Lock "cd28be8d-847b-468c-860f-4f479740738d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:50:51 user nova-compute[74190]: DEBUG nova.compute.manager [req-92f9fb5d-751e-4ac1-9f85-f42001b2fa10 req-130f7ac2-06df-479e-94ad-4cb9dd63e120 service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] No waiting events found dispatching network-vif-plugged-c2ed33ff-2096-4def-98c5-709db8bc0ea4 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:50:51 user nova-compute[74190]: WARNING nova.compute.manager [req-92f9fb5d-751e-4ac1-9f85-f42001b2fa10 req-130f7ac2-06df-479e-94ad-4cb9dd63e120 service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Received unexpected event network-vif-plugged-c2ed33ff-2096-4def-98c5-709db8bc0ea4 for instance with vm_state building and task_state spawning.
Oct 18 11:50:51 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:51 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-6db53e46-be0a-4f09-af3e-f21a637a4a24 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Acquiring lock "52d7b8e5-02cc-4148-86e2-ceb295e81afc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:50:51 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-6db53e46-be0a-4f09-af3e-f21a637a4a24 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lock "52d7b8e5-02cc-4148-86e2-ceb295e81afc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:50:51 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-6db53e46-be0a-4f09-af3e-f21a637a4a24 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Acquiring lock "52d7b8e5-02cc-4148-86e2-ceb295e81afc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:50:51 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-6db53e46-be0a-4f09-af3e-f21a637a4a24 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lock "52d7b8e5-02cc-4148-86e2-ceb295e81afc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:50:51 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-6db53e46-be0a-4f09-af3e-f21a637a4a24 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lock "52d7b8e5-02cc-4148-86e2-ceb295e81afc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:50:51 user nova-compute[74190]: INFO nova.compute.manager [None req-6db53e46-be0a-4f09-af3e-f21a637a4a24 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Terminating instance
Oct 18 11:50:51 user nova-compute[74190]: DEBUG nova.compute.manager [None req-6db53e46-be0a-4f09-af3e-f21a637a4a24 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Start destroying the instance on the hypervisor. {{(pid=74190) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 11:50:51 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:51 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:51 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:51 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:51 user nova-compute[74190]: DEBUG nova.compute.manager [req-f48ea314-7849-40c7-bf65-fe3a1867808b req-ff2b3d73-9d17-4e81-9cd3-fb128c7db0d8 service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Received event network-vif-plugged-aca29f48-4a6d-472a-ac70-7006b63b9996 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:50:51 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-f48ea314-7849-40c7-bf65-fe3a1867808b req-ff2b3d73-9d17-4e81-9cd3-fb128c7db0d8 service nova] Acquiring lock "cd28be8d-847b-468c-860f-4f479740738d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:50:51 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-f48ea314-7849-40c7-bf65-fe3a1867808b req-ff2b3d73-9d17-4e81-9cd3-fb128c7db0d8 service nova] Lock "cd28be8d-847b-468c-860f-4f479740738d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:50:51 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-f48ea314-7849-40c7-bf65-fe3a1867808b req-ff2b3d73-9d17-4e81-9cd3-fb128c7db0d8 service nova] Lock "cd28be8d-847b-468c-860f-4f479740738d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:50:51 user nova-compute[74190]: DEBUG nova.compute.manager [req-f48ea314-7849-40c7-bf65-fe3a1867808b req-ff2b3d73-9d17-4e81-9cd3-fb128c7db0d8 service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] No waiting events found dispatching network-vif-plugged-aca29f48-4a6d-472a-ac70-7006b63b9996 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:50:51 user nova-compute[74190]: WARNING nova.compute.manager [req-f48ea314-7849-40c7-bf65-fe3a1867808b req-ff2b3d73-9d17-4e81-9cd3-fb128c7db0d8 service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Received unexpected event network-vif-plugged-aca29f48-4a6d-472a-ac70-7006b63b9996 for instance with vm_state building and task_state spawning.
Oct 18 11:50:51 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:51 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:51 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:51 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:51 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:51 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:52 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:52 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:52 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:52 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:52 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:52 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Instance destroyed successfully.
Oct 18 11:50:52 user nova-compute[74190]: DEBUG nova.objects.instance [None req-6db53e46-be0a-4f09-af3e-f21a637a4a24 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lazy-loading 'resources' on Instance uuid 52d7b8e5-02cc-4148-86e2-ceb295e81afc {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:50:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-6db53e46-be0a-4f09-af3e-f21a637a4a24 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-18T11:44:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-438639954',display_name='tempest-ServerActionsTestOtherA-server-123298975',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-438639954',id=12,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFdYXPh75Q7xKUqDE9zPp25KXyLhkj0/QLZATeV9ge1D1Ga7GiFXEGYg8QjRnvIAI0+WdgkHzK6fQEWBqJjE2h37Va7NyrV0Yc22ekpkzrQQ2biGg9l9Yf1LSoVy9aLWgA==',key_name='tempest-keypair-286461082',keypairs=<?>,launch_index=0,launched_at=2023-10-18T11:47:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='08cf52ce927443158aa731367f08bd57',ramdisk_id='',reservation_id='r-5s39f1w2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1288544694',owner_user_name='tempest-ServerActionsTestOtherA-1288544694-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T11:47:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b771e627a76b4540bf8de665df3d7787',uuid=52d7b8e5-02cc-4148-86e2-ceb295e81afc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "550e157d-7f82-41a1-b4ba-9dbb43037d8c", "address": "fa:16:3e:88:36:f0", "network": {"id": "f5ab7da4-2b07-4465-9a89-a07eb053ba91", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1315695374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08cf52ce927443158aa731367f08bd57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap550e157d-7f", "ovs_interfaceid": "550e157d-7f82-41a1-b4ba-9dbb43037d8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 11:50:52 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-6db53e46-be0a-4f09-af3e-f21a637a4a24 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Converting VIF {"id": "550e157d-7f82-41a1-b4ba-9dbb43037d8c", "address": "fa:16:3e:88:36:f0", "network": {"id": "f5ab7da4-2b07-4465-9a89-a07eb053ba91", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1315695374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08cf52ce927443158aa731367f08bd57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap550e157d-7f", "ovs_interfaceid": "550e157d-7f82-41a1-b4ba-9dbb43037d8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:50:52 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-6db53e46-be0a-4f09-af3e-f21a637a4a24 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:88:36:f0,bridge_name='br-int',has_traffic_filtering=True,id=550e157d-7f82-41a1-b4ba-9dbb43037d8c,network=Network(f5ab7da4-2b07-4465-9a89-a07eb053ba91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap550e157d-7f') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:50:52 user nova-compute[74190]: DEBUG os_vif [None req-6db53e46-be0a-4f09-af3e-f21a637a4a24 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:36:f0,bridge_name='br-int',has_traffic_filtering=True,id=550e157d-7f82-41a1-b4ba-9dbb43037d8c,network=Network(f5ab7da4-2b07-4465-9a89-a07eb053ba91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap550e157d-7f') {{(pid=74190) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 11:50:52 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:52 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap550e157d-7f, bridge=br-int, if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:50:52 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:52 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:50:52 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:52 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:52 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:52 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4df88888-5e19-4319-b296-030e91bcf2e2) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:50:52 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:52 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:50:52 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:52 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:52 user nova-compute[74190]: INFO os_vif [None req-6db53e46-be0a-4f09-af3e-f21a637a4a24 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:36:f0,bridge_name='br-int',has_traffic_filtering=True,id=550e157d-7f82-41a1-b4ba-9dbb43037d8c,network=Network(f5ab7da4-2b07-4465-9a89-a07eb053ba91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap550e157d-7f')
Oct 18 11:50:52 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-6db53e46-be0a-4f09-af3e-f21a637a4a24 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Deleting instance files /opt/stack/data/nova/instances/52d7b8e5-02cc-4148-86e2-ceb295e81afc_del
Oct 18 11:50:52 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-6db53e46-be0a-4f09-af3e-f21a637a4a24 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Deletion of /opt/stack/data/nova/instances/52d7b8e5-02cc-4148-86e2-ceb295e81afc_del complete
Oct 18 11:50:52 user nova-compute[74190]: DEBUG nova.compute.manager [req-f9fd41df-dc03-4787-bd47-b8d49a32024e req-ed09bd11-b1ec-4fee-a6f1-2461aebdcf0c service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Received event network-vif-plugged-11c7c4ff-db41-4231-8300-ee85a94619c1 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:50:52 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-f9fd41df-dc03-4787-bd47-b8d49a32024e req-ed09bd11-b1ec-4fee-a6f1-2461aebdcf0c service nova] Acquiring lock "cd28be8d-847b-468c-860f-4f479740738d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:50:52 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-f9fd41df-dc03-4787-bd47-b8d49a32024e req-ed09bd11-b1ec-4fee-a6f1-2461aebdcf0c service nova] Lock "cd28be8d-847b-468c-860f-4f479740738d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:50:52 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-f9fd41df-dc03-4787-bd47-b8d49a32024e req-ed09bd11-b1ec-4fee-a6f1-2461aebdcf0c service nova] Lock "cd28be8d-847b-468c-860f-4f479740738d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:50:52 user nova-compute[74190]: DEBUG nova.compute.manager [req-f9fd41df-dc03-4787-bd47-b8d49a32024e req-ed09bd11-b1ec-4fee-a6f1-2461aebdcf0c service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] No waiting events found dispatching network-vif-plugged-11c7c4ff-db41-4231-8300-ee85a94619c1 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:50:52 user nova-compute[74190]: WARNING nova.compute.manager [req-f9fd41df-dc03-4787-bd47-b8d49a32024e req-ed09bd11-b1ec-4fee-a6f1-2461aebdcf0c service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Received unexpected event network-vif-plugged-11c7c4ff-db41-4231-8300-ee85a94619c1 for instance with vm_state building and task_state spawning.
Oct 18 11:50:52 user nova-compute[74190]: INFO nova.compute.manager [None req-6db53e46-be0a-4f09-af3e-f21a637a4a24 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Took 1.70 seconds to destroy the instance on the hypervisor.
Oct 18 11:50:52 user nova-compute[74190]: DEBUG oslo.service.loopingcall [None req-6db53e46-be0a-4f09-af3e-f21a637a4a24 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74190) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 11:50:52 user nova-compute[74190]: DEBUG nova.compute.manager [-] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Deallocating network for instance {{(pid=74190) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 11:50:52 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] deallocate_for_instance() {{(pid=74190) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 11:50:53 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:53 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:53 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:53 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:53 user nova-compute[74190]: DEBUG nova.compute.manager [req-d8482e2c-5e09-4d86-bf21-016d8bfa38ee req-f4991591-edbd-4aa3-8e14-bc4af3c3dcb5 service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Received event network-vif-plugged-c2ed33ff-2096-4def-98c5-709db8bc0ea4 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:50:53 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d8482e2c-5e09-4d86-bf21-016d8bfa38ee req-f4991591-edbd-4aa3-8e14-bc4af3c3dcb5 service nova] Acquiring lock "cd28be8d-847b-468c-860f-4f479740738d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:50:53 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d8482e2c-5e09-4d86-bf21-016d8bfa38ee req-f4991591-edbd-4aa3-8e14-bc4af3c3dcb5 service nova] Lock "cd28be8d-847b-468c-860f-4f479740738d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:50:53 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d8482e2c-5e09-4d86-bf21-016d8bfa38ee req-f4991591-edbd-4aa3-8e14-bc4af3c3dcb5 service nova] Lock "cd28be8d-847b-468c-860f-4f479740738d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:50:53 user nova-compute[74190]: DEBUG nova.compute.manager [req-d8482e2c-5e09-4d86-bf21-016d8bfa38ee req-f4991591-edbd-4aa3-8e14-bc4af3c3dcb5 service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] No waiting events found dispatching network-vif-plugged-c2ed33ff-2096-4def-98c5-709db8bc0ea4 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:50:53 user nova-compute[74190]: WARNING nova.compute.manager [req-d8482e2c-5e09-4d86-bf21-016d8bfa38ee req-f4991591-edbd-4aa3-8e14-bc4af3c3dcb5 service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Received unexpected event network-vif-plugged-c2ed33ff-2096-4def-98c5-709db8bc0ea4 for instance with vm_state building and task_state spawning.
Oct 18 11:50:53 user nova-compute[74190]: DEBUG nova.compute.manager [req-d8482e2c-5e09-4d86-bf21-016d8bfa38ee req-f4991591-edbd-4aa3-8e14-bc4af3c3dcb5 service nova] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Received event network-vif-unplugged-550e157d-7f82-41a1-b4ba-9dbb43037d8c {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:50:53 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d8482e2c-5e09-4d86-bf21-016d8bfa38ee req-f4991591-edbd-4aa3-8e14-bc4af3c3dcb5 service nova] Acquiring lock "52d7b8e5-02cc-4148-86e2-ceb295e81afc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:50:53 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d8482e2c-5e09-4d86-bf21-016d8bfa38ee req-f4991591-edbd-4aa3-8e14-bc4af3c3dcb5 service nova] Lock "52d7b8e5-02cc-4148-86e2-ceb295e81afc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:50:53 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d8482e2c-5e09-4d86-bf21-016d8bfa38ee req-f4991591-edbd-4aa3-8e14-bc4af3c3dcb5 service nova] Lock "52d7b8e5-02cc-4148-86e2-ceb295e81afc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:50:53 user nova-compute[74190]: DEBUG nova.compute.manager [req-d8482e2c-5e09-4d86-bf21-016d8bfa38ee req-f4991591-edbd-4aa3-8e14-bc4af3c3dcb5 service nova] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] No waiting events found dispatching network-vif-unplugged-550e157d-7f82-41a1-b4ba-9dbb43037d8c {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:50:53 user nova-compute[74190]: DEBUG nova.compute.manager [req-d8482e2c-5e09-4d86-bf21-016d8bfa38ee req-f4991591-edbd-4aa3-8e14-bc4af3c3dcb5 service nova] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Received event network-vif-unplugged-550e157d-7f82-41a1-b4ba-9dbb43037d8c for instance with task_state deleting. {{(pid=74190) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 11:50:53 user nova-compute[74190]: DEBUG nova.compute.manager [req-d8482e2c-5e09-4d86-bf21-016d8bfa38ee req-f4991591-edbd-4aa3-8e14-bc4af3c3dcb5 service nova] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Received event network-vif-plugged-550e157d-7f82-41a1-b4ba-9dbb43037d8c {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:50:53 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d8482e2c-5e09-4d86-bf21-016d8bfa38ee req-f4991591-edbd-4aa3-8e14-bc4af3c3dcb5 service nova] Acquiring lock "52d7b8e5-02cc-4148-86e2-ceb295e81afc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:50:53 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d8482e2c-5e09-4d86-bf21-016d8bfa38ee req-f4991591-edbd-4aa3-8e14-bc4af3c3dcb5 service nova] Lock "52d7b8e5-02cc-4148-86e2-ceb295e81afc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:50:53 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d8482e2c-5e09-4d86-bf21-016d8bfa38ee req-f4991591-edbd-4aa3-8e14-bc4af3c3dcb5 service nova] Lock "52d7b8e5-02cc-4148-86e2-ceb295e81afc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:50:53 user nova-compute[74190]: DEBUG nova.compute.manager [req-d8482e2c-5e09-4d86-bf21-016d8bfa38ee req-f4991591-edbd-4aa3-8e14-bc4af3c3dcb5 service nova] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] No waiting events found dispatching network-vif-plugged-550e157d-7f82-41a1-b4ba-9dbb43037d8c {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:50:53 user nova-compute[74190]: WARNING nova.compute.manager [req-d8482e2c-5e09-4d86-bf21-016d8bfa38ee req-f4991591-edbd-4aa3-8e14-bc4af3c3dcb5 service nova] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Received unexpected event network-vif-plugged-550e157d-7f82-41a1-b4ba-9dbb43037d8c for instance with vm_state active and task_state deleting.
Oct 18 11:50:53 user nova-compute[74190]: DEBUG nova.compute.manager [req-d8482e2c-5e09-4d86-bf21-016d8bfa38ee req-f4991591-edbd-4aa3-8e14-bc4af3c3dcb5 service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Received event network-vif-plugged-0a00abcf-957e-4276-a975-522f8a42ad55 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:50:53 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d8482e2c-5e09-4d86-bf21-016d8bfa38ee req-f4991591-edbd-4aa3-8e14-bc4af3c3dcb5 service nova] Acquiring lock "cd28be8d-847b-468c-860f-4f479740738d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:50:53 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d8482e2c-5e09-4d86-bf21-016d8bfa38ee req-f4991591-edbd-4aa3-8e14-bc4af3c3dcb5 service nova] Lock "cd28be8d-847b-468c-860f-4f479740738d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:50:53 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d8482e2c-5e09-4d86-bf21-016d8bfa38ee req-f4991591-edbd-4aa3-8e14-bc4af3c3dcb5 service nova] Lock "cd28be8d-847b-468c-860f-4f479740738d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:50:53 user nova-compute[74190]: DEBUG nova.compute.manager [req-d8482e2c-5e09-4d86-bf21-016d8bfa38ee req-f4991591-edbd-4aa3-8e14-bc4af3c3dcb5 service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] No waiting events found dispatching network-vif-plugged-0a00abcf-957e-4276-a975-522f8a42ad55 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:50:53 user nova-compute[74190]: WARNING nova.compute.manager [req-d8482e2c-5e09-4d86-bf21-016d8bfa38ee req-f4991591-edbd-4aa3-8e14-bc4af3c3dcb5 service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Received unexpected event network-vif-plugged-0a00abcf-957e-4276-a975-522f8a42ad55 for instance with vm_state building and task_state spawning.
Oct 18 11:50:53 user nova-compute[74190]: DEBUG nova.compute.manager [req-d8482e2c-5e09-4d86-bf21-016d8bfa38ee req-f4991591-edbd-4aa3-8e14-bc4af3c3dcb5 service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Received event network-vif-plugged-0a00abcf-957e-4276-a975-522f8a42ad55 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:50:53 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d8482e2c-5e09-4d86-bf21-016d8bfa38ee req-f4991591-edbd-4aa3-8e14-bc4af3c3dcb5 service nova] Acquiring lock "cd28be8d-847b-468c-860f-4f479740738d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:50:53 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d8482e2c-5e09-4d86-bf21-016d8bfa38ee req-f4991591-edbd-4aa3-8e14-bc4af3c3dcb5 service nova] Lock "cd28be8d-847b-468c-860f-4f479740738d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:50:53 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d8482e2c-5e09-4d86-bf21-016d8bfa38ee req-f4991591-edbd-4aa3-8e14-bc4af3c3dcb5 service nova] Lock "cd28be8d-847b-468c-860f-4f479740738d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:50:53 user nova-compute[74190]: DEBUG nova.compute.manager [req-d8482e2c-5e09-4d86-bf21-016d8bfa38ee req-f4991591-edbd-4aa3-8e14-bc4af3c3dcb5 service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] No waiting events found dispatching network-vif-plugged-0a00abcf-957e-4276-a975-522f8a42ad55 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:50:53 user nova-compute[74190]: WARNING nova.compute.manager [req-d8482e2c-5e09-4d86-bf21-016d8bfa38ee req-f4991591-edbd-4aa3-8e14-bc4af3c3dcb5 service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Received unexpected event network-vif-plugged-0a00abcf-957e-4276-a975-522f8a42ad55 for instance with vm_state building and task_state spawning.
Oct 18 11:50:53 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:53 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:53 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:53 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:53 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:53 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:53 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:53 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:53 user nova-compute[74190]: DEBUG nova.compute.manager [req-3e125904-7e24-4c80-9f38-abe8a8ff8e72 req-f40ccc0a-aca8-4382-88d4-e2efcee9b50f service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Received event network-vif-plugged-aca29f48-4a6d-472a-ac70-7006b63b9996 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:50:53 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-3e125904-7e24-4c80-9f38-abe8a8ff8e72 req-f40ccc0a-aca8-4382-88d4-e2efcee9b50f service nova] Acquiring lock "cd28be8d-847b-468c-860f-4f479740738d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:50:53 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-3e125904-7e24-4c80-9f38-abe8a8ff8e72 req-f40ccc0a-aca8-4382-88d4-e2efcee9b50f service nova] Lock "cd28be8d-847b-468c-860f-4f479740738d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:50:53 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-3e125904-7e24-4c80-9f38-abe8a8ff8e72 req-f40ccc0a-aca8-4382-88d4-e2efcee9b50f service nova] Lock "cd28be8d-847b-468c-860f-4f479740738d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:50:53 user nova-compute[74190]: DEBUG nova.compute.manager [req-3e125904-7e24-4c80-9f38-abe8a8ff8e72 req-f40ccc0a-aca8-4382-88d4-e2efcee9b50f service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] No waiting events found dispatching network-vif-plugged-aca29f48-4a6d-472a-ac70-7006b63b9996 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:50:53 user nova-compute[74190]: WARNING nova.compute.manager [req-3e125904-7e24-4c80-9f38-abe8a8ff8e72 req-f40ccc0a-aca8-4382-88d4-e2efcee9b50f service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Received unexpected event network-vif-plugged-aca29f48-4a6d-472a-ac70-7006b63b9996 for instance with vm_state building and task_state spawning.
Oct 18 11:50:53 user nova-compute[74190]: DEBUG nova.compute.manager [req-3e125904-7e24-4c80-9f38-abe8a8ff8e72 req-f40ccc0a-aca8-4382-88d4-e2efcee9b50f service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Received event network-vif-plugged-d5f803c0-bb6c-41be-8294-fb3565e03413 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:50:53 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-3e125904-7e24-4c80-9f38-abe8a8ff8e72 req-f40ccc0a-aca8-4382-88d4-e2efcee9b50f service nova] Acquiring lock "cd28be8d-847b-468c-860f-4f479740738d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:50:53 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-3e125904-7e24-4c80-9f38-abe8a8ff8e72 req-f40ccc0a-aca8-4382-88d4-e2efcee9b50f service nova] Lock "cd28be8d-847b-468c-860f-4f479740738d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:50:53 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-3e125904-7e24-4c80-9f38-abe8a8ff8e72 req-f40ccc0a-aca8-4382-88d4-e2efcee9b50f service nova] Lock "cd28be8d-847b-468c-860f-4f479740738d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:50:53 user nova-compute[74190]: DEBUG nova.compute.manager [req-3e125904-7e24-4c80-9f38-abe8a8ff8e72 req-f40ccc0a-aca8-4382-88d4-e2efcee9b50f service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] No waiting events found dispatching network-vif-plugged-d5f803c0-bb6c-41be-8294-fb3565e03413 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:50:53 user nova-compute[74190]: WARNING nova.compute.manager [req-3e125904-7e24-4c80-9f38-abe8a8ff8e72 req-f40ccc0a-aca8-4382-88d4-e2efcee9b50f service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Received unexpected event network-vif-plugged-d5f803c0-bb6c-41be-8294-fb3565e03413 for instance with vm_state building and task_state spawning.
Oct 18 11:50:53 user nova-compute[74190]: DEBUG nova.compute.manager [req-3e125904-7e24-4c80-9f38-abe8a8ff8e72 req-f40ccc0a-aca8-4382-88d4-e2efcee9b50f service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Received event network-vif-plugged-d5f803c0-bb6c-41be-8294-fb3565e03413 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:50:53 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-3e125904-7e24-4c80-9f38-abe8a8ff8e72 req-f40ccc0a-aca8-4382-88d4-e2efcee9b50f service nova] Acquiring lock "cd28be8d-847b-468c-860f-4f479740738d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:50:53 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-3e125904-7e24-4c80-9f38-abe8a8ff8e72 req-f40ccc0a-aca8-4382-88d4-e2efcee9b50f service nova] Lock "cd28be8d-847b-468c-860f-4f479740738d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:50:53 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-3e125904-7e24-4c80-9f38-abe8a8ff8e72 req-f40ccc0a-aca8-4382-88d4-e2efcee9b50f service nova] Lock "cd28be8d-847b-468c-860f-4f479740738d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:50:53 user nova-compute[74190]: DEBUG nova.compute.manager [req-3e125904-7e24-4c80-9f38-abe8a8ff8e72 req-f40ccc0a-aca8-4382-88d4-e2efcee9b50f service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] No waiting events found dispatching network-vif-plugged-d5f803c0-bb6c-41be-8294-fb3565e03413 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:50:53 user nova-compute[74190]: WARNING nova.compute.manager [req-3e125904-7e24-4c80-9f38-abe8a8ff8e72 req-f40ccc0a-aca8-4382-88d4-e2efcee9b50f service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Received unexpected event network-vif-plugged-d5f803c0-bb6c-41be-8294-fb3565e03413 for instance with vm_state building and task_state spawning.
Oct 18 11:50:54 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:50:54 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:50:54 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74190) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 11:50:54 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:54 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:54 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:54 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:54 user nova-compute[74190]: DEBUG nova.compute.manager [req-42429e55-cb5c-44b2-bd01-8852ba2600aa req-becc5c47-120c-4063-ae14-3ee6bde6620a service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Received event network-vif-plugged-11c7c4ff-db41-4231-8300-ee85a94619c1 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:50:54 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-42429e55-cb5c-44b2-bd01-8852ba2600aa req-becc5c47-120c-4063-ae14-3ee6bde6620a service nova] Acquiring lock "cd28be8d-847b-468c-860f-4f479740738d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:50:54 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-42429e55-cb5c-44b2-bd01-8852ba2600aa req-becc5c47-120c-4063-ae14-3ee6bde6620a service nova] Lock "cd28be8d-847b-468c-860f-4f479740738d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:50:54 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-42429e55-cb5c-44b2-bd01-8852ba2600aa req-becc5c47-120c-4063-ae14-3ee6bde6620a service nova] Lock "cd28be8d-847b-468c-860f-4f479740738d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:50:54 user nova-compute[74190]: DEBUG nova.compute.manager [req-42429e55-cb5c-44b2-bd01-8852ba2600aa req-becc5c47-120c-4063-ae14-3ee6bde6620a service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] No waiting events found dispatching network-vif-plugged-11c7c4ff-db41-4231-8300-ee85a94619c1 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:50:54 user nova-compute[74190]: WARNING nova.compute.manager [req-42429e55-cb5c-44b2-bd01-8852ba2600aa req-becc5c47-120c-4063-ae14-3ee6bde6620a service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Received unexpected event network-vif-plugged-11c7c4ff-db41-4231-8300-ee85a94619c1 for instance with vm_state building and task_state spawning.
Oct 18 11:50:55 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:50:55 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:50:55 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:50:55 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:50:55 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:50:55 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Auditing locally available compute resources for user (node: user) {{(pid=74190) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 11:50:55 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:55 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:55 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Updating instance_info_cache with network_info: [] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:50:55 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:55 user nova-compute[74190]: INFO nova.compute.manager [-] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Took 2.26 seconds to deallocate network for instance.
Oct 18 11:50:55 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0e52e79-ce1e-4a77-a189-b0b837165e68/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:55 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-6db53e46-be0a-4f09-af3e-f21a637a4a24 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:50:55 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-6db53e46-be0a-4f09-af3e-f21a637a4a24 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.005s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:50:55 user nova-compute[74190]: DEBUG nova.compute.manager [req-ea332e3c-56ae-4f3a-939a-0d3342f70224 req-c1c64fc9-1c1c-470e-ba08-960a0dc7bb36 service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Received event network-vif-plugged-dba85cc3-dd42-4fa4-96d3-bec15903344f {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:50:55 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-ea332e3c-56ae-4f3a-939a-0d3342f70224 req-c1c64fc9-1c1c-470e-ba08-960a0dc7bb36 service nova] Acquiring lock "cd28be8d-847b-468c-860f-4f479740738d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:50:55 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-ea332e3c-56ae-4f3a-939a-0d3342f70224 req-c1c64fc9-1c1c-470e-ba08-960a0dc7bb36 service nova] Lock "cd28be8d-847b-468c-860f-4f479740738d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:50:55 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-ea332e3c-56ae-4f3a-939a-0d3342f70224 req-c1c64fc9-1c1c-470e-ba08-960a0dc7bb36 service nova] Lock "cd28be8d-847b-468c-860f-4f479740738d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:50:55 user nova-compute[74190]: DEBUG nova.compute.manager [req-ea332e3c-56ae-4f3a-939a-0d3342f70224 req-c1c64fc9-1c1c-470e-ba08-960a0dc7bb36 service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] No waiting events found dispatching network-vif-plugged-dba85cc3-dd42-4fa4-96d3-bec15903344f {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:50:55 user nova-compute[74190]: WARNING nova.compute.manager [req-ea332e3c-56ae-4f3a-939a-0d3342f70224 req-c1c64fc9-1c1c-470e-ba08-960a0dc7bb36 service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Received unexpected event network-vif-plugged-dba85cc3-dd42-4fa4-96d3-bec15903344f for instance with vm_state building and task_state spawning.
Oct 18 11:50:55 user nova-compute[74190]: DEBUG nova.compute.manager [req-ea332e3c-56ae-4f3a-939a-0d3342f70224 req-c1c64fc9-1c1c-470e-ba08-960a0dc7bb36 service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Received event network-vif-plugged-dba85cc3-dd42-4fa4-96d3-bec15903344f {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:50:55 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-ea332e3c-56ae-4f3a-939a-0d3342f70224 req-c1c64fc9-1c1c-470e-ba08-960a0dc7bb36 service nova] Acquiring lock "cd28be8d-847b-468c-860f-4f479740738d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:50:55 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-ea332e3c-56ae-4f3a-939a-0d3342f70224 req-c1c64fc9-1c1c-470e-ba08-960a0dc7bb36 service nova] Lock "cd28be8d-847b-468c-860f-4f479740738d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:50:55 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-ea332e3c-56ae-4f3a-939a-0d3342f70224 req-c1c64fc9-1c1c-470e-ba08-960a0dc7bb36 service nova] Lock "cd28be8d-847b-468c-860f-4f479740738d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:50:55 user nova-compute[74190]: DEBUG nova.compute.manager [req-ea332e3c-56ae-4f3a-939a-0d3342f70224 req-c1c64fc9-1c1c-470e-ba08-960a0dc7bb36 service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] No waiting events found dispatching network-vif-plugged-dba85cc3-dd42-4fa4-96d3-bec15903344f {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:50:55 user nova-compute[74190]: WARNING nova.compute.manager [req-ea332e3c-56ae-4f3a-939a-0d3342f70224 req-c1c64fc9-1c1c-470e-ba08-960a0dc7bb36 service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Received unexpected event network-vif-plugged-dba85cc3-dd42-4fa4-96d3-bec15903344f for instance with vm_state building and task_state spawning.
Oct 18 11:50:55 user nova-compute[74190]: DEBUG nova.compute.manager [req-ea332e3c-56ae-4f3a-939a-0d3342f70224 req-c1c64fc9-1c1c-470e-ba08-960a0dc7bb36 service nova] [instance: 52d7b8e5-02cc-4148-86e2-ceb295e81afc] Received event network-vif-deleted-550e157d-7f82-41a1-b4ba-9dbb43037d8c {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:50:55 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0e52e79-ce1e-4a77-a189-b0b837165e68/disk --force-share --output=json" returned: 0 in 0.309s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:55 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0e52e79-ce1e-4a77-a189-b0b837165e68/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:55 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:55 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-6db53e46-be0a-4f09-af3e-f21a637a4a24 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 11:50:55 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0e52e79-ce1e-4a77-a189-b0b837165e68/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:55 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-6db53e46-be0a-4f09-af3e-f21a637a4a24 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 11:50:55 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0209c824-88a7-4976-83bf-8a72437f0cc2/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:55 user nova-compute[74190]: DEBUG nova.compute.manager [req-a7d32a66-2b48-4bbc-bdf3-86616648a6af req-693c0dad-24ea-4aa5-b7c1-1c7f09d05bcf service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Received event network-vif-plugged-35f010df-56fb-4234-879b-19f86f36a2d3 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:50:55 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-a7d32a66-2b48-4bbc-bdf3-86616648a6af req-693c0dad-24ea-4aa5-b7c1-1c7f09d05bcf service nova] Acquiring lock "cd28be8d-847b-468c-860f-4f479740738d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:50:55 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-a7d32a66-2b48-4bbc-bdf3-86616648a6af req-693c0dad-24ea-4aa5-b7c1-1c7f09d05bcf service nova] Lock "cd28be8d-847b-468c-860f-4f479740738d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:50:55 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-a7d32a66-2b48-4bbc-bdf3-86616648a6af req-693c0dad-24ea-4aa5-b7c1-1c7f09d05bcf service nova] Lock "cd28be8d-847b-468c-860f-4f479740738d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:50:55 user nova-compute[74190]: DEBUG nova.compute.manager [req-a7d32a66-2b48-4bbc-bdf3-86616648a6af req-693c0dad-24ea-4aa5-b7c1-1c7f09d05bcf service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] No waiting events found dispatching network-vif-plugged-35f010df-56fb-4234-879b-19f86f36a2d3 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:50:55 user nova-compute[74190]: WARNING nova.compute.manager [req-a7d32a66-2b48-4bbc-bdf3-86616648a6af req-693c0dad-24ea-4aa5-b7c1-1c7f09d05bcf service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Received unexpected event network-vif-plugged-35f010df-56fb-4234-879b-19f86f36a2d3 for instance with vm_state building and task_state spawning.
Oct 18 11:50:55 user nova-compute[74190]: DEBUG nova.compute.manager [req-a7d32a66-2b48-4bbc-bdf3-86616648a6af req-693c0dad-24ea-4aa5-b7c1-1c7f09d05bcf service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Received event network-vif-plugged-35f010df-56fb-4234-879b-19f86f36a2d3 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:50:55 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-a7d32a66-2b48-4bbc-bdf3-86616648a6af req-693c0dad-24ea-4aa5-b7c1-1c7f09d05bcf service nova] Acquiring lock "cd28be8d-847b-468c-860f-4f479740738d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:50:55 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-a7d32a66-2b48-4bbc-bdf3-86616648a6af req-693c0dad-24ea-4aa5-b7c1-1c7f09d05bcf service nova] Lock "cd28be8d-847b-468c-860f-4f479740738d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:50:55 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-a7d32a66-2b48-4bbc-bdf3-86616648a6af req-693c0dad-24ea-4aa5-b7c1-1c7f09d05bcf service nova] Lock "cd28be8d-847b-468c-860f-4f479740738d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:50:55 user nova-compute[74190]: DEBUG nova.compute.manager [req-a7d32a66-2b48-4bbc-bdf3-86616648a6af req-693c0dad-24ea-4aa5-b7c1-1c7f09d05bcf service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] No waiting events found dispatching network-vif-plugged-35f010df-56fb-4234-879b-19f86f36a2d3 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:50:55 user nova-compute[74190]: WARNING nova.compute.manager [req-a7d32a66-2b48-4bbc-bdf3-86616648a6af req-693c0dad-24ea-4aa5-b7c1-1c7f09d05bcf service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Received unexpected event network-vif-plugged-35f010df-56fb-4234-879b-19f86f36a2d3 for instance with vm_state building and task_state spawning.
Oct 18 11:50:55 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-6db53e46-be0a-4f09-af3e-f21a637a4a24 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.571s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:50:55 user nova-compute[74190]: INFO nova.scheduler.client.report [None req-6db53e46-be0a-4f09-af3e-f21a637a4a24 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Deleted allocations for instance 52d7b8e5-02cc-4148-86e2-ceb295e81afc
Oct 18 11:50:56 user nova-compute[74190]: DEBUG nova.compute.manager [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] [instance: cd28be8d-847b-468c-860f-4f479740738d] Instance event wait completed in 0 seconds for  {{(pid=74190) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 11:50:56 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] [instance: cd28be8d-847b-468c-860f-4f479740738d] Guest created on hypervisor {{(pid=74190) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 11:50:56 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0209c824-88a7-4976-83bf-8a72437f0cc2/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:56 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-6db53e46-be0a-4f09-af3e-f21a637a4a24 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lock "52d7b8e5-02cc-4148-86e2-ceb295e81afc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.838s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:50:56 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0209c824-88a7-4976-83bf-8a72437f0cc2/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:56 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: cd28be8d-847b-468c-860f-4f479740738d] Instance spawned successfully.
Oct 18 11:50:56 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] [instance: cd28be8d-847b-468c-860f-4f479740738d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 11:50:56 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] [instance: cd28be8d-847b-468c-860f-4f479740738d] Found default for hw_cdrom_bus of ide {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:50:56 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] [instance: cd28be8d-847b-468c-860f-4f479740738d] Found default for hw_disk_bus of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:50:56 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] [instance: cd28be8d-847b-468c-860f-4f479740738d] Found default for hw_input_bus of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:50:56 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] [instance: cd28be8d-847b-468c-860f-4f479740738d] Found default for hw_pointer_model of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:50:56 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] [instance: cd28be8d-847b-468c-860f-4f479740738d] Found default for hw_video_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:50:56 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] [instance: cd28be8d-847b-468c-860f-4f479740738d] Found default for hw_vif_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:50:56 user nova-compute[74190]: INFO nova.compute.manager [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] [instance: cd28be8d-847b-468c-860f-4f479740738d] Took 13.89 seconds to spawn the instance on the hypervisor.
Oct 18 11:50:56 user nova-compute[74190]: DEBUG nova.compute.manager [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] [instance: cd28be8d-847b-468c-860f-4f479740738d] Checking state {{(pid=74190) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 11:50:56 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0209c824-88a7-4976-83bf-8a72437f0cc2/disk --force-share --output=json" returned: 0 in 0.276s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:56 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c11bc6b-303f-427e-a5d4-993acd74bb27/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:56 user nova-compute[74190]: INFO nova.compute.manager [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] [instance: cd28be8d-847b-468c-860f-4f479740738d] Took 80.06 seconds to build instance.
Oct 18 11:50:56 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-3513314e-fd1a-46a3-8e36-f9f09ee04548 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Lock "cd28be8d-847b-468c-860f-4f479740738d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 80.157s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:50:56 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c11bc6b-303f-427e-a5d4-993acd74bb27/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:56 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c11bc6b-303f-427e-a5d4-993acd74bb27/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:56 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c11bc6b-303f-427e-a5d4-993acd74bb27/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:56 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c280652c-ffde-40f8-a919-adb8be618db8/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:56 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c280652c-ffde-40f8-a919-adb8be618db8/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:56 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c280652c-ffde-40f8-a919-adb8be618db8/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:57 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c280652c-ffde-40f8-a919-adb8be618db8/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:57 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:57 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:57 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:57 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:57 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 11:50:57 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 11:50:57 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 11:50:57 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdfe420d-f46c-44ad-8773-b675f42e24ed/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:57 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdfe420d-f46c-44ad-8773-b675f42e24ed/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:57 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdfe420d-f46c-44ad-8773-b675f42e24ed/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:57 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:57 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdfe420d-f46c-44ad-8773-b675f42e24ed/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:57 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 11:50:58 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:50:58 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:50:58 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Hypervisor/Node resource view: name=user free_ram=7933MB free_disk=25.453716278076172GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74190) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 11:50:58 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:50:58 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:50:58 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Applying migration context for instance bdfe420d-f46c-44ad-8773-b675f42e24ed as it has an incoming, in-progress migration 794d7f84-f831-4a34-a773-e9b869d038ae. Migration status is finished {{(pid=74190) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 18 11:50:58 user nova-compute[74190]: INFO nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Updating resource usage from migration 794d7f84-f831-4a34-a773-e9b869d038ae
Oct 18 11:50:58 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance c280652c-ffde-40f8-a919-adb8be618db8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:50:58 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 0209c824-88a7-4976-83bf-8a72437f0cc2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:50:58 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 4e916d24-9f9d-4289-87ce-f65d2499fcd9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:50:58 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 0c11bc6b-303f-427e-a5d4-993acd74bb27 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:50:58 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance cd28be8d-847b-468c-860f-4f479740738d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:50:58 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance d0e52e79-ce1e-4a77-a189-b0b837165e68 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:50:58 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Migration 794d7f84-f831-4a34-a773-e9b869d038ae is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 18 11:50:58 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance bdfe420d-f46c-44ad-8773-b675f42e24ed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:50:58 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 11:50:58 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=26GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 11:50:59 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 11:50:59 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 11:50:59 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Compute_service record updated for user:user {{(pid=74190) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 11:50:59 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.575s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:50:59 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9b1da64e-bb4f-43a2-8c7e-df61e0046424 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Acquiring lock "0c11bc6b-303f-427e-a5d4-993acd74bb27" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:50:59 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9b1da64e-bb4f-43a2-8c7e-df61e0046424 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Lock "0c11bc6b-303f-427e-a5d4-993acd74bb27" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:50:59 user nova-compute[74190]: DEBUG nova.objects.instance [None req-9b1da64e-bb4f-43a2-8c7e-df61e0046424 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Lazy-loading 'flavor' on Instance uuid 0c11bc6b-303f-427e-a5d4-993acd74bb27 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:50:59 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9b1da64e-bb4f-43a2-8c7e-df61e0046424 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Lock "0c11bc6b-303f-427e-a5d4-993acd74bb27" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.084s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:50:59 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:50:59 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9b1da64e-bb4f-43a2-8c7e-df61e0046424 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Acquiring lock "0c11bc6b-303f-427e-a5d4-993acd74bb27" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:50:59 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9b1da64e-bb4f-43a2-8c7e-df61e0046424 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Lock "0c11bc6b-303f-427e-a5d4-993acd74bb27" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:50:59 user nova-compute[74190]: INFO nova.compute.manager [None req-9b1da64e-bb4f-43a2-8c7e-df61e0046424 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] [instance: 0c11bc6b-303f-427e-a5d4-993acd74bb27] Attaching volume 33c85b60-bfe0-442e-a0f6-8aaceb02d090 to /dev/vdb
Oct 18 11:50:59 user nova-compute[74190]: DEBUG os_brick.utils [None req-9b1da64e-bb4f-43a2-8c7e-df61e0046424 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:50:59 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:59 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:59 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3422b6d-b828-4f58-a676-a0cab3582561]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cff158e257e1\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:59 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:59 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:59 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bbe3636-9ecb-43b7-86a6-05bf493f415e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:59 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:59 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:50:59 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[e125a460-9d9e-4bc3-a0fa-a954b29bb20a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:59 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d75b59-0c0c-4633-823b-f9f9ed81be3b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:59 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-9b1da64e-bb4f-43a2-8c7e-df61e0046424 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Running cmd (subprocess): nvme version {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:59 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-9b1da64e-bb4f-43a2-8c7e-df61e0046424 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] 'nvme version' failed. Not Retrying. {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 11:50:59 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9b1da64e-bb4f-43a2-8c7e-df61e0046424 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] nvme not present on system {{(pid=74190) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 11:50:59 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:50:59 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 11:50:59 user nova-compute[74190]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 11:50:59 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[a12ac9ea-7295-4f3f-b4c4-d0c96077f617]: (4, '') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:50:59 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-9b1da64e-bb4f-43a2-8c7e-df61e0046424 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74190) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 11:50:59 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-9b1da64e-bb4f-43a2-8c7e-df61e0046424 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 11:50:59 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-9b1da64e-bb4f-43a2-8c7e-df61e0046424 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] LIGHTOS: no hostnqn found. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 11:50:59 user nova-compute[74190]: DEBUG os_brick.utils [None req-9b1da64e-bb4f-43a2-8c7e-df61e0046424 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cff158e257e1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:50:59 user nova-compute[74190]: DEBUG nova.virt.block_device [None req-9b1da64e-bb4f-43a2-8c7e-df61e0046424 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] [instance: 0c11bc6b-303f-427e-a5d4-993acd74bb27] Updating existing volume attachment record: 0869e878-24a6-4e07-9d31-dc8c921da762 {{(pid=74190) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 11:51:00 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:51:00 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:51:00 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:51:00 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Starting heal instance info cache {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 11:51:00 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "refresh_cache-bdfe420d-f46c-44ad-8773-b675f42e24ed" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:51:00 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquired lock "refresh_cache-bdfe420d-f46c-44ad-8773-b675f42e24ed" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:51:00 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Forcefully refreshing network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 18 11:51:00 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Updating instance_info_cache with network_info: [{"id": "5f5b65f1-7748-4422-8b45-e1b88476716d", "address": "fa:16:3e:cb:ff:0f", "network": {"id": "7be8675d-326a-4184-9b3e-fbaa02a4e1fc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-468552750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce179d9f22684865b577bd91bc841400", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5b65f1-77", "ovs_interfaceid": "5f5b65f1-7748-4422-8b45-e1b88476716d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:51:00 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Releasing lock "refresh_cache-bdfe420d-f46c-44ad-8773-b675f42e24ed" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:51:00 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Updated the network info_cache for instance {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 18 11:51:00 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:51:00 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:51:01 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:51:02 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:51:07 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:51:09 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:51:12 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:51:14 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:51:17 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:51:18 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b1da64e-bb4f-43a2-8c7e-df61e0046424 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] [instance: 0c11bc6b-303f-427e-a5d4-993acd74bb27] Calling os-brick to attach iSCSI Volume {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 11:51:18 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b1da64e-bb4f-43a2-8c7e-df61e0046424 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:33c85b60-bfe0-442e-a0f6-8aaceb02d090', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nOGacxRD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:51:18 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-9b1da64e-bb4f-43a2-8c7e-df61e0046424 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:51:18 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-9b1da64e-bb4f-43a2-8c7e-df61e0046424 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:51:18 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-9b1da64e-bb4f-43a2-8c7e-df61e0046424 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:51:18 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-9b1da64e-bb4f-43a2-8c7e-df61e0046424 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:51:18 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-9b1da64e-bb4f-43a2-8c7e-df61e0046424 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33c85b60-bfe0-442e-a0f6-8aaceb02d090" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:51:18 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-9b1da64e-bb4f-43a2-8c7e-df61e0046424 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33c85b60-bfe0-442e-a0f6-8aaceb02d090" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:51:18 user nova-compute[74190]: INFO os_brick.initiator.connectors.iscsi [None req-9b1da64e-bb4f-43a2-8c7e-df61e0046424 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 11:51:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33c85b60-bfe0-442e-a0f6-8aaceb02d090 -p 172.16.0.220:3260 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:51:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33c85b60-bfe0-442e-a0f6-8aaceb02d090 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:51:18 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[291efce0-68ba-447c-8c34-d4ffa9727d7e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:51:18 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b1da64e-bb4f-43a2-8c7e-df61e0046424 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 11:51:18 user nova-compute[74190]:  {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:51:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33c85b60-bfe0-442e-a0f6-8aaceb02d090 -p 172.16.0.220:3260 --interface default --op new {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:51:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33c85b60-bfe0-442e-a0f6-8aaceb02d090 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:51:18 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce2608ee-9bc5-4ea1-b245-28fe77b52d0b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:33c85b60-bfe0-442e-a0f6-8aaceb02d090] added\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:51:18 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b1da64e-bb4f-43a2-8c7e-df61e0046424 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:33c85b60-bfe0-442e-a0f6-8aaceb02d090] added
Oct 18 11:51:18 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:51:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33c85b60-bfe0-442e-a0f6-8aaceb02d090 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:51:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33c85b60-bfe0-442e-a0f6-8aaceb02d090 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:51:18 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[131d65de-1945-49e3-85f5-aa3fb50e515d]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:51:18 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b1da64e-bb4f-43a2-8c7e-df61e0046424 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:51:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33c85b60-bfe0-442e-a0f6-8aaceb02d090 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:51:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33c85b60-bfe0-442e-a0f6-8aaceb02d090 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:51:18 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a30d78-b442-4388-8de1-692b518c0794]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:51:18 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b1da64e-bb4f-43a2-8c7e-df61e0046424 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:51:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33c85b60-bfe0-442e-a0f6-8aaceb02d090 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nOGacxRD {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:51:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33c85b60-bfe0-442e-a0f6-8aaceb02d090 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nOGacxRD" returned: 0 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:51:18 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b04cc0c-bdf7-4ee5-afee-c0ad847b761e]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:51:18 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b1da64e-bb4f-43a2-8c7e-df61e0046424 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nOGacxRD'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:51:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33c85b60-bfe0-442e-a0f6-8aaceb02d090 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:51:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33c85b60-bfe0-442e-a0f6-8aaceb02d090 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:51:18 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[913f15c1-f44b-49e6-b8e6-a9240ddd29eb]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:51:18 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b1da64e-bb4f-43a2-8c7e-df61e0046424 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:51:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:51:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:51:18 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[8337b05e-77e9-44bb-9ad5-77876d6bf54e]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:011ac309-ad42-43cc-ab45-e09e022b6e56 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17a1c8f7-ad7d-4b2a-863f-561e1c18768a (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:51:18 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b1da64e-bb4f-43a2-8c7e-df61e0046424 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a (non-flash)
Oct 18 11:51:18 user nova-compute[74190]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 (non-flash)
Oct 18 11:51:18 user nova-compute[74190]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:011ac309-ad42-43cc-ab45-e09e022b6e56 (non-flash)
Oct 18 11:51:18 user nova-compute[74190]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17a1c8f7-ad7d-4b2a-863f-561e1c18768a (non-flash)
Oct 18 11:51:18 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:51:18 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b1da64e-bb4f-43a2-8c7e-df61e0046424 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a (non-flash)
Oct 18 11:51:18 user nova-compute[74190]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 (non-flash)
Oct 18 11:51:18 user nova-compute[74190]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:011ac309-ad42-43cc-ab45-e09e022b6e56 (non-flash)
Oct 18 11:51:18 user nova-compute[74190]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17a1c8f7-ad7d-4b2a-863f-561e1c18768a (non-flash)
Oct 18 11:51:18 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:51:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33c85b60-bfe0-442e-a0f6-8aaceb02d090 -p 172.16.0.220:3260 --login {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:51:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33c85b60-bfe0-442e-a0f6-8aaceb02d090 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:51:18 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e4fe8a5-738a-4aa5-b499-f250420d8f63]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:33c85b60-bfe0-442e-a0f6-8aaceb02d090, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:33c85b60-bfe0-442e-a0f6-8aaceb02d090, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:51:18 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b1da64e-bb4f-43a2-8c7e-df61e0046424 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:33c85b60-bfe0-442e-a0f6-8aaceb02d090, portal: 172.16.0.220,3260]
Oct 18 11:51:18 user nova-compute[74190]: Login to [iface: default, target: iqn.2010-10.org.openstack:33c85b60-bfe0-442e-a0f6-8aaceb02d090, portal: 172.16.0.220,3260] successful.
Oct 18 11:51:18 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:51:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33c85b60-bfe0-442e-a0f6-8aaceb02d090 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:51:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33c85b60-bfe0-442e-a0f6-8aaceb02d090 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:51:18 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f2d833-b4b3-4719-8208-af80a9cb12b0]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:51:18 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b1da64e-bb4f-43a2-8c7e-df61e0046424 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:51:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:51:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:51:18 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[9264d029-7f62-4369-9847-3a37dc7e3c77]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:011ac309-ad42-43cc-ab45-e09e022b6e56 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17a1c8f7-ad7d-4b2a-863f-561e1c18768a (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33c85b60-bfe0-442e-a0f6-8aaceb02d090 (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:51:18 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b1da64e-bb4f-43a2-8c7e-df61e0046424 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a (non-flash)
Oct 18 11:51:18 user nova-compute[74190]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 (non-flash)
Oct 18 11:51:18 user nova-compute[74190]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:011ac309-ad42-43cc-ab45-e09e022b6e56 (non-flash)
Oct 18 11:51:18 user nova-compute[74190]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17a1c8f7-ad7d-4b2a-863f-561e1c18768a (non-flash)
Oct 18 11:51:18 user nova-compute[74190]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33c85b60-bfe0-442e-a0f6-8aaceb02d090 (non-flash)
Oct 18 11:51:18 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:51:18 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b1da64e-bb4f-43a2-8c7e-df61e0046424 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a (non-flash)
Oct 18 11:51:18 user nova-compute[74190]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 (non-flash)
Oct 18 11:51:18 user nova-compute[74190]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:011ac309-ad42-43cc-ab45-e09e022b6e56 (non-flash)
Oct 18 11:51:18 user nova-compute[74190]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17a1c8f7-ad7d-4b2a-863f-561e1c18768a (non-flash)
Oct 18 11:51:18 user nova-compute[74190]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33c85b60-bfe0-442e-a0f6-8aaceb02d090 (non-flash)
Oct 18 11:51:18 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:51:18 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-9b1da64e-bb4f-43a2-8c7e-df61e0046424 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33c85b60-bfe0-442e-a0f6-8aaceb02d090" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:51:18 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b1da64e-bb4f-43a2-8c7e-df61e0046424 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Connected to 172.16.0.220:3260 {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 11:51:18 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-9b1da64e-bb4f-43a2-8c7e-df61e0046424 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] HCTL ('37', '-', '-', 0) found on session 26 with lun 0 {{(pid=74190) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 11:51:18 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-9b1da64e-bb4f-43a2-8c7e-df61e0046424 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74190) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 11:51:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:51:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:51:18 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[4415574b-62c2-40f5-bf1f-496b9f2d9ff9]: (4, ('- - 0', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:51:18 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-9b1da64e-bb4f-43a2-8c7e-df61e0046424 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Searching for a device in session 26 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74190) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 11:51:18 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b1da64e-bb4f-43a2-8c7e-df61e0046424 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:33c85b60-bfe0-442e-a0f6-8aaceb02d090', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nOGacxRD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 11:51:19 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:51:19 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-9b1da64e-bb4f-43a2-8c7e-df61e0046424 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:51:19 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b1da64e-bb4f-43a2-8c7e-df61e0046424 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] <== connect_volume: return (1357ms) {'type': 'block', 'scsi_wwn': '23930326235636635', 'path': '/dev/sdf'} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:51:19 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b1da64e-bb4f-43a2-8c7e-df61e0046424 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] [instance: 0c11bc6b-303f-427e-a5d4-993acd74bb27] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23930326235636635', 'path': '/dev/sdf'} {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 11:51:19 user nova-compute[74190]: DEBUG nova.objects.instance [None req-9b1da64e-bb4f-43a2-8c7e-df61e0046424 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Lazy-loading 'flavor' on Instance uuid 0c11bc6b-303f-427e-a5d4-993acd74bb27 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:51:19 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-9b1da64e-bb4f-43a2-8c7e-df61e0046424 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] attach device xml: <disk type="block" device="disk">
Oct 18 11:51:19 user nova-compute[74190]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 11:51:19 user nova-compute[74190]:   <source dev="/dev/sdf"/>
Oct 18 11:51:19 user nova-compute[74190]:   <target dev="vdb" bus="virtio"/>
Oct 18 11:51:19 user nova-compute[74190]:   <serial>33c85b60-bfe0-442e-a0f6-8aaceb02d090</serial>
Oct 18 11:51:19 user nova-compute[74190]: </disk>
Oct 18 11:51:19 user nova-compute[74190]:  {{(pid=74190) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 18 11:51:20 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-9b1da64e-bb4f-43a2-8c7e-df61e0046424 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] No BDM found with device name vda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 11:51:20 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-9b1da64e-bb4f-43a2-8c7e-df61e0046424 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 11:51:20 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-9b1da64e-bb4f-43a2-8c7e-df61e0046424 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] No VIF found with MAC fa:16:3e:25:67:c0, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 11:51:20 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9b1da64e-bb4f-43a2-8c7e-df61e0046424 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Lock "0c11bc6b-303f-427e-a5d4-993acd74bb27" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.763s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:51:21 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9efc043b-e532-4b90-8c20-25b4521803d3 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Acquiring lock "0c11bc6b-303f-427e-a5d4-993acd74bb27" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:51:21 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9efc043b-e532-4b90-8c20-25b4521803d3 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Lock "0c11bc6b-303f-427e-a5d4-993acd74bb27" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:51:21 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9efc043b-e532-4b90-8c20-25b4521803d3 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Acquiring lock "0c11bc6b-303f-427e-a5d4-993acd74bb27-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:51:21 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9efc043b-e532-4b90-8c20-25b4521803d3 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Lock "0c11bc6b-303f-427e-a5d4-993acd74bb27-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:51:21 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9efc043b-e532-4b90-8c20-25b4521803d3 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Lock "0c11bc6b-303f-427e-a5d4-993acd74bb27-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:51:21 user nova-compute[74190]: INFO nova.compute.manager [None req-9efc043b-e532-4b90-8c20-25b4521803d3 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] [instance: 0c11bc6b-303f-427e-a5d4-993acd74bb27] Terminating instance
Oct 18 11:51:21 user nova-compute[74190]: DEBUG nova.compute.manager [None req-9efc043b-e532-4b90-8c20-25b4521803d3 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] [instance: 0c11bc6b-303f-427e-a5d4-993acd74bb27] Start destroying the instance on the hypervisor. {{(pid=74190) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 11:51:21 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:51:21 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:51:21 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:51:21 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:51:21 user nova-compute[74190]: DEBUG nova.compute.manager [req-780f36a4-9766-4768-9433-21ac8a9f5429 req-1d820bf5-f353-401f-be11-7fd64dc3e4e9 service nova] [instance: 0c11bc6b-303f-427e-a5d4-993acd74bb27] Received event network-vif-unplugged-30366b5a-3e80-4fb4-be78-0fdff62dfcaa {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:51:21 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-780f36a4-9766-4768-9433-21ac8a9f5429 req-1d820bf5-f353-401f-be11-7fd64dc3e4e9 service nova] Acquiring lock "0c11bc6b-303f-427e-a5d4-993acd74bb27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:51:21 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-780f36a4-9766-4768-9433-21ac8a9f5429 req-1d820bf5-f353-401f-be11-7fd64dc3e4e9 service nova] Lock "0c11bc6b-303f-427e-a5d4-993acd74bb27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:51:21 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-780f36a4-9766-4768-9433-21ac8a9f5429 req-1d820bf5-f353-401f-be11-7fd64dc3e4e9 service nova] Lock "0c11bc6b-303f-427e-a5d4-993acd74bb27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:51:21 user nova-compute[74190]: DEBUG nova.compute.manager [req-780f36a4-9766-4768-9433-21ac8a9f5429 req-1d820bf5-f353-401f-be11-7fd64dc3e4e9 service nova] [instance: 0c11bc6b-303f-427e-a5d4-993acd74bb27] No waiting events found dispatching network-vif-unplugged-30366b5a-3e80-4fb4-be78-0fdff62dfcaa {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:51:21 user nova-compute[74190]: DEBUG nova.compute.manager [req-780f36a4-9766-4768-9433-21ac8a9f5429 req-1d820bf5-f353-401f-be11-7fd64dc3e4e9 service nova] [instance: 0c11bc6b-303f-427e-a5d4-993acd74bb27] Received event network-vif-unplugged-30366b5a-3e80-4fb4-be78-0fdff62dfcaa for instance with task_state deleting. {{(pid=74190) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 11:51:22 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 0c11bc6b-303f-427e-a5d4-993acd74bb27] Instance destroyed successfully.
Oct 18 11:51:22 user nova-compute[74190]: DEBUG nova.objects.instance [None req-9efc043b-e532-4b90-8c20-25b4521803d3 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Lazy-loading 'resources' on Instance uuid 0c11bc6b-303f-427e-a5d4-993acd74bb27 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:51:22 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-9efc043b-e532-4b90-8c20-25b4521803d3 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:49:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-2119548194',display_name='tempest-DeleteServersTestJSON-server-2119548194',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-2119548194',id=17,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-18T11:49:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4e7b038b65b84b819175fe34941d4909',ramdisk_id='',reservation_id='r-nrvfuye2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1054813631',owner_user_name='tempest-DeleteServersTestJSON-1054813631-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T11:49:10Z,user_data=None,user_id='d098d8f1d4ad4bfe8b5a4ada891990de',uuid=0c11bc6b-303f-427e-a5d4-993acd74bb27,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "30366b5a-3e80-4fb4-be78-0fdff62dfcaa", "address": "fa:16:3e:25:67:c0", "network": {"id": "aeb25e9d-effa-4ae6-9e7e-61915593bb26", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-539764280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e7b038b65b84b819175fe34941d4909", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30366b5a-3e", "ovs_interfaceid": "30366b5a-3e80-4fb4-be78-0fdff62dfcaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 11:51:22 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-9efc043b-e532-4b90-8c20-25b4521803d3 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Converting VIF {"id": "30366b5a-3e80-4fb4-be78-0fdff62dfcaa", "address": "fa:16:3e:25:67:c0", "network": {"id": "aeb25e9d-effa-4ae6-9e7e-61915593bb26", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-539764280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e7b038b65b84b819175fe34941d4909", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30366b5a-3e", "ovs_interfaceid": "30366b5a-3e80-4fb4-be78-0fdff62dfcaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:51:22 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-9efc043b-e532-4b90-8c20-25b4521803d3 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:67:c0,bridge_name='br-int',has_traffic_filtering=True,id=30366b5a-3e80-4fb4-be78-0fdff62dfcaa,network=Network(aeb25e9d-effa-4ae6-9e7e-61915593bb26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30366b5a-3e') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:51:22 user nova-compute[74190]: DEBUG os_vif [None req-9efc043b-e532-4b90-8c20-25b4521803d3 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:67:c0,bridge_name='br-int',has_traffic_filtering=True,id=30366b5a-3e80-4fb4-be78-0fdff62dfcaa,network=Network(aeb25e9d-effa-4ae6-9e7e-61915593bb26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30366b5a-3e') {{(pid=74190) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 11:51:22 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:51:22 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap30366b5a-3e, bridge=br-int, if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:51:22 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:51:22 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:51:22 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:51:22 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d40832fe-43cb-4f80-afa1-0e3c0bc3c099) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:51:22 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:51:22 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:51:22 user nova-compute[74190]: INFO os_vif [None req-9efc043b-e532-4b90-8c20-25b4521803d3 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:67:c0,bridge_name='br-int',has_traffic_filtering=True,id=30366b5a-3e80-4fb4-be78-0fdff62dfcaa,network=Network(aeb25e9d-effa-4ae6-9e7e-61915593bb26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30366b5a-3e')
Oct 18 11:51:22 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9efc043b-e532-4b90-8c20-25b4521803d3 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] [instance: 0c11bc6b-303f-427e-a5d4-993acd74bb27] calling os-brick to detach iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 11:51:22 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-9efc043b-e532-4b90-8c20-25b4521803d3 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, {'target_iqn': 'iqn.2010-10.org.openstack:33c85b60-bfe0-442e-a0f6-8aaceb02d090', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nOGacxRD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:51:22 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-9efc043b-e532-4b90-8c20-25b4521803d3 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:51:22 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-9efc043b-e532-4b90-8c20-25b4521803d3 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:51:22 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-9efc043b-e532-4b90-8c20-25b4521803d3 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:51:22 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:51:22 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:51:22 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9dd887d-8af0-4c2c-b403-53f77eb24dc2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:33c85b60-bfe0-442e-a0f6-8aaceb02d090\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:011ac309-ad42-43cc-ab45-e09e022b6e56\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:17a1c8f7-ad7d-4b2a-863f-561e1c18768a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:51:22 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-9efc043b-e532-4b90-8c20-25b4521803d3 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 11:51:22 user nova-compute[74190]: No targets found.
Oct 18 11:51:22 user nova-compute[74190]: iSNS:
Oct 18 11:51:22 user nova-compute[74190]: No targets found.
Oct 18 11:51:22 user nova-compute[74190]: STATIC:
Oct 18 11:51:22 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a
Oct 18 11:51:22 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:51:22 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:51:22 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:33c85b60-bfe0-442e-a0f6-8aaceb02d090
Oct 18 11:51:22 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:51:22 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:51:22 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:011ac309-ad42-43cc-ab45-e09e022b6e56
Oct 18 11:51:22 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:51:22 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:51:22 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:17a1c8f7-ad7d-4b2a-863f-561e1c18768a
Oct 18 11:51:22 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:51:22 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:51:22 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71
Oct 18 11:51:22 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:51:22 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:51:22 user nova-compute[74190]: FIRMWARE:
Oct 18 11:51:22 user nova-compute[74190]: No targets found.
Oct 18 11:51:22 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:51:22 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-9efc043b-e532-4b90-8c20-25b4521803d3 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 11:51:22 user nova-compute[74190]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 11:51:22 user nova-compute[74190]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74190) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 11:51:22 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-9efc043b-e532-4b90-8c20-25b4521803d3 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33c85b60-bfe0-442e-a0f6-8aaceb02d090', 0)] {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 11:51:22 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:51:22 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:51:22 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec58fa43-7b05-413d-9dc4-8d17881aa8c4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:011ac309-ad42-43cc-ab45-e09e022b6e56\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17a1c8f7-ad7d-4b2a-863f-561e1c18768a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33c85b60-bfe0-442e-a0f6-8aaceb02d090\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:51:22 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:51:22 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:51:22 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a4a4461-eaea-4b83-a993-f830b3f2c40f]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:011ac309-ad42-43cc-ab45-e09e022b6e56 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17a1c8f7-ad7d-4b2a-863f-561e1c18768a (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33c85b60-bfe0-442e-a0f6-8aaceb02d090 (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:51:22 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-9efc043b-e532-4b90-8c20-25b4521803d3 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a (non-flash)
Oct 18 11:51:22 user nova-compute[74190]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 (non-flash)
Oct 18 11:51:22 user nova-compute[74190]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:011ac309-ad42-43cc-ab45-e09e022b6e56 (non-flash)
Oct 18 11:51:22 user nova-compute[74190]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17a1c8f7-ad7d-4b2a-863f-561e1c18768a (non-flash)
Oct 18 11:51:22 user nova-compute[74190]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33c85b60-bfe0-442e-a0f6-8aaceb02d090 (non-flash)
Oct 18 11:51:22 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:51:22 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-9efc043b-e532-4b90-8c20-25b4521803d3 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a (non-flash)
Oct 18 11:51:22 user nova-compute[74190]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 (non-flash)
Oct 18 11:51:22 user nova-compute[74190]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:011ac309-ad42-43cc-ab45-e09e022b6e56 (non-flash)
Oct 18 11:51:22 user nova-compute[74190]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17a1c8f7-ad7d-4b2a-863f-561e1c18768a (non-flash)
Oct 18 11:51:22 user nova-compute[74190]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33c85b60-bfe0-442e-a0f6-8aaceb02d090 (non-flash)
Oct 18 11:51:22 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:51:22 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-9efc043b-e532-4b90-8c20-25b4521803d3 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1f247630a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33c85b60-bfe0-442e-a0f6-8aaceb02d090'): ({'sdf'}, set())}) {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 11:51:22 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-9efc043b-e532-4b90-8c20-25b4521803d3 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Removing single pathed devices sdf {{(pid=74190) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 11:51:22 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:51:22 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:51:22 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[55dda891-19cc-4861-8136-77445ea9f630]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:51:22 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:51:22 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:51:22 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf5912d4-3ea4-485f-8077-111f17ff3439]: (4, ('ok\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:51:22 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-9efc043b-e532-4b90-8c20-25b4521803d3 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Flushing IO for device /dev/sdf {{(pid=74190) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 11:51:22 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:51:22 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:51:22 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b700623-86e6-4868-9f7f-b3e7a4258793]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:51:22 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-9efc043b-e532-4b90-8c20-25b4521803d3 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74190) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 11:51:22 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:51:22 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.042s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:51:22 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e3a05da-dac6-45d1-9d7c-8d9ed86af128]: (4, ('1', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:51:22 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-9efc043b-e532-4b90-8c20-25b4521803d3 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 11:51:22 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-9efc043b-e532-4b90-8c20-25b4521803d3 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] SCSI volumes sdf have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 11:51:22 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-9efc043b-e532-4b90-8c20-25b4521803d3 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33c85b60-bfe0-442e-a0f6-8aaceb02d090')] {{(pid=74190) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 11:51:22 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33c85b60-bfe0-442e-a0f6-8aaceb02d090 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:51:22 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33c85b60-bfe0-442e-a0f6-8aaceb02d090 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:51:22 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad1ad1e-54cb-491b-b96a-3e8490351022]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:51:22 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-9efc043b-e532-4b90-8c20-25b4521803d3 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:51:22 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33c85b60-bfe0-442e-a0f6-8aaceb02d090 -p 172.16.0.220:3260 --logout {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:51:22 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33c85b60-bfe0-442e-a0f6-8aaceb02d090 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:51:22 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c90896-97a7-49a4-aa68-6cad9ed912e6]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:33c85b60-bfe0-442e-a0f6-8aaceb02d090, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:33c85b60-bfe0-442e-a0f6-8aaceb02d090, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:51:22 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-9efc043b-e532-4b90-8c20-25b4521803d3 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:33c85b60-bfe0-442e-a0f6-8aaceb02d090, portal: 172.16.0.220,3260]
Oct 18 11:51:22 user nova-compute[74190]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:33c85b60-bfe0-442e-a0f6-8aaceb02d090, portal: 172.16.0.220,3260] successful.
Oct 18 11:51:22 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:51:22 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33c85b60-bfe0-442e-a0f6-8aaceb02d090 -p 172.16.0.220:3260 --op delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:51:22 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33c85b60-bfe0-442e-a0f6-8aaceb02d090 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:51:22 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[610fe162-1e11-4693-829b-6c3cefc63584]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:51:22 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-9efc043b-e532-4b90-8c20-25b4521803d3 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:51:22 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-9efc043b-e532-4b90-8c20-25b4521803d3 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:51:22 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-9efc043b-e532-4b90-8c20-25b4521803d3 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] <== disconnect_volume: return (324ms) None {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:51:22 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9efc043b-e532-4b90-8c20-25b4521803d3 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] [instance: 0c11bc6b-303f-427e-a5d4-993acd74bb27] Disconnected iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 11:51:22 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-9efc043b-e532-4b90-8c20-25b4521803d3 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] [instance: 0c11bc6b-303f-427e-a5d4-993acd74bb27] Deleting instance files /opt/stack/data/nova/instances/0c11bc6b-303f-427e-a5d4-993acd74bb27_del
Oct 18 11:51:22 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-9efc043b-e532-4b90-8c20-25b4521803d3 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] [instance: 0c11bc6b-303f-427e-a5d4-993acd74bb27] Deletion of /opt/stack/data/nova/instances/0c11bc6b-303f-427e-a5d4-993acd74bb27_del complete
Oct 18 11:51:22 user nova-compute[74190]: INFO nova.compute.manager [None req-9efc043b-e532-4b90-8c20-25b4521803d3 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] [instance: 0c11bc6b-303f-427e-a5d4-993acd74bb27] Took 1.21 seconds to destroy the instance on the hypervisor.
Oct 18 11:51:22 user nova-compute[74190]: DEBUG oslo.service.loopingcall [None req-9efc043b-e532-4b90-8c20-25b4521803d3 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74190) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 11:51:22 user nova-compute[74190]: DEBUG nova.compute.manager [-] [instance: 0c11bc6b-303f-427e-a5d4-993acd74bb27] Deallocating network for instance {{(pid=74190) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 11:51:22 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: 0c11bc6b-303f-427e-a5d4-993acd74bb27] deallocate_for_instance() {{(pid=74190) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 11:51:22 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: 0c11bc6b-303f-427e-a5d4-993acd74bb27] Updating instance_info_cache with network_info: [] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:51:22 user nova-compute[74190]: INFO nova.compute.manager [-] [instance: 0c11bc6b-303f-427e-a5d4-993acd74bb27] Took 0.48 seconds to deallocate network for instance.
Oct 18 11:51:23 user nova-compute[74190]: DEBUG nova.compute.manager [req-25f1420a-111c-42f6-a413-9e1d30ab9886 req-2b46a98d-e46d-40d1-9a3a-415f1da0837c service nova] [instance: 0c11bc6b-303f-427e-a5d4-993acd74bb27] Received event network-vif-plugged-30366b5a-3e80-4fb4-be78-0fdff62dfcaa {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:51:23 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-25f1420a-111c-42f6-a413-9e1d30ab9886 req-2b46a98d-e46d-40d1-9a3a-415f1da0837c service nova] Acquiring lock "0c11bc6b-303f-427e-a5d4-993acd74bb27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:51:23 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-25f1420a-111c-42f6-a413-9e1d30ab9886 req-2b46a98d-e46d-40d1-9a3a-415f1da0837c service nova] Lock "0c11bc6b-303f-427e-a5d4-993acd74bb27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:51:23 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-25f1420a-111c-42f6-a413-9e1d30ab9886 req-2b46a98d-e46d-40d1-9a3a-415f1da0837c service nova] Lock "0c11bc6b-303f-427e-a5d4-993acd74bb27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:51:23 user nova-compute[74190]: DEBUG nova.compute.manager [req-25f1420a-111c-42f6-a413-9e1d30ab9886 req-2b46a98d-e46d-40d1-9a3a-415f1da0837c service nova] [instance: 0c11bc6b-303f-427e-a5d4-993acd74bb27] No waiting events found dispatching network-vif-plugged-30366b5a-3e80-4fb4-be78-0fdff62dfcaa {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:51:23 user nova-compute[74190]: WARNING nova.compute.manager [req-25f1420a-111c-42f6-a413-9e1d30ab9886 req-2b46a98d-e46d-40d1-9a3a-415f1da0837c service nova] [instance: 0c11bc6b-303f-427e-a5d4-993acd74bb27] Received unexpected event network-vif-plugged-30366b5a-3e80-4fb4-be78-0fdff62dfcaa for instance with vm_state active and task_state deleting.
Oct 18 11:51:23 user nova-compute[74190]: DEBUG nova.compute.manager [req-25f1420a-111c-42f6-a413-9e1d30ab9886 req-2b46a98d-e46d-40d1-9a3a-415f1da0837c service nova] [instance: 0c11bc6b-303f-427e-a5d4-993acd74bb27] Received event network-vif-deleted-30366b5a-3e80-4fb4-be78-0fdff62dfcaa {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:51:23 user nova-compute[74190]: INFO nova.compute.manager [None req-9efc043b-e532-4b90-8c20-25b4521803d3 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] [instance: 0c11bc6b-303f-427e-a5d4-993acd74bb27] Took 0.87 seconds to detach 1 volumes for instance.
Oct 18 11:51:23 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9efc043b-e532-4b90-8c20-25b4521803d3 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:51:23 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9efc043b-e532-4b90-8c20-25b4521803d3 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:51:24 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-9efc043b-e532-4b90-8c20-25b4521803d3 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 11:51:24 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-9efc043b-e532-4b90-8c20-25b4521803d3 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 11:51:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9efc043b-e532-4b90-8c20-25b4521803d3 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.279s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:51:24 user nova-compute[74190]: INFO nova.scheduler.client.report [None req-9efc043b-e532-4b90-8c20-25b4521803d3 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Deleted allocations for instance 0c11bc6b-303f-427e-a5d4-993acd74bb27
Oct 18 11:51:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9efc043b-e532-4b90-8c20-25b4521803d3 tempest-DeleteServersTestJSON-1054813631 tempest-DeleteServersTestJSON-1054813631-project-member] Lock "0c11bc6b-303f-427e-a5d4-993acd74bb27" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.058s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:51:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:51:25 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:51:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:51:27 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-e77e69e8-86a5-41c7-81fb-db4697e8d281 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Acquiring lock "c280652c-ffde-40f8-a919-adb8be618db8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:51:27 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-e77e69e8-86a5-41c7-81fb-db4697e8d281 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lock "c280652c-ffde-40f8-a919-adb8be618db8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:51:27 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-e77e69e8-86a5-41c7-81fb-db4697e8d281 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Acquiring lock "c280652c-ffde-40f8-a919-adb8be618db8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:51:27 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-e77e69e8-86a5-41c7-81fb-db4697e8d281 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lock "c280652c-ffde-40f8-a919-adb8be618db8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:51:27 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-e77e69e8-86a5-41c7-81fb-db4697e8d281 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lock "c280652c-ffde-40f8-a919-adb8be618db8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:51:27 user nova-compute[74190]: INFO nova.compute.manager [None req-e77e69e8-86a5-41c7-81fb-db4697e8d281 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Terminating instance
Oct 18 11:51:27 user nova-compute[74190]: DEBUG nova.compute.manager [None req-e77e69e8-86a5-41c7-81fb-db4697e8d281 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Start destroying the instance on the hypervisor. {{(pid=74190) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 11:51:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:51:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:51:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:51:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:51:27 user nova-compute[74190]: DEBUG nova.compute.manager [req-b0f58108-00f9-458b-8124-01e85d904606 req-6dc1df8b-0038-4316-8190-2dca6b5fe80e service nova] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Received event network-vif-unplugged-80b77e2d-aa04-4996-a0c1-713054affac4 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:51:27 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-b0f58108-00f9-458b-8124-01e85d904606 req-6dc1df8b-0038-4316-8190-2dca6b5fe80e service nova] Acquiring lock "c280652c-ffde-40f8-a919-adb8be618db8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:51:27 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-b0f58108-00f9-458b-8124-01e85d904606 req-6dc1df8b-0038-4316-8190-2dca6b5fe80e service nova] Lock "c280652c-ffde-40f8-a919-adb8be618db8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:51:27 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-b0f58108-00f9-458b-8124-01e85d904606 req-6dc1df8b-0038-4316-8190-2dca6b5fe80e service nova] Lock "c280652c-ffde-40f8-a919-adb8be618db8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:51:27 user nova-compute[74190]: DEBUG nova.compute.manager [req-b0f58108-00f9-458b-8124-01e85d904606 req-6dc1df8b-0038-4316-8190-2dca6b5fe80e service nova] [instance: c280652c-ffde-40f8-a919-adb8be618db8] No waiting events found dispatching network-vif-unplugged-80b77e2d-aa04-4996-a0c1-713054affac4 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:51:27 user nova-compute[74190]: DEBUG nova.compute.manager [req-b0f58108-00f9-458b-8124-01e85d904606 req-6dc1df8b-0038-4316-8190-2dca6b5fe80e service nova] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Received event network-vif-unplugged-80b77e2d-aa04-4996-a0c1-713054affac4 for instance with task_state deleting. {{(pid=74190) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 11:51:27 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Instance destroyed successfully.
Oct 18 11:51:27 user nova-compute[74190]: DEBUG nova.objects.instance [None req-e77e69e8-86a5-41c7-81fb-db4697e8d281 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lazy-loading 'resources' on Instance uuid c280652c-ffde-40f8-a919-adb8be618db8 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:51:27 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-e77e69e8-86a5-41c7-81fb-db4697e8d281 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:40:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-711461105',display_name='tempest-AttachVolumeTestJSON-server-711461105',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-711461105',id=1,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPnE2mtL+LbI3yVW2kYaN2Dxz5V1+PIccsOPxNaLovIe8VN7EUmA+C39USstHm9Yifnik7GFCenLhGnFytwIhcv6ox30HzhlwfaoDrZEfYtFLQ2I1/Og7nqCIt/6qIOiKA==',key_name='tempest-keypair-355856933',keypairs=<?>,launch_index=0,launched_at=2023-10-18T11:41:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='99cf8d4d4f504e82868ed295e054644c',ramdisk_id='',reservation_id='r-zf27bcaw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2125017306',owner_user_name='tempest-AttachVolumeTestJSON-2125017306-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T11:49:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='852309a19f1b4d49a4974c3be53f67cb',uuid=c280652c-ffde-40f8-a919-adb8be618db8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "80b77e2d-aa04-4996-a0c1-713054affac4", "address": "fa:16:3e:4f:00:ce", "network": {"id": "cf0a4705-3fff-4716-87ac-b0ca7700e11c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1739631852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cf8d4d4f504e82868ed295e054644c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80b77e2d-aa", "ovs_interfaceid": "80b77e2d-aa04-4996-a0c1-713054affac4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 11:51:27 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-e77e69e8-86a5-41c7-81fb-db4697e8d281 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Converting VIF {"id": "80b77e2d-aa04-4996-a0c1-713054affac4", "address": "fa:16:3e:4f:00:ce", "network": {"id": "cf0a4705-3fff-4716-87ac-b0ca7700e11c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1739631852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cf8d4d4f504e82868ed295e054644c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80b77e2d-aa", "ovs_interfaceid": "80b77e2d-aa04-4996-a0c1-713054affac4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:51:27 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-e77e69e8-86a5-41c7-81fb-db4697e8d281 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:00:ce,bridge_name='br-int',has_traffic_filtering=True,id=80b77e2d-aa04-4996-a0c1-713054affac4,network=Network(cf0a4705-3fff-4716-87ac-b0ca7700e11c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80b77e2d-aa') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:51:27 user nova-compute[74190]: DEBUG os_vif [None req-e77e69e8-86a5-41c7-81fb-db4697e8d281 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:00:ce,bridge_name='br-int',has_traffic_filtering=True,id=80b77e2d-aa04-4996-a0c1-713054affac4,network=Network(cf0a4705-3fff-4716-87ac-b0ca7700e11c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80b77e2d-aa') {{(pid=74190) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 11:51:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:51:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap80b77e2d-aa, bridge=br-int, if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:51:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:51:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:51:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:51:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:51:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a73eced4-d94b-4742-96ef-ed15e581db6d) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:51:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:51:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:51:27 user nova-compute[74190]: INFO os_vif [None req-e77e69e8-86a5-41c7-81fb-db4697e8d281 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:00:ce,bridge_name='br-int',has_traffic_filtering=True,id=80b77e2d-aa04-4996-a0c1-713054affac4,network=Network(cf0a4705-3fff-4716-87ac-b0ca7700e11c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80b77e2d-aa')
Oct 18 11:51:27 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-e77e69e8-86a5-41c7-81fb-db4697e8d281 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Deleting instance files /opt/stack/data/nova/instances/c280652c-ffde-40f8-a919-adb8be618db8_del
Oct 18 11:51:27 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-e77e69e8-86a5-41c7-81fb-db4697e8d281 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Deletion of /opt/stack/data/nova/instances/c280652c-ffde-40f8-a919-adb8be618db8_del complete
Oct 18 11:51:27 user nova-compute[74190]: INFO nova.compute.manager [None req-e77e69e8-86a5-41c7-81fb-db4697e8d281 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Took 0.73 seconds to destroy the instance on the hypervisor.
Oct 18 11:51:27 user nova-compute[74190]: DEBUG oslo.service.loopingcall [None req-e77e69e8-86a5-41c7-81fb-db4697e8d281 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74190) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 11:51:27 user nova-compute[74190]: DEBUG nova.compute.manager [-] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Deallocating network for instance {{(pid=74190) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 11:51:27 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: c280652c-ffde-40f8-a919-adb8be618db8] deallocate_for_instance() {{(pid=74190) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 11:51:28 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Updating instance_info_cache with network_info: [] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:51:28 user nova-compute[74190]: INFO nova.compute.manager [-] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Took 0.82 seconds to deallocate network for instance.
Oct 18 11:51:28 user nova-compute[74190]: DEBUG nova.compute.manager [req-c930449a-365d-4c1d-938c-5227d71bd497 req-a4625ab0-c197-43dd-8950-c8f06900e77e service nova] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Received event network-vif-deleted-80b77e2d-aa04-4996-a0c1-713054affac4 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:51:28 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-e77e69e8-86a5-41c7-81fb-db4697e8d281 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:51:28 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-e77e69e8-86a5-41c7-81fb-db4697e8d281 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:51:29 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-e77e69e8-86a5-41c7-81fb-db4697e8d281 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 11:51:29 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-e77e69e8-86a5-41c7-81fb-db4697e8d281 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 11:51:29 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-e77e69e8-86a5-41c7-81fb-db4697e8d281 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.256s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:51:29 user nova-compute[74190]: INFO nova.scheduler.client.report [None req-e77e69e8-86a5-41c7-81fb-db4697e8d281 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Deleted allocations for instance c280652c-ffde-40f8-a919-adb8be618db8
Oct 18 11:51:29 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-e77e69e8-86a5-41c7-81fb-db4697e8d281 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lock "c280652c-ffde-40f8-a919-adb8be618db8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.279s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:51:29 user nova-compute[74190]: DEBUG nova.compute.manager [req-b9e1be40-53dc-4543-b58b-a70920bfed6d req-4b22c2ca-0925-40aa-8690-1d001f281afa service nova] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Received event network-vif-plugged-80b77e2d-aa04-4996-a0c1-713054affac4 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:51:29 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-b9e1be40-53dc-4543-b58b-a70920bfed6d req-4b22c2ca-0925-40aa-8690-1d001f281afa service nova] Acquiring lock "c280652c-ffde-40f8-a919-adb8be618db8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:51:29 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-b9e1be40-53dc-4543-b58b-a70920bfed6d req-4b22c2ca-0925-40aa-8690-1d001f281afa service nova] Lock "c280652c-ffde-40f8-a919-adb8be618db8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:51:29 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-b9e1be40-53dc-4543-b58b-a70920bfed6d req-4b22c2ca-0925-40aa-8690-1d001f281afa service nova] Lock "c280652c-ffde-40f8-a919-adb8be618db8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:51:29 user nova-compute[74190]: DEBUG nova.compute.manager [req-b9e1be40-53dc-4543-b58b-a70920bfed6d req-4b22c2ca-0925-40aa-8690-1d001f281afa service nova] [instance: c280652c-ffde-40f8-a919-adb8be618db8] No waiting events found dispatching network-vif-plugged-80b77e2d-aa04-4996-a0c1-713054affac4 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:51:29 user nova-compute[74190]: WARNING nova.compute.manager [req-b9e1be40-53dc-4543-b58b-a70920bfed6d req-4b22c2ca-0925-40aa-8690-1d001f281afa service nova] [instance: c280652c-ffde-40f8-a919-adb8be618db8] Received unexpected event network-vif-plugged-80b77e2d-aa04-4996-a0c1-713054affac4 for instance with vm_state deleted and task_state None.
Oct 18 11:51:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:51:32 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:51:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:51:42 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:51:47 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:51:47 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:51:47 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74190) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 11:51:47 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 11:51:47 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 11:51:47 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:51:48 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:51:48 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Cleaning up deleted instances {{(pid=74190) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 18 11:51:48 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] There are 0 instances to clean {{(pid=74190) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 18 11:51:51 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-f3fc923a-b9f6-40d7-8f81-2fd9006e8245 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Acquiring lock "4e916d24-9f9d-4289-87ce-f65d2499fcd9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:51:51 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-f3fc923a-b9f6-40d7-8f81-2fd9006e8245 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Lock "4e916d24-9f9d-4289-87ce-f65d2499fcd9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:51:51 user nova-compute[74190]: DEBUG nova.objects.instance [None req-f3fc923a-b9f6-40d7-8f81-2fd9006e8245 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Lazy-loading 'flavor' on Instance uuid 4e916d24-9f9d-4289-87ce-f65d2499fcd9 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:51:51 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-f3fc923a-b9f6-40d7-8f81-2fd9006e8245 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Lock "4e916d24-9f9d-4289-87ce-f65d2499fcd9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:51:51 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-f3fc923a-b9f6-40d7-8f81-2fd9006e8245 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Acquiring lock "4e916d24-9f9d-4289-87ce-f65d2499fcd9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:51:51 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-f3fc923a-b9f6-40d7-8f81-2fd9006e8245 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Lock "4e916d24-9f9d-4289-87ce-f65d2499fcd9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:51:51 user nova-compute[74190]: INFO nova.compute.manager [None req-f3fc923a-b9f6-40d7-8f81-2fd9006e8245 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Attaching volume 226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa to /dev/vdb
Oct 18 11:51:51 user nova-compute[74190]: DEBUG os_brick.utils [None req-f3fc923a-b9f6-40d7-8f81-2fd9006e8245 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:51:51 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:51:51 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:51:51 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[3370f000-639f-4830-a5ed-4c786209939b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cff158e257e1\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:51:51 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:51:51 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:51:51 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a6ee5e-ce76-4839-8ab1-9b097f61c8bd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:51:51 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:51:51 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:51:51 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a74ac0b-fc47-424b-a93e-3ea371ade7f6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:51:51 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[22aa5e2e-0663-4a38-bd2c-e38746940119]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:51:51 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-f3fc923a-b9f6-40d7-8f81-2fd9006e8245 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Running cmd (subprocess): nvme version {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:51:51 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-f3fc923a-b9f6-40d7-8f81-2fd9006e8245 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] 'nvme version' failed. Not Retrying. {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 11:51:51 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f3fc923a-b9f6-40d7-8f81-2fd9006e8245 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] nvme not present on system {{(pid=74190) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 11:51:51 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:51:51 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 11:51:51 user nova-compute[74190]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 11:51:51 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[07ccafbf-670d-44cf-9397-3dc91cc9de81]: (4, '') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:51:51 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-f3fc923a-b9f6-40d7-8f81-2fd9006e8245 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74190) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 11:51:51 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-f3fc923a-b9f6-40d7-8f81-2fd9006e8245 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 11:51:51 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-f3fc923a-b9f6-40d7-8f81-2fd9006e8245 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] LIGHTOS: no hostnqn found. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 11:51:51 user nova-compute[74190]: DEBUG os_brick.utils [None req-f3fc923a-b9f6-40d7-8f81-2fd9006e8245 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cff158e257e1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:51:51 user nova-compute[74190]: DEBUG nova.virt.block_device [None req-f3fc923a-b9f6-40d7-8f81-2fd9006e8245 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Updating existing volume attachment record: 43016236-c9b6-4f4c-9594-914c9e1dfd61 {{(pid=74190) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 11:51:52 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:51:55 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:51:55 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:51:55 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74190) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 11:51:56 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:51:57 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:51:57 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:51:57 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:51:57 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:51:57 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Auditing locally available compute resources for user (node: user) {{(pid=74190) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 11:51:57 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0e52e79-ce1e-4a77-a189-b0b837165e68/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:51:57 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0e52e79-ce1e-4a77-a189-b0b837165e68/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:51:57 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0e52e79-ce1e-4a77-a189-b0b837165e68/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:51:57 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0e52e79-ce1e-4a77-a189-b0b837165e68/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:51:57 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0209c824-88a7-4976-83bf-8a72437f0cc2/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:51:57 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0209c824-88a7-4976-83bf-8a72437f0cc2/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:51:57 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0209c824-88a7-4976-83bf-8a72437f0cc2/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:51:57 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:51:57 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0209c824-88a7-4976-83bf-8a72437f0cc2/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:51:57 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:51:58 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:51:58 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:51:58 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:51:58 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 11:51:58 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 11:51:58 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 11:51:58 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdfe420d-f46c-44ad-8773-b675f42e24ed/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:51:58 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdfe420d-f46c-44ad-8773-b675f42e24ed/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:51:58 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdfe420d-f46c-44ad-8773-b675f42e24ed/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:51:58 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdfe420d-f46c-44ad-8773-b675f42e24ed/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:51:58 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 11:51:59 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:51:59 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:51:59 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Hypervisor/Node resource view: name=user free_ram=8088MB free_disk=25.50634765625GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74190) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 11:51:59 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:51:59 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:51:59 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Applying migration context for instance bdfe420d-f46c-44ad-8773-b675f42e24ed as it has an incoming, in-progress migration 794d7f84-f831-4a34-a773-e9b869d038ae. Migration status is finished {{(pid=74190) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 18 11:51:59 user nova-compute[74190]: INFO nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Updating resource usage from migration 794d7f84-f831-4a34-a773-e9b869d038ae
Oct 18 11:51:59 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 0209c824-88a7-4976-83bf-8a72437f0cc2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:51:59 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 4e916d24-9f9d-4289-87ce-f65d2499fcd9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:51:59 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance cd28be8d-847b-468c-860f-4f479740738d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:51:59 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance d0e52e79-ce1e-4a77-a189-b0b837165e68 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:51:59 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Migration 794d7f84-f831-4a34-a773-e9b869d038ae is active on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 18 11:51:59 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance bdfe420d-f46c-44ad-8773-b675f42e24ed actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:51:59 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 11:51:59 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=24GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 11:51:59 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 11:51:59 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 11:51:59 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:51:59 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Compute_service record updated for user:user {{(pid=74190) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 11:51:59 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.594s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:51:59 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:51:59 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74190) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 18 11:51:59 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:52:00 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:52:00 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Starting heal instance info cache {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 11:52:00 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Rebuilding the list of instances to heal {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 18 11:52:00 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "refresh_cache-0209c824-88a7-4976-83bf-8a72437f0cc2" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:52:00 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquired lock "refresh_cache-0209c824-88a7-4976-83bf-8a72437f0cc2" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:52:00 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] Forcefully refreshing network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 18 11:52:00 user nova-compute[74190]: DEBUG nova.objects.instance [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lazy-loading 'info_cache' on Instance uuid 0209c824-88a7-4976-83bf-8a72437f0cc2 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:52:01 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] Updating instance_info_cache with network_info: [{"id": "5e4eb783-7e7c-4501-bf99-33472454f4ac", "address": "fa:16:3e:7e:d2:03", "network": {"id": "f5ab7da4-2b07-4465-9a89-a07eb053ba91", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1315695374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08cf52ce927443158aa731367f08bd57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e4eb783-7e", "ovs_interfaceid": "5e4eb783-7e7c-4501-bf99-33472454f4ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:52:01 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Releasing lock "refresh_cache-0209c824-88a7-4976-83bf-8a72437f0cc2" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:52:01 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] Updated the network info_cache for instance {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 18 11:52:01 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:52:01 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:52:02 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:02 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:52:02 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-80b10dc4-7647-490f-8e30-6d3e527c22c3 tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] Acquiring lock "d0e52e79-ce1e-4a77-a189-b0b837165e68" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:52:02 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-80b10dc4-7647-490f-8e30-6d3e527c22c3 tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] Lock "d0e52e79-ce1e-4a77-a189-b0b837165e68" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:52:02 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-80b10dc4-7647-490f-8e30-6d3e527c22c3 tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] Acquiring lock "d0e52e79-ce1e-4a77-a189-b0b837165e68-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:52:02 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-80b10dc4-7647-490f-8e30-6d3e527c22c3 tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] Lock "d0e52e79-ce1e-4a77-a189-b0b837165e68-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:52:02 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-80b10dc4-7647-490f-8e30-6d3e527c22c3 tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] Lock "d0e52e79-ce1e-4a77-a189-b0b837165e68-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:52:02 user nova-compute[74190]: INFO nova.compute.manager [None req-80b10dc4-7647-490f-8e30-6d3e527c22c3 tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] [instance: d0e52e79-ce1e-4a77-a189-b0b837165e68] Terminating instance
Oct 18 11:52:02 user nova-compute[74190]: DEBUG nova.compute.manager [None req-80b10dc4-7647-490f-8e30-6d3e527c22c3 tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] [instance: d0e52e79-ce1e-4a77-a189-b0b837165e68] Start destroying the instance on the hypervisor. {{(pid=74190) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 11:52:02 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:02 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:02 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:02 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:02 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:03 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:52:03 user nova-compute[74190]: DEBUG nova.compute.manager [req-63f1673d-184c-481e-9733-709bfc6f4869 req-2604be5a-9381-4c15-8d8b-c1987271a957 service nova] [instance: d0e52e79-ce1e-4a77-a189-b0b837165e68] Received event network-vif-unplugged-3ed3f9e7-9dab-435e-a54d-eea1ee04c15c {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:52:03 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-63f1673d-184c-481e-9733-709bfc6f4869 req-2604be5a-9381-4c15-8d8b-c1987271a957 service nova] Acquiring lock "d0e52e79-ce1e-4a77-a189-b0b837165e68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:52:03 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-63f1673d-184c-481e-9733-709bfc6f4869 req-2604be5a-9381-4c15-8d8b-c1987271a957 service nova] Lock "d0e52e79-ce1e-4a77-a189-b0b837165e68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:52:03 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-63f1673d-184c-481e-9733-709bfc6f4869 req-2604be5a-9381-4c15-8d8b-c1987271a957 service nova] Lock "d0e52e79-ce1e-4a77-a189-b0b837165e68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:52:03 user nova-compute[74190]: DEBUG nova.compute.manager [req-63f1673d-184c-481e-9733-709bfc6f4869 req-2604be5a-9381-4c15-8d8b-c1987271a957 service nova] [instance: d0e52e79-ce1e-4a77-a189-b0b837165e68] No waiting events found dispatching network-vif-unplugged-3ed3f9e7-9dab-435e-a54d-eea1ee04c15c {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:52:03 user nova-compute[74190]: DEBUG nova.compute.manager [req-63f1673d-184c-481e-9733-709bfc6f4869 req-2604be5a-9381-4c15-8d8b-c1987271a957 service nova] [instance: d0e52e79-ce1e-4a77-a189-b0b837165e68] Received event network-vif-unplugged-3ed3f9e7-9dab-435e-a54d-eea1ee04c15c for instance with task_state deleting. {{(pid=74190) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 11:52:03 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: d0e52e79-ce1e-4a77-a189-b0b837165e68] Instance destroyed successfully.
Oct 18 11:52:03 user nova-compute[74190]: DEBUG nova.objects.instance [None req-80b10dc4-7647-490f-8e30-6d3e527c22c3 tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] Lazy-loading 'resources' on Instance uuid d0e52e79-ce1e-4a77-a189-b0b837165e68 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:52:03 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-80b10dc4-7647-490f-8e30-6d3e527c22c3 tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:50:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-210485289',display_name='tempest-VolumesNegativeTest-instance-210485289',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-210485289',id=19,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-18T11:50:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='80f77bf8a3c54482b45a9a37b4fb699d',ramdisk_id='',reservation_id='r-pu37qrxu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-70695717',owner_user_name='tempest-VolumesNegativeTest-70695717-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T11:50:20Z,user_data=None,user_id='957ea997ac634e3cb3065522f7df5ad7',uuid=d0e52e79-ce1e-4a77-a189-b0b837165e68,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3ed3f9e7-9dab-435e-a54d-eea1ee04c15c", "address": "fa:16:3e:b1:dc:32", "network": {"id": "c9ed86bb-c34c-43c7-994f-ffd9d8c8e080", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "5b47e79bab9143e5acee2b7862cf2c49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ed3f9e7-9d", "ovs_interfaceid": "3ed3f9e7-9dab-435e-a54d-eea1ee04c15c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 11:52:03 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-80b10dc4-7647-490f-8e30-6d3e527c22c3 tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] Converting VIF {"id": "3ed3f9e7-9dab-435e-a54d-eea1ee04c15c", "address": "fa:16:3e:b1:dc:32", "network": {"id": "c9ed86bb-c34c-43c7-994f-ffd9d8c8e080", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "5b47e79bab9143e5acee2b7862cf2c49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ed3f9e7-9d", "ovs_interfaceid": "3ed3f9e7-9dab-435e-a54d-eea1ee04c15c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:52:03 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-80b10dc4-7647-490f-8e30-6d3e527c22c3 tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:dc:32,bridge_name='br-int',has_traffic_filtering=True,id=3ed3f9e7-9dab-435e-a54d-eea1ee04c15c,network=Network(c9ed86bb-c34c-43c7-994f-ffd9d8c8e080),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ed3f9e7-9d') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:52:03 user nova-compute[74190]: DEBUG os_vif [None req-80b10dc4-7647-490f-8e30-6d3e527c22c3 tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:dc:32,bridge_name='br-int',has_traffic_filtering=True,id=3ed3f9e7-9dab-435e-a54d-eea1ee04c15c,network=Network(c9ed86bb-c34c-43c7-994f-ffd9d8c8e080),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ed3f9e7-9d') {{(pid=74190) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 11:52:03 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:03 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3ed3f9e7-9d, bridge=br-int, if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:52:03 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:03 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:52:03 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:03 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8aa697c1-c7f1-49de-934c-4c8d57417c87) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:52:03 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:03 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:03 user nova-compute[74190]: INFO os_vif [None req-80b10dc4-7647-490f-8e30-6d3e527c22c3 tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:dc:32,bridge_name='br-int',has_traffic_filtering=True,id=3ed3f9e7-9dab-435e-a54d-eea1ee04c15c,network=Network(c9ed86bb-c34c-43c7-994f-ffd9d8c8e080),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ed3f9e7-9d')
Oct 18 11:52:03 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-80b10dc4-7647-490f-8e30-6d3e527c22c3 tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] [instance: d0e52e79-ce1e-4a77-a189-b0b837165e68] Deleting instance files /opt/stack/data/nova/instances/d0e52e79-ce1e-4a77-a189-b0b837165e68_del
Oct 18 11:52:03 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-80b10dc4-7647-490f-8e30-6d3e527c22c3 tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] [instance: d0e52e79-ce1e-4a77-a189-b0b837165e68] Deletion of /opt/stack/data/nova/instances/d0e52e79-ce1e-4a77-a189-b0b837165e68_del complete
Oct 18 11:52:03 user nova-compute[74190]: INFO nova.compute.manager [None req-80b10dc4-7647-490f-8e30-6d3e527c22c3 tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] [instance: d0e52e79-ce1e-4a77-a189-b0b837165e68] Took 0.89 seconds to destroy the instance on the hypervisor.
Oct 18 11:52:03 user nova-compute[74190]: DEBUG oslo.service.loopingcall [None req-80b10dc4-7647-490f-8e30-6d3e527c22c3 tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74190) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 11:52:03 user nova-compute[74190]: DEBUG nova.compute.manager [-] [instance: d0e52e79-ce1e-4a77-a189-b0b837165e68] Deallocating network for instance {{(pid=74190) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 11:52:03 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: d0e52e79-ce1e-4a77-a189-b0b837165e68] deallocate_for_instance() {{(pid=74190) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 11:52:04 user nova-compute[74190]: DEBUG nova.network.neutron [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Port 5f5b65f1-7748-4422-8b45-e1b88476716d binding to destination host user is already ACTIVE {{(pid=74190) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Oct 18 11:52:04 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Acquiring lock "refresh_cache-bdfe420d-f46c-44ad-8773-b675f42e24ed" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:52:04 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Acquired lock "refresh_cache-bdfe420d-f46c-44ad-8773-b675f42e24ed" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:52:04 user nova-compute[74190]: DEBUG nova.network.neutron [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Building network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 11:52:04 user nova-compute[74190]: DEBUG nova.network.neutron [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Updating instance_info_cache with network_info: [{"id": "5f5b65f1-7748-4422-8b45-e1b88476716d", "address": "fa:16:3e:cb:ff:0f", "network": {"id": "7be8675d-326a-4184-9b3e-fbaa02a4e1fc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-468552750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce179d9f22684865b577bd91bc841400", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5b65f1-77", "ovs_interfaceid": "5f5b65f1-7748-4422-8b45-e1b88476716d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:52:04 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Releasing lock "refresh_cache-bdfe420d-f46c-44ad-8773-b675f42e24ed" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:52:04 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Creating tmpfile /opt/stack/data/nova/instances/bdfe420d-f46c-44ad-8773-b675f42e24ed/tmppdusnw0g to verify with other compute node that the instance is on the same shared storage. {{(pid=74190) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Oct 18 11:52:05 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:05 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:05 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: d0e52e79-ce1e-4a77-a189-b0b837165e68] Updating instance_info_cache with network_info: [] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:52:05 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:05 user nova-compute[74190]: INFO nova.compute.manager [-] [instance: d0e52e79-ce1e-4a77-a189-b0b837165e68] Took 1.42 seconds to deallocate network for instance.
Oct 18 11:52:05 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:05 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-80b10dc4-7647-490f-8e30-6d3e527c22c3 tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:52:05 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-80b10dc4-7647-490f-8e30-6d3e527c22c3 tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:52:05 user nova-compute[74190]: DEBUG nova.compute.manager [req-a8c0f510-2cec-465e-8811-170fe0c345f9 req-1bf0fad5-9200-4f39-a7e0-132bd7c923ee service nova] [instance: d0e52e79-ce1e-4a77-a189-b0b837165e68] Received event network-vif-plugged-3ed3f9e7-9dab-435e-a54d-eea1ee04c15c {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:52:05 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-a8c0f510-2cec-465e-8811-170fe0c345f9 req-1bf0fad5-9200-4f39-a7e0-132bd7c923ee service nova] Acquiring lock "d0e52e79-ce1e-4a77-a189-b0b837165e68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:52:05 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-a8c0f510-2cec-465e-8811-170fe0c345f9 req-1bf0fad5-9200-4f39-a7e0-132bd7c923ee service nova] Lock "d0e52e79-ce1e-4a77-a189-b0b837165e68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:52:05 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-a8c0f510-2cec-465e-8811-170fe0c345f9 req-1bf0fad5-9200-4f39-a7e0-132bd7c923ee service nova] Lock "d0e52e79-ce1e-4a77-a189-b0b837165e68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:52:05 user nova-compute[74190]: DEBUG nova.compute.manager [req-a8c0f510-2cec-465e-8811-170fe0c345f9 req-1bf0fad5-9200-4f39-a7e0-132bd7c923ee service nova] [instance: d0e52e79-ce1e-4a77-a189-b0b837165e68] No waiting events found dispatching network-vif-plugged-3ed3f9e7-9dab-435e-a54d-eea1ee04c15c {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:52:05 user nova-compute[74190]: WARNING nova.compute.manager [req-a8c0f510-2cec-465e-8811-170fe0c345f9 req-1bf0fad5-9200-4f39-a7e0-132bd7c923ee service nova] [instance: d0e52e79-ce1e-4a77-a189-b0b837165e68] Received unexpected event network-vif-plugged-3ed3f9e7-9dab-435e-a54d-eea1ee04c15c for instance with vm_state active and task_state deleting.
Oct 18 11:52:05 user nova-compute[74190]: DEBUG nova.compute.manager [req-a8c0f510-2cec-465e-8811-170fe0c345f9 req-1bf0fad5-9200-4f39-a7e0-132bd7c923ee service nova] [instance: d0e52e79-ce1e-4a77-a189-b0b837165e68] Received event network-vif-deleted-3ed3f9e7-9dab-435e-a54d-eea1ee04c15c {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:52:05 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-80b10dc4-7647-490f-8e30-6d3e527c22c3 tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 11:52:05 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-80b10dc4-7647-490f-8e30-6d3e527c22c3 tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 11:52:05 user nova-compute[74190]: DEBUG nova.compute.manager [req-a020f83c-a617-4304-9887-f77da05517cd req-c38d5227-50aa-475e-a2a0-78b1940e6217 service nova] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Received event network-vif-unplugged-5f5b65f1-7748-4422-8b45-e1b88476716d {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:52:05 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-a020f83c-a617-4304-9887-f77da05517cd req-c38d5227-50aa-475e-a2a0-78b1940e6217 service nova] Acquiring lock "bdfe420d-f46c-44ad-8773-b675f42e24ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:52:05 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-a020f83c-a617-4304-9887-f77da05517cd req-c38d5227-50aa-475e-a2a0-78b1940e6217 service nova] Lock "bdfe420d-f46c-44ad-8773-b675f42e24ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:52:05 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-a020f83c-a617-4304-9887-f77da05517cd req-c38d5227-50aa-475e-a2a0-78b1940e6217 service nova] Lock "bdfe420d-f46c-44ad-8773-b675f42e24ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:52:05 user nova-compute[74190]: DEBUG nova.compute.manager [req-a020f83c-a617-4304-9887-f77da05517cd req-c38d5227-50aa-475e-a2a0-78b1940e6217 service nova] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] No waiting events found dispatching network-vif-unplugged-5f5b65f1-7748-4422-8b45-e1b88476716d {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:52:05 user nova-compute[74190]: WARNING nova.compute.manager [req-a020f83c-a617-4304-9887-f77da05517cd req-c38d5227-50aa-475e-a2a0-78b1940e6217 service nova] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Received unexpected event network-vif-unplugged-5f5b65f1-7748-4422-8b45-e1b88476716d for instance with vm_state resized and task_state resize_reverting.
Oct 18 11:52:05 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-80b10dc4-7647-490f-8e30-6d3e527c22c3 tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.337s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:52:05 user nova-compute[74190]: INFO nova.scheduler.client.report [None req-80b10dc4-7647-490f-8e30-6d3e527c22c3 tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] Deleted allocations for instance d0e52e79-ce1e-4a77-a189-b0b837165e68
Oct 18 11:52:05 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Instance destroyed successfully.
Oct 18 11:52:05 user nova-compute[74190]: DEBUG nova.objects.instance [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Lazy-loading 'resources' on Instance uuid bdfe420d-f46c-44ad-8773-b675f42e24ed {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:52:05 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:45:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1652011593',display_name='tempest-ServerActionsTestOtherB-server-1652011593',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1652011593',id=13,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJf2+oC1LymyOUKrd79qlp9w/sLNNXOE0jNeE016Gw/qD1l2yX0bGo5VP+iKF1MHpeTJ2Ix6czkMyFuUdVqQvcY91kItew2KCNk3ZYu6m5FRy6Ycq3v+bQ+PiA7mcNgHFg==',key_name='tempest-keypair-1546248338',keypairs=<?>,launch_index=0,launched_at=2023-10-18T11:50:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ce179d9f22684865b577bd91bc841400',ramdisk_id='',reservation_id='r-iuitp9n6',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1277618284',owner_user_name='tempest-ServerActionsTestOtherB-1277618284-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T11:50:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c5f5ddf3c4174afcbe7075b7f89b4f05',uuid=bdfe420d-f46c-44ad-8773-b675f42e24ed,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "5f5b65f1-7748-4422-8b45-e1b88476716d", "address": "fa:16:3e:cb:ff:0f", "network": {"id": "7be8675d-326a-4184-9b3e-fbaa02a4e1fc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-468552750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce179d9f22684865b577bd91bc841400", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5b65f1-77", "ovs_interfaceid": "5f5b65f1-7748-4422-8b45-e1b88476716d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 11:52:05 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Converting VIF {"id": "5f5b65f1-7748-4422-8b45-e1b88476716d", "address": "fa:16:3e:cb:ff:0f", "network": {"id": "7be8675d-326a-4184-9b3e-fbaa02a4e1fc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-468552750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce179d9f22684865b577bd91bc841400", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5b65f1-77", "ovs_interfaceid": "5f5b65f1-7748-4422-8b45-e1b88476716d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:52:05 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cb:ff:0f,bridge_name='br-int',has_traffic_filtering=True,id=5f5b65f1-7748-4422-8b45-e1b88476716d,network=Network(7be8675d-326a-4184-9b3e-fbaa02a4e1fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f5b65f1-77') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:52:05 user nova-compute[74190]: DEBUG os_vif [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cb:ff:0f,bridge_name='br-int',has_traffic_filtering=True,id=5f5b65f1-7748-4422-8b45-e1b88476716d,network=Network(7be8675d-326a-4184-9b3e-fbaa02a4e1fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f5b65f1-77') {{(pid=74190) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 11:52:05 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-80b10dc4-7647-490f-8e30-6d3e527c22c3 tempest-VolumesNegativeTest-70695717 tempest-VolumesNegativeTest-70695717-project-member] Lock "d0e52e79-ce1e-4a77-a189-b0b837165e68" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.044s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:52:05 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:05 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5f5b65f1-77, bridge=br-int, if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:52:05 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:05 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:52:05 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:05 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6c4e1f7a-87fc-4bae-937f-75e82b56a667) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:52:05 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:05 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:05 user nova-compute[74190]: INFO os_vif [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cb:ff:0f,bridge_name='br-int',has_traffic_filtering=True,id=5f5b65f1-7748-4422-8b45-e1b88476716d,network=Network(7be8675d-326a-4184-9b3e-fbaa02a4e1fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f5b65f1-77')
Oct 18 11:52:05 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] calling os-brick to detach iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 11:52:05 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, {'target_iqn': 'iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HmdgMSxP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:52:05 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:52:05 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:52:05 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:52:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:05 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[a75ae63d-94a4-4ed7-bd19-a936aca53f6c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:011ac309-ad42-43cc-ab45-e09e022b6e56\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:17a1c8f7-ad7d-4b2a-863f-561e1c18768a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:52:05 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 11:52:05 user nova-compute[74190]: No targets found.
Oct 18 11:52:05 user nova-compute[74190]: iSNS:
Oct 18 11:52:05 user nova-compute[74190]: No targets found.
Oct 18 11:52:05 user nova-compute[74190]: STATIC:
Oct 18 11:52:05 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a
Oct 18 11:52:05 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:52:05 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:52:05 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:011ac309-ad42-43cc-ab45-e09e022b6e56
Oct 18 11:52:05 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:52:05 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:52:05 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:17a1c8f7-ad7d-4b2a-863f-561e1c18768a
Oct 18 11:52:05 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:52:05 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:52:05 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71
Oct 18 11:52:05 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:52:05 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:52:05 user nova-compute[74190]: FIRMWARE:
Oct 18 11:52:05 user nova-compute[74190]: No targets found.
Oct 18 11:52:05 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:52:05 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 11:52:05 user nova-compute[74190]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 11:52:05 user nova-compute[74190]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74190) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 11:52:05 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71', 0)] {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 11:52:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:05 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a32ff22-6ad2-433c-b72c-b3d8d35cd165]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:011ac309-ad42-43cc-ab45-e09e022b6e56\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17a1c8f7-ad7d-4b2a-863f-561e1c18768a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:52:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:05 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[8921c758-a827-4213-a9ec-4905e97abb60]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:011ac309-ad42-43cc-ab45-e09e022b6e56 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17a1c8f7-ad7d-4b2a-863f-561e1c18768a (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:52:05 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a (non-flash)
Oct 18 11:52:05 user nova-compute[74190]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 (non-flash)
Oct 18 11:52:05 user nova-compute[74190]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:011ac309-ad42-43cc-ab45-e09e022b6e56 (non-flash)
Oct 18 11:52:05 user nova-compute[74190]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17a1c8f7-ad7d-4b2a-863f-561e1c18768a (non-flash)
Oct 18 11:52:05 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:52:05 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a (non-flash)
Oct 18 11:52:05 user nova-compute[74190]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 (non-flash)
Oct 18 11:52:05 user nova-compute[74190]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:011ac309-ad42-43cc-ab45-e09e022b6e56 (non-flash)
Oct 18 11:52:05 user nova-compute[74190]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17a1c8f7-ad7d-4b2a-863f-561e1c18768a (non-flash)
Oct 18 11:52:05 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:52:05 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1f445385e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71'): ({'sdc'}, set())}) {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 11:52:05 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Removing single pathed devices sdc {{(pid=74190) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 11:52:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:05 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e61138d-fcd7-4616-b9b8-1d8d2a68a9b3]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:52:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:05 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b6758d4-79d2-4603-b87b-f268a2fcb9c2]: (4, ('ok\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:52:05 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Flushing IO for device /dev/sdc {{(pid=74190) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 11:52:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:05 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f04f56-b8b0-4ec1-9c93-74ea46093432]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:52:05 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74190) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 11:52:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.035s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:05 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[93961181-b9e1-4909-9fa6-9517ea52da6a]: (4, ('1', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:52:05 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 11:52:05 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] SCSI volumes sdc have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 11:52:05 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71')] {{(pid=74190) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 11:52:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:06 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:06 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae5cc2f-2656-4875-a1d2-582e5e453855]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:52:06 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:52:06 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 -p 172.16.0.220:3260 --logout {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:06 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:06 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d7f36fe-f23c-4019-8f8e-93fb3fb7013a]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:52:06 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71, portal: 172.16.0.220,3260]
Oct 18 11:52:06 user nova-compute[74190]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71, portal: 172.16.0.220,3260] successful.
Oct 18 11:52:06 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:52:06 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 -p 172.16.0.220:3260 --op delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:06 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:06 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[e185229d-f2e2-4f82-bb5f-caaff3a5b159]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:52:06 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:52:06 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:52:06 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] <== disconnect_volume: return (289ms) None {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:52:06 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Disconnected iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 11:52:07 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:52:07 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:52:07 user nova-compute[74190]: DEBUG nova.objects.instance [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Lazy-loading 'migration_context' on Instance uuid bdfe420d-f46c-44ad-8773-b675f42e24ed {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:52:07 user nova-compute[74190]: DEBUG nova.objects.base [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Object Instance<bdfe420d-f46c-44ad-8773-b675f42e24ed> lazy-loaded attributes: resources,migration_context {{(pid=74190) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 11:52:07 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 11:52:07 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 11:52:07 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.277s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:52:07 user nova-compute[74190]: DEBUG nova.compute.manager [req-3c20cb74-8d37-40a7-90aa-80350d3920ed req-08f25b7f-b88e-411b-b91d-5ca8dee2c12d service nova] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Received event network-vif-plugged-5f5b65f1-7748-4422-8b45-e1b88476716d {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:52:07 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-3c20cb74-8d37-40a7-90aa-80350d3920ed req-08f25b7f-b88e-411b-b91d-5ca8dee2c12d service nova] Acquiring lock "bdfe420d-f46c-44ad-8773-b675f42e24ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:52:07 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-3c20cb74-8d37-40a7-90aa-80350d3920ed req-08f25b7f-b88e-411b-b91d-5ca8dee2c12d service nova] Lock "bdfe420d-f46c-44ad-8773-b675f42e24ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:52:07 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-3c20cb74-8d37-40a7-90aa-80350d3920ed req-08f25b7f-b88e-411b-b91d-5ca8dee2c12d service nova] Lock "bdfe420d-f46c-44ad-8773-b675f42e24ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:52:07 user nova-compute[74190]: DEBUG nova.compute.manager [req-3c20cb74-8d37-40a7-90aa-80350d3920ed req-08f25b7f-b88e-411b-b91d-5ca8dee2c12d service nova] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] No waiting events found dispatching network-vif-plugged-5f5b65f1-7748-4422-8b45-e1b88476716d {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:52:07 user nova-compute[74190]: WARNING nova.compute.manager [req-3c20cb74-8d37-40a7-90aa-80350d3920ed req-08f25b7f-b88e-411b-b91d-5ca8dee2c12d service nova] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Received unexpected event network-vif-plugged-5f5b65f1-7748-4422-8b45-e1b88476716d for instance with vm_state resized and task_state resize_reverting.
Oct 18 11:52:07 user nova-compute[74190]: INFO nova.compute.manager [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Swapping old allocation on dict_keys(['11291cdf-1d1c-43a5-bad7-6a29a5f06f66']) held by migration 794d7f84-f831-4a34-a773-e9b869d038ae for instance
Oct 18 11:52:07 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Overwriting current allocation {'allocations': {'11291cdf-1d1c-43a5-bad7-6a29a5f06f66': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 25}}, 'project_id': 'ce179d9f22684865b577bd91bc841400', 'user_id': 'c5f5ddf3c4174afcbe7075b7f89b4f05', 'consumer_generation': 1} on consumer bdfe420d-f46c-44ad-8773-b675f42e24ed {{(pid=74190) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Oct 18 11:52:07 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Acquiring lock "refresh_cache-bdfe420d-f46c-44ad-8773-b675f42e24ed" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:52:07 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Acquired lock "refresh_cache-bdfe420d-f46c-44ad-8773-b675f42e24ed" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:52:07 user nova-compute[74190]: DEBUG nova.network.neutron [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Building network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 11:52:08 user nova-compute[74190]: DEBUG nova.network.neutron [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Updating instance_info_cache with network_info: [{"id": "5f5b65f1-7748-4422-8b45-e1b88476716d", "address": "fa:16:3e:cb:ff:0f", "network": {"id": "7be8675d-326a-4184-9b3e-fbaa02a4e1fc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-468552750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce179d9f22684865b577bd91bc841400", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5b65f1-77", "ovs_interfaceid": "5f5b65f1-7748-4422-8b45-e1b88476716d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:52:08 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Releasing lock "refresh_cache-bdfe420d-f46c-44ad-8773-b675f42e24ed" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:52:08 user nova-compute[74190]: DEBUG os_brick.utils [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:52:08 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:08 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:08 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[e63954a9-be37-49bd-ac2c-262eabb220d4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cff158e257e1\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:52:08 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:08 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:08 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[b64f9b5c-57ff-40ac-8fe2-8cc19ea9eeaf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:52:08 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:08 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:08 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd6e5934-910f-4d07-8997-67e3f31a65ed]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:52:08 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[093c2a3f-429b-45d8-9216-dce8d213ff14]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:52:08 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Running cmd (subprocess): nvme version {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:08 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] 'nvme version' failed. Not Retrying. {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 11:52:08 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.nvmeof [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] nvme not present on system {{(pid=74190) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 11:52:08 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:08 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 11:52:08 user nova-compute[74190]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 11:52:08 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[b74777c1-a25b-4e82-b1d2-34ffde71d472]: (4, '') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:52:08 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74190) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 11:52:08 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 11:52:08 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] LIGHTOS: no hostnqn found. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 11:52:08 user nova-compute[74190]: DEBUG os_brick.utils [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cff158e257e1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:52:09 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:10 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3fc923a-b9f6-40d7-8f81-2fd9006e8245 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Calling os-brick to attach iSCSI Volume {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 11:52:10 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fc923a-b9f6-40d7-8f81-2fd9006e8245 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jMIouEKV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:52:10 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-f3fc923a-b9f6-40d7-8f81-2fd9006e8245 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:52:10 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-f3fc923a-b9f6-40d7-8f81-2fd9006e8245 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:52:10 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-f3fc923a-b9f6-40d7-8f81-2fd9006e8245 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:52:10 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-f3fc923a-b9f6-40d7-8f81-2fd9006e8245 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:52:10 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-f3fc923a-b9f6-40d7-8f81-2fd9006e8245 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:52:10 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-f3fc923a-b9f6-40d7-8f81-2fd9006e8245 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:52:10 user nova-compute[74190]: INFO os_brick.initiator.connectors.iscsi [None req-f3fc923a-b9f6-40d7-8f81-2fd9006e8245 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 11:52:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa -p 172.16.0.220:3260 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:10 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[518cf1d6-dc69-43c4-a388-f808ce31452f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:52:10 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fc923a-b9f6-40d7-8f81-2fd9006e8245 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 11:52:10 user nova-compute[74190]:  {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:52:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa -p 172.16.0.220:3260 --interface default --op new {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:10 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc15d80-8ca1-426d-8a57-f73652b31953]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa] added\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:52:10 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fc923a-b9f6-40d7-8f81-2fd9006e8245 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa] added
Oct 18 11:52:10 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:52:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:10 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fed2187-75dd-4aa2-becf-2c7eea814503]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:52:10 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fc923a-b9f6-40d7-8f81-2fd9006e8245 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:52:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:10 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[baaaa49d-97c9-4705-8ef0-9479cf025797]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:52:10 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fc923a-b9f6-40d7-8f81-2fd9006e8245 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:52:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jMIouEKV {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jMIouEKV" returned: 0 in 0.022s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:10 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[4618f780-d8d9-4c27-88aa-1e05986a39e8]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:52:10 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fc923a-b9f6-40d7-8f81-2fd9006e8245 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jMIouEKV'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:52:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:10 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[a56d7551-dee7-4501-a1c6-cb852c98f42b]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:52:10 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fc923a-b9f6-40d7-8f81-2fd9006e8245 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:52:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:10 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b57472-7e18-43ab-94d7-eaef4716f7bf]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:011ac309-ad42-43cc-ab45-e09e022b6e56 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17a1c8f7-ad7d-4b2a-863f-561e1c18768a (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:52:10 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fc923a-b9f6-40d7-8f81-2fd9006e8245 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a (non-flash)
Oct 18 11:52:10 user nova-compute[74190]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:011ac309-ad42-43cc-ab45-e09e022b6e56 (non-flash)
Oct 18 11:52:10 user nova-compute[74190]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17a1c8f7-ad7d-4b2a-863f-561e1c18768a (non-flash)
Oct 18 11:52:10 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:52:10 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fc923a-b9f6-40d7-8f81-2fd9006e8245 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a (non-flash)
Oct 18 11:52:10 user nova-compute[74190]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:011ac309-ad42-43cc-ab45-e09e022b6e56 (non-flash)
Oct 18 11:52:10 user nova-compute[74190]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17a1c8f7-ad7d-4b2a-863f-561e1c18768a (non-flash)
Oct 18 11:52:10 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:52:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa -p 172.16.0.220:3260 --login {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:10 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab1d21a4-f15b-42cc-9222-b5143b897064]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:52:10 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fc923a-b9f6-40d7-8f81-2fd9006e8245 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa, portal: 172.16.0.220,3260]
Oct 18 11:52:10 user nova-compute[74190]: Login to [iface: default, target: iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa, portal: 172.16.0.220,3260] successful.
Oct 18 11:52:10 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:52:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:10 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb9b9389-f8b7-45c6-bff7-08d7621d2f90]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:52:10 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fc923a-b9f6-40d7-8f81-2fd9006e8245 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:52:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:10 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c4e2c8-8397-4265-a53f-a9381c6a02ae]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:011ac309-ad42-43cc-ab45-e09e022b6e56 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17a1c8f7-ad7d-4b2a-863f-561e1c18768a (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:52:10 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fc923a-b9f6-40d7-8f81-2fd9006e8245 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a (non-flash)
Oct 18 11:52:10 user nova-compute[74190]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:011ac309-ad42-43cc-ab45-e09e022b6e56 (non-flash)
Oct 18 11:52:10 user nova-compute[74190]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17a1c8f7-ad7d-4b2a-863f-561e1c18768a (non-flash)
Oct 18 11:52:10 user nova-compute[74190]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 11:52:10 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:52:10 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fc923a-b9f6-40d7-8f81-2fd9006e8245 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a (non-flash)
Oct 18 11:52:10 user nova-compute[74190]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:011ac309-ad42-43cc-ab45-e09e022b6e56 (non-flash)
Oct 18 11:52:10 user nova-compute[74190]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17a1c8f7-ad7d-4b2a-863f-561e1c18768a (non-flash)
Oct 18 11:52:10 user nova-compute[74190]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 11:52:10 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:52:10 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-f3fc923a-b9f6-40d7-8f81-2fd9006e8245 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:52:10 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fc923a-b9f6-40d7-8f81-2fd9006e8245 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Connected to 172.16.0.220:3260 {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 11:52:10 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-f3fc923a-b9f6-40d7-8f81-2fd9006e8245 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] HCTL ('34', '-', '-', 0) found on session 27 with lun 0 {{(pid=74190) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 11:52:10 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-f3fc923a-b9f6-40d7-8f81-2fd9006e8245 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74190) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 11:52:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:10 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[1858c9f1-69ea-4d2f-9b7d-df90661c2811]: (4, ('- - 0', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:52:10 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-f3fc923a-b9f6-40d7-8f81-2fd9006e8245 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Searching for a device in session 27 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74190) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 11:52:10 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fc923a-b9f6-40d7-8f81-2fd9006e8245 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jMIouEKV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 11:52:10 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:11 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:11 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-f3fc923a-b9f6-40d7-8f81-2fd9006e8245 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:52:11 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fc923a-b9f6-40d7-8f81-2fd9006e8245 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '26462346534633330', 'path': '/dev/sdc'} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:52:11 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3fc923a-b9f6-40d7-8f81-2fd9006e8245 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26462346534633330', 'path': '/dev/sdc'} {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 11:52:11 user nova-compute[74190]: DEBUG nova.objects.instance [None req-f3fc923a-b9f6-40d7-8f81-2fd9006e8245 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Lazy-loading 'flavor' on Instance uuid 4e916d24-9f9d-4289-87ce-f65d2499fcd9 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:52:11 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-f3fc923a-b9f6-40d7-8f81-2fd9006e8245 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] attach device xml: <disk type="block" device="disk">
Oct 18 11:52:11 user nova-compute[74190]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 11:52:11 user nova-compute[74190]:   <source dev="/dev/sdc"/>
Oct 18 11:52:11 user nova-compute[74190]:   <target dev="vdb" bus="virtio"/>
Oct 18 11:52:11 user nova-compute[74190]:   <serial>226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa</serial>
Oct 18 11:52:11 user nova-compute[74190]: </disk>
Oct 18 11:52:11 user nova-compute[74190]:  {{(pid=74190) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 18 11:52:12 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-f3fc923a-b9f6-40d7-8f81-2fd9006e8245 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] No BDM found with device name vda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 11:52:12 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-f3fc923a-b9f6-40d7-8f81-2fd9006e8245 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 11:52:12 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-f3fc923a-b9f6-40d7-8f81-2fd9006e8245 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] No VIF found with MAC fa:16:3e:15:15:1d, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 11:52:12 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-f3fc923a-b9f6-40d7-8f81-2fd9006e8245 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Lock "4e916d24-9f9d-4289-87ce-f65d2499fcd9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.608s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:52:13 user nova-compute[74190]: INFO nova.compute.manager [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Rescuing
Oct 18 11:52:13 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Acquiring lock "refresh_cache-4e916d24-9f9d-4289-87ce-f65d2499fcd9" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:52:13 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Acquired lock "refresh_cache-4e916d24-9f9d-4289-87ce-f65d2499fcd9" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:52:13 user nova-compute[74190]: DEBUG nova.network.neutron [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Building network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 11:52:13 user nova-compute[74190]: DEBUG nova.network.neutron [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Updating instance_info_cache with network_info: [{"id": "7cee893b-5ac8-45f8-a1f8-5374b49cc3b5", "address": "fa:16:3e:15:15:1d", "network": {"id": "4609cfba-1e8b-4740-bdf6-642b196097a3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1019354168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a4f041e58144d54a458a01074eb35a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cee893b-5a", "ovs_interfaceid": "7cee893b-5ac8-45f8-a1f8-5374b49cc3b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:52:13 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Releasing lock "refresh_cache-4e916d24-9f9d-4289-87ce-f65d2499fcd9" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:52:14 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:14 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:14 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:14 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:14 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:14 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Instance destroyed successfully.
Oct 18 11:52:14 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Attempting a stable device rescue
Oct 18 11:52:15 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=74190) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 18 11:52:15 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Instance directory exists: not creating {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 18 11:52:15 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Creating image(s)
Oct 18 11:52:15 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Acquiring lock "/opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:52:15 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Lock "/opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:52:15 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Lock "/opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:52:15 user nova-compute[74190]: DEBUG nova.objects.instance [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4e916d24-9f9d-4289-87ce-f65d2499fcd9 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:52:15 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Acquiring lock "fe028cd67e08f279d123d1d01d37054950fb230a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:52:15 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Lock "fe028cd67e08f279d123d1d01d37054950fb230a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:52:16 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe028cd67e08f279d123d1d01d37054950fb230a.part --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:16 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:16 user nova-compute[74190]: DEBUG nova.compute.manager [req-edb75d25-d534-49ca-a29a-3d1da865723c req-a4ca2118-48f9-4497-9479-09824ed92d7c service nova] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Received event network-vif-unplugged-7cee893b-5ac8-45f8-a1f8-5374b49cc3b5 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:52:16 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-edb75d25-d534-49ca-a29a-3d1da865723c req-a4ca2118-48f9-4497-9479-09824ed92d7c service nova] Acquiring lock "4e916d24-9f9d-4289-87ce-f65d2499fcd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:52:16 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-edb75d25-d534-49ca-a29a-3d1da865723c req-a4ca2118-48f9-4497-9479-09824ed92d7c service nova] Lock "4e916d24-9f9d-4289-87ce-f65d2499fcd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:52:16 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-edb75d25-d534-49ca-a29a-3d1da865723c req-a4ca2118-48f9-4497-9479-09824ed92d7c service nova] Lock "4e916d24-9f9d-4289-87ce-f65d2499fcd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:52:16 user nova-compute[74190]: DEBUG nova.compute.manager [req-edb75d25-d534-49ca-a29a-3d1da865723c req-a4ca2118-48f9-4497-9479-09824ed92d7c service nova] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] No waiting events found dispatching network-vif-unplugged-7cee893b-5ac8-45f8-a1f8-5374b49cc3b5 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:52:16 user nova-compute[74190]: WARNING nova.compute.manager [req-edb75d25-d534-49ca-a29a-3d1da865723c req-a4ca2118-48f9-4497-9479-09824ed92d7c service nova] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Received unexpected event network-vif-unplugged-7cee893b-5ac8-45f8-a1f8-5374b49cc3b5 for instance with vm_state active and task_state rescuing.
Oct 18 11:52:16 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:52:16 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe028cd67e08f279d123d1d01d37054950fb230a.part --force-share --output=json" returned: 0 in 0.199s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:16 user nova-compute[74190]: DEBUG nova.virt.images [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] 17899eff-9fe4-4d03-98e5-b7992fe1c017 was qcow2, converting to raw {{(pid=74190) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 18 11:52:16 user nova-compute[74190]: DEBUG nova.privsep.utils [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74190) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 18 11:52:16 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fe028cd67e08f279d123d1d01d37054950fb230a.part /opt/stack/data/nova/instances/_base/fe028cd67e08f279d123d1d01d37054950fb230a.converted {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:16 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fe028cd67e08f279d123d1d01d37054950fb230a.part /opt/stack/data/nova/instances/_base/fe028cd67e08f279d123d1d01d37054950fb230a.converted" returned: 0 in 0.602s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:16 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe028cd67e08f279d123d1d01d37054950fb230a.converted --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:17 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe028cd67e08f279d123d1d01d37054950fb230a.converted --force-share --output=json" returned: 0 in 0.204s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:17 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Lock "fe028cd67e08f279d123d1d01d37054950fb230a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.095s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:52:17 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Acquiring lock "fe028cd67e08f279d123d1d01d37054950fb230a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:52:17 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Lock "fe028cd67e08f279d123d1d01d37054950fb230a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:52:17 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe028cd67e08f279d123d1d01d37054950fb230a --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:17 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe028cd67e08f279d123d1d01d37054950fb230a --force-share --output=json" returned: 0 in 0.205s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:17 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe028cd67e08f279d123d1d01d37054950fb230a,backing_fmt=raw /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk.rescue {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:17 user nova-compute[74190]: DEBUG nova.compute.manager [req-3059af58-19e7-485e-9b9d-5ece5cc1d804 req-3fe49bbc-9b7f-4b92-9aa0-bac4676d8b7d service nova] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Received event network-vif-plugged-7cee893b-5ac8-45f8-a1f8-5374b49cc3b5 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:52:17 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-3059af58-19e7-485e-9b9d-5ece5cc1d804 req-3fe49bbc-9b7f-4b92-9aa0-bac4676d8b7d service nova] Acquiring lock "4e916d24-9f9d-4289-87ce-f65d2499fcd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:52:17 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-3059af58-19e7-485e-9b9d-5ece5cc1d804 req-3fe49bbc-9b7f-4b92-9aa0-bac4676d8b7d service nova] Lock "4e916d24-9f9d-4289-87ce-f65d2499fcd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:52:17 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-3059af58-19e7-485e-9b9d-5ece5cc1d804 req-3fe49bbc-9b7f-4b92-9aa0-bac4676d8b7d service nova] Lock "4e916d24-9f9d-4289-87ce-f65d2499fcd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:52:17 user nova-compute[74190]: DEBUG nova.compute.manager [req-3059af58-19e7-485e-9b9d-5ece5cc1d804 req-3fe49bbc-9b7f-4b92-9aa0-bac4676d8b7d service nova] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] No waiting events found dispatching network-vif-plugged-7cee893b-5ac8-45f8-a1f8-5374b49cc3b5 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:52:17 user nova-compute[74190]: WARNING nova.compute.manager [req-3059af58-19e7-485e-9b9d-5ece5cc1d804 req-3fe49bbc-9b7f-4b92-9aa0-bac4676d8b7d service nova] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Received unexpected event network-vif-plugged-7cee893b-5ac8-45f8-a1f8-5374b49cc3b5 for instance with vm_state active and task_state rescuing.
Oct 18 11:52:17 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe028cd67e08f279d123d1d01d37054950fb230a,backing_fmt=raw /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk.rescue" returned: 0 in 0.083s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:17 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Lock "fe028cd67e08f279d123d1d01d37054950fb230a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.294s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:52:17 user nova-compute[74190]: DEBUG nova.objects.instance [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Lazy-loading 'migration_context' on Instance uuid 4e916d24-9f9d-4289-87ce-f65d2499fcd9 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:52:17 user nova-compute[74190]: DEBUG nova.objects.base [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Object Instance<4e916d24-9f9d-4289-87ce-f65d2499fcd9> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74190) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 11:52:17 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Created local disks {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 11:52:17 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Start _get_guest_xml network_info=[{"id": "7cee893b-5ac8-45f8-a1f8-5374b49cc3b5", "address": "fa:16:3e:15:15:1d", "network": {"id": "4609cfba-1e8b-4740-bdf6-642b196097a3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1019354168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1019354168-network", "vif_mac": "fa:16:3e:15:15:1d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a4f041e58144d54a458a01074eb35a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cee893b-5a", "ovs_interfaceid": "7cee893b-5ac8-45f8-a1f8-5374b49cc3b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '17899eff-9fe4-4d03-98e5-b7992fe1c017', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'image_id': '6e88bbf0-6e78-49a8-b3c5-9453d22a89df'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jMIouEKV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '4e916d24-9f9d-4289-87ce-f65d2499fcd9', 'attached_at': '', 'detached_at': '', 'volume_id': '226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa', 'serial': '226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa'}, 'delete_on_termination': False, 'guest_format': None, 'attachment_id': '43016236-c9b6-4f4c-9594-914c9e1dfd61', 'volume_type': None} {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 11:52:17 user nova-compute[74190]: DEBUG nova.objects.instance [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Lazy-loading 'resources' on Instance uuid 4e916d24-9f9d-4289-87ce-f65d2499fcd9 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:52:17 user nova-compute[74190]: DEBUG nova.objects.base [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Object Instance<4e916d24-9f9d-4289-87ce-f65d2499fcd9> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74190) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 11:52:17 user nova-compute[74190]: DEBUG nova.objects.instance [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Lazy-loading 'numa_topology' on Instance uuid 4e916d24-9f9d-4289-87ce-f65d2499fcd9 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:52:17 user nova-compute[74190]: DEBUG nova.objects.base [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Object Instance<4e916d24-9f9d-4289-87ce-f65d2499fcd9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74190) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 11:52:17 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:52:17 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:52:17 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 11:52:17 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] CPU controller missing on host. {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 11:52:17 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 11:52:17 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] CPU controller found on host. {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 11:52:17 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74190) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 11:52:17 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T11:37:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 11:52:17 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Flavor limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 11:52:17 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Image limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 11:52:17 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Flavor pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 11:52:17 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Image pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 11:52:17 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 11:52:17 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 11:52:17 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 11:52:17 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Got 1 possible topologies {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 11:52:17 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 11:52:17 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 11:52:17 user nova-compute[74190]: DEBUG nova.objects.instance [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4e916d24-9f9d-4289-87ce-f65d2499fcd9 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:52:17 user nova-compute[74190]: DEBUG nova.objects.base [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Object Instance<4e916d24-9f9d-4289-87ce-f65d2499fcd9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74190) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 11:52:17 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Calling os-brick to attach iSCSI Volume {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 11:52:17 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jMIouEKV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:52:17 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:52:17 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:52:17 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:52:17 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:52:17 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:52:17 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:52:17 user nova-compute[74190]: INFO os_brick.initiator.connectors.iscsi [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 11:52:17 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa -p 172.16.0.220:3260 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:17 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa -p 172.16.0.220:3260" returned: 0 in 0.022s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:17 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff2b9da-ff8b-43e4-949e-7a4cef00f88d]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = jMIouEKV\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:52:17 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Oct 18 11:52:17 user nova-compute[74190]: node.name = iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa
Oct 18 11:52:17 user nova-compute[74190]: node.tpgt = -1
Oct 18 11:52:17 user nova-compute[74190]: node.startup = automatic
Oct 18 11:52:17 user nova-compute[74190]: node.leading_login = No
Oct 18 11:52:17 user nova-compute[74190]: iface.iscsi_ifacename = default
Oct 18 11:52:17 user nova-compute[74190]: iface.net_ifacename = <empty>
Oct 18 11:52:17 user nova-compute[74190]: iface.ipaddress = <empty>
Oct 18 11:52:17 user nova-compute[74190]: iface.prefix_len = 0
Oct 18 11:52:17 user nova-compute[74190]: iface.hwaddress = <empty>
Oct 18 11:52:17 user nova-compute[74190]: iface.transport_name = tcp
Oct 18 11:52:17 user nova-compute[74190]: iface.initiatorname = <empty>
Oct 18 11:52:17 user nova-compute[74190]: iface.state = <empty>
Oct 18 11:52:17 user nova-compute[74190]: iface.vlan_id = 0
Oct 18 11:52:17 user nova-compute[74190]: iface.vlan_priority = 0
Oct 18 11:52:17 user nova-compute[74190]: iface.vlan_state = <empty>
Oct 18 11:52:17 user nova-compute[74190]: iface.iface_num = 0
Oct 18 11:52:17 user nova-compute[74190]: iface.mtu = 0
Oct 18 11:52:17 user nova-compute[74190]: iface.port = 0
Oct 18 11:52:17 user nova-compute[74190]: iface.bootproto = <empty>
Oct 18 11:52:17 user nova-compute[74190]: iface.subnet_mask = <empty>
Oct 18 11:52:17 user nova-compute[74190]: iface.gateway = <empty>
Oct 18 11:52:17 user nova-compute[74190]: iface.dhcp_alt_client_id_state = <empty>
Oct 18 11:52:17 user nova-compute[74190]: iface.dhcp_alt_client_id = <empty>
Oct 18 11:52:17 user nova-compute[74190]: iface.dhcp_dns = <empty>
Oct 18 11:52:17 user nova-compute[74190]: iface.dhcp_learn_iqn = <empty>
Oct 18 11:52:17 user nova-compute[74190]: iface.dhcp_req_vendor_id_state = <empty>
Oct 18 11:52:17 user nova-compute[74190]: iface.dhcp_vendor_id_state = <empty>
Oct 18 11:52:17 user nova-compute[74190]: iface.dhcp_vendor_id = <empty>
Oct 18 11:52:17 user nova-compute[74190]: iface.dhcp_slp_da = <empty>
Oct 18 11:52:17 user nova-compute[74190]: iface.fragmentation = <empty>
Oct 18 11:52:17 user nova-compute[74190]: iface.gratuitous_arp = <empty>
Oct 18 11:52:17 user nova-compute[74190]: iface.incoming_forwarding = <empty>
Oct 18 11:52:17 user nova-compute[74190]: iface.tos_state = <empty>
Oct 18 11:52:17 user nova-compute[74190]: iface.tos = 0
Oct 18 11:52:17 user nova-compute[74190]: iface.ttl = 0
Oct 18 11:52:17 user nova-compute[74190]: iface.delayed_ack = <empty>
Oct 18 11:52:17 user nova-compute[74190]: iface.tcp_nagle = <empty>
Oct 18 11:52:17 user nova-compute[74190]: iface.tcp_wsf_state = <empty>
Oct 18 11:52:17 user nova-compute[74190]: iface.tcp_wsf = 0
Oct 18 11:52:17 user nova-compute[74190]: iface.tcp_timer_scale = 0
Oct 18 11:52:17 user nova-compute[74190]: iface.tcp_timestamp = <empty>
Oct 18 11:52:17 user nova-compute[74190]: iface.redirect = <empty>
Oct 18 11:52:17 user nova-compute[74190]: iface.def_task_mgmt_timeout = 0
Oct 18 11:52:17 user nova-compute[74190]: iface.header_digest = <empty>
Oct 18 11:52:17 user nova-compute[74190]: iface.data_digest = <empty>
Oct 18 11:52:17 user nova-compute[74190]: iface.immediate_data = <empty>
Oct 18 11:52:17 user nova-compute[74190]: iface.initial_r2t = <empty>
Oct 18 11:52:17 user nova-compute[74190]: iface.data_seq_inorder = <empty>
Oct 18 11:52:17 user nova-compute[74190]: iface.data_pdu_inorder = <empty>
Oct 18 11:52:17 user nova-compute[74190]: iface.erl = 0
Oct 18 11:52:17 user nova-compute[74190]: iface.max_receive_data_len = 0
Oct 18 11:52:17 user nova-compute[74190]: iface.first_burst_len = 0
Oct 18 11:52:17 user nova-compute[74190]: iface.max_outstanding_r2t = 0
Oct 18 11:52:17 user nova-compute[74190]: iface.max_burst_len = 0
Oct 18 11:52:17 user nova-compute[74190]: iface.chap_auth = <empty>
Oct 18 11:52:17 user nova-compute[74190]: iface.bidi_chap = <empty>
Oct 18 11:52:17 user nova-compute[74190]: iface.strict_login_compliance = <empty>
Oct 18 11:52:17 user nova-compute[74190]: iface.discovery_auth = <empty>
Oct 18 11:52:17 user nova-compute[74190]: iface.discovery_logout = <empty>
Oct 18 11:52:17 user nova-compute[74190]: node.discovery_address = <empty>
Oct 18 11:52:17 user nova-compute[74190]: node.discovery_port = 0
Oct 18 11:52:17 user nova-compute[74190]: node.discovery_type = static
Oct 18 11:52:17 user nova-compute[74190]: node.session.initial_cmdsn = 0
Oct 18 11:52:17 user nova-compute[74190]: node.session.initial_login_retry_max = 8
Oct 18 11:52:17 user nova-compute[74190]: node.session.xmit_thread_priority = -20
Oct 18 11:52:17 user nova-compute[74190]: node.session.cmds_max = 128
Oct 18 11:52:17 user nova-compute[74190]: node.session.queue_depth = 32
Oct 18 11:52:17 user nova-compute[74190]: node.session.nr_sessions = 1
Oct 18 11:52:17 user nova-compute[74190]: node.session.auth.authmethod = CHAP
Oct 18 11:52:17 user nova-compute[74190]: node.session.auth.username = jMIouEKV
Oct 18 11:52:17 user nova-compute[74190]: node.session.auth.password = ***
Oct 18 11:52:17 user nova-compute[74190]: node.session.auth.username_in = <empty>
Oct 18 11:52:17 user nova-compute[74190]: node.session.auth.password_in = <empty>
Oct 18 11:52:17 user nova-compute[74190]: node.session.auth.chap_algs = MD5
Oct 18 11:52:17 user nova-compute[74190]: node.session.timeo.replacement_timeout = 120
Oct 18 11:52:17 user nova-compute[74190]: node.session.err_timeo.abort_timeout = 15
Oct 18 11:52:17 user nova-compute[74190]: node.session.err_timeo.lu_reset_timeout = 30
Oct 18 11:52:17 user nova-compute[74190]: node.session.err_timeo.tgt_reset_timeout = 30
Oct 18 11:52:17 user nova-compute[74190]: node.session.err_timeo.host_reset_timeout = 60
Oct 18 11:52:17 user nova-compute[74190]: node.session.iscsi.FastAbort = Yes
Oct 18 11:52:17 user nova-compute[74190]: node.session.iscsi.InitialR2T = No
Oct 18 11:52:17 user nova-compute[74190]: node.session.iscsi.ImmediateData = Yes
Oct 18 11:52:17 user nova-compute[74190]: node.session.iscsi.FirstBurstLength = 262144
Oct 18 11:52:17 user nova-compute[74190]: node.session.iscsi.MaxBurstLength = 16776192
Oct 18 11:52:17 user nova-compute[74190]: node.session.iscsi.DefaultTime2Retain = 0
Oct 18 11:52:17 user nova-compute[74190]: node.session.iscsi.DefaultTime2Wait = 2
Oct 18 11:52:17 user nova-compute[74190]: node.session.iscsi.MaxConnections = 1
Oct 18 11:52:17 user nova-compute[74190]: node.session.iscsi.MaxOutstandingR2T = 1
Oct 18 11:52:17 user nova-compute[74190]: node.session.iscsi.ERL = 0
Oct 18 11:52:17 user nova-compute[74190]: node.session.scan = manual
Oct 18 11:52:17 user nova-compute[74190]: node.session.reopen_max = 0
Oct 18 11:52:17 user nova-compute[74190]: node.conn[0].address = 172.16.0.220
Oct 18 11:52:17 user nova-compute[74190]: node.conn[0].port = 3260
Oct 18 11:52:17 user nova-compute[74190]: node.conn[0].startup = manual
Oct 18 11:52:17 user nova-compute[74190]: node.conn[0].tcp.window_size = 524288
Oct 18 11:52:17 user nova-compute[74190]: node.conn[0].tcp.type_of_service = 0
Oct 18 11:52:17 user nova-compute[74190]: node.conn[0].timeo.logout_timeout = 15
Oct 18 11:52:17 user nova-compute[74190]: node.conn[0].timeo.login_timeout = 15
Oct 18 11:52:17 user nova-compute[74190]: node.conn[0].timeo.auth_timeout = 45
Oct 18 11:52:17 user nova-compute[74190]: node.conn[0].timeo.noop_out_interval = 5
Oct 18 11:52:17 user nova-compute[74190]: node.conn[0].timeo.noop_out_timeout = 5
Oct 18 11:52:17 user nova-compute[74190]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Oct 18 11:52:17 user nova-compute[74190]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Oct 18 11:52:17 user nova-compute[74190]: node.conn[0].iscsi.HeaderDigest = None
Oct 18 11:52:17 user nova-compute[74190]: node.conn[0].iscsi.DataDigest = None
Oct 18 11:52:17 user nova-compute[74190]: node.conn[0].iscsi.IFMarker = No
Oct 18 11:52:17 user nova-compute[74190]: node.conn[0].iscsi.OFMarker = No
Oct 18 11:52:17 user nova-compute[74190]: # END RECORD
Oct 18 11:52:17 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:52:17 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:17 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.032s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:17 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9578af6-74f1-409c-b755-5558f6328ff9]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:52:17 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:52:17 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:17 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:17 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[a74e8213-7c9c-45dc-985a-5c16c1651842]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:52:17 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:52:17 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jMIouEKV {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:17 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jMIouEKV" returned: 0 in 0.022s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:17 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bdc4fc4-2bd0-4049-a69d-af472a65ffe0]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:52:17 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jMIouEKV'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:52:17 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:17 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:17 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa89e73f-f956-4712-b274-2b5a3feb4959]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:52:17 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:52:17 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:17 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:17 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbab90c4-7bc5-4fb5-91af-93a140228bb3]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:011ac309-ad42-43cc-ab45-e09e022b6e56 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17a1c8f7-ad7d-4b2a-863f-561e1c18768a (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:52:17 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a (non-flash)
Oct 18 11:52:17 user nova-compute[74190]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:011ac309-ad42-43cc-ab45-e09e022b6e56 (non-flash)
Oct 18 11:52:17 user nova-compute[74190]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17a1c8f7-ad7d-4b2a-863f-561e1c18768a (non-flash)
Oct 18 11:52:17 user nova-compute[74190]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 11:52:17 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:52:17 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a (non-flash)
Oct 18 11:52:17 user nova-compute[74190]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:011ac309-ad42-43cc-ab45-e09e022b6e56 (non-flash)
Oct 18 11:52:17 user nova-compute[74190]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17a1c8f7-ad7d-4b2a-863f-561e1c18768a (non-flash)
Oct 18 11:52:17 user nova-compute[74190]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 11:52:17 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:52:17 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.179s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:52:17 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Connected to 172.16.0.220:3260 {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 11:52:17 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] HCTL ('34', '0', '0', 0) found on session 27 with lun 0 {{(pid=74190) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 11:52:17 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=74190) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 11:52:17 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:17 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:17 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd86953c-db24-40f4-9fe6-5d40b0e46d22]: (4, ('0 0 0', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:52:17 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Searching for a device in session 27 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=74190) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 11:52:17 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jMIouEKV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 11:52:17 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.205s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:52:17 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] <== connect_volume: return (207ms) {'type': 'block', 'scsi_wwn': '26462346534633330', 'path': '/dev/sdc'} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:52:17 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26462346534633330', 'path': '/dev/sdc'} {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 11:52:17 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:48:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1239510214',display_name='tempest-ServerStableDeviceRescueTest-server-1239510214',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1239510214',id=15,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDzj5UAT4iUqANSvOBkAoJEwMfUM16idg1NibS//oAl0VdU9TP7e54hP2zexPvt5KYwy6IiTFUli5lpncFsKpJEn0+n2xJbrGOus7ZAEqg7XexOxHCi0AyMnjk7r++Fq+A==',key_name='tempest-keypair-1340095913',keypairs=<?>,launch_index=0,launched_at=2023-10-18T11:48:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8a4f041e58144d54a458a01074eb35a4',ramdisk_id='',reservation_id='r-4olb5240',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1127867733',owner_user_name='tempest-ServerStableDeviceRescueTest-1127867733-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:50:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0289211c145a424d8b9350aa69bc435d',uuid=4e916d24-9f9d-4289-87ce-f65d2499fcd9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7cee893b-5ac8-45f8-a1f8-5374b49cc3b5", "address": "fa:16:3e:15:15:1d", "network": {"id": "4609cfba-1e8b-4740-bdf6-642b196097a3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1019354168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1019354168-network", "vif_mac": "fa:16:3e:15:15:1d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a4f041e58144d54a458a01074eb35a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cee893b-5a", "ovs_interfaceid": "7cee893b-5ac8-45f8-a1f8-5374b49cc3b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74190) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 11:52:17 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Converting VIF {"id": "7cee893b-5ac8-45f8-a1f8-5374b49cc3b5", "address": "fa:16:3e:15:15:1d", "network": {"id": "4609cfba-1e8b-4740-bdf6-642b196097a3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1019354168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1019354168-network", "vif_mac": "fa:16:3e:15:15:1d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a4f041e58144d54a458a01074eb35a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cee893b-5a", "ovs_interfaceid": "7cee893b-5ac8-45f8-a1f8-5374b49cc3b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:52:17 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:15:15:1d,bridge_name='br-int',has_traffic_filtering=True,id=7cee893b-5ac8-45f8-a1f8-5374b49cc3b5,network=Network(4609cfba-1e8b-4740-bdf6-642b196097a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cee893b-5a') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:52:17 user nova-compute[74190]: DEBUG nova.objects.instance [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Lazy-loading 'pci_devices' on Instance uuid 4e916d24-9f9d-4289-87ce-f65d2499fcd9 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:52:17 user nova-compute[74190]: DEBUG nova.objects.base [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Object Instance<4e916d24-9f9d-4289-87ce-f65d2499fcd9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74190) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 11:52:17 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] End _get_guest_xml xml=<domain type="kvm">
Oct 18 11:52:17 user nova-compute[74190]:   <uuid>4e916d24-9f9d-4289-87ce-f65d2499fcd9</uuid>
Oct 18 11:52:17 user nova-compute[74190]:   <name>instance-0000000f</name>
Oct 18 11:52:17 user nova-compute[74190]:   <memory>524288</memory>
Oct 18 11:52:17 user nova-compute[74190]:   <vcpu>1</vcpu>
Oct 18 11:52:17 user nova-compute[74190]:   <metadata>
Oct 18 11:52:17 user nova-compute[74190]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 11:52:17 user nova-compute[74190]:       <nova:package version="0.0.0"/>
Oct 18 11:52:17 user nova-compute[74190]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1239510214</nova:name>
Oct 18 11:52:17 user nova-compute[74190]:       <nova:creationTime>2023-10-18 11:52:17</nova:creationTime>
Oct 18 11:52:17 user nova-compute[74190]:       <nova:flavor name="m1.tiny">
Oct 18 11:52:17 user nova-compute[74190]:         <nova:memory>512</nova:memory>
Oct 18 11:52:17 user nova-compute[74190]:         <nova:disk>1</nova:disk>
Oct 18 11:52:17 user nova-compute[74190]:         <nova:swap>0</nova:swap>
Oct 18 11:52:17 user nova-compute[74190]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 11:52:17 user nova-compute[74190]:         <nova:vcpus>1</nova:vcpus>
Oct 18 11:52:17 user nova-compute[74190]:       </nova:flavor>
Oct 18 11:52:17 user nova-compute[74190]:       <nova:owner>
Oct 18 11:52:17 user nova-compute[74190]:         <nova:user uuid="0289211c145a424d8b9350aa69bc435d">tempest-ServerStableDeviceRescueTest-1127867733-project-member</nova:user>
Oct 18 11:52:17 user nova-compute[74190]:         <nova:project uuid="8a4f041e58144d54a458a01074eb35a4">tempest-ServerStableDeviceRescueTest-1127867733</nova:project>
Oct 18 11:52:17 user nova-compute[74190]:       </nova:owner>
Oct 18 11:52:17 user nova-compute[74190]:       <nova:root type="image" uuid="6e88bbf0-6e78-49a8-b3c5-9453d22a89df"/>
Oct 18 11:52:17 user nova-compute[74190]:       <nova:ports>
Oct 18 11:52:17 user nova-compute[74190]:         <nova:port uuid="7cee893b-5ac8-45f8-a1f8-5374b49cc3b5">
Oct 18 11:52:17 user nova-compute[74190]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 18 11:52:17 user nova-compute[74190]:         </nova:port>
Oct 18 11:52:17 user nova-compute[74190]:       </nova:ports>
Oct 18 11:52:17 user nova-compute[74190]:     </nova:instance>
Oct 18 11:52:17 user nova-compute[74190]:   </metadata>
Oct 18 11:52:17 user nova-compute[74190]:   <sysinfo type="smbios">
Oct 18 11:52:17 user nova-compute[74190]:     <system>
Oct 18 11:52:17 user nova-compute[74190]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 11:52:17 user nova-compute[74190]:       <entry name="product">OpenStack Nova</entry>
Oct 18 11:52:17 user nova-compute[74190]:       <entry name="version">0.0.0</entry>
Oct 18 11:52:17 user nova-compute[74190]:       <entry name="serial">4e916d24-9f9d-4289-87ce-f65d2499fcd9</entry>
Oct 18 11:52:17 user nova-compute[74190]:       <entry name="uuid">4e916d24-9f9d-4289-87ce-f65d2499fcd9</entry>
Oct 18 11:52:17 user nova-compute[74190]:       <entry name="family">Virtual Machine</entry>
Oct 18 11:52:17 user nova-compute[74190]:     </system>
Oct 18 11:52:17 user nova-compute[74190]:   </sysinfo>
Oct 18 11:52:17 user nova-compute[74190]:   <os>
Oct 18 11:52:17 user nova-compute[74190]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 11:52:17 user nova-compute[74190]:     <smbios mode="sysinfo"/>
Oct 18 11:52:17 user nova-compute[74190]:   </os>
Oct 18 11:52:17 user nova-compute[74190]:   <features>
Oct 18 11:52:17 user nova-compute[74190]:     <acpi/>
Oct 18 11:52:17 user nova-compute[74190]:     <apic/>
Oct 18 11:52:17 user nova-compute[74190]:     <vmcoreinfo/>
Oct 18 11:52:17 user nova-compute[74190]:   </features>
Oct 18 11:52:17 user nova-compute[74190]:   <clock offset="utc">
Oct 18 11:52:17 user nova-compute[74190]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 11:52:17 user nova-compute[74190]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 11:52:17 user nova-compute[74190]:     <timer name="hpet" present="no"/>
Oct 18 11:52:17 user nova-compute[74190]:   </clock>
Oct 18 11:52:17 user nova-compute[74190]:   <cpu mode="custom" match="exact">
Oct 18 11:52:17 user nova-compute[74190]:     <model>Nehalem</model>
Oct 18 11:52:17 user nova-compute[74190]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 11:52:17 user nova-compute[74190]:   </cpu>
Oct 18 11:52:17 user nova-compute[74190]:   <devices>
Oct 18 11:52:17 user nova-compute[74190]:     <disk type="file" device="disk">
Oct 18 11:52:17 user nova-compute[74190]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 11:52:17 user nova-compute[74190]:       <source file="/opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk"/>
Oct 18 11:52:17 user nova-compute[74190]:       <target dev="vda" bus="virtio"/>
Oct 18 11:52:17 user nova-compute[74190]:     </disk>
Oct 18 11:52:17 user nova-compute[74190]:     <disk type="block" device="disk">
Oct 18 11:52:17 user nova-compute[74190]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 11:52:17 user nova-compute[74190]:       <source dev="/dev/sdc"/>
Oct 18 11:52:17 user nova-compute[74190]:       <target dev="vdb" bus="virtio"/>
Oct 18 11:52:17 user nova-compute[74190]:       <serial>226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa</serial>
Oct 18 11:52:17 user nova-compute[74190]:     </disk>
Oct 18 11:52:17 user nova-compute[74190]:     <disk type="file" device="disk">
Oct 18 11:52:17 user nova-compute[74190]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 11:52:17 user nova-compute[74190]:       <source file="/opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk.rescue"/>
Oct 18 11:52:17 user nova-compute[74190]:       <target dev="vdc" bus="virtio"/>
Oct 18 11:52:17 user nova-compute[74190]:       <boot order="1"/>
Oct 18 11:52:17 user nova-compute[74190]:     </disk>
Oct 18 11:52:17 user nova-compute[74190]:     <interface type="ethernet">
Oct 18 11:52:17 user nova-compute[74190]:       <mac address="fa:16:3e:15:15:1d"/>
Oct 18 11:52:17 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:52:17 user nova-compute[74190]:       <mtu size="1442"/>
Oct 18 11:52:17 user nova-compute[74190]:       <target dev="tap7cee893b-5a"/>
Oct 18 11:52:17 user nova-compute[74190]:     </interface>
Oct 18 11:52:17 user nova-compute[74190]:     <serial type="pty">
Oct 18 11:52:17 user nova-compute[74190]:       <log file="/opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/console.log" append="off"/>
Oct 18 11:52:17 user nova-compute[74190]:     </serial>
Oct 18 11:52:17 user nova-compute[74190]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 11:52:17 user nova-compute[74190]:     <video>
Oct 18 11:52:17 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:52:17 user nova-compute[74190]:     </video>
Oct 18 11:52:17 user nova-compute[74190]:     <rng model="virtio">
Oct 18 11:52:17 user nova-compute[74190]:       <backend model="random">/dev/urandom</backend>
Oct 18 11:52:17 user nova-compute[74190]:     </rng>
Oct 18 11:52:17 user nova-compute[74190]:     <controller type="usb" index="0" model="none"/>
Oct 18 11:52:17 user nova-compute[74190]:     <memballoon model="virtio">
Oct 18 11:52:17 user nova-compute[74190]:       <stats period="10"/>
Oct 18 11:52:17 user nova-compute[74190]:     </memballoon>
Oct 18 11:52:17 user nova-compute[74190]:   </devices>
Oct 18 11:52:17 user nova-compute[74190]: </domain>
Oct 18 11:52:17 user nova-compute[74190]:  {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 11:52:17 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Instance destroyed successfully.
Oct 18 11:52:17 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] No BDM found with device name vda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 11:52:17 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 11:52:17 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 11:52:17 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] No VIF found with MAC fa:16:3e:15:15:1d, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 11:52:18 user nova-compute[74190]: DEBUG nova.compute.manager [req-f0088ffa-3790-4468-beb5-2b8b196a498c req-11b34e8c-6a0c-445a-97bc-f085d0ca781f service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Received event network-changed-c2ed33ff-2096-4def-98c5-709db8bc0ea4 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:52:18 user nova-compute[74190]: DEBUG nova.compute.manager [req-f0088ffa-3790-4468-beb5-2b8b196a498c req-11b34e8c-6a0c-445a-97bc-f085d0ca781f service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Refreshing instance network info cache due to event network-changed-c2ed33ff-2096-4def-98c5-709db8bc0ea4. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 11:52:18 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-f0088ffa-3790-4468-beb5-2b8b196a498c req-11b34e8c-6a0c-445a-97bc-f085d0ca781f service nova] Acquiring lock "refresh_cache-cd28be8d-847b-468c-860f-4f479740738d" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:52:18 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-f0088ffa-3790-4468-beb5-2b8b196a498c req-11b34e8c-6a0c-445a-97bc-f085d0ca781f service nova] Acquired lock "refresh_cache-cd28be8d-847b-468c-860f-4f479740738d" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:52:18 user nova-compute[74190]: DEBUG nova.network.neutron [req-f0088ffa-3790-4468-beb5-2b8b196a498c req-11b34e8c-6a0c-445a-97bc-f085d0ca781f service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Refreshing network info cache for port c2ed33ff-2096-4def-98c5-709db8bc0ea4 {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 11:52:18 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:18 user nova-compute[74190]: DEBUG nova.network.neutron [req-f0088ffa-3790-4468-beb5-2b8b196a498c req-11b34e8c-6a0c-445a-97bc-f085d0ca781f service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Updated VIF entry in instance network info cache for port c2ed33ff-2096-4def-98c5-709db8bc0ea4. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 11:52:18 user nova-compute[74190]: DEBUG nova.network.neutron [req-f0088ffa-3790-4468-beb5-2b8b196a498c req-11b34e8c-6a0c-445a-97bc-f085d0ca781f service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Updating instance_info_cache with network_info: [{"id": "c2ed33ff-2096-4def-98c5-709db8bc0ea4", "address": "fa:16:3e:11:db:57", "network": {"id": "bef90182-e108-423e-842c-2037d5cc1a4b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-640378484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ed33ff-20", "ovs_interfaceid": "c2ed33ff-2096-4def-98c5-709db8bc0ea4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "aca29f48-4a6d-472a-ac70-7006b63b9996", "address": "fa:16:3e:71:0a:c4", "network": {"id": "50f9056b-d85d-4a43-8981-3c5c98e1bf52", "bridge": "br-int", "label": "tempest-device-tagging-net1-737454421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaca29f48-4a", "ovs_interfaceid": "aca29f48-4a6d-472a-ac70-7006b63b9996", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d5f803c0-bb6c-41be-8294-fb3565e03413", "address": "fa:16:3e:43:be:0d", "network": {"id": "50f9056b-d85d-4a43-8981-3c5c98e1bf52", "bridge": "br-int", "label": "tempest-device-tagging-net1-737454421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f803c0-bb", "ovs_interfaceid": "d5f803c0-bb6c-41be-8294-fb3565e03413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0a00abcf-957e-4276-a975-522f8a42ad55", "address": "fa:16:3e:c8:b9:46", "network": {"id": "50f9056b-d85d-4a43-8981-3c5c98e1bf52", "bridge": "br-int", "label": "tempest-device-tagging-net1-737454421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a00abcf-95", "ovs_interfaceid": "0a00abcf-957e-4276-a975-522f8a42ad55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "11c7c4ff-db41-4231-8300-ee85a94619c1", "address": "fa:16:3e:ca:c8:e5", "network": {"id": "50f9056b-d85d-4a43-8981-3c5c98e1bf52", "bridge": "br-int", "label": "tempest-device-tagging-net1-737454421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11c7c4ff-db", "ovs_interfaceid": "11c7c4ff-db41-4231-8300-ee85a94619c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dba85cc3-dd42-4fa4-96d3-bec15903344f", "address": "fa:16:3e:fb:32:89", "network": {"id": "1ba257ec-d104-413d-bbf9-d9702ed5a1b4", "bridge": "br-int", "label": "tempest-device-tagging-net2-445498545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdba85cc3-dd", "ovs_interfaceid": "dba85cc3-dd42-4fa4-96d3-bec15903344f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "35f010df-56fb-4234-879b-19f86f36a2d3", "address": "fa:16:3e:bf:a7:36", "network": {"id": "1ba257ec-d104-413d-bbf9-d9702ed5a1b4", "bridge": "br-int", "label": "tempest-device-tagging-net2-445498545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35f010df-56", "ovs_interfaceid": "35f010df-56fb-4234-879b-19f86f36a2d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:52:18 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-f0088ffa-3790-4468-beb5-2b8b196a498c req-11b34e8c-6a0c-445a-97bc-f085d0ca781f service nova] Releasing lock "refresh_cache-cd28be8d-847b-468c-860f-4f479740738d" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:52:19 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:19 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:19 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:19 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:20 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:20 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:20 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:21 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:21 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Acquiring lock "cd28be8d-847b-468c-860f-4f479740738d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:52:21 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Lock "cd28be8d-847b-468c-860f-4f479740738d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:52:21 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Acquiring lock "cd28be8d-847b-468c-860f-4f479740738d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:52:21 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Lock "cd28be8d-847b-468c-860f-4f479740738d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:52:21 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Lock "cd28be8d-847b-468c-860f-4f479740738d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:52:21 user nova-compute[74190]: INFO nova.compute.manager [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] [instance: cd28be8d-847b-468c-860f-4f479740738d] Terminating instance
Oct 18 11:52:21 user nova-compute[74190]: DEBUG nova.compute.manager [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] [instance: cd28be8d-847b-468c-860f-4f479740738d] Start destroying the instance on the hypervisor. {{(pid=74190) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 11:52:21 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:21 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:21 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:21 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:21 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:21 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:21 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:21 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:21 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:21 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:21 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:21 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:22 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:22 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:22 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:22 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:22 user nova-compute[74190]: DEBUG nova.compute.manager [req-c2610a47-cb43-459d-a93d-4d5d37dab463 req-a54f9cca-58cd-412c-be4b-fc5736c37c6e service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Received event network-vif-unplugged-c2ed33ff-2096-4def-98c5-709db8bc0ea4 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:52:22 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-c2610a47-cb43-459d-a93d-4d5d37dab463 req-a54f9cca-58cd-412c-be4b-fc5736c37c6e service nova] Acquiring lock "cd28be8d-847b-468c-860f-4f479740738d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:52:22 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-c2610a47-cb43-459d-a93d-4d5d37dab463 req-a54f9cca-58cd-412c-be4b-fc5736c37c6e service nova] Lock "cd28be8d-847b-468c-860f-4f479740738d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:52:22 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-c2610a47-cb43-459d-a93d-4d5d37dab463 req-a54f9cca-58cd-412c-be4b-fc5736c37c6e service nova] Lock "cd28be8d-847b-468c-860f-4f479740738d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:52:22 user nova-compute[74190]: DEBUG nova.compute.manager [req-c2610a47-cb43-459d-a93d-4d5d37dab463 req-a54f9cca-58cd-412c-be4b-fc5736c37c6e service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] No waiting events found dispatching network-vif-unplugged-c2ed33ff-2096-4def-98c5-709db8bc0ea4 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:52:22 user nova-compute[74190]: DEBUG nova.compute.manager [req-c2610a47-cb43-459d-a93d-4d5d37dab463 req-a54f9cca-58cd-412c-be4b-fc5736c37c6e service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Received event network-vif-unplugged-c2ed33ff-2096-4def-98c5-709db8bc0ea4 for instance with task_state deleting. {{(pid=74190) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 11:52:22 user nova-compute[74190]: DEBUG nova.compute.manager [None req-509f3538-168d-4a0a-90c1-1731079bad65 tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Checking state {{(pid=74190) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 11:52:22 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:22 user nova-compute[74190]: DEBUG nova.compute.manager [req-266094ea-06ca-4447-8030-7955968f4c9f req-fed06511-bdee-4f85-8251-4a7d37305416 service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Received event network-vif-unplugged-11c7c4ff-db41-4231-8300-ee85a94619c1 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:52:22 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-266094ea-06ca-4447-8030-7955968f4c9f req-fed06511-bdee-4f85-8251-4a7d37305416 service nova] Acquiring lock "cd28be8d-847b-468c-860f-4f479740738d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:52:22 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-266094ea-06ca-4447-8030-7955968f4c9f req-fed06511-bdee-4f85-8251-4a7d37305416 service nova] Lock "cd28be8d-847b-468c-860f-4f479740738d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:52:22 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-266094ea-06ca-4447-8030-7955968f4c9f req-fed06511-bdee-4f85-8251-4a7d37305416 service nova] Lock "cd28be8d-847b-468c-860f-4f479740738d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:52:22 user nova-compute[74190]: DEBUG nova.compute.manager [req-266094ea-06ca-4447-8030-7955968f4c9f req-fed06511-bdee-4f85-8251-4a7d37305416 service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] No waiting events found dispatching network-vif-unplugged-11c7c4ff-db41-4231-8300-ee85a94619c1 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:52:22 user nova-compute[74190]: DEBUG nova.compute.manager [req-266094ea-06ca-4447-8030-7955968f4c9f req-fed06511-bdee-4f85-8251-4a7d37305416 service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Received event network-vif-unplugged-11c7c4ff-db41-4231-8300-ee85a94619c1 for instance with task_state deleting. {{(pid=74190) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 11:52:22 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:22 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:22 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:22 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-cb1b3c45-07fb-4d41-8cc4-87acccba66c5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Acquiring lock "47ed3fb0-c159-484f-8380-79b5564d0ac1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:52:22 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-cb1b3c45-07fb-4d41-8cc4-87acccba66c5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lock "47ed3fb0-c159-484f-8380-79b5564d0ac1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:52:22 user nova-compute[74190]: DEBUG nova.compute.manager [None req-cb1b3c45-07fb-4d41-8cc4-87acccba66c5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: 47ed3fb0-c159-484f-8380-79b5564d0ac1] Starting instance... {{(pid=74190) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 11:52:23 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-cb1b3c45-07fb-4d41-8cc4-87acccba66c5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:52:23 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-cb1b3c45-07fb-4d41-8cc4-87acccba66c5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:52:23 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: cd28be8d-847b-468c-860f-4f479740738d] Instance destroyed successfully.
Oct 18 11:52:23 user nova-compute[74190]: DEBUG nova.objects.instance [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Lazy-loading 'resources' on Instance uuid cd28be8d-847b-468c-860f-4f479740738d {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:52:23 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-cb1b3c45-07fb-4d41-8cc4-87acccba66c5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74190) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 11:52:23 user nova-compute[74190]: INFO nova.compute.claims [None req-cb1b3c45-07fb-4d41-8cc4-87acccba66c5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: 47ed3fb0-c159-484f-8380-79b5564d0ac1] Claim successful on node user
Oct 18 11:52:23 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T11:49:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1070511893',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1070511893',id=18,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKBVslbZEBCyddD78nfODxLMQOA10HLdeoyHJpwL0LX2DVFby+C6OMMAsTj4P/vGPT3eFNKVrplFcT2qxWYSTR79oTFsUZwl238caZpIs58KdEidArGj0m+IHMu+D/m5Dg==',key_name='tempest-keypair-232390733',keypairs=<?>,launch_index=0,launched_at=2023-10-18T11:50:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='daccec0feffd445492c3ab4ff40bcde2',ramdisk_id='',reservation_id='r-ugx6bgpm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1710887731',owner_user_name='tempest-TaggedBootDevicesTest-1710887731-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T11:50:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8f517ba22b1494ca5700e014e7ab8b9',uuid=cd28be8d-847b-468c-860f-4f479740738d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c2ed33ff-2096-4def-98c5-709db8bc0ea4", "address": "fa:16:3e:11:db:57", "network": {"id": "bef90182-e108-423e-842c-2037d5cc1a4b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-640378484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ed33ff-20", "ovs_interfaceid": "c2ed33ff-2096-4def-98c5-709db8bc0ea4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 11:52:23 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Converting VIF {"id": "c2ed33ff-2096-4def-98c5-709db8bc0ea4", "address": "fa:16:3e:11:db:57", "network": {"id": "bef90182-e108-423e-842c-2037d5cc1a4b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-640378484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ed33ff-20", "ovs_interfaceid": "c2ed33ff-2096-4def-98c5-709db8bc0ea4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:52:23 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:11:db:57,bridge_name='br-int',has_traffic_filtering=True,id=c2ed33ff-2096-4def-98c5-709db8bc0ea4,network=Network(bef90182-e108-423e-842c-2037d5cc1a4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2ed33ff-20') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:52:23 user nova-compute[74190]: DEBUG os_vif [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:db:57,bridge_name='br-int',has_traffic_filtering=True,id=c2ed33ff-2096-4def-98c5-709db8bc0ea4,network=Network(bef90182-e108-423e-842c-2037d5cc1a4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2ed33ff-20') {{(pid=74190) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 11:52:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc2ed33ff-20, bridge=br-int, if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:52:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:52:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c59a1851-6149-4db2-9645-c682645eeba1) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:52:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:52:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:23 user nova-compute[74190]: INFO os_vif [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:db:57,bridge_name='br-int',has_traffic_filtering=True,id=c2ed33ff-2096-4def-98c5-709db8bc0ea4,network=Network(bef90182-e108-423e-842c-2037d5cc1a4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2ed33ff-20')
Oct 18 11:52:23 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T11:49:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1070511893',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1070511893',id=18,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKBVslbZEBCyddD78nfODxLMQOA10HLdeoyHJpwL0LX2DVFby+C6OMMAsTj4P/vGPT3eFNKVrplFcT2qxWYSTR79oTFsUZwl238caZpIs58KdEidArGj0m+IHMu+D/m5Dg==',key_name='tempest-keypair-232390733',keypairs=<?>,launch_index=0,launched_at=2023-10-18T11:50:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='daccec0feffd445492c3ab4ff40bcde2',ramdisk_id='',reservation_id='r-ugx6bgpm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1710887731',owner_user_name='tempest-TaggedBootDevicesTest-1710887731-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T11:50:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8f517ba22b1494ca5700e014e7ab8b9',uuid=cd28be8d-847b-468c-860f-4f479740738d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aca29f48-4a6d-472a-ac70-7006b63b9996", "address": "fa:16:3e:71:0a:c4", "network": {"id": "50f9056b-d85d-4a43-8981-3c5c98e1bf52", "bridge": "br-int", "label": "tempest-device-tagging-net1-737454421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaca29f48-4a", "ovs_interfaceid": "aca29f48-4a6d-472a-ac70-7006b63b9996", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74190) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 11:52:23 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Converting VIF {"id": "aca29f48-4a6d-472a-ac70-7006b63b9996", "address": "fa:16:3e:71:0a:c4", "network": {"id": "50f9056b-d85d-4a43-8981-3c5c98e1bf52", "bridge": "br-int", "label": "tempest-device-tagging-net1-737454421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaca29f48-4a", "ovs_interfaceid": "aca29f48-4a6d-472a-ac70-7006b63b9996", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:52:23 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:0a:c4,bridge_name='br-int',has_traffic_filtering=True,id=aca29f48-4a6d-472a-ac70-7006b63b9996,network=Network(50f9056b-d85d-4a43-8981-3c5c98e1bf52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapaca29f48-4a') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:52:23 user nova-compute[74190]: DEBUG os_vif [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:0a:c4,bridge_name='br-int',has_traffic_filtering=True,id=aca29f48-4a6d-472a-ac70-7006b63b9996,network=Network(50f9056b-d85d-4a43-8981-3c5c98e1bf52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapaca29f48-4a') {{(pid=74190) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 11:52:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaca29f48-4a, bridge=br-int, if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:52:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:52:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5c9c0ee7-db49-45a0-9fe0-1e6d382096c5) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:52:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:52:23 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-cb1b3c45-07fb-4d41-8cc4-87acccba66c5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 11:52:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:23 user nova-compute[74190]: INFO os_vif [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:0a:c4,bridge_name='br-int',has_traffic_filtering=True,id=aca29f48-4a6d-472a-ac70-7006b63b9996,network=Network(50f9056b-d85d-4a43-8981-3c5c98e1bf52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapaca29f48-4a')
Oct 18 11:52:23 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T11:49:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1070511893',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1070511893',id=18,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKBVslbZEBCyddD78nfODxLMQOA10HLdeoyHJpwL0LX2DVFby+C6OMMAsTj4P/vGPT3eFNKVrplFcT2qxWYSTR79oTFsUZwl238caZpIs58KdEidArGj0m+IHMu+D/m5Dg==',key_name='tempest-keypair-232390733',keypairs=<?>,launch_index=0,launched_at=2023-10-18T11:50:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='daccec0feffd445492c3ab4ff40bcde2',ramdisk_id='',reservation_id='r-ugx6bgpm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1710887731',owner_user_name='tempest-TaggedBootDevicesTest-1710887731-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T11:50:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8f517ba22b1494ca5700e014e7ab8b9',uuid=cd28be8d-847b-468c-860f-4f479740738d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d5f803c0-bb6c-41be-8294-fb3565e03413", "address": "fa:16:3e:43:be:0d", "network": {"id": "50f9056b-d85d-4a43-8981-3c5c98e1bf52", "bridge": "br-int", "label": "tempest-device-tagging-net1-737454421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f803c0-bb", "ovs_interfaceid": "d5f803c0-bb6c-41be-8294-fb3565e03413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74190) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 11:52:23 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Converting VIF {"id": "d5f803c0-bb6c-41be-8294-fb3565e03413", "address": "fa:16:3e:43:be:0d", "network": {"id": "50f9056b-d85d-4a43-8981-3c5c98e1bf52", "bridge": "br-int", "label": "tempest-device-tagging-net1-737454421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f803c0-bb", "ovs_interfaceid": "d5f803c0-bb6c-41be-8294-fb3565e03413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:52:23 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:be:0d,bridge_name='br-int',has_traffic_filtering=True,id=d5f803c0-bb6c-41be-8294-fb3565e03413,network=Network(50f9056b-d85d-4a43-8981-3c5c98e1bf52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd5f803c0-bb') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:52:23 user nova-compute[74190]: DEBUG os_vif [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:be:0d,bridge_name='br-int',has_traffic_filtering=True,id=d5f803c0-bb6c-41be-8294-fb3565e03413,network=Network(50f9056b-d85d-4a43-8981-3c5c98e1bf52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd5f803c0-bb') {{(pid=74190) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 11:52:23 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-cb1b3c45-07fb-4d41-8cc4-87acccba66c5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 11:52:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd5f803c0-bb, bridge=br-int, if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:52:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:52:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5ca566b3-c46b-48ec-aebd-e4c14a30a8fb) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:52:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:52:23 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-cb1b3c45-07fb-4d41-8cc4-87acccba66c5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.491s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:52:23 user nova-compute[74190]: DEBUG nova.compute.manager [None req-cb1b3c45-07fb-4d41-8cc4-87acccba66c5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: 47ed3fb0-c159-484f-8380-79b5564d0ac1] Start building networks asynchronously for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 11:52:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:23 user nova-compute[74190]: INFO os_vif [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:be:0d,bridge_name='br-int',has_traffic_filtering=True,id=d5f803c0-bb6c-41be-8294-fb3565e03413,network=Network(50f9056b-d85d-4a43-8981-3c5c98e1bf52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd5f803c0-bb')
Oct 18 11:52:23 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T11:49:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1070511893',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1070511893',id=18,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKBVslbZEBCyddD78nfODxLMQOA10HLdeoyHJpwL0LX2DVFby+C6OMMAsTj4P/vGPT3eFNKVrplFcT2qxWYSTR79oTFsUZwl238caZpIs58KdEidArGj0m+IHMu+D/m5Dg==',key_name='tempest-keypair-232390733',keypairs=<?>,launch_index=0,launched_at=2023-10-18T11:50:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='daccec0feffd445492c3ab4ff40bcde2',ramdisk_id='',reservation_id='r-ugx6bgpm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1710887731',owner_user_name='tempest-TaggedBootDevicesTest-1710887731-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T11:50:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8f517ba22b1494ca5700e014e7ab8b9',uuid=cd28be8d-847b-468c-860f-4f479740738d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0a00abcf-957e-4276-a975-522f8a42ad55", "address": "fa:16:3e:c8:b9:46", "network": {"id": "50f9056b-d85d-4a43-8981-3c5c98e1bf52", "bridge": "br-int", "label": "tempest-device-tagging-net1-737454421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a00abcf-95", "ovs_interfaceid": "0a00abcf-957e-4276-a975-522f8a42ad55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 11:52:23 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Converting VIF {"id": "0a00abcf-957e-4276-a975-522f8a42ad55", "address": "fa:16:3e:c8:b9:46", "network": {"id": "50f9056b-d85d-4a43-8981-3c5c98e1bf52", "bridge": "br-int", "label": "tempest-device-tagging-net1-737454421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a00abcf-95", "ovs_interfaceid": "0a00abcf-957e-4276-a975-522f8a42ad55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:52:23 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:b9:46,bridge_name='br-int',has_traffic_filtering=True,id=0a00abcf-957e-4276-a975-522f8a42ad55,network=Network(50f9056b-d85d-4a43-8981-3c5c98e1bf52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a00abcf-95') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:52:23 user nova-compute[74190]: DEBUG os_vif [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:b9:46,bridge_name='br-int',has_traffic_filtering=True,id=0a00abcf-957e-4276-a975-522f8a42ad55,network=Network(50f9056b-d85d-4a43-8981-3c5c98e1bf52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a00abcf-95') {{(pid=74190) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 11:52:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0a00abcf-95, bridge=br-int, if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:52:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:52:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=78362c57-e798-41c3-ac38-cc7fdb3bbf48) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:52:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:52:23 user nova-compute[74190]: DEBUG nova.compute.manager [None req-cb1b3c45-07fb-4d41-8cc4-87acccba66c5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: 47ed3fb0-c159-484f-8380-79b5564d0ac1] Allocating IP information in the background. {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 11:52:23 user nova-compute[74190]: DEBUG nova.network.neutron [None req-cb1b3c45-07fb-4d41-8cc4-87acccba66c5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: 47ed3fb0-c159-484f-8380-79b5564d0ac1] allocate_for_instance() {{(pid=74190) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 11:52:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:23 user nova-compute[74190]: INFO os_vif [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:b9:46,bridge_name='br-int',has_traffic_filtering=True,id=0a00abcf-957e-4276-a975-522f8a42ad55,network=Network(50f9056b-d85d-4a43-8981-3c5c98e1bf52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a00abcf-95')
Oct 18 11:52:23 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T11:49:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1070511893',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1070511893',id=18,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKBVslbZEBCyddD78nfODxLMQOA10HLdeoyHJpwL0LX2DVFby+C6OMMAsTj4P/vGPT3eFNKVrplFcT2qxWYSTR79oTFsUZwl238caZpIs58KdEidArGj0m+IHMu+D/m5Dg==',key_name='tempest-keypair-232390733',keypairs=<?>,launch_index=0,launched_at=2023-10-18T11:50:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='daccec0feffd445492c3ab4ff40bcde2',ramdisk_id='',reservation_id='r-ugx6bgpm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1710887731',owner_user_name='tempest-TaggedBootDevicesTest-1710887731-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T11:50:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8f517ba22b1494ca5700e014e7ab8b9',uuid=cd28be8d-847b-468c-860f-4f479740738d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "11c7c4ff-db41-4231-8300-ee85a94619c1", "address": "fa:16:3e:ca:c8:e5", "network": {"id": "50f9056b-d85d-4a43-8981-3c5c98e1bf52", "bridge": "br-int", "label": "tempest-device-tagging-net1-737454421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11c7c4ff-db", "ovs_interfaceid": "11c7c4ff-db41-4231-8300-ee85a94619c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 11:52:23 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Converting VIF {"id": "11c7c4ff-db41-4231-8300-ee85a94619c1", "address": "fa:16:3e:ca:c8:e5", "network": {"id": "50f9056b-d85d-4a43-8981-3c5c98e1bf52", "bridge": "br-int", "label": "tempest-device-tagging-net1-737454421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11c7c4ff-db", "ovs_interfaceid": "11c7c4ff-db41-4231-8300-ee85a94619c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:52:23 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:c8:e5,bridge_name='br-int',has_traffic_filtering=True,id=11c7c4ff-db41-4231-8300-ee85a94619c1,network=Network(50f9056b-d85d-4a43-8981-3c5c98e1bf52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11c7c4ff-db') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:52:23 user nova-compute[74190]: DEBUG os_vif [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:c8:e5,bridge_name='br-int',has_traffic_filtering=True,id=11c7c4ff-db41-4231-8300-ee85a94619c1,network=Network(50f9056b-d85d-4a43-8981-3c5c98e1bf52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11c7c4ff-db') {{(pid=74190) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 11:52:23 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-cb1b3c45-07fb-4d41-8cc4-87acccba66c5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: 47ed3fb0-c159-484f-8380-79b5564d0ac1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 11:52:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap11c7c4ff-db, bridge=br-int, if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:52:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:52:23 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-1343bb93-97ce-4b75-82f7-10077af96c3c tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Acquiring lock "8eec9cde-3553-4fc8-9162-cda963d1a81e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:52:23 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-1343bb93-97ce-4b75-82f7-10077af96c3c tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Lock "8eec9cde-3553-4fc8-9162-cda963d1a81e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:52:23 user nova-compute[74190]: DEBUG nova.compute.manager [None req-cb1b3c45-07fb-4d41-8cc4-87acccba66c5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: 47ed3fb0-c159-484f-8380-79b5564d0ac1] Start building block device mappings for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 11:52:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d4eb7dc0-91fd-4b4a-8ef5-25123623de8a) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:52:23 user nova-compute[74190]: DEBUG nova.compute.manager [None req-1343bb93-97ce-4b75-82f7-10077af96c3c tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] Starting instance... {{(pid=74190) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 11:52:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:52:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:23 user nova-compute[74190]: INFO os_vif [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:c8:e5,bridge_name='br-int',has_traffic_filtering=True,id=11c7c4ff-db41-4231-8300-ee85a94619c1,network=Network(50f9056b-d85d-4a43-8981-3c5c98e1bf52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11c7c4ff-db')
Oct 18 11:52:23 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T11:49:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1070511893',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1070511893',id=18,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKBVslbZEBCyddD78nfODxLMQOA10HLdeoyHJpwL0LX2DVFby+C6OMMAsTj4P/vGPT3eFNKVrplFcT2qxWYSTR79oTFsUZwl238caZpIs58KdEidArGj0m+IHMu+D/m5Dg==',key_name='tempest-keypair-232390733',keypairs=<?>,launch_index=0,launched_at=2023-10-18T11:50:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='daccec0feffd445492c3ab4ff40bcde2',ramdisk_id='',reservation_id='r-ugx6bgpm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1710887731',owner_user_name='tempest-TaggedBootDevicesTest-1710887731-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T11:50:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8f517ba22b1494ca5700e014e7ab8b9',uuid=cd28be8d-847b-468c-860f-4f479740738d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dba85cc3-dd42-4fa4-96d3-bec15903344f", "address": "fa:16:3e:fb:32:89", "network": {"id": "1ba257ec-d104-413d-bbf9-d9702ed5a1b4", "bridge": "br-int", "label": "tempest-device-tagging-net2-445498545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdba85cc3-dd", "ovs_interfaceid": "dba85cc3-dd42-4fa4-96d3-bec15903344f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 11:52:23 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Converting VIF {"id": "dba85cc3-dd42-4fa4-96d3-bec15903344f", "address": "fa:16:3e:fb:32:89", "network": {"id": "1ba257ec-d104-413d-bbf9-d9702ed5a1b4", "bridge": "br-int", "label": "tempest-device-tagging-net2-445498545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdba85cc3-dd", "ovs_interfaceid": "dba85cc3-dd42-4fa4-96d3-bec15903344f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:52:23 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:32:89,bridge_name='br-int',has_traffic_filtering=True,id=dba85cc3-dd42-4fa4-96d3-bec15903344f,network=Network(1ba257ec-d104-413d-bbf9-d9702ed5a1b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdba85cc3-dd') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:52:23 user nova-compute[74190]: DEBUG os_vif [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:32:89,bridge_name='br-int',has_traffic_filtering=True,id=dba85cc3-dd42-4fa4-96d3-bec15903344f,network=Network(1ba257ec-d104-413d-bbf9-d9702ed5a1b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdba85cc3-dd') {{(pid=74190) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 11:52:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdba85cc3-dd, bridge=br-int, if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:52:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:52:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2b887a4c-74fa-408d-a5af-6144bdf14e6c) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:52:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:24 user nova-compute[74190]: INFO os_vif [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:32:89,bridge_name='br-int',has_traffic_filtering=True,id=dba85cc3-dd42-4fa4-96d3-bec15903344f,network=Network(1ba257ec-d104-413d-bbf9-d9702ed5a1b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdba85cc3-dd')
Oct 18 11:52:24 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-18T11:49:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1070511893',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1070511893',id=18,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKBVslbZEBCyddD78nfODxLMQOA10HLdeoyHJpwL0LX2DVFby+C6OMMAsTj4P/vGPT3eFNKVrplFcT2qxWYSTR79oTFsUZwl238caZpIs58KdEidArGj0m+IHMu+D/m5Dg==',key_name='tempest-keypair-232390733',keypairs=<?>,launch_index=0,launched_at=2023-10-18T11:50:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='daccec0feffd445492c3ab4ff40bcde2',ramdisk_id='',reservation_id='r-ugx6bgpm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1710887731',owner_user_name='tempest-TaggedBootDevicesTest-1710887731-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T11:50:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8f517ba22b1494ca5700e014e7ab8b9',uuid=cd28be8d-847b-468c-860f-4f479740738d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "35f010df-56fb-4234-879b-19f86f36a2d3", "address": "fa:16:3e:bf:a7:36", "network": {"id": "1ba257ec-d104-413d-bbf9-d9702ed5a1b4", "bridge": "br-int", "label": "tempest-device-tagging-net2-445498545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35f010df-56", "ovs_interfaceid": "35f010df-56fb-4234-879b-19f86f36a2d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Converting VIF {"id": "35f010df-56fb-4234-879b-19f86f36a2d3", "address": "fa:16:3e:bf:a7:36", "network": {"id": "1ba257ec-d104-413d-bbf9-d9702ed5a1b4", "bridge": "br-int", "label": "tempest-device-tagging-net2-445498545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35f010df-56", "ovs_interfaceid": "35f010df-56fb-4234-879b-19f86f36a2d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:a7:36,bridge_name='br-int',has_traffic_filtering=True,id=35f010df-56fb-4234-879b-19f86f36a2d3,network=Network(1ba257ec-d104-413d-bbf9-d9702ed5a1b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35f010df-56') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG os_vif [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:a7:36,bridge_name='br-int',has_traffic_filtering=True,id=35f010df-56fb-4234-879b-19f86f36a2d3,network=Network(1ba257ec-d104-413d-bbf9-d9702ed5a1b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35f010df-56') {{(pid=74190) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG nova.policy [None req-cb1b3c45-07fb-4d41-8cc4-87acccba66c5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '852309a19f1b4d49a4974c3be53f67cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99cf8d4d4f504e82868ed295e054644c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74190) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap35f010df-56, bridge=br-int, if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1fdb2525-cb29-44a3-b65b-d1aae0d5e4e1) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:52:24 user nova-compute[74190]: INFO os_vif [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:a7:36,bridge_name='br-int',has_traffic_filtering=True,id=35f010df-56fb-4234-879b-19f86f36a2d3,network=Network(1ba257ec-d104-413d-bbf9-d9702ed5a1b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35f010df-56')
Oct 18 11:52:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-1343bb93-97ce-4b75-82f7-10077af96c3c tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-1343bb93-97ce-4b75-82f7-10077af96c3c tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] [instance: cd28be8d-847b-468c-860f-4f479740738d] calling os-brick to detach iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, {'target_iqn': 'iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aciJuZkM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:52:24 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:52:24 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-1343bb93-97ce-4b75-82f7-10077af96c3c tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74190) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 11:52:24 user nova-compute[74190]: INFO nova.compute.claims [None req-1343bb93-97ce-4b75-82f7-10077af96c3c tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] Claim successful on node user
Oct 18 11:52:24 user nova-compute[74190]: DEBUG nova.compute.manager [None req-cb1b3c45-07fb-4d41-8cc4-87acccba66c5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: 47ed3fb0-c159-484f-8380-79b5564d0ac1] Start spawning the instance on the hypervisor. {{(pid=74190) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-cb1b3c45-07fb-4d41-8cc4-87acccba66c5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: 47ed3fb0-c159-484f-8380-79b5564d0ac1] Creating instance directory {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 11:52:24 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-cb1b3c45-07fb-4d41-8cc4-87acccba66c5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: 47ed3fb0-c159-484f-8380-79b5564d0ac1] Creating image(s)
Oct 18 11:52:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-cb1b3c45-07fb-4d41-8cc4-87acccba66c5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Acquiring lock "/opt/stack/data/nova/instances/47ed3fb0-c159-484f-8380-79b5564d0ac1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-cb1b3c45-07fb-4d41-8cc4-87acccba66c5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lock "/opt/stack/data/nova/instances/47ed3fb0-c159-484f-8380-79b5564d0ac1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-cb1b3c45-07fb-4d41-8cc4-87acccba66c5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lock "/opt/stack/data/nova/instances/47ed3fb0-c159-484f-8380-79b5564d0ac1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-cb1b3c45-07fb-4d41-8cc4-87acccba66c5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[62df6037-eb52-4bbe-84b4-f56fa6bee5c9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:011ac309-ad42-43cc-ab45-e09e022b6e56\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:17a1c8f7-ad7d-4b2a-863f-561e1c18768a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 11:52:24 user nova-compute[74190]: No targets found.
Oct 18 11:52:24 user nova-compute[74190]: iSNS:
Oct 18 11:52:24 user nova-compute[74190]: No targets found.
Oct 18 11:52:24 user nova-compute[74190]: STATIC:
Oct 18 11:52:24 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa
Oct 18 11:52:24 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:52:24 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:52:24 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a
Oct 18 11:52:24 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:52:24 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:52:24 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:011ac309-ad42-43cc-ab45-e09e022b6e56
Oct 18 11:52:24 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:52:24 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:52:24 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:17a1c8f7-ad7d-4b2a-863f-561e1c18768a
Oct 18 11:52:24 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:52:24 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:52:24 user nova-compute[74190]: FIRMWARE:
Oct 18 11:52:24 user nova-compute[74190]: No targets found.
Oct 18 11:52:24 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 11:52:24 user nova-compute[74190]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 11:52:24 user nova-compute[74190]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74190) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a', 0)] {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.031s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[3693aaec-fa20-4c83-8fd1-b0767a8855f6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:011ac309-ad42-43cc-ab45-e09e022b6e56\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17a1c8f7-ad7d-4b2a-863f-561e1c18768a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG nova.compute.manager [req-d163749d-8acb-4ab6-b19a-250452f58c9d req-6287607d-9cc9-4720-a194-2261f8ff5346 service nova] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Received event network-vif-plugged-7cee893b-5ac8-45f8-a1f8-5374b49cc3b5 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d163749d-8acb-4ab6-b19a-250452f58c9d req-6287607d-9cc9-4720-a194-2261f8ff5346 service nova] Acquiring lock "4e916d24-9f9d-4289-87ce-f65d2499fcd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d163749d-8acb-4ab6-b19a-250452f58c9d req-6287607d-9cc9-4720-a194-2261f8ff5346 service nova] Lock "4e916d24-9f9d-4289-87ce-f65d2499fcd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d163749d-8acb-4ab6-b19a-250452f58c9d req-6287607d-9cc9-4720-a194-2261f8ff5346 service nova] Lock "4e916d24-9f9d-4289-87ce-f65d2499fcd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG nova.compute.manager [req-d163749d-8acb-4ab6-b19a-250452f58c9d req-6287607d-9cc9-4720-a194-2261f8ff5346 service nova] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] No waiting events found dispatching network-vif-plugged-7cee893b-5ac8-45f8-a1f8-5374b49cc3b5 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:52:24 user nova-compute[74190]: WARNING nova.compute.manager [req-d163749d-8acb-4ab6-b19a-250452f58c9d req-6287607d-9cc9-4720-a194-2261f8ff5346 service nova] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Received unexpected event network-vif-plugged-7cee893b-5ac8-45f8-a1f8-5374b49cc3b5 for instance with vm_state rescued and task_state None.
Oct 18 11:52:24 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c76fda-d59e-4da8-9961-04b477b80248]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:011ac309-ad42-43cc-ab45-e09e022b6e56 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17a1c8f7-ad7d-4b2a-863f-561e1c18768a (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a (non-flash)
Oct 18 11:52:24 user nova-compute[74190]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:011ac309-ad42-43cc-ab45-e09e022b6e56 (non-flash)
Oct 18 11:52:24 user nova-compute[74190]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17a1c8f7-ad7d-4b2a-863f-561e1c18768a (non-flash)
Oct 18 11:52:24 user nova-compute[74190]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 11:52:24 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a (non-flash)
Oct 18 11:52:24 user nova-compute[74190]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:011ac309-ad42-43cc-ab45-e09e022b6e56 (non-flash)
Oct 18 11:52:24 user nova-compute[74190]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17a1c8f7-ad7d-4b2a-863f-561e1c18768a (non-flash)
Oct 18 11:52:24 user nova-compute[74190]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 11:52:24 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1f44405990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a'): ({'sdb'}, set())}) {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Removing single pathed devices sdb {{(pid=74190) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc0da2be-8027-4a1c-900c-ca1d5d5ee715]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG nova.compute.manager [req-8862f22e-39d9-4602-bc7f-4d3958300fb4 req-8a4f4822-6426-4f37-b7e6-11c27d788052 service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Received event network-vif-plugged-c2ed33ff-2096-4def-98c5-709db8bc0ea4 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-8862f22e-39d9-4602-bc7f-4d3958300fb4 req-8a4f4822-6426-4f37-b7e6-11c27d788052 service nova] Acquiring lock "cd28be8d-847b-468c-860f-4f479740738d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-8862f22e-39d9-4602-bc7f-4d3958300fb4 req-8a4f4822-6426-4f37-b7e6-11c27d788052 service nova] Lock "cd28be8d-847b-468c-860f-4f479740738d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-8862f22e-39d9-4602-bc7f-4d3958300fb4 req-8a4f4822-6426-4f37-b7e6-11c27d788052 service nova] Lock "cd28be8d-847b-468c-860f-4f479740738d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG nova.compute.manager [req-8862f22e-39d9-4602-bc7f-4d3958300fb4 req-8a4f4822-6426-4f37-b7e6-11c27d788052 service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] No waiting events found dispatching network-vif-plugged-c2ed33ff-2096-4def-98c5-709db8bc0ea4 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:52:24 user nova-compute[74190]: WARNING nova.compute.manager [req-8862f22e-39d9-4602-bc7f-4d3958300fb4 req-8a4f4822-6426-4f37-b7e6-11c27d788052 service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Received unexpected event network-vif-plugged-c2ed33ff-2096-4def-98c5-709db8bc0ea4 for instance with vm_state active and task_state deleting.
Oct 18 11:52:24 user nova-compute[74190]: DEBUG nova.compute.manager [req-8862f22e-39d9-4602-bc7f-4d3958300fb4 req-8a4f4822-6426-4f37-b7e6-11c27d788052 service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Received event network-vif-unplugged-0a00abcf-957e-4276-a975-522f8a42ad55 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-8862f22e-39d9-4602-bc7f-4d3958300fb4 req-8a4f4822-6426-4f37-b7e6-11c27d788052 service nova] Acquiring lock "cd28be8d-847b-468c-860f-4f479740738d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-8862f22e-39d9-4602-bc7f-4d3958300fb4 req-8a4f4822-6426-4f37-b7e6-11c27d788052 service nova] Lock "cd28be8d-847b-468c-860f-4f479740738d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-8862f22e-39d9-4602-bc7f-4d3958300fb4 req-8a4f4822-6426-4f37-b7e6-11c27d788052 service nova] Lock "cd28be8d-847b-468c-860f-4f479740738d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG nova.compute.manager [req-8862f22e-39d9-4602-bc7f-4d3958300fb4 req-8a4f4822-6426-4f37-b7e6-11c27d788052 service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] No waiting events found dispatching network-vif-unplugged-0a00abcf-957e-4276-a975-522f8a42ad55 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG nova.compute.manager [req-8862f22e-39d9-4602-bc7f-4d3958300fb4 req-8a4f4822-6426-4f37-b7e6-11c27d788052 service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Received event network-vif-unplugged-0a00abcf-957e-4276-a975-522f8a42ad55 for instance with task_state deleting. {{(pid=74190) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG nova.compute.manager [req-8862f22e-39d9-4602-bc7f-4d3958300fb4 req-8a4f4822-6426-4f37-b7e6-11c27d788052 service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Received event network-vif-plugged-0a00abcf-957e-4276-a975-522f8a42ad55 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-8862f22e-39d9-4602-bc7f-4d3958300fb4 req-8a4f4822-6426-4f37-b7e6-11c27d788052 service nova] Acquiring lock "cd28be8d-847b-468c-860f-4f479740738d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-8862f22e-39d9-4602-bc7f-4d3958300fb4 req-8a4f4822-6426-4f37-b7e6-11c27d788052 service nova] Lock "cd28be8d-847b-468c-860f-4f479740738d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-8862f22e-39d9-4602-bc7f-4d3958300fb4 req-8a4f4822-6426-4f37-b7e6-11c27d788052 service nova] Lock "cd28be8d-847b-468c-860f-4f479740738d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG nova.compute.manager [req-8862f22e-39d9-4602-bc7f-4d3958300fb4 req-8a4f4822-6426-4f37-b7e6-11c27d788052 service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] No waiting events found dispatching network-vif-plugged-0a00abcf-957e-4276-a975-522f8a42ad55 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:52:24 user nova-compute[74190]: WARNING nova.compute.manager [req-8862f22e-39d9-4602-bc7f-4d3958300fb4 req-8a4f4822-6426-4f37-b7e6-11c27d788052 service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Received unexpected event network-vif-plugged-0a00abcf-957e-4276-a975-522f8a42ad55 for instance with vm_state active and task_state deleting.
Oct 18 11:52:24 user nova-compute[74190]: DEBUG nova.compute.manager [req-8862f22e-39d9-4602-bc7f-4d3958300fb4 req-8a4f4822-6426-4f37-b7e6-11c27d788052 service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Received event network-vif-unplugged-dba85cc3-dd42-4fa4-96d3-bec15903344f {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-8862f22e-39d9-4602-bc7f-4d3958300fb4 req-8a4f4822-6426-4f37-b7e6-11c27d788052 service nova] Acquiring lock "cd28be8d-847b-468c-860f-4f479740738d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-8862f22e-39d9-4602-bc7f-4d3958300fb4 req-8a4f4822-6426-4f37-b7e6-11c27d788052 service nova] Lock "cd28be8d-847b-468c-860f-4f479740738d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-8862f22e-39d9-4602-bc7f-4d3958300fb4 req-8a4f4822-6426-4f37-b7e6-11c27d788052 service nova] Lock "cd28be8d-847b-468c-860f-4f479740738d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG nova.compute.manager [req-8862f22e-39d9-4602-bc7f-4d3958300fb4 req-8a4f4822-6426-4f37-b7e6-11c27d788052 service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] No waiting events found dispatching network-vif-unplugged-dba85cc3-dd42-4fa4-96d3-bec15903344f {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG nova.compute.manager [req-8862f22e-39d9-4602-bc7f-4d3958300fb4 req-8a4f4822-6426-4f37-b7e6-11c27d788052 service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Received event network-vif-unplugged-dba85cc3-dd42-4fa4-96d3-bec15903344f for instance with task_state deleting. {{(pid=74190) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG nova.compute.manager [req-8862f22e-39d9-4602-bc7f-4d3958300fb4 req-8a4f4822-6426-4f37-b7e6-11c27d788052 service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Received event network-vif-plugged-dba85cc3-dd42-4fa4-96d3-bec15903344f {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-8862f22e-39d9-4602-bc7f-4d3958300fb4 req-8a4f4822-6426-4f37-b7e6-11c27d788052 service nova] Acquiring lock "cd28be8d-847b-468c-860f-4f479740738d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-8862f22e-39d9-4602-bc7f-4d3958300fb4 req-8a4f4822-6426-4f37-b7e6-11c27d788052 service nova] Lock "cd28be8d-847b-468c-860f-4f479740738d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-8862f22e-39d9-4602-bc7f-4d3958300fb4 req-8a4f4822-6426-4f37-b7e6-11c27d788052 service nova] Lock "cd28be8d-847b-468c-860f-4f479740738d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG nova.compute.manager [req-8862f22e-39d9-4602-bc7f-4d3958300fb4 req-8a4f4822-6426-4f37-b7e6-11c27d788052 service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] No waiting events found dispatching network-vif-plugged-dba85cc3-dd42-4fa4-96d3-bec15903344f {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:52:24 user nova-compute[74190]: WARNING nova.compute.manager [req-8862f22e-39d9-4602-bc7f-4d3958300fb4 req-8a4f4822-6426-4f37-b7e6-11c27d788052 service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Received unexpected event network-vif-plugged-dba85cc3-dd42-4fa4-96d3-bec15903344f for instance with vm_state active and task_state deleting.
Oct 18 11:52:24 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.033s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1723a0d-3078-4fe9-bbc7-10e360c50536]: (4, ('ok\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Flushing IO for device /dev/sdb {{(pid=74190) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[960082e9-347a-4c9d-9a08-6c5884f7f380]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74190) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-cb1b3c45-07fb-4d41-8cc4-87acccba66c5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.264s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-cb1b3c45-07fb-4d41-8cc4-87acccba66c5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Acquiring lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-cb1b3c45-07fb-4d41-8cc4-87acccba66c5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-cb1b3c45-07fb-4d41-8cc4-87acccba66c5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.070s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d7948a6-3bc4-4d6d-a149-1a9821597898]: (4, ('1', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] SCSI volumes sdb have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a')] {{(pid=74190) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d21542-e6c5-4d28-8262-79ebc2f89800]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a -p 172.16.0.220:3260 --logout {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a -p 172.16.0.220:3260 --logout" returned: 0 in 0.084s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[30dea87b-00fd-43b1-bc9b-0f64148ac4d9]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a, portal: 172.16.0.220,3260]
Oct 18 11:52:24 user nova-compute[74190]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a, portal: 172.16.0.220,3260] successful.
Oct 18 11:52:24 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a -p 172.16.0.220:3260 --op delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-1343bb93-97ce-4b75-82f7-10077af96c3c tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-1343bb93-97ce-4b75-82f7-10077af96c3c tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40eb314e-5a7a-45f4-93f5-e67b23f6d02a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.055s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[043618c7-e303-4b70-8209-386035c66aaa]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.565s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] <== disconnect_volume: return (567ms) None {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] [instance: cd28be8d-847b-468c-860f-4f479740738d] Disconnected iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-cb1b3c45-07fb-4d41-8cc4-87acccba66c5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.284s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-cb1b3c45-07fb-4d41-8cc4-87acccba66c5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f,backing_fmt=raw /opt/stack/data/nova/instances/47ed3fb0-c159-484f-8380-79b5564d0ac1/disk 1073741824 {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-1343bb93-97ce-4b75-82f7-10077af96c3c tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.643s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG nova.compute.manager [None req-1343bb93-97ce-4b75-82f7-10077af96c3c tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] Start building networks asynchronously for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] [instance: cd28be8d-847b-468c-860f-4f479740738d] calling os-brick to detach iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, {'target_iqn': 'iqn.2010-10.org.openstack:011ac309-ad42-43cc-ab45-e09e022b6e56', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tAxbldQM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:52:24 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:52:24 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.012s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-cb1b3c45-07fb-4d41-8cc4-87acccba66c5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f,backing_fmt=raw /opt/stack/data/nova/instances/47ed3fb0-c159-484f-8380-79b5564d0ac1/disk 1073741824" returned: 0 in 0.125s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-cb1b3c45-07fb-4d41-8cc4-87acccba66c5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.415s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-cb1b3c45-07fb-4d41-8cc4-87acccba66c5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[377d867f-6557-4b5a-86c5-2516bf6497f6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:011ac309-ad42-43cc-ab45-e09e022b6e56\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:17a1c8f7-ad7d-4b2a-863f-561e1c18768a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 11:52:24 user nova-compute[74190]: No targets found.
Oct 18 11:52:24 user nova-compute[74190]: iSNS:
Oct 18 11:52:24 user nova-compute[74190]: No targets found.
Oct 18 11:52:24 user nova-compute[74190]: STATIC:
Oct 18 11:52:24 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa
Oct 18 11:52:24 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:52:24 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:52:24 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:011ac309-ad42-43cc-ab45-e09e022b6e56
Oct 18 11:52:24 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:52:24 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:52:24 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:17a1c8f7-ad7d-4b2a-863f-561e1c18768a
Oct 18 11:52:24 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:52:24 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:52:24 user nova-compute[74190]: FIRMWARE:
Oct 18 11:52:24 user nova-compute[74190]: No targets found.
Oct 18 11:52:24 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 11:52:24 user nova-compute[74190]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 11:52:24 user nova-compute[74190]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74190) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:011ac309-ad42-43cc-ab45-e09e022b6e56', 0)] {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG nova.compute.manager [req-a2dd7d66-dc37-4058-a2dd-4493e42647b3 req-6299a82f-9eec-409f-a8b0-bb26daa4c3cb service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Received event network-vif-plugged-11c7c4ff-db41-4231-8300-ee85a94619c1 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-a2dd7d66-dc37-4058-a2dd-4493e42647b3 req-6299a82f-9eec-409f-a8b0-bb26daa4c3cb service nova] Acquiring lock "cd28be8d-847b-468c-860f-4f479740738d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-a2dd7d66-dc37-4058-a2dd-4493e42647b3 req-6299a82f-9eec-409f-a8b0-bb26daa4c3cb service nova] Lock "cd28be8d-847b-468c-860f-4f479740738d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-a2dd7d66-dc37-4058-a2dd-4493e42647b3 req-6299a82f-9eec-409f-a8b0-bb26daa4c3cb service nova] Lock "cd28be8d-847b-468c-860f-4f479740738d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG nova.compute.manager [req-a2dd7d66-dc37-4058-a2dd-4493e42647b3 req-6299a82f-9eec-409f-a8b0-bb26daa4c3cb service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] No waiting events found dispatching network-vif-plugged-11c7c4ff-db41-4231-8300-ee85a94619c1 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:52:24 user nova-compute[74190]: WARNING nova.compute.manager [req-a2dd7d66-dc37-4058-a2dd-4493e42647b3 req-6299a82f-9eec-409f-a8b0-bb26daa4c3cb service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Received unexpected event network-vif-plugged-11c7c4ff-db41-4231-8300-ee85a94619c1 for instance with vm_state active and task_state deleting.
Oct 18 11:52:24 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[0026d763-444d-4e60-b259-1dac464ff288]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:011ac309-ad42-43cc-ab45-e09e022b6e56\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17a1c8f7-ad7d-4b2a-863f-561e1c18768a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG nova.compute.manager [None req-1343bb93-97ce-4b75-82f7-10077af96c3c tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] Allocating IP information in the background. {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG nova.network.neutron [None req-1343bb93-97ce-4b75-82f7-10077af96c3c tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] allocate_for_instance() {{(pid=74190) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:24 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-1343bb93-97ce-4b75-82f7-10077af96c3c tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 11:52:24 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[9958c29d-b737-4cb5-a78e-13ad46c3eec5]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:011ac309-ad42-43cc-ab45-e09e022b6e56 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17a1c8f7-ad7d-4b2a-863f-561e1c18768a (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:011ac309-ad42-43cc-ab45-e09e022b6e56 (non-flash)
Oct 18 11:52:24 user nova-compute[74190]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17a1c8f7-ad7d-4b2a-863f-561e1c18768a (non-flash)
Oct 18 11:52:24 user nova-compute[74190]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 11:52:24 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:011ac309-ad42-43cc-ab45-e09e022b6e56 (non-flash)
Oct 18 11:52:24 user nova-compute[74190]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17a1c8f7-ad7d-4b2a-863f-561e1c18768a (non-flash)
Oct 18 11:52:24 user nova-compute[74190]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 11:52:24 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1f2476d7e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:011ac309-ad42-43cc-ab45-e09e022b6e56'): ({'sdd'}, set())}) {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Removing single pathed devices sdd {{(pid=74190) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG nova.compute.manager [None req-1343bb93-97ce-4b75-82f7-10077af96c3c tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] Start building block device mappings for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 11:52:24 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.040s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[417deb4e-645c-4a3f-a1a2-758ab116b968]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-cb1b3c45-07fb-4d41-8cc4-87acccba66c5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.226s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG nova.virt.disk.api [None req-cb1b3c45-07fb-4d41-8cc4-87acccba66c5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Checking if we can resize image /opt/stack/data/nova/instances/47ed3fb0-c159-484f-8380-79b5564d0ac1/disk. size=1073741824 {{(pid=74190) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-cb1b3c45-07fb-4d41-8cc4-87acccba66c5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47ed3fb0-c159-484f-8380-79b5564d0ac1/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.026s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e395da-2e89-49aa-b725-0f2e26659aed]: (4, ('ok\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Flushing IO for device /dev/sdd {{(pid=74190) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d10135-6166-4967-bd32-2c287cb0f260]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74190) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG nova.policy [None req-1343bb93-97ce-4b75-82f7-10077af96c3c tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a252f2c479b740a29a1adc79e6346b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389e1c2dbc904130ba08b137f0b2e837', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74190) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[205e2495-01e7-48fd-9212-f1721677d684]: (4, ('1', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] SCSI volumes sdd have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:011ac309-ad42-43cc-ab45-e09e022b6e56')] {{(pid=74190) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:011ac309-ad42-43cc-ab45-e09e022b6e56 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG nova.compute.manager [None req-1343bb93-97ce-4b75-82f7-10077af96c3c tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] Start spawning the instance on the hypervisor. {{(pid=74190) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-1343bb93-97ce-4b75-82f7-10077af96c3c tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] Creating instance directory {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 11:52:25 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-1343bb93-97ce-4b75-82f7-10077af96c3c tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] Creating image(s)
Oct 18 11:52:25 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-1343bb93-97ce-4b75-82f7-10077af96c3c tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Acquiring lock "/opt/stack/data/nova/instances/8eec9cde-3553-4fc8-9162-cda963d1a81e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-1343bb93-97ce-4b75-82f7-10077af96c3c tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Lock "/opt/stack/data/nova/instances/8eec9cde-3553-4fc8-9162-cda963d1a81e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-1343bb93-97ce-4b75-82f7-10077af96c3c tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Lock "/opt/stack/data/nova/instances/8eec9cde-3553-4fc8-9162-cda963d1a81e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-1343bb93-97ce-4b75-82f7-10077af96c3c tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:011ac309-ad42-43cc-ab45-e09e022b6e56 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[b43fb307-7cc9-4a7e-9d5c-15026cf55105]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:011ac309-ad42-43cc-ab45-e09e022b6e56 -p 172.16.0.220:3260 --logout {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-cb1b3c45-07fb-4d41-8cc4-87acccba66c5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47ed3fb0-c159-484f-8380-79b5564d0ac1/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG nova.virt.disk.api [None req-cb1b3c45-07fb-4d41-8cc4-87acccba66c5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Cannot resize image /opt/stack/data/nova/instances/47ed3fb0-c159-484f-8380-79b5564d0ac1/disk to a smaller size. {{(pid=74190) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-cb1b3c45-07fb-4d41-8cc4-87acccba66c5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: 47ed3fb0-c159-484f-8380-79b5564d0ac1] Created local disks {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-cb1b3c45-07fb-4d41-8cc4-87acccba66c5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: 47ed3fb0-c159-484f-8380-79b5564d0ac1] Ensure instance console log exists: /opt/stack/data/nova/instances/47ed3fb0-c159-484f-8380-79b5564d0ac1/console.log {{(pid=74190) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-cb1b3c45-07fb-4d41-8cc4-87acccba66c5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-cb1b3c45-07fb-4d41-8cc4-87acccba66c5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-cb1b3c45-07fb-4d41-8cc4-87acccba66c5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:011ac309-ad42-43cc-ab45-e09e022b6e56 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fcb69d8-ecf8-4a2c-bc67-0f8e696d8e7d]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:011ac309-ad42-43cc-ab45-e09e022b6e56, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:011ac309-ad42-43cc-ab45-e09e022b6e56, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:011ac309-ad42-43cc-ab45-e09e022b6e56, portal: 172.16.0.220,3260]
Oct 18 11:52:25 user nova-compute[74190]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:011ac309-ad42-43cc-ab45-e09e022b6e56, portal: 172.16.0.220,3260] successful.
Oct 18 11:52:25 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:011ac309-ad42-43cc-ab45-e09e022b6e56 -p 172.16.0.220:3260 --op delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:011ac309-ad42-43cc-ab45-e09e022b6e56 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[00669748-3597-441d-8e4d-6b5b2729cb23]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.582s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] <== disconnect_volume: return (595ms) None {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] [instance: cd28be8d-847b-468c-860f-4f479740738d] Disconnected iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] [instance: cd28be8d-847b-468c-860f-4f479740738d] calling os-brick to detach iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, {'target_iqn': 'iqn.2010-10.org.openstack:17a1c8f7-ad7d-4b2a-863f-561e1c18768a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZJKGlEXu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:52:25 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:52:25 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce3d49b-1e50-4dfd-a491-2855e3f9a769]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:17a1c8f7-ad7d-4b2a-863f-561e1c18768a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 11:52:25 user nova-compute[74190]: No targets found.
Oct 18 11:52:25 user nova-compute[74190]: iSNS:
Oct 18 11:52:25 user nova-compute[74190]: No targets found.
Oct 18 11:52:25 user nova-compute[74190]: STATIC:
Oct 18 11:52:25 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa
Oct 18 11:52:25 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:52:25 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:52:25 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:17a1c8f7-ad7d-4b2a-863f-561e1c18768a
Oct 18 11:52:25 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:52:25 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:52:25 user nova-compute[74190]: FIRMWARE:
Oct 18 11:52:25 user nova-compute[74190]: No targets found.
Oct 18 11:52:25 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 11:52:25 user nova-compute[74190]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 11:52:25 user nova-compute[74190]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74190) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:17a1c8f7-ad7d-4b2a-863f-561e1c18768a', 0)] {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a9f3ef-f6cb-47e3-a2d8-5e31f2cd9123]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17a1c8f7-ad7d-4b2a-863f-561e1c18768a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-1343bb93-97ce-4b75-82f7-10077af96c3c tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.249s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-1343bb93-97ce-4b75-82f7-10077af96c3c tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Acquiring lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-1343bb93-97ce-4b75-82f7-10077af96c3c tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-1343bb93-97ce-4b75-82f7-10077af96c3c tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[c92cde4b-796a-4eff-b184-2371ab8a0d0b]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17a1c8f7-ad7d-4b2a-863f-561e1c18768a (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17a1c8f7-ad7d-4b2a-863f-561e1c18768a (non-flash)
Oct 18 11:52:25 user nova-compute[74190]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 11:52:25 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17a1c8f7-ad7d-4b2a-863f-561e1c18768a (non-flash)
Oct 18 11:52:25 user nova-compute[74190]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 11:52:25 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1f2476c9d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:17a1c8f7-ad7d-4b2a-863f-561e1c18768a'): ({'sde'}, set())}) {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Removing single pathed devices sde {{(pid=74190) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG nova.network.neutron [None req-cb1b3c45-07fb-4d41-8cc4-87acccba66c5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: 47ed3fb0-c159-484f-8380-79b5564d0ac1] Successfully created port: 693871aa-4bc1-41f8-aa49-4882800b9592 {{(pid=74190) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.032s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab617020-23b5-42ef-9282-a4bc62952b55]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.027s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[5414a4df-8476-4799-8252-09608eada384]: (4, ('ok\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Flushing IO for device /dev/sde {{(pid=74190) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[a371632b-8c4b-478d-93c8-e3560e0b8723]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74190) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.056s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d6cfd2-fd0a-4133-a80a-23ce0aacdc29]: (4, ('1', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] SCSI volumes sde have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:17a1c8f7-ad7d-4b2a-863f-561e1c18768a')] {{(pid=74190) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17a1c8f7-ad7d-4b2a-863f-561e1c18768a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17a1c8f7-ad7d-4b2a-863f-561e1c18768a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[43151e7a-0864-4c75-892b-9c20067e923b]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17a1c8f7-ad7d-4b2a-863f-561e1c18768a -p 172.16.0.220:3260 --logout {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-1343bb93-97ce-4b75-82f7-10077af96c3c tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.234s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-1343bb93-97ce-4b75-82f7-10077af96c3c tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f,backing_fmt=raw /opt/stack/data/nova/instances/8eec9cde-3553-4fc8-9162-cda963d1a81e/disk 1073741824 {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17a1c8f7-ad7d-4b2a-863f-561e1c18768a -p 172.16.0.220:3260 --logout" returned: 0 in 0.173s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb831fc6-d584-4be5-9688-aa8476777d44]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:17a1c8f7-ad7d-4b2a-863f-561e1c18768a, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:17a1c8f7-ad7d-4b2a-863f-561e1c18768a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:17a1c8f7-ad7d-4b2a-863f-561e1c18768a, portal: 172.16.0.220,3260]
Oct 18 11:52:25 user nova-compute[74190]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:17a1c8f7-ad7d-4b2a-863f-561e1c18768a, portal: 172.16.0.220,3260] successful.
Oct 18 11:52:25 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17a1c8f7-ad7d-4b2a-863f-561e1c18768a -p 172.16.0.220:3260 --op delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-1343bb93-97ce-4b75-82f7-10077af96c3c tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f,backing_fmt=raw /opt/stack/data/nova/instances/8eec9cde-3553-4fc8-9162-cda963d1a81e/disk 1073741824" returned: 0 in 0.205s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-1343bb93-97ce-4b75-82f7-10077af96c3c tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.443s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-1343bb93-97ce-4b75-82f7-10077af96c3c tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17a1c8f7-ad7d-4b2a-863f-561e1c18768a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[d52faa9c-63c5-4f4e-ad92-011f86652fc8]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.564s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] <== disconnect_volume: return (566ms) None {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:52:25 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] [instance: cd28be8d-847b-468c-860f-4f479740738d] Disconnected iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 11:52:25 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] [instance: cd28be8d-847b-468c-860f-4f479740738d] Deleting instance files /opt/stack/data/nova/instances/cd28be8d-847b-468c-860f-4f479740738d_del
Oct 18 11:52:25 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] [instance: cd28be8d-847b-468c-860f-4f479740738d] Deletion of /opt/stack/data/nova/instances/cd28be8d-847b-468c-860f-4f479740738d_del complete
Oct 18 11:52:25 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:26 user nova-compute[74190]: INFO nova.compute.manager [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] [instance: cd28be8d-847b-468c-860f-4f479740738d] Took 4.74 seconds to destroy the instance on the hypervisor.
Oct 18 11:52:26 user nova-compute[74190]: DEBUG oslo.service.loopingcall [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74190) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 11:52:26 user nova-compute[74190]: DEBUG nova.compute.manager [-] [instance: cd28be8d-847b-468c-860f-4f479740738d] Deallocating network for instance {{(pid=74190) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 11:52:26 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: cd28be8d-847b-468c-860f-4f479740738d] deallocate_for_instance() {{(pid=74190) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 11:52:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-1343bb93-97ce-4b75-82f7-10077af96c3c tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.292s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:26 user nova-compute[74190]: DEBUG nova.virt.disk.api [None req-1343bb93-97ce-4b75-82f7-10077af96c3c tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8eec9cde-3553-4fc8-9162-cda963d1a81e/disk. size=1073741824 {{(pid=74190) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 18 11:52:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-1343bb93-97ce-4b75-82f7-10077af96c3c tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eec9cde-3553-4fc8-9162-cda963d1a81e/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:26 user nova-compute[74190]: DEBUG nova.compute.manager [req-85184114-131b-423e-83c6-ee946d9b2ab7 req-bd4b17ce-0104-4e2d-8863-d43f7372b1f2 service nova] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Received event network-vif-plugged-7cee893b-5ac8-45f8-a1f8-5374b49cc3b5 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:52:26 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-85184114-131b-423e-83c6-ee946d9b2ab7 req-bd4b17ce-0104-4e2d-8863-d43f7372b1f2 service nova] Acquiring lock "4e916d24-9f9d-4289-87ce-f65d2499fcd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:52:26 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-85184114-131b-423e-83c6-ee946d9b2ab7 req-bd4b17ce-0104-4e2d-8863-d43f7372b1f2 service nova] Lock "4e916d24-9f9d-4289-87ce-f65d2499fcd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:52:26 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-85184114-131b-423e-83c6-ee946d9b2ab7 req-bd4b17ce-0104-4e2d-8863-d43f7372b1f2 service nova] Lock "4e916d24-9f9d-4289-87ce-f65d2499fcd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:52:26 user nova-compute[74190]: DEBUG nova.compute.manager [req-85184114-131b-423e-83c6-ee946d9b2ab7 req-bd4b17ce-0104-4e2d-8863-d43f7372b1f2 service nova] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] No waiting events found dispatching network-vif-plugged-7cee893b-5ac8-45f8-a1f8-5374b49cc3b5 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:52:26 user nova-compute[74190]: WARNING nova.compute.manager [req-85184114-131b-423e-83c6-ee946d9b2ab7 req-bd4b17ce-0104-4e2d-8863-d43f7372b1f2 service nova] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Received unexpected event network-vif-plugged-7cee893b-5ac8-45f8-a1f8-5374b49cc3b5 for instance with vm_state rescued and task_state None.
Oct 18 11:52:26 user nova-compute[74190]: DEBUG nova.compute.manager [req-85184114-131b-423e-83c6-ee946d9b2ab7 req-bd4b17ce-0104-4e2d-8863-d43f7372b1f2 service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Received event network-vif-unplugged-aca29f48-4a6d-472a-ac70-7006b63b9996 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:52:26 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-85184114-131b-423e-83c6-ee946d9b2ab7 req-bd4b17ce-0104-4e2d-8863-d43f7372b1f2 service nova] Acquiring lock "cd28be8d-847b-468c-860f-4f479740738d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:52:26 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-85184114-131b-423e-83c6-ee946d9b2ab7 req-bd4b17ce-0104-4e2d-8863-d43f7372b1f2 service nova] Lock "cd28be8d-847b-468c-860f-4f479740738d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:52:26 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-85184114-131b-423e-83c6-ee946d9b2ab7 req-bd4b17ce-0104-4e2d-8863-d43f7372b1f2 service nova] Lock "cd28be8d-847b-468c-860f-4f479740738d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:52:26 user nova-compute[74190]: DEBUG nova.compute.manager [req-85184114-131b-423e-83c6-ee946d9b2ab7 req-bd4b17ce-0104-4e2d-8863-d43f7372b1f2 service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] No waiting events found dispatching network-vif-unplugged-aca29f48-4a6d-472a-ac70-7006b63b9996 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:52:26 user nova-compute[74190]: DEBUG nova.compute.manager [req-85184114-131b-423e-83c6-ee946d9b2ab7 req-bd4b17ce-0104-4e2d-8863-d43f7372b1f2 service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Received event network-vif-unplugged-aca29f48-4a6d-472a-ac70-7006b63b9996 for instance with task_state deleting. {{(pid=74190) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 11:52:26 user nova-compute[74190]: DEBUG nova.compute.manager [req-85184114-131b-423e-83c6-ee946d9b2ab7 req-bd4b17ce-0104-4e2d-8863-d43f7372b1f2 service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Received event network-vif-plugged-aca29f48-4a6d-472a-ac70-7006b63b9996 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:52:26 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-85184114-131b-423e-83c6-ee946d9b2ab7 req-bd4b17ce-0104-4e2d-8863-d43f7372b1f2 service nova] Acquiring lock "cd28be8d-847b-468c-860f-4f479740738d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:52:26 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-85184114-131b-423e-83c6-ee946d9b2ab7 req-bd4b17ce-0104-4e2d-8863-d43f7372b1f2 service nova] Lock "cd28be8d-847b-468c-860f-4f479740738d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:52:26 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-85184114-131b-423e-83c6-ee946d9b2ab7 req-bd4b17ce-0104-4e2d-8863-d43f7372b1f2 service nova] Lock "cd28be8d-847b-468c-860f-4f479740738d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:52:26 user nova-compute[74190]: DEBUG nova.compute.manager [req-85184114-131b-423e-83c6-ee946d9b2ab7 req-bd4b17ce-0104-4e2d-8863-d43f7372b1f2 service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] No waiting events found dispatching network-vif-plugged-aca29f48-4a6d-472a-ac70-7006b63b9996 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:52:26 user nova-compute[74190]: WARNING nova.compute.manager [req-85184114-131b-423e-83c6-ee946d9b2ab7 req-bd4b17ce-0104-4e2d-8863-d43f7372b1f2 service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Received unexpected event network-vif-plugged-aca29f48-4a6d-472a-ac70-7006b63b9996 for instance with vm_state active and task_state deleting.
Oct 18 11:52:26 user nova-compute[74190]: DEBUG nova.compute.manager [req-85184114-131b-423e-83c6-ee946d9b2ab7 req-bd4b17ce-0104-4e2d-8863-d43f7372b1f2 service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Received event network-vif-unplugged-d5f803c0-bb6c-41be-8294-fb3565e03413 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:52:26 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-85184114-131b-423e-83c6-ee946d9b2ab7 req-bd4b17ce-0104-4e2d-8863-d43f7372b1f2 service nova] Acquiring lock "cd28be8d-847b-468c-860f-4f479740738d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:52:26 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-85184114-131b-423e-83c6-ee946d9b2ab7 req-bd4b17ce-0104-4e2d-8863-d43f7372b1f2 service nova] Lock "cd28be8d-847b-468c-860f-4f479740738d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:52:26 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-85184114-131b-423e-83c6-ee946d9b2ab7 req-bd4b17ce-0104-4e2d-8863-d43f7372b1f2 service nova] Lock "cd28be8d-847b-468c-860f-4f479740738d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:52:26 user nova-compute[74190]: DEBUG nova.compute.manager [req-85184114-131b-423e-83c6-ee946d9b2ab7 req-bd4b17ce-0104-4e2d-8863-d43f7372b1f2 service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] No waiting events found dispatching network-vif-unplugged-d5f803c0-bb6c-41be-8294-fb3565e03413 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:52:26 user nova-compute[74190]: DEBUG nova.compute.manager [req-85184114-131b-423e-83c6-ee946d9b2ab7 req-bd4b17ce-0104-4e2d-8863-d43f7372b1f2 service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Received event network-vif-unplugged-d5f803c0-bb6c-41be-8294-fb3565e03413 for instance with task_state deleting. {{(pid=74190) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 11:52:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-1343bb93-97ce-4b75-82f7-10077af96c3c tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eec9cde-3553-4fc8-9162-cda963d1a81e/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:26 user nova-compute[74190]: DEBUG nova.virt.disk.api [None req-1343bb93-97ce-4b75-82f7-10077af96c3c tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Cannot resize image /opt/stack/data/nova/instances/8eec9cde-3553-4fc8-9162-cda963d1a81e/disk to a smaller size. {{(pid=74190) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 18 11:52:26 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-1343bb93-97ce-4b75-82f7-10077af96c3c tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] Created local disks {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 11:52:26 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-1343bb93-97ce-4b75-82f7-10077af96c3c tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] Ensure instance console log exists: /opt/stack/data/nova/instances/8eec9cde-3553-4fc8-9162-cda963d1a81e/console.log {{(pid=74190) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 11:52:26 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-1343bb93-97ce-4b75-82f7-10077af96c3c tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:52:26 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-1343bb93-97ce-4b75-82f7-10077af96c3c tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:52:26 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-1343bb93-97ce-4b75-82f7-10077af96c3c tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:52:26 user nova-compute[74190]: DEBUG nova.network.neutron [None req-cb1b3c45-07fb-4d41-8cc4-87acccba66c5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: 47ed3fb0-c159-484f-8380-79b5564d0ac1] Successfully updated port: 693871aa-4bc1-41f8-aa49-4882800b9592 {{(pid=74190) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 11:52:26 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-cb1b3c45-07fb-4d41-8cc4-87acccba66c5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Acquiring lock "refresh_cache-47ed3fb0-c159-484f-8380-79b5564d0ac1" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:52:26 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-cb1b3c45-07fb-4d41-8cc4-87acccba66c5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Acquired lock "refresh_cache-47ed3fb0-c159-484f-8380-79b5564d0ac1" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:52:26 user nova-compute[74190]: DEBUG nova.network.neutron [None req-cb1b3c45-07fb-4d41-8cc4-87acccba66c5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: 47ed3fb0-c159-484f-8380-79b5564d0ac1] Building network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 11:52:26 user nova-compute[74190]: DEBUG nova.compute.manager [req-406464ff-7790-4adf-84ad-27007a29833a req-b1f9d878-9800-42d4-af46-b059f30fac3e service nova] [instance: 47ed3fb0-c159-484f-8380-79b5564d0ac1] Received event network-changed-693871aa-4bc1-41f8-aa49-4882800b9592 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:52:26 user nova-compute[74190]: DEBUG nova.compute.manager [req-406464ff-7790-4adf-84ad-27007a29833a req-b1f9d878-9800-42d4-af46-b059f30fac3e service nova] [instance: 47ed3fb0-c159-484f-8380-79b5564d0ac1] Refreshing instance network info cache due to event network-changed-693871aa-4bc1-41f8-aa49-4882800b9592. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 11:52:26 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-406464ff-7790-4adf-84ad-27007a29833a req-b1f9d878-9800-42d4-af46-b059f30fac3e service nova] Acquiring lock "refresh_cache-47ed3fb0-c159-484f-8380-79b5564d0ac1" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:52:26 user nova-compute[74190]: DEBUG nova.network.neutron [None req-cb1b3c45-07fb-4d41-8cc4-87acccba66c5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: 47ed3fb0-c159-484f-8380-79b5564d0ac1] Instance cache missing network info. {{(pid=74190) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 11:52:27 user nova-compute[74190]: DEBUG nova.network.neutron [None req-1343bb93-97ce-4b75-82f7-10077af96c3c tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] Successfully created port: 1a9d494b-8515-4508-b0d8-387e20c897bb {{(pid=74190) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 11:52:27 user nova-compute[74190]: DEBUG nova.network.neutron [None req-cb1b3c45-07fb-4d41-8cc4-87acccba66c5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: 47ed3fb0-c159-484f-8380-79b5564d0ac1] Updating instance_info_cache with network_info: [{"id": "693871aa-4bc1-41f8-aa49-4882800b9592", "address": "fa:16:3e:4b:2c:c3", "network": {"id": "cf0a4705-3fff-4716-87ac-b0ca7700e11c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1739631852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cf8d4d4f504e82868ed295e054644c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap693871aa-4b", "ovs_interfaceid": "693871aa-4bc1-41f8-aa49-4882800b9592", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:52:27 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-cb1b3c45-07fb-4d41-8cc4-87acccba66c5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Releasing lock "refresh_cache-47ed3fb0-c159-484f-8380-79b5564d0ac1" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:52:27 user nova-compute[74190]: DEBUG nova.compute.manager [None req-cb1b3c45-07fb-4d41-8cc4-87acccba66c5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: 47ed3fb0-c159-484f-8380-79b5564d0ac1] Instance network_info: |[{"id": "693871aa-4bc1-41f8-aa49-4882800b9592", "address": "fa:16:3e:4b:2c:c3", "network": {"id": "cf0a4705-3fff-4716-87ac-b0ca7700e11c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1739631852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cf8d4d4f504e82868ed295e054644c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap693871aa-4b", "ovs_interfaceid": "693871aa-4bc1-41f8-aa49-4882800b9592", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 11:52:27 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-406464ff-7790-4adf-84ad-27007a29833a req-b1f9d878-9800-42d4-af46-b059f30fac3e service nova] Acquired lock "refresh_cache-47ed3fb0-c159-484f-8380-79b5564d0ac1" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:52:27 user nova-compute[74190]: DEBUG nova.network.neutron [req-406464ff-7790-4adf-84ad-27007a29833a req-b1f9d878-9800-42d4-af46-b059f30fac3e service nova] [instance: 47ed3fb0-c159-484f-8380-79b5564d0ac1] Refreshing network info cache for port 693871aa-4bc1-41f8-aa49-4882800b9592 {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 11:52:27 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-cb1b3c45-07fb-4d41-8cc4-87acccba66c5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: 47ed3fb0-c159-484f-8380-79b5564d0ac1] Start _get_guest_xml network_info=[{"id": "693871aa-4bc1-41f8-aa49-4882800b9592", "address": "fa:16:3e:4b:2c:c3", "network": {"id": "cf0a4705-3fff-4716-87ac-b0ca7700e11c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1739631852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cf8d4d4f504e82868ed295e054644c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap693871aa-4b", "ovs_interfaceid": "693871aa-4bc1-41f8-aa49-4882800b9592", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'image_id': '6e88bbf0-6e78-49a8-b3c5-9453d22a89df'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 11:52:27 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-cb1b3c45-07fb-4d41-8cc4-87acccba66c5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:52:27 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-cb1b3c45-07fb-4d41-8cc4-87acccba66c5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:52:27 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-cb1b3c45-07fb-4d41-8cc4-87acccba66c5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 11:52:27 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-cb1b3c45-07fb-4d41-8cc4-87acccba66c5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] CPU controller missing on host. {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 11:52:27 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-cb1b3c45-07fb-4d41-8cc4-87acccba66c5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 11:52:27 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-cb1b3c45-07fb-4d41-8cc4-87acccba66c5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] CPU controller found on host. {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 11:52:27 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-cb1b3c45-07fb-4d41-8cc4-87acccba66c5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74190) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 11:52:27 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-cb1b3c45-07fb-4d41-8cc4-87acccba66c5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T11:37:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 11:52:27 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-cb1b3c45-07fb-4d41-8cc4-87acccba66c5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Flavor limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 11:52:27 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-cb1b3c45-07fb-4d41-8cc4-87acccba66c5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Image limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 11:52:27 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-cb1b3c45-07fb-4d41-8cc4-87acccba66c5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Flavor pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 11:52:27 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-cb1b3c45-07fb-4d41-8cc4-87acccba66c5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Image pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 11:52:27 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-cb1b3c45-07fb-4d41-8cc4-87acccba66c5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 11:52:27 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-cb1b3c45-07fb-4d41-8cc4-87acccba66c5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 11:52:27 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-cb1b3c45-07fb-4d41-8cc4-87acccba66c5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 11:52:27 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-cb1b3c45-07fb-4d41-8cc4-87acccba66c5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Got 1 possible topologies {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 11:52:27 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-cb1b3c45-07fb-4d41-8cc4-87acccba66c5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 11:52:27 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-cb1b3c45-07fb-4d41-8cc4-87acccba66c5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 11:52:27 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-cb1b3c45-07fb-4d41-8cc4-87acccba66c5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:52:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-456038629',display_name='tempest-AttachVolumeTestJSON-server-456038629',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-456038629',id=20,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBkgFytixGjsjs/C1VxYydi/VmFlzQx03eXWvil/WfHYEFf8RVJiRUoA22chhGmvUuOxPuOWK93Bmu7ldGrtzJ/Hm1HU7mPE3T0sLniuJZRStzEYProGy2VdfSBuWO2F2A==',key_name='tempest-keypair-343955058',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='99cf8d4d4f504e82868ed295e054644c',ramdisk_id='',reservation_id='r-ffhxqcn6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-2125017306',owner_user_name='tempest-AttachVolumeTestJSON-2125017306-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:52:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='852309a19f1b4d49a4974c3be53f67cb',uuid=47ed3fb0-c159-484f-8380-79b5564d0ac1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "693871aa-4bc1-41f8-aa49-4882800b9592", "address": "fa:16:3e:4b:2c:c3", "network": {"id": "cf0a4705-3fff-4716-87ac-b0ca7700e11c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1739631852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cf8d4d4f504e82868ed295e054644c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap693871aa-4b", "ovs_interfaceid": "693871aa-4bc1-41f8-aa49-4882800b9592", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74190) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 11:52:27 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-cb1b3c45-07fb-4d41-8cc4-87acccba66c5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Converting VIF {"id": "693871aa-4bc1-41f8-aa49-4882800b9592", "address": "fa:16:3e:4b:2c:c3", "network": {"id": "cf0a4705-3fff-4716-87ac-b0ca7700e11c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1739631852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cf8d4d4f504e82868ed295e054644c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap693871aa-4b", "ovs_interfaceid": "693871aa-4bc1-41f8-aa49-4882800b9592", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:52:27 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-cb1b3c45-07fb-4d41-8cc4-87acccba66c5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:2c:c3,bridge_name='br-int',has_traffic_filtering=True,id=693871aa-4bc1-41f8-aa49-4882800b9592,network=Network(cf0a4705-3fff-4716-87ac-b0ca7700e11c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap693871aa-4b') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:52:27 user nova-compute[74190]: DEBUG nova.objects.instance [None req-cb1b3c45-07fb-4d41-8cc4-87acccba66c5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lazy-loading 'pci_devices' on Instance uuid 47ed3fb0-c159-484f-8380-79b5564d0ac1 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:52:27 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-cb1b3c45-07fb-4d41-8cc4-87acccba66c5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: 47ed3fb0-c159-484f-8380-79b5564d0ac1] End _get_guest_xml xml=<domain type="kvm">
Oct 18 11:52:27 user nova-compute[74190]:   <uuid>47ed3fb0-c159-484f-8380-79b5564d0ac1</uuid>
Oct 18 11:52:27 user nova-compute[74190]:   <name>instance-00000014</name>
Oct 18 11:52:27 user nova-compute[74190]:   <memory>524288</memory>
Oct 18 11:52:27 user nova-compute[74190]:   <vcpu>1</vcpu>
Oct 18 11:52:27 user nova-compute[74190]:   <metadata>
Oct 18 11:52:27 user nova-compute[74190]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 11:52:27 user nova-compute[74190]:       <nova:package version="0.0.0"/>
Oct 18 11:52:27 user nova-compute[74190]:       <nova:name>tempest-AttachVolumeTestJSON-server-456038629</nova:name>
Oct 18 11:52:27 user nova-compute[74190]:       <nova:creationTime>2023-10-18 11:52:27</nova:creationTime>
Oct 18 11:52:27 user nova-compute[74190]:       <nova:flavor name="m1.tiny">
Oct 18 11:52:27 user nova-compute[74190]:         <nova:memory>512</nova:memory>
Oct 18 11:52:27 user nova-compute[74190]:         <nova:disk>1</nova:disk>
Oct 18 11:52:27 user nova-compute[74190]:         <nova:swap>0</nova:swap>
Oct 18 11:52:27 user nova-compute[74190]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 11:52:27 user nova-compute[74190]:         <nova:vcpus>1</nova:vcpus>
Oct 18 11:52:27 user nova-compute[74190]:       </nova:flavor>
Oct 18 11:52:27 user nova-compute[74190]:       <nova:owner>
Oct 18 11:52:27 user nova-compute[74190]:         <nova:user uuid="852309a19f1b4d49a4974c3be53f67cb">tempest-AttachVolumeTestJSON-2125017306-project-member</nova:user>
Oct 18 11:52:27 user nova-compute[74190]:         <nova:project uuid="99cf8d4d4f504e82868ed295e054644c">tempest-AttachVolumeTestJSON-2125017306</nova:project>
Oct 18 11:52:27 user nova-compute[74190]:       </nova:owner>
Oct 18 11:52:27 user nova-compute[74190]:       <nova:root type="image" uuid="6e88bbf0-6e78-49a8-b3c5-9453d22a89df"/>
Oct 18 11:52:27 user nova-compute[74190]:       <nova:ports>
Oct 18 11:52:27 user nova-compute[74190]:         <nova:port uuid="693871aa-4bc1-41f8-aa49-4882800b9592">
Oct 18 11:52:27 user nova-compute[74190]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 18 11:52:27 user nova-compute[74190]:         </nova:port>
Oct 18 11:52:27 user nova-compute[74190]:       </nova:ports>
Oct 18 11:52:27 user nova-compute[74190]:     </nova:instance>
Oct 18 11:52:27 user nova-compute[74190]:   </metadata>
Oct 18 11:52:27 user nova-compute[74190]:   <sysinfo type="smbios">
Oct 18 11:52:27 user nova-compute[74190]:     <system>
Oct 18 11:52:27 user nova-compute[74190]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 11:52:27 user nova-compute[74190]:       <entry name="product">OpenStack Nova</entry>
Oct 18 11:52:27 user nova-compute[74190]:       <entry name="version">0.0.0</entry>
Oct 18 11:52:27 user nova-compute[74190]:       <entry name="serial">47ed3fb0-c159-484f-8380-79b5564d0ac1</entry>
Oct 18 11:52:27 user nova-compute[74190]:       <entry name="uuid">47ed3fb0-c159-484f-8380-79b5564d0ac1</entry>
Oct 18 11:52:27 user nova-compute[74190]:       <entry name="family">Virtual Machine</entry>
Oct 18 11:52:27 user nova-compute[74190]:     </system>
Oct 18 11:52:27 user nova-compute[74190]:   </sysinfo>
Oct 18 11:52:27 user nova-compute[74190]:   <os>
Oct 18 11:52:27 user nova-compute[74190]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 11:52:27 user nova-compute[74190]:     <boot dev="hd"/>
Oct 18 11:52:27 user nova-compute[74190]:     <smbios mode="sysinfo"/>
Oct 18 11:52:27 user nova-compute[74190]:   </os>
Oct 18 11:52:27 user nova-compute[74190]:   <features>
Oct 18 11:52:27 user nova-compute[74190]:     <acpi/>
Oct 18 11:52:27 user nova-compute[74190]:     <apic/>
Oct 18 11:52:27 user nova-compute[74190]:     <vmcoreinfo/>
Oct 18 11:52:27 user nova-compute[74190]:   </features>
Oct 18 11:52:27 user nova-compute[74190]:   <clock offset="utc">
Oct 18 11:52:27 user nova-compute[74190]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 11:52:27 user nova-compute[74190]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 11:52:27 user nova-compute[74190]:     <timer name="hpet" present="no"/>
Oct 18 11:52:27 user nova-compute[74190]:   </clock>
Oct 18 11:52:27 user nova-compute[74190]:   <cpu mode="custom" match="exact">
Oct 18 11:52:27 user nova-compute[74190]:     <model>Nehalem</model>
Oct 18 11:52:27 user nova-compute[74190]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 11:52:27 user nova-compute[74190]:   </cpu>
Oct 18 11:52:27 user nova-compute[74190]:   <devices>
Oct 18 11:52:27 user nova-compute[74190]:     <disk type="file" device="disk">
Oct 18 11:52:27 user nova-compute[74190]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 11:52:27 user nova-compute[74190]:       <source file="/opt/stack/data/nova/instances/47ed3fb0-c159-484f-8380-79b5564d0ac1/disk"/>
Oct 18 11:52:27 user nova-compute[74190]:       <target dev="vda" bus="virtio"/>
Oct 18 11:52:27 user nova-compute[74190]:     </disk>
Oct 18 11:52:27 user nova-compute[74190]:     <interface type="ethernet">
Oct 18 11:52:27 user nova-compute[74190]:       <mac address="fa:16:3e:4b:2c:c3"/>
Oct 18 11:52:27 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:52:27 user nova-compute[74190]:       <mtu size="1442"/>
Oct 18 11:52:27 user nova-compute[74190]:       <target dev="tap693871aa-4b"/>
Oct 18 11:52:27 user nova-compute[74190]:     </interface>
Oct 18 11:52:27 user nova-compute[74190]:     <serial type="pty">
Oct 18 11:52:27 user nova-compute[74190]:       <log file="/opt/stack/data/nova/instances/47ed3fb0-c159-484f-8380-79b5564d0ac1/console.log" append="off"/>
Oct 18 11:52:27 user nova-compute[74190]:     </serial>
Oct 18 11:52:27 user nova-compute[74190]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 11:52:27 user nova-compute[74190]:     <video>
Oct 18 11:52:27 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:52:27 user nova-compute[74190]:     </video>
Oct 18 11:52:27 user nova-compute[74190]:     <rng model="virtio">
Oct 18 11:52:27 user nova-compute[74190]:       <backend model="random">/dev/urandom</backend>
Oct 18 11:52:27 user nova-compute[74190]:     </rng>
Oct 18 11:52:27 user nova-compute[74190]:     <controller type="usb" index="0" model="none"/>
Oct 18 11:52:27 user nova-compute[74190]:     <memballoon model="virtio">
Oct 18 11:52:27 user nova-compute[74190]:       <stats period="10"/>
Oct 18 11:52:27 user nova-compute[74190]:     </memballoon>
Oct 18 11:52:27 user nova-compute[74190]:   </devices>
Oct 18 11:52:27 user nova-compute[74190]: </domain>
Oct 18 11:52:27 user nova-compute[74190]:  {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 11:52:27 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-cb1b3c45-07fb-4d41-8cc4-87acccba66c5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:52:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-456038629',display_name='tempest-AttachVolumeTestJSON-server-456038629',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-456038629',id=20,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBkgFytixGjsjs/C1VxYydi/VmFlzQx03eXWvil/WfHYEFf8RVJiRUoA22chhGmvUuOxPuOWK93Bmu7ldGrtzJ/Hm1HU7mPE3T0sLniuJZRStzEYProGy2VdfSBuWO2F2A==',key_name='tempest-keypair-343955058',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='99cf8d4d4f504e82868ed295e054644c',ramdisk_id='',reservation_id='r-ffhxqcn6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-2125017306',owner_user_name='tempest-AttachVolumeTestJSON-2125017306-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:52:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='852309a19f1b4d49a4974c3be53f67cb',uuid=47ed3fb0-c159-484f-8380-79b5564d0ac1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "693871aa-4bc1-41f8-aa49-4882800b9592", "address": "fa:16:3e:4b:2c:c3", "network": {"id": "cf0a4705-3fff-4716-87ac-b0ca7700e11c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1739631852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cf8d4d4f504e82868ed295e054644c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap693871aa-4b", "ovs_interfaceid": "693871aa-4bc1-41f8-aa49-4882800b9592", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 11:52:27 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-cb1b3c45-07fb-4d41-8cc4-87acccba66c5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Converting VIF {"id": "693871aa-4bc1-41f8-aa49-4882800b9592", "address": "fa:16:3e:4b:2c:c3", "network": {"id": "cf0a4705-3fff-4716-87ac-b0ca7700e11c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1739631852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cf8d4d4f504e82868ed295e054644c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap693871aa-4b", "ovs_interfaceid": "693871aa-4bc1-41f8-aa49-4882800b9592", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:52:27 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-cb1b3c45-07fb-4d41-8cc4-87acccba66c5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:2c:c3,bridge_name='br-int',has_traffic_filtering=True,id=693871aa-4bc1-41f8-aa49-4882800b9592,network=Network(cf0a4705-3fff-4716-87ac-b0ca7700e11c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap693871aa-4b') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:52:27 user nova-compute[74190]: DEBUG os_vif [None req-cb1b3c45-07fb-4d41-8cc4-87acccba66c5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:2c:c3,bridge_name='br-int',has_traffic_filtering=True,id=693871aa-4bc1-41f8-aa49-4882800b9592,network=Network(cf0a4705-3fff-4716-87ac-b0ca7700e11c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap693871aa-4b') {{(pid=74190) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 11:52:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:52:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 11:52:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '83f9fe26-0dca-5685-82c6-b52282ecbbb8', '_type': 'linux-noop'}}, row=False) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:52:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap693871aa-4b, may_exist=True, interface_attrs={}) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:52:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap693871aa-4b, col_values=(('qos', UUID('9ff4a270-0b09-4f5a-8c9a-7e4d6ca61277')),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:52:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap693871aa-4b, col_values=(('external_ids', {'iface-id': '693871aa-4bc1-41f8-aa49-4882800b9592', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4b:2c:c3', 'vm-uuid': '47ed3fb0-c159-484f-8380-79b5564d0ac1'}),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:52:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:52:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:27 user nova-compute[74190]: INFO os_vif [None req-cb1b3c45-07fb-4d41-8cc4-87acccba66c5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:2c:c3,bridge_name='br-int',has_traffic_filtering=True,id=693871aa-4bc1-41f8-aa49-4882800b9592,network=Network(cf0a4705-3fff-4716-87ac-b0ca7700e11c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap693871aa-4b')
Oct 18 11:52:27 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-cb1b3c45-07fb-4d41-8cc4-87acccba66c5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] No BDM found with device name vda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 11:52:27 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-cb1b3c45-07fb-4d41-8cc4-87acccba66c5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] No VIF found with MAC fa:16:3e:4b:2c:c3, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 11:52:27 user nova-compute[74190]: DEBUG nova.network.neutron [req-406464ff-7790-4adf-84ad-27007a29833a req-b1f9d878-9800-42d4-af46-b059f30fac3e service nova] [instance: 47ed3fb0-c159-484f-8380-79b5564d0ac1] Updated VIF entry in instance network info cache for port 693871aa-4bc1-41f8-aa49-4882800b9592. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 11:52:27 user nova-compute[74190]: DEBUG nova.network.neutron [req-406464ff-7790-4adf-84ad-27007a29833a req-b1f9d878-9800-42d4-af46-b059f30fac3e service nova] [instance: 47ed3fb0-c159-484f-8380-79b5564d0ac1] Updating instance_info_cache with network_info: [{"id": "693871aa-4bc1-41f8-aa49-4882800b9592", "address": "fa:16:3e:4b:2c:c3", "network": {"id": "cf0a4705-3fff-4716-87ac-b0ca7700e11c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1739631852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cf8d4d4f504e82868ed295e054644c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap693871aa-4b", "ovs_interfaceid": "693871aa-4bc1-41f8-aa49-4882800b9592", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:52:27 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-406464ff-7790-4adf-84ad-27007a29833a req-b1f9d878-9800-42d4-af46-b059f30fac3e service nova] Releasing lock "refresh_cache-47ed3fb0-c159-484f-8380-79b5564d0ac1" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG nova.network.neutron [None req-1343bb93-97ce-4b75-82f7-10077af96c3c tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] Successfully updated port: 1a9d494b-8515-4508-b0d8-387e20c897bb {{(pid=74190) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-1343bb93-97ce-4b75-82f7-10077af96c3c tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Acquiring lock "refresh_cache-8eec9cde-3553-4fc8-9162-cda963d1a81e" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-1343bb93-97ce-4b75-82f7-10077af96c3c tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Acquired lock "refresh_cache-8eec9cde-3553-4fc8-9162-cda963d1a81e" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG nova.network.neutron [None req-1343bb93-97ce-4b75-82f7-10077af96c3c tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] Building network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG nova.network.neutron [None req-1343bb93-97ce-4b75-82f7-10077af96c3c tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] Instance cache missing network info. {{(pid=74190) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG nova.network.neutron [None req-1343bb93-97ce-4b75-82f7-10077af96c3c tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] Updating instance_info_cache with network_info: [{"id": "1a9d494b-8515-4508-b0d8-387e20c897bb", "address": "fa:16:3e:41:d4:c9", "network": {"id": "56026ce6-77fb-40c7-9976-732e745c219d", "bridge": "br-int", "label": "tempest-TestStampPattern-989787934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "389e1c2dbc904130ba08b137f0b2e837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a9d494b-85", "ovs_interfaceid": "1a9d494b-8515-4508-b0d8-387e20c897bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-1343bb93-97ce-4b75-82f7-10077af96c3c tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Releasing lock "refresh_cache-8eec9cde-3553-4fc8-9162-cda963d1a81e" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG nova.compute.manager [None req-1343bb93-97ce-4b75-82f7-10077af96c3c tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] Instance network_info: |[{"id": "1a9d494b-8515-4508-b0d8-387e20c897bb", "address": "fa:16:3e:41:d4:c9", "network": {"id": "56026ce6-77fb-40c7-9976-732e745c219d", "bridge": "br-int", "label": "tempest-TestStampPattern-989787934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "389e1c2dbc904130ba08b137f0b2e837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a9d494b-85", "ovs_interfaceid": "1a9d494b-8515-4508-b0d8-387e20c897bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-1343bb93-97ce-4b75-82f7-10077af96c3c tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] Start _get_guest_xml network_info=[{"id": "1a9d494b-8515-4508-b0d8-387e20c897bb", "address": "fa:16:3e:41:d4:c9", "network": {"id": "56026ce6-77fb-40c7-9976-732e745c219d", "bridge": "br-int", "label": "tempest-TestStampPattern-989787934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "389e1c2dbc904130ba08b137f0b2e837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a9d494b-85", "ovs_interfaceid": "1a9d494b-8515-4508-b0d8-387e20c897bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'image_id': '6e88bbf0-6e78-49a8-b3c5-9453d22a89df'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 11:52:28 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-1343bb93-97ce-4b75-82f7-10077af96c3c tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:52:28 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-1343bb93-97ce-4b75-82f7-10077af96c3c tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:52:28 user nova-compute[74190]: DEBUG nova.compute.manager [req-fefe13ca-80da-4972-a87f-0fe32abb8a44 req-fd03fa38-8674-4d02-812b-6d7a7bb6cf0b service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Received event network-vif-plugged-d5f803c0-bb6c-41be-8294-fb3565e03413 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-fefe13ca-80da-4972-a87f-0fe32abb8a44 req-fd03fa38-8674-4d02-812b-6d7a7bb6cf0b service nova] Acquiring lock "cd28be8d-847b-468c-860f-4f479740738d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-fefe13ca-80da-4972-a87f-0fe32abb8a44 req-fd03fa38-8674-4d02-812b-6d7a7bb6cf0b service nova] Lock "cd28be8d-847b-468c-860f-4f479740738d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-fefe13ca-80da-4972-a87f-0fe32abb8a44 req-fd03fa38-8674-4d02-812b-6d7a7bb6cf0b service nova] Lock "cd28be8d-847b-468c-860f-4f479740738d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG nova.compute.manager [req-fefe13ca-80da-4972-a87f-0fe32abb8a44 req-fd03fa38-8674-4d02-812b-6d7a7bb6cf0b service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] No waiting events found dispatching network-vif-plugged-d5f803c0-bb6c-41be-8294-fb3565e03413 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:52:28 user nova-compute[74190]: WARNING nova.compute.manager [req-fefe13ca-80da-4972-a87f-0fe32abb8a44 req-fd03fa38-8674-4d02-812b-6d7a7bb6cf0b service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Received unexpected event network-vif-plugged-d5f803c0-bb6c-41be-8294-fb3565e03413 for instance with vm_state active and task_state deleting.
Oct 18 11:52:28 user nova-compute[74190]: DEBUG nova.compute.manager [req-fefe13ca-80da-4972-a87f-0fe32abb8a44 req-fd03fa38-8674-4d02-812b-6d7a7bb6cf0b service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Received event network-vif-unplugged-35f010df-56fb-4234-879b-19f86f36a2d3 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-fefe13ca-80da-4972-a87f-0fe32abb8a44 req-fd03fa38-8674-4d02-812b-6d7a7bb6cf0b service nova] Acquiring lock "cd28be8d-847b-468c-860f-4f479740738d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-fefe13ca-80da-4972-a87f-0fe32abb8a44 req-fd03fa38-8674-4d02-812b-6d7a7bb6cf0b service nova] Lock "cd28be8d-847b-468c-860f-4f479740738d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-fefe13ca-80da-4972-a87f-0fe32abb8a44 req-fd03fa38-8674-4d02-812b-6d7a7bb6cf0b service nova] Lock "cd28be8d-847b-468c-860f-4f479740738d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG nova.compute.manager [req-fefe13ca-80da-4972-a87f-0fe32abb8a44 req-fd03fa38-8674-4d02-812b-6d7a7bb6cf0b service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] No waiting events found dispatching network-vif-unplugged-35f010df-56fb-4234-879b-19f86f36a2d3 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG nova.compute.manager [req-fefe13ca-80da-4972-a87f-0fe32abb8a44 req-fd03fa38-8674-4d02-812b-6d7a7bb6cf0b service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Received event network-vif-unplugged-35f010df-56fb-4234-879b-19f86f36a2d3 for instance with task_state deleting. {{(pid=74190) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG nova.compute.manager [req-fefe13ca-80da-4972-a87f-0fe32abb8a44 req-fd03fa38-8674-4d02-812b-6d7a7bb6cf0b service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Received event network-vif-plugged-35f010df-56fb-4234-879b-19f86f36a2d3 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-fefe13ca-80da-4972-a87f-0fe32abb8a44 req-fd03fa38-8674-4d02-812b-6d7a7bb6cf0b service nova] Acquiring lock "cd28be8d-847b-468c-860f-4f479740738d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-fefe13ca-80da-4972-a87f-0fe32abb8a44 req-fd03fa38-8674-4d02-812b-6d7a7bb6cf0b service nova] Lock "cd28be8d-847b-468c-860f-4f479740738d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-fefe13ca-80da-4972-a87f-0fe32abb8a44 req-fd03fa38-8674-4d02-812b-6d7a7bb6cf0b service nova] Lock "cd28be8d-847b-468c-860f-4f479740738d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG nova.compute.manager [req-fefe13ca-80da-4972-a87f-0fe32abb8a44 req-fd03fa38-8674-4d02-812b-6d7a7bb6cf0b service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] No waiting events found dispatching network-vif-plugged-35f010df-56fb-4234-879b-19f86f36a2d3 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:52:28 user nova-compute[74190]: WARNING nova.compute.manager [req-fefe13ca-80da-4972-a87f-0fe32abb8a44 req-fd03fa38-8674-4d02-812b-6d7a7bb6cf0b service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Received unexpected event network-vif-plugged-35f010df-56fb-4234-879b-19f86f36a2d3 for instance with vm_state active and task_state deleting.
Oct 18 11:52:28 user nova-compute[74190]: DEBUG nova.compute.manager [req-fefe13ca-80da-4972-a87f-0fe32abb8a44 req-fd03fa38-8674-4d02-812b-6d7a7bb6cf0b service nova] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] Received event network-changed-1a9d494b-8515-4508-b0d8-387e20c897bb {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG nova.compute.manager [req-fefe13ca-80da-4972-a87f-0fe32abb8a44 req-fd03fa38-8674-4d02-812b-6d7a7bb6cf0b service nova] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] Refreshing instance network info cache due to event network-changed-1a9d494b-8515-4508-b0d8-387e20c897bb. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-fefe13ca-80da-4972-a87f-0fe32abb8a44 req-fd03fa38-8674-4d02-812b-6d7a7bb6cf0b service nova] Acquiring lock "refresh_cache-8eec9cde-3553-4fc8-9162-cda963d1a81e" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-fefe13ca-80da-4972-a87f-0fe32abb8a44 req-fd03fa38-8674-4d02-812b-6d7a7bb6cf0b service nova] Acquired lock "refresh_cache-8eec9cde-3553-4fc8-9162-cda963d1a81e" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG nova.network.neutron [req-fefe13ca-80da-4972-a87f-0fe32abb8a44 req-fd03fa38-8674-4d02-812b-6d7a7bb6cf0b service nova] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] Refreshing network info cache for port 1a9d494b-8515-4508-b0d8-387e20c897bb {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-1343bb93-97ce-4b75-82f7-10077af96c3c tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-1343bb93-97ce-4b75-82f7-10077af96c3c tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] CPU controller missing on host. {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-1343bb93-97ce-4b75-82f7-10077af96c3c tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-1343bb93-97ce-4b75-82f7-10077af96c3c tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] CPU controller found on host. {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-1343bb93-97ce-4b75-82f7-10077af96c3c tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74190) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-1343bb93-97ce-4b75-82f7-10077af96c3c tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T11:37:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-1343bb93-97ce-4b75-82f7-10077af96c3c tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Flavor limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-1343bb93-97ce-4b75-82f7-10077af96c3c tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Image limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-1343bb93-97ce-4b75-82f7-10077af96c3c tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Flavor pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-1343bb93-97ce-4b75-82f7-10077af96c3c tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Image pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-1343bb93-97ce-4b75-82f7-10077af96c3c tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-1343bb93-97ce-4b75-82f7-10077af96c3c tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-1343bb93-97ce-4b75-82f7-10077af96c3c tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-1343bb93-97ce-4b75-82f7-10077af96c3c tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Got 1 possible topologies {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-1343bb93-97ce-4b75-82f7-10077af96c3c tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-1343bb93-97ce-4b75-82f7-10077af96c3c tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-1343bb93-97ce-4b75-82f7-10077af96c3c tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:52:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-542376931',display_name='tempest-TestStampPattern-server-542376931',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-542376931',id=21,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIWsfXQkdYGPKym2GX8abBzSE1TgaUSMy3GxYdQVyxTc9qElJuld8J6hiVUfhDnJocQnssGij1BqYm1SJS/pWo5ybDXV8dLSSiMAGmlRDARneJEWLLFP/+ol+LaeplXvXg==',key_name='tempest-TestStampPattern-1418984438',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='389e1c2dbc904130ba08b137f0b2e837',ramdisk_id='',reservation_id='r-yopd55yn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-2116730913',owner_user_name='tempest-TestStampPattern-2116730913-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:52:25Z,user_data=None,user_id='a252f2c479b740a29a1adc79e6346b20',uuid=8eec9cde-3553-4fc8-9162-cda963d1a81e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1a9d494b-8515-4508-b0d8-387e20c897bb", "address": "fa:16:3e:41:d4:c9", "network": {"id": "56026ce6-77fb-40c7-9976-732e745c219d", "bridge": "br-int", "label": "tempest-TestStampPattern-989787934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "389e1c2dbc904130ba08b137f0b2e837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a9d494b-85", "ovs_interfaceid": "1a9d494b-8515-4508-b0d8-387e20c897bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74190) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-1343bb93-97ce-4b75-82f7-10077af96c3c tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Converting VIF {"id": "1a9d494b-8515-4508-b0d8-387e20c897bb", "address": "fa:16:3e:41:d4:c9", "network": {"id": "56026ce6-77fb-40c7-9976-732e745c219d", "bridge": "br-int", "label": "tempest-TestStampPattern-989787934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "389e1c2dbc904130ba08b137f0b2e837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a9d494b-85", "ovs_interfaceid": "1a9d494b-8515-4508-b0d8-387e20c897bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-1343bb93-97ce-4b75-82f7-10077af96c3c tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:d4:c9,bridge_name='br-int',has_traffic_filtering=True,id=1a9d494b-8515-4508-b0d8-387e20c897bb,network=Network(56026ce6-77fb-40c7-9976-732e745c219d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a9d494b-85') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG nova.objects.instance [None req-1343bb93-97ce-4b75-82f7-10077af96c3c tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Lazy-loading 'pci_devices' on Instance uuid 8eec9cde-3553-4fc8-9162-cda963d1a81e {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG nova.compute.manager [req-37e6fb75-7be2-4366-951f-555bd60843be req-4d880d5a-180a-4a76-bf8c-0470f1a05069 service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Received event network-vif-deleted-11c7c4ff-db41-4231-8300-ee85a94619c1 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:52:28 user nova-compute[74190]: INFO nova.compute.manager [req-37e6fb75-7be2-4366-951f-555bd60843be req-4d880d5a-180a-4a76-bf8c-0470f1a05069 service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Neutron deleted interface 11c7c4ff-db41-4231-8300-ee85a94619c1; detaching it from the instance and deleting it from the info cache
Oct 18 11:52:28 user nova-compute[74190]: DEBUG nova.network.neutron [req-37e6fb75-7be2-4366-951f-555bd60843be req-4d880d5a-180a-4a76-bf8c-0470f1a05069 service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Updating instance_info_cache with network_info: [{"id": "c2ed33ff-2096-4def-98c5-709db8bc0ea4", "address": "fa:16:3e:11:db:57", "network": {"id": "bef90182-e108-423e-842c-2037d5cc1a4b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-640378484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ed33ff-20", "ovs_interfaceid": "c2ed33ff-2096-4def-98c5-709db8bc0ea4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "aca29f48-4a6d-472a-ac70-7006b63b9996", "address": "fa:16:3e:71:0a:c4", "network": {"id": "50f9056b-d85d-4a43-8981-3c5c98e1bf52", "bridge": "br-int", "label": "tempest-device-tagging-net1-737454421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaca29f48-4a", "ovs_interfaceid": "aca29f48-4a6d-472a-ac70-7006b63b9996", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d5f803c0-bb6c-41be-8294-fb3565e03413", "address": "fa:16:3e:43:be:0d", "network": {"id": "50f9056b-d85d-4a43-8981-3c5c98e1bf52", "bridge": "br-int", "label": "tempest-device-tagging-net1-737454421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f803c0-bb", "ovs_interfaceid": "d5f803c0-bb6c-41be-8294-fb3565e03413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0a00abcf-957e-4276-a975-522f8a42ad55", "address": "fa:16:3e:c8:b9:46", "network": {"id": "50f9056b-d85d-4a43-8981-3c5c98e1bf52", "bridge": "br-int", "label": "tempest-device-tagging-net1-737454421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a00abcf-95", "ovs_interfaceid": "0a00abcf-957e-4276-a975-522f8a42ad55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dba85cc3-dd42-4fa4-96d3-bec15903344f", "address": "fa:16:3e:fb:32:89", "network": {"id": "1ba257ec-d104-413d-bbf9-d9702ed5a1b4", "bridge": "br-int", "label": "tempest-device-tagging-net2-445498545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdba85cc3-dd", "ovs_interfaceid": "dba85cc3-dd42-4fa4-96d3-bec15903344f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "35f010df-56fb-4234-879b-19f86f36a2d3", "address": "fa:16:3e:bf:a7:36", "network": {"id": "1ba257ec-d104-413d-bbf9-d9702ed5a1b4", "bridge": "br-int", "label": "tempest-device-tagging-net2-445498545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35f010df-56", "ovs_interfaceid": "35f010df-56fb-4234-879b-19f86f36a2d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-1343bb93-97ce-4b75-82f7-10077af96c3c tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] End _get_guest_xml xml=<domain type="kvm">
Oct 18 11:52:28 user nova-compute[74190]:   <uuid>8eec9cde-3553-4fc8-9162-cda963d1a81e</uuid>
Oct 18 11:52:28 user nova-compute[74190]:   <name>instance-00000015</name>
Oct 18 11:52:28 user nova-compute[74190]:   <memory>524288</memory>
Oct 18 11:52:28 user nova-compute[74190]:   <vcpu>1</vcpu>
Oct 18 11:52:28 user nova-compute[74190]:   <metadata>
Oct 18 11:52:28 user nova-compute[74190]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 11:52:28 user nova-compute[74190]:       <nova:package version="0.0.0"/>
Oct 18 11:52:28 user nova-compute[74190]:       <nova:name>tempest-TestStampPattern-server-542376931</nova:name>
Oct 18 11:52:28 user nova-compute[74190]:       <nova:creationTime>2023-10-18 11:52:28</nova:creationTime>
Oct 18 11:52:28 user nova-compute[74190]:       <nova:flavor name="m1.tiny">
Oct 18 11:52:28 user nova-compute[74190]:         <nova:memory>512</nova:memory>
Oct 18 11:52:28 user nova-compute[74190]:         <nova:disk>1</nova:disk>
Oct 18 11:52:28 user nova-compute[74190]:         <nova:swap>0</nova:swap>
Oct 18 11:52:28 user nova-compute[74190]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 11:52:28 user nova-compute[74190]:         <nova:vcpus>1</nova:vcpus>
Oct 18 11:52:28 user nova-compute[74190]:       </nova:flavor>
Oct 18 11:52:28 user nova-compute[74190]:       <nova:owner>
Oct 18 11:52:28 user nova-compute[74190]:         <nova:user uuid="a252f2c479b740a29a1adc79e6346b20">tempest-TestStampPattern-2116730913-project-member</nova:user>
Oct 18 11:52:28 user nova-compute[74190]:         <nova:project uuid="389e1c2dbc904130ba08b137f0b2e837">tempest-TestStampPattern-2116730913</nova:project>
Oct 18 11:52:28 user nova-compute[74190]:       </nova:owner>
Oct 18 11:52:28 user nova-compute[74190]:       <nova:root type="image" uuid="6e88bbf0-6e78-49a8-b3c5-9453d22a89df"/>
Oct 18 11:52:28 user nova-compute[74190]:       <nova:ports>
Oct 18 11:52:28 user nova-compute[74190]:         <nova:port uuid="1a9d494b-8515-4508-b0d8-387e20c897bb">
Oct 18 11:52:28 user nova-compute[74190]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 18 11:52:28 user nova-compute[74190]:         </nova:port>
Oct 18 11:52:28 user nova-compute[74190]:       </nova:ports>
Oct 18 11:52:28 user nova-compute[74190]:     </nova:instance>
Oct 18 11:52:28 user nova-compute[74190]:   </metadata>
Oct 18 11:52:28 user nova-compute[74190]:   <sysinfo type="smbios">
Oct 18 11:52:28 user nova-compute[74190]:     <system>
Oct 18 11:52:28 user nova-compute[74190]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 11:52:28 user nova-compute[74190]:       <entry name="product">OpenStack Nova</entry>
Oct 18 11:52:28 user nova-compute[74190]:       <entry name="version">0.0.0</entry>
Oct 18 11:52:28 user nova-compute[74190]:       <entry name="serial">8eec9cde-3553-4fc8-9162-cda963d1a81e</entry>
Oct 18 11:52:28 user nova-compute[74190]:       <entry name="uuid">8eec9cde-3553-4fc8-9162-cda963d1a81e</entry>
Oct 18 11:52:28 user nova-compute[74190]:       <entry name="family">Virtual Machine</entry>
Oct 18 11:52:28 user nova-compute[74190]:     </system>
Oct 18 11:52:28 user nova-compute[74190]:   </sysinfo>
Oct 18 11:52:28 user nova-compute[74190]:   <os>
Oct 18 11:52:28 user nova-compute[74190]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 11:52:28 user nova-compute[74190]:     <boot dev="hd"/>
Oct 18 11:52:28 user nova-compute[74190]:     <smbios mode="sysinfo"/>
Oct 18 11:52:28 user nova-compute[74190]:   </os>
Oct 18 11:52:28 user nova-compute[74190]:   <features>
Oct 18 11:52:28 user nova-compute[74190]:     <acpi/>
Oct 18 11:52:28 user nova-compute[74190]:     <apic/>
Oct 18 11:52:28 user nova-compute[74190]:     <vmcoreinfo/>
Oct 18 11:52:28 user nova-compute[74190]:   </features>
Oct 18 11:52:28 user nova-compute[74190]:   <clock offset="utc">
Oct 18 11:52:28 user nova-compute[74190]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 11:52:28 user nova-compute[74190]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 11:52:28 user nova-compute[74190]:     <timer name="hpet" present="no"/>
Oct 18 11:52:28 user nova-compute[74190]:   </clock>
Oct 18 11:52:28 user nova-compute[74190]:   <cpu mode="custom" match="exact">
Oct 18 11:52:28 user nova-compute[74190]:     <model>Nehalem</model>
Oct 18 11:52:28 user nova-compute[74190]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 11:52:28 user nova-compute[74190]:   </cpu>
Oct 18 11:52:28 user nova-compute[74190]:   <devices>
Oct 18 11:52:28 user nova-compute[74190]:     <disk type="file" device="disk">
Oct 18 11:52:28 user nova-compute[74190]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 11:52:28 user nova-compute[74190]:       <source file="/opt/stack/data/nova/instances/8eec9cde-3553-4fc8-9162-cda963d1a81e/disk"/>
Oct 18 11:52:28 user nova-compute[74190]:       <target dev="vda" bus="virtio"/>
Oct 18 11:52:28 user nova-compute[74190]:     </disk>
Oct 18 11:52:28 user nova-compute[74190]:     <interface type="ethernet">
Oct 18 11:52:28 user nova-compute[74190]:       <mac address="fa:16:3e:41:d4:c9"/>
Oct 18 11:52:28 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:52:28 user nova-compute[74190]:       <mtu size="1442"/>
Oct 18 11:52:28 user nova-compute[74190]:       <target dev="tap1a9d494b-85"/>
Oct 18 11:52:28 user nova-compute[74190]:     </interface>
Oct 18 11:52:28 user nova-compute[74190]:     <serial type="pty">
Oct 18 11:52:28 user nova-compute[74190]:       <log file="/opt/stack/data/nova/instances/8eec9cde-3553-4fc8-9162-cda963d1a81e/console.log" append="off"/>
Oct 18 11:52:28 user nova-compute[74190]:     </serial>
Oct 18 11:52:28 user nova-compute[74190]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 11:52:28 user nova-compute[74190]:     <video>
Oct 18 11:52:28 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:52:28 user nova-compute[74190]:     </video>
Oct 18 11:52:28 user nova-compute[74190]:     <rng model="virtio">
Oct 18 11:52:28 user nova-compute[74190]:       <backend model="random">/dev/urandom</backend>
Oct 18 11:52:28 user nova-compute[74190]:     </rng>
Oct 18 11:52:28 user nova-compute[74190]:     <controller type="usb" index="0" model="none"/>
Oct 18 11:52:28 user nova-compute[74190]:     <memballoon model="virtio">
Oct 18 11:52:28 user nova-compute[74190]:       <stats period="10"/>
Oct 18 11:52:28 user nova-compute[74190]:     </memballoon>
Oct 18 11:52:28 user nova-compute[74190]:   </devices>
Oct 18 11:52:28 user nova-compute[74190]: </domain>
Oct 18 11:52:28 user nova-compute[74190]:  {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-1343bb93-97ce-4b75-82f7-10077af96c3c tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:52:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-542376931',display_name='tempest-TestStampPattern-server-542376931',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-542376931',id=21,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIWsfXQkdYGPKym2GX8abBzSE1TgaUSMy3GxYdQVyxTc9qElJuld8J6hiVUfhDnJocQnssGij1BqYm1SJS/pWo5ybDXV8dLSSiMAGmlRDARneJEWLLFP/+ol+LaeplXvXg==',key_name='tempest-TestStampPattern-1418984438',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='389e1c2dbc904130ba08b137f0b2e837',ramdisk_id='',reservation_id='r-yopd55yn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-2116730913',owner_user_name='tempest-TestStampPattern-2116730913-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:52:25Z,user_data=None,user_id='a252f2c479b740a29a1adc79e6346b20',uuid=8eec9cde-3553-4fc8-9162-cda963d1a81e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1a9d494b-8515-4508-b0d8-387e20c897bb", "address": "fa:16:3e:41:d4:c9", "network": {"id": "56026ce6-77fb-40c7-9976-732e745c219d", "bridge": "br-int", "label": "tempest-TestStampPattern-989787934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "389e1c2dbc904130ba08b137f0b2e837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a9d494b-85", "ovs_interfaceid": "1a9d494b-8515-4508-b0d8-387e20c897bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-1343bb93-97ce-4b75-82f7-10077af96c3c tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Converting VIF {"id": "1a9d494b-8515-4508-b0d8-387e20c897bb", "address": "fa:16:3e:41:d4:c9", "network": {"id": "56026ce6-77fb-40c7-9976-732e745c219d", "bridge": "br-int", "label": "tempest-TestStampPattern-989787934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "389e1c2dbc904130ba08b137f0b2e837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a9d494b-85", "ovs_interfaceid": "1a9d494b-8515-4508-b0d8-387e20c897bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-1343bb93-97ce-4b75-82f7-10077af96c3c tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:d4:c9,bridge_name='br-int',has_traffic_filtering=True,id=1a9d494b-8515-4508-b0d8-387e20c897bb,network=Network(56026ce6-77fb-40c7-9976-732e745c219d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a9d494b-85') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG os_vif [None req-1343bb93-97ce-4b75-82f7-10077af96c3c tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:d4:c9,bridge_name='br-int',has_traffic_filtering=True,id=1a9d494b-8515-4508-b0d8-387e20c897bb,network=Network(56026ce6-77fb-40c7-9976-732e745c219d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a9d494b-85') {{(pid=74190) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fc3d04bb-a441-5f4c-970f-5784bdd54ef2', '_type': 'linux-noop'}}, row=False) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG nova.compute.manager [req-37e6fb75-7be2-4366-951f-555bd60843be req-4d880d5a-180a-4a76-bf8c-0470f1a05069 service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Detach interface failed, port_id=11c7c4ff-db41-4231-8300-ee85a94619c1, reason: Instance cd28be8d-847b-468c-860f-4f479740738d could not be found. {{(pid=74190) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1a9d494b-85, may_exist=True, interface_attrs={}) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1a9d494b-85, col_values=(('qos', UUID('68141a98-5dad-40a6-bf6a-0338dbb347ba')),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1a9d494b-85, col_values=(('external_ids', {'iface-id': '1a9d494b-8515-4508-b0d8-387e20c897bb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:d4:c9', 'vm-uuid': '8eec9cde-3553-4fc8-9162-cda963d1a81e'}),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:28 user nova-compute[74190]: INFO os_vif [None req-1343bb93-97ce-4b75-82f7-10077af96c3c tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:d4:c9,bridge_name='br-int',has_traffic_filtering=True,id=1a9d494b-8515-4508-b0d8-387e20c897bb,network=Network(56026ce6-77fb-40c7-9976-732e745c219d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a9d494b-85')
Oct 18 11:52:28 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-1343bb93-97ce-4b75-82f7-10077af96c3c tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] No BDM found with device name vda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-1343bb93-97ce-4b75-82f7-10077af96c3c tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] No VIF found with MAC fa:16:3e:41:d4:c9, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Starting finish_revert_migration {{(pid=74190) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Start _get_guest_xml network_info=[{"id": "5f5b65f1-7748-4422-8b45-e1b88476716d", "address": "fa:16:3e:cb:ff:0f", "network": {"id": "7be8675d-326a-4184-9b3e-fbaa02a4e1fc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-468552750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce179d9f22684865b577bd91bc841400", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5b65f1-77", "ovs_interfaceid": "5f5b65f1-7748-4422-8b45-e1b88476716d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'image_id': '6e88bbf0-6e78-49a8-b3c5-9453d22a89df'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HmdgMSxP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'bdfe420d-f46c-44ad-8773-b675f42e24ed', 'attached_at': '2023-10-18T11:52:29.000000', 'detached_at': '', 'volume_id': '7316be11-03d9-47f3-bf3c-2563c3a92c71', 'serial': '7316be11-03d9-47f3-bf3c-2563c3a92c71'}, 'delete_on_termination': False, 'guest_format': None, 'attachment_id': '5151ba15-2500-489b-b504-485b17dcfb20', 'volume_type': None} {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 11:52:28 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:52:28 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:52:28 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] CPU controller missing on host. {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] CPU controller found on host. {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74190) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T11:37:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Flavor limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Image limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Flavor pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Image pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Got 1 possible topologies {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG nova.objects.instance [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Lazy-loading 'vcpu_model' on Instance uuid bdfe420d-f46c-44ad-8773-b675f42e24ed {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Calling os-brick to attach iSCSI Volume {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HmdgMSxP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:52:28 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:52:28 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:52:28 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:52:28 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:52:28 user nova-compute[74190]: INFO os_brick.initiator.connectors.iscsi [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 11:52:28 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 -p 172.16.0.220:3260 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[787cf83a-4d7c-4471-9706-79ac6ff83342]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 11:52:28 user nova-compute[74190]:  {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 -p 172.16.0.220:3260 --interface default --op new {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf873c5-7e8c-45d7-a3b3-1b3e8d48e95a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71] added\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71] added
Oct 18 11:52:28 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:52:28 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:29 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[786cd28c-d10a-4aa5-ab28-59513708ce28]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:52:29 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:52:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:29 user nova-compute[74190]: DEBUG nova.network.neutron [req-fefe13ca-80da-4972-a87f-0fe32abb8a44 req-fd03fa38-8674-4d02-812b-6d7a7bb6cf0b service nova] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] Updated VIF entry in instance network info cache for port 1a9d494b-8515-4508-b0d8-387e20c897bb. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 11:52:29 user nova-compute[74190]: DEBUG nova.network.neutron [req-fefe13ca-80da-4972-a87f-0fe32abb8a44 req-fd03fa38-8674-4d02-812b-6d7a7bb6cf0b service nova] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] Updating instance_info_cache with network_info: [{"id": "1a9d494b-8515-4508-b0d8-387e20c897bb", "address": "fa:16:3e:41:d4:c9", "network": {"id": "56026ce6-77fb-40c7-9976-732e745c219d", "bridge": "br-int", "label": "tempest-TestStampPattern-989787934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "389e1c2dbc904130ba08b137f0b2e837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a9d494b-85", "ovs_interfaceid": "1a9d494b-8515-4508-b0d8-387e20c897bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:52:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:29 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d6762c6-5d12-49b5-b970-dcfc9c6c28f5]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:52:29 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:52:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HmdgMSxP {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HmdgMSxP" returned: 0 in 0.023s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:29 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab60487-c8ca-45ce-ad32-23828c55505b]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:52:29 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HmdgMSxP'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:52:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:29 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-fefe13ca-80da-4972-a87f-0fe32abb8a44 req-fd03fa38-8674-4d02-812b-6d7a7bb6cf0b service nova] Releasing lock "refresh_cache-8eec9cde-3553-4fc8-9162-cda963d1a81e" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:52:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:29 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c9d71cb-0164-4fdf-9530-75162a57dfe8]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:52:29 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:52:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:29 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[a904536d-fd18-46ed-a550-06dd2363693e]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:52:29 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 11:52:29 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:52:29 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 11:52:29 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:52:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 -p 172.16.0.220:3260 --login {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:29 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[258d6603-549e-4f64-8e11-03aa113981ac]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:52:29 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71, portal: 172.16.0.220,3260]
Oct 18 11:52:29 user nova-compute[74190]: Login to [iface: default, target: iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71, portal: 172.16.0.220,3260] successful.
Oct 18 11:52:29 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:52:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:29 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[74223fe1-949c-4146-8b81-99b8f94156b3]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:52:29 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:52:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:29 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f01d1aa-1df5-4034-921b-83c7172b3647]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:52:29 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 11:52:29 user nova-compute[74190]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 (non-flash)
Oct 18 11:52:29 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:52:29 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 11:52:29 user nova-compute[74190]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 (non-flash)
Oct 18 11:52:29 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:52:29 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.356s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:52:29 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Connected to 172.16.0.220:3260 {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 11:52:29 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] HCTL ('33', '-', '-', 0) found on session 28 with lun 0 {{(pid=74190) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 11:52:29 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74190) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 11:52:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.043s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:29 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[6404b3e7-9451-435c-b757-65014d3d377a]: (4, ('- - 0', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:52:29 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Searching for a device in session 28 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74190) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 11:52:29 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HmdgMSxP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 11:52:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:30 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.414s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:52:30 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] <== connect_volume: return (1415ms) {'type': 'block', 'scsi_wwn': '26339373435386535', 'path': '/dev/sdb'} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:52:30 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26339373435386535', 'path': '/dev/sdb'} {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 11:52:30 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:45:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1652011593',display_name='tempest-ServerActionsTestOtherB-server-1652011593',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1652011593',id=13,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJf2+oC1LymyOUKrd79qlp9w/sLNNXOE0jNeE016Gw/qD1l2yX0bGo5VP+iKF1MHpeTJ2Ix6czkMyFuUdVqQvcY91kItew2KCNk3ZYu6m5FRy6Ycq3v+bQ+PiA7mcNgHFg==',key_name='tempest-keypair-1546248338',keypairs=<?>,launch_index=0,launched_at=2023-10-18T11:50:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ce179d9f22684865b577bd91bc841400',ramdisk_id='',reservation_id='r-iuitp9n6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1277618284',owner_user_name='tempest-ServerActionsTestOtherB-1277618284-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T11:52:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c5f5ddf3c4174afcbe7075b7f89b4f05',uuid=bdfe420d-f46c-44ad-8773-b675f42e24ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "5f5b65f1-7748-4422-8b45-e1b88476716d", "address": "fa:16:3e:cb:ff:0f", "network": {"id": "7be8675d-326a-4184-9b3e-fbaa02a4e1fc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-468552750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce179d9f22684865b577bd91bc841400", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5b65f1-77", "ovs_interfaceid": "5f5b65f1-7748-4422-8b45-e1b88476716d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74190) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 11:52:30 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Converting VIF {"id": "5f5b65f1-7748-4422-8b45-e1b88476716d", "address": "fa:16:3e:cb:ff:0f", "network": {"id": "7be8675d-326a-4184-9b3e-fbaa02a4e1fc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-468552750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce179d9f22684865b577bd91bc841400", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5b65f1-77", "ovs_interfaceid": "5f5b65f1-7748-4422-8b45-e1b88476716d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:52:30 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:ff:0f,bridge_name='br-int',has_traffic_filtering=True,id=5f5b65f1-7748-4422-8b45-e1b88476716d,network=Network(7be8675d-326a-4184-9b3e-fbaa02a4e1fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f5b65f1-77') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:52:30 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] End _get_guest_xml xml=<domain type="kvm">
Oct 18 11:52:30 user nova-compute[74190]:   <uuid>bdfe420d-f46c-44ad-8773-b675f42e24ed</uuid>
Oct 18 11:52:30 user nova-compute[74190]:   <name>instance-0000000d</name>
Oct 18 11:52:30 user nova-compute[74190]:   <memory>524288</memory>
Oct 18 11:52:30 user nova-compute[74190]:   <vcpu>1</vcpu>
Oct 18 11:52:30 user nova-compute[74190]:   <metadata>
Oct 18 11:52:30 user nova-compute[74190]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 11:52:30 user nova-compute[74190]:       <nova:package version="0.0.0"/>
Oct 18 11:52:30 user nova-compute[74190]:       <nova:name>tempest-ServerActionsTestOtherB-server-1652011593</nova:name>
Oct 18 11:52:30 user nova-compute[74190]:       <nova:creationTime>2023-10-18 11:52:28</nova:creationTime>
Oct 18 11:52:30 user nova-compute[74190]:       <nova:flavor name="m1.tiny">
Oct 18 11:52:30 user nova-compute[74190]:         <nova:memory>512</nova:memory>
Oct 18 11:52:30 user nova-compute[74190]:         <nova:disk>1</nova:disk>
Oct 18 11:52:30 user nova-compute[74190]:         <nova:swap>0</nova:swap>
Oct 18 11:52:30 user nova-compute[74190]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 11:52:30 user nova-compute[74190]:         <nova:vcpus>1</nova:vcpus>
Oct 18 11:52:30 user nova-compute[74190]:       </nova:flavor>
Oct 18 11:52:30 user nova-compute[74190]:       <nova:owner>
Oct 18 11:52:30 user nova-compute[74190]:         <nova:user uuid="c5f5ddf3c4174afcbe7075b7f89b4f05">tempest-ServerActionsTestOtherB-1277618284-project-member</nova:user>
Oct 18 11:52:30 user nova-compute[74190]:         <nova:project uuid="ce179d9f22684865b577bd91bc841400">tempest-ServerActionsTestOtherB-1277618284</nova:project>
Oct 18 11:52:30 user nova-compute[74190]:       </nova:owner>
Oct 18 11:52:30 user nova-compute[74190]:       <nova:root type="image" uuid="6e88bbf0-6e78-49a8-b3c5-9453d22a89df"/>
Oct 18 11:52:30 user nova-compute[74190]:       <nova:ports>
Oct 18 11:52:30 user nova-compute[74190]:         <nova:port uuid="5f5b65f1-7748-4422-8b45-e1b88476716d">
Oct 18 11:52:30 user nova-compute[74190]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 18 11:52:30 user nova-compute[74190]:         </nova:port>
Oct 18 11:52:30 user nova-compute[74190]:       </nova:ports>
Oct 18 11:52:30 user nova-compute[74190]:     </nova:instance>
Oct 18 11:52:30 user nova-compute[74190]:   </metadata>
Oct 18 11:52:30 user nova-compute[74190]:   <sysinfo type="smbios">
Oct 18 11:52:30 user nova-compute[74190]:     <system>
Oct 18 11:52:30 user nova-compute[74190]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 11:52:30 user nova-compute[74190]:       <entry name="product">OpenStack Nova</entry>
Oct 18 11:52:30 user nova-compute[74190]:       <entry name="version">0.0.0</entry>
Oct 18 11:52:30 user nova-compute[74190]:       <entry name="serial">bdfe420d-f46c-44ad-8773-b675f42e24ed</entry>
Oct 18 11:52:30 user nova-compute[74190]:       <entry name="uuid">bdfe420d-f46c-44ad-8773-b675f42e24ed</entry>
Oct 18 11:52:30 user nova-compute[74190]:       <entry name="family">Virtual Machine</entry>
Oct 18 11:52:30 user nova-compute[74190]:     </system>
Oct 18 11:52:30 user nova-compute[74190]:   </sysinfo>
Oct 18 11:52:30 user nova-compute[74190]:   <os>
Oct 18 11:52:30 user nova-compute[74190]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 11:52:30 user nova-compute[74190]:     <boot dev="hd"/>
Oct 18 11:52:30 user nova-compute[74190]:     <smbios mode="sysinfo"/>
Oct 18 11:52:30 user nova-compute[74190]:   </os>
Oct 18 11:52:30 user nova-compute[74190]:   <features>
Oct 18 11:52:30 user nova-compute[74190]:     <acpi/>
Oct 18 11:52:30 user nova-compute[74190]:     <apic/>
Oct 18 11:52:30 user nova-compute[74190]:     <vmcoreinfo/>
Oct 18 11:52:30 user nova-compute[74190]:   </features>
Oct 18 11:52:30 user nova-compute[74190]:   <clock offset="utc">
Oct 18 11:52:30 user nova-compute[74190]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 11:52:30 user nova-compute[74190]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 11:52:30 user nova-compute[74190]:     <timer name="hpet" present="no"/>
Oct 18 11:52:30 user nova-compute[74190]:   </clock>
Oct 18 11:52:30 user nova-compute[74190]:   <cpu mode="custom" match="exact">
Oct 18 11:52:30 user nova-compute[74190]:     <model>Nehalem</model>
Oct 18 11:52:30 user nova-compute[74190]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 11:52:30 user nova-compute[74190]:   </cpu>
Oct 18 11:52:30 user nova-compute[74190]:   <devices>
Oct 18 11:52:30 user nova-compute[74190]:     <disk type="file" device="disk">
Oct 18 11:52:30 user nova-compute[74190]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 11:52:30 user nova-compute[74190]:       <source file="/opt/stack/data/nova/instances/bdfe420d-f46c-44ad-8773-b675f42e24ed/disk"/>
Oct 18 11:52:30 user nova-compute[74190]:       <target dev="vda" bus="virtio"/>
Oct 18 11:52:30 user nova-compute[74190]:     </disk>
Oct 18 11:52:30 user nova-compute[74190]:     <disk type="block" device="disk">
Oct 18 11:52:30 user nova-compute[74190]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 11:52:30 user nova-compute[74190]:       <source dev="/dev/sdb"/>
Oct 18 11:52:30 user nova-compute[74190]:       <target dev="vdb" bus="virtio"/>
Oct 18 11:52:30 user nova-compute[74190]:       <serial>7316be11-03d9-47f3-bf3c-2563c3a92c71</serial>
Oct 18 11:52:30 user nova-compute[74190]:     </disk>
Oct 18 11:52:30 user nova-compute[74190]:     <interface type="ethernet">
Oct 18 11:52:30 user nova-compute[74190]:       <mac address="fa:16:3e:cb:ff:0f"/>
Oct 18 11:52:30 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:52:30 user nova-compute[74190]:       <mtu size="1442"/>
Oct 18 11:52:30 user nova-compute[74190]:       <target dev="tap5f5b65f1-77"/>
Oct 18 11:52:30 user nova-compute[74190]:     </interface>
Oct 18 11:52:30 user nova-compute[74190]:     <serial type="pty">
Oct 18 11:52:30 user nova-compute[74190]:       <log file="/opt/stack/data/nova/instances/bdfe420d-f46c-44ad-8773-b675f42e24ed/console.log" append="off"/>
Oct 18 11:52:30 user nova-compute[74190]:     </serial>
Oct 18 11:52:30 user nova-compute[74190]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 11:52:30 user nova-compute[74190]:     <video>
Oct 18 11:52:30 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:52:30 user nova-compute[74190]:     </video>
Oct 18 11:52:30 user nova-compute[74190]:     <rng model="virtio">
Oct 18 11:52:30 user nova-compute[74190]:       <backend model="random">/dev/urandom</backend>
Oct 18 11:52:30 user nova-compute[74190]:     </rng>
Oct 18 11:52:30 user nova-compute[74190]:     <controller type="usb" index="0" model="none"/>
Oct 18 11:52:30 user nova-compute[74190]:     <memballoon model="virtio">
Oct 18 11:52:30 user nova-compute[74190]:       <stats period="10"/>
Oct 18 11:52:30 user nova-compute[74190]:     </memballoon>
Oct 18 11:52:30 user nova-compute[74190]:   </devices>
Oct 18 11:52:30 user nova-compute[74190]: </domain>
Oct 18 11:52:30 user nova-compute[74190]:  {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 11:52:30 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:45:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1652011593',display_name='tempest-ServerActionsTestOtherB-server-1652011593',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1652011593',id=13,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJf2+oC1LymyOUKrd79qlp9w/sLNNXOE0jNeE016Gw/qD1l2yX0bGo5VP+iKF1MHpeTJ2Ix6czkMyFuUdVqQvcY91kItew2KCNk3ZYu6m5FRy6Ycq3v+bQ+PiA7mcNgHFg==',key_name='tempest-keypair-1546248338',keypairs=<?>,launch_index=0,launched_at=2023-10-18T11:50:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ce179d9f22684865b577bd91bc841400',ramdisk_id='',reservation_id='r-iuitp9n6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1277618284',owner_user_name='tempest-ServerActionsTestOtherB-1277618284-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T11:52:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c5f5ddf3c4174afcbe7075b7f89b4f05',uuid=bdfe420d-f46c-44ad-8773-b675f42e24ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "5f5b65f1-7748-4422-8b45-e1b88476716d", "address": "fa:16:3e:cb:ff:0f", "network": {"id": "7be8675d-326a-4184-9b3e-fbaa02a4e1fc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-468552750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce179d9f22684865b577bd91bc841400", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5b65f1-77", "ovs_interfaceid": "5f5b65f1-7748-4422-8b45-e1b88476716d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 11:52:30 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Converting VIF {"id": "5f5b65f1-7748-4422-8b45-e1b88476716d", "address": "fa:16:3e:cb:ff:0f", "network": {"id": "7be8675d-326a-4184-9b3e-fbaa02a4e1fc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-468552750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce179d9f22684865b577bd91bc841400", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5b65f1-77", "ovs_interfaceid": "5f5b65f1-7748-4422-8b45-e1b88476716d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:52:30 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:ff:0f,bridge_name='br-int',has_traffic_filtering=True,id=5f5b65f1-7748-4422-8b45-e1b88476716d,network=Network(7be8675d-326a-4184-9b3e-fbaa02a4e1fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f5b65f1-77') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:52:30 user nova-compute[74190]: DEBUG os_vif [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:ff:0f,bridge_name='br-int',has_traffic_filtering=True,id=5f5b65f1-7748-4422-8b45-e1b88476716d,network=Network(7be8675d-326a-4184-9b3e-fbaa02a4e1fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f5b65f1-77') {{(pid=74190) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 11:52:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:52:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 11:52:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3fd0ec1e-344b-5167-9f79-aed34c0ad165', '_type': 'linux-noop'}}, row=False) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:52:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:52:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5f5b65f1-77, may_exist=True, interface_attrs={}) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:52:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5f5b65f1-77, col_values=(('qos', UUID('72b5760c-1fc9-4873-aedf-a42f411a8e3f')),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:52:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5f5b65f1-77, col_values=(('external_ids', {'iface-id': '5f5b65f1-7748-4422-8b45-e1b88476716d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cb:ff:0f', 'vm-uuid': 'bdfe420d-f46c-44ad-8773-b675f42e24ed'}),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:52:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:52:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:30 user nova-compute[74190]: INFO os_vif [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:ff:0f,bridge_name='br-int',has_traffic_filtering=True,id=5f5b65f1-7748-4422-8b45-e1b88476716d,network=Network(7be8675d-326a-4184-9b3e-fbaa02a4e1fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f5b65f1-77')
Oct 18 11:52:30 user nova-compute[74190]: DEBUG nova.compute.manager [req-caaa7686-d9f0-4ca8-996e-01bafef7f3f3 req-601c7c0a-9a81-41ef-925c-121f6e030109 service nova] [instance: 47ed3fb0-c159-484f-8380-79b5564d0ac1] Received event network-vif-plugged-693871aa-4bc1-41f8-aa49-4882800b9592 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:52:30 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-caaa7686-d9f0-4ca8-996e-01bafef7f3f3 req-601c7c0a-9a81-41ef-925c-121f6e030109 service nova] Acquiring lock "47ed3fb0-c159-484f-8380-79b5564d0ac1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:52:30 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-caaa7686-d9f0-4ca8-996e-01bafef7f3f3 req-601c7c0a-9a81-41ef-925c-121f6e030109 service nova] Lock "47ed3fb0-c159-484f-8380-79b5564d0ac1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:52:30 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-caaa7686-d9f0-4ca8-996e-01bafef7f3f3 req-601c7c0a-9a81-41ef-925c-121f6e030109 service nova] Lock "47ed3fb0-c159-484f-8380-79b5564d0ac1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:52:30 user nova-compute[74190]: DEBUG nova.compute.manager [req-caaa7686-d9f0-4ca8-996e-01bafef7f3f3 req-601c7c0a-9a81-41ef-925c-121f6e030109 service nova] [instance: 47ed3fb0-c159-484f-8380-79b5564d0ac1] No waiting events found dispatching network-vif-plugged-693871aa-4bc1-41f8-aa49-4882800b9592 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:52:30 user nova-compute[74190]: WARNING nova.compute.manager [req-caaa7686-d9f0-4ca8-996e-01bafef7f3f3 req-601c7c0a-9a81-41ef-925c-121f6e030109 service nova] [instance: 47ed3fb0-c159-484f-8380-79b5564d0ac1] Received unexpected event network-vif-plugged-693871aa-4bc1-41f8-aa49-4882800b9592 for instance with vm_state building and task_state spawning.
Oct 18 11:52:30 user nova-compute[74190]: DEBUG nova.compute.manager [req-caaa7686-d9f0-4ca8-996e-01bafef7f3f3 req-601c7c0a-9a81-41ef-925c-121f6e030109 service nova] [instance: 47ed3fb0-c159-484f-8380-79b5564d0ac1] Received event network-vif-plugged-693871aa-4bc1-41f8-aa49-4882800b9592 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:52:30 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-caaa7686-d9f0-4ca8-996e-01bafef7f3f3 req-601c7c0a-9a81-41ef-925c-121f6e030109 service nova] Acquiring lock "47ed3fb0-c159-484f-8380-79b5564d0ac1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:52:30 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-caaa7686-d9f0-4ca8-996e-01bafef7f3f3 req-601c7c0a-9a81-41ef-925c-121f6e030109 service nova] Lock "47ed3fb0-c159-484f-8380-79b5564d0ac1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:52:30 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-caaa7686-d9f0-4ca8-996e-01bafef7f3f3 req-601c7c0a-9a81-41ef-925c-121f6e030109 service nova] Lock "47ed3fb0-c159-484f-8380-79b5564d0ac1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:52:30 user nova-compute[74190]: DEBUG nova.compute.manager [req-caaa7686-d9f0-4ca8-996e-01bafef7f3f3 req-601c7c0a-9a81-41ef-925c-121f6e030109 service nova] [instance: 47ed3fb0-c159-484f-8380-79b5564d0ac1] No waiting events found dispatching network-vif-plugged-693871aa-4bc1-41f8-aa49-4882800b9592 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:52:30 user nova-compute[74190]: WARNING nova.compute.manager [req-caaa7686-d9f0-4ca8-996e-01bafef7f3f3 req-601c7c0a-9a81-41ef-925c-121f6e030109 service nova] [instance: 47ed3fb0-c159-484f-8380-79b5564d0ac1] Received unexpected event network-vif-plugged-693871aa-4bc1-41f8-aa49-4882800b9592 for instance with vm_state building and task_state spawning.
Oct 18 11:52:30 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: cd28be8d-847b-468c-860f-4f479740738d] Updating instance_info_cache with network_info: [] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:52:30 user nova-compute[74190]: DEBUG nova.compute.manager [req-f3223c13-de13-48b7-b5ab-7e998982a53b req-69f25b5e-994c-4a57-936d-be1d63359438 service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Received event network-vif-deleted-dba85cc3-dd42-4fa4-96d3-bec15903344f {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:52:30 user nova-compute[74190]: INFO nova.compute.manager [req-f3223c13-de13-48b7-b5ab-7e998982a53b req-69f25b5e-994c-4a57-936d-be1d63359438 service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Neutron deleted interface dba85cc3-dd42-4fa4-96d3-bec15903344f; detaching it from the instance and deleting it from the info cache
Oct 18 11:52:30 user nova-compute[74190]: DEBUG nova.network.neutron [req-f3223c13-de13-48b7-b5ab-7e998982a53b req-69f25b5e-994c-4a57-936d-be1d63359438 service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Updating instance_info_cache with network_info: [{"id": "c2ed33ff-2096-4def-98c5-709db8bc0ea4", "address": "fa:16:3e:11:db:57", "network": {"id": "bef90182-e108-423e-842c-2037d5cc1a4b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-640378484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ed33ff-20", "ovs_interfaceid": "c2ed33ff-2096-4def-98c5-709db8bc0ea4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "aca29f48-4a6d-472a-ac70-7006b63b9996", "address": "fa:16:3e:71:0a:c4", "network": {"id": "50f9056b-d85d-4a43-8981-3c5c98e1bf52", "bridge": "br-int", "label": "tempest-device-tagging-net1-737454421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaca29f48-4a", "ovs_interfaceid": "aca29f48-4a6d-472a-ac70-7006b63b9996", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d5f803c0-bb6c-41be-8294-fb3565e03413", "address": "fa:16:3e:43:be:0d", "network": {"id": "50f9056b-d85d-4a43-8981-3c5c98e1bf52", "bridge": "br-int", "label": "tempest-device-tagging-net1-737454421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f803c0-bb", "ovs_interfaceid": "d5f803c0-bb6c-41be-8294-fb3565e03413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0a00abcf-957e-4276-a975-522f8a42ad55", "address": "fa:16:3e:c8:b9:46", "network": {"id": "50f9056b-d85d-4a43-8981-3c5c98e1bf52", "bridge": "br-int", "label": "tempest-device-tagging-net1-737454421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a00abcf-95", "ovs_interfaceid": "0a00abcf-957e-4276-a975-522f8a42ad55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "35f010df-56fb-4234-879b-19f86f36a2d3", "address": "fa:16:3e:bf:a7:36", "network": {"id": "1ba257ec-d104-413d-bbf9-d9702ed5a1b4", "bridge": "br-int", "label": "tempest-device-tagging-net2-445498545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35f010df-56", "ovs_interfaceid": "35f010df-56fb-4234-879b-19f86f36a2d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:52:30 user nova-compute[74190]: INFO nova.compute.manager [-] [instance: cd28be8d-847b-468c-860f-4f479740738d] Took 4.52 seconds to deallocate network for instance.
Oct 18 11:52:30 user nova-compute[74190]: DEBUG nova.compute.manager [req-f3223c13-de13-48b7-b5ab-7e998982a53b req-69f25b5e-994c-4a57-936d-be1d63359438 service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Detach interface failed, port_id=dba85cc3-dd42-4fa4-96d3-bec15903344f, reason: Instance cd28be8d-847b-468c-860f-4f479740738d could not be found. {{(pid=74190) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 18 11:52:30 user nova-compute[74190]: DEBUG nova.compute.manager [req-f3223c13-de13-48b7-b5ab-7e998982a53b req-69f25b5e-994c-4a57-936d-be1d63359438 service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Received event network-vif-deleted-0a00abcf-957e-4276-a975-522f8a42ad55 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:52:30 user nova-compute[74190]: INFO nova.compute.manager [req-f3223c13-de13-48b7-b5ab-7e998982a53b req-69f25b5e-994c-4a57-936d-be1d63359438 service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Neutron deleted interface 0a00abcf-957e-4276-a975-522f8a42ad55; detaching it from the instance and deleting it from the info cache
Oct 18 11:52:30 user nova-compute[74190]: DEBUG nova.network.neutron [req-f3223c13-de13-48b7-b5ab-7e998982a53b req-69f25b5e-994c-4a57-936d-be1d63359438 service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Updating instance_info_cache with network_info: [{"id": "c2ed33ff-2096-4def-98c5-709db8bc0ea4", "address": "fa:16:3e:11:db:57", "network": {"id": "bef90182-e108-423e-842c-2037d5cc1a4b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-640378484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ed33ff-20", "ovs_interfaceid": "c2ed33ff-2096-4def-98c5-709db8bc0ea4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "aca29f48-4a6d-472a-ac70-7006b63b9996", "address": "fa:16:3e:71:0a:c4", "network": {"id": "50f9056b-d85d-4a43-8981-3c5c98e1bf52", "bridge": "br-int", "label": "tempest-device-tagging-net1-737454421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaca29f48-4a", "ovs_interfaceid": "aca29f48-4a6d-472a-ac70-7006b63b9996", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d5f803c0-bb6c-41be-8294-fb3565e03413", "address": "fa:16:3e:43:be:0d", "network": {"id": "50f9056b-d85d-4a43-8981-3c5c98e1bf52", "bridge": "br-int", "label": "tempest-device-tagging-net1-737454421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f803c0-bb", "ovs_interfaceid": "d5f803c0-bb6c-41be-8294-fb3565e03413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "35f010df-56fb-4234-879b-19f86f36a2d3", "address": "fa:16:3e:bf:a7:36", "network": {"id": "1ba257ec-d104-413d-bbf9-d9702ed5a1b4", "bridge": "br-int", "label": "tempest-device-tagging-net2-445498545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35f010df-56", "ovs_interfaceid": "35f010df-56fb-4234-879b-19f86f36a2d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:52:30 user nova-compute[74190]: DEBUG nova.compute.manager [req-f3223c13-de13-48b7-b5ab-7e998982a53b req-69f25b5e-994c-4a57-936d-be1d63359438 service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Detach interface failed, port_id=0a00abcf-957e-4276-a975-522f8a42ad55, reason: Instance cd28be8d-847b-468c-860f-4f479740738d could not be found. {{(pid=74190) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 18 11:52:30 user nova-compute[74190]: DEBUG nova.compute.manager [req-f3223c13-de13-48b7-b5ab-7e998982a53b req-69f25b5e-994c-4a57-936d-be1d63359438 service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Received event network-vif-deleted-c2ed33ff-2096-4def-98c5-709db8bc0ea4 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:52:30 user nova-compute[74190]: INFO nova.compute.manager [req-f3223c13-de13-48b7-b5ab-7e998982a53b req-69f25b5e-994c-4a57-936d-be1d63359438 service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Neutron deleted interface c2ed33ff-2096-4def-98c5-709db8bc0ea4; detaching it from the instance and deleting it from the info cache
Oct 18 11:52:30 user nova-compute[74190]: DEBUG nova.network.neutron [req-f3223c13-de13-48b7-b5ab-7e998982a53b req-69f25b5e-994c-4a57-936d-be1d63359438 service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Updating instance_info_cache with network_info: [{"id": "aca29f48-4a6d-472a-ac70-7006b63b9996", "address": "fa:16:3e:71:0a:c4", "network": {"id": "50f9056b-d85d-4a43-8981-3c5c98e1bf52", "bridge": "br-int", "label": "tempest-device-tagging-net1-737454421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaca29f48-4a", "ovs_interfaceid": "aca29f48-4a6d-472a-ac70-7006b63b9996", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d5f803c0-bb6c-41be-8294-fb3565e03413", "address": "fa:16:3e:43:be:0d", "network": {"id": "50f9056b-d85d-4a43-8981-3c5c98e1bf52", "bridge": "br-int", "label": "tempest-device-tagging-net1-737454421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f803c0-bb", "ovs_interfaceid": "d5f803c0-bb6c-41be-8294-fb3565e03413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "35f010df-56fb-4234-879b-19f86f36a2d3", "address": "fa:16:3e:bf:a7:36", "network": {"id": "1ba257ec-d104-413d-bbf9-d9702ed5a1b4", "bridge": "br-int", "label": "tempest-device-tagging-net2-445498545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35f010df-56", "ovs_interfaceid": "35f010df-56fb-4234-879b-19f86f36a2d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:52:30 user nova-compute[74190]: DEBUG nova.compute.manager [req-f3223c13-de13-48b7-b5ab-7e998982a53b req-69f25b5e-994c-4a57-936d-be1d63359438 service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Detach interface failed, port_id=c2ed33ff-2096-4def-98c5-709db8bc0ea4, reason: Instance cd28be8d-847b-468c-860f-4f479740738d could not be found. {{(pid=74190) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 18 11:52:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:31 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:31 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:31 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:31 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:32 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:32 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:32 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:32 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:32 user nova-compute[74190]: DEBUG nova.compute.manager [req-ce7f625d-e321-45ea-9134-69118599117a req-652b1d6a-8518-44f4-9e47-9927d40d02dd service nova] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] Received event network-vif-plugged-1a9d494b-8515-4508-b0d8-387e20c897bb {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:52:32 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-ce7f625d-e321-45ea-9134-69118599117a req-652b1d6a-8518-44f4-9e47-9927d40d02dd service nova] Acquiring lock "8eec9cde-3553-4fc8-9162-cda963d1a81e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:52:32 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-ce7f625d-e321-45ea-9134-69118599117a req-652b1d6a-8518-44f4-9e47-9927d40d02dd service nova] Lock "8eec9cde-3553-4fc8-9162-cda963d1a81e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:52:32 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-ce7f625d-e321-45ea-9134-69118599117a req-652b1d6a-8518-44f4-9e47-9927d40d02dd service nova] Lock "8eec9cde-3553-4fc8-9162-cda963d1a81e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:52:32 user nova-compute[74190]: DEBUG nova.compute.manager [req-ce7f625d-e321-45ea-9134-69118599117a req-652b1d6a-8518-44f4-9e47-9927d40d02dd service nova] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] No waiting events found dispatching network-vif-plugged-1a9d494b-8515-4508-b0d8-387e20c897bb {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:52:32 user nova-compute[74190]: WARNING nova.compute.manager [req-ce7f625d-e321-45ea-9134-69118599117a req-652b1d6a-8518-44f4-9e47-9927d40d02dd service nova] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] Received unexpected event network-vif-plugged-1a9d494b-8515-4508-b0d8-387e20c897bb for instance with vm_state building and task_state spawning.
Oct 18 11:52:32 user nova-compute[74190]: DEBUG nova.compute.manager [req-ce7f625d-e321-45ea-9134-69118599117a req-652b1d6a-8518-44f4-9e47-9927d40d02dd service nova] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] Received event network-vif-plugged-1a9d494b-8515-4508-b0d8-387e20c897bb {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:52:32 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-ce7f625d-e321-45ea-9134-69118599117a req-652b1d6a-8518-44f4-9e47-9927d40d02dd service nova] Acquiring lock "8eec9cde-3553-4fc8-9162-cda963d1a81e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:52:32 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-ce7f625d-e321-45ea-9134-69118599117a req-652b1d6a-8518-44f4-9e47-9927d40d02dd service nova] Lock "8eec9cde-3553-4fc8-9162-cda963d1a81e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:52:32 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-ce7f625d-e321-45ea-9134-69118599117a req-652b1d6a-8518-44f4-9e47-9927d40d02dd service nova] Lock "8eec9cde-3553-4fc8-9162-cda963d1a81e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:52:32 user nova-compute[74190]: DEBUG nova.compute.manager [req-ce7f625d-e321-45ea-9134-69118599117a req-652b1d6a-8518-44f4-9e47-9927d40d02dd service nova] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] No waiting events found dispatching network-vif-plugged-1a9d494b-8515-4508-b0d8-387e20c897bb {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:52:32 user nova-compute[74190]: WARNING nova.compute.manager [req-ce7f625d-e321-45ea-9134-69118599117a req-652b1d6a-8518-44f4-9e47-9927d40d02dd service nova] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] Received unexpected event network-vif-plugged-1a9d494b-8515-4508-b0d8-387e20c897bb for instance with vm_state building and task_state spawning.
Oct 18 11:52:32 user nova-compute[74190]: DEBUG nova.compute.manager [req-556a5fc8-aad9-4815-ab93-63d2c7494187 req-c226f40e-72d6-46f4-b17f-ab018dd042a9 service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Received event network-vif-deleted-35f010df-56fb-4234-879b-19f86f36a2d3 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:52:32 user nova-compute[74190]: INFO nova.compute.manager [req-556a5fc8-aad9-4815-ab93-63d2c7494187 req-c226f40e-72d6-46f4-b17f-ab018dd042a9 service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Neutron deleted interface 35f010df-56fb-4234-879b-19f86f36a2d3; detaching it from the instance and deleting it from the info cache
Oct 18 11:52:32 user nova-compute[74190]: DEBUG nova.network.neutron [req-556a5fc8-aad9-4815-ab93-63d2c7494187 req-c226f40e-72d6-46f4-b17f-ab018dd042a9 service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Updating instance_info_cache with network_info: [{"id": "aca29f48-4a6d-472a-ac70-7006b63b9996", "address": "fa:16:3e:71:0a:c4", "network": {"id": "50f9056b-d85d-4a43-8981-3c5c98e1bf52", "bridge": "br-int", "label": "tempest-device-tagging-net1-737454421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaca29f48-4a", "ovs_interfaceid": "aca29f48-4a6d-472a-ac70-7006b63b9996", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d5f803c0-bb6c-41be-8294-fb3565e03413", "address": "fa:16:3e:43:be:0d", "network": {"id": "50f9056b-d85d-4a43-8981-3c5c98e1bf52", "bridge": "br-int", "label": "tempest-device-tagging-net1-737454421", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "daccec0feffd445492c3ab4ff40bcde2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f803c0-bb", "ovs_interfaceid": "d5f803c0-bb6c-41be-8294-fb3565e03413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:52:32 user nova-compute[74190]: DEBUG nova.compute.manager [req-556a5fc8-aad9-4815-ab93-63d2c7494187 req-c226f40e-72d6-46f4-b17f-ab018dd042a9 service nova] [instance: cd28be8d-847b-468c-860f-4f479740738d] Detach interface failed, port_id=35f010df-56fb-4234-879b-19f86f36a2d3, reason: Instance cd28be8d-847b-468c-860f-4f479740738d could not be found. {{(pid=74190) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 18 11:52:33 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:33 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:33 user nova-compute[74190]: INFO nova.compute.manager [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] [instance: cd28be8d-847b-468c-860f-4f479740738d] Took 3.11 seconds to detach 3 volumes for instance.
Oct 18 11:52:33 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:52:33 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:52:33 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Refreshing inventories for resource provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 18 11:52:33 user nova-compute[74190]: DEBUG nova.compute.manager [None req-cb1b3c45-07fb-4d41-8cc4-87acccba66c5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: 47ed3fb0-c159-484f-8380-79b5564d0ac1] Instance event wait completed in 0 seconds for  {{(pid=74190) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 11:52:33 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-cb1b3c45-07fb-4d41-8cc4-87acccba66c5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: 47ed3fb0-c159-484f-8380-79b5564d0ac1] Guest created on hypervisor {{(pid=74190) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 11:52:33 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 47ed3fb0-c159-484f-8380-79b5564d0ac1] Instance spawned successfully.
Oct 18 11:52:33 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-cb1b3c45-07fb-4d41-8cc4-87acccba66c5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: 47ed3fb0-c159-484f-8380-79b5564d0ac1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 11:52:33 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Updating ProviderTree inventory for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 18 11:52:33 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Updating inventory in ProviderTree for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 18 11:52:33 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-cb1b3c45-07fb-4d41-8cc4-87acccba66c5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: 47ed3fb0-c159-484f-8380-79b5564d0ac1] Found default for hw_cdrom_bus of ide {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:52:33 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-cb1b3c45-07fb-4d41-8cc4-87acccba66c5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: 47ed3fb0-c159-484f-8380-79b5564d0ac1] Found default for hw_disk_bus of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:52:33 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-cb1b3c45-07fb-4d41-8cc4-87acccba66c5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: 47ed3fb0-c159-484f-8380-79b5564d0ac1] Found default for hw_input_bus of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:52:34 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-cb1b3c45-07fb-4d41-8cc4-87acccba66c5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: 47ed3fb0-c159-484f-8380-79b5564d0ac1] Found default for hw_pointer_model of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:52:34 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-cb1b3c45-07fb-4d41-8cc4-87acccba66c5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: 47ed3fb0-c159-484f-8380-79b5564d0ac1] Found default for hw_video_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:52:34 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-cb1b3c45-07fb-4d41-8cc4-87acccba66c5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: 47ed3fb0-c159-484f-8380-79b5564d0ac1] Found default for hw_vif_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:52:34 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Refreshing aggregate associations for resource provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66, aggregates: None {{(pid=74190) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 18 11:52:34 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Refreshing trait associations for resource provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66, traits: COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE42,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_ACCELERATORS,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=74190) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 18 11:52:34 user nova-compute[74190]: INFO nova.compute.manager [None req-cb1b3c45-07fb-4d41-8cc4-87acccba66c5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: 47ed3fb0-c159-484f-8380-79b5564d0ac1] Took 10.05 seconds to spawn the instance on the hypervisor.
Oct 18 11:52:34 user nova-compute[74190]: DEBUG nova.compute.manager [None req-cb1b3c45-07fb-4d41-8cc4-87acccba66c5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: 47ed3fb0-c159-484f-8380-79b5564d0ac1] Checking state {{(pid=74190) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 11:52:34 user nova-compute[74190]: INFO nova.compute.manager [None req-cb1b3c45-07fb-4d41-8cc4-87acccba66c5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: 47ed3fb0-c159-484f-8380-79b5564d0ac1] Took 11.17 seconds to build instance.
Oct 18 11:52:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-cb1b3c45-07fb-4d41-8cc4-87acccba66c5 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lock "47ed3fb0-c159-484f-8380-79b5564d0ac1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.344s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:52:34 user nova-compute[74190]: DEBUG nova.compute.manager [None req-1343bb93-97ce-4b75-82f7-10077af96c3c tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] Instance event wait completed in 0 seconds for  {{(pid=74190) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 11:52:34 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-1343bb93-97ce-4b75-82f7-10077af96c3c tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] Guest created on hypervisor {{(pid=74190) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 11:52:34 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] Instance spawned successfully.
Oct 18 11:52:34 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-1343bb93-97ce-4b75-82f7-10077af96c3c tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 11:52:34 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 11:52:34 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-1343bb93-97ce-4b75-82f7-10077af96c3c tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] Found default for hw_cdrom_bus of ide {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:52:34 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-1343bb93-97ce-4b75-82f7-10077af96c3c tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] Found default for hw_disk_bus of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:52:34 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-1343bb93-97ce-4b75-82f7-10077af96c3c tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] Found default for hw_input_bus of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:52:34 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-1343bb93-97ce-4b75-82f7-10077af96c3c tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] Found default for hw_pointer_model of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:52:34 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-1343bb93-97ce-4b75-82f7-10077af96c3c tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] Found default for hw_video_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:52:34 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-1343bb93-97ce-4b75-82f7-10077af96c3c tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] Found default for hw_vif_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:52:34 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 11:52:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.602s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:52:34 user nova-compute[74190]: INFO nova.compute.manager [None req-1343bb93-97ce-4b75-82f7-10077af96c3c tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] Took 9.31 seconds to spawn the instance on the hypervisor.
Oct 18 11:52:34 user nova-compute[74190]: DEBUG nova.compute.manager [None req-1343bb93-97ce-4b75-82f7-10077af96c3c tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] Checking state {{(pid=74190) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 11:52:34 user nova-compute[74190]: INFO nova.scheduler.client.report [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Deleted allocations for instance cd28be8d-847b-468c-860f-4f479740738d
Oct 18 11:52:34 user nova-compute[74190]: INFO nova.compute.manager [None req-1343bb93-97ce-4b75-82f7-10077af96c3c tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] Took 10.57 seconds to build instance.
Oct 18 11:52:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-87b58ed5-821e-4802-90aa-eef6288d35a5 tempest-TaggedBootDevicesTest-1710887731 tempest-TaggedBootDevicesTest-1710887731-project-member] Lock "cd28be8d-847b-468c-860f-4f479740738d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 13.312s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:52:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-1343bb93-97ce-4b75-82f7-10077af96c3c tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Lock "8eec9cde-3553-4fc8-9162-cda963d1a81e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.728s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:52:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:35 user nova-compute[74190]: DEBUG nova.compute.manager [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Instance event wait completed in 0 seconds for  {{(pid=74190) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 11:52:35 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Instance running successfully.
Oct 18 11:52:35 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] finish_revert_migration finished successfully. {{(pid=74190) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Oct 18 11:52:35 user nova-compute[74190]: INFO nova.compute.manager [None req-45595413-cefe-482b-8996-4de52785dbb0 tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Updating instance to original state: 'active'
Oct 18 11:52:35 user nova-compute[74190]: DEBUG nova.compute.manager [req-6797e1cf-2ef1-48f6-8955-80ad50d7d1d6 req-bce71772-1c47-41c4-af2a-379f1abefcb9 service nova] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Received event network-vif-plugged-5f5b65f1-7748-4422-8b45-e1b88476716d {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:52:35 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-6797e1cf-2ef1-48f6-8955-80ad50d7d1d6 req-bce71772-1c47-41c4-af2a-379f1abefcb9 service nova] Acquiring lock "bdfe420d-f46c-44ad-8773-b675f42e24ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:52:35 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-6797e1cf-2ef1-48f6-8955-80ad50d7d1d6 req-bce71772-1c47-41c4-af2a-379f1abefcb9 service nova] Lock "bdfe420d-f46c-44ad-8773-b675f42e24ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:52:35 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-6797e1cf-2ef1-48f6-8955-80ad50d7d1d6 req-bce71772-1c47-41c4-af2a-379f1abefcb9 service nova] Lock "bdfe420d-f46c-44ad-8773-b675f42e24ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:52:35 user nova-compute[74190]: DEBUG nova.compute.manager [req-6797e1cf-2ef1-48f6-8955-80ad50d7d1d6 req-bce71772-1c47-41c4-af2a-379f1abefcb9 service nova] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] No waiting events found dispatching network-vif-plugged-5f5b65f1-7748-4422-8b45-e1b88476716d {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:52:35 user nova-compute[74190]: WARNING nova.compute.manager [req-6797e1cf-2ef1-48f6-8955-80ad50d7d1d6 req-bce71772-1c47-41c4-af2a-379f1abefcb9 service nova] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Received unexpected event network-vif-plugged-5f5b65f1-7748-4422-8b45-e1b88476716d for instance with vm_state resized and task_state resize_reverting.
Oct 18 11:52:35 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Acquiring lock "d90a6ca0-19a6-4221-81b7-0cb05d67f38e" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:52:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Lock "d90a6ca0-19a6-4221-81b7-0cb05d67f38e" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:52:36 user nova-compute[74190]: INFO nova.compute.manager [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Unshelving
Oct 18 11:52:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:52:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.005s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:52:36 user nova-compute[74190]: DEBUG nova.objects.instance [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Lazy-loading 'pci_requests' on Instance uuid d90a6ca0-19a6-4221-81b7-0cb05d67f38e {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:52:36 user nova-compute[74190]: DEBUG nova.objects.instance [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Lazy-loading 'numa_topology' on Instance uuid d90a6ca0-19a6-4221-81b7-0cb05d67f38e {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:52:36 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74190) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 11:52:36 user nova-compute[74190]: INFO nova.compute.claims [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Claim successful on node user
Oct 18 11:52:37 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 11:52:37 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 11:52:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.501s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:52:37 user nova-compute[74190]: INFO nova.network.neutron [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Updating port 2d8060bc-84e4-41e2-9e72-42b2159a1d1e with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 18 11:52:37 user nova-compute[74190]: DEBUG nova.compute.manager [req-d1c7ae06-6624-49d7-8bbb-28c094d22deb req-42b56c01-2a62-4ad8-a779-a0ac381d415f service nova] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Received event network-vif-plugged-5f5b65f1-7748-4422-8b45-e1b88476716d {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:52:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d1c7ae06-6624-49d7-8bbb-28c094d22deb req-42b56c01-2a62-4ad8-a779-a0ac381d415f service nova] Acquiring lock "bdfe420d-f46c-44ad-8773-b675f42e24ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:52:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d1c7ae06-6624-49d7-8bbb-28c094d22deb req-42b56c01-2a62-4ad8-a779-a0ac381d415f service nova] Lock "bdfe420d-f46c-44ad-8773-b675f42e24ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:52:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d1c7ae06-6624-49d7-8bbb-28c094d22deb req-42b56c01-2a62-4ad8-a779-a0ac381d415f service nova] Lock "bdfe420d-f46c-44ad-8773-b675f42e24ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:52:37 user nova-compute[74190]: DEBUG nova.compute.manager [req-d1c7ae06-6624-49d7-8bbb-28c094d22deb req-42b56c01-2a62-4ad8-a779-a0ac381d415f service nova] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] No waiting events found dispatching network-vif-plugged-5f5b65f1-7748-4422-8b45-e1b88476716d {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:52:37 user nova-compute[74190]: WARNING nova.compute.manager [req-d1c7ae06-6624-49d7-8bbb-28c094d22deb req-42b56c01-2a62-4ad8-a779-a0ac381d415f service nova] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Received unexpected event network-vif-plugged-5f5b65f1-7748-4422-8b45-e1b88476716d for instance with vm_state active and task_state None.
Oct 18 11:52:38 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Acquiring lock "refresh_cache-d90a6ca0-19a6-4221-81b7-0cb05d67f38e" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:52:38 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Acquired lock "refresh_cache-d90a6ca0-19a6-4221-81b7-0cb05d67f38e" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:52:38 user nova-compute[74190]: DEBUG nova.network.neutron [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Building network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 11:52:38 user nova-compute[74190]: DEBUG nova.network.neutron [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Updating instance_info_cache with network_info: [{"id": "2d8060bc-84e4-41e2-9e72-42b2159a1d1e", "address": "fa:16:3e:6c:a0:e2", "network": {"id": "e6ae8edc-7014-4341-91b2-4c82d72c9bb9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-15434410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548640fa718f4fdfa21c1a7783519c9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d8060bc-84", "ovs_interfaceid": "2d8060bc-84e4-41e2-9e72-42b2159a1d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:52:38 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Releasing lock "refresh_cache-d90a6ca0-19a6-4221-81b7-0cb05d67f38e" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:52:38 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Creating instance directory {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 11:52:38 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Creating image(s)
Oct 18 11:52:38 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Acquiring lock "/opt/stack/data/nova/instances/d90a6ca0-19a6-4221-81b7-0cb05d67f38e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:52:38 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Lock "/opt/stack/data/nova/instances/d90a6ca0-19a6-4221-81b7-0cb05d67f38e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:52:38 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Lock "/opt/stack/data/nova/instances/d90a6ca0-19a6-4221-81b7-0cb05d67f38e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:52:38 user nova-compute[74190]: DEBUG nova.objects.instance [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Lazy-loading 'trusted_certs' on Instance uuid d90a6ca0-19a6-4221-81b7-0cb05d67f38e {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:52:38 user nova-compute[74190]: DEBUG nova.objects.base [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Object Instance<d90a6ca0-19a6-4221-81b7-0cb05d67f38e> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74190) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 11:52:38 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Acquiring lock "2dfb4bff716bd0492befc710d472376b168a613c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:52:38 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Lock "2dfb4bff716bd0492befc710d472376b168a613c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:52:39 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2dfb4bff716bd0492befc710d472376b168a613c.part --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:39 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:39 user nova-compute[74190]: DEBUG nova.compute.manager [req-4bfbc570-b550-454c-a8a7-be3bce978195 req-583ddaed-6593-47ef-bafb-1df9349c6404 service nova] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Received event network-changed-2d8060bc-84e4-41e2-9e72-42b2159a1d1e {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:52:39 user nova-compute[74190]: DEBUG nova.compute.manager [req-4bfbc570-b550-454c-a8a7-be3bce978195 req-583ddaed-6593-47ef-bafb-1df9349c6404 service nova] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Refreshing instance network info cache due to event network-changed-2d8060bc-84e4-41e2-9e72-42b2159a1d1e. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 11:52:39 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-4bfbc570-b550-454c-a8a7-be3bce978195 req-583ddaed-6593-47ef-bafb-1df9349c6404 service nova] Acquiring lock "refresh_cache-d90a6ca0-19a6-4221-81b7-0cb05d67f38e" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:52:39 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-4bfbc570-b550-454c-a8a7-be3bce978195 req-583ddaed-6593-47ef-bafb-1df9349c6404 service nova] Acquired lock "refresh_cache-d90a6ca0-19a6-4221-81b7-0cb05d67f38e" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:52:39 user nova-compute[74190]: DEBUG nova.network.neutron [req-4bfbc570-b550-454c-a8a7-be3bce978195 req-583ddaed-6593-47ef-bafb-1df9349c6404 service nova] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Refreshing network info cache for port 2d8060bc-84e4-41e2-9e72-42b2159a1d1e {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 11:52:39 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-d70fcf24-7489-4b70-a5ae-3e36d4c8c7e2 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Acquiring lock "b200eb6a-be24-4a8f-be23-4e36f7b7b26e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:52:39 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-d70fcf24-7489-4b70-a5ae-3e36d4c8c7e2 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "b200eb6a-be24-4a8f-be23-4e36f7b7b26e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:52:40 user nova-compute[74190]: DEBUG nova.compute.manager [None req-d70fcf24-7489-4b70-a5ae-3e36d4c8c7e2 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: b200eb6a-be24-4a8f-be23-4e36f7b7b26e] Starting instance... {{(pid=74190) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 11:52:40 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2dfb4bff716bd0492befc710d472376b168a613c.part --force-share --output=json" returned: 0 in 0.237s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:40 user nova-compute[74190]: DEBUG nova.virt.images [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] 5dad9d13-4172-4aa2-80cc-d43ceb28bb72 was qcow2, converting to raw {{(pid=74190) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 18 11:52:40 user nova-compute[74190]: DEBUG nova.privsep.utils [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74190) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 18 11:52:40 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2dfb4bff716bd0492befc710d472376b168a613c.part /opt/stack/data/nova/instances/_base/2dfb4bff716bd0492befc710d472376b168a613c.converted {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:40 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-d70fcf24-7489-4b70-a5ae-3e36d4c8c7e2 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:52:40 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-d70fcf24-7489-4b70-a5ae-3e36d4c8c7e2 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:52:40 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-d70fcf24-7489-4b70-a5ae-3e36d4c8c7e2 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74190) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 11:52:40 user nova-compute[74190]: INFO nova.compute.claims [None req-d70fcf24-7489-4b70-a5ae-3e36d4c8c7e2 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: b200eb6a-be24-4a8f-be23-4e36f7b7b26e] Claim successful on node user
Oct 18 11:52:40 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:40 user nova-compute[74190]: DEBUG nova.network.neutron [req-4bfbc570-b550-454c-a8a7-be3bce978195 req-583ddaed-6593-47ef-bafb-1df9349c6404 service nova] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Updated VIF entry in instance network info cache for port 2d8060bc-84e4-41e2-9e72-42b2159a1d1e. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 11:52:40 user nova-compute[74190]: DEBUG nova.network.neutron [req-4bfbc570-b550-454c-a8a7-be3bce978195 req-583ddaed-6593-47ef-bafb-1df9349c6404 service nova] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Updating instance_info_cache with network_info: [{"id": "2d8060bc-84e4-41e2-9e72-42b2159a1d1e", "address": "fa:16:3e:6c:a0:e2", "network": {"id": "e6ae8edc-7014-4341-91b2-4c82d72c9bb9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-15434410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548640fa718f4fdfa21c1a7783519c9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d8060bc-84", "ovs_interfaceid": "2d8060bc-84e4-41e2-9e72-42b2159a1d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:52:40 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-4bfbc570-b550-454c-a8a7-be3bce978195 req-583ddaed-6593-47ef-bafb-1df9349c6404 service nova] Releasing lock "refresh_cache-d90a6ca0-19a6-4221-81b7-0cb05d67f38e" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:52:41 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2dfb4bff716bd0492befc710d472376b168a613c.part /opt/stack/data/nova/instances/_base/2dfb4bff716bd0492befc710d472376b168a613c.converted" returned: 0 in 0.941s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:41 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2dfb4bff716bd0492befc710d472376b168a613c.converted --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:41 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-d70fcf24-7489-4b70-a5ae-3e36d4c8c7e2 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 11:52:41 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-d70fcf24-7489-4b70-a5ae-3e36d4c8c7e2 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 11:52:41 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-d70fcf24-7489-4b70-a5ae-3e36d4c8c7e2 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.841s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:52:41 user nova-compute[74190]: DEBUG nova.compute.manager [None req-d70fcf24-7489-4b70-a5ae-3e36d4c8c7e2 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: b200eb6a-be24-4a8f-be23-4e36f7b7b26e] Start building networks asynchronously for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 11:52:41 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2dfb4bff716bd0492befc710d472376b168a613c.converted --force-share --output=json" returned: 0 in 0.206s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:41 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Lock "2dfb4bff716bd0492befc710d472376b168a613c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.623s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:52:41 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2dfb4bff716bd0492befc710d472376b168a613c --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:41 user nova-compute[74190]: DEBUG nova.compute.manager [None req-d70fcf24-7489-4b70-a5ae-3e36d4c8c7e2 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: b200eb6a-be24-4a8f-be23-4e36f7b7b26e] Allocating IP information in the background. {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 11:52:41 user nova-compute[74190]: DEBUG nova.network.neutron [None req-d70fcf24-7489-4b70-a5ae-3e36d4c8c7e2 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: b200eb6a-be24-4a8f-be23-4e36f7b7b26e] allocate_for_instance() {{(pid=74190) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 11:52:41 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-d70fcf24-7489-4b70-a5ae-3e36d4c8c7e2 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: b200eb6a-be24-4a8f-be23-4e36f7b7b26e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 11:52:41 user nova-compute[74190]: DEBUG nova.compute.manager [None req-d70fcf24-7489-4b70-a5ae-3e36d4c8c7e2 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: b200eb6a-be24-4a8f-be23-4e36f7b7b26e] Start building block device mappings for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 11:52:41 user nova-compute[74190]: DEBUG nova.policy [None req-d70fcf24-7489-4b70-a5ae-3e36d4c8c7e2 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7d6bb993153245daabfc59215abbf7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df06c4b010434e3da9ba4ea41f26befa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74190) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 11:52:41 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2dfb4bff716bd0492befc710d472376b168a613c --force-share --output=json" returned: 0 in 0.220s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:41 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Acquiring lock "2dfb4bff716bd0492befc710d472376b168a613c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:52:41 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Lock "2dfb4bff716bd0492befc710d472376b168a613c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:52:41 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2dfb4bff716bd0492befc710d472376b168a613c --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:41 user nova-compute[74190]: DEBUG nova.compute.manager [None req-d70fcf24-7489-4b70-a5ae-3e36d4c8c7e2 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: b200eb6a-be24-4a8f-be23-4e36f7b7b26e] Start spawning the instance on the hypervisor. {{(pid=74190) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 11:52:41 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-d70fcf24-7489-4b70-a5ae-3e36d4c8c7e2 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: b200eb6a-be24-4a8f-be23-4e36f7b7b26e] Creating instance directory {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 11:52:41 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-d70fcf24-7489-4b70-a5ae-3e36d4c8c7e2 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: b200eb6a-be24-4a8f-be23-4e36f7b7b26e] Creating image(s)
Oct 18 11:52:41 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-d70fcf24-7489-4b70-a5ae-3e36d4c8c7e2 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Acquiring lock "/opt/stack/data/nova/instances/b200eb6a-be24-4a8f-be23-4e36f7b7b26e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:52:41 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-d70fcf24-7489-4b70-a5ae-3e36d4c8c7e2 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "/opt/stack/data/nova/instances/b200eb6a-be24-4a8f-be23-4e36f7b7b26e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:52:41 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-d70fcf24-7489-4b70-a5ae-3e36d4c8c7e2 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "/opt/stack/data/nova/instances/b200eb6a-be24-4a8f-be23-4e36f7b7b26e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:52:41 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-d70fcf24-7489-4b70-a5ae-3e36d4c8c7e2 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:41 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2dfb4bff716bd0492befc710d472376b168a613c --force-share --output=json" returned: 0 in 0.210s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:41 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2dfb4bff716bd0492befc710d472376b168a613c,backing_fmt=raw /opt/stack/data/nova/instances/d90a6ca0-19a6-4221-81b7-0cb05d67f38e/disk 1073741824 {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:41 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-d70fcf24-7489-4b70-a5ae-3e36d4c8c7e2 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.209s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:41 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-d70fcf24-7489-4b70-a5ae-3e36d4c8c7e2 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Acquiring lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:52:41 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-d70fcf24-7489-4b70-a5ae-3e36d4c8c7e2 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:52:41 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-d70fcf24-7489-4b70-a5ae-3e36d4c8c7e2 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:41 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2dfb4bff716bd0492befc710d472376b168a613c,backing_fmt=raw /opt/stack/data/nova/instances/d90a6ca0-19a6-4221-81b7-0cb05d67f38e/disk 1073741824" returned: 0 in 0.106s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:41 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Lock "2dfb4bff716bd0492befc710d472376b168a613c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.328s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:52:41 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2dfb4bff716bd0492befc710d472376b168a613c --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:41 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-d70fcf24-7489-4b70-a5ae-3e36d4c8c7e2 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.193s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:41 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-d70fcf24-7489-4b70-a5ae-3e36d4c8c7e2 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f,backing_fmt=raw /opt/stack/data/nova/instances/b200eb6a-be24-4a8f-be23-4e36f7b7b26e/disk 1073741824 {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-d70fcf24-7489-4b70-a5ae-3e36d4c8c7e2 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f,backing_fmt=raw /opt/stack/data/nova/instances/b200eb6a-be24-4a8f-be23-4e36f7b7b26e/disk 1073741824" returned: 0 in 0.056s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:42 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-d70fcf24-7489-4b70-a5ae-3e36d4c8c7e2 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:52:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-d70fcf24-7489-4b70-a5ae-3e36d4c8c7e2 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2dfb4bff716bd0492befc710d472376b168a613c --force-share --output=json" returned: 0 in 0.252s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:42 user nova-compute[74190]: DEBUG nova.objects.instance [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Lazy-loading 'migration_context' on Instance uuid d90a6ca0-19a6-4221-81b7-0cb05d67f38e {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:52:42 user nova-compute[74190]: DEBUG nova.objects.base [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Object Instance<d90a6ca0-19a6-4221-81b7-0cb05d67f38e> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74190) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 11:52:42 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Rebasing disk image.
Oct 18 11:52:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:42 user nova-compute[74190]: DEBUG nova.network.neutron [None req-d70fcf24-7489-4b70-a5ae-3e36d4c8c7e2 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: b200eb6a-be24-4a8f-be23-4e36f7b7b26e] Successfully created port: c9514478-3402-47b2-b649-0b8b762c1a35 {{(pid=74190) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 11:52:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-d70fcf24-7489-4b70-a5ae-3e36d4c8c7e2 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.200s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:42 user nova-compute[74190]: DEBUG nova.virt.disk.api [None req-d70fcf24-7489-4b70-a5ae-3e36d4c8c7e2 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b200eb6a-be24-4a8f-be23-4e36f7b7b26e/disk. size=1073741824 {{(pid=74190) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 18 11:52:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-d70fcf24-7489-4b70-a5ae-3e36d4c8c7e2 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b200eb6a-be24-4a8f-be23-4e36f7b7b26e/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.189s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f -F raw /opt/stack/data/nova/instances/d90a6ca0-19a6-4221-81b7-0cb05d67f38e/disk {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-d70fcf24-7489-4b70-a5ae-3e36d4c8c7e2 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b200eb6a-be24-4a8f-be23-4e36f7b7b26e/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:42 user nova-compute[74190]: DEBUG nova.virt.disk.api [None req-d70fcf24-7489-4b70-a5ae-3e36d4c8c7e2 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Cannot resize image /opt/stack/data/nova/instances/b200eb6a-be24-4a8f-be23-4e36f7b7b26e/disk to a smaller size. {{(pid=74190) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 18 11:52:42 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-d70fcf24-7489-4b70-a5ae-3e36d4c8c7e2 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: b200eb6a-be24-4a8f-be23-4e36f7b7b26e] Created local disks {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 11:52:42 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-d70fcf24-7489-4b70-a5ae-3e36d4c8c7e2 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: b200eb6a-be24-4a8f-be23-4e36f7b7b26e] Ensure instance console log exists: /opt/stack/data/nova/instances/b200eb6a-be24-4a8f-be23-4e36f7b7b26e/console.log {{(pid=74190) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 11:52:42 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-d70fcf24-7489-4b70-a5ae-3e36d4c8c7e2 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:52:42 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-d70fcf24-7489-4b70-a5ae-3e36d4c8c7e2 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:52:42 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-d70fcf24-7489-4b70-a5ae-3e36d4c8c7e2 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:52:42 user nova-compute[74190]: DEBUG nova.network.neutron [None req-d70fcf24-7489-4b70-a5ae-3e36d4c8c7e2 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: b200eb6a-be24-4a8f-be23-4e36f7b7b26e] Successfully updated port: c9514478-3402-47b2-b649-0b8b762c1a35 {{(pid=74190) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 11:52:42 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-d70fcf24-7489-4b70-a5ae-3e36d4c8c7e2 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Acquiring lock "refresh_cache-b200eb6a-be24-4a8f-be23-4e36f7b7b26e" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:52:42 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-d70fcf24-7489-4b70-a5ae-3e36d4c8c7e2 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Acquired lock "refresh_cache-b200eb6a-be24-4a8f-be23-4e36f7b7b26e" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:52:42 user nova-compute[74190]: DEBUG nova.network.neutron [None req-d70fcf24-7489-4b70-a5ae-3e36d4c8c7e2 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: b200eb6a-be24-4a8f-be23-4e36f7b7b26e] Building network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 11:52:42 user nova-compute[74190]: DEBUG nova.compute.manager [req-8725738e-aa39-49ab-8d9b-bbdd802d51da req-025af701-43fd-4391-b38b-1234811eb2c2 service nova] [instance: b200eb6a-be24-4a8f-be23-4e36f7b7b26e] Received event network-changed-c9514478-3402-47b2-b649-0b8b762c1a35 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:52:42 user nova-compute[74190]: DEBUG nova.compute.manager [req-8725738e-aa39-49ab-8d9b-bbdd802d51da req-025af701-43fd-4391-b38b-1234811eb2c2 service nova] [instance: b200eb6a-be24-4a8f-be23-4e36f7b7b26e] Refreshing instance network info cache due to event network-changed-c9514478-3402-47b2-b649-0b8b762c1a35. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 11:52:42 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-8725738e-aa39-49ab-8d9b-bbdd802d51da req-025af701-43fd-4391-b38b-1234811eb2c2 service nova] Acquiring lock "refresh_cache-b200eb6a-be24-4a8f-be23-4e36f7b7b26e" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:52:43 user nova-compute[74190]: DEBUG nova.network.neutron [None req-d70fcf24-7489-4b70-a5ae-3e36d4c8c7e2 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: b200eb6a-be24-4a8f-be23-4e36f7b7b26e] Instance cache missing network info. {{(pid=74190) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 11:52:43 user nova-compute[74190]: DEBUG nova.network.neutron [None req-d70fcf24-7489-4b70-a5ae-3e36d4c8c7e2 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: b200eb6a-be24-4a8f-be23-4e36f7b7b26e] Updating instance_info_cache with network_info: [{"id": "c9514478-3402-47b2-b649-0b8b762c1a35", "address": "fa:16:3e:5a:49:f4", "network": {"id": "25e0d6f5-497d-4898-8181-5b4848950f16", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-245925644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df06c4b010434e3da9ba4ea41f26befa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9514478-34", "ovs_interfaceid": "c9514478-3402-47b2-b649-0b8b762c1a35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:52:43 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-d70fcf24-7489-4b70-a5ae-3e36d4c8c7e2 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Releasing lock "refresh_cache-b200eb6a-be24-4a8f-be23-4e36f7b7b26e" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:52:43 user nova-compute[74190]: DEBUG nova.compute.manager [None req-d70fcf24-7489-4b70-a5ae-3e36d4c8c7e2 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: b200eb6a-be24-4a8f-be23-4e36f7b7b26e] Instance network_info: |[{"id": "c9514478-3402-47b2-b649-0b8b762c1a35", "address": "fa:16:3e:5a:49:f4", "network": {"id": "25e0d6f5-497d-4898-8181-5b4848950f16", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-245925644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df06c4b010434e3da9ba4ea41f26befa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9514478-34", "ovs_interfaceid": "c9514478-3402-47b2-b649-0b8b762c1a35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 11:52:43 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-8725738e-aa39-49ab-8d9b-bbdd802d51da req-025af701-43fd-4391-b38b-1234811eb2c2 service nova] Acquired lock "refresh_cache-b200eb6a-be24-4a8f-be23-4e36f7b7b26e" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:52:43 user nova-compute[74190]: DEBUG nova.network.neutron [req-8725738e-aa39-49ab-8d9b-bbdd802d51da req-025af701-43fd-4391-b38b-1234811eb2c2 service nova] [instance: b200eb6a-be24-4a8f-be23-4e36f7b7b26e] Refreshing network info cache for port c9514478-3402-47b2-b649-0b8b762c1a35 {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 11:52:43 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-d70fcf24-7489-4b70-a5ae-3e36d4c8c7e2 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: b200eb6a-be24-4a8f-be23-4e36f7b7b26e] Start _get_guest_xml network_info=[{"id": "c9514478-3402-47b2-b649-0b8b762c1a35", "address": "fa:16:3e:5a:49:f4", "network": {"id": "25e0d6f5-497d-4898-8181-5b4848950f16", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-245925644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df06c4b010434e3da9ba4ea41f26befa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9514478-34", "ovs_interfaceid": "c9514478-3402-47b2-b649-0b8b762c1a35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'image_id': '6e88bbf0-6e78-49a8-b3c5-9453d22a89df'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 11:52:43 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-d70fcf24-7489-4b70-a5ae-3e36d4c8c7e2 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:52:43 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-d70fcf24-7489-4b70-a5ae-3e36d4c8c7e2 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:52:43 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-d70fcf24-7489-4b70-a5ae-3e36d4c8c7e2 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 11:52:43 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-d70fcf24-7489-4b70-a5ae-3e36d4c8c7e2 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] CPU controller missing on host. {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 11:52:43 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-d70fcf24-7489-4b70-a5ae-3e36d4c8c7e2 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 11:52:43 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-d70fcf24-7489-4b70-a5ae-3e36d4c8c7e2 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] CPU controller found on host. {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 11:52:43 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-d70fcf24-7489-4b70-a5ae-3e36d4c8c7e2 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74190) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 11:52:43 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-d70fcf24-7489-4b70-a5ae-3e36d4c8c7e2 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T11:37:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 11:52:43 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-d70fcf24-7489-4b70-a5ae-3e36d4c8c7e2 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Flavor limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 11:52:43 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-d70fcf24-7489-4b70-a5ae-3e36d4c8c7e2 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Image limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 11:52:43 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-d70fcf24-7489-4b70-a5ae-3e36d4c8c7e2 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Flavor pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 11:52:43 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-d70fcf24-7489-4b70-a5ae-3e36d4c8c7e2 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Image pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 11:52:43 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-d70fcf24-7489-4b70-a5ae-3e36d4c8c7e2 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 11:52:43 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-d70fcf24-7489-4b70-a5ae-3e36d4c8c7e2 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 11:52:43 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-d70fcf24-7489-4b70-a5ae-3e36d4c8c7e2 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 11:52:43 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-d70fcf24-7489-4b70-a5ae-3e36d4c8c7e2 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Got 1 possible topologies {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 11:52:43 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-d70fcf24-7489-4b70-a5ae-3e36d4c8c7e2 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 11:52:43 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-d70fcf24-7489-4b70-a5ae-3e36d4c8c7e2 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 11:52:43 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-d70fcf24-7489-4b70-a5ae-3e36d4c8c7e2 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:52:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1988495736',display_name='tempest-AttachVolumeNegativeTest-server-1988495736',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1988495736',id=22,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+VhIsnrQ1pBl9gGgofPIbSrQYqk/GismLcdAftsesKJUpwN7y1HwqWfeEUHaJv9CXbqXOJ3xxgxfB7vWEIeDeGCahXw/27YEUII2L9wGgWPQrN7JoAQEEpUGSp4sdOOA==',key_name='tempest-keypair-2102343167',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df06c4b010434e3da9ba4ea41f26befa',ramdisk_id='',reservation_id='r-ye714lsh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1730208605',owner_user_name='tempest-AttachVolumeNegativeTest-1730208605-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:52:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d6bb993153245daabfc59215abbf7a1',uuid=b200eb6a-be24-4a8f-be23-4e36f7b7b26e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c9514478-3402-47b2-b649-0b8b762c1a35", "address": "fa:16:3e:5a:49:f4", "network": {"id": "25e0d6f5-497d-4898-8181-5b4848950f16", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-245925644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df06c4b010434e3da9ba4ea41f26befa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9514478-34", "ovs_interfaceid": "c9514478-3402-47b2-b649-0b8b762c1a35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74190) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 11:52:43 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-d70fcf24-7489-4b70-a5ae-3e36d4c8c7e2 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Converting VIF {"id": "c9514478-3402-47b2-b649-0b8b762c1a35", "address": "fa:16:3e:5a:49:f4", "network": {"id": "25e0d6f5-497d-4898-8181-5b4848950f16", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-245925644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df06c4b010434e3da9ba4ea41f26befa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9514478-34", "ovs_interfaceid": "c9514478-3402-47b2-b649-0b8b762c1a35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:52:43 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-d70fcf24-7489-4b70-a5ae-3e36d4c8c7e2 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:49:f4,bridge_name='br-int',has_traffic_filtering=True,id=c9514478-3402-47b2-b649-0b8b762c1a35,network=Network(25e0d6f5-497d-4898-8181-5b4848950f16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9514478-34') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:52:43 user nova-compute[74190]: DEBUG nova.objects.instance [None req-d70fcf24-7489-4b70-a5ae-3e36d4c8c7e2 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lazy-loading 'pci_devices' on Instance uuid b200eb6a-be24-4a8f-be23-4e36f7b7b26e {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:52:43 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-d70fcf24-7489-4b70-a5ae-3e36d4c8c7e2 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: b200eb6a-be24-4a8f-be23-4e36f7b7b26e] End _get_guest_xml xml=<domain type="kvm">
Oct 18 11:52:43 user nova-compute[74190]:   <uuid>b200eb6a-be24-4a8f-be23-4e36f7b7b26e</uuid>
Oct 18 11:52:43 user nova-compute[74190]:   <name>instance-00000016</name>
Oct 18 11:52:43 user nova-compute[74190]:   <memory>524288</memory>
Oct 18 11:52:43 user nova-compute[74190]:   <vcpu>1</vcpu>
Oct 18 11:52:43 user nova-compute[74190]:   <metadata>
Oct 18 11:52:43 user nova-compute[74190]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 11:52:43 user nova-compute[74190]:       <nova:package version="0.0.0"/>
Oct 18 11:52:43 user nova-compute[74190]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1988495736</nova:name>
Oct 18 11:52:43 user nova-compute[74190]:       <nova:creationTime>2023-10-18 11:52:43</nova:creationTime>
Oct 18 11:52:43 user nova-compute[74190]:       <nova:flavor name="m1.tiny">
Oct 18 11:52:43 user nova-compute[74190]:         <nova:memory>512</nova:memory>
Oct 18 11:52:43 user nova-compute[74190]:         <nova:disk>1</nova:disk>
Oct 18 11:52:43 user nova-compute[74190]:         <nova:swap>0</nova:swap>
Oct 18 11:52:43 user nova-compute[74190]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 11:52:43 user nova-compute[74190]:         <nova:vcpus>1</nova:vcpus>
Oct 18 11:52:43 user nova-compute[74190]:       </nova:flavor>
Oct 18 11:52:43 user nova-compute[74190]:       <nova:owner>
Oct 18 11:52:43 user nova-compute[74190]:         <nova:user uuid="7d6bb993153245daabfc59215abbf7a1">tempest-AttachVolumeNegativeTest-1730208605-project-member</nova:user>
Oct 18 11:52:43 user nova-compute[74190]:         <nova:project uuid="df06c4b010434e3da9ba4ea41f26befa">tempest-AttachVolumeNegativeTest-1730208605</nova:project>
Oct 18 11:52:43 user nova-compute[74190]:       </nova:owner>
Oct 18 11:52:43 user nova-compute[74190]:       <nova:root type="image" uuid="6e88bbf0-6e78-49a8-b3c5-9453d22a89df"/>
Oct 18 11:52:43 user nova-compute[74190]:       <nova:ports>
Oct 18 11:52:43 user nova-compute[74190]:         <nova:port uuid="c9514478-3402-47b2-b649-0b8b762c1a35">
Oct 18 11:52:43 user nova-compute[74190]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 18 11:52:43 user nova-compute[74190]:         </nova:port>
Oct 18 11:52:43 user nova-compute[74190]:       </nova:ports>
Oct 18 11:52:43 user nova-compute[74190]:     </nova:instance>
Oct 18 11:52:43 user nova-compute[74190]:   </metadata>
Oct 18 11:52:43 user nova-compute[74190]:   <sysinfo type="smbios">
Oct 18 11:52:43 user nova-compute[74190]:     <system>
Oct 18 11:52:43 user nova-compute[74190]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 11:52:43 user nova-compute[74190]:       <entry name="product">OpenStack Nova</entry>
Oct 18 11:52:43 user nova-compute[74190]:       <entry name="version">0.0.0</entry>
Oct 18 11:52:43 user nova-compute[74190]:       <entry name="serial">b200eb6a-be24-4a8f-be23-4e36f7b7b26e</entry>
Oct 18 11:52:43 user nova-compute[74190]:       <entry name="uuid">b200eb6a-be24-4a8f-be23-4e36f7b7b26e</entry>
Oct 18 11:52:43 user nova-compute[74190]:       <entry name="family">Virtual Machine</entry>
Oct 18 11:52:43 user nova-compute[74190]:     </system>
Oct 18 11:52:43 user nova-compute[74190]:   </sysinfo>
Oct 18 11:52:43 user nova-compute[74190]:   <os>
Oct 18 11:52:43 user nova-compute[74190]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 11:52:43 user nova-compute[74190]:     <boot dev="hd"/>
Oct 18 11:52:43 user nova-compute[74190]:     <smbios mode="sysinfo"/>
Oct 18 11:52:43 user nova-compute[74190]:   </os>
Oct 18 11:52:43 user nova-compute[74190]:   <features>
Oct 18 11:52:43 user nova-compute[74190]:     <acpi/>
Oct 18 11:52:43 user nova-compute[74190]:     <apic/>
Oct 18 11:52:43 user nova-compute[74190]:     <vmcoreinfo/>
Oct 18 11:52:43 user nova-compute[74190]:   </features>
Oct 18 11:52:43 user nova-compute[74190]:   <clock offset="utc">
Oct 18 11:52:43 user nova-compute[74190]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 11:52:43 user nova-compute[74190]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 11:52:43 user nova-compute[74190]:     <timer name="hpet" present="no"/>
Oct 18 11:52:43 user nova-compute[74190]:   </clock>
Oct 18 11:52:43 user nova-compute[74190]:   <cpu mode="custom" match="exact">
Oct 18 11:52:43 user nova-compute[74190]:     <model>Nehalem</model>
Oct 18 11:52:43 user nova-compute[74190]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 11:52:43 user nova-compute[74190]:   </cpu>
Oct 18 11:52:43 user nova-compute[74190]:   <devices>
Oct 18 11:52:43 user nova-compute[74190]:     <disk type="file" device="disk">
Oct 18 11:52:43 user nova-compute[74190]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 11:52:43 user nova-compute[74190]:       <source file="/opt/stack/data/nova/instances/b200eb6a-be24-4a8f-be23-4e36f7b7b26e/disk"/>
Oct 18 11:52:43 user nova-compute[74190]:       <target dev="vda" bus="virtio"/>
Oct 18 11:52:43 user nova-compute[74190]:     </disk>
Oct 18 11:52:43 user nova-compute[74190]:     <interface type="ethernet">
Oct 18 11:52:43 user nova-compute[74190]:       <mac address="fa:16:3e:5a:49:f4"/>
Oct 18 11:52:43 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:52:43 user nova-compute[74190]:       <mtu size="1442"/>
Oct 18 11:52:43 user nova-compute[74190]:       <target dev="tapc9514478-34"/>
Oct 18 11:52:43 user nova-compute[74190]:     </interface>
Oct 18 11:52:43 user nova-compute[74190]:     <serial type="pty">
Oct 18 11:52:43 user nova-compute[74190]:       <log file="/opt/stack/data/nova/instances/b200eb6a-be24-4a8f-be23-4e36f7b7b26e/console.log" append="off"/>
Oct 18 11:52:43 user nova-compute[74190]:     </serial>
Oct 18 11:52:43 user nova-compute[74190]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 11:52:43 user nova-compute[74190]:     <video>
Oct 18 11:52:43 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:52:43 user nova-compute[74190]:     </video>
Oct 18 11:52:43 user nova-compute[74190]:     <rng model="virtio">
Oct 18 11:52:43 user nova-compute[74190]:       <backend model="random">/dev/urandom</backend>
Oct 18 11:52:43 user nova-compute[74190]:     </rng>
Oct 18 11:52:43 user nova-compute[74190]:     <controller type="usb" index="0" model="none"/>
Oct 18 11:52:43 user nova-compute[74190]:     <memballoon model="virtio">
Oct 18 11:52:43 user nova-compute[74190]:       <stats period="10"/>
Oct 18 11:52:43 user nova-compute[74190]:     </memballoon>
Oct 18 11:52:43 user nova-compute[74190]:   </devices>
Oct 18 11:52:43 user nova-compute[74190]: </domain>
Oct 18 11:52:43 user nova-compute[74190]:  {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 11:52:43 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-d70fcf24-7489-4b70-a5ae-3e36d4c8c7e2 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:52:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1988495736',display_name='tempest-AttachVolumeNegativeTest-server-1988495736',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1988495736',id=22,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+VhIsnrQ1pBl9gGgofPIbSrQYqk/GismLcdAftsesKJUpwN7y1HwqWfeEUHaJv9CXbqXOJ3xxgxfB7vWEIeDeGCahXw/27YEUII2L9wGgWPQrN7JoAQEEpUGSp4sdOOA==',key_name='tempest-keypair-2102343167',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df06c4b010434e3da9ba4ea41f26befa',ramdisk_id='',reservation_id='r-ye714lsh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1730208605',owner_user_name='tempest-AttachVolumeNegativeTest-1730208605-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:52:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d6bb993153245daabfc59215abbf7a1',uuid=b200eb6a-be24-4a8f-be23-4e36f7b7b26e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c9514478-3402-47b2-b649-0b8b762c1a35", "address": "fa:16:3e:5a:49:f4", "network": {"id": "25e0d6f5-497d-4898-8181-5b4848950f16", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-245925644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df06c4b010434e3da9ba4ea41f26befa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9514478-34", "ovs_interfaceid": "c9514478-3402-47b2-b649-0b8b762c1a35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 11:52:43 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-d70fcf24-7489-4b70-a5ae-3e36d4c8c7e2 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Converting VIF {"id": "c9514478-3402-47b2-b649-0b8b762c1a35", "address": "fa:16:3e:5a:49:f4", "network": {"id": "25e0d6f5-497d-4898-8181-5b4848950f16", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-245925644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df06c4b010434e3da9ba4ea41f26befa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9514478-34", "ovs_interfaceid": "c9514478-3402-47b2-b649-0b8b762c1a35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:52:43 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-d70fcf24-7489-4b70-a5ae-3e36d4c8c7e2 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:49:f4,bridge_name='br-int',has_traffic_filtering=True,id=c9514478-3402-47b2-b649-0b8b762c1a35,network=Network(25e0d6f5-497d-4898-8181-5b4848950f16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9514478-34') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:52:43 user nova-compute[74190]: DEBUG os_vif [None req-d70fcf24-7489-4b70-a5ae-3e36d4c8c7e2 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:49:f4,bridge_name='br-int',has_traffic_filtering=True,id=c9514478-3402-47b2-b649-0b8b762c1a35,network=Network(25e0d6f5-497d-4898-8181-5b4848950f16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9514478-34') {{(pid=74190) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 11:52:43 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:43 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:52:43 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 11:52:43 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:43 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '29f041bf-3148-5c11-960e-fd66ecaf274e', '_type': 'linux-noop'}}, row=False) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:52:43 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:52:43 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:43 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc9514478-34, may_exist=True, interface_attrs={}) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:52:43 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc9514478-34, col_values=(('qos', UUID('35e52b62-e329-4b0a-aa8b-ebfa8320ee95')),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:52:43 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc9514478-34, col_values=(('external_ids', {'iface-id': 'c9514478-3402-47b2-b649-0b8b762c1a35', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5a:49:f4', 'vm-uuid': 'b200eb6a-be24-4a8f-be23-4e36f7b7b26e'}),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:52:43 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:52:43 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:43 user nova-compute[74190]: INFO os_vif [None req-d70fcf24-7489-4b70-a5ae-3e36d4c8c7e2 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:49:f4,bridge_name='br-int',has_traffic_filtering=True,id=c9514478-3402-47b2-b649-0b8b762c1a35,network=Network(25e0d6f5-497d-4898-8181-5b4848950f16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9514478-34')
Oct 18 11:52:43 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-d70fcf24-7489-4b70-a5ae-3e36d4c8c7e2 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] No BDM found with device name vda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 11:52:43 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-d70fcf24-7489-4b70-a5ae-3e36d4c8c7e2 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] No VIF found with MAC fa:16:3e:5a:49:f4, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 11:52:43 user nova-compute[74190]: DEBUG nova.network.neutron [req-8725738e-aa39-49ab-8d9b-bbdd802d51da req-025af701-43fd-4391-b38b-1234811eb2c2 service nova] [instance: b200eb6a-be24-4a8f-be23-4e36f7b7b26e] Updated VIF entry in instance network info cache for port c9514478-3402-47b2-b649-0b8b762c1a35. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 11:52:43 user nova-compute[74190]: DEBUG nova.network.neutron [req-8725738e-aa39-49ab-8d9b-bbdd802d51da req-025af701-43fd-4391-b38b-1234811eb2c2 service nova] [instance: b200eb6a-be24-4a8f-be23-4e36f7b7b26e] Updating instance_info_cache with network_info: [{"id": "c9514478-3402-47b2-b649-0b8b762c1a35", "address": "fa:16:3e:5a:49:f4", "network": {"id": "25e0d6f5-497d-4898-8181-5b4848950f16", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-245925644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df06c4b010434e3da9ba4ea41f26befa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9514478-34", "ovs_interfaceid": "c9514478-3402-47b2-b649-0b8b762c1a35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:52:43 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-8725738e-aa39-49ab-8d9b-bbdd802d51da req-025af701-43fd-4391-b38b-1234811eb2c2 service nova] Releasing lock "refresh_cache-b200eb6a-be24-4a8f-be23-4e36f7b7b26e" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:52:44 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:45 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f -F raw /opt/stack/data/nova/instances/d90a6ca0-19a6-4221-81b7-0cb05d67f38e/disk" returned: 0 in 2.900s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:45 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Created local disks {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 11:52:45 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Ensure instance console log exists: /opt/stack/data/nova/instances/d90a6ca0-19a6-4221-81b7-0cb05d67f38e/console.log {{(pid=74190) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 11:52:45 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:52:45 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:52:45 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:52:45 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Start _get_guest_xml network_info=[{"id": "2d8060bc-84e4-41e2-9e72-42b2159a1d1e", "address": "fa:16:3e:6c:a0:e2", "network": {"id": "e6ae8edc-7014-4341-91b2-4c82d72c9bb9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-15434410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548640fa718f4fdfa21c1a7783519c9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d8060bc-84", "ovs_interfaceid": "2d8060bc-84e4-41e2-9e72-42b2159a1d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='10c0691d0837e6047785bef8b40fe111',container_format='bare',created_at=2023-10-18T11:50:43Z,direct_url=<?>,disk_format='qcow2',id=5dad9d13-4172-4aa2-80cc-d43ceb28bb72,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1378919830-shelved',owner='548640fa718f4fdfa21c1a7783519c9f',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-18T11:50:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'image_id': '6e88bbf0-6e78-49a8-b3c5-9453d22a89df'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 11:52:45 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:52:45 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:52:45 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 11:52:45 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] CPU controller missing on host. {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 11:52:45 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 11:52:45 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] CPU controller found on host. {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 11:52:45 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74190) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 11:52:45 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T11:37:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='10c0691d0837e6047785bef8b40fe111',container_format='bare',created_at=2023-10-18T11:50:43Z,direct_url=<?>,disk_format='qcow2',id=5dad9d13-4172-4aa2-80cc-d43ceb28bb72,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1378919830-shelved',owner='548640fa718f4fdfa21c1a7783519c9f',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-18T11:50:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 11:52:45 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Flavor limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 11:52:45 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Image limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 11:52:45 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Flavor pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 11:52:45 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Image pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 11:52:45 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 11:52:45 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 11:52:45 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 11:52:45 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Got 1 possible topologies {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 11:52:45 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 11:52:45 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 11:52:45 user nova-compute[74190]: DEBUG nova.objects.instance [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Lazy-loading 'vcpu_model' on Instance uuid d90a6ca0-19a6-4221-81b7-0cb05d67f38e {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:52:45 user nova-compute[74190]: DEBUG nova.objects.base [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Object Instance<d90a6ca0-19a6-4221-81b7-0cb05d67f38e> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74190) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 11:52:45 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-18T11:48:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1378919830',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1378919830',id=16,image_ref='5dad9d13-4172-4aa2-80cc-d43ceb28bb72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1365040796',keypairs=<?>,launch_index=0,launched_at=2023-10-18T11:48:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='548640fa718f4fdfa21c1a7783519c9f',ramdisk_id='',reservation_id='r-eukfw0x8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-83921126',owner_user_name='tempest-AttachVolumeShelveTestJSON-83921126-project-member',shelved_at='2023-10-18T11:50:47.885613',shelved_host='user',shelved_image_id='5dad9d13-4172-4aa2-80cc-d43ceb28bb72'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:52:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='829b310c15b54dc7836d0b9d7fd757ed',uuid=d90a6ca0-19a6-4221-81b7-0cb05d67f38e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "2d8060bc-84e4-41e2-9e72-42b2159a1d1e", "address": "fa:16:3e:6c:a0:e2", "network": {"id": "e6ae8edc-7014-4341-91b2-4c82d72c9bb9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-15434410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548640fa718f4fdfa21c1a7783519c9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d8060bc-84", "ovs_interfaceid": "2d8060bc-84e4-41e2-9e72-42b2159a1d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74190) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 11:52:45 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Converting VIF {"id": "2d8060bc-84e4-41e2-9e72-42b2159a1d1e", "address": "fa:16:3e:6c:a0:e2", "network": {"id": "e6ae8edc-7014-4341-91b2-4c82d72c9bb9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-15434410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548640fa718f4fdfa21c1a7783519c9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d8060bc-84", "ovs_interfaceid": "2d8060bc-84e4-41e2-9e72-42b2159a1d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:52:45 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:a0:e2,bridge_name='br-int',has_traffic_filtering=True,id=2d8060bc-84e4-41e2-9e72-42b2159a1d1e,network=Network(e6ae8edc-7014-4341-91b2-4c82d72c9bb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d8060bc-84') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:52:45 user nova-compute[74190]: DEBUG nova.objects.instance [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Lazy-loading 'pci_devices' on Instance uuid d90a6ca0-19a6-4221-81b7-0cb05d67f38e {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:52:45 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:45 user nova-compute[74190]: DEBUG nova.objects.base [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Object Instance<d90a6ca0-19a6-4221-81b7-0cb05d67f38e> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74190) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 11:52:45 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] End _get_guest_xml xml=<domain type="kvm">
Oct 18 11:52:45 user nova-compute[74190]:   <uuid>d90a6ca0-19a6-4221-81b7-0cb05d67f38e</uuid>
Oct 18 11:52:45 user nova-compute[74190]:   <name>instance-00000010</name>
Oct 18 11:52:45 user nova-compute[74190]:   <memory>524288</memory>
Oct 18 11:52:45 user nova-compute[74190]:   <vcpu>1</vcpu>
Oct 18 11:52:45 user nova-compute[74190]:   <metadata>
Oct 18 11:52:45 user nova-compute[74190]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 11:52:45 user nova-compute[74190]:       <nova:package version="0.0.0"/>
Oct 18 11:52:45 user nova-compute[74190]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1378919830</nova:name>
Oct 18 11:52:45 user nova-compute[74190]:       <nova:creationTime>2023-10-18 11:52:45</nova:creationTime>
Oct 18 11:52:45 user nova-compute[74190]:       <nova:flavor name="m1.tiny">
Oct 18 11:52:45 user nova-compute[74190]:         <nova:memory>512</nova:memory>
Oct 18 11:52:45 user nova-compute[74190]:         <nova:disk>1</nova:disk>
Oct 18 11:52:45 user nova-compute[74190]:         <nova:swap>0</nova:swap>
Oct 18 11:52:45 user nova-compute[74190]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 11:52:45 user nova-compute[74190]:         <nova:vcpus>1</nova:vcpus>
Oct 18 11:52:45 user nova-compute[74190]:       </nova:flavor>
Oct 18 11:52:45 user nova-compute[74190]:       <nova:owner>
Oct 18 11:52:45 user nova-compute[74190]:         <nova:user uuid="829b310c15b54dc7836d0b9d7fd757ed">tempest-AttachVolumeShelveTestJSON-83921126-project-member</nova:user>
Oct 18 11:52:45 user nova-compute[74190]:         <nova:project uuid="548640fa718f4fdfa21c1a7783519c9f">tempest-AttachVolumeShelveTestJSON-83921126</nova:project>
Oct 18 11:52:45 user nova-compute[74190]:       </nova:owner>
Oct 18 11:52:45 user nova-compute[74190]:       <nova:root type="image" uuid="5dad9d13-4172-4aa2-80cc-d43ceb28bb72"/>
Oct 18 11:52:45 user nova-compute[74190]:       <nova:ports>
Oct 18 11:52:45 user nova-compute[74190]:         <nova:port uuid="2d8060bc-84e4-41e2-9e72-42b2159a1d1e">
Oct 18 11:52:45 user nova-compute[74190]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 18 11:52:45 user nova-compute[74190]:         </nova:port>
Oct 18 11:52:45 user nova-compute[74190]:       </nova:ports>
Oct 18 11:52:45 user nova-compute[74190]:     </nova:instance>
Oct 18 11:52:45 user nova-compute[74190]:   </metadata>
Oct 18 11:52:45 user nova-compute[74190]:   <sysinfo type="smbios">
Oct 18 11:52:45 user nova-compute[74190]:     <system>
Oct 18 11:52:45 user nova-compute[74190]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 11:52:45 user nova-compute[74190]:       <entry name="product">OpenStack Nova</entry>
Oct 18 11:52:45 user nova-compute[74190]:       <entry name="version">0.0.0</entry>
Oct 18 11:52:45 user nova-compute[74190]:       <entry name="serial">d90a6ca0-19a6-4221-81b7-0cb05d67f38e</entry>
Oct 18 11:52:45 user nova-compute[74190]:       <entry name="uuid">d90a6ca0-19a6-4221-81b7-0cb05d67f38e</entry>
Oct 18 11:52:45 user nova-compute[74190]:       <entry name="family">Virtual Machine</entry>
Oct 18 11:52:45 user nova-compute[74190]:     </system>
Oct 18 11:52:45 user nova-compute[74190]:   </sysinfo>
Oct 18 11:52:45 user nova-compute[74190]:   <os>
Oct 18 11:52:45 user nova-compute[74190]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 11:52:45 user nova-compute[74190]:     <boot dev="hd"/>
Oct 18 11:52:45 user nova-compute[74190]:     <smbios mode="sysinfo"/>
Oct 18 11:52:45 user nova-compute[74190]:   </os>
Oct 18 11:52:45 user nova-compute[74190]:   <features>
Oct 18 11:52:45 user nova-compute[74190]:     <acpi/>
Oct 18 11:52:45 user nova-compute[74190]:     <apic/>
Oct 18 11:52:45 user nova-compute[74190]:     <vmcoreinfo/>
Oct 18 11:52:45 user nova-compute[74190]:   </features>
Oct 18 11:52:45 user nova-compute[74190]:   <clock offset="utc">
Oct 18 11:52:45 user nova-compute[74190]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 11:52:45 user nova-compute[74190]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 11:52:45 user nova-compute[74190]:     <timer name="hpet" present="no"/>
Oct 18 11:52:45 user nova-compute[74190]:   </clock>
Oct 18 11:52:45 user nova-compute[74190]:   <cpu mode="custom" match="exact">
Oct 18 11:52:45 user nova-compute[74190]:     <model>Nehalem</model>
Oct 18 11:52:45 user nova-compute[74190]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 11:52:45 user nova-compute[74190]:   </cpu>
Oct 18 11:52:45 user nova-compute[74190]:   <devices>
Oct 18 11:52:45 user nova-compute[74190]:     <disk type="file" device="disk">
Oct 18 11:52:45 user nova-compute[74190]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 11:52:45 user nova-compute[74190]:       <source file="/opt/stack/data/nova/instances/d90a6ca0-19a6-4221-81b7-0cb05d67f38e/disk"/>
Oct 18 11:52:45 user nova-compute[74190]:       <target dev="vda" bus="virtio"/>
Oct 18 11:52:45 user nova-compute[74190]:     </disk>
Oct 18 11:52:45 user nova-compute[74190]:     <interface type="ethernet">
Oct 18 11:52:45 user nova-compute[74190]:       <mac address="fa:16:3e:6c:a0:e2"/>
Oct 18 11:52:45 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:52:45 user nova-compute[74190]:       <mtu size="1442"/>
Oct 18 11:52:45 user nova-compute[74190]:       <target dev="tap2d8060bc-84"/>
Oct 18 11:52:45 user nova-compute[74190]:     </interface>
Oct 18 11:52:45 user nova-compute[74190]:     <serial type="pty">
Oct 18 11:52:45 user nova-compute[74190]:       <log file="/opt/stack/data/nova/instances/d90a6ca0-19a6-4221-81b7-0cb05d67f38e/console.log" append="off"/>
Oct 18 11:52:45 user nova-compute[74190]:     </serial>
Oct 18 11:52:45 user nova-compute[74190]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 11:52:45 user nova-compute[74190]:     <video>
Oct 18 11:52:45 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:52:45 user nova-compute[74190]:     </video>
Oct 18 11:52:45 user nova-compute[74190]:     <rng model="virtio">
Oct 18 11:52:45 user nova-compute[74190]:       <backend model="random">/dev/urandom</backend>
Oct 18 11:52:45 user nova-compute[74190]:     </rng>
Oct 18 11:52:45 user nova-compute[74190]:     <controller type="usb" index="0" model="none"/>
Oct 18 11:52:45 user nova-compute[74190]:     <memballoon model="virtio">
Oct 18 11:52:45 user nova-compute[74190]:       <stats period="10"/>
Oct 18 11:52:45 user nova-compute[74190]:     </memballoon>
Oct 18 11:52:45 user nova-compute[74190]:   </devices>
Oct 18 11:52:45 user nova-compute[74190]: </domain>
Oct 18 11:52:45 user nova-compute[74190]:  {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 11:52:45 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-18T11:48:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1378919830',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1378919830',id=16,image_ref='5dad9d13-4172-4aa2-80cc-d43ceb28bb72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1365040796',keypairs=<?>,launch_index=0,launched_at=2023-10-18T11:48:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='548640fa718f4fdfa21c1a7783519c9f',ramdisk_id='',reservation_id='r-eukfw0x8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-83921126',owner_user_name='tempest-AttachVolumeShelveTestJSON-83921126-project-member',shelved_at='2023-10-18T11:50:47.885613',shelved_host='user',shelved_image_id='5dad9d13-4172-4aa2-80cc-d43ceb28bb72'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:52:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='829b310c15b54dc7836d0b9d7fd757ed',uuid=d90a6ca0-19a6-4221-81b7-0cb05d67f38e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "2d8060bc-84e4-41e2-9e72-42b2159a1d1e", "address": "fa:16:3e:6c:a0:e2", "network": {"id": "e6ae8edc-7014-4341-91b2-4c82d72c9bb9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-15434410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548640fa718f4fdfa21c1a7783519c9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d8060bc-84", "ovs_interfaceid": "2d8060bc-84e4-41e2-9e72-42b2159a1d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 11:52:45 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Converting VIF {"id": "2d8060bc-84e4-41e2-9e72-42b2159a1d1e", "address": "fa:16:3e:6c:a0:e2", "network": {"id": "e6ae8edc-7014-4341-91b2-4c82d72c9bb9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-15434410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548640fa718f4fdfa21c1a7783519c9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d8060bc-84", "ovs_interfaceid": "2d8060bc-84e4-41e2-9e72-42b2159a1d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:52:45 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:a0:e2,bridge_name='br-int',has_traffic_filtering=True,id=2d8060bc-84e4-41e2-9e72-42b2159a1d1e,network=Network(e6ae8edc-7014-4341-91b2-4c82d72c9bb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d8060bc-84') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:52:45 user nova-compute[74190]: DEBUG os_vif [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:a0:e2,bridge_name='br-int',has_traffic_filtering=True,id=2d8060bc-84e4-41e2-9e72-42b2159a1d1e,network=Network(e6ae8edc-7014-4341-91b2-4c82d72c9bb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d8060bc-84') {{(pid=74190) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 11:52:45 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:45 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:52:45 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 11:52:45 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:45 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ff472df0-1156-5a76-b5f5-151417eb2037', '_type': 'linux-noop'}}, row=False) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:52:45 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:52:45 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:45 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:45 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:45 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2d8060bc-84, may_exist=True, interface_attrs={}) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:52:45 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2d8060bc-84, col_values=(('qos', UUID('f6224a33-0499-4c64-8d4e-d65e80d94de8')),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:52:45 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2d8060bc-84, col_values=(('external_ids', {'iface-id': '2d8060bc-84e4-41e2-9e72-42b2159a1d1e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:a0:e2', 'vm-uuid': 'd90a6ca0-19a6-4221-81b7-0cb05d67f38e'}),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:52:45 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:45 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:52:45 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:45 user nova-compute[74190]: INFO os_vif [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:a0:e2,bridge_name='br-int',has_traffic_filtering=True,id=2d8060bc-84e4-41e2-9e72-42b2159a1d1e,network=Network(e6ae8edc-7014-4341-91b2-4c82d72c9bb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d8060bc-84')
Oct 18 11:52:45 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] No BDM found with device name vda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 11:52:45 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] No VIF found with MAC fa:16:3e:6c:a0:e2, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 11:52:45 user nova-compute[74190]: DEBUG nova.compute.manager [req-9b5cc049-0d8c-487b-bc87-c037d62b74bc req-d6e6bca3-0d3b-4bde-bf97-0e4dcb8d5e6d service nova] [instance: b200eb6a-be24-4a8f-be23-4e36f7b7b26e] Received event network-vif-plugged-c9514478-3402-47b2-b649-0b8b762c1a35 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:52:45 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-9b5cc049-0d8c-487b-bc87-c037d62b74bc req-d6e6bca3-0d3b-4bde-bf97-0e4dcb8d5e6d service nova] Acquiring lock "b200eb6a-be24-4a8f-be23-4e36f7b7b26e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:52:45 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-9b5cc049-0d8c-487b-bc87-c037d62b74bc req-d6e6bca3-0d3b-4bde-bf97-0e4dcb8d5e6d service nova] Lock "b200eb6a-be24-4a8f-be23-4e36f7b7b26e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:52:45 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-9b5cc049-0d8c-487b-bc87-c037d62b74bc req-d6e6bca3-0d3b-4bde-bf97-0e4dcb8d5e6d service nova] Lock "b200eb6a-be24-4a8f-be23-4e36f7b7b26e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:52:45 user nova-compute[74190]: DEBUG nova.compute.manager [req-9b5cc049-0d8c-487b-bc87-c037d62b74bc req-d6e6bca3-0d3b-4bde-bf97-0e4dcb8d5e6d service nova] [instance: b200eb6a-be24-4a8f-be23-4e36f7b7b26e] No waiting events found dispatching network-vif-plugged-c9514478-3402-47b2-b649-0b8b762c1a35 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:52:45 user nova-compute[74190]: WARNING nova.compute.manager [req-9b5cc049-0d8c-487b-bc87-c037d62b74bc req-d6e6bca3-0d3b-4bde-bf97-0e4dcb8d5e6d service nova] [instance: b200eb6a-be24-4a8f-be23-4e36f7b7b26e] Received unexpected event network-vif-plugged-c9514478-3402-47b2-b649-0b8b762c1a35 for instance with vm_state building and task_state spawning.
Oct 18 11:52:46 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:46 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:46 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:46 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:46 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:47 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:47 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:47 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:47 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:47 user nova-compute[74190]: DEBUG nova.compute.manager [req-e5fd4997-9bd7-4cec-8d2b-ff97e36f6d14 req-5773f9df-3202-4c6c-99af-d133a94a61f6 service nova] [instance: b200eb6a-be24-4a8f-be23-4e36f7b7b26e] Received event network-vif-plugged-c9514478-3402-47b2-b649-0b8b762c1a35 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:52:47 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-e5fd4997-9bd7-4cec-8d2b-ff97e36f6d14 req-5773f9df-3202-4c6c-99af-d133a94a61f6 service nova] Acquiring lock "b200eb6a-be24-4a8f-be23-4e36f7b7b26e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:52:47 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-e5fd4997-9bd7-4cec-8d2b-ff97e36f6d14 req-5773f9df-3202-4c6c-99af-d133a94a61f6 service nova] Lock "b200eb6a-be24-4a8f-be23-4e36f7b7b26e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:52:47 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-e5fd4997-9bd7-4cec-8d2b-ff97e36f6d14 req-5773f9df-3202-4c6c-99af-d133a94a61f6 service nova] Lock "b200eb6a-be24-4a8f-be23-4e36f7b7b26e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:52:47 user nova-compute[74190]: DEBUG nova.compute.manager [req-e5fd4997-9bd7-4cec-8d2b-ff97e36f6d14 req-5773f9df-3202-4c6c-99af-d133a94a61f6 service nova] [instance: b200eb6a-be24-4a8f-be23-4e36f7b7b26e] No waiting events found dispatching network-vif-plugged-c9514478-3402-47b2-b649-0b8b762c1a35 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:52:47 user nova-compute[74190]: WARNING nova.compute.manager [req-e5fd4997-9bd7-4cec-8d2b-ff97e36f6d14 req-5773f9df-3202-4c6c-99af-d133a94a61f6 service nova] [instance: b200eb6a-be24-4a8f-be23-4e36f7b7b26e] Received unexpected event network-vif-plugged-c9514478-3402-47b2-b649-0b8b762c1a35 for instance with vm_state building and task_state spawning.
Oct 18 11:52:47 user nova-compute[74190]: DEBUG nova.compute.manager [req-e5fd4997-9bd7-4cec-8d2b-ff97e36f6d14 req-5773f9df-3202-4c6c-99af-d133a94a61f6 service nova] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Received event network-vif-plugged-2d8060bc-84e4-41e2-9e72-42b2159a1d1e {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:52:47 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-e5fd4997-9bd7-4cec-8d2b-ff97e36f6d14 req-5773f9df-3202-4c6c-99af-d133a94a61f6 service nova] Acquiring lock "d90a6ca0-19a6-4221-81b7-0cb05d67f38e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:52:47 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-e5fd4997-9bd7-4cec-8d2b-ff97e36f6d14 req-5773f9df-3202-4c6c-99af-d133a94a61f6 service nova] Lock "d90a6ca0-19a6-4221-81b7-0cb05d67f38e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:52:47 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-e5fd4997-9bd7-4cec-8d2b-ff97e36f6d14 req-5773f9df-3202-4c6c-99af-d133a94a61f6 service nova] Lock "d90a6ca0-19a6-4221-81b7-0cb05d67f38e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:52:47 user nova-compute[74190]: DEBUG nova.compute.manager [req-e5fd4997-9bd7-4cec-8d2b-ff97e36f6d14 req-5773f9df-3202-4c6c-99af-d133a94a61f6 service nova] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] No waiting events found dispatching network-vif-plugged-2d8060bc-84e4-41e2-9e72-42b2159a1d1e {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:52:47 user nova-compute[74190]: WARNING nova.compute.manager [req-e5fd4997-9bd7-4cec-8d2b-ff97e36f6d14 req-5773f9df-3202-4c6c-99af-d133a94a61f6 service nova] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Received unexpected event network-vif-plugged-2d8060bc-84e4-41e2-9e72-42b2159a1d1e for instance with vm_state shelved_offloaded and task_state spawning.
Oct 18 11:52:47 user nova-compute[74190]: DEBUG nova.compute.manager [req-e5fd4997-9bd7-4cec-8d2b-ff97e36f6d14 req-5773f9df-3202-4c6c-99af-d133a94a61f6 service nova] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Received event network-vif-plugged-2d8060bc-84e4-41e2-9e72-42b2159a1d1e {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:52:47 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-e5fd4997-9bd7-4cec-8d2b-ff97e36f6d14 req-5773f9df-3202-4c6c-99af-d133a94a61f6 service nova] Acquiring lock "d90a6ca0-19a6-4221-81b7-0cb05d67f38e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:52:47 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-e5fd4997-9bd7-4cec-8d2b-ff97e36f6d14 req-5773f9df-3202-4c6c-99af-d133a94a61f6 service nova] Lock "d90a6ca0-19a6-4221-81b7-0cb05d67f38e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:52:47 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-e5fd4997-9bd7-4cec-8d2b-ff97e36f6d14 req-5773f9df-3202-4c6c-99af-d133a94a61f6 service nova] Lock "d90a6ca0-19a6-4221-81b7-0cb05d67f38e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:52:47 user nova-compute[74190]: DEBUG nova.compute.manager [req-e5fd4997-9bd7-4cec-8d2b-ff97e36f6d14 req-5773f9df-3202-4c6c-99af-d133a94a61f6 service nova] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] No waiting events found dispatching network-vif-plugged-2d8060bc-84e4-41e2-9e72-42b2159a1d1e {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:52:47 user nova-compute[74190]: WARNING nova.compute.manager [req-e5fd4997-9bd7-4cec-8d2b-ff97e36f6d14 req-5773f9df-3202-4c6c-99af-d133a94a61f6 service nova] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Received unexpected event network-vif-plugged-2d8060bc-84e4-41e2-9e72-42b2159a1d1e for instance with vm_state shelved_offloaded and task_state spawning.
Oct 18 11:52:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:49 user nova-compute[74190]: DEBUG nova.compute.manager [None req-d70fcf24-7489-4b70-a5ae-3e36d4c8c7e2 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: b200eb6a-be24-4a8f-be23-4e36f7b7b26e] Instance event wait completed in 0 seconds for  {{(pid=74190) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 11:52:49 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-d70fcf24-7489-4b70-a5ae-3e36d4c8c7e2 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: b200eb6a-be24-4a8f-be23-4e36f7b7b26e] Guest created on hypervisor {{(pid=74190) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 11:52:49 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: b200eb6a-be24-4a8f-be23-4e36f7b7b26e] Instance spawned successfully.
Oct 18 11:52:49 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-d70fcf24-7489-4b70-a5ae-3e36d4c8c7e2 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: b200eb6a-be24-4a8f-be23-4e36f7b7b26e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 11:52:49 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-d70fcf24-7489-4b70-a5ae-3e36d4c8c7e2 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: b200eb6a-be24-4a8f-be23-4e36f7b7b26e] Found default for hw_cdrom_bus of ide {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:52:49 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-d70fcf24-7489-4b70-a5ae-3e36d4c8c7e2 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: b200eb6a-be24-4a8f-be23-4e36f7b7b26e] Found default for hw_disk_bus of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:52:49 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-d70fcf24-7489-4b70-a5ae-3e36d4c8c7e2 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: b200eb6a-be24-4a8f-be23-4e36f7b7b26e] Found default for hw_input_bus of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:52:49 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-d70fcf24-7489-4b70-a5ae-3e36d4c8c7e2 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: b200eb6a-be24-4a8f-be23-4e36f7b7b26e] Found default for hw_pointer_model of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:52:49 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-d70fcf24-7489-4b70-a5ae-3e36d4c8c7e2 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: b200eb6a-be24-4a8f-be23-4e36f7b7b26e] Found default for hw_video_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:52:49 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-d70fcf24-7489-4b70-a5ae-3e36d4c8c7e2 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: b200eb6a-be24-4a8f-be23-4e36f7b7b26e] Found default for hw_vif_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:52:49 user nova-compute[74190]: INFO nova.compute.manager [None req-d70fcf24-7489-4b70-a5ae-3e36d4c8c7e2 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: b200eb6a-be24-4a8f-be23-4e36f7b7b26e] Took 7.91 seconds to spawn the instance on the hypervisor.
Oct 18 11:52:49 user nova-compute[74190]: DEBUG nova.compute.manager [None req-d70fcf24-7489-4b70-a5ae-3e36d4c8c7e2 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: b200eb6a-be24-4a8f-be23-4e36f7b7b26e] Checking state {{(pid=74190) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 11:52:49 user nova-compute[74190]: INFO nova.compute.manager [None req-d70fcf24-7489-4b70-a5ae-3e36d4c8c7e2 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: b200eb6a-be24-4a8f-be23-4e36f7b7b26e] Took 9.39 seconds to build instance.
Oct 18 11:52:49 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-d70fcf24-7489-4b70-a5ae-3e36d4c8c7e2 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "b200eb6a-be24-4a8f-be23-4e36f7b7b26e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.575s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:52:49 user nova-compute[74190]: DEBUG nova.compute.manager [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Instance event wait completed in 0 seconds for  {{(pid=74190) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 11:52:49 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Guest created on hypervisor {{(pid=74190) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 11:52:49 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Instance spawned successfully.
Oct 18 11:52:49 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:50 user nova-compute[74190]: DEBUG nova.compute.manager [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Checking state {{(pid=74190) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 11:52:50 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-81ea6eb9-96d9-41bf-8ce3-a1d32de44134 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Lock "d90a6ca0-19a6-4221-81b7-0cb05d67f38e" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 13.759s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:52:50 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:54 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:55 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:52:55 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:56 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:52:57 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:52:57 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74190) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 11:52:58 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:52:58 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:52:58 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:52:58 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:52:58 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:52:58 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Auditing locally available compute resources for user (node: user) {{(pid=74190) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 11:52:58 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47ed3fb0-c159-484f-8380-79b5564d0ac1/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:58 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47ed3fb0-c159-484f-8380-79b5564d0ac1/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:58 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47ed3fb0-c159-484f-8380-79b5564d0ac1/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:58 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47ed3fb0-c159-484f-8380-79b5564d0ac1/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:58 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b200eb6a-be24-4a8f-be23-4e36f7b7b26e/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:58 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b200eb6a-be24-4a8f-be23-4e36f7b7b26e/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:58 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b200eb6a-be24-4a8f-be23-4e36f7b7b26e/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:59 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b200eb6a-be24-4a8f-be23-4e36f7b7b26e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:59 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eec9cde-3553-4fc8-9162-cda963d1a81e/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:59 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eec9cde-3553-4fc8-9162-cda963d1a81e/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:59 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eec9cde-3553-4fc8-9162-cda963d1a81e/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:59 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eec9cde-3553-4fc8-9162-cda963d1a81e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:59 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0209c824-88a7-4976-83bf-8a72437f0cc2/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:59 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0209c824-88a7-4976-83bf-8a72437f0cc2/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:59 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0209c824-88a7-4976-83bf-8a72437f0cc2/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:52:59 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:52:59 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0209c824-88a7-4976-83bf-8a72437f0cc2/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:52:59 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:53:00 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk --force-share --output=json" returned: 0 in 0.316s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:53:00 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:53:00 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:53:00 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 11:53:00 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk.rescue --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:53:00 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:53:00 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk.rescue --force-share --output=json" returned: 0 in 0.228s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:53:00 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk.rescue --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:53:00 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:53:00 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d90a6ca0-19a6-4221-81b7-0cb05d67f38e/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:53:01 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d90a6ca0-19a6-4221-81b7-0cb05d67f38e/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:53:01 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d90a6ca0-19a6-4221-81b7-0cb05d67f38e/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:53:01 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d90a6ca0-19a6-4221-81b7-0cb05d67f38e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:53:01 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdfe420d-f46c-44ad-8773-b675f42e24ed/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:53:01 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Acquiring lock "a9012673-826b-4be7-a55b-9bb35a227c17" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:53:01 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lock "a9012673-826b-4be7-a55b-9bb35a227c17" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:53:01 user nova-compute[74190]: DEBUG nova.compute.manager [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Starting instance... {{(pid=74190) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 11:53:01 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdfe420d-f46c-44ad-8773-b675f42e24ed/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:53:01 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdfe420d-f46c-44ad-8773-b675f42e24ed/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:53:01 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:53:01 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:53:01 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74190) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 11:53:01 user nova-compute[74190]: INFO nova.compute.claims [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Claim successful on node user
Oct 18 11:53:01 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdfe420d-f46c-44ad-8773-b675f42e24ed/disk --force-share --output=json" returned: 0 in 0.281s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:53:01 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 11:53:02 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:53:02 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:53:02 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Hypervisor/Node resource view: name=user free_ram=7800MB free_disk=25.364124298095703GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74190) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 11:53:02 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:53:02 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 11:53:02 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 11:53:02 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.935s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:53:02 user nova-compute[74190]: DEBUG nova.compute.manager [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Start building networks asynchronously for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 11:53:02 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.283s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:53:02 user nova-compute[74190]: DEBUG nova.compute.manager [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Allocating IP information in the background. {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 11:53:02 user nova-compute[74190]: DEBUG nova.network.neutron [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] allocate_for_instance() {{(pid=74190) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 11:53:02 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 11:53:02 user nova-compute[74190]: DEBUG nova.compute.manager [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Start building block device mappings for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 11:53:02 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 0209c824-88a7-4976-83bf-8a72437f0cc2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:53:02 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 4e916d24-9f9d-4289-87ce-f65d2499fcd9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:53:02 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance bdfe420d-f46c-44ad-8773-b675f42e24ed actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:53:02 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 47ed3fb0-c159-484f-8380-79b5564d0ac1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:53:02 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 8eec9cde-3553-4fc8-9162-cda963d1a81e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:53:02 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance d90a6ca0-19a6-4221-81b7-0cb05d67f38e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:53:02 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance b200eb6a-be24-4a8f-be23-4e36f7b7b26e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:53:02 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance a9012673-826b-4be7-a55b-9bb35a227c17 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:53:02 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 11:53:02 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 11:53:02 user nova-compute[74190]: DEBUG nova.policy [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b771e627a76b4540bf8de665df3d7787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cf52ce927443158aa731367f08bd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74190) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 11:53:02 user nova-compute[74190]: INFO nova.virt.block_device [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Booting with volume cc26cf8b-df01-4da0-a6d0-9013e888d227 at /dev/vda
Oct 18 11:53:02 user nova-compute[74190]: DEBUG os_brick.utils [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:53:02 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:53:02 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.029s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:53:02 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d76b4da-fb1a-4109-9460-9c8240564bd6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cff158e257e1\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:53:02 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:53:02 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:53:02 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[13cb56d4-8bb2-49c2-80eb-083934062c60]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:53:02 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:53:02 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:53:02 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce17949-18c0-4db2-9364-729eeae29c8a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:53:02 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6214ffb-9ee5-4bfa-875f-ef3b63d57a8d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:53:02 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Running cmd (subprocess): nvme version {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:53:02 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] 'nvme version' failed. Not Retrying. {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 11:53:02 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] nvme not present on system {{(pid=74190) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 11:53:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:53:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 11:53:03 user nova-compute[74190]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 11:53:03 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d789085-2260-41df-8d9d-9d58c3a962af]: (4, '') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:53:03 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74190) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 11:53:03 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 11:53:03 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] LIGHTOS: no hostnqn found. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 11:53:03 user nova-compute[74190]: DEBUG os_brick.utils [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cff158e257e1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:53:03 user nova-compute[74190]: DEBUG nova.virt.block_device [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Updating existing volume attachment record: 3f90850e-6447-4b1b-90aa-eab111a30003 {{(pid=74190) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 11:53:03 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 11:53:03 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 11:53:03 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Compute_service record updated for user:user {{(pid=74190) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 11:53:03 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.515s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:53:03 user nova-compute[74190]: DEBUG nova.network.neutron [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Successfully created port: 98016144-4b95-4e94-8ae4-581089fe4f63 {{(pid=74190) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 11:53:04 user nova-compute[74190]: DEBUG nova.network.neutron [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Successfully updated port: 98016144-4b95-4e94-8ae4-581089fe4f63 {{(pid=74190) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 11:53:04 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Acquiring lock "refresh_cache-a9012673-826b-4be7-a55b-9bb35a227c17" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:53:04 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Acquired lock "refresh_cache-a9012673-826b-4be7-a55b-9bb35a227c17" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:53:04 user nova-compute[74190]: DEBUG nova.network.neutron [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Building network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 11:53:04 user nova-compute[74190]: DEBUG nova.compute.manager [req-01f06402-e862-4d91-a810-dc9ac16450a0 req-98672a48-423b-49b8-b1f5-b2be2c70b301 service nova] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Received event network-changed-98016144-4b95-4e94-8ae4-581089fe4f63 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:53:04 user nova-compute[74190]: DEBUG nova.compute.manager [req-01f06402-e862-4d91-a810-dc9ac16450a0 req-98672a48-423b-49b8-b1f5-b2be2c70b301 service nova] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Refreshing instance network info cache due to event network-changed-98016144-4b95-4e94-8ae4-581089fe4f63. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 11:53:04 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-01f06402-e862-4d91-a810-dc9ac16450a0 req-98672a48-423b-49b8-b1f5-b2be2c70b301 service nova] Acquiring lock "refresh_cache-a9012673-826b-4be7-a55b-9bb35a227c17" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:53:04 user nova-compute[74190]: DEBUG nova.network.neutron [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Instance cache missing network info. {{(pid=74190) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 11:53:04 user nova-compute[74190]: DEBUG nova.network.neutron [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Updating instance_info_cache with network_info: [{"id": "98016144-4b95-4e94-8ae4-581089fe4f63", "address": "fa:16:3e:ea:1d:55", "network": {"id": "f5ab7da4-2b07-4465-9a89-a07eb053ba91", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1315695374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08cf52ce927443158aa731367f08bd57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98016144-4b", "ovs_interfaceid": "98016144-4b95-4e94-8ae4-581089fe4f63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:53:04 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Releasing lock "refresh_cache-a9012673-826b-4be7-a55b-9bb35a227c17" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:53:04 user nova-compute[74190]: DEBUG nova.compute.manager [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Instance network_info: |[{"id": "98016144-4b95-4e94-8ae4-581089fe4f63", "address": "fa:16:3e:ea:1d:55", "network": {"id": "f5ab7da4-2b07-4465-9a89-a07eb053ba91", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1315695374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08cf52ce927443158aa731367f08bd57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98016144-4b", "ovs_interfaceid": "98016144-4b95-4e94-8ae4-581089fe4f63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 11:53:04 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-01f06402-e862-4d91-a810-dc9ac16450a0 req-98672a48-423b-49b8-b1f5-b2be2c70b301 service nova] Acquired lock "refresh_cache-a9012673-826b-4be7-a55b-9bb35a227c17" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:53:04 user nova-compute[74190]: DEBUG nova.network.neutron [req-01f06402-e862-4d91-a810-dc9ac16450a0 req-98672a48-423b-49b8-b1f5-b2be2c70b301 service nova] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Refreshing network info cache for port 98016144-4b95-4e94-8ae4-581089fe4f63 {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 11:53:04 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:53:04 user nova-compute[74190]: DEBUG nova.network.neutron [req-01f06402-e862-4d91-a810-dc9ac16450a0 req-98672a48-423b-49b8-b1f5-b2be2c70b301 service nova] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Updated VIF entry in instance network info cache for port 98016144-4b95-4e94-8ae4-581089fe4f63. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 11:53:04 user nova-compute[74190]: DEBUG nova.network.neutron [req-01f06402-e862-4d91-a810-dc9ac16450a0 req-98672a48-423b-49b8-b1f5-b2be2c70b301 service nova] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Updating instance_info_cache with network_info: [{"id": "98016144-4b95-4e94-8ae4-581089fe4f63", "address": "fa:16:3e:ea:1d:55", "network": {"id": "f5ab7da4-2b07-4465-9a89-a07eb053ba91", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1315695374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08cf52ce927443158aa731367f08bd57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98016144-4b", "ovs_interfaceid": "98016144-4b95-4e94-8ae4-581089fe4f63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:53:04 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-01f06402-e862-4d91-a810-dc9ac16450a0 req-98672a48-423b-49b8-b1f5-b2be2c70b301 service nova] Releasing lock "refresh_cache-a9012673-826b-4be7-a55b-9bb35a227c17" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:53:05 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:53:05 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:53:05 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:53:05 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Starting heal instance info cache {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 11:53:05 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "refresh_cache-bdfe420d-f46c-44ad-8773-b675f42e24ed" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:53:05 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquired lock "refresh_cache-bdfe420d-f46c-44ad-8773-b675f42e24ed" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:53:05 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Forcefully refreshing network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 18 11:53:05 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:53:05 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Updating instance_info_cache with network_info: [{"id": "5f5b65f1-7748-4422-8b45-e1b88476716d", "address": "fa:16:3e:cb:ff:0f", "network": {"id": "7be8675d-326a-4184-9b3e-fbaa02a4e1fc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-468552750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce179d9f22684865b577bd91bc841400", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5b65f1-77", "ovs_interfaceid": "5f5b65f1-7748-4422-8b45-e1b88476716d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:53:05 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Releasing lock "refresh_cache-bdfe420d-f46c-44ad-8773-b675f42e24ed" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:53:05 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Updated the network info_cache for instance {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 18 11:53:05 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:53:05 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:53:09 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:53:09 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:53:10 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:53:14 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:53:15 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:53:19 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:53:20 user nova-compute[74190]: DEBUG nova.compute.manager [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Start spawning the instance on the hypervisor. {{(pid=74190) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 11:53:20 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Creating instance directory {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 11:53:20 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Creating image(s)
Oct 18 11:53:20 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Did not create local disks {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 18 11:53:20 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Ensure instance console log exists: /opt/stack/data/nova/instances/a9012673-826b-4be7-a55b-9bb35a227c17/console.log {{(pid=74190) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 11:53:20 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:53:20 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:53:20 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:53:20 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Start _get_guest_xml network_info=[{"id": "98016144-4b95-4e94-8ae4-581089fe4f63", "address": "fa:16:3e:ea:1d:55", "network": {"id": "f5ab7da4-2b07-4465-9a89-a07eb053ba91", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1315695374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08cf52ce927443158aa731367f08bd57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98016144-4b", "ovs_interfaceid": "98016144-4b95-4e94-8ae4-581089fe4f63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qAZlmtWu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a9012673-826b-4be7-a55b-9bb35a227c17', 'attached_at': '', 'detached_at': '', 'volume_id': 'cc26cf8b-df01-4da0-a6d0-9013e888d227', 'serial': 'cc26cf8b-df01-4da0-a6d0-9013e888d227'}, 'delete_on_termination': True, 'guest_format': None, 'attachment_id': '3f90850e-6447-4b1b-90aa-eab111a30003', 'volume_type': None} {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 11:53:20 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:53:20 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:53:20 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:53:20 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 11:53:20 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] CPU controller missing on host. {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 11:53:20 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 11:53:20 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] CPU controller found on host. {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 11:53:20 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74190) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 11:53:20 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T11:37:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 11:53:20 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Flavor limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 11:53:20 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Image limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 11:53:20 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Flavor pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 11:53:20 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Image pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 11:53:20 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 11:53:20 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 11:53:20 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 11:53:20 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Got 1 possible topologies {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 11:53:20 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 11:53:20 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 11:53:20 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Calling os-brick to attach iSCSI Volume {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 11:53:20 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qAZlmtWu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:53:20 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:53:20 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:53:20 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:53:20 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:53:20 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:53:20 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:53:20 user nova-compute[74190]: INFO os_brick.initiator.connectors.iscsi [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 11:53:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 -p 172.16.0.220:3260 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:53:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:53:20 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f5ac5d-d6f9-4a08-8e9a-c2ab190532db]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:53:20 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 11:53:20 user nova-compute[74190]:  {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:53:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 -p 172.16.0.220:3260 --interface default --op new {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:53:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:53:20 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[987673d2-0fa0-4470-836c-fc02318ba173]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227] added\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:53:20 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227] added
Oct 18 11:53:20 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:53:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:53:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:53:20 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a9c03a-baad-4cb4-8f72-be048c0f348c]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:53:20 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:53:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:53:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:53:20 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[7995a0c4-9552-47e8-ba0d-261f5f831efb]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:53:20 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:53:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qAZlmtWu {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:53:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qAZlmtWu" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:53:20 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[67454494-d0e0-46f0-83dc-87bd39899149]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:53:20 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qAZlmtWu'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:53:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:53:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:53:20 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[1990aab8-ebaf-4c23-a6c4-05a792a99428]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:53:20 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:53:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:53:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:53:20 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d0f62d1-bef4-4b5e-9231-b5b7297b6b6c]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:53:20 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 11:53:20 user nova-compute[74190]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 (non-flash)
Oct 18 11:53:20 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:53:20 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 11:53:20 user nova-compute[74190]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 (non-flash)
Oct 18 11:53:20 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:53:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 -p 172.16.0.220:3260 --login {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:53:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:53:20 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[10b7f7e6-03f5-4913-91e6-8b262c4e7fa3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:53:20 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227, portal: 172.16.0.220,3260]
Oct 18 11:53:20 user nova-compute[74190]: Login to [iface: default, target: iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227, portal: 172.16.0.220,3260] successful.
Oct 18 11:53:20 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:53:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:53:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:53:20 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eed002f-dbe7-45af-9cc5-5c3a375d8578]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:53:20 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:53:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:53:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:53:20 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[2615d78d-d94f-47d7-a04e-93c2b02e0af6]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:53:20 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 11:53:20 user nova-compute[74190]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 (non-flash)
Oct 18 11:53:20 user nova-compute[74190]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 (non-flash)
Oct 18 11:53:20 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:53:20 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 11:53:20 user nova-compute[74190]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 (non-flash)
Oct 18 11:53:20 user nova-compute[74190]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 (non-flash)
Oct 18 11:53:20 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:53:20 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:53:20 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Connected to 172.16.0.220:3260 {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 11:53:20 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] HCTL ('35', '-', '-', 0) found on session 29 with lun 0 {{(pid=74190) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 11:53:20 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74190) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 11:53:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:53:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:53:20 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c3f8118-99ec-48f2-b535-894ce932334d]: (4, ('- - 0', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:53:20 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Searching for a device in session 29 and hctl ['35', '*', '*', 0] yield: None {{(pid=74190) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 11:53:21 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Searching for a device in session 29 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74190) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 11:53:21 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qAZlmtWu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 11:53:21 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:53:21 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '26234386438336635', 'path': '/dev/sdd'} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:53:21 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26234386438336635', 'path': '/dev/sdd'} {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 11:53:21 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:53:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1490971997',display_name='tempest-ServerActionsTestOtherA-server-1490971997',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1490971997',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOQBzNTv9LZg0yq/3lf4kmMEAFSSxHvdpQtvKWiUtvrhz9NgEirvm+N8Tqx31x38AF1/g3O4be21YeguWgKCS7N36Oy8ZZWxYYR46ATEkZPMIr3HhNKcU83cECzcDD++0g==',key_name='tempest-keypair-1511789347',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='08cf52ce927443158aa731367f08bd57',ramdisk_id='',reservation_id='r-0xda3q9d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1288544694',owner_user_name='tempest-ServerActionsTestOtherA-1288544694-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:53:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b771e627a76b4540bf8de665df3d7787',uuid=a9012673-826b-4be7-a55b-9bb35a227c17,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98016144-4b95-4e94-8ae4-581089fe4f63", "address": "fa:16:3e:ea:1d:55", "network": {"id": "f5ab7da4-2b07-4465-9a89-a07eb053ba91", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1315695374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08cf52ce927443158aa731367f08bd57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98016144-4b", "ovs_interfaceid": "98016144-4b95-4e94-8ae4-581089fe4f63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74190) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 11:53:21 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Converting VIF {"id": "98016144-4b95-4e94-8ae4-581089fe4f63", "address": "fa:16:3e:ea:1d:55", "network": {"id": "f5ab7da4-2b07-4465-9a89-a07eb053ba91", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1315695374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08cf52ce927443158aa731367f08bd57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98016144-4b", "ovs_interfaceid": "98016144-4b95-4e94-8ae4-581089fe4f63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:53:21 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:1d:55,bridge_name='br-int',has_traffic_filtering=True,id=98016144-4b95-4e94-8ae4-581089fe4f63,network=Network(f5ab7da4-2b07-4465-9a89-a07eb053ba91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98016144-4b') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:53:21 user nova-compute[74190]: DEBUG nova.objects.instance [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lazy-loading 'pci_devices' on Instance uuid a9012673-826b-4be7-a55b-9bb35a227c17 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:53:21 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] End _get_guest_xml xml=<domain type="kvm">
Oct 18 11:53:21 user nova-compute[74190]:   <uuid>a9012673-826b-4be7-a55b-9bb35a227c17</uuid>
Oct 18 11:53:21 user nova-compute[74190]:   <name>instance-00000017</name>
Oct 18 11:53:21 user nova-compute[74190]:   <memory>524288</memory>
Oct 18 11:53:21 user nova-compute[74190]:   <vcpu>1</vcpu>
Oct 18 11:53:21 user nova-compute[74190]:   <metadata>
Oct 18 11:53:21 user nova-compute[74190]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 11:53:21 user nova-compute[74190]:       <nova:package version="0.0.0"/>
Oct 18 11:53:21 user nova-compute[74190]:       <nova:name>tempest-ServerActionsTestOtherA-server-1490971997</nova:name>
Oct 18 11:53:21 user nova-compute[74190]:       <nova:creationTime>2023-10-18 11:53:20</nova:creationTime>
Oct 18 11:53:21 user nova-compute[74190]:       <nova:flavor name="m1.tiny">
Oct 18 11:53:21 user nova-compute[74190]:         <nova:memory>512</nova:memory>
Oct 18 11:53:21 user nova-compute[74190]:         <nova:disk>1</nova:disk>
Oct 18 11:53:21 user nova-compute[74190]:         <nova:swap>0</nova:swap>
Oct 18 11:53:21 user nova-compute[74190]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 11:53:21 user nova-compute[74190]:         <nova:vcpus>1</nova:vcpus>
Oct 18 11:53:21 user nova-compute[74190]:       </nova:flavor>
Oct 18 11:53:21 user nova-compute[74190]:       <nova:owner>
Oct 18 11:53:21 user nova-compute[74190]:         <nova:user uuid="b771e627a76b4540bf8de665df3d7787">tempest-ServerActionsTestOtherA-1288544694-project-member</nova:user>
Oct 18 11:53:21 user nova-compute[74190]:         <nova:project uuid="08cf52ce927443158aa731367f08bd57">tempest-ServerActionsTestOtherA-1288544694</nova:project>
Oct 18 11:53:21 user nova-compute[74190]:       </nova:owner>
Oct 18 11:53:21 user nova-compute[74190]:       <nova:ports>
Oct 18 11:53:21 user nova-compute[74190]:         <nova:port uuid="98016144-4b95-4e94-8ae4-581089fe4f63">
Oct 18 11:53:21 user nova-compute[74190]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 18 11:53:21 user nova-compute[74190]:         </nova:port>
Oct 18 11:53:21 user nova-compute[74190]:       </nova:ports>
Oct 18 11:53:21 user nova-compute[74190]:     </nova:instance>
Oct 18 11:53:21 user nova-compute[74190]:   </metadata>
Oct 18 11:53:21 user nova-compute[74190]:   <sysinfo type="smbios">
Oct 18 11:53:21 user nova-compute[74190]:     <system>
Oct 18 11:53:21 user nova-compute[74190]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 11:53:21 user nova-compute[74190]:       <entry name="product">OpenStack Nova</entry>
Oct 18 11:53:21 user nova-compute[74190]:       <entry name="version">0.0.0</entry>
Oct 18 11:53:21 user nova-compute[74190]:       <entry name="serial">a9012673-826b-4be7-a55b-9bb35a227c17</entry>
Oct 18 11:53:21 user nova-compute[74190]:       <entry name="uuid">a9012673-826b-4be7-a55b-9bb35a227c17</entry>
Oct 18 11:53:21 user nova-compute[74190]:       <entry name="family">Virtual Machine</entry>
Oct 18 11:53:21 user nova-compute[74190]:     </system>
Oct 18 11:53:21 user nova-compute[74190]:   </sysinfo>
Oct 18 11:53:21 user nova-compute[74190]:   <os>
Oct 18 11:53:21 user nova-compute[74190]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 11:53:21 user nova-compute[74190]:     <boot dev="hd"/>
Oct 18 11:53:21 user nova-compute[74190]:     <smbios mode="sysinfo"/>
Oct 18 11:53:21 user nova-compute[74190]:   </os>
Oct 18 11:53:21 user nova-compute[74190]:   <features>
Oct 18 11:53:21 user nova-compute[74190]:     <acpi/>
Oct 18 11:53:21 user nova-compute[74190]:     <apic/>
Oct 18 11:53:21 user nova-compute[74190]:     <vmcoreinfo/>
Oct 18 11:53:21 user nova-compute[74190]:   </features>
Oct 18 11:53:21 user nova-compute[74190]:   <clock offset="utc">
Oct 18 11:53:21 user nova-compute[74190]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 11:53:21 user nova-compute[74190]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 11:53:21 user nova-compute[74190]:     <timer name="hpet" present="no"/>
Oct 18 11:53:21 user nova-compute[74190]:   </clock>
Oct 18 11:53:21 user nova-compute[74190]:   <cpu mode="custom" match="exact">
Oct 18 11:53:21 user nova-compute[74190]:     <model>Nehalem</model>
Oct 18 11:53:21 user nova-compute[74190]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 11:53:21 user nova-compute[74190]:   </cpu>
Oct 18 11:53:21 user nova-compute[74190]:   <devices>
Oct 18 11:53:21 user nova-compute[74190]:     <disk type="block" device="disk">
Oct 18 11:53:21 user nova-compute[74190]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 11:53:21 user nova-compute[74190]:       <source dev="/dev/sdd"/>
Oct 18 11:53:21 user nova-compute[74190]:       <target dev="vda" bus="virtio"/>
Oct 18 11:53:21 user nova-compute[74190]:       <serial>cc26cf8b-df01-4da0-a6d0-9013e888d227</serial>
Oct 18 11:53:21 user nova-compute[74190]:     </disk>
Oct 18 11:53:21 user nova-compute[74190]:     <interface type="ethernet">
Oct 18 11:53:21 user nova-compute[74190]:       <mac address="fa:16:3e:ea:1d:55"/>
Oct 18 11:53:21 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:53:21 user nova-compute[74190]:       <mtu size="1442"/>
Oct 18 11:53:21 user nova-compute[74190]:       <target dev="tap98016144-4b"/>
Oct 18 11:53:21 user nova-compute[74190]:     </interface>
Oct 18 11:53:21 user nova-compute[74190]:     <serial type="pty">
Oct 18 11:53:21 user nova-compute[74190]:       <log file="/opt/stack/data/nova/instances/a9012673-826b-4be7-a55b-9bb35a227c17/console.log" append="off"/>
Oct 18 11:53:21 user nova-compute[74190]:     </serial>
Oct 18 11:53:21 user nova-compute[74190]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 11:53:21 user nova-compute[74190]:     <video>
Oct 18 11:53:21 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:53:21 user nova-compute[74190]:     </video>
Oct 18 11:53:21 user nova-compute[74190]:     <rng model="virtio">
Oct 18 11:53:21 user nova-compute[74190]:       <backend model="random">/dev/urandom</backend>
Oct 18 11:53:21 user nova-compute[74190]:     </rng>
Oct 18 11:53:21 user nova-compute[74190]:     <controller type="usb" index="0" model="none"/>
Oct 18 11:53:21 user nova-compute[74190]:     <memballoon model="virtio">
Oct 18 11:53:21 user nova-compute[74190]:       <stats period="10"/>
Oct 18 11:53:21 user nova-compute[74190]:     </memballoon>
Oct 18 11:53:21 user nova-compute[74190]:   </devices>
Oct 18 11:53:21 user nova-compute[74190]: </domain>
Oct 18 11:53:21 user nova-compute[74190]:  {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 11:53:21 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:53:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1490971997',display_name='tempest-ServerActionsTestOtherA-server-1490971997',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1490971997',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOQBzNTv9LZg0yq/3lf4kmMEAFSSxHvdpQtvKWiUtvrhz9NgEirvm+N8Tqx31x38AF1/g3O4be21YeguWgKCS7N36Oy8ZZWxYYR46ATEkZPMIr3HhNKcU83cECzcDD++0g==',key_name='tempest-keypair-1511789347',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='08cf52ce927443158aa731367f08bd57',ramdisk_id='',reservation_id='r-0xda3q9d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1288544694',owner_user_name='tempest-ServerActionsTestOtherA-1288544694-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:53:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b771e627a76b4540bf8de665df3d7787',uuid=a9012673-826b-4be7-a55b-9bb35a227c17,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98016144-4b95-4e94-8ae4-581089fe4f63", "address": "fa:16:3e:ea:1d:55", "network": {"id": "f5ab7da4-2b07-4465-9a89-a07eb053ba91", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1315695374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08cf52ce927443158aa731367f08bd57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98016144-4b", "ovs_interfaceid": "98016144-4b95-4e94-8ae4-581089fe4f63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 11:53:21 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Converting VIF {"id": "98016144-4b95-4e94-8ae4-581089fe4f63", "address": "fa:16:3e:ea:1d:55", "network": {"id": "f5ab7da4-2b07-4465-9a89-a07eb053ba91", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1315695374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08cf52ce927443158aa731367f08bd57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98016144-4b", "ovs_interfaceid": "98016144-4b95-4e94-8ae4-581089fe4f63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:53:21 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:1d:55,bridge_name='br-int',has_traffic_filtering=True,id=98016144-4b95-4e94-8ae4-581089fe4f63,network=Network(f5ab7da4-2b07-4465-9a89-a07eb053ba91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98016144-4b') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:53:21 user nova-compute[74190]: DEBUG os_vif [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:1d:55,bridge_name='br-int',has_traffic_filtering=True,id=98016144-4b95-4e94-8ae4-581089fe4f63,network=Network(f5ab7da4-2b07-4465-9a89-a07eb053ba91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98016144-4b') {{(pid=74190) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 11:53:21 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:53:21 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:53:21 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 11:53:21 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:53:21 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '47a61e6d-c36e-5934-ad57-41d2e5d40d2f', '_type': 'linux-noop'}}, row=False) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:53:21 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:53:21 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:53:21 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap98016144-4b, may_exist=True, interface_attrs={}) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:53:21 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap98016144-4b, col_values=(('qos', UUID('4982c875-daff-412d-be4f-76d3b69e4e53')),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:53:21 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap98016144-4b, col_values=(('external_ids', {'iface-id': '98016144-4b95-4e94-8ae4-581089fe4f63', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:1d:55', 'vm-uuid': 'a9012673-826b-4be7-a55b-9bb35a227c17'}),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:53:21 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:53:21 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:53:21 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:53:21 user nova-compute[74190]: INFO os_vif [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:1d:55,bridge_name='br-int',has_traffic_filtering=True,id=98016144-4b95-4e94-8ae4-581089fe4f63,network=Network(f5ab7da4-2b07-4465-9a89-a07eb053ba91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98016144-4b')
Oct 18 11:53:22 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] No BDM found with device name vda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 11:53:22 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] No VIF found with MAC fa:16:3e:ea:1d:55, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 11:53:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:53:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:53:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:53:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:53:23 user nova-compute[74190]: DEBUG nova.compute.manager [req-349a96bc-28b6-4ceb-afeb-0b4f5f416a8e req-06faf714-975a-49da-b3be-2905afc514af service nova] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Received event network-vif-plugged-98016144-4b95-4e94-8ae4-581089fe4f63 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:53:23 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-349a96bc-28b6-4ceb-afeb-0b4f5f416a8e req-06faf714-975a-49da-b3be-2905afc514af service nova] Acquiring lock "a9012673-826b-4be7-a55b-9bb35a227c17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:53:23 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-349a96bc-28b6-4ceb-afeb-0b4f5f416a8e req-06faf714-975a-49da-b3be-2905afc514af service nova] Lock "a9012673-826b-4be7-a55b-9bb35a227c17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:53:23 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-349a96bc-28b6-4ceb-afeb-0b4f5f416a8e req-06faf714-975a-49da-b3be-2905afc514af service nova] Lock "a9012673-826b-4be7-a55b-9bb35a227c17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:53:23 user nova-compute[74190]: DEBUG nova.compute.manager [req-349a96bc-28b6-4ceb-afeb-0b4f5f416a8e req-06faf714-975a-49da-b3be-2905afc514af service nova] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] No waiting events found dispatching network-vif-plugged-98016144-4b95-4e94-8ae4-581089fe4f63 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:53:23 user nova-compute[74190]: WARNING nova.compute.manager [req-349a96bc-28b6-4ceb-afeb-0b4f5f416a8e req-06faf714-975a-49da-b3be-2905afc514af service nova] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Received unexpected event network-vif-plugged-98016144-4b95-4e94-8ae4-581089fe4f63 for instance with vm_state building and task_state spawning.
Oct 18 11:53:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:53:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:53:25 user nova-compute[74190]: DEBUG nova.compute.manager [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Instance event wait completed in 0 seconds for  {{(pid=74190) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 11:53:25 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Guest created on hypervisor {{(pid=74190) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 11:53:25 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Instance spawned successfully.
Oct 18 11:53:25 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 11:53:25 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Found default for hw_cdrom_bus of ide {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:53:25 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Found default for hw_disk_bus of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:53:25 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Found default for hw_input_bus of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:53:25 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Found default for hw_pointer_model of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:53:25 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Found default for hw_video_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:53:25 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Found default for hw_vif_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:53:25 user nova-compute[74190]: DEBUG nova.compute.manager [req-86b7f875-02e4-48b5-9a4f-10f25f70858d req-85605a6e-9a54-4870-866c-ded01ad5657a service nova] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Received event network-vif-plugged-98016144-4b95-4e94-8ae4-581089fe4f63 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:53:25 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-86b7f875-02e4-48b5-9a4f-10f25f70858d req-85605a6e-9a54-4870-866c-ded01ad5657a service nova] Acquiring lock "a9012673-826b-4be7-a55b-9bb35a227c17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:53:25 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-86b7f875-02e4-48b5-9a4f-10f25f70858d req-85605a6e-9a54-4870-866c-ded01ad5657a service nova] Lock "a9012673-826b-4be7-a55b-9bb35a227c17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:53:25 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-86b7f875-02e4-48b5-9a4f-10f25f70858d req-85605a6e-9a54-4870-866c-ded01ad5657a service nova] Lock "a9012673-826b-4be7-a55b-9bb35a227c17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:53:25 user nova-compute[74190]: DEBUG nova.compute.manager [req-86b7f875-02e4-48b5-9a4f-10f25f70858d req-85605a6e-9a54-4870-866c-ded01ad5657a service nova] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] No waiting events found dispatching network-vif-plugged-98016144-4b95-4e94-8ae4-581089fe4f63 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:53:25 user nova-compute[74190]: WARNING nova.compute.manager [req-86b7f875-02e4-48b5-9a4f-10f25f70858d req-85605a6e-9a54-4870-866c-ded01ad5657a service nova] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Received unexpected event network-vif-plugged-98016144-4b95-4e94-8ae4-581089fe4f63 for instance with vm_state building and task_state spawning.
Oct 18 11:53:25 user nova-compute[74190]: INFO nova.compute.manager [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Took 4.99 seconds to spawn the instance on the hypervisor.
Oct 18 11:53:25 user nova-compute[74190]: DEBUG nova.compute.manager [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Checking state {{(pid=74190) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 11:53:25 user nova-compute[74190]: INFO nova.compute.manager [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Took 24.01 seconds to build instance.
Oct 18 11:53:25 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-e32936b5-66c1-4049-90ff-2c41f9a82349 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lock "a9012673-826b-4be7-a55b-9bb35a227c17" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.145s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:53:26 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:53:31 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:53:31 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:53:31 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74190) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 11:53:31 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 11:53:31 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 11:53:31 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:53:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:53:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:53:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74190) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 11:53:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 11:53:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 11:53:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:53:39 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:53:41 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:53:44 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:53:46 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:53:47 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:53:47 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:53:49 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:53:50 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:53:51 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:53:54 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:53:56 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:53:56 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:53:57 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:53:57 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:53:57 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:53:57 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74190) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 11:53:58 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:53:59 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:53:59 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-dc356042-71a4-4358-ae08-a5438d0f55ee tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Acquiring lock "95ca0697-22b5-4109-868f-ca5556015a1f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:53:59 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-dc356042-71a4-4358-ae08-a5438d0f55ee tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lock "95ca0697-22b5-4109-868f-ca5556015a1f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:53:59 user nova-compute[74190]: DEBUG nova.compute.manager [None req-dc356042-71a4-4358-ae08-a5438d0f55ee tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] Starting instance... {{(pid=74190) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 11:53:59 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-dc356042-71a4-4358-ae08-a5438d0f55ee tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:53:59 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-dc356042-71a4-4358-ae08-a5438d0f55ee tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:53:59 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-dc356042-71a4-4358-ae08-a5438d0f55ee tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74190) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 11:53:59 user nova-compute[74190]: INFO nova.compute.claims [None req-dc356042-71a4-4358-ae08-a5438d0f55ee tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] Claim successful on node user
Oct 18 11:53:59 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:00 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-dc356042-71a4-4358-ae08-a5438d0f55ee tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 11:54:00 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-dc356042-71a4-4358-ae08-a5438d0f55ee tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 11:54:00 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:54:00 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:54:00 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-dc356042-71a4-4358-ae08-a5438d0f55ee tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.469s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:54:00 user nova-compute[74190]: DEBUG nova.compute.manager [None req-dc356042-71a4-4358-ae08-a5438d0f55ee tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] Start building networks asynchronously for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 11:54:00 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:54:00 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:54:00 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:54:00 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Auditing locally available compute resources for user (node: user) {{(pid=74190) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 11:54:00 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-f61ebfd3-16e3-439f-af45-e7eb40916b72 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Acquiring lock "42413a94-9973-4e8d-83b6-207a4e7847c1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:54:00 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-f61ebfd3-16e3-439f-af45-e7eb40916b72 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lock "42413a94-9973-4e8d-83b6-207a4e7847c1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:54:00 user nova-compute[74190]: DEBUG nova.compute.manager [None req-f61ebfd3-16e3-439f-af45-e7eb40916b72 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 42413a94-9973-4e8d-83b6-207a4e7847c1] Starting instance... {{(pid=74190) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 11:54:00 user nova-compute[74190]: DEBUG nova.compute.manager [None req-dc356042-71a4-4358-ae08-a5438d0f55ee tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] Allocating IP information in the background. {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 11:54:00 user nova-compute[74190]: DEBUG nova.network.neutron [None req-dc356042-71a4-4358-ae08-a5438d0f55ee tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] allocate_for_instance() {{(pid=74190) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 11:54:00 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-dc356042-71a4-4358-ae08-a5438d0f55ee tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 11:54:00 user nova-compute[74190]: DEBUG nova.compute.manager [None req-dc356042-71a4-4358-ae08-a5438d0f55ee tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] Start building block device mappings for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 11:54:00 user nova-compute[74190]: DEBUG nova.policy [None req-dc356042-71a4-4358-ae08-a5438d0f55ee tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9db2d65206e24d0aa1428b9bcaa0a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa18c02b8a4117ab1ccc52aca64f06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74190) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 11:54:00 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-f61ebfd3-16e3-439f-af45-e7eb40916b72 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:54:00 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-f61ebfd3-16e3-439f-af45-e7eb40916b72 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:54:00 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-f61ebfd3-16e3-439f-af45-e7eb40916b72 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74190) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 11:54:00 user nova-compute[74190]: INFO nova.compute.claims [None req-f61ebfd3-16e3-439f-af45-e7eb40916b72 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 42413a94-9973-4e8d-83b6-207a4e7847c1] Claim successful on node user
Oct 18 11:54:00 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eec9cde-3553-4fc8-9162-cda963d1a81e/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:00 user nova-compute[74190]: DEBUG nova.compute.manager [None req-dc356042-71a4-4358-ae08-a5438d0f55ee tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] Start spawning the instance on the hypervisor. {{(pid=74190) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 11:54:00 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-dc356042-71a4-4358-ae08-a5438d0f55ee tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] Creating instance directory {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 11:54:00 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-dc356042-71a4-4358-ae08-a5438d0f55ee tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] Creating image(s)
Oct 18 11:54:00 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-dc356042-71a4-4358-ae08-a5438d0f55ee tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Acquiring lock "/opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:54:00 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-dc356042-71a4-4358-ae08-a5438d0f55ee tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lock "/opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:54:00 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-dc356042-71a4-4358-ae08-a5438d0f55ee tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lock "/opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:54:00 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-dc356042-71a4-4358-ae08-a5438d0f55ee tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:00 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eec9cde-3553-4fc8-9162-cda963d1a81e/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:00 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eec9cde-3553-4fc8-9162-cda963d1a81e/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:00 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-dc356042-71a4-4358-ae08-a5438d0f55ee tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.188s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:00 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-dc356042-71a4-4358-ae08-a5438d0f55ee tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Acquiring lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:54:00 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-dc356042-71a4-4358-ae08-a5438d0f55ee tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:54:00 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-dc356042-71a4-4358-ae08-a5438d0f55ee tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:00 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eec9cde-3553-4fc8-9162-cda963d1a81e/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:00 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b200eb6a-be24-4a8f-be23-4e36f7b7b26e/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:00 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-dc356042-71a4-4358-ae08-a5438d0f55ee tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.196s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:00 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-dc356042-71a4-4358-ae08-a5438d0f55ee tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f,backing_fmt=raw /opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/disk 1073741824 {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:00 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-dc356042-71a4-4358-ae08-a5438d0f55ee tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f,backing_fmt=raw /opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/disk 1073741824" returned: 0 in 0.063s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:00 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-dc356042-71a4-4358-ae08-a5438d0f55ee tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:54:00 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-dc356042-71a4-4358-ae08-a5438d0f55ee tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:00 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b200eb6a-be24-4a8f-be23-4e36f7b7b26e/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:00 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b200eb6a-be24-4a8f-be23-4e36f7b7b26e/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:00 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-f61ebfd3-16e3-439f-af45-e7eb40916b72 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 11:54:01 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-f61ebfd3-16e3-439f-af45-e7eb40916b72 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 11:54:01 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-dc356042-71a4-4358-ae08-a5438d0f55ee tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.220s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:01 user nova-compute[74190]: DEBUG nova.virt.disk.api [None req-dc356042-71a4-4358-ae08-a5438d0f55ee tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Checking if we can resize image /opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/disk. size=1073741824 {{(pid=74190) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 18 11:54:01 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-dc356042-71a4-4358-ae08-a5438d0f55ee tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:01 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-f61ebfd3-16e3-439f-af45-e7eb40916b72 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.809s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:54:01 user nova-compute[74190]: DEBUG nova.compute.manager [None req-f61ebfd3-16e3-439f-af45-e7eb40916b72 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 42413a94-9973-4e8d-83b6-207a4e7847c1] Start building networks asynchronously for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 11:54:01 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b200eb6a-be24-4a8f-be23-4e36f7b7b26e/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:01 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 11:54:01 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47ed3fb0-c159-484f-8380-79b5564d0ac1/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:01 user nova-compute[74190]: DEBUG nova.network.neutron [None req-dc356042-71a4-4358-ae08-a5438d0f55ee tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] Successfully created port: 58c81983-46ab-4026-b712-775ae319a09f {{(pid=74190) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 11:54:01 user nova-compute[74190]: DEBUG nova.compute.manager [None req-f61ebfd3-16e3-439f-af45-e7eb40916b72 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 42413a94-9973-4e8d-83b6-207a4e7847c1] Allocating IP information in the background. {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 11:54:01 user nova-compute[74190]: DEBUG nova.network.neutron [None req-f61ebfd3-16e3-439f-af45-e7eb40916b72 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 42413a94-9973-4e8d-83b6-207a4e7847c1] allocate_for_instance() {{(pid=74190) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 11:54:01 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-f61ebfd3-16e3-439f-af45-e7eb40916b72 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 42413a94-9973-4e8d-83b6-207a4e7847c1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 11:54:01 user nova-compute[74190]: DEBUG nova.compute.manager [None req-f61ebfd3-16e3-439f-af45-e7eb40916b72 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 42413a94-9973-4e8d-83b6-207a4e7847c1] Start building block device mappings for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 11:54:01 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-dc356042-71a4-4358-ae08-a5438d0f55ee tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:01 user nova-compute[74190]: DEBUG nova.virt.disk.api [None req-dc356042-71a4-4358-ae08-a5438d0f55ee tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Cannot resize image /opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/disk to a smaller size. {{(pid=74190) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 18 11:54:01 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-dc356042-71a4-4358-ae08-a5438d0f55ee tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] Created local disks {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 11:54:01 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-dc356042-71a4-4358-ae08-a5438d0f55ee tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] Ensure instance console log exists: /opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/console.log {{(pid=74190) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 11:54:01 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-dc356042-71a4-4358-ae08-a5438d0f55ee tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:54:01 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-dc356042-71a4-4358-ae08-a5438d0f55ee tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:54:01 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-dc356042-71a4-4358-ae08-a5438d0f55ee tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:54:01 user nova-compute[74190]: DEBUG nova.policy [None req-f61ebfd3-16e3-439f-af45-e7eb40916b72 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9db2d65206e24d0aa1428b9bcaa0a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa18c02b8a4117ab1ccc52aca64f06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74190) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 11:54:01 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47ed3fb0-c159-484f-8380-79b5564d0ac1/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:01 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47ed3fb0-c159-484f-8380-79b5564d0ac1/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:01 user nova-compute[74190]: DEBUG nova.compute.manager [None req-f61ebfd3-16e3-439f-af45-e7eb40916b72 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 42413a94-9973-4e8d-83b6-207a4e7847c1] Start spawning the instance on the hypervisor. {{(pid=74190) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 11:54:01 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-f61ebfd3-16e3-439f-af45-e7eb40916b72 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 42413a94-9973-4e8d-83b6-207a4e7847c1] Creating instance directory {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 11:54:01 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-f61ebfd3-16e3-439f-af45-e7eb40916b72 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 42413a94-9973-4e8d-83b6-207a4e7847c1] Creating image(s)
Oct 18 11:54:01 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-f61ebfd3-16e3-439f-af45-e7eb40916b72 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Acquiring lock "/opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:54:01 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-f61ebfd3-16e3-439f-af45-e7eb40916b72 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lock "/opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:54:01 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-f61ebfd3-16e3-439f-af45-e7eb40916b72 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lock "/opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:54:01 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-f61ebfd3-16e3-439f-af45-e7eb40916b72 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:01 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47ed3fb0-c159-484f-8380-79b5564d0ac1/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:01 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0209c824-88a7-4976-83bf-8a72437f0cc2/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:01 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-f61ebfd3-16e3-439f-af45-e7eb40916b72 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.205s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:01 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-f61ebfd3-16e3-439f-af45-e7eb40916b72 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Acquiring lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:54:01 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-f61ebfd3-16e3-439f-af45-e7eb40916b72 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:54:01 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-f61ebfd3-16e3-439f-af45-e7eb40916b72 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:01 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0209c824-88a7-4976-83bf-8a72437f0cc2/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:01 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0209c824-88a7-4976-83bf-8a72437f0cc2/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:01 user nova-compute[74190]: DEBUG nova.network.neutron [None req-dc356042-71a4-4358-ae08-a5438d0f55ee tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] Successfully updated port: 58c81983-46ab-4026-b712-775ae319a09f {{(pid=74190) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 11:54:01 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-f61ebfd3-16e3-439f-af45-e7eb40916b72 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.209s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:01 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-f61ebfd3-16e3-439f-af45-e7eb40916b72 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f,backing_fmt=raw /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk 1073741824 {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:01 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-dc356042-71a4-4358-ae08-a5438d0f55ee tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Acquiring lock "refresh_cache-95ca0697-22b5-4109-868f-ca5556015a1f" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:54:01 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-dc356042-71a4-4358-ae08-a5438d0f55ee tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Acquired lock "refresh_cache-95ca0697-22b5-4109-868f-ca5556015a1f" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:54:01 user nova-compute[74190]: DEBUG nova.network.neutron [None req-dc356042-71a4-4358-ae08-a5438d0f55ee tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] Building network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 11:54:01 user nova-compute[74190]: DEBUG nova.compute.manager [req-0c3cb385-7a43-475e-9278-fd340b04a30e req-946a2885-9491-4e74-8c76-c9c946ab9974 service nova] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] Received event network-changed-58c81983-46ab-4026-b712-775ae319a09f {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:54:01 user nova-compute[74190]: DEBUG nova.compute.manager [req-0c3cb385-7a43-475e-9278-fd340b04a30e req-946a2885-9491-4e74-8c76-c9c946ab9974 service nova] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] Refreshing instance network info cache due to event network-changed-58c81983-46ab-4026-b712-775ae319a09f. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 11:54:01 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-0c3cb385-7a43-475e-9278-fd340b04a30e req-946a2885-9491-4e74-8c76-c9c946ab9974 service nova] Acquiring lock "refresh_cache-95ca0697-22b5-4109-868f-ca5556015a1f" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:54:01 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-f61ebfd3-16e3-439f-af45-e7eb40916b72 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f,backing_fmt=raw /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk 1073741824" returned: 0 in 0.054s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:01 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-f61ebfd3-16e3-439f-af45-e7eb40916b72 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:54:01 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-f61ebfd3-16e3-439f-af45-e7eb40916b72 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:01 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0209c824-88a7-4976-83bf-8a72437f0cc2/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:01 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdfe420d-f46c-44ad-8773-b675f42e24ed/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:02 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:02 user nova-compute[74190]: DEBUG nova.network.neutron [None req-dc356042-71a4-4358-ae08-a5438d0f55ee tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] Instance cache missing network info. {{(pid=74190) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 11:54:02 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-f61ebfd3-16e3-439f-af45-e7eb40916b72 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.265s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:02 user nova-compute[74190]: DEBUG nova.virt.disk.api [None req-f61ebfd3-16e3-439f-af45-e7eb40916b72 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Checking if we can resize image /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk. size=1073741824 {{(pid=74190) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 18 11:54:02 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-f61ebfd3-16e3-439f-af45-e7eb40916b72 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:02 user nova-compute[74190]: DEBUG nova.network.neutron [None req-f61ebfd3-16e3-439f-af45-e7eb40916b72 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 42413a94-9973-4e8d-83b6-207a4e7847c1] Successfully created port: 1bad07b8-897d-4280-9eac-ea800fd1cf5a {{(pid=74190) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 11:54:02 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdfe420d-f46c-44ad-8773-b675f42e24ed/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:02 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdfe420d-f46c-44ad-8773-b675f42e24ed/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:02 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-f61ebfd3-16e3-439f-af45-e7eb40916b72 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:02 user nova-compute[74190]: DEBUG nova.virt.disk.api [None req-f61ebfd3-16e3-439f-af45-e7eb40916b72 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Cannot resize image /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk to a smaller size. {{(pid=74190) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 18 11:54:02 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-f61ebfd3-16e3-439f-af45-e7eb40916b72 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 42413a94-9973-4e8d-83b6-207a4e7847c1] Created local disks {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 11:54:02 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-f61ebfd3-16e3-439f-af45-e7eb40916b72 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 42413a94-9973-4e8d-83b6-207a4e7847c1] Ensure instance console log exists: /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/console.log {{(pid=74190) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 11:54:02 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-f61ebfd3-16e3-439f-af45-e7eb40916b72 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:54:02 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-f61ebfd3-16e3-439f-af45-e7eb40916b72 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:54:02 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-f61ebfd3-16e3-439f-af45-e7eb40916b72 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:54:02 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdfe420d-f46c-44ad-8773-b675f42e24ed/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:02 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 11:54:02 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:02 user nova-compute[74190]: DEBUG nova.network.neutron [None req-dc356042-71a4-4358-ae08-a5438d0f55ee tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] Updating instance_info_cache with network_info: [{"id": "58c81983-46ab-4026-b712-775ae319a09f", "address": "fa:16:3e:dd:c9:17", "network": {"id": "130f7948-11e4-49b4-9d4a-dffb2b48bdcd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595419292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ffa18c02b8a4117ab1ccc52aca64f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58c81983-46", "ovs_interfaceid": "58c81983-46ab-4026-b712-775ae319a09f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:54:02 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-dc356042-71a4-4358-ae08-a5438d0f55ee tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Releasing lock "refresh_cache-95ca0697-22b5-4109-868f-ca5556015a1f" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:54:02 user nova-compute[74190]: DEBUG nova.compute.manager [None req-dc356042-71a4-4358-ae08-a5438d0f55ee tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] Instance network_info: |[{"id": "58c81983-46ab-4026-b712-775ae319a09f", "address": "fa:16:3e:dd:c9:17", "network": {"id": "130f7948-11e4-49b4-9d4a-dffb2b48bdcd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595419292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ffa18c02b8a4117ab1ccc52aca64f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58c81983-46", "ovs_interfaceid": "58c81983-46ab-4026-b712-775ae319a09f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 11:54:02 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-0c3cb385-7a43-475e-9278-fd340b04a30e req-946a2885-9491-4e74-8c76-c9c946ab9974 service nova] Acquired lock "refresh_cache-95ca0697-22b5-4109-868f-ca5556015a1f" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:54:02 user nova-compute[74190]: DEBUG nova.network.neutron [req-0c3cb385-7a43-475e-9278-fd340b04a30e req-946a2885-9491-4e74-8c76-c9c946ab9974 service nova] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] Refreshing network info cache for port 58c81983-46ab-4026-b712-775ae319a09f {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 11:54:02 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-dc356042-71a4-4358-ae08-a5438d0f55ee tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] Start _get_guest_xml network_info=[{"id": "58c81983-46ab-4026-b712-775ae319a09f", "address": "fa:16:3e:dd:c9:17", "network": {"id": "130f7948-11e4-49b4-9d4a-dffb2b48bdcd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595419292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ffa18c02b8a4117ab1ccc52aca64f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58c81983-46", "ovs_interfaceid": "58c81983-46ab-4026-b712-775ae319a09f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'image_id': '6e88bbf0-6e78-49a8-b3c5-9453d22a89df'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 11:54:02 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-dc356042-71a4-4358-ae08-a5438d0f55ee tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:54:02 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-dc356042-71a4-4358-ae08-a5438d0f55ee tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:54:02 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-dc356042-71a4-4358-ae08-a5438d0f55ee tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 11:54:02 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-dc356042-71a4-4358-ae08-a5438d0f55ee tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] CPU controller missing on host. {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 11:54:02 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-dc356042-71a4-4358-ae08-a5438d0f55ee tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 11:54:02 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-dc356042-71a4-4358-ae08-a5438d0f55ee tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] CPU controller found on host. {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 11:54:02 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-dc356042-71a4-4358-ae08-a5438d0f55ee tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74190) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 11:54:02 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-dc356042-71a4-4358-ae08-a5438d0f55ee tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T11:37:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 11:54:02 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-dc356042-71a4-4358-ae08-a5438d0f55ee tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Flavor limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 11:54:02 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-dc356042-71a4-4358-ae08-a5438d0f55ee tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Image limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 11:54:02 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-dc356042-71a4-4358-ae08-a5438d0f55ee tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Flavor pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 11:54:02 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-dc356042-71a4-4358-ae08-a5438d0f55ee tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Image pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 11:54:02 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-dc356042-71a4-4358-ae08-a5438d0f55ee tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 11:54:02 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-dc356042-71a4-4358-ae08-a5438d0f55ee tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 11:54:02 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-dc356042-71a4-4358-ae08-a5438d0f55ee tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 11:54:02 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-dc356042-71a4-4358-ae08-a5438d0f55ee tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Got 1 possible topologies {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 11:54:02 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-dc356042-71a4-4358-ae08-a5438d0f55ee tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 11:54:02 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-dc356042-71a4-4358-ae08-a5438d0f55ee tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 11:54:02 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-dc356042-71a4-4358-ae08-a5438d0f55ee tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:53:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1133778819',display_name='tempest-ServerRescueNegativeTestJSON-server-1133778819',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1133778819',id=24,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ffa18c02b8a4117ab1ccc52aca64f06',ramdisk_id='',reservation_id='r-nbj7z5hd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1266902394',owner_user_name='tempest-ServerRescueNegativeTestJSON-1266902394-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:54:00Z,user_data=None,user_id='9db2d65206e24d0aa1428b9bcaa0a86e',uuid=95ca0697-22b5-4109-868f-ca5556015a1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "58c81983-46ab-4026-b712-775ae319a09f", "address": "fa:16:3e:dd:c9:17", "network": {"id": "130f7948-11e4-49b4-9d4a-dffb2b48bdcd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595419292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ffa18c02b8a4117ab1ccc52aca64f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58c81983-46", "ovs_interfaceid": "58c81983-46ab-4026-b712-775ae319a09f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74190) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 11:54:02 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-dc356042-71a4-4358-ae08-a5438d0f55ee tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Converting VIF {"id": "58c81983-46ab-4026-b712-775ae319a09f", "address": "fa:16:3e:dd:c9:17", "network": {"id": "130f7948-11e4-49b4-9d4a-dffb2b48bdcd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595419292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ffa18c02b8a4117ab1ccc52aca64f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58c81983-46", "ovs_interfaceid": "58c81983-46ab-4026-b712-775ae319a09f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:54:02 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-dc356042-71a4-4358-ae08-a5438d0f55ee tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:c9:17,bridge_name='br-int',has_traffic_filtering=True,id=58c81983-46ab-4026-b712-775ae319a09f,network=Network(130f7948-11e4-49b4-9d4a-dffb2b48bdcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58c81983-46') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:54:02 user nova-compute[74190]: DEBUG nova.objects.instance [None req-dc356042-71a4-4358-ae08-a5438d0f55ee tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lazy-loading 'pci_devices' on Instance uuid 95ca0697-22b5-4109-868f-ca5556015a1f {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:54:02 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-dc356042-71a4-4358-ae08-a5438d0f55ee tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] End _get_guest_xml xml=<domain type="kvm">
Oct 18 11:54:02 user nova-compute[74190]:   <uuid>95ca0697-22b5-4109-868f-ca5556015a1f</uuid>
Oct 18 11:54:02 user nova-compute[74190]:   <name>instance-00000018</name>
Oct 18 11:54:02 user nova-compute[74190]:   <memory>524288</memory>
Oct 18 11:54:02 user nova-compute[74190]:   <vcpu>1</vcpu>
Oct 18 11:54:02 user nova-compute[74190]:   <metadata>
Oct 18 11:54:02 user nova-compute[74190]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 11:54:02 user nova-compute[74190]:       <nova:package version="0.0.0"/>
Oct 18 11:54:02 user nova-compute[74190]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1133778819</nova:name>
Oct 18 11:54:02 user nova-compute[74190]:       <nova:creationTime>2023-10-18 11:54:02</nova:creationTime>
Oct 18 11:54:02 user nova-compute[74190]:       <nova:flavor name="m1.tiny">
Oct 18 11:54:02 user nova-compute[74190]:         <nova:memory>512</nova:memory>
Oct 18 11:54:02 user nova-compute[74190]:         <nova:disk>1</nova:disk>
Oct 18 11:54:02 user nova-compute[74190]:         <nova:swap>0</nova:swap>
Oct 18 11:54:02 user nova-compute[74190]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 11:54:02 user nova-compute[74190]:         <nova:vcpus>1</nova:vcpus>
Oct 18 11:54:02 user nova-compute[74190]:       </nova:flavor>
Oct 18 11:54:02 user nova-compute[74190]:       <nova:owner>
Oct 18 11:54:02 user nova-compute[74190]:         <nova:user uuid="9db2d65206e24d0aa1428b9bcaa0a86e">tempest-ServerRescueNegativeTestJSON-1266902394-project-member</nova:user>
Oct 18 11:54:02 user nova-compute[74190]:         <nova:project uuid="1ffa18c02b8a4117ab1ccc52aca64f06">tempest-ServerRescueNegativeTestJSON-1266902394</nova:project>
Oct 18 11:54:02 user nova-compute[74190]:       </nova:owner>
Oct 18 11:54:02 user nova-compute[74190]:       <nova:root type="image" uuid="6e88bbf0-6e78-49a8-b3c5-9453d22a89df"/>
Oct 18 11:54:02 user nova-compute[74190]:       <nova:ports>
Oct 18 11:54:02 user nova-compute[74190]:         <nova:port uuid="58c81983-46ab-4026-b712-775ae319a09f">
Oct 18 11:54:02 user nova-compute[74190]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 18 11:54:02 user nova-compute[74190]:         </nova:port>
Oct 18 11:54:02 user nova-compute[74190]:       </nova:ports>
Oct 18 11:54:02 user nova-compute[74190]:     </nova:instance>
Oct 18 11:54:02 user nova-compute[74190]:   </metadata>
Oct 18 11:54:02 user nova-compute[74190]:   <sysinfo type="smbios">
Oct 18 11:54:02 user nova-compute[74190]:     <system>
Oct 18 11:54:02 user nova-compute[74190]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 11:54:02 user nova-compute[74190]:       <entry name="product">OpenStack Nova</entry>
Oct 18 11:54:02 user nova-compute[74190]:       <entry name="version">0.0.0</entry>
Oct 18 11:54:02 user nova-compute[74190]:       <entry name="serial">95ca0697-22b5-4109-868f-ca5556015a1f</entry>
Oct 18 11:54:02 user nova-compute[74190]:       <entry name="uuid">95ca0697-22b5-4109-868f-ca5556015a1f</entry>
Oct 18 11:54:02 user nova-compute[74190]:       <entry name="family">Virtual Machine</entry>
Oct 18 11:54:02 user nova-compute[74190]:     </system>
Oct 18 11:54:02 user nova-compute[74190]:   </sysinfo>
Oct 18 11:54:02 user nova-compute[74190]:   <os>
Oct 18 11:54:02 user nova-compute[74190]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 11:54:02 user nova-compute[74190]:     <boot dev="hd"/>
Oct 18 11:54:02 user nova-compute[74190]:     <smbios mode="sysinfo"/>
Oct 18 11:54:02 user nova-compute[74190]:   </os>
Oct 18 11:54:02 user nova-compute[74190]:   <features>
Oct 18 11:54:02 user nova-compute[74190]:     <acpi/>
Oct 18 11:54:02 user nova-compute[74190]:     <apic/>
Oct 18 11:54:02 user nova-compute[74190]:     <vmcoreinfo/>
Oct 18 11:54:02 user nova-compute[74190]:   </features>
Oct 18 11:54:02 user nova-compute[74190]:   <clock offset="utc">
Oct 18 11:54:02 user nova-compute[74190]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 11:54:02 user nova-compute[74190]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 11:54:02 user nova-compute[74190]:     <timer name="hpet" present="no"/>
Oct 18 11:54:02 user nova-compute[74190]:   </clock>
Oct 18 11:54:02 user nova-compute[74190]:   <cpu mode="custom" match="exact">
Oct 18 11:54:02 user nova-compute[74190]:     <model>Nehalem</model>
Oct 18 11:54:02 user nova-compute[74190]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 11:54:02 user nova-compute[74190]:   </cpu>
Oct 18 11:54:02 user nova-compute[74190]:   <devices>
Oct 18 11:54:02 user nova-compute[74190]:     <disk type="file" device="disk">
Oct 18 11:54:02 user nova-compute[74190]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 11:54:02 user nova-compute[74190]:       <source file="/opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/disk"/>
Oct 18 11:54:02 user nova-compute[74190]:       <target dev="vda" bus="virtio"/>
Oct 18 11:54:02 user nova-compute[74190]:     </disk>
Oct 18 11:54:02 user nova-compute[74190]:     <interface type="ethernet">
Oct 18 11:54:02 user nova-compute[74190]:       <mac address="fa:16:3e:dd:c9:17"/>
Oct 18 11:54:02 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:54:02 user nova-compute[74190]:       <mtu size="1442"/>
Oct 18 11:54:02 user nova-compute[74190]:       <target dev="tap58c81983-46"/>
Oct 18 11:54:02 user nova-compute[74190]:     </interface>
Oct 18 11:54:02 user nova-compute[74190]:     <serial type="pty">
Oct 18 11:54:02 user nova-compute[74190]:       <log file="/opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/console.log" append="off"/>
Oct 18 11:54:02 user nova-compute[74190]:     </serial>
Oct 18 11:54:02 user nova-compute[74190]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 11:54:02 user nova-compute[74190]:     <video>
Oct 18 11:54:02 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:54:02 user nova-compute[74190]:     </video>
Oct 18 11:54:02 user nova-compute[74190]:     <rng model="virtio">
Oct 18 11:54:02 user nova-compute[74190]:       <backend model="random">/dev/urandom</backend>
Oct 18 11:54:02 user nova-compute[74190]:     </rng>
Oct 18 11:54:02 user nova-compute[74190]:     <controller type="usb" index="0" model="none"/>
Oct 18 11:54:02 user nova-compute[74190]:     <memballoon model="virtio">
Oct 18 11:54:02 user nova-compute[74190]:       <stats period="10"/>
Oct 18 11:54:02 user nova-compute[74190]:     </memballoon>
Oct 18 11:54:02 user nova-compute[74190]:   </devices>
Oct 18 11:54:02 user nova-compute[74190]: </domain>
Oct 18 11:54:02 user nova-compute[74190]:  {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 11:54:02 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-dc356042-71a4-4358-ae08-a5438d0f55ee tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:53:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1133778819',display_name='tempest-ServerRescueNegativeTestJSON-server-1133778819',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1133778819',id=24,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ffa18c02b8a4117ab1ccc52aca64f06',ramdisk_id='',reservation_id='r-nbj7z5hd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1266902394',owner_user_name='tempest-ServerRescueNegativeTestJSON-1266902394-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:54:00Z,user_data=None,user_id='9db2d65206e24d0aa1428b9bcaa0a86e',uuid=95ca0697-22b5-4109-868f-ca5556015a1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "58c81983-46ab-4026-b712-775ae319a09f", "address": "fa:16:3e:dd:c9:17", "network": {"id": "130f7948-11e4-49b4-9d4a-dffb2b48bdcd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595419292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ffa18c02b8a4117ab1ccc52aca64f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58c81983-46", "ovs_interfaceid": "58c81983-46ab-4026-b712-775ae319a09f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 11:54:02 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-dc356042-71a4-4358-ae08-a5438d0f55ee tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Converting VIF {"id": "58c81983-46ab-4026-b712-775ae319a09f", "address": "fa:16:3e:dd:c9:17", "network": {"id": "130f7948-11e4-49b4-9d4a-dffb2b48bdcd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595419292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ffa18c02b8a4117ab1ccc52aca64f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58c81983-46", "ovs_interfaceid": "58c81983-46ab-4026-b712-775ae319a09f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:54:02 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-dc356042-71a4-4358-ae08-a5438d0f55ee tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:c9:17,bridge_name='br-int',has_traffic_filtering=True,id=58c81983-46ab-4026-b712-775ae319a09f,network=Network(130f7948-11e4-49b4-9d4a-dffb2b48bdcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58c81983-46') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:54:02 user nova-compute[74190]: DEBUG os_vif [None req-dc356042-71a4-4358-ae08-a5438d0f55ee tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:c9:17,bridge_name='br-int',has_traffic_filtering=True,id=58c81983-46ab-4026-b712-775ae319a09f,network=Network(130f7948-11e4-49b4-9d4a-dffb2b48bdcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58c81983-46') {{(pid=74190) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 11:54:02 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:02 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:54:02 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 11:54:02 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:02 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3be31587-91da-582c-b2ef-b9c30a460079', '_type': 'linux-noop'}}, row=False) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:54:02 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:02 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:54:02 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:02 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:02 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:02 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap58c81983-46, may_exist=True, interface_attrs={}) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:54:02 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap58c81983-46, col_values=(('qos', UUID('936e13ff-b6d5-47cb-bd93-d77f5aecc793')),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:54:02 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap58c81983-46, col_values=(('external_ids', {'iface-id': '58c81983-46ab-4026-b712-775ae319a09f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:c9:17', 'vm-uuid': '95ca0697-22b5-4109-868f-ca5556015a1f'}),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:54:02 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:02 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:02 user nova-compute[74190]: INFO os_vif [None req-dc356042-71a4-4358-ae08-a5438d0f55ee tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:c9:17,bridge_name='br-int',has_traffic_filtering=True,id=58c81983-46ab-4026-b712-775ae319a09f,network=Network(130f7948-11e4-49b4-9d4a-dffb2b48bdcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58c81983-46')
Oct 18 11:54:02 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-dc356042-71a4-4358-ae08-a5438d0f55ee tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] No BDM found with device name vda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 11:54:02 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-dc356042-71a4-4358-ae08-a5438d0f55ee tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] No VIF found with MAC fa:16:3e:dd:c9:17, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 11:54:02 user nova-compute[74190]: DEBUG nova.network.neutron [None req-f61ebfd3-16e3-439f-af45-e7eb40916b72 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 42413a94-9973-4e8d-83b6-207a4e7847c1] Successfully updated port: 1bad07b8-897d-4280-9eac-ea800fd1cf5a {{(pid=74190) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 11:54:02 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:02 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 11:54:02 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk.rescue --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:02 user nova-compute[74190]: DEBUG nova.compute.manager [req-45ea8531-8dd5-4009-8d2f-4b9462573dc7 req-54bfa412-c50a-4f86-9500-251ef1013061 service nova] [instance: 42413a94-9973-4e8d-83b6-207a4e7847c1] Received event network-changed-1bad07b8-897d-4280-9eac-ea800fd1cf5a {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:54:02 user nova-compute[74190]: DEBUG nova.compute.manager [req-45ea8531-8dd5-4009-8d2f-4b9462573dc7 req-54bfa412-c50a-4f86-9500-251ef1013061 service nova] [instance: 42413a94-9973-4e8d-83b6-207a4e7847c1] Refreshing instance network info cache due to event network-changed-1bad07b8-897d-4280-9eac-ea800fd1cf5a. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 11:54:02 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-45ea8531-8dd5-4009-8d2f-4b9462573dc7 req-54bfa412-c50a-4f86-9500-251ef1013061 service nova] Acquiring lock "refresh_cache-42413a94-9973-4e8d-83b6-207a4e7847c1" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:54:02 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-45ea8531-8dd5-4009-8d2f-4b9462573dc7 req-54bfa412-c50a-4f86-9500-251ef1013061 service nova] Acquired lock "refresh_cache-42413a94-9973-4e8d-83b6-207a4e7847c1" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:54:02 user nova-compute[74190]: DEBUG nova.network.neutron [req-45ea8531-8dd5-4009-8d2f-4b9462573dc7 req-54bfa412-c50a-4f86-9500-251ef1013061 service nova] [instance: 42413a94-9973-4e8d-83b6-207a4e7847c1] Refreshing network info cache for port 1bad07b8-897d-4280-9eac-ea800fd1cf5a {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 11:54:02 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-f61ebfd3-16e3-439f-af45-e7eb40916b72 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Acquiring lock "refresh_cache-42413a94-9973-4e8d-83b6-207a4e7847c1" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:54:02 user nova-compute[74190]: DEBUG nova.network.neutron [req-45ea8531-8dd5-4009-8d2f-4b9462573dc7 req-54bfa412-c50a-4f86-9500-251ef1013061 service nova] [instance: 42413a94-9973-4e8d-83b6-207a4e7847c1] Instance cache missing network info. {{(pid=74190) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 11:54:02 user nova-compute[74190]: DEBUG nova.network.neutron [req-0c3cb385-7a43-475e-9278-fd340b04a30e req-946a2885-9491-4e74-8c76-c9c946ab9974 service nova] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] Updated VIF entry in instance network info cache for port 58c81983-46ab-4026-b712-775ae319a09f. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 11:54:02 user nova-compute[74190]: DEBUG nova.network.neutron [req-0c3cb385-7a43-475e-9278-fd340b04a30e req-946a2885-9491-4e74-8c76-c9c946ab9974 service nova] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] Updating instance_info_cache with network_info: [{"id": "58c81983-46ab-4026-b712-775ae319a09f", "address": "fa:16:3e:dd:c9:17", "network": {"id": "130f7948-11e4-49b4-9d4a-dffb2b48bdcd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595419292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ffa18c02b8a4117ab1ccc52aca64f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58c81983-46", "ovs_interfaceid": "58c81983-46ab-4026-b712-775ae319a09f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:54:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk.rescue --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:03 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-0c3cb385-7a43-475e-9278-fd340b04a30e req-946a2885-9491-4e74-8c76-c9c946ab9974 service nova] Releasing lock "refresh_cache-95ca0697-22b5-4109-868f-ca5556015a1f" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:54:03 user nova-compute[74190]: DEBUG nova.network.neutron [req-45ea8531-8dd5-4009-8d2f-4b9462573dc7 req-54bfa412-c50a-4f86-9500-251ef1013061 service nova] [instance: 42413a94-9973-4e8d-83b6-207a4e7847c1] Updating instance_info_cache with network_info: [] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:54:03 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-45ea8531-8dd5-4009-8d2f-4b9462573dc7 req-54bfa412-c50a-4f86-9500-251ef1013061 service nova] Releasing lock "refresh_cache-42413a94-9973-4e8d-83b6-207a4e7847c1" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:54:03 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-f61ebfd3-16e3-439f-af45-e7eb40916b72 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Acquired lock "refresh_cache-42413a94-9973-4e8d-83b6-207a4e7847c1" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:54:03 user nova-compute[74190]: DEBUG nova.network.neutron [None req-f61ebfd3-16e3-439f-af45-e7eb40916b72 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 42413a94-9973-4e8d-83b6-207a4e7847c1] Building network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 11:54:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d90a6ca0-19a6-4221-81b7-0cb05d67f38e/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:03 user nova-compute[74190]: DEBUG nova.network.neutron [None req-f61ebfd3-16e3-439f-af45-e7eb40916b72 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 42413a94-9973-4e8d-83b6-207a4e7847c1] Instance cache missing network info. {{(pid=74190) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 11:54:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d90a6ca0-19a6-4221-81b7-0cb05d67f38e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d90a6ca0-19a6-4221-81b7-0cb05d67f38e/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:03 user nova-compute[74190]: DEBUG nova.network.neutron [None req-f61ebfd3-16e3-439f-af45-e7eb40916b72 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 42413a94-9973-4e8d-83b6-207a4e7847c1] Updating instance_info_cache with network_info: [{"id": "1bad07b8-897d-4280-9eac-ea800fd1cf5a", "address": "fa:16:3e:0f:dd:a5", "network": {"id": "130f7948-11e4-49b4-9d4a-dffb2b48bdcd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595419292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ffa18c02b8a4117ab1ccc52aca64f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bad07b8-89", "ovs_interfaceid": "1bad07b8-897d-4280-9eac-ea800fd1cf5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:54:03 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-f61ebfd3-16e3-439f-af45-e7eb40916b72 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Releasing lock "refresh_cache-42413a94-9973-4e8d-83b6-207a4e7847c1" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:54:03 user nova-compute[74190]: DEBUG nova.compute.manager [None req-f61ebfd3-16e3-439f-af45-e7eb40916b72 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 42413a94-9973-4e8d-83b6-207a4e7847c1] Instance network_info: |[{"id": "1bad07b8-897d-4280-9eac-ea800fd1cf5a", "address": "fa:16:3e:0f:dd:a5", "network": {"id": "130f7948-11e4-49b4-9d4a-dffb2b48bdcd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595419292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ffa18c02b8a4117ab1ccc52aca64f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bad07b8-89", "ovs_interfaceid": "1bad07b8-897d-4280-9eac-ea800fd1cf5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 11:54:03 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-f61ebfd3-16e3-439f-af45-e7eb40916b72 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 42413a94-9973-4e8d-83b6-207a4e7847c1] Start _get_guest_xml network_info=[{"id": "1bad07b8-897d-4280-9eac-ea800fd1cf5a", "address": "fa:16:3e:0f:dd:a5", "network": {"id": "130f7948-11e4-49b4-9d4a-dffb2b48bdcd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595419292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ffa18c02b8a4117ab1ccc52aca64f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bad07b8-89", "ovs_interfaceid": "1bad07b8-897d-4280-9eac-ea800fd1cf5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'image_id': '6e88bbf0-6e78-49a8-b3c5-9453d22a89df'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 11:54:03 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-f61ebfd3-16e3-439f-af45-e7eb40916b72 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:54:03 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-f61ebfd3-16e3-439f-af45-e7eb40916b72 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:54:03 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-f61ebfd3-16e3-439f-af45-e7eb40916b72 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 11:54:03 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-f61ebfd3-16e3-439f-af45-e7eb40916b72 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] CPU controller missing on host. {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 11:54:03 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-f61ebfd3-16e3-439f-af45-e7eb40916b72 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 11:54:03 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-f61ebfd3-16e3-439f-af45-e7eb40916b72 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] CPU controller found on host. {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 11:54:03 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-f61ebfd3-16e3-439f-af45-e7eb40916b72 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74190) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 11:54:03 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-f61ebfd3-16e3-439f-af45-e7eb40916b72 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T11:37:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 11:54:03 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-f61ebfd3-16e3-439f-af45-e7eb40916b72 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Flavor limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 11:54:03 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-f61ebfd3-16e3-439f-af45-e7eb40916b72 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Image limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 11:54:03 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-f61ebfd3-16e3-439f-af45-e7eb40916b72 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Flavor pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 11:54:03 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-f61ebfd3-16e3-439f-af45-e7eb40916b72 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Image pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 11:54:03 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-f61ebfd3-16e3-439f-af45-e7eb40916b72 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 11:54:03 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-f61ebfd3-16e3-439f-af45-e7eb40916b72 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 11:54:03 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-f61ebfd3-16e3-439f-af45-e7eb40916b72 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 11:54:03 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-f61ebfd3-16e3-439f-af45-e7eb40916b72 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Got 1 possible topologies {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 11:54:03 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-f61ebfd3-16e3-439f-af45-e7eb40916b72 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 11:54:03 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-f61ebfd3-16e3-439f-af45-e7eb40916b72 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 11:54:03 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-f61ebfd3-16e3-439f-af45-e7eb40916b72 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:53:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1737897040',display_name='tempest-ServerRescueNegativeTestJSON-server-1737897040',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1737897040',id=25,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ffa18c02b8a4117ab1ccc52aca64f06',ramdisk_id='',reservation_id='r-4ho14m2i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1266902394',owner_user_name='tempest-ServerRescueNegativeTestJSON-1266902394-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:54:01Z,user_data=None,user_id='9db2d65206e24d0aa1428b9bcaa0a86e',uuid=42413a94-9973-4e8d-83b6-207a4e7847c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1bad07b8-897d-4280-9eac-ea800fd1cf5a", "address": "fa:16:3e:0f:dd:a5", "network": {"id": "130f7948-11e4-49b4-9d4a-dffb2b48bdcd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595419292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ffa18c02b8a4117ab1ccc52aca64f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bad07b8-89", "ovs_interfaceid": "1bad07b8-897d-4280-9eac-ea800fd1cf5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74190) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 11:54:03 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-f61ebfd3-16e3-439f-af45-e7eb40916b72 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Converting VIF {"id": "1bad07b8-897d-4280-9eac-ea800fd1cf5a", "address": "fa:16:3e:0f:dd:a5", "network": {"id": "130f7948-11e4-49b4-9d4a-dffb2b48bdcd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595419292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ffa18c02b8a4117ab1ccc52aca64f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bad07b8-89", "ovs_interfaceid": "1bad07b8-897d-4280-9eac-ea800fd1cf5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:54:03 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-f61ebfd3-16e3-439f-af45-e7eb40916b72 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:dd:a5,bridge_name='br-int',has_traffic_filtering=True,id=1bad07b8-897d-4280-9eac-ea800fd1cf5a,network=Network(130f7948-11e4-49b4-9d4a-dffb2b48bdcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bad07b8-89') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:54:03 user nova-compute[74190]: DEBUG nova.objects.instance [None req-f61ebfd3-16e3-439f-af45-e7eb40916b72 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lazy-loading 'pci_devices' on Instance uuid 42413a94-9973-4e8d-83b6-207a4e7847c1 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:54:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d90a6ca0-19a6-4221-81b7-0cb05d67f38e/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:03 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-f61ebfd3-16e3-439f-af45-e7eb40916b72 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 42413a94-9973-4e8d-83b6-207a4e7847c1] End _get_guest_xml xml=<domain type="kvm">
Oct 18 11:54:03 user nova-compute[74190]:   <uuid>42413a94-9973-4e8d-83b6-207a4e7847c1</uuid>
Oct 18 11:54:03 user nova-compute[74190]:   <name>instance-00000019</name>
Oct 18 11:54:03 user nova-compute[74190]:   <memory>524288</memory>
Oct 18 11:54:03 user nova-compute[74190]:   <vcpu>1</vcpu>
Oct 18 11:54:03 user nova-compute[74190]:   <metadata>
Oct 18 11:54:03 user nova-compute[74190]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 11:54:03 user nova-compute[74190]:       <nova:package version="0.0.0"/>
Oct 18 11:54:03 user nova-compute[74190]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1737897040</nova:name>
Oct 18 11:54:03 user nova-compute[74190]:       <nova:creationTime>2023-10-18 11:54:03</nova:creationTime>
Oct 18 11:54:03 user nova-compute[74190]:       <nova:flavor name="m1.tiny">
Oct 18 11:54:03 user nova-compute[74190]:         <nova:memory>512</nova:memory>
Oct 18 11:54:03 user nova-compute[74190]:         <nova:disk>1</nova:disk>
Oct 18 11:54:03 user nova-compute[74190]:         <nova:swap>0</nova:swap>
Oct 18 11:54:03 user nova-compute[74190]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 11:54:03 user nova-compute[74190]:         <nova:vcpus>1</nova:vcpus>
Oct 18 11:54:03 user nova-compute[74190]:       </nova:flavor>
Oct 18 11:54:03 user nova-compute[74190]:       <nova:owner>
Oct 18 11:54:03 user nova-compute[74190]:         <nova:user uuid="9db2d65206e24d0aa1428b9bcaa0a86e">tempest-ServerRescueNegativeTestJSON-1266902394-project-member</nova:user>
Oct 18 11:54:03 user nova-compute[74190]:         <nova:project uuid="1ffa18c02b8a4117ab1ccc52aca64f06">tempest-ServerRescueNegativeTestJSON-1266902394</nova:project>
Oct 18 11:54:03 user nova-compute[74190]:       </nova:owner>
Oct 18 11:54:03 user nova-compute[74190]:       <nova:root type="image" uuid="6e88bbf0-6e78-49a8-b3c5-9453d22a89df"/>
Oct 18 11:54:03 user nova-compute[74190]:       <nova:ports>
Oct 18 11:54:03 user nova-compute[74190]:         <nova:port uuid="1bad07b8-897d-4280-9eac-ea800fd1cf5a">
Oct 18 11:54:03 user nova-compute[74190]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 18 11:54:03 user nova-compute[74190]:         </nova:port>
Oct 18 11:54:03 user nova-compute[74190]:       </nova:ports>
Oct 18 11:54:03 user nova-compute[74190]:     </nova:instance>
Oct 18 11:54:03 user nova-compute[74190]:   </metadata>
Oct 18 11:54:03 user nova-compute[74190]:   <sysinfo type="smbios">
Oct 18 11:54:03 user nova-compute[74190]:     <system>
Oct 18 11:54:03 user nova-compute[74190]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 11:54:03 user nova-compute[74190]:       <entry name="product">OpenStack Nova</entry>
Oct 18 11:54:03 user nova-compute[74190]:       <entry name="version">0.0.0</entry>
Oct 18 11:54:03 user nova-compute[74190]:       <entry name="serial">42413a94-9973-4e8d-83b6-207a4e7847c1</entry>
Oct 18 11:54:03 user nova-compute[74190]:       <entry name="uuid">42413a94-9973-4e8d-83b6-207a4e7847c1</entry>
Oct 18 11:54:03 user nova-compute[74190]:       <entry name="family">Virtual Machine</entry>
Oct 18 11:54:03 user nova-compute[74190]:     </system>
Oct 18 11:54:03 user nova-compute[74190]:   </sysinfo>
Oct 18 11:54:03 user nova-compute[74190]:   <os>
Oct 18 11:54:03 user nova-compute[74190]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 11:54:03 user nova-compute[74190]:     <boot dev="hd"/>
Oct 18 11:54:03 user nova-compute[74190]:     <smbios mode="sysinfo"/>
Oct 18 11:54:03 user nova-compute[74190]:   </os>
Oct 18 11:54:03 user nova-compute[74190]:   <features>
Oct 18 11:54:03 user nova-compute[74190]:     <acpi/>
Oct 18 11:54:03 user nova-compute[74190]:     <apic/>
Oct 18 11:54:03 user nova-compute[74190]:     <vmcoreinfo/>
Oct 18 11:54:03 user nova-compute[74190]:   </features>
Oct 18 11:54:03 user nova-compute[74190]:   <clock offset="utc">
Oct 18 11:54:03 user nova-compute[74190]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 11:54:03 user nova-compute[74190]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 11:54:03 user nova-compute[74190]:     <timer name="hpet" present="no"/>
Oct 18 11:54:03 user nova-compute[74190]:   </clock>
Oct 18 11:54:03 user nova-compute[74190]:   <cpu mode="custom" match="exact">
Oct 18 11:54:03 user nova-compute[74190]:     <model>Nehalem</model>
Oct 18 11:54:03 user nova-compute[74190]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 11:54:03 user nova-compute[74190]:   </cpu>
Oct 18 11:54:03 user nova-compute[74190]:   <devices>
Oct 18 11:54:03 user nova-compute[74190]:     <disk type="file" device="disk">
Oct 18 11:54:03 user nova-compute[74190]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 11:54:03 user nova-compute[74190]:       <source file="/opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk"/>
Oct 18 11:54:03 user nova-compute[74190]:       <target dev="vda" bus="virtio"/>
Oct 18 11:54:03 user nova-compute[74190]:     </disk>
Oct 18 11:54:03 user nova-compute[74190]:     <interface type="ethernet">
Oct 18 11:54:03 user nova-compute[74190]:       <mac address="fa:16:3e:0f:dd:a5"/>
Oct 18 11:54:03 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:54:03 user nova-compute[74190]:       <mtu size="1442"/>
Oct 18 11:54:03 user nova-compute[74190]:       <target dev="tap1bad07b8-89"/>
Oct 18 11:54:03 user nova-compute[74190]:     </interface>
Oct 18 11:54:03 user nova-compute[74190]:     <serial type="pty">
Oct 18 11:54:03 user nova-compute[74190]:       <log file="/opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/console.log" append="off"/>
Oct 18 11:54:03 user nova-compute[74190]:     </serial>
Oct 18 11:54:03 user nova-compute[74190]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 11:54:03 user nova-compute[74190]:     <video>
Oct 18 11:54:03 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:54:03 user nova-compute[74190]:     </video>
Oct 18 11:54:03 user nova-compute[74190]:     <rng model="virtio">
Oct 18 11:54:03 user nova-compute[74190]:       <backend model="random">/dev/urandom</backend>
Oct 18 11:54:03 user nova-compute[74190]:     </rng>
Oct 18 11:54:03 user nova-compute[74190]:     <controller type="usb" index="0" model="none"/>
Oct 18 11:54:03 user nova-compute[74190]:     <memballoon model="virtio">
Oct 18 11:54:03 user nova-compute[74190]:       <stats period="10"/>
Oct 18 11:54:03 user nova-compute[74190]:     </memballoon>
Oct 18 11:54:03 user nova-compute[74190]:   </devices>
Oct 18 11:54:03 user nova-compute[74190]: </domain>
Oct 18 11:54:03 user nova-compute[74190]:  {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 11:54:03 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-f61ebfd3-16e3-439f-af45-e7eb40916b72 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:53:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1737897040',display_name='tempest-ServerRescueNegativeTestJSON-server-1737897040',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1737897040',id=25,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ffa18c02b8a4117ab1ccc52aca64f06',ramdisk_id='',reservation_id='r-4ho14m2i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1266902394',owner_user_name='tempest-ServerRescueNegativeTestJSON-1266902394-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:54:01Z,user_data=None,user_id='9db2d65206e24d0aa1428b9bcaa0a86e',uuid=42413a94-9973-4e8d-83b6-207a4e7847c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1bad07b8-897d-4280-9eac-ea800fd1cf5a", "address": "fa:16:3e:0f:dd:a5", "network": {"id": "130f7948-11e4-49b4-9d4a-dffb2b48bdcd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595419292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ffa18c02b8a4117ab1ccc52aca64f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bad07b8-89", "ovs_interfaceid": "1bad07b8-897d-4280-9eac-ea800fd1cf5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 11:54:03 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-f61ebfd3-16e3-439f-af45-e7eb40916b72 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Converting VIF {"id": "1bad07b8-897d-4280-9eac-ea800fd1cf5a", "address": "fa:16:3e:0f:dd:a5", "network": {"id": "130f7948-11e4-49b4-9d4a-dffb2b48bdcd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595419292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ffa18c02b8a4117ab1ccc52aca64f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bad07b8-89", "ovs_interfaceid": "1bad07b8-897d-4280-9eac-ea800fd1cf5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:54:03 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-f61ebfd3-16e3-439f-af45-e7eb40916b72 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:dd:a5,bridge_name='br-int',has_traffic_filtering=True,id=1bad07b8-897d-4280-9eac-ea800fd1cf5a,network=Network(130f7948-11e4-49b4-9d4a-dffb2b48bdcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bad07b8-89') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:54:03 user nova-compute[74190]: DEBUG os_vif [None req-f61ebfd3-16e3-439f-af45-e7eb40916b72 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:dd:a5,bridge_name='br-int',has_traffic_filtering=True,id=1bad07b8-897d-4280-9eac-ea800fd1cf5a,network=Network(130f7948-11e4-49b4-9d4a-dffb2b48bdcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bad07b8-89') {{(pid=74190) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 11:54:03 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:03 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:54:03 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 11:54:03 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:03 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '05c9798a-2cf5-5968-b5fa-d3b105bb0229', '_type': 'linux-noop'}}, row=False) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:54:03 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:03 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:54:03 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:03 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:03 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1bad07b8-89, may_exist=True, interface_attrs={}) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:54:03 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1bad07b8-89, col_values=(('qos', UUID('58e10205-33aa-4a8f-9542-43fddd9865a8')),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:54:03 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1bad07b8-89, col_values=(('external_ids', {'iface-id': '1bad07b8-897d-4280-9eac-ea800fd1cf5a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0f:dd:a5', 'vm-uuid': '42413a94-9973-4e8d-83b6-207a4e7847c1'}),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:54:06 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:06 user nova-compute[74190]: DEBUG nova.compute.manager [req-a40ef74b-bc19-476d-a72a-2b3dc278606b req-d1ca203a-bf3b-486e-84af-55ce9966e568 service nova] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] Received event network-vif-plugged-58c81983-46ab-4026-b712-775ae319a09f {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:54:06 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-a40ef74b-bc19-476d-a72a-2b3dc278606b req-d1ca203a-bf3b-486e-84af-55ce9966e568 service nova] Acquiring lock "95ca0697-22b5-4109-868f-ca5556015a1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:54:06 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-a40ef74b-bc19-476d-a72a-2b3dc278606b req-d1ca203a-bf3b-486e-84af-55ce9966e568 service nova] Lock "95ca0697-22b5-4109-868f-ca5556015a1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:54:06 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-a40ef74b-bc19-476d-a72a-2b3dc278606b req-d1ca203a-bf3b-486e-84af-55ce9966e568 service nova] Lock "95ca0697-22b5-4109-868f-ca5556015a1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:54:06 user nova-compute[74190]: DEBUG nova.compute.manager [req-a40ef74b-bc19-476d-a72a-2b3dc278606b req-d1ca203a-bf3b-486e-84af-55ce9966e568 service nova] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] No waiting events found dispatching network-vif-plugged-58c81983-46ab-4026-b712-775ae319a09f {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:54:06 user nova-compute[74190]: WARNING nova.compute.manager [req-a40ef74b-bc19-476d-a72a-2b3dc278606b req-d1ca203a-bf3b-486e-84af-55ce9966e568 service nova] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] Received unexpected event network-vif-plugged-58c81983-46ab-4026-b712-775ae319a09f for instance with vm_state building and task_state spawning.
Oct 18 11:54:06 user nova-compute[74190]: DEBUG nova.compute.manager [req-a40ef74b-bc19-476d-a72a-2b3dc278606b req-d1ca203a-bf3b-486e-84af-55ce9966e568 service nova] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] Received event network-vif-plugged-58c81983-46ab-4026-b712-775ae319a09f {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:54:06 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-a40ef74b-bc19-476d-a72a-2b3dc278606b req-d1ca203a-bf3b-486e-84af-55ce9966e568 service nova] Acquiring lock "95ca0697-22b5-4109-868f-ca5556015a1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:54:06 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-a40ef74b-bc19-476d-a72a-2b3dc278606b req-d1ca203a-bf3b-486e-84af-55ce9966e568 service nova] Lock "95ca0697-22b5-4109-868f-ca5556015a1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:54:06 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-a40ef74b-bc19-476d-a72a-2b3dc278606b req-d1ca203a-bf3b-486e-84af-55ce9966e568 service nova] Lock "95ca0697-22b5-4109-868f-ca5556015a1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:54:06 user nova-compute[74190]: DEBUG nova.compute.manager [req-a40ef74b-bc19-476d-a72a-2b3dc278606b req-d1ca203a-bf3b-486e-84af-55ce9966e568 service nova] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] No waiting events found dispatching network-vif-plugged-58c81983-46ab-4026-b712-775ae319a09f {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:54:06 user nova-compute[74190]: WARNING nova.compute.manager [req-a40ef74b-bc19-476d-a72a-2b3dc278606b req-d1ca203a-bf3b-486e-84af-55ce9966e568 service nova] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] Received unexpected event network-vif-plugged-58c81983-46ab-4026-b712-775ae319a09f for instance with vm_state building and task_state spawning.
Oct 18 11:54:06 user nova-compute[74190]: DEBUG nova.compute.manager [req-f716152d-8160-4f87-8a94-28ddf347f63e req-93c716d7-70ce-4b5e-9fdc-b68e9a0a65d4 service nova] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Received event network-changed-7cee893b-5ac8-45f8-a1f8-5374b49cc3b5 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:54:06 user nova-compute[74190]: DEBUG nova.compute.manager [req-f716152d-8160-4f87-8a94-28ddf347f63e req-93c716d7-70ce-4b5e-9fdc-b68e9a0a65d4 service nova] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Refreshing instance network info cache due to event network-changed-7cee893b-5ac8-45f8-a1f8-5374b49cc3b5. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 11:54:06 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-f716152d-8160-4f87-8a94-28ddf347f63e req-93c716d7-70ce-4b5e-9fdc-b68e9a0a65d4 service nova] Acquiring lock "refresh_cache-4e916d24-9f9d-4289-87ce-f65d2499fcd9" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:54:06 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-f716152d-8160-4f87-8a94-28ddf347f63e req-93c716d7-70ce-4b5e-9fdc-b68e9a0a65d4 service nova] Acquired lock "refresh_cache-4e916d24-9f9d-4289-87ce-f65d2499fcd9" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:54:06 user nova-compute[74190]: DEBUG nova.network.neutron [req-f716152d-8160-4f87-8a94-28ddf347f63e req-93c716d7-70ce-4b5e-9fdc-b68e9a0a65d4 service nova] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Refreshing network info cache for port 7cee893b-5ac8-45f8-a1f8-5374b49cc3b5 {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 11:54:06 user nova-compute[74190]: DEBUG nova.compute.manager [None req-dc356042-71a4-4358-ae08-a5438d0f55ee tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] Instance event wait completed in 0 seconds for  {{(pid=74190) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 11:54:06 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-dc356042-71a4-4358-ae08-a5438d0f55ee tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] Guest created on hypervisor {{(pid=74190) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 11:54:06 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:54:06 user nova-compute[74190]: INFO os_vif [None req-f61ebfd3-16e3-439f-af45-e7eb40916b72 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:dd:a5,bridge_name='br-int',has_traffic_filtering=True,id=1bad07b8-897d-4280-9eac-ea800fd1cf5a,network=Network(130f7948-11e4-49b4-9d4a-dffb2b48bdcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bad07b8-89')
Oct 18 11:54:06 user nova-compute[74190]: INFO nova.compute.manager [None req-a3f9f685-cb9a-4350-a386-1d3b66a0b25b tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Unrescuing
Oct 18 11:54:06 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-a3f9f685-cb9a-4350-a386-1d3b66a0b25b tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Acquiring lock "refresh_cache-4e916d24-9f9d-4289-87ce-f65d2499fcd9" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:54:06 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] Instance spawned successfully.
Oct 18 11:54:06 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-dc356042-71a4-4358-ae08-a5438d0f55ee tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 11:54:06 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:54:06 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:54:06 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Hypervisor/Node resource view: name=user free_ram=7662MB free_disk=25.320758819580078GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74190) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 11:54:06 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:54:06 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:54:06 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-dc356042-71a4-4358-ae08-a5438d0f55ee tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] Found default for hw_cdrom_bus of ide {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:54:06 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-dc356042-71a4-4358-ae08-a5438d0f55ee tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] Found default for hw_disk_bus of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:54:06 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-dc356042-71a4-4358-ae08-a5438d0f55ee tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] Found default for hw_input_bus of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:54:06 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-dc356042-71a4-4358-ae08-a5438d0f55ee tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] Found default for hw_pointer_model of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:54:06 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-dc356042-71a4-4358-ae08-a5438d0f55ee tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] Found default for hw_video_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:54:06 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-dc356042-71a4-4358-ae08-a5438d0f55ee tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] Found default for hw_vif_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:54:06 user nova-compute[74190]: INFO nova.compute.manager [None req-dc356042-71a4-4358-ae08-a5438d0f55ee tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] Took 6.26 seconds to spawn the instance on the hypervisor.
Oct 18 11:54:06 user nova-compute[74190]: DEBUG nova.compute.manager [None req-dc356042-71a4-4358-ae08-a5438d0f55ee tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] Checking state {{(pid=74190) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 11:54:06 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-f61ebfd3-16e3-439f-af45-e7eb40916b72 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] No BDM found with device name vda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 11:54:06 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-f61ebfd3-16e3-439f-af45-e7eb40916b72 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] No VIF found with MAC fa:16:3e:0f:dd:a5, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 11:54:06 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 0209c824-88a7-4976-83bf-8a72437f0cc2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:54:06 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 4e916d24-9f9d-4289-87ce-f65d2499fcd9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:54:06 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance bdfe420d-f46c-44ad-8773-b675f42e24ed actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:54:06 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 47ed3fb0-c159-484f-8380-79b5564d0ac1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:54:06 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 8eec9cde-3553-4fc8-9162-cda963d1a81e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:54:06 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance d90a6ca0-19a6-4221-81b7-0cb05d67f38e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:54:06 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance b200eb6a-be24-4a8f-be23-4e36f7b7b26e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:54:06 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance a9012673-826b-4be7-a55b-9bb35a227c17 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:54:06 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 95ca0697-22b5-4109-868f-ca5556015a1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:54:06 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 42413a94-9973-4e8d-83b6-207a4e7847c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:54:06 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 11:54:06 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 11:54:06 user nova-compute[74190]: INFO nova.compute.manager [None req-dc356042-71a4-4358-ae08-a5438d0f55ee tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] Took 7.15 seconds to build instance.
Oct 18 11:54:06 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-dc356042-71a4-4358-ae08-a5438d0f55ee tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lock "95ca0697-22b5-4109-868f-ca5556015a1f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.277s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:54:07 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 11:54:07 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 11:54:07 user nova-compute[74190]: DEBUG nova.network.neutron [req-f716152d-8160-4f87-8a94-28ddf347f63e req-93c716d7-70ce-4b5e-9fdc-b68e9a0a65d4 service nova] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Updated VIF entry in instance network info cache for port 7cee893b-5ac8-45f8-a1f8-5374b49cc3b5. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 11:54:07 user nova-compute[74190]: DEBUG nova.network.neutron [req-f716152d-8160-4f87-8a94-28ddf347f63e req-93c716d7-70ce-4b5e-9fdc-b68e9a0a65d4 service nova] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Updating instance_info_cache with network_info: [{"id": "7cee893b-5ac8-45f8-a1f8-5374b49cc3b5", "address": "fa:16:3e:15:15:1d", "network": {"id": "4609cfba-1e8b-4740-bdf6-642b196097a3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1019354168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a4f041e58144d54a458a01074eb35a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cee893b-5a", "ovs_interfaceid": "7cee893b-5ac8-45f8-a1f8-5374b49cc3b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:54:07 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-f716152d-8160-4f87-8a94-28ddf347f63e req-93c716d7-70ce-4b5e-9fdc-b68e9a0a65d4 service nova] Releasing lock "refresh_cache-4e916d24-9f9d-4289-87ce-f65d2499fcd9" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:54:07 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Compute_service record updated for user:user {{(pid=74190) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 11:54:07 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.599s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:54:07 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-a3f9f685-cb9a-4350-a386-1d3b66a0b25b tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Acquired lock "refresh_cache-4e916d24-9f9d-4289-87ce-f65d2499fcd9" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:54:07 user nova-compute[74190]: DEBUG nova.network.neutron [None req-a3f9f685-cb9a-4350-a386-1d3b66a0b25b tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Building network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 11:54:07 user nova-compute[74190]: DEBUG nova.network.neutron [None req-a3f9f685-cb9a-4350-a386-1d3b66a0b25b tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Updating instance_info_cache with network_info: [{"id": "7cee893b-5ac8-45f8-a1f8-5374b49cc3b5", "address": "fa:16:3e:15:15:1d", "network": {"id": "4609cfba-1e8b-4740-bdf6-642b196097a3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1019354168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a4f041e58144d54a458a01074eb35a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cee893b-5a", "ovs_interfaceid": "7cee893b-5ac8-45f8-a1f8-5374b49cc3b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:54:07 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-a3f9f685-cb9a-4350-a386-1d3b66a0b25b tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Releasing lock "refresh_cache-4e916d24-9f9d-4289-87ce-f65d2499fcd9" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:54:07 user nova-compute[74190]: DEBUG nova.objects.instance [None req-a3f9f685-cb9a-4350-a386-1d3b66a0b25b tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Lazy-loading 'flavor' on Instance uuid 4e916d24-9f9d-4289-87ce-f65d2499fcd9 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:54:07 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:07 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:07 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:07 user nova-compute[74190]: DEBUG nova.compute.manager [req-5476dafd-d00b-42ab-9037-bc5dc8ec62a1 req-8ac31bec-2387-454c-9a2c-c39965de5fe7 service nova] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Received event network-changed-7cee893b-5ac8-45f8-a1f8-5374b49cc3b5 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:54:07 user nova-compute[74190]: DEBUG nova.compute.manager [req-5476dafd-d00b-42ab-9037-bc5dc8ec62a1 req-8ac31bec-2387-454c-9a2c-c39965de5fe7 service nova] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Refreshing instance network info cache due to event network-changed-7cee893b-5ac8-45f8-a1f8-5374b49cc3b5. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 11:54:07 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-5476dafd-d00b-42ab-9037-bc5dc8ec62a1 req-8ac31bec-2387-454c-9a2c-c39965de5fe7 service nova] Acquiring lock "refresh_cache-4e916d24-9f9d-4289-87ce-f65d2499fcd9" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:54:07 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-5476dafd-d00b-42ab-9037-bc5dc8ec62a1 req-8ac31bec-2387-454c-9a2c-c39965de5fe7 service nova] Acquired lock "refresh_cache-4e916d24-9f9d-4289-87ce-f65d2499fcd9" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:54:07 user nova-compute[74190]: DEBUG nova.network.neutron [req-5476dafd-d00b-42ab-9037-bc5dc8ec62a1 req-8ac31bec-2387-454c-9a2c-c39965de5fe7 service nova] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Refreshing network info cache for port 7cee893b-5ac8-45f8-a1f8-5374b49cc3b5 {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 11:54:07 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:07 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:08 user nova-compute[74190]: DEBUG nova.compute.manager [req-06f4817a-a6af-4e06-bb20-78d667114f06 req-6be611be-eddc-45f8-8d7f-2f0b26e8baf6 service nova] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Received event network-vif-unplugged-7cee893b-5ac8-45f8-a1f8-5374b49cc3b5 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:54:08 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-06f4817a-a6af-4e06-bb20-78d667114f06 req-6be611be-eddc-45f8-8d7f-2f0b26e8baf6 service nova] Acquiring lock "4e916d24-9f9d-4289-87ce-f65d2499fcd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:54:08 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-06f4817a-a6af-4e06-bb20-78d667114f06 req-6be611be-eddc-45f8-8d7f-2f0b26e8baf6 service nova] Lock "4e916d24-9f9d-4289-87ce-f65d2499fcd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:54:08 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-06f4817a-a6af-4e06-bb20-78d667114f06 req-6be611be-eddc-45f8-8d7f-2f0b26e8baf6 service nova] Lock "4e916d24-9f9d-4289-87ce-f65d2499fcd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:54:08 user nova-compute[74190]: DEBUG nova.compute.manager [req-06f4817a-a6af-4e06-bb20-78d667114f06 req-6be611be-eddc-45f8-8d7f-2f0b26e8baf6 service nova] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] No waiting events found dispatching network-vif-unplugged-7cee893b-5ac8-45f8-a1f8-5374b49cc3b5 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:54:08 user nova-compute[74190]: WARNING nova.compute.manager [req-06f4817a-a6af-4e06-bb20-78d667114f06 req-6be611be-eddc-45f8-8d7f-2f0b26e8baf6 service nova] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Received unexpected event network-vif-unplugged-7cee893b-5ac8-45f8-a1f8-5374b49cc3b5 for instance with vm_state rescued and task_state unrescuing.
Oct 18 11:54:08 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:08 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:08 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:08 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:08 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:08 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:08 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Instance destroyed successfully.
Oct 18 11:54:09 user nova-compute[74190]: DEBUG nova.network.neutron [req-5476dafd-d00b-42ab-9037-bc5dc8ec62a1 req-8ac31bec-2387-454c-9a2c-c39965de5fe7 service nova] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Updated VIF entry in instance network info cache for port 7cee893b-5ac8-45f8-a1f8-5374b49cc3b5. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 11:54:09 user nova-compute[74190]: DEBUG nova.network.neutron [req-5476dafd-d00b-42ab-9037-bc5dc8ec62a1 req-8ac31bec-2387-454c-9a2c-c39965de5fe7 service nova] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Updating instance_info_cache with network_info: [{"id": "7cee893b-5ac8-45f8-a1f8-5374b49cc3b5", "address": "fa:16:3e:15:15:1d", "network": {"id": "4609cfba-1e8b-4740-bdf6-642b196097a3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1019354168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a4f041e58144d54a458a01074eb35a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cee893b-5a", "ovs_interfaceid": "7cee893b-5ac8-45f8-a1f8-5374b49cc3b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:54:09 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-5476dafd-d00b-42ab-9037-bc5dc8ec62a1 req-8ac31bec-2387-454c-9a2c-c39965de5fe7 service nova] Releasing lock "refresh_cache-4e916d24-9f9d-4289-87ce-f65d2499fcd9" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:54:09 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:10 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:10 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:10 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:54:10 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:54:10 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Starting heal instance info cache {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 11:54:10 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:10 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "refresh_cache-4e916d24-9f9d-4289-87ce-f65d2499fcd9" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:54:10 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquired lock "refresh_cache-4e916d24-9f9d-4289-87ce-f65d2499fcd9" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:54:10 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Forcefully refreshing network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 18 11:54:10 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:10 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:10 user nova-compute[74190]: DEBUG nova.compute.manager [req-6a1961be-60e7-4e2a-9335-887213b30be1 req-d33f737a-dd5f-4f40-a443-b8d32be984cd service nova] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Received event network-vif-plugged-7cee893b-5ac8-45f8-a1f8-5374b49cc3b5 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:54:10 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-6a1961be-60e7-4e2a-9335-887213b30be1 req-d33f737a-dd5f-4f40-a443-b8d32be984cd service nova] Acquiring lock "4e916d24-9f9d-4289-87ce-f65d2499fcd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:54:10 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-6a1961be-60e7-4e2a-9335-887213b30be1 req-d33f737a-dd5f-4f40-a443-b8d32be984cd service nova] Lock "4e916d24-9f9d-4289-87ce-f65d2499fcd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:54:10 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-6a1961be-60e7-4e2a-9335-887213b30be1 req-d33f737a-dd5f-4f40-a443-b8d32be984cd service nova] Lock "4e916d24-9f9d-4289-87ce-f65d2499fcd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:54:10 user nova-compute[74190]: DEBUG nova.compute.manager [req-6a1961be-60e7-4e2a-9335-887213b30be1 req-d33f737a-dd5f-4f40-a443-b8d32be984cd service nova] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] No waiting events found dispatching network-vif-plugged-7cee893b-5ac8-45f8-a1f8-5374b49cc3b5 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:54:10 user nova-compute[74190]: WARNING nova.compute.manager [req-6a1961be-60e7-4e2a-9335-887213b30be1 req-d33f737a-dd5f-4f40-a443-b8d32be984cd service nova] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Received unexpected event network-vif-plugged-7cee893b-5ac8-45f8-a1f8-5374b49cc3b5 for instance with vm_state rescued and task_state unrescuing.
Oct 18 11:54:10 user nova-compute[74190]: DEBUG nova.compute.manager [req-6a1961be-60e7-4e2a-9335-887213b30be1 req-d33f737a-dd5f-4f40-a443-b8d32be984cd service nova] [instance: 42413a94-9973-4e8d-83b6-207a4e7847c1] Received event network-vif-plugged-1bad07b8-897d-4280-9eac-ea800fd1cf5a {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:54:10 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-6a1961be-60e7-4e2a-9335-887213b30be1 req-d33f737a-dd5f-4f40-a443-b8d32be984cd service nova] Acquiring lock "42413a94-9973-4e8d-83b6-207a4e7847c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:54:10 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-6a1961be-60e7-4e2a-9335-887213b30be1 req-d33f737a-dd5f-4f40-a443-b8d32be984cd service nova] Lock "42413a94-9973-4e8d-83b6-207a4e7847c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:54:10 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-6a1961be-60e7-4e2a-9335-887213b30be1 req-d33f737a-dd5f-4f40-a443-b8d32be984cd service nova] Lock "42413a94-9973-4e8d-83b6-207a4e7847c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:54:10 user nova-compute[74190]: DEBUG nova.compute.manager [req-6a1961be-60e7-4e2a-9335-887213b30be1 req-d33f737a-dd5f-4f40-a443-b8d32be984cd service nova] [instance: 42413a94-9973-4e8d-83b6-207a4e7847c1] No waiting events found dispatching network-vif-plugged-1bad07b8-897d-4280-9eac-ea800fd1cf5a {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:54:10 user nova-compute[74190]: WARNING nova.compute.manager [req-6a1961be-60e7-4e2a-9335-887213b30be1 req-d33f737a-dd5f-4f40-a443-b8d32be984cd service nova] [instance: 42413a94-9973-4e8d-83b6-207a4e7847c1] Received unexpected event network-vif-plugged-1bad07b8-897d-4280-9eac-ea800fd1cf5a for instance with vm_state building and task_state spawning.
Oct 18 11:54:10 user nova-compute[74190]: DEBUG nova.compute.manager [req-6a1961be-60e7-4e2a-9335-887213b30be1 req-d33f737a-dd5f-4f40-a443-b8d32be984cd service nova] [instance: 42413a94-9973-4e8d-83b6-207a4e7847c1] Received event network-vif-plugged-1bad07b8-897d-4280-9eac-ea800fd1cf5a {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:54:10 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-6a1961be-60e7-4e2a-9335-887213b30be1 req-d33f737a-dd5f-4f40-a443-b8d32be984cd service nova] Acquiring lock "42413a94-9973-4e8d-83b6-207a4e7847c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:54:10 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-6a1961be-60e7-4e2a-9335-887213b30be1 req-d33f737a-dd5f-4f40-a443-b8d32be984cd service nova] Lock "42413a94-9973-4e8d-83b6-207a4e7847c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:54:10 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-6a1961be-60e7-4e2a-9335-887213b30be1 req-d33f737a-dd5f-4f40-a443-b8d32be984cd service nova] Lock "42413a94-9973-4e8d-83b6-207a4e7847c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:54:10 user nova-compute[74190]: DEBUG nova.compute.manager [req-6a1961be-60e7-4e2a-9335-887213b30be1 req-d33f737a-dd5f-4f40-a443-b8d32be984cd service nova] [instance: 42413a94-9973-4e8d-83b6-207a4e7847c1] No waiting events found dispatching network-vif-plugged-1bad07b8-897d-4280-9eac-ea800fd1cf5a {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:54:10 user nova-compute[74190]: WARNING nova.compute.manager [req-6a1961be-60e7-4e2a-9335-887213b30be1 req-d33f737a-dd5f-4f40-a443-b8d32be984cd service nova] [instance: 42413a94-9973-4e8d-83b6-207a4e7847c1] Received unexpected event network-vif-plugged-1bad07b8-897d-4280-9eac-ea800fd1cf5a for instance with vm_state building and task_state spawning.
Oct 18 11:54:10 user nova-compute[74190]: DEBUG nova.compute.manager [req-6a1961be-60e7-4e2a-9335-887213b30be1 req-d33f737a-dd5f-4f40-a443-b8d32be984cd service nova] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Received event network-vif-plugged-7cee893b-5ac8-45f8-a1f8-5374b49cc3b5 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:54:10 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-6a1961be-60e7-4e2a-9335-887213b30be1 req-d33f737a-dd5f-4f40-a443-b8d32be984cd service nova] Acquiring lock "4e916d24-9f9d-4289-87ce-f65d2499fcd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:54:10 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-6a1961be-60e7-4e2a-9335-887213b30be1 req-d33f737a-dd5f-4f40-a443-b8d32be984cd service nova] Lock "4e916d24-9f9d-4289-87ce-f65d2499fcd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:54:10 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-6a1961be-60e7-4e2a-9335-887213b30be1 req-d33f737a-dd5f-4f40-a443-b8d32be984cd service nova] Lock "4e916d24-9f9d-4289-87ce-f65d2499fcd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:54:10 user nova-compute[74190]: DEBUG nova.compute.manager [req-6a1961be-60e7-4e2a-9335-887213b30be1 req-d33f737a-dd5f-4f40-a443-b8d32be984cd service nova] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] No waiting events found dispatching network-vif-plugged-7cee893b-5ac8-45f8-a1f8-5374b49cc3b5 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:54:10 user nova-compute[74190]: WARNING nova.compute.manager [req-6a1961be-60e7-4e2a-9335-887213b30be1 req-d33f737a-dd5f-4f40-a443-b8d32be984cd service nova] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Received unexpected event network-vif-plugged-7cee893b-5ac8-45f8-a1f8-5374b49cc3b5 for instance with vm_state rescued and task_state unrescuing.
Oct 18 11:54:10 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:10 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:10 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:10 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:10 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:11 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Updating instance_info_cache with network_info: [{"id": "7cee893b-5ac8-45f8-a1f8-5374b49cc3b5", "address": "fa:16:3e:15:15:1d", "network": {"id": "4609cfba-1e8b-4740-bdf6-642b196097a3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1019354168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a4f041e58144d54a458a01074eb35a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cee893b-5a", "ovs_interfaceid": "7cee893b-5ac8-45f8-a1f8-5374b49cc3b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:54:11 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Releasing lock "refresh_cache-4e916d24-9f9d-4289-87ce-f65d2499fcd9" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:54:11 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Updated the network info_cache for instance {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 18 11:54:11 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:54:11 user nova-compute[74190]: DEBUG nova.compute.manager [None req-f61ebfd3-16e3-439f-af45-e7eb40916b72 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 42413a94-9973-4e8d-83b6-207a4e7847c1] Instance event wait completed in 0 seconds for  {{(pid=74190) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 11:54:11 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-f61ebfd3-16e3-439f-af45-e7eb40916b72 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 42413a94-9973-4e8d-83b6-207a4e7847c1] Guest created on hypervisor {{(pid=74190) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 11:54:11 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 42413a94-9973-4e8d-83b6-207a4e7847c1] Instance spawned successfully.
Oct 18 11:54:11 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-f61ebfd3-16e3-439f-af45-e7eb40916b72 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 42413a94-9973-4e8d-83b6-207a4e7847c1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 11:54:11 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-f61ebfd3-16e3-439f-af45-e7eb40916b72 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 42413a94-9973-4e8d-83b6-207a4e7847c1] Found default for hw_cdrom_bus of ide {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:54:11 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-f61ebfd3-16e3-439f-af45-e7eb40916b72 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 42413a94-9973-4e8d-83b6-207a4e7847c1] Found default for hw_disk_bus of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:54:11 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-f61ebfd3-16e3-439f-af45-e7eb40916b72 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 42413a94-9973-4e8d-83b6-207a4e7847c1] Found default for hw_input_bus of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:54:11 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-f61ebfd3-16e3-439f-af45-e7eb40916b72 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 42413a94-9973-4e8d-83b6-207a4e7847c1] Found default for hw_pointer_model of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:54:11 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-f61ebfd3-16e3-439f-af45-e7eb40916b72 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 42413a94-9973-4e8d-83b6-207a4e7847c1] Found default for hw_video_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:54:11 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-f61ebfd3-16e3-439f-af45-e7eb40916b72 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 42413a94-9973-4e8d-83b6-207a4e7847c1] Found default for hw_vif_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:54:11 user nova-compute[74190]: INFO nova.compute.manager [None req-f61ebfd3-16e3-439f-af45-e7eb40916b72 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 42413a94-9973-4e8d-83b6-207a4e7847c1] Took 10.61 seconds to spawn the instance on the hypervisor.
Oct 18 11:54:11 user nova-compute[74190]: DEBUG nova.compute.manager [None req-f61ebfd3-16e3-439f-af45-e7eb40916b72 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 42413a94-9973-4e8d-83b6-207a4e7847c1] Checking state {{(pid=74190) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 11:54:12 user nova-compute[74190]: INFO nova.compute.manager [None req-f61ebfd3-16e3-439f-af45-e7eb40916b72 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 42413a94-9973-4e8d-83b6-207a4e7847c1] Took 11.88 seconds to build instance.
Oct 18 11:54:12 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-f61ebfd3-16e3-439f-af45-e7eb40916b72 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lock "42413a94-9973-4e8d-83b6-207a4e7847c1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.043s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:54:12 user nova-compute[74190]: DEBUG nova.compute.manager [req-b9114f60-9ce5-41b0-92c4-952155ba3187 req-51af8640-e9f7-487d-bd91-0a21a063ef06 service nova] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Received event network-vif-plugged-7cee893b-5ac8-45f8-a1f8-5374b49cc3b5 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:54:12 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-b9114f60-9ce5-41b0-92c4-952155ba3187 req-51af8640-e9f7-487d-bd91-0a21a063ef06 service nova] Acquiring lock "4e916d24-9f9d-4289-87ce-f65d2499fcd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:54:12 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-b9114f60-9ce5-41b0-92c4-952155ba3187 req-51af8640-e9f7-487d-bd91-0a21a063ef06 service nova] Lock "4e916d24-9f9d-4289-87ce-f65d2499fcd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:54:12 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-b9114f60-9ce5-41b0-92c4-952155ba3187 req-51af8640-e9f7-487d-bd91-0a21a063ef06 service nova] Lock "4e916d24-9f9d-4289-87ce-f65d2499fcd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:54:12 user nova-compute[74190]: DEBUG nova.compute.manager [req-b9114f60-9ce5-41b0-92c4-952155ba3187 req-51af8640-e9f7-487d-bd91-0a21a063ef06 service nova] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] No waiting events found dispatching network-vif-plugged-7cee893b-5ac8-45f8-a1f8-5374b49cc3b5 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:54:12 user nova-compute[74190]: WARNING nova.compute.manager [req-b9114f60-9ce5-41b0-92c4-952155ba3187 req-51af8640-e9f7-487d-bd91-0a21a063ef06 service nova] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Received unexpected event network-vif-plugged-7cee893b-5ac8-45f8-a1f8-5374b49cc3b5 for instance with vm_state rescued and task_state unrescuing.
Oct 18 11:54:12 user nova-compute[74190]: DEBUG nova.compute.manager [None req-a3f9f685-cb9a-4350-a386-1d3b66a0b25b tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Checking state {{(pid=74190) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 11:54:13 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:13 user nova-compute[74190]: DEBUG nova.compute.manager [req-41e76f01-69d0-4d43-aa1e-10ba42c073b3 req-630ffdc1-6896-4927-bf81-818fef55055b service nova] [instance: 47ed3fb0-c159-484f-8380-79b5564d0ac1] Received event network-changed-693871aa-4bc1-41f8-aa49-4882800b9592 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:54:13 user nova-compute[74190]: DEBUG nova.compute.manager [req-41e76f01-69d0-4d43-aa1e-10ba42c073b3 req-630ffdc1-6896-4927-bf81-818fef55055b service nova] [instance: 47ed3fb0-c159-484f-8380-79b5564d0ac1] Refreshing instance network info cache due to event network-changed-693871aa-4bc1-41f8-aa49-4882800b9592. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 11:54:13 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-41e76f01-69d0-4d43-aa1e-10ba42c073b3 req-630ffdc1-6896-4927-bf81-818fef55055b service nova] Acquiring lock "refresh_cache-47ed3fb0-c159-484f-8380-79b5564d0ac1" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:54:13 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-41e76f01-69d0-4d43-aa1e-10ba42c073b3 req-630ffdc1-6896-4927-bf81-818fef55055b service nova] Acquired lock "refresh_cache-47ed3fb0-c159-484f-8380-79b5564d0ac1" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:54:13 user nova-compute[74190]: DEBUG nova.network.neutron [req-41e76f01-69d0-4d43-aa1e-10ba42c073b3 req-630ffdc1-6896-4927-bf81-818fef55055b service nova] [instance: 47ed3fb0-c159-484f-8380-79b5564d0ac1] Refreshing network info cache for port 693871aa-4bc1-41f8-aa49-4882800b9592 {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 11:54:14 user nova-compute[74190]: DEBUG nova.network.neutron [req-41e76f01-69d0-4d43-aa1e-10ba42c073b3 req-630ffdc1-6896-4927-bf81-818fef55055b service nova] [instance: 47ed3fb0-c159-484f-8380-79b5564d0ac1] Updated VIF entry in instance network info cache for port 693871aa-4bc1-41f8-aa49-4882800b9592. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 11:54:14 user nova-compute[74190]: DEBUG nova.network.neutron [req-41e76f01-69d0-4d43-aa1e-10ba42c073b3 req-630ffdc1-6896-4927-bf81-818fef55055b service nova] [instance: 47ed3fb0-c159-484f-8380-79b5564d0ac1] Updating instance_info_cache with network_info: [{"id": "693871aa-4bc1-41f8-aa49-4882800b9592", "address": "fa:16:3e:4b:2c:c3", "network": {"id": "cf0a4705-3fff-4716-87ac-b0ca7700e11c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1739631852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cf8d4d4f504e82868ed295e054644c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap693871aa-4b", "ovs_interfaceid": "693871aa-4bc1-41f8-aa49-4882800b9592", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:54:14 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-41e76f01-69d0-4d43-aa1e-10ba42c073b3 req-630ffdc1-6896-4927-bf81-818fef55055b service nova] Releasing lock "refresh_cache-47ed3fb0-c159-484f-8380-79b5564d0ac1" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:54:14 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:15 user nova-compute[74190]: DEBUG nova.compute.manager [req-e3ed86fc-a79b-4c99-bf67-3a542c9f038a req-5319727f-2f51-4c3a-a849-451ad6e5682a service nova] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] Received event network-changed-1a9d494b-8515-4508-b0d8-387e20c897bb {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:54:15 user nova-compute[74190]: DEBUG nova.compute.manager [req-e3ed86fc-a79b-4c99-bf67-3a542c9f038a req-5319727f-2f51-4c3a-a849-451ad6e5682a service nova] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] Refreshing instance network info cache due to event network-changed-1a9d494b-8515-4508-b0d8-387e20c897bb. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 11:54:15 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-e3ed86fc-a79b-4c99-bf67-3a542c9f038a req-5319727f-2f51-4c3a-a849-451ad6e5682a service nova] Acquiring lock "refresh_cache-8eec9cde-3553-4fc8-9162-cda963d1a81e" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:54:15 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-e3ed86fc-a79b-4c99-bf67-3a542c9f038a req-5319727f-2f51-4c3a-a849-451ad6e5682a service nova] Acquired lock "refresh_cache-8eec9cde-3553-4fc8-9162-cda963d1a81e" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:54:15 user nova-compute[74190]: DEBUG nova.network.neutron [req-e3ed86fc-a79b-4c99-bf67-3a542c9f038a req-5319727f-2f51-4c3a-a849-451ad6e5682a service nova] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] Refreshing network info cache for port 1a9d494b-8515-4508-b0d8-387e20c897bb {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 11:54:16 user nova-compute[74190]: DEBUG nova.network.neutron [req-e3ed86fc-a79b-4c99-bf67-3a542c9f038a req-5319727f-2f51-4c3a-a849-451ad6e5682a service nova] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] Updated VIF entry in instance network info cache for port 1a9d494b-8515-4508-b0d8-387e20c897bb. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 11:54:16 user nova-compute[74190]: DEBUG nova.network.neutron [req-e3ed86fc-a79b-4c99-bf67-3a542c9f038a req-5319727f-2f51-4c3a-a849-451ad6e5682a service nova] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] Updating instance_info_cache with network_info: [{"id": "1a9d494b-8515-4508-b0d8-387e20c897bb", "address": "fa:16:3e:41:d4:c9", "network": {"id": "56026ce6-77fb-40c7-9976-732e745c219d", "bridge": "br-int", "label": "tempest-TestStampPattern-989787934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "389e1c2dbc904130ba08b137f0b2e837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a9d494b-85", "ovs_interfaceid": "1a9d494b-8515-4508-b0d8-387e20c897bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:54:16 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-e3ed86fc-a79b-4c99-bf67-3a542c9f038a req-5319727f-2f51-4c3a-a849-451ad6e5682a service nova] Releasing lock "refresh_cache-8eec9cde-3553-4fc8-9162-cda963d1a81e" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:54:16 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-a2b9e330-03ca-4f51-bad5-39e66154507b tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Acquiring lock "8eec9cde-3553-4fc8-9162-cda963d1a81e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:54:16 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-a2b9e330-03ca-4f51-bad5-39e66154507b tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Lock "8eec9cde-3553-4fc8-9162-cda963d1a81e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:54:16 user nova-compute[74190]: DEBUG nova.objects.instance [None req-a2b9e330-03ca-4f51-bad5-39e66154507b tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Lazy-loading 'flavor' on Instance uuid 8eec9cde-3553-4fc8-9162-cda963d1a81e {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:54:16 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-a2b9e330-03ca-4f51-bad5-39e66154507b tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Lock "8eec9cde-3553-4fc8-9162-cda963d1a81e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.080s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:54:16 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-a2b9e330-03ca-4f51-bad5-39e66154507b tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Acquiring lock "8eec9cde-3553-4fc8-9162-cda963d1a81e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:54:16 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-a2b9e330-03ca-4f51-bad5-39e66154507b tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Lock "8eec9cde-3553-4fc8-9162-cda963d1a81e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:54:16 user nova-compute[74190]: INFO nova.compute.manager [None req-a2b9e330-03ca-4f51-bad5-39e66154507b tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] Attaching volume 26d7d20b-7f34-4e38-b6fc-66570f1e4250 to /dev/vdb
Oct 18 11:54:16 user nova-compute[74190]: DEBUG os_brick.utils [None req-a2b9e330-03ca-4f51-bad5-39e66154507b tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:54:16 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:16 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:16 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[89510a41-0f37-48eb-aea7-ed3f3a8e8455]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cff158e257e1\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:54:16 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:16 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:16 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[f85b54cc-59b2-4970-aad5-74a07f3eb257]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:54:16 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:16 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:16 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2469d50-20b4-4c7c-ad36-a37ff9a51403]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:54:16 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d527f82-4843-4bdf-bff4-0851a7723f34]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:54:16 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-a2b9e330-03ca-4f51-bad5-39e66154507b tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Running cmd (subprocess): nvme version {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:16 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-a2b9e330-03ca-4f51-bad5-39e66154507b tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] 'nvme version' failed. Not Retrying. {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 11:54:16 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a2b9e330-03ca-4f51-bad5-39e66154507b tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] nvme not present on system {{(pid=74190) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 11:54:17 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:17 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 11:54:17 user nova-compute[74190]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 11:54:17 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[183ec02c-c0ad-4dac-8e34-c2aa2b7097b1]: (4, '') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:54:17 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-a2b9e330-03ca-4f51-bad5-39e66154507b tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74190) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 11:54:17 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-a2b9e330-03ca-4f51-bad5-39e66154507b tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 11:54:17 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-a2b9e330-03ca-4f51-bad5-39e66154507b tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] LIGHTOS: no hostnqn found. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 11:54:17 user nova-compute[74190]: DEBUG os_brick.utils [None req-a2b9e330-03ca-4f51-bad5-39e66154507b tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] <== get_connector_properties: return (167ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cff158e257e1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:54:17 user nova-compute[74190]: DEBUG nova.virt.block_device [None req-a2b9e330-03ca-4f51-bad5-39e66154507b tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] Updating existing volume attachment record: 382cb201-323b-417b-adc9-c4cb5ad5a6ce {{(pid=74190) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 11:54:18 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:19 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:19 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-1640aef3-aedd-4f56-b53c-5c960efbb6d3 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Acquiring lock "47ed3fb0-c159-484f-8380-79b5564d0ac1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:54:19 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-1640aef3-aedd-4f56-b53c-5c960efbb6d3 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lock "47ed3fb0-c159-484f-8380-79b5564d0ac1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:54:19 user nova-compute[74190]: DEBUG nova.objects.instance [None req-1640aef3-aedd-4f56-b53c-5c960efbb6d3 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lazy-loading 'flavor' on Instance uuid 47ed3fb0-c159-484f-8380-79b5564d0ac1 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:54:20 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-1640aef3-aedd-4f56-b53c-5c960efbb6d3 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lock "47ed3fb0-c159-484f-8380-79b5564d0ac1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:54:20 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-1640aef3-aedd-4f56-b53c-5c960efbb6d3 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Acquiring lock "47ed3fb0-c159-484f-8380-79b5564d0ac1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:54:20 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-1640aef3-aedd-4f56-b53c-5c960efbb6d3 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lock "47ed3fb0-c159-484f-8380-79b5564d0ac1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:54:20 user nova-compute[74190]: INFO nova.compute.manager [None req-1640aef3-aedd-4f56-b53c-5c960efbb6d3 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: 47ed3fb0-c159-484f-8380-79b5564d0ac1] Attaching volume 7c03633a-f8e8-41ca-be64-1261c907bb2b to /dev/vdb
Oct 18 11:54:20 user nova-compute[74190]: DEBUG os_brick.utils [None req-1640aef3-aedd-4f56-b53c-5c960efbb6d3 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:54:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:20 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f7664bf-c596-4e35-b769-6109d3a54201]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cff158e257e1\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:54:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:20 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e0cdbc4-291d-49aa-81ca-b0fe2d70c443]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:54:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:20 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c8b664-287c-4329-b078-e245d42c36f6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:54:20 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f8d0cb8-82a2-47be-9a6c-3dbb898f7154]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:54:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-1640aef3-aedd-4f56-b53c-5c960efbb6d3 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Running cmd (subprocess): nvme version {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-1640aef3-aedd-4f56-b53c-5c960efbb6d3 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] 'nvme version' failed. Not Retrying. {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 11:54:20 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1640aef3-aedd-4f56-b53c-5c960efbb6d3 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] nvme not present on system {{(pid=74190) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 11:54:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 11:54:20 user nova-compute[74190]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 11:54:20 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fba252b-5283-41b4-99e6-6c15ed058614]: (4, '') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:54:20 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-1640aef3-aedd-4f56-b53c-5c960efbb6d3 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74190) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 11:54:20 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-1640aef3-aedd-4f56-b53c-5c960efbb6d3 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 11:54:20 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-1640aef3-aedd-4f56-b53c-5c960efbb6d3 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] LIGHTOS: no hostnqn found. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 11:54:20 user nova-compute[74190]: DEBUG os_brick.utils [None req-1640aef3-aedd-4f56-b53c-5c960efbb6d3 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cff158e257e1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:54:20 user nova-compute[74190]: DEBUG nova.virt.block_device [None req-1640aef3-aedd-4f56-b53c-5c960efbb6d3 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: 47ed3fb0-c159-484f-8380-79b5564d0ac1] Updating existing volume attachment record: 91432437-5867-452c-971e-0c07c0151f76 {{(pid=74190) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 11:54:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:26 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:27 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-704efd55-6c7e-4ff8-9a57-1da47551e0f3 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Acquiring lock "d90a6ca0-19a6-4221-81b7-0cb05d67f38e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:54:27 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-704efd55-6c7e-4ff8-9a57-1da47551e0f3 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Lock "d90a6ca0-19a6-4221-81b7-0cb05d67f38e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:54:27 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-704efd55-6c7e-4ff8-9a57-1da47551e0f3 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Acquiring lock "d90a6ca0-19a6-4221-81b7-0cb05d67f38e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:54:27 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-704efd55-6c7e-4ff8-9a57-1da47551e0f3 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Lock "d90a6ca0-19a6-4221-81b7-0cb05d67f38e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:54:27 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-704efd55-6c7e-4ff8-9a57-1da47551e0f3 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Lock "d90a6ca0-19a6-4221-81b7-0cb05d67f38e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:54:27 user nova-compute[74190]: INFO nova.compute.manager [None req-704efd55-6c7e-4ff8-9a57-1da47551e0f3 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Terminating instance
Oct 18 11:54:27 user nova-compute[74190]: DEBUG nova.compute.manager [None req-704efd55-6c7e-4ff8-9a57-1da47551e0f3 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Start destroying the instance on the hypervisor. {{(pid=74190) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 11:54:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:27 user nova-compute[74190]: DEBUG nova.compute.manager [req-c1b5c159-93b3-4b3a-8fa5-da8b77413883 req-ffb7fdf2-2340-498f-bca6-39be854877e4 service nova] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Received event network-vif-unplugged-2d8060bc-84e4-41e2-9e72-42b2159a1d1e {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:54:27 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-c1b5c159-93b3-4b3a-8fa5-da8b77413883 req-ffb7fdf2-2340-498f-bca6-39be854877e4 service nova] Acquiring lock "d90a6ca0-19a6-4221-81b7-0cb05d67f38e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:54:27 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-c1b5c159-93b3-4b3a-8fa5-da8b77413883 req-ffb7fdf2-2340-498f-bca6-39be854877e4 service nova] Lock "d90a6ca0-19a6-4221-81b7-0cb05d67f38e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:54:27 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-c1b5c159-93b3-4b3a-8fa5-da8b77413883 req-ffb7fdf2-2340-498f-bca6-39be854877e4 service nova] Lock "d90a6ca0-19a6-4221-81b7-0cb05d67f38e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:54:27 user nova-compute[74190]: DEBUG nova.compute.manager [req-c1b5c159-93b3-4b3a-8fa5-da8b77413883 req-ffb7fdf2-2340-498f-bca6-39be854877e4 service nova] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] No waiting events found dispatching network-vif-unplugged-2d8060bc-84e4-41e2-9e72-42b2159a1d1e {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:54:27 user nova-compute[74190]: DEBUG nova.compute.manager [req-c1b5c159-93b3-4b3a-8fa5-da8b77413883 req-ffb7fdf2-2340-498f-bca6-39be854877e4 service nova] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Received event network-vif-unplugged-2d8060bc-84e4-41e2-9e72-42b2159a1d1e for instance with task_state deleting. {{(pid=74190) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 11:54:28 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Instance destroyed successfully.
Oct 18 11:54:28 user nova-compute[74190]: DEBUG nova.objects.instance [None req-704efd55-6c7e-4ff8-9a57-1da47551e0f3 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Lazy-loading 'resources' on Instance uuid d90a6ca0-19a6-4221-81b7-0cb05d67f38e {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:54:28 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-704efd55-6c7e-4ff8-9a57-1da47551e0f3 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-18T11:48:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1378919830',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1378919830',id=16,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN/VyCpYe57sZza+zIcDL8lX6OOvHO+LrEprfV8DJYOtk4t8fMJlRU0klieaFBHD4cS9lGee5DWDaQGdYbzBF339L3I7vrfQc+lY8v5MadYTacmbDVCw1jMPM0jY/aL4cw==',key_name='tempest-keypair-1365040796',keypairs=<?>,launch_index=0,launched_at=2023-10-18T11:52:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='548640fa718f4fdfa21c1a7783519c9f',ramdisk_id='',reservation_id='r-eukfw0x8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-83921126',owner_user_name='tempest-AttachVolumeShelveTestJSON-83921126-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T11:52:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='829b310c15b54dc7836d0b9d7fd757ed',uuid=d90a6ca0-19a6-4221-81b7-0cb05d67f38e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2d8060bc-84e4-41e2-9e72-42b2159a1d1e", "address": "fa:16:3e:6c:a0:e2", "network": {"id": "e6ae8edc-7014-4341-91b2-4c82d72c9bb9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-15434410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548640fa718f4fdfa21c1a7783519c9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d8060bc-84", "ovs_interfaceid": "2d8060bc-84e4-41e2-9e72-42b2159a1d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 11:54:28 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-704efd55-6c7e-4ff8-9a57-1da47551e0f3 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Converting VIF {"id": "2d8060bc-84e4-41e2-9e72-42b2159a1d1e", "address": "fa:16:3e:6c:a0:e2", "network": {"id": "e6ae8edc-7014-4341-91b2-4c82d72c9bb9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-15434410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548640fa718f4fdfa21c1a7783519c9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d8060bc-84", "ovs_interfaceid": "2d8060bc-84e4-41e2-9e72-42b2159a1d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:54:28 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-704efd55-6c7e-4ff8-9a57-1da47551e0f3 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:a0:e2,bridge_name='br-int',has_traffic_filtering=True,id=2d8060bc-84e4-41e2-9e72-42b2159a1d1e,network=Network(e6ae8edc-7014-4341-91b2-4c82d72c9bb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d8060bc-84') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:54:28 user nova-compute[74190]: DEBUG os_vif [None req-704efd55-6c7e-4ff8-9a57-1da47551e0f3 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:a0:e2,bridge_name='br-int',has_traffic_filtering=True,id=2d8060bc-84e4-41e2-9e72-42b2159a1d1e,network=Network(e6ae8edc-7014-4341-91b2-4c82d72c9bb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d8060bc-84') {{(pid=74190) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 11:54:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2d8060bc-84, bridge=br-int, if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:54:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:54:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f6224a33-0499-4c64-8d4e-d65e80d94de8) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:54:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:28 user nova-compute[74190]: INFO os_vif [None req-704efd55-6c7e-4ff8-9a57-1da47551e0f3 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:a0:e2,bridge_name='br-int',has_traffic_filtering=True,id=2d8060bc-84e4-41e2-9e72-42b2159a1d1e,network=Network(e6ae8edc-7014-4341-91b2-4c82d72c9bb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d8060bc-84')
Oct 18 11:54:28 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-704efd55-6c7e-4ff8-9a57-1da47551e0f3 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Deleting instance files /opt/stack/data/nova/instances/d90a6ca0-19a6-4221-81b7-0cb05d67f38e_del
Oct 18 11:54:28 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-704efd55-6c7e-4ff8-9a57-1da47551e0f3 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Deletion of /opt/stack/data/nova/instances/d90a6ca0-19a6-4221-81b7-0cb05d67f38e_del complete
Oct 18 11:54:28 user nova-compute[74190]: INFO nova.compute.manager [None req-704efd55-6c7e-4ff8-9a57-1da47551e0f3 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Took 0.99 seconds to destroy the instance on the hypervisor.
Oct 18 11:54:28 user nova-compute[74190]: DEBUG oslo.service.loopingcall [None req-704efd55-6c7e-4ff8-9a57-1da47551e0f3 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74190) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 11:54:28 user nova-compute[74190]: DEBUG nova.compute.manager [-] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Deallocating network for instance {{(pid=74190) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 11:54:28 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] deallocate_for_instance() {{(pid=74190) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 11:54:29 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Updating instance_info_cache with network_info: [] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:54:29 user nova-compute[74190]: INFO nova.compute.manager [-] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Took 0.93 seconds to deallocate network for instance.
Oct 18 11:54:29 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-704efd55-6c7e-4ff8-9a57-1da47551e0f3 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:54:29 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-704efd55-6c7e-4ff8-9a57-1da47551e0f3 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:54:29 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-704efd55-6c7e-4ff8-9a57-1da47551e0f3 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 11:54:29 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-704efd55-6c7e-4ff8-9a57-1da47551e0f3 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 11:54:29 user nova-compute[74190]: DEBUG nova.compute.manager [req-2319ba80-9254-4d19-9bcb-2ebfda2dfff2 req-6b1c7739-5212-4acc-9ee7-3294969ab4f8 service nova] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Received event network-vif-plugged-2d8060bc-84e4-41e2-9e72-42b2159a1d1e {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:54:29 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-2319ba80-9254-4d19-9bcb-2ebfda2dfff2 req-6b1c7739-5212-4acc-9ee7-3294969ab4f8 service nova] Acquiring lock "d90a6ca0-19a6-4221-81b7-0cb05d67f38e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:54:29 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-2319ba80-9254-4d19-9bcb-2ebfda2dfff2 req-6b1c7739-5212-4acc-9ee7-3294969ab4f8 service nova] Lock "d90a6ca0-19a6-4221-81b7-0cb05d67f38e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:54:29 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-2319ba80-9254-4d19-9bcb-2ebfda2dfff2 req-6b1c7739-5212-4acc-9ee7-3294969ab4f8 service nova] Lock "d90a6ca0-19a6-4221-81b7-0cb05d67f38e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:54:29 user nova-compute[74190]: DEBUG nova.compute.manager [req-2319ba80-9254-4d19-9bcb-2ebfda2dfff2 req-6b1c7739-5212-4acc-9ee7-3294969ab4f8 service nova] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] No waiting events found dispatching network-vif-plugged-2d8060bc-84e4-41e2-9e72-42b2159a1d1e {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:54:29 user nova-compute[74190]: WARNING nova.compute.manager [req-2319ba80-9254-4d19-9bcb-2ebfda2dfff2 req-6b1c7739-5212-4acc-9ee7-3294969ab4f8 service nova] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Received unexpected event network-vif-plugged-2d8060bc-84e4-41e2-9e72-42b2159a1d1e for instance with vm_state deleted and task_state None.
Oct 18 11:54:29 user nova-compute[74190]: DEBUG nova.compute.manager [req-2319ba80-9254-4d19-9bcb-2ebfda2dfff2 req-6b1c7739-5212-4acc-9ee7-3294969ab4f8 service nova] [instance: d90a6ca0-19a6-4221-81b7-0cb05d67f38e] Received event network-vif-deleted-2d8060bc-84e4-41e2-9e72-42b2159a1d1e {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:54:29 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-704efd55-6c7e-4ff8-9a57-1da47551e0f3 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.452s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:54:29 user nova-compute[74190]: INFO nova.scheduler.client.report [None req-704efd55-6c7e-4ff8-9a57-1da47551e0f3 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Deleted allocations for instance d90a6ca0-19a6-4221-81b7-0cb05d67f38e
Oct 18 11:54:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:29 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-704efd55-6c7e-4ff8-9a57-1da47551e0f3 tempest-AttachVolumeShelveTestJSON-83921126 tempest-AttachVolumeShelveTestJSON-83921126-project-member] Lock "d90a6ca0-19a6-4221-81b7-0cb05d67f38e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.627s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:54:30 user nova-compute[74190]: DEBUG nova.compute.manager [req-dc537a88-3659-4db3-9350-9be643fbbdca req-d3833c3f-f498-472b-8ed4-55b06616bead service nova] [instance: b200eb6a-be24-4a8f-be23-4e36f7b7b26e] Received event network-changed-c9514478-3402-47b2-b649-0b8b762c1a35 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:54:30 user nova-compute[74190]: DEBUG nova.compute.manager [req-dc537a88-3659-4db3-9350-9be643fbbdca req-d3833c3f-f498-472b-8ed4-55b06616bead service nova] [instance: b200eb6a-be24-4a8f-be23-4e36f7b7b26e] Refreshing instance network info cache due to event network-changed-c9514478-3402-47b2-b649-0b8b762c1a35. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 11:54:30 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-dc537a88-3659-4db3-9350-9be643fbbdca req-d3833c3f-f498-472b-8ed4-55b06616bead service nova] Acquiring lock "refresh_cache-b200eb6a-be24-4a8f-be23-4e36f7b7b26e" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:54:30 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-dc537a88-3659-4db3-9350-9be643fbbdca req-d3833c3f-f498-472b-8ed4-55b06616bead service nova] Acquired lock "refresh_cache-b200eb6a-be24-4a8f-be23-4e36f7b7b26e" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:54:30 user nova-compute[74190]: DEBUG nova.network.neutron [req-dc537a88-3659-4db3-9350-9be643fbbdca req-d3833c3f-f498-472b-8ed4-55b06616bead service nova] [instance: b200eb6a-be24-4a8f-be23-4e36f7b7b26e] Refreshing network info cache for port c9514478-3402-47b2-b649-0b8b762c1a35 {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 11:54:30 user nova-compute[74190]: DEBUG nova.network.neutron [req-dc537a88-3659-4db3-9350-9be643fbbdca req-d3833c3f-f498-472b-8ed4-55b06616bead service nova] [instance: b200eb6a-be24-4a8f-be23-4e36f7b7b26e] Updated VIF entry in instance network info cache for port c9514478-3402-47b2-b649-0b8b762c1a35. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 11:54:30 user nova-compute[74190]: DEBUG nova.network.neutron [req-dc537a88-3659-4db3-9350-9be643fbbdca req-d3833c3f-f498-472b-8ed4-55b06616bead service nova] [instance: b200eb6a-be24-4a8f-be23-4e36f7b7b26e] Updating instance_info_cache with network_info: [{"id": "c9514478-3402-47b2-b649-0b8b762c1a35", "address": "fa:16:3e:5a:49:f4", "network": {"id": "25e0d6f5-497d-4898-8181-5b4848950f16", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-245925644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df06c4b010434e3da9ba4ea41f26befa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9514478-34", "ovs_interfaceid": "c9514478-3402-47b2-b649-0b8b762c1a35", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:54:30 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-dc537a88-3659-4db3-9350-9be643fbbdca req-d3833c3f-f498-472b-8ed4-55b06616bead service nova] Releasing lock "refresh_cache-b200eb6a-be24-4a8f-be23-4e36f7b7b26e" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:54:31 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:33 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:35 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-0450802e-23f8-4256-8765-9abc759063ee tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Acquiring lock "b200eb6a-be24-4a8f-be23-4e36f7b7b26e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:54:35 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-0450802e-23f8-4256-8765-9abc759063ee tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "b200eb6a-be24-4a8f-be23-4e36f7b7b26e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:54:35 user nova-compute[74190]: DEBUG nova.objects.instance [None req-0450802e-23f8-4256-8765-9abc759063ee tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lazy-loading 'flavor' on Instance uuid b200eb6a-be24-4a8f-be23-4e36f7b7b26e {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:54:35 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-0450802e-23f8-4256-8765-9abc759063ee tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "b200eb6a-be24-4a8f-be23-4e36f7b7b26e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:54:35 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-0450802e-23f8-4256-8765-9abc759063ee tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Acquiring lock "b200eb6a-be24-4a8f-be23-4e36f7b7b26e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:54:35 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-0450802e-23f8-4256-8765-9abc759063ee tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "b200eb6a-be24-4a8f-be23-4e36f7b7b26e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:54:35 user nova-compute[74190]: INFO nova.compute.manager [None req-0450802e-23f8-4256-8765-9abc759063ee tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: b200eb6a-be24-4a8f-be23-4e36f7b7b26e] Attaching volume f859861f-19fb-4f6a-abd3-2160677199a7 to /dev/vdb
Oct 18 11:54:35 user nova-compute[74190]: DEBUG os_brick.utils [None req-0450802e-23f8-4256-8765-9abc759063ee tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:54:35 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:35 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:35 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4293c98-2f79-4bd9-b3c0-f32a7106dce1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cff158e257e1\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:54:35 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:35 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:35 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[30669730-c51c-4ac3-b2ea-065dd5ee4e80]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:54:35 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:35 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:35 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c85059-7f2c-4d89-8af7-da256aa8284b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:54:35 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cc1e89b-922d-4134-a4af-a52ebc28da86]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:54:35 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-0450802e-23f8-4256-8765-9abc759063ee tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Running cmd (subprocess): nvme version {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:35 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-0450802e-23f8-4256-8765-9abc759063ee tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] 'nvme version' failed. Not Retrying. {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 11:54:35 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0450802e-23f8-4256-8765-9abc759063ee tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] nvme not present on system {{(pid=74190) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 11:54:35 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:35 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 11:54:35 user nova-compute[74190]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 11:54:35 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ea5420-a839-4f63-9659-b215c21c6d1d]: (4, '') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:54:35 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-0450802e-23f8-4256-8765-9abc759063ee tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74190) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 11:54:35 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-0450802e-23f8-4256-8765-9abc759063ee tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 11:54:35 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-0450802e-23f8-4256-8765-9abc759063ee tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] LIGHTOS: no hostnqn found. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 11:54:35 user nova-compute[74190]: DEBUG os_brick.utils [None req-0450802e-23f8-4256-8765-9abc759063ee tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cff158e257e1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:54:35 user nova-compute[74190]: DEBUG nova.virt.block_device [None req-0450802e-23f8-4256-8765-9abc759063ee tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: b200eb6a-be24-4a8f-be23-4e36f7b7b26e] Updating existing volume attachment record: 89874827-083a-4b37-8083-4a18b2620e48 {{(pid=74190) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 11:54:36 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2b9e330-03ca-4f51-bad5-39e66154507b tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] Calling os-brick to attach iSCSI Volume {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 11:54:36 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b9e330-03ca-4f51-bad5-39e66154507b tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:26d7d20b-7f34-4e38-b6fc-66570f1e4250', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PyoCbhdz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:54:36 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-a2b9e330-03ca-4f51-bad5-39e66154507b tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:54:36 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-a2b9e330-03ca-4f51-bad5-39e66154507b tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:54:36 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-a2b9e330-03ca-4f51-bad5-39e66154507b tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:54:36 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-a2b9e330-03ca-4f51-bad5-39e66154507b tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:54:36 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-a2b9e330-03ca-4f51-bad5-39e66154507b tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26d7d20b-7f34-4e38-b6fc-66570f1e4250" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:54:36 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-a2b9e330-03ca-4f51-bad5-39e66154507b tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26d7d20b-7f34-4e38-b6fc-66570f1e4250" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:54:36 user nova-compute[74190]: INFO os_brick.initiator.connectors.iscsi [None req-a2b9e330-03ca-4f51-bad5-39e66154507b tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 11:54:36 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26d7d20b-7f34-4e38-b6fc-66570f1e4250 -p 172.16.0.220:3260 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:36 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26d7d20b-7f34-4e38-b6fc-66570f1e4250 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:36 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[7840dc1a-486e-4020-b98f-dcc19d650132]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:54:36 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b9e330-03ca-4f51-bad5-39e66154507b tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 11:54:36 user nova-compute[74190]:  {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:54:36 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26d7d20b-7f34-4e38-b6fc-66570f1e4250 -p 172.16.0.220:3260 --interface default --op new {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:36 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26d7d20b-7f34-4e38-b6fc-66570f1e4250 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:36 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[726031e6-503c-47a8-a35c-740f86a3eab0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:26d7d20b-7f34-4e38-b6fc-66570f1e4250] added\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:54:36 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b9e330-03ca-4f51-bad5-39e66154507b tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:26d7d20b-7f34-4e38-b6fc-66570f1e4250] added
Oct 18 11:54:36 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:54:36 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26d7d20b-7f34-4e38-b6fc-66570f1e4250 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:36 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26d7d20b-7f34-4e38-b6fc-66570f1e4250 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:36 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[165fb619-402a-4133-8e2a-f134d41ca9f8]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:54:36 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b9e330-03ca-4f51-bad5-39e66154507b tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:54:36 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26d7d20b-7f34-4e38-b6fc-66570f1e4250 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:36 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26d7d20b-7f34-4e38-b6fc-66570f1e4250 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:36 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f64fc5c-9cb5-4f6d-b99d-14339f26eec3]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:54:36 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b9e330-03ca-4f51-bad5-39e66154507b tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:54:36 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26d7d20b-7f34-4e38-b6fc-66570f1e4250 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PyoCbhdz {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:36 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26d7d20b-7f34-4e38-b6fc-66570f1e4250 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PyoCbhdz" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:36 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f914f7-dc8d-4c2a-8194-e5a3f23c5965]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:54:36 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b9e330-03ca-4f51-bad5-39e66154507b tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PyoCbhdz'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:54:36 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26d7d20b-7f34-4e38-b6fc-66570f1e4250 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:36 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26d7d20b-7f34-4e38-b6fc-66570f1e4250 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:36 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[68c490dd-9a1b-4efc-84a6-c74f07f7814c]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:54:36 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b9e330-03ca-4f51-bad5-39e66154507b tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:54:36 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:36 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:36 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b845e68-141f-405c-8142-fdd7d849aa98]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:54:36 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b9e330-03ca-4f51-bad5-39e66154507b tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 11:54:36 user nova-compute[74190]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 (non-flash)
Oct 18 11:54:36 user nova-compute[74190]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 (non-flash)
Oct 18 11:54:36 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:54:36 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b9e330-03ca-4f51-bad5-39e66154507b tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 11:54:36 user nova-compute[74190]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 (non-flash)
Oct 18 11:54:36 user nova-compute[74190]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 (non-flash)
Oct 18 11:54:36 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:54:36 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26d7d20b-7f34-4e38-b6fc-66570f1e4250 -p 172.16.0.220:3260 --login {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:36 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26d7d20b-7f34-4e38-b6fc-66570f1e4250 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:36 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d1c9a06-4894-44e3-b887-b2721a57649c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:26d7d20b-7f34-4e38-b6fc-66570f1e4250, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:26d7d20b-7f34-4e38-b6fc-66570f1e4250, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:54:36 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b9e330-03ca-4f51-bad5-39e66154507b tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:26d7d20b-7f34-4e38-b6fc-66570f1e4250, portal: 172.16.0.220,3260]
Oct 18 11:54:36 user nova-compute[74190]: Login to [iface: default, target: iqn.2010-10.org.openstack:26d7d20b-7f34-4e38-b6fc-66570f1e4250, portal: 172.16.0.220,3260] successful.
Oct 18 11:54:36 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:54:36 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26d7d20b-7f34-4e38-b6fc-66570f1e4250 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:36 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26d7d20b-7f34-4e38-b6fc-66570f1e4250 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:36 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a7db4d-3e9e-4182-9800-f74e93d24bd4]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:54:36 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b9e330-03ca-4f51-bad5-39e66154507b tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:54:36 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:36 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:36 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[49ea46eb-e528-4a1e-9bb8-e3b8adcbb537]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26d7d20b-7f34-4e38-b6fc-66570f1e4250 (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:54:36 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b9e330-03ca-4f51-bad5-39e66154507b tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 11:54:36 user nova-compute[74190]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 (non-flash)
Oct 18 11:54:36 user nova-compute[74190]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 (non-flash)
Oct 18 11:54:36 user nova-compute[74190]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26d7d20b-7f34-4e38-b6fc-66570f1e4250 (non-flash)
Oct 18 11:54:36 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:54:36 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b9e330-03ca-4f51-bad5-39e66154507b tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 11:54:36 user nova-compute[74190]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 (non-flash)
Oct 18 11:54:36 user nova-compute[74190]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 (non-flash)
Oct 18 11:54:36 user nova-compute[74190]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26d7d20b-7f34-4e38-b6fc-66570f1e4250 (non-flash)
Oct 18 11:54:36 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:54:36 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-a2b9e330-03ca-4f51-bad5-39e66154507b tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26d7d20b-7f34-4e38-b6fc-66570f1e4250" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:54:36 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b9e330-03ca-4f51-bad5-39e66154507b tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Connected to 172.16.0.220:3260 {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 11:54:36 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-a2b9e330-03ca-4f51-bad5-39e66154507b tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] HCTL ('36', '-', '-', 0) found on session 30 with lun 0 {{(pid=74190) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 11:54:36 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-a2b9e330-03ca-4f51-bad5-39e66154507b tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74190) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 11:54:36 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:36 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:36 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[e09a84f4-14ee-45cd-bae5-b441a7856426]: (4, ('- - 0', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:54:36 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-a2b9e330-03ca-4f51-bad5-39e66154507b tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Searching for a device in session 30 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74190) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 11:54:36 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b9e330-03ca-4f51-bad5-39e66154507b tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:26d7d20b-7f34-4e38-b6fc-66570f1e4250', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PyoCbhdz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 11:54:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-a2b9e330-03ca-4f51-bad5-39e66154507b tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:54:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b9e330-03ca-4f51-bad5-39e66154507b tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] <== connect_volume: return (1346ms) {'type': 'block', 'scsi_wwn': '26536613137356263', 'path': '/dev/sde'} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:54:37 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2b9e330-03ca-4f51-bad5-39e66154507b tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26536613137356263', 'path': '/dev/sde'} {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 11:54:37 user nova-compute[74190]: DEBUG nova.objects.instance [None req-a2b9e330-03ca-4f51-bad5-39e66154507b tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Lazy-loading 'flavor' on Instance uuid 8eec9cde-3553-4fc8-9162-cda963d1a81e {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:54:37 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-a2b9e330-03ca-4f51-bad5-39e66154507b tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] attach device xml: <disk type="block" device="disk">
Oct 18 11:54:37 user nova-compute[74190]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 11:54:37 user nova-compute[74190]:   <source dev="/dev/sde"/>
Oct 18 11:54:37 user nova-compute[74190]:   <target dev="vdb" bus="virtio"/>
Oct 18 11:54:37 user nova-compute[74190]:   <serial>26d7d20b-7f34-4e38-b6fc-66570f1e4250</serial>
Oct 18 11:54:37 user nova-compute[74190]: </disk>
Oct 18 11:54:37 user nova-compute[74190]:  {{(pid=74190) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 18 11:54:37 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-a2b9e330-03ca-4f51-bad5-39e66154507b tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] No BDM found with device name vda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 11:54:37 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-a2b9e330-03ca-4f51-bad5-39e66154507b tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 11:54:37 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-a2b9e330-03ca-4f51-bad5-39e66154507b tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] No VIF found with MAC fa:16:3e:41:d4:c9, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 11:54:38 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-a2b9e330-03ca-4f51-bad5-39e66154507b tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Lock "8eec9cde-3553-4fc8-9162-cda963d1a81e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.318s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:54:38 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:38 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:39 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1640aef3-aedd-4f56-b53c-5c960efbb6d3 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: 47ed3fb0-c159-484f-8380-79b5564d0ac1] Calling os-brick to attach iSCSI Volume {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 11:54:39 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-1640aef3-aedd-4f56-b53c-5c960efbb6d3 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7c03633a-f8e8-41ca-be64-1261c907bb2b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ULlkTqjN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:54:39 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-1640aef3-aedd-4f56-b53c-5c960efbb6d3 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:54:39 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-1640aef3-aedd-4f56-b53c-5c960efbb6d3 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:54:39 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-1640aef3-aedd-4f56-b53c-5c960efbb6d3 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:54:39 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-1640aef3-aedd-4f56-b53c-5c960efbb6d3 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:54:39 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-1640aef3-aedd-4f56-b53c-5c960efbb6d3 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c03633a-f8e8-41ca-be64-1261c907bb2b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:54:39 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-1640aef3-aedd-4f56-b53c-5c960efbb6d3 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c03633a-f8e8-41ca-be64-1261c907bb2b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:54:39 user nova-compute[74190]: INFO os_brick.initiator.connectors.iscsi [None req-1640aef3-aedd-4f56-b53c-5c960efbb6d3 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 11:54:39 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c03633a-f8e8-41ca-be64-1261c907bb2b -p 172.16.0.220:3260 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:39 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c03633a-f8e8-41ca-be64-1261c907bb2b -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:39 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d505699-8aa2-44c5-a839-e826ba222776]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:54:39 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-1640aef3-aedd-4f56-b53c-5c960efbb6d3 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 11:54:39 user nova-compute[74190]:  {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:54:39 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c03633a-f8e8-41ca-be64-1261c907bb2b -p 172.16.0.220:3260 --interface default --op new {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:39 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c03633a-f8e8-41ca-be64-1261c907bb2b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:39 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f46c96d-d6f7-4ebf-9b1f-ca70a4762c51]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7c03633a-f8e8-41ca-be64-1261c907bb2b] added\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:54:39 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-1640aef3-aedd-4f56-b53c-5c960efbb6d3 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7c03633a-f8e8-41ca-be64-1261c907bb2b] added
Oct 18 11:54:39 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:54:39 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c03633a-f8e8-41ca-be64-1261c907bb2b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:39 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c03633a-f8e8-41ca-be64-1261c907bb2b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:39 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[6009b8ee-fd4a-4897-8394-1234ca14996a]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:54:39 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-1640aef3-aedd-4f56-b53c-5c960efbb6d3 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:54:39 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c03633a-f8e8-41ca-be64-1261c907bb2b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:39 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c03633a-f8e8-41ca-be64-1261c907bb2b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:39 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8998a4f-0f4c-4855-b210-9977e18986c4]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:54:39 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-1640aef3-aedd-4f56-b53c-5c960efbb6d3 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:54:39 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c03633a-f8e8-41ca-be64-1261c907bb2b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ULlkTqjN {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:39 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c03633a-f8e8-41ca-be64-1261c907bb2b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ULlkTqjN" returned: 0 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:39 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[da6b515c-d119-4fec-be27-bf0f07a5ab78]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:54:39 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-1640aef3-aedd-4f56-b53c-5c960efbb6d3 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ULlkTqjN'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:54:39 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c03633a-f8e8-41ca-be64-1261c907bb2b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:39 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c03633a-f8e8-41ca-be64-1261c907bb2b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:39 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d12d3e-11e6-4c8c-bc5c-50102585fdae]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:54:39 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-1640aef3-aedd-4f56-b53c-5c960efbb6d3 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:54:39 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:39 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:39 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[866a8e90-d696-4eee-9cc4-824dd640c3fa]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26d7d20b-7f34-4e38-b6fc-66570f1e4250 (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:54:39 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-1640aef3-aedd-4f56-b53c-5c960efbb6d3 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 11:54:39 user nova-compute[74190]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 (non-flash)
Oct 18 11:54:39 user nova-compute[74190]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 (non-flash)
Oct 18 11:54:39 user nova-compute[74190]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26d7d20b-7f34-4e38-b6fc-66570f1e4250 (non-flash)
Oct 18 11:54:39 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:54:39 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-1640aef3-aedd-4f56-b53c-5c960efbb6d3 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 11:54:39 user nova-compute[74190]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 (non-flash)
Oct 18 11:54:39 user nova-compute[74190]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 (non-flash)
Oct 18 11:54:39 user nova-compute[74190]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26d7d20b-7f34-4e38-b6fc-66570f1e4250 (non-flash)
Oct 18 11:54:39 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:54:39 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c03633a-f8e8-41ca-be64-1261c907bb2b -p 172.16.0.220:3260 --login {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:39 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c03633a-f8e8-41ca-be64-1261c907bb2b -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:39 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[237b8008-5f49-41b3-ada1-748ba7a7b186]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7c03633a-f8e8-41ca-be64-1261c907bb2b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7c03633a-f8e8-41ca-be64-1261c907bb2b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:54:39 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-1640aef3-aedd-4f56-b53c-5c960efbb6d3 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7c03633a-f8e8-41ca-be64-1261c907bb2b, portal: 172.16.0.220,3260]
Oct 18 11:54:39 user nova-compute[74190]: Login to [iface: default, target: iqn.2010-10.org.openstack:7c03633a-f8e8-41ca-be64-1261c907bb2b, portal: 172.16.0.220,3260] successful.
Oct 18 11:54:39 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:54:39 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c03633a-f8e8-41ca-be64-1261c907bb2b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:39 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c03633a-f8e8-41ca-be64-1261c907bb2b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:39 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ea46c9-fcd6-465a-83b4-f81e9b65c188]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:54:39 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-1640aef3-aedd-4f56-b53c-5c960efbb6d3 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:54:39 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:39 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:39 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd46a1f-8851-4799-a74e-ed6f83327bf0]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26d7d20b-7f34-4e38-b6fc-66570f1e4250 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c03633a-f8e8-41ca-be64-1261c907bb2b (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:54:39 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-1640aef3-aedd-4f56-b53c-5c960efbb6d3 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 11:54:39 user nova-compute[74190]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 (non-flash)
Oct 18 11:54:39 user nova-compute[74190]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 (non-flash)
Oct 18 11:54:39 user nova-compute[74190]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26d7d20b-7f34-4e38-b6fc-66570f1e4250 (non-flash)
Oct 18 11:54:39 user nova-compute[74190]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c03633a-f8e8-41ca-be64-1261c907bb2b (non-flash)
Oct 18 11:54:39 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:54:39 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-1640aef3-aedd-4f56-b53c-5c960efbb6d3 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 11:54:39 user nova-compute[74190]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 (non-flash)
Oct 18 11:54:39 user nova-compute[74190]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 (non-flash)
Oct 18 11:54:39 user nova-compute[74190]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26d7d20b-7f34-4e38-b6fc-66570f1e4250 (non-flash)
Oct 18 11:54:39 user nova-compute[74190]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c03633a-f8e8-41ca-be64-1261c907bb2b (non-flash)
Oct 18 11:54:39 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:54:39 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-1640aef3-aedd-4f56-b53c-5c960efbb6d3 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c03633a-f8e8-41ca-be64-1261c907bb2b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:54:39 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-1640aef3-aedd-4f56-b53c-5c960efbb6d3 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Connected to 172.16.0.220:3260 {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 11:54:39 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-1640aef3-aedd-4f56-b53c-5c960efbb6d3 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] HCTL ('37', '-', '-', 0) found on session 31 with lun 0 {{(pid=74190) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 11:54:39 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-1640aef3-aedd-4f56-b53c-5c960efbb6d3 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74190) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 11:54:39 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:39 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:39 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e30cf1-eefe-4309-983e-8afecb176cdf]: (4, ('- - 0', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:54:39 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-1640aef3-aedd-4f56-b53c-5c960efbb6d3 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Searching for a device in session 31 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74190) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 11:54:39 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-1640aef3-aedd-4f56-b53c-5c960efbb6d3 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:7c03633a-f8e8-41ca-be64-1261c907bb2b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ULlkTqjN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 11:54:39 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:40 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-36aa86a3-733d-4caa-a345-090b6e4ca6b0 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Acquiring lock "8eec9cde-3553-4fc8-9162-cda963d1a81e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:54:40 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-36aa86a3-733d-4caa-a345-090b6e4ca6b0 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Lock "8eec9cde-3553-4fc8-9162-cda963d1a81e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:54:40 user nova-compute[74190]: INFO nova.compute.manager [None req-36aa86a3-733d-4caa-a345-090b6e4ca6b0 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] Detaching volume 26d7d20b-7f34-4e38-b6fc-66570f1e4250
Oct 18 11:54:40 user nova-compute[74190]: INFO nova.virt.block_device [None req-36aa86a3-733d-4caa-a345-090b6e4ca6b0 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] Attempting to driver detach volume 26d7d20b-7f34-4e38-b6fc-66570f1e4250 from mountpoint /dev/vdb
Oct 18 11:54:40 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-1640aef3-aedd-4f56-b53c-5c960efbb6d3 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.364s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:54:40 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-1640aef3-aedd-4f56-b53c-5c960efbb6d3 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] <== connect_volume: return (1365ms) {'type': 'block', 'scsi_wwn': '23465626533633562', 'path': '/dev/sdf'} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:54:40 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1640aef3-aedd-4f56-b53c-5c960efbb6d3 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: 47ed3fb0-c159-484f-8380-79b5564d0ac1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23465626533633562', 'path': '/dev/sdf'} {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 11:54:40 user nova-compute[74190]: DEBUG nova.objects.instance [None req-1640aef3-aedd-4f56-b53c-5c960efbb6d3 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lazy-loading 'flavor' on Instance uuid 47ed3fb0-c159-484f-8380-79b5564d0ac1 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:54:40 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-36aa86a3-733d-4caa-a345-090b6e4ca6b0 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Attempting to detach device vdb from instance 8eec9cde-3553-4fc8-9162-cda963d1a81e from the persistent domain config. {{(pid=74190) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 18 11:54:40 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-36aa86a3-733d-4caa-a345-090b6e4ca6b0 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 11:54:40 user nova-compute[74190]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 11:54:40 user nova-compute[74190]:   <source dev="/dev/sde"/>
Oct 18 11:54:40 user nova-compute[74190]:   <target dev="vdb" bus="virtio"/>
Oct 18 11:54:40 user nova-compute[74190]:   <serial>26d7d20b-7f34-4e38-b6fc-66570f1e4250</serial>
Oct 18 11:54:40 user nova-compute[74190]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 18 11:54:40 user nova-compute[74190]: </disk>
Oct 18 11:54:40 user nova-compute[74190]:  {{(pid=74190) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 11:54:40 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-36aa86a3-733d-4caa-a345-090b6e4ca6b0 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Successfully detached device vdb from instance 8eec9cde-3553-4fc8-9162-cda963d1a81e from the persistent domain config.
Oct 18 11:54:40 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-36aa86a3-733d-4caa-a345-090b6e4ca6b0 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8eec9cde-3553-4fc8-9162-cda963d1a81e from the live domain config. {{(pid=74190) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 18 11:54:40 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-36aa86a3-733d-4caa-a345-090b6e4ca6b0 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 11:54:40 user nova-compute[74190]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 11:54:40 user nova-compute[74190]:   <source dev="/dev/sde"/>
Oct 18 11:54:40 user nova-compute[74190]:   <target dev="vdb" bus="virtio"/>
Oct 18 11:54:40 user nova-compute[74190]:   <serial>26d7d20b-7f34-4e38-b6fc-66570f1e4250</serial>
Oct 18 11:54:40 user nova-compute[74190]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 18 11:54:40 user nova-compute[74190]: </disk>
Oct 18 11:54:40 user nova-compute[74190]:  {{(pid=74190) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 11:54:40 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-1640aef3-aedd-4f56-b53c-5c960efbb6d3 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] attach device xml: <disk type="block" device="disk">
Oct 18 11:54:40 user nova-compute[74190]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 11:54:40 user nova-compute[74190]:   <source dev="/dev/sdf"/>
Oct 18 11:54:40 user nova-compute[74190]:   <target dev="vdb" bus="virtio"/>
Oct 18 11:54:40 user nova-compute[74190]:   <serial>7c03633a-f8e8-41ca-be64-1261c907bb2b</serial>
Oct 18 11:54:40 user nova-compute[74190]: </disk>
Oct 18 11:54:40 user nova-compute[74190]:  {{(pid=74190) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 18 11:54:40 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:41 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-1640aef3-aedd-4f56-b53c-5c960efbb6d3 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] No BDM found with device name vda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 11:54:41 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-1640aef3-aedd-4f56-b53c-5c960efbb6d3 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 11:54:41 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-1640aef3-aedd-4f56-b53c-5c960efbb6d3 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] No VIF found with MAC fa:16:3e:4b:2c:c3, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 11:54:41 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-1640aef3-aedd-4f56-b53c-5c960efbb6d3 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lock "47ed3fb0-c159-484f-8380-79b5564d0ac1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.956s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:54:41 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-36aa86a3-733d-4caa-a345-090b6e4ca6b0 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8eec9cde-3553-4fc8-9162-cda963d1a81e {{(pid=74190) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 18 11:54:43 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:43 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-31d2fe13-2476-4805-ae07-2b8f4aded5d2 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Acquiring lock "31a86ab2-d72d-4274-b5a6-84c5c4bdfc01" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:54:43 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-31d2fe13-2476-4805-ae07-2b8f4aded5d2 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Lock "31a86ab2-d72d-4274-b5a6-84c5c4bdfc01" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:54:43 user nova-compute[74190]: DEBUG nova.compute.manager [None req-31d2fe13-2476-4805-ae07-2b8f4aded5d2 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] [instance: 31a86ab2-d72d-4274-b5a6-84c5c4bdfc01] Starting instance... {{(pid=74190) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 11:54:43 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-31d2fe13-2476-4805-ae07-2b8f4aded5d2 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:54:43 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-31d2fe13-2476-4805-ae07-2b8f4aded5d2 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:54:43 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-31d2fe13-2476-4805-ae07-2b8f4aded5d2 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74190) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 11:54:43 user nova-compute[74190]: INFO nova.compute.claims [None req-31d2fe13-2476-4805-ae07-2b8f4aded5d2 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] [instance: 31a86ab2-d72d-4274-b5a6-84c5c4bdfc01] Claim successful on node user
Oct 18 11:54:44 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-31d2fe13-2476-4805-ae07-2b8f4aded5d2 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 11:54:44 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-31d2fe13-2476-4805-ae07-2b8f4aded5d2 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 11:54:44 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-31d2fe13-2476-4805-ae07-2b8f4aded5d2 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.419s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:54:44 user nova-compute[74190]: DEBUG nova.compute.manager [None req-31d2fe13-2476-4805-ae07-2b8f4aded5d2 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] [instance: 31a86ab2-d72d-4274-b5a6-84c5c4bdfc01] Start building networks asynchronously for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 11:54:44 user nova-compute[74190]: DEBUG nova.compute.manager [None req-31d2fe13-2476-4805-ae07-2b8f4aded5d2 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] [instance: 31a86ab2-d72d-4274-b5a6-84c5c4bdfc01] Allocating IP information in the background. {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 11:54:44 user nova-compute[74190]: DEBUG nova.network.neutron [None req-31d2fe13-2476-4805-ae07-2b8f4aded5d2 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] [instance: 31a86ab2-d72d-4274-b5a6-84c5c4bdfc01] allocate_for_instance() {{(pid=74190) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 11:54:44 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-31d2fe13-2476-4805-ae07-2b8f4aded5d2 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] [instance: 31a86ab2-d72d-4274-b5a6-84c5c4bdfc01] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 11:54:44 user nova-compute[74190]: DEBUG nova.compute.manager [None req-31d2fe13-2476-4805-ae07-2b8f4aded5d2 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] [instance: 31a86ab2-d72d-4274-b5a6-84c5c4bdfc01] Start building block device mappings for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 11:54:44 user nova-compute[74190]: DEBUG nova.policy [None req-31d2fe13-2476-4805-ae07-2b8f4aded5d2 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'adbb4169207e403187eeb180b304b632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49002c1f5044a13b4c70aa5cc9bf45e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74190) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 11:54:44 user nova-compute[74190]: DEBUG nova.compute.manager [None req-31d2fe13-2476-4805-ae07-2b8f4aded5d2 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] [instance: 31a86ab2-d72d-4274-b5a6-84c5c4bdfc01] Start spawning the instance on the hypervisor. {{(pid=74190) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 11:54:44 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-31d2fe13-2476-4805-ae07-2b8f4aded5d2 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] [instance: 31a86ab2-d72d-4274-b5a6-84c5c4bdfc01] Creating instance directory {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 11:54:44 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-31d2fe13-2476-4805-ae07-2b8f4aded5d2 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] [instance: 31a86ab2-d72d-4274-b5a6-84c5c4bdfc01] Creating image(s)
Oct 18 11:54:44 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-31d2fe13-2476-4805-ae07-2b8f4aded5d2 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Acquiring lock "/opt/stack/data/nova/instances/31a86ab2-d72d-4274-b5a6-84c5c4bdfc01/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:54:44 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-31d2fe13-2476-4805-ae07-2b8f4aded5d2 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Lock "/opt/stack/data/nova/instances/31a86ab2-d72d-4274-b5a6-84c5c4bdfc01/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:54:44 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-31d2fe13-2476-4805-ae07-2b8f4aded5d2 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Lock "/opt/stack/data/nova/instances/31a86ab2-d72d-4274-b5a6-84c5c4bdfc01/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:54:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-31d2fe13-2476-4805-ae07-2b8f4aded5d2 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-31d2fe13-2476-4805-ae07-2b8f4aded5d2 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.183s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:44 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-31d2fe13-2476-4805-ae07-2b8f4aded5d2 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Acquiring lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:54:44 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-31d2fe13-2476-4805-ae07-2b8f4aded5d2 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:54:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-31d2fe13-2476-4805-ae07-2b8f4aded5d2 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:44 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-31d2fe13-2476-4805-ae07-2b8f4aded5d2 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.186s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-31d2fe13-2476-4805-ae07-2b8f4aded5d2 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f,backing_fmt=raw /opt/stack/data/nova/instances/31a86ab2-d72d-4274-b5a6-84c5c4bdfc01/disk 1073741824 {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-31d2fe13-2476-4805-ae07-2b8f4aded5d2 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f,backing_fmt=raw /opt/stack/data/nova/instances/31a86ab2-d72d-4274-b5a6-84c5c4bdfc01/disk 1073741824" returned: 0 in 0.062s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:44 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-31d2fe13-2476-4805-ae07-2b8f4aded5d2 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:54:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-31d2fe13-2476-4805-ae07-2b8f4aded5d2 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:45 user nova-compute[74190]: DEBUG nova.network.neutron [None req-31d2fe13-2476-4805-ae07-2b8f4aded5d2 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] [instance: 31a86ab2-d72d-4274-b5a6-84c5c4bdfc01] Successfully created port: 5c59d9a0-1a31-4096-a5aa-ca1e4f46d0fc {{(pid=74190) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 11:54:45 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-31d2fe13-2476-4805-ae07-2b8f4aded5d2 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.188s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:45 user nova-compute[74190]: DEBUG nova.virt.disk.api [None req-31d2fe13-2476-4805-ae07-2b8f4aded5d2 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Checking if we can resize image /opt/stack/data/nova/instances/31a86ab2-d72d-4274-b5a6-84c5c4bdfc01/disk. size=1073741824 {{(pid=74190) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 18 11:54:45 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-31d2fe13-2476-4805-ae07-2b8f4aded5d2 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31a86ab2-d72d-4274-b5a6-84c5c4bdfc01/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:45 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-31d2fe13-2476-4805-ae07-2b8f4aded5d2 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31a86ab2-d72d-4274-b5a6-84c5c4bdfc01/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:45 user nova-compute[74190]: DEBUG nova.virt.disk.api [None req-31d2fe13-2476-4805-ae07-2b8f4aded5d2 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Cannot resize image /opt/stack/data/nova/instances/31a86ab2-d72d-4274-b5a6-84c5c4bdfc01/disk to a smaller size. {{(pid=74190) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 18 11:54:45 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-31d2fe13-2476-4805-ae07-2b8f4aded5d2 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] [instance: 31a86ab2-d72d-4274-b5a6-84c5c4bdfc01] Created local disks {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 11:54:45 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-31d2fe13-2476-4805-ae07-2b8f4aded5d2 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] [instance: 31a86ab2-d72d-4274-b5a6-84c5c4bdfc01] Ensure instance console log exists: /opt/stack/data/nova/instances/31a86ab2-d72d-4274-b5a6-84c5c4bdfc01/console.log {{(pid=74190) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 11:54:45 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-31d2fe13-2476-4805-ae07-2b8f4aded5d2 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:54:45 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-31d2fe13-2476-4805-ae07-2b8f4aded5d2 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:54:45 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-31d2fe13-2476-4805-ae07-2b8f4aded5d2 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:54:45 user nova-compute[74190]: DEBUG nova.network.neutron [None req-31d2fe13-2476-4805-ae07-2b8f4aded5d2 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] [instance: 31a86ab2-d72d-4274-b5a6-84c5c4bdfc01] Successfully updated port: 5c59d9a0-1a31-4096-a5aa-ca1e4f46d0fc {{(pid=74190) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 11:54:45 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-31d2fe13-2476-4805-ae07-2b8f4aded5d2 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Acquiring lock "refresh_cache-31a86ab2-d72d-4274-b5a6-84c5c4bdfc01" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:54:45 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-31d2fe13-2476-4805-ae07-2b8f4aded5d2 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Acquired lock "refresh_cache-31a86ab2-d72d-4274-b5a6-84c5c4bdfc01" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:54:45 user nova-compute[74190]: DEBUG nova.network.neutron [None req-31d2fe13-2476-4805-ae07-2b8f4aded5d2 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] [instance: 31a86ab2-d72d-4274-b5a6-84c5c4bdfc01] Building network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 11:54:45 user nova-compute[74190]: DEBUG nova.compute.manager [req-4e9c6019-3170-47d9-8e69-168ad2c35314 req-4b1b2650-a26b-45a4-b5f3-8288e0136afc service nova] [instance: 31a86ab2-d72d-4274-b5a6-84c5c4bdfc01] Received event network-changed-5c59d9a0-1a31-4096-a5aa-ca1e4f46d0fc {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:54:45 user nova-compute[74190]: DEBUG nova.compute.manager [req-4e9c6019-3170-47d9-8e69-168ad2c35314 req-4b1b2650-a26b-45a4-b5f3-8288e0136afc service nova] [instance: 31a86ab2-d72d-4274-b5a6-84c5c4bdfc01] Refreshing instance network info cache due to event network-changed-5c59d9a0-1a31-4096-a5aa-ca1e4f46d0fc. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 11:54:45 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-4e9c6019-3170-47d9-8e69-168ad2c35314 req-4b1b2650-a26b-45a4-b5f3-8288e0136afc service nova] Acquiring lock "refresh_cache-31a86ab2-d72d-4274-b5a6-84c5c4bdfc01" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:54:45 user nova-compute[74190]: DEBUG nova.network.neutron [None req-31d2fe13-2476-4805-ae07-2b8f4aded5d2 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] [instance: 31a86ab2-d72d-4274-b5a6-84c5c4bdfc01] Instance cache missing network info. {{(pid=74190) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 11:54:46 user nova-compute[74190]: DEBUG nova.network.neutron [None req-31d2fe13-2476-4805-ae07-2b8f4aded5d2 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] [instance: 31a86ab2-d72d-4274-b5a6-84c5c4bdfc01] Updating instance_info_cache with network_info: [{"id": "5c59d9a0-1a31-4096-a5aa-ca1e4f46d0fc", "address": "fa:16:3e:25:cc:e5", "network": {"id": "0a2d5316-a012-43d3-a7c7-54b8cff14dca", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1175284376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c49002c1f5044a13b4c70aa5cc9bf45e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c59d9a0-1a", "ovs_interfaceid": "5c59d9a0-1a31-4096-a5aa-ca1e4f46d0fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:54:46 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-31d2fe13-2476-4805-ae07-2b8f4aded5d2 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Releasing lock "refresh_cache-31a86ab2-d72d-4274-b5a6-84c5c4bdfc01" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:54:46 user nova-compute[74190]: DEBUG nova.compute.manager [None req-31d2fe13-2476-4805-ae07-2b8f4aded5d2 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] [instance: 31a86ab2-d72d-4274-b5a6-84c5c4bdfc01] Instance network_info: |[{"id": "5c59d9a0-1a31-4096-a5aa-ca1e4f46d0fc", "address": "fa:16:3e:25:cc:e5", "network": {"id": "0a2d5316-a012-43d3-a7c7-54b8cff14dca", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1175284376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c49002c1f5044a13b4c70aa5cc9bf45e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c59d9a0-1a", "ovs_interfaceid": "5c59d9a0-1a31-4096-a5aa-ca1e4f46d0fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 11:54:46 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-4e9c6019-3170-47d9-8e69-168ad2c35314 req-4b1b2650-a26b-45a4-b5f3-8288e0136afc service nova] Acquired lock "refresh_cache-31a86ab2-d72d-4274-b5a6-84c5c4bdfc01" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:54:46 user nova-compute[74190]: DEBUG nova.network.neutron [req-4e9c6019-3170-47d9-8e69-168ad2c35314 req-4b1b2650-a26b-45a4-b5f3-8288e0136afc service nova] [instance: 31a86ab2-d72d-4274-b5a6-84c5c4bdfc01] Refreshing network info cache for port 5c59d9a0-1a31-4096-a5aa-ca1e4f46d0fc {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 11:54:46 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-31d2fe13-2476-4805-ae07-2b8f4aded5d2 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] [instance: 31a86ab2-d72d-4274-b5a6-84c5c4bdfc01] Start _get_guest_xml network_info=[{"id": "5c59d9a0-1a31-4096-a5aa-ca1e4f46d0fc", "address": "fa:16:3e:25:cc:e5", "network": {"id": "0a2d5316-a012-43d3-a7c7-54b8cff14dca", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1175284376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c49002c1f5044a13b4c70aa5cc9bf45e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c59d9a0-1a", "ovs_interfaceid": "5c59d9a0-1a31-4096-a5aa-ca1e4f46d0fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'image_id': '6e88bbf0-6e78-49a8-b3c5-9453d22a89df'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 11:54:46 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-31d2fe13-2476-4805-ae07-2b8f4aded5d2 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:54:46 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-31d2fe13-2476-4805-ae07-2b8f4aded5d2 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:54:46 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-31d2fe13-2476-4805-ae07-2b8f4aded5d2 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 11:54:46 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-31d2fe13-2476-4805-ae07-2b8f4aded5d2 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] CPU controller missing on host. {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 11:54:46 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-31d2fe13-2476-4805-ae07-2b8f4aded5d2 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 11:54:46 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-31d2fe13-2476-4805-ae07-2b8f4aded5d2 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] CPU controller found on host. {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 11:54:46 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-31d2fe13-2476-4805-ae07-2b8f4aded5d2 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74190) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 11:54:46 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-31d2fe13-2476-4805-ae07-2b8f4aded5d2 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T11:37:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 11:54:46 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-31d2fe13-2476-4805-ae07-2b8f4aded5d2 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Flavor limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 11:54:46 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-31d2fe13-2476-4805-ae07-2b8f4aded5d2 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Image limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 11:54:46 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-31d2fe13-2476-4805-ae07-2b8f4aded5d2 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Flavor pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 11:54:46 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-31d2fe13-2476-4805-ae07-2b8f4aded5d2 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Image pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 11:54:46 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-31d2fe13-2476-4805-ae07-2b8f4aded5d2 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 11:54:46 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-31d2fe13-2476-4805-ae07-2b8f4aded5d2 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 11:54:46 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-31d2fe13-2476-4805-ae07-2b8f4aded5d2 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 11:54:46 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-31d2fe13-2476-4805-ae07-2b8f4aded5d2 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Got 1 possible topologies {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 11:54:46 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-31d2fe13-2476-4805-ae07-2b8f4aded5d2 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 11:54:46 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-31d2fe13-2476-4805-ae07-2b8f4aded5d2 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 11:54:46 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-31d2fe13-2476-4805-ae07-2b8f4aded5d2 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:54:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1987002089',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1987002089',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1987002',id=26,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAp1pyualrt+ClKnRPPGTl9IqX5o+FXRgWE2Anaz/U3+mO/cfgwkEem3BGWxgaKTCFw/B19g1u7AupjN2mjHajBqQNfxbk7e5EWfS5S5bbUkxpwb+w5+dI/yfcNzSls4XQ==',key_name='tempest-keypair-738545322',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c49002c1f5044a13b4c70aa5cc9bf45e',ramdisk_id='',reservation_id='r-orx2sciz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1464642078',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:54:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='adbb4169207e403187eeb180b304b632',uuid=31a86ab2-d72d-4274-b5a6-84c5c4bdfc01,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5c59d9a0-1a31-4096-a5aa-ca1e4f46d0fc", "address": "fa:16:3e:25:cc:e5", "network": {"id": "0a2d5316-a012-43d3-a7c7-54b8cff14dca", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1175284376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c49002c1f5044a13b4c70aa5cc9bf45e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c59d9a0-1a", "ovs_interfaceid": "5c59d9a0-1a31-4096-a5aa-ca1e4f46d0fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74190) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 11:54:46 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-31d2fe13-2476-4805-ae07-2b8f4aded5d2 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Converting VIF {"id": "5c59d9a0-1a31-4096-a5aa-ca1e4f46d0fc", "address": "fa:16:3e:25:cc:e5", "network": {"id": "0a2d5316-a012-43d3-a7c7-54b8cff14dca", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1175284376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c49002c1f5044a13b4c70aa5cc9bf45e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c59d9a0-1a", "ovs_interfaceid": "5c59d9a0-1a31-4096-a5aa-ca1e4f46d0fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:54:46 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-31d2fe13-2476-4805-ae07-2b8f4aded5d2 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:cc:e5,bridge_name='br-int',has_traffic_filtering=True,id=5c59d9a0-1a31-4096-a5aa-ca1e4f46d0fc,network=Network(0a2d5316-a012-43d3-a7c7-54b8cff14dca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c59d9a0-1a') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:54:46 user nova-compute[74190]: DEBUG nova.objects.instance [None req-31d2fe13-2476-4805-ae07-2b8f4aded5d2 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Lazy-loading 'pci_devices' on Instance uuid 31a86ab2-d72d-4274-b5a6-84c5c4bdfc01 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:54:46 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-31d2fe13-2476-4805-ae07-2b8f4aded5d2 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] [instance: 31a86ab2-d72d-4274-b5a6-84c5c4bdfc01] End _get_guest_xml xml=<domain type="kvm">
Oct 18 11:54:46 user nova-compute[74190]:   <uuid>31a86ab2-d72d-4274-b5a6-84c5c4bdfc01</uuid>
Oct 18 11:54:46 user nova-compute[74190]:   <name>instance-0000001a</name>
Oct 18 11:54:46 user nova-compute[74190]:   <memory>524288</memory>
Oct 18 11:54:46 user nova-compute[74190]:   <vcpu>1</vcpu>
Oct 18 11:54:46 user nova-compute[74190]:   <metadata>
Oct 18 11:54:46 user nova-compute[74190]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 11:54:46 user nova-compute[74190]:       <nova:package version="0.0.0"/>
Oct 18 11:54:46 user nova-compute[74190]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1987002089</nova:name>
Oct 18 11:54:46 user nova-compute[74190]:       <nova:creationTime>2023-10-18 11:54:46</nova:creationTime>
Oct 18 11:54:46 user nova-compute[74190]:       <nova:flavor name="m1.tiny">
Oct 18 11:54:46 user nova-compute[74190]:         <nova:memory>512</nova:memory>
Oct 18 11:54:46 user nova-compute[74190]:         <nova:disk>1</nova:disk>
Oct 18 11:54:46 user nova-compute[74190]:         <nova:swap>0</nova:swap>
Oct 18 11:54:46 user nova-compute[74190]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 11:54:46 user nova-compute[74190]:         <nova:vcpus>1</nova:vcpus>
Oct 18 11:54:46 user nova-compute[74190]:       </nova:flavor>
Oct 18 11:54:46 user nova-compute[74190]:       <nova:owner>
Oct 18 11:54:46 user nova-compute[74190]:         <nova:user uuid="adbb4169207e403187eeb180b304b632">tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member</nova:user>
Oct 18 11:54:46 user nova-compute[74190]:         <nova:project uuid="c49002c1f5044a13b4c70aa5cc9bf45e">tempest-TestServerVolumeAttachScenarioOldVersion-1464642078</nova:project>
Oct 18 11:54:46 user nova-compute[74190]:       </nova:owner>
Oct 18 11:54:46 user nova-compute[74190]:       <nova:root type="image" uuid="6e88bbf0-6e78-49a8-b3c5-9453d22a89df"/>
Oct 18 11:54:46 user nova-compute[74190]:       <nova:ports>
Oct 18 11:54:46 user nova-compute[74190]:         <nova:port uuid="5c59d9a0-1a31-4096-a5aa-ca1e4f46d0fc">
Oct 18 11:54:46 user nova-compute[74190]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 18 11:54:46 user nova-compute[74190]:         </nova:port>
Oct 18 11:54:46 user nova-compute[74190]:       </nova:ports>
Oct 18 11:54:46 user nova-compute[74190]:     </nova:instance>
Oct 18 11:54:46 user nova-compute[74190]:   </metadata>
Oct 18 11:54:46 user nova-compute[74190]:   <sysinfo type="smbios">
Oct 18 11:54:46 user nova-compute[74190]:     <system>
Oct 18 11:54:46 user nova-compute[74190]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 11:54:46 user nova-compute[74190]:       <entry name="product">OpenStack Nova</entry>
Oct 18 11:54:46 user nova-compute[74190]:       <entry name="version">0.0.0</entry>
Oct 18 11:54:46 user nova-compute[74190]:       <entry name="serial">31a86ab2-d72d-4274-b5a6-84c5c4bdfc01</entry>
Oct 18 11:54:46 user nova-compute[74190]:       <entry name="uuid">31a86ab2-d72d-4274-b5a6-84c5c4bdfc01</entry>
Oct 18 11:54:46 user nova-compute[74190]:       <entry name="family">Virtual Machine</entry>
Oct 18 11:54:46 user nova-compute[74190]:     </system>
Oct 18 11:54:46 user nova-compute[74190]:   </sysinfo>
Oct 18 11:54:46 user nova-compute[74190]:   <os>
Oct 18 11:54:46 user nova-compute[74190]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 11:54:46 user nova-compute[74190]:     <boot dev="hd"/>
Oct 18 11:54:46 user nova-compute[74190]:     <smbios mode="sysinfo"/>
Oct 18 11:54:46 user nova-compute[74190]:   </os>
Oct 18 11:54:46 user nova-compute[74190]:   <features>
Oct 18 11:54:46 user nova-compute[74190]:     <acpi/>
Oct 18 11:54:46 user nova-compute[74190]:     <apic/>
Oct 18 11:54:46 user nova-compute[74190]:     <vmcoreinfo/>
Oct 18 11:54:46 user nova-compute[74190]:   </features>
Oct 18 11:54:46 user nova-compute[74190]:   <clock offset="utc">
Oct 18 11:54:46 user nova-compute[74190]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 11:54:46 user nova-compute[74190]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 11:54:46 user nova-compute[74190]:     <timer name="hpet" present="no"/>
Oct 18 11:54:46 user nova-compute[74190]:   </clock>
Oct 18 11:54:46 user nova-compute[74190]:   <cpu mode="custom" match="exact">
Oct 18 11:54:46 user nova-compute[74190]:     <model>Nehalem</model>
Oct 18 11:54:46 user nova-compute[74190]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 11:54:46 user nova-compute[74190]:   </cpu>
Oct 18 11:54:46 user nova-compute[74190]:   <devices>
Oct 18 11:54:46 user nova-compute[74190]:     <disk type="file" device="disk">
Oct 18 11:54:46 user nova-compute[74190]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 11:54:46 user nova-compute[74190]:       <source file="/opt/stack/data/nova/instances/31a86ab2-d72d-4274-b5a6-84c5c4bdfc01/disk"/>
Oct 18 11:54:46 user nova-compute[74190]:       <target dev="vda" bus="virtio"/>
Oct 18 11:54:46 user nova-compute[74190]:     </disk>
Oct 18 11:54:46 user nova-compute[74190]:     <interface type="ethernet">
Oct 18 11:54:46 user nova-compute[74190]:       <mac address="fa:16:3e:25:cc:e5"/>
Oct 18 11:54:46 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:54:46 user nova-compute[74190]:       <mtu size="1442"/>
Oct 18 11:54:46 user nova-compute[74190]:       <target dev="tap5c59d9a0-1a"/>
Oct 18 11:54:46 user nova-compute[74190]:     </interface>
Oct 18 11:54:46 user nova-compute[74190]:     <serial type="pty">
Oct 18 11:54:46 user nova-compute[74190]:       <log file="/opt/stack/data/nova/instances/31a86ab2-d72d-4274-b5a6-84c5c4bdfc01/console.log" append="off"/>
Oct 18 11:54:46 user nova-compute[74190]:     </serial>
Oct 18 11:54:46 user nova-compute[74190]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 11:54:46 user nova-compute[74190]:     <video>
Oct 18 11:54:46 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:54:46 user nova-compute[74190]:     </video>
Oct 18 11:54:46 user nova-compute[74190]:     <rng model="virtio">
Oct 18 11:54:46 user nova-compute[74190]:       <backend model="random">/dev/urandom</backend>
Oct 18 11:54:46 user nova-compute[74190]:     </rng>
Oct 18 11:54:46 user nova-compute[74190]:     <controller type="usb" index="0" model="none"/>
Oct 18 11:54:46 user nova-compute[74190]:     <memballoon model="virtio">
Oct 18 11:54:46 user nova-compute[74190]:       <stats period="10"/>
Oct 18 11:54:46 user nova-compute[74190]:     </memballoon>
Oct 18 11:54:46 user nova-compute[74190]:   </devices>
Oct 18 11:54:46 user nova-compute[74190]: </domain>
Oct 18 11:54:46 user nova-compute[74190]:  {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 11:54:46 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-31d2fe13-2476-4805-ae07-2b8f4aded5d2 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:54:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1987002089',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1987002089',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1987002',id=26,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAp1pyualrt+ClKnRPPGTl9IqX5o+FXRgWE2Anaz/U3+mO/cfgwkEem3BGWxgaKTCFw/B19g1u7AupjN2mjHajBqQNfxbk7e5EWfS5S5bbUkxpwb+w5+dI/yfcNzSls4XQ==',key_name='tempest-keypair-738545322',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c49002c1f5044a13b4c70aa5cc9bf45e',ramdisk_id='',reservation_id='r-orx2sciz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1464642078',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:54:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='adbb4169207e403187eeb180b304b632',uuid=31a86ab2-d72d-4274-b5a6-84c5c4bdfc01,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5c59d9a0-1a31-4096-a5aa-ca1e4f46d0fc", "address": "fa:16:3e:25:cc:e5", "network": {"id": "0a2d5316-a012-43d3-a7c7-54b8cff14dca", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1175284376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c49002c1f5044a13b4c70aa5cc9bf45e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c59d9a0-1a", "ovs_interfaceid": "5c59d9a0-1a31-4096-a5aa-ca1e4f46d0fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 11:54:46 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-31d2fe13-2476-4805-ae07-2b8f4aded5d2 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Converting VIF {"id": "5c59d9a0-1a31-4096-a5aa-ca1e4f46d0fc", "address": "fa:16:3e:25:cc:e5", "network": {"id": "0a2d5316-a012-43d3-a7c7-54b8cff14dca", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1175284376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c49002c1f5044a13b4c70aa5cc9bf45e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c59d9a0-1a", "ovs_interfaceid": "5c59d9a0-1a31-4096-a5aa-ca1e4f46d0fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:54:46 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-31d2fe13-2476-4805-ae07-2b8f4aded5d2 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:cc:e5,bridge_name='br-int',has_traffic_filtering=True,id=5c59d9a0-1a31-4096-a5aa-ca1e4f46d0fc,network=Network(0a2d5316-a012-43d3-a7c7-54b8cff14dca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c59d9a0-1a') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:54:46 user nova-compute[74190]: DEBUG os_vif [None req-31d2fe13-2476-4805-ae07-2b8f4aded5d2 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:cc:e5,bridge_name='br-int',has_traffic_filtering=True,id=5c59d9a0-1a31-4096-a5aa-ca1e4f46d0fc,network=Network(0a2d5316-a012-43d3-a7c7-54b8cff14dca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c59d9a0-1a') {{(pid=74190) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 11:54:46 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:46 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:54:46 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 11:54:46 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:46 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '94ef187c-4269-54a6-9aa4-fee686e0a98f', '_type': 'linux-noop'}}, row=False) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:54:46 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:46 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:54:46 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:46 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5c59d9a0-1a, may_exist=True, interface_attrs={}) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:54:46 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5c59d9a0-1a, col_values=(('qos', UUID('edb27d67-4d48-4330-ac3e-6241483ae390')),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:54:46 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5c59d9a0-1a, col_values=(('external_ids', {'iface-id': '5c59d9a0-1a31-4096-a5aa-ca1e4f46d0fc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:25:cc:e5', 'vm-uuid': '31a86ab2-d72d-4274-b5a6-84c5c4bdfc01'}),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:54:46 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:46 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:54:46 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:46 user nova-compute[74190]: INFO os_vif [None req-31d2fe13-2476-4805-ae07-2b8f4aded5d2 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:cc:e5,bridge_name='br-int',has_traffic_filtering=True,id=5c59d9a0-1a31-4096-a5aa-ca1e4f46d0fc,network=Network(0a2d5316-a012-43d3-a7c7-54b8cff14dca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c59d9a0-1a')
Oct 18 11:54:46 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-31d2fe13-2476-4805-ae07-2b8f4aded5d2 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] No BDM found with device name vda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 11:54:46 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-31d2fe13-2476-4805-ae07-2b8f4aded5d2 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] No VIF found with MAC fa:16:3e:25:cc:e5, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 11:54:46 user nova-compute[74190]: DEBUG nova.network.neutron [req-4e9c6019-3170-47d9-8e69-168ad2c35314 req-4b1b2650-a26b-45a4-b5f3-8288e0136afc service nova] [instance: 31a86ab2-d72d-4274-b5a6-84c5c4bdfc01] Updated VIF entry in instance network info cache for port 5c59d9a0-1a31-4096-a5aa-ca1e4f46d0fc. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 11:54:46 user nova-compute[74190]: DEBUG nova.network.neutron [req-4e9c6019-3170-47d9-8e69-168ad2c35314 req-4b1b2650-a26b-45a4-b5f3-8288e0136afc service nova] [instance: 31a86ab2-d72d-4274-b5a6-84c5c4bdfc01] Updating instance_info_cache with network_info: [{"id": "5c59d9a0-1a31-4096-a5aa-ca1e4f46d0fc", "address": "fa:16:3e:25:cc:e5", "network": {"id": "0a2d5316-a012-43d3-a7c7-54b8cff14dca", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1175284376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c49002c1f5044a13b4c70aa5cc9bf45e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c59d9a0-1a", "ovs_interfaceid": "5c59d9a0-1a31-4096-a5aa-ca1e4f46d0fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:54:46 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-4e9c6019-3170-47d9-8e69-168ad2c35314 req-4b1b2650-a26b-45a4-b5f3-8288e0136afc service nova] Releasing lock "refresh_cache-31a86ab2-d72d-4274-b5a6-84c5c4bdfc01" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:54:46 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-d8757507-6f7d-4d26-b5e9-da9fcbbd2e40 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Acquiring lock "47ed3fb0-c159-484f-8380-79b5564d0ac1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:54:46 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-d8757507-6f7d-4d26-b5e9-da9fcbbd2e40 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lock "47ed3fb0-c159-484f-8380-79b5564d0ac1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:54:46 user nova-compute[74190]: DEBUG nova.objects.instance [None req-d8757507-6f7d-4d26-b5e9-da9fcbbd2e40 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lazy-loading 'flavor' on Instance uuid 47ed3fb0-c159-484f-8380-79b5564d0ac1 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:54:46 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-d8757507-6f7d-4d26-b5e9-da9fcbbd2e40 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lock "47ed3fb0-c159-484f-8380-79b5564d0ac1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:54:46 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-d8757507-6f7d-4d26-b5e9-da9fcbbd2e40 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Acquiring lock "47ed3fb0-c159-484f-8380-79b5564d0ac1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:54:46 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-d8757507-6f7d-4d26-b5e9-da9fcbbd2e40 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lock "47ed3fb0-c159-484f-8380-79b5564d0ac1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:54:46 user nova-compute[74190]: INFO nova.compute.manager [None req-d8757507-6f7d-4d26-b5e9-da9fcbbd2e40 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: 47ed3fb0-c159-484f-8380-79b5564d0ac1] Attaching volume f9e5036f-2095-4ea5-bcf5-e4d952b21ab1 to /dev/vdc
Oct 18 11:54:46 user nova-compute[74190]: DEBUG os_brick.utils [None req-d8757507-6f7d-4d26-b5e9-da9fcbbd2e40 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:54:46 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:46 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:46 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[1257104c-cf92-4750-939d-5241fa4dd78b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cff158e257e1\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:54:46 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:46 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:46 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c132c5-7ede-499e-be50-960e81c5047b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:54:46 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:47 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:47 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[7073916e-0759-4ecb-8794-c5345c3451e8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:54:47 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce013209-86d4-4163-9080-34b3ce7c198a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:54:47 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-d8757507-6f7d-4d26-b5e9-da9fcbbd2e40 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Running cmd (subprocess): nvme version {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:47 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-d8757507-6f7d-4d26-b5e9-da9fcbbd2e40 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] 'nvme version' failed. Not Retrying. {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 11:54:47 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d8757507-6f7d-4d26-b5e9-da9fcbbd2e40 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] nvme not present on system {{(pid=74190) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 11:54:47 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:47 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 11:54:47 user nova-compute[74190]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 11:54:47 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e96d61-c327-4513-a8a3-c58af4826d7d]: (4, '') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:54:47 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-d8757507-6f7d-4d26-b5e9-da9fcbbd2e40 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74190) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 11:54:47 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-d8757507-6f7d-4d26-b5e9-da9fcbbd2e40 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 11:54:47 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-d8757507-6f7d-4d26-b5e9-da9fcbbd2e40 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] LIGHTOS: no hostnqn found. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 11:54:47 user nova-compute[74190]: DEBUG os_brick.utils [None req-d8757507-6f7d-4d26-b5e9-da9fcbbd2e40 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cff158e257e1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:54:47 user nova-compute[74190]: DEBUG nova.virt.block_device [None req-d8757507-6f7d-4d26-b5e9-da9fcbbd2e40 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: 47ed3fb0-c159-484f-8380-79b5564d0ac1] Updating existing volume attachment record: aeda89e3-90b3-468a-80af-9bb3d2b139be {{(pid=74190) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 11:54:47 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:47 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:47 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:47 user nova-compute[74190]: DEBUG nova.compute.manager [req-36062c7a-0972-49dc-8a4d-49fd6de6436a req-76d37a9b-af57-4065-bdea-bf8dc0459c18 service nova] [instance: 31a86ab2-d72d-4274-b5a6-84c5c4bdfc01] Received event network-vif-plugged-5c59d9a0-1a31-4096-a5aa-ca1e4f46d0fc {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:54:47 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-36062c7a-0972-49dc-8a4d-49fd6de6436a req-76d37a9b-af57-4065-bdea-bf8dc0459c18 service nova] Acquiring lock "31a86ab2-d72d-4274-b5a6-84c5c4bdfc01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:54:47 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-36062c7a-0972-49dc-8a4d-49fd6de6436a req-76d37a9b-af57-4065-bdea-bf8dc0459c18 service nova] Lock "31a86ab2-d72d-4274-b5a6-84c5c4bdfc01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:54:47 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-36062c7a-0972-49dc-8a4d-49fd6de6436a req-76d37a9b-af57-4065-bdea-bf8dc0459c18 service nova] Lock "31a86ab2-d72d-4274-b5a6-84c5c4bdfc01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:54:47 user nova-compute[74190]: DEBUG nova.compute.manager [req-36062c7a-0972-49dc-8a4d-49fd6de6436a req-76d37a9b-af57-4065-bdea-bf8dc0459c18 service nova] [instance: 31a86ab2-d72d-4274-b5a6-84c5c4bdfc01] No waiting events found dispatching network-vif-plugged-5c59d9a0-1a31-4096-a5aa-ca1e4f46d0fc {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:54:47 user nova-compute[74190]: WARNING nova.compute.manager [req-36062c7a-0972-49dc-8a4d-49fd6de6436a req-76d37a9b-af57-4065-bdea-bf8dc0459c18 service nova] [instance: 31a86ab2-d72d-4274-b5a6-84c5c4bdfc01] Received unexpected event network-vif-plugged-5c59d9a0-1a31-4096-a5aa-ca1e4f46d0fc for instance with vm_state building and task_state spawning.
Oct 18 11:54:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:49 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:49 user nova-compute[74190]: DEBUG nova.compute.manager [req-d66f4266-be65-4551-9be2-7534164b5db2 req-c647b1af-2d2e-446b-9fce-376ff3bca670 service nova] [instance: 31a86ab2-d72d-4274-b5a6-84c5c4bdfc01] Received event network-vif-plugged-5c59d9a0-1a31-4096-a5aa-ca1e4f46d0fc {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:54:49 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d66f4266-be65-4551-9be2-7534164b5db2 req-c647b1af-2d2e-446b-9fce-376ff3bca670 service nova] Acquiring lock "31a86ab2-d72d-4274-b5a6-84c5c4bdfc01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:54:49 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d66f4266-be65-4551-9be2-7534164b5db2 req-c647b1af-2d2e-446b-9fce-376ff3bca670 service nova] Lock "31a86ab2-d72d-4274-b5a6-84c5c4bdfc01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:54:49 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d66f4266-be65-4551-9be2-7534164b5db2 req-c647b1af-2d2e-446b-9fce-376ff3bca670 service nova] Lock "31a86ab2-d72d-4274-b5a6-84c5c4bdfc01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:54:49 user nova-compute[74190]: DEBUG nova.compute.manager [req-d66f4266-be65-4551-9be2-7534164b5db2 req-c647b1af-2d2e-446b-9fce-376ff3bca670 service nova] [instance: 31a86ab2-d72d-4274-b5a6-84c5c4bdfc01] No waiting events found dispatching network-vif-plugged-5c59d9a0-1a31-4096-a5aa-ca1e4f46d0fc {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:54:49 user nova-compute[74190]: WARNING nova.compute.manager [req-d66f4266-be65-4551-9be2-7534164b5db2 req-c647b1af-2d2e-446b-9fce-376ff3bca670 service nova] [instance: 31a86ab2-d72d-4274-b5a6-84c5c4bdfc01] Received unexpected event network-vif-plugged-5c59d9a0-1a31-4096-a5aa-ca1e4f46d0fc for instance with vm_state building and task_state spawning.
Oct 18 11:54:49 user nova-compute[74190]: DEBUG nova.compute.manager [None req-31d2fe13-2476-4805-ae07-2b8f4aded5d2 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] [instance: 31a86ab2-d72d-4274-b5a6-84c5c4bdfc01] Instance event wait completed in 0 seconds for  {{(pid=74190) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 11:54:49 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-31d2fe13-2476-4805-ae07-2b8f4aded5d2 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] [instance: 31a86ab2-d72d-4274-b5a6-84c5c4bdfc01] Guest created on hypervisor {{(pid=74190) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 11:54:50 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 31a86ab2-d72d-4274-b5a6-84c5c4bdfc01] Instance spawned successfully.
Oct 18 11:54:50 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-31d2fe13-2476-4805-ae07-2b8f4aded5d2 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] [instance: 31a86ab2-d72d-4274-b5a6-84c5c4bdfc01] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 11:54:50 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-31d2fe13-2476-4805-ae07-2b8f4aded5d2 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] [instance: 31a86ab2-d72d-4274-b5a6-84c5c4bdfc01] Found default for hw_cdrom_bus of ide {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:54:50 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-31d2fe13-2476-4805-ae07-2b8f4aded5d2 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] [instance: 31a86ab2-d72d-4274-b5a6-84c5c4bdfc01] Found default for hw_disk_bus of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:54:50 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-31d2fe13-2476-4805-ae07-2b8f4aded5d2 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] [instance: 31a86ab2-d72d-4274-b5a6-84c5c4bdfc01] Found default for hw_input_bus of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:54:50 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-31d2fe13-2476-4805-ae07-2b8f4aded5d2 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] [instance: 31a86ab2-d72d-4274-b5a6-84c5c4bdfc01] Found default for hw_pointer_model of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:54:50 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-31d2fe13-2476-4805-ae07-2b8f4aded5d2 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] [instance: 31a86ab2-d72d-4274-b5a6-84c5c4bdfc01] Found default for hw_video_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:54:50 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-31d2fe13-2476-4805-ae07-2b8f4aded5d2 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] [instance: 31a86ab2-d72d-4274-b5a6-84c5c4bdfc01] Found default for hw_vif_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:54:50 user nova-compute[74190]: INFO nova.compute.manager [None req-31d2fe13-2476-4805-ae07-2b8f4aded5d2 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] [instance: 31a86ab2-d72d-4274-b5a6-84c5c4bdfc01] Took 5.59 seconds to spawn the instance on the hypervisor.
Oct 18 11:54:50 user nova-compute[74190]: DEBUG nova.compute.manager [None req-31d2fe13-2476-4805-ae07-2b8f4aded5d2 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] [instance: 31a86ab2-d72d-4274-b5a6-84c5c4bdfc01] Checking state {{(pid=74190) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 11:54:50 user nova-compute[74190]: INFO nova.compute.manager [None req-31d2fe13-2476-4805-ae07-2b8f4aded5d2 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] [instance: 31a86ab2-d72d-4274-b5a6-84c5c4bdfc01] Took 6.40 seconds to build instance.
Oct 18 11:54:50 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-31d2fe13-2476-4805-ae07-2b8f4aded5d2 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Lock "31a86ab2-d72d-4274-b5a6-84c5c4bdfc01" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.552s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:54:51 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:52 user nova-compute[74190]: DEBUG nova.compute.manager [req-0cbe2022-fe57-4900-aedb-5c5f819b0612 req-827dd804-b427-45b3-9e28-25df1e207af3 service nova] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] Received event network-changed-5e4eb783-7e7c-4501-bf99-33472454f4ac {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:54:52 user nova-compute[74190]: DEBUG nova.compute.manager [req-0cbe2022-fe57-4900-aedb-5c5f819b0612 req-827dd804-b427-45b3-9e28-25df1e207af3 service nova] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] Refreshing instance network info cache due to event network-changed-5e4eb783-7e7c-4501-bf99-33472454f4ac. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 11:54:52 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-0cbe2022-fe57-4900-aedb-5c5f819b0612 req-827dd804-b427-45b3-9e28-25df1e207af3 service nova] Acquiring lock "refresh_cache-0209c824-88a7-4976-83bf-8a72437f0cc2" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:54:52 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-0cbe2022-fe57-4900-aedb-5c5f819b0612 req-827dd804-b427-45b3-9e28-25df1e207af3 service nova] Acquired lock "refresh_cache-0209c824-88a7-4976-83bf-8a72437f0cc2" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:54:52 user nova-compute[74190]: DEBUG nova.network.neutron [req-0cbe2022-fe57-4900-aedb-5c5f819b0612 req-827dd804-b427-45b3-9e28-25df1e207af3 service nova] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] Refreshing network info cache for port 5e4eb783-7e7c-4501-bf99-33472454f4ac {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 11:54:53 user nova-compute[74190]: DEBUG nova.network.neutron [req-0cbe2022-fe57-4900-aedb-5c5f819b0612 req-827dd804-b427-45b3-9e28-25df1e207af3 service nova] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] Updated VIF entry in instance network info cache for port 5e4eb783-7e7c-4501-bf99-33472454f4ac. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 11:54:53 user nova-compute[74190]: DEBUG nova.network.neutron [req-0cbe2022-fe57-4900-aedb-5c5f819b0612 req-827dd804-b427-45b3-9e28-25df1e207af3 service nova] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] Updating instance_info_cache with network_info: [{"id": "5e4eb783-7e7c-4501-bf99-33472454f4ac", "address": "fa:16:3e:7e:d2:03", "network": {"id": "f5ab7da4-2b07-4465-9a89-a07eb053ba91", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1315695374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08cf52ce927443158aa731367f08bd57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e4eb783-7e", "ovs_interfaceid": "5e4eb783-7e7c-4501-bf99-33472454f4ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:54:53 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-0cbe2022-fe57-4900-aedb-5c5f819b0612 req-827dd804-b427-45b3-9e28-25df1e207af3 service nova] Releasing lock "refresh_cache-0209c824-88a7-4976-83bf-8a72437f0cc2" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:54:54 user nova-compute[74190]: DEBUG nova.compute.manager [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Stashing vm_state: active {{(pid=74190) _prep_resize /opt/stack/nova/nova/compute/manager.py:5614}}
Oct 18 11:54:54 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0450802e-23f8-4256-8765-9abc759063ee tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: b200eb6a-be24-4a8f-be23-4e36f7b7b26e] Calling os-brick to attach iSCSI Volume {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 11:54:54 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-0450802e-23f8-4256-8765-9abc759063ee tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dLCemaps', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:54:54 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-0450802e-23f8-4256-8765-9abc759063ee tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:54:54 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-0450802e-23f8-4256-8765-9abc759063ee tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:54:54 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-0450802e-23f8-4256-8765-9abc759063ee tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:54:54 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-0450802e-23f8-4256-8765-9abc759063ee tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:54:54 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-0450802e-23f8-4256-8765-9abc759063ee tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:54:54 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-0450802e-23f8-4256-8765-9abc759063ee tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:54:54 user nova-compute[74190]: INFO os_brick.initiator.connectors.iscsi [None req-0450802e-23f8-4256-8765-9abc759063ee tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 11:54:54 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7 -p 172.16.0.220:3260 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:54 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:54 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba6372dd-9854-46ba-be70-99fb4ae79be5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:54:54 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-0450802e-23f8-4256-8765-9abc759063ee tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 11:54:54 user nova-compute[74190]:  {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:54:54 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7 -p 172.16.0.220:3260 --interface default --op new {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:54 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:54 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[2066a5c9-c437-41d0-bd12-ec57a5891008]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7] added\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:54:54 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-0450802e-23f8-4256-8765-9abc759063ee tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7] added
Oct 18 11:54:54 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:54:54 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:54 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:54 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[038634a9-1ee4-4ddf-8c96-49ee18dcf86f]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:54:54 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-0450802e-23f8-4256-8765-9abc759063ee tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:54:54 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:54 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:54:54 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:54:54 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:54 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4199dd5-7674-4ef4-b720-f7bf8cb0f758]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:54:54 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-0450802e-23f8-4256-8765-9abc759063ee tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:54:54 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dLCemaps {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:54 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74190) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 11:54:54 user nova-compute[74190]: INFO nova.compute.claims [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Claim successful on node user
Oct 18 11:54:54 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dLCemaps" returned: 0 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:54 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[eace2743-0810-4e01-9d60-7d6648a9fbb0]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:54:54 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-0450802e-23f8-4256-8765-9abc759063ee tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dLCemaps'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:54:54 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:54 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:54 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[b982596c-bb5a-47d7-90cb-a28d1fcc4f49]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:54:54 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-0450802e-23f8-4256-8765-9abc759063ee tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:54:54 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:54 user nova-compute[74190]: INFO nova.compute.resource_tracker [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Updating resource usage from migration 721bcb36-1ad7-4025-baa0-50a8a0705c76
Oct 18 11:54:54 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:54 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ddf778d-9823-4026-b042-85c954e64541]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26d7d20b-7f34-4e38-b6fc-66570f1e4250 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c03633a-f8e8-41ca-be64-1261c907bb2b (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:54:54 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-0450802e-23f8-4256-8765-9abc759063ee tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 11:54:54 user nova-compute[74190]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 (non-flash)
Oct 18 11:54:54 user nova-compute[74190]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 (non-flash)
Oct 18 11:54:54 user nova-compute[74190]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26d7d20b-7f34-4e38-b6fc-66570f1e4250 (non-flash)
Oct 18 11:54:54 user nova-compute[74190]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c03633a-f8e8-41ca-be64-1261c907bb2b (non-flash)
Oct 18 11:54:54 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:54:54 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-0450802e-23f8-4256-8765-9abc759063ee tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 11:54:54 user nova-compute[74190]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 (non-flash)
Oct 18 11:54:54 user nova-compute[74190]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 (non-flash)
Oct 18 11:54:54 user nova-compute[74190]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26d7d20b-7f34-4e38-b6fc-66570f1e4250 (non-flash)
Oct 18 11:54:54 user nova-compute[74190]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c03633a-f8e8-41ca-be64-1261c907bb2b (non-flash)
Oct 18 11:54:54 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:54:54 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7 -p 172.16.0.220:3260 --login {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:54 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:54 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bcd7cfa-2cde-4ddd-a814-0a6f2b21e7cf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:54:54 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-0450802e-23f8-4256-8765-9abc759063ee tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7, portal: 172.16.0.220,3260]
Oct 18 11:54:54 user nova-compute[74190]: Login to [iface: default, target: iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7, portal: 172.16.0.220,3260] successful.
Oct 18 11:54:54 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:54:54 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:54 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:54 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe58a52-46a0-4ea8-8ded-d6eefda5f9cc]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:54:54 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-0450802e-23f8-4256-8765-9abc759063ee tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:54:54 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:54 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:54 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[192bd148-7b92-4f96-b94c-23258175e429]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26d7d20b-7f34-4e38-b6fc-66570f1e4250 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c03633a-f8e8-41ca-be64-1261c907bb2b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7 (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:54:54 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-0450802e-23f8-4256-8765-9abc759063ee tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 11:54:54 user nova-compute[74190]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 (non-flash)
Oct 18 11:54:54 user nova-compute[74190]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 (non-flash)
Oct 18 11:54:54 user nova-compute[74190]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26d7d20b-7f34-4e38-b6fc-66570f1e4250 (non-flash)
Oct 18 11:54:54 user nova-compute[74190]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c03633a-f8e8-41ca-be64-1261c907bb2b (non-flash)
Oct 18 11:54:54 user nova-compute[74190]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7 (non-flash)
Oct 18 11:54:54 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:54:54 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-0450802e-23f8-4256-8765-9abc759063ee tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 11:54:54 user nova-compute[74190]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 (non-flash)
Oct 18 11:54:54 user nova-compute[74190]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 (non-flash)
Oct 18 11:54:54 user nova-compute[74190]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26d7d20b-7f34-4e38-b6fc-66570f1e4250 (non-flash)
Oct 18 11:54:54 user nova-compute[74190]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c03633a-f8e8-41ca-be64-1261c907bb2b (non-flash)
Oct 18 11:54:54 user nova-compute[74190]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7 (non-flash)
Oct 18 11:54:54 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:54:54 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-0450802e-23f8-4256-8765-9abc759063ee tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:54:54 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-0450802e-23f8-4256-8765-9abc759063ee tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Connected to 172.16.0.220:3260 {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 11:54:54 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-0450802e-23f8-4256-8765-9abc759063ee tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] HCTL ('38', '-', '-', 0) found on session 32 with lun 0 {{(pid=74190) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 11:54:54 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-0450802e-23f8-4256-8765-9abc759063ee tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74190) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 11:54:54 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:54 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.026s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:54 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[6714dd1a-2825-4392-8732-a40d7ebd994c]: (4, ('- - 0', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:54:54 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-0450802e-23f8-4256-8765-9abc759063ee tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Searching for a device in session 32 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74190) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 11:54:54 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-0450802e-23f8-4256-8765-9abc759063ee tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dLCemaps', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 11:54:54 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 11:54:54 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 11:54:54 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.444s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:54:54 user nova-compute[74190]: INFO nova.compute.manager [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Migrating
Oct 18 11:54:54 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Acquiring lock "refresh_cache-a9012673-826b-4be7-a55b-9bb35a227c17" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:54:54 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Acquired lock "refresh_cache-a9012673-826b-4be7-a55b-9bb35a227c17" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:54:54 user nova-compute[74190]: DEBUG nova.network.neutron [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Building network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 11:54:54 user nova-compute[74190]: DEBUG nova.compute.manager [req-c890a179-7d4c-4dbd-b763-03cc9b6080cc req-238ca197-7887-4d10-875f-57363cc5dab5 service nova] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Received event network-changed-98016144-4b95-4e94-8ae4-581089fe4f63 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:54:54 user nova-compute[74190]: DEBUG nova.compute.manager [req-c890a179-7d4c-4dbd-b763-03cc9b6080cc req-238ca197-7887-4d10-875f-57363cc5dab5 service nova] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Refreshing instance network info cache due to event network-changed-98016144-4b95-4e94-8ae4-581089fe4f63. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 11:54:54 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-c890a179-7d4c-4dbd-b763-03cc9b6080cc req-238ca197-7887-4d10-875f-57363cc5dab5 service nova] Acquiring lock "refresh_cache-a9012673-826b-4be7-a55b-9bb35a227c17" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:54:54 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:55 user nova-compute[74190]: DEBUG nova.network.neutron [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Updating instance_info_cache with network_info: [{"id": "98016144-4b95-4e94-8ae4-581089fe4f63", "address": "fa:16:3e:ea:1d:55", "network": {"id": "f5ab7da4-2b07-4465-9a89-a07eb053ba91", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1315695374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08cf52ce927443158aa731367f08bd57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98016144-4b", "ovs_interfaceid": "98016144-4b95-4e94-8ae4-581089fe4f63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:54:55 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Releasing lock "refresh_cache-a9012673-826b-4be7-a55b-9bb35a227c17" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:54:55 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-c890a179-7d4c-4dbd-b763-03cc9b6080cc req-238ca197-7887-4d10-875f-57363cc5dab5 service nova] Acquired lock "refresh_cache-a9012673-826b-4be7-a55b-9bb35a227c17" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:54:55 user nova-compute[74190]: DEBUG nova.network.neutron [req-c890a179-7d4c-4dbd-b763-03cc9b6080cc req-238ca197-7887-4d10-875f-57363cc5dab5 service nova] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Refreshing network info cache for port 98016144-4b95-4e94-8ae4-581089fe4f63 {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 11:54:55 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Starting migrate_disk_and_power_off {{(pid=74190) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Oct 18 11:54:55 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:55 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:55 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-0450802e-23f8-4256-8765-9abc759063ee tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.384s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:54:55 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-0450802e-23f8-4256-8765-9abc759063ee tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] <== connect_volume: return (1386ms) {'type': 'block', 'scsi_wwn': '26430316436356533', 'path': '/dev/sdg'} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:54:55 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0450802e-23f8-4256-8765-9abc759063ee tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: b200eb6a-be24-4a8f-be23-4e36f7b7b26e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26430316436356533', 'path': '/dev/sdg'} {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 11:54:55 user nova-compute[74190]: DEBUG nova.objects.instance [None req-0450802e-23f8-4256-8765-9abc759063ee tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lazy-loading 'flavor' on Instance uuid b200eb6a-be24-4a8f-be23-4e36f7b7b26e {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:54:55 user nova-compute[74190]: DEBUG nova.network.neutron [req-c890a179-7d4c-4dbd-b763-03cc9b6080cc req-238ca197-7887-4d10-875f-57363cc5dab5 service nova] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Updated VIF entry in instance network info cache for port 98016144-4b95-4e94-8ae4-581089fe4f63. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 11:54:55 user nova-compute[74190]: DEBUG nova.network.neutron [req-c890a179-7d4c-4dbd-b763-03cc9b6080cc req-238ca197-7887-4d10-875f-57363cc5dab5 service nova] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Updating instance_info_cache with network_info: [{"id": "98016144-4b95-4e94-8ae4-581089fe4f63", "address": "fa:16:3e:ea:1d:55", "network": {"id": "f5ab7da4-2b07-4465-9a89-a07eb053ba91", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1315695374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08cf52ce927443158aa731367f08bd57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98016144-4b", "ovs_interfaceid": "98016144-4b95-4e94-8ae4-581089fe4f63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:54:55 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-0450802e-23f8-4256-8765-9abc759063ee tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] attach device xml: <disk type="block" device="disk">
Oct 18 11:54:55 user nova-compute[74190]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 11:54:55 user nova-compute[74190]:   <source dev="/dev/sdg"/>
Oct 18 11:54:55 user nova-compute[74190]:   <target dev="vdb" bus="virtio"/>
Oct 18 11:54:55 user nova-compute[74190]:   <serial>f859861f-19fb-4f6a-abd3-2160677199a7</serial>
Oct 18 11:54:55 user nova-compute[74190]: </disk>
Oct 18 11:54:55 user nova-compute[74190]:  {{(pid=74190) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 18 11:54:55 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-c890a179-7d4c-4dbd-b763-03cc9b6080cc req-238ca197-7887-4d10-875f-57363cc5dab5 service nova] Releasing lock "refresh_cache-a9012673-826b-4be7-a55b-9bb35a227c17" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:54:55 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:55 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:56 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-0450802e-23f8-4256-8765-9abc759063ee tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] No BDM found with device name vda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 11:54:56 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-0450802e-23f8-4256-8765-9abc759063ee tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 11:54:56 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-0450802e-23f8-4256-8765-9abc759063ee tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] No VIF found with MAC fa:16:3e:5a:49:f4, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 11:54:56 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-0450802e-23f8-4256-8765-9abc759063ee tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "b200eb6a-be24-4a8f-be23-4e36f7b7b26e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.911s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:54:56 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b15cee3e-c186-407a-b070-660d690403eb tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Acquiring lock "bdfe420d-f46c-44ad-8773-b675f42e24ed" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:54:56 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b15cee3e-c186-407a-b070-660d690403eb tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Lock "bdfe420d-f46c-44ad-8773-b675f42e24ed" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:54:56 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b15cee3e-c186-407a-b070-660d690403eb tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Acquiring lock "bdfe420d-f46c-44ad-8773-b675f42e24ed-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:54:56 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b15cee3e-c186-407a-b070-660d690403eb tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Lock "bdfe420d-f46c-44ad-8773-b675f42e24ed-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:54:56 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b15cee3e-c186-407a-b070-660d690403eb tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Lock "bdfe420d-f46c-44ad-8773-b675f42e24ed-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:54:56 user nova-compute[74190]: INFO nova.compute.manager [None req-b15cee3e-c186-407a-b070-660d690403eb tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Terminating instance
Oct 18 11:54:56 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b15cee3e-c186-407a-b070-660d690403eb tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Start destroying the instance on the hypervisor. {{(pid=74190) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 11:54:56 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:56 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Instance destroyed successfully.
Oct 18 11:54:56 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:53:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1490971997',display_name='tempest-ServerActionsTestOtherA-server-1490971997',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1490971997',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOQBzNTv9LZg0yq/3lf4kmMEAFSSxHvdpQtvKWiUtvrhz9NgEirvm+N8Tqx31x38AF1/g3O4be21YeguWgKCS7N36Oy8ZZWxYYR46ATEkZPMIr3HhNKcU83cECzcDD++0g==',key_name='tempest-keypair-1511789347',keypairs=<?>,launch_index=0,launched_at=2023-10-18T11:53:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='08cf52ce927443158aa731367f08bd57',ramdisk_id='',reservation_id='r-0xda3q9d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1288544694',owner_user_name='tempest-ServerActionsTestOtherA-1288544694-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:54:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b771e627a76b4540bf8de665df3d7787',uuid=a9012673-826b-4be7-a55b-9bb35a227c17,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "98016144-4b95-4e94-8ae4-581089fe4f63", "address": "fa:16:3e:ea:1d:55", "network": {"id": "f5ab7da4-2b07-4465-9a89-a07eb053ba91", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1315695374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1315695374-network", "vif_mac": "fa:16:3e:ea:1d:55"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08cf52ce927443158aa731367f08bd57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98016144-4b", "ovs_interfaceid": "98016144-4b95-4e94-8ae4-581089fe4f63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 11:54:56 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Converting VIF {"id": "98016144-4b95-4e94-8ae4-581089fe4f63", "address": "fa:16:3e:ea:1d:55", "network": {"id": "f5ab7da4-2b07-4465-9a89-a07eb053ba91", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1315695374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1315695374-network", "vif_mac": "fa:16:3e:ea:1d:55"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08cf52ce927443158aa731367f08bd57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98016144-4b", "ovs_interfaceid": "98016144-4b95-4e94-8ae4-581089fe4f63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:54:56 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ea:1d:55,bridge_name='br-int',has_traffic_filtering=True,id=98016144-4b95-4e94-8ae4-581089fe4f63,network=Network(f5ab7da4-2b07-4465-9a89-a07eb053ba91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98016144-4b') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:54:56 user nova-compute[74190]: DEBUG os_vif [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:1d:55,bridge_name='br-int',has_traffic_filtering=True,id=98016144-4b95-4e94-8ae4-581089fe4f63,network=Network(f5ab7da4-2b07-4465-9a89-a07eb053ba91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98016144-4b') {{(pid=74190) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 11:54:56 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:56 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap98016144-4b, bridge=br-int, if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:54:56 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:56 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:54:56 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:56 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:56 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:56 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4982c875-daff-412d-be4f-76d3b69e4e53) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:54:56 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:56 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:54:56 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:56 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:56 user nova-compute[74190]: INFO os_vif [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:1d:55,bridge_name='br-int',has_traffic_filtering=True,id=98016144-4b95-4e94-8ae4-581089fe4f63,network=Network(f5ab7da4-2b07-4465-9a89-a07eb053ba91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98016144-4b')
Oct 18 11:54:56 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] calling os-brick to detach iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 11:54:56 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, {'target_iqn': 'iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qAZlmtWu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:54:56 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:54:56 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:54:56 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:54:56 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:56 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.032s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:56 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d5ffa50-0daa-4de9-99df-12cd5a587427]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:26d7d20b-7f34-4e38-b6fc-66570f1e4250\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c03633a-f8e8-41ca-be64-1261c907bb2b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:54:56 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 11:54:56 user nova-compute[74190]: No targets found.
Oct 18 11:54:56 user nova-compute[74190]: iSNS:
Oct 18 11:54:56 user nova-compute[74190]: No targets found.
Oct 18 11:54:56 user nova-compute[74190]: STATIC:
Oct 18 11:54:56 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227
Oct 18 11:54:56 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:54:56 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:54:56 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:26d7d20b-7f34-4e38-b6fc-66570f1e4250
Oct 18 11:54:56 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:54:56 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:54:56 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa
Oct 18 11:54:56 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:54:56 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:54:56 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7
Oct 18 11:54:56 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:54:56 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:54:56 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71
Oct 18 11:54:56 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:54:56 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:54:56 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:7c03633a-f8e8-41ca-be64-1261c907bb2b
Oct 18 11:54:56 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:54:56 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:54:56 user nova-compute[74190]: FIRMWARE:
Oct 18 11:54:56 user nova-compute[74190]: No targets found.
Oct 18 11:54:56 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:54:56 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 11:54:56 user nova-compute[74190]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 11:54:56 user nova-compute[74190]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74190) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 11:54:56 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227', 0)] {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 11:54:56 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:56 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:56 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7219711-0e03-4ccd-802e-fbd466fc46b5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26d7d20b-7f34-4e38-b6fc-66570f1e4250\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c03633a-f8e8-41ca-be64-1261c907bb2b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:54:56 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:56 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:56 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[522917cc-b34c-4d21-8924-1f9398c988f8]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26d7d20b-7f34-4e38-b6fc-66570f1e4250 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c03633a-f8e8-41ca-be64-1261c907bb2b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7 (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:54:56 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 11:54:56 user nova-compute[74190]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 (non-flash)
Oct 18 11:54:56 user nova-compute[74190]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 (non-flash)
Oct 18 11:54:56 user nova-compute[74190]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26d7d20b-7f34-4e38-b6fc-66570f1e4250 (non-flash)
Oct 18 11:54:56 user nova-compute[74190]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c03633a-f8e8-41ca-be64-1261c907bb2b (non-flash)
Oct 18 11:54:56 user nova-compute[74190]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7 (non-flash)
Oct 18 11:54:56 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:54:56 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 11:54:56 user nova-compute[74190]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 (non-flash)
Oct 18 11:54:56 user nova-compute[74190]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 (non-flash)
Oct 18 11:54:56 user nova-compute[74190]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26d7d20b-7f34-4e38-b6fc-66570f1e4250 (non-flash)
Oct 18 11:54:56 user nova-compute[74190]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c03633a-f8e8-41ca-be64-1261c907bb2b (non-flash)
Oct 18 11:54:56 user nova-compute[74190]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7 (non-flash)
Oct 18 11:54:56 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:54:56 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1f446ff880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227'): ({'sdd'}, set())}) {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 11:54:56 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Removing single pathed devices sdd {{(pid=74190) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 11:54:56 user nova-compute[74190]: DEBUG nova.compute.manager [req-43da4883-a91e-426b-a098-b54a8ba97086 req-9d18baab-930b-4ac8-9bbd-7ef9451ba5a4 service nova] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Received event network-vif-unplugged-5f5b65f1-7748-4422-8b45-e1b88476716d {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:54:56 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-43da4883-a91e-426b-a098-b54a8ba97086 req-9d18baab-930b-4ac8-9bbd-7ef9451ba5a4 service nova] Acquiring lock "bdfe420d-f46c-44ad-8773-b675f42e24ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:54:56 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-43da4883-a91e-426b-a098-b54a8ba97086 req-9d18baab-930b-4ac8-9bbd-7ef9451ba5a4 service nova] Lock "bdfe420d-f46c-44ad-8773-b675f42e24ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:54:56 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-43da4883-a91e-426b-a098-b54a8ba97086 req-9d18baab-930b-4ac8-9bbd-7ef9451ba5a4 service nova] Lock "bdfe420d-f46c-44ad-8773-b675f42e24ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:54:56 user nova-compute[74190]: DEBUG nova.compute.manager [req-43da4883-a91e-426b-a098-b54a8ba97086 req-9d18baab-930b-4ac8-9bbd-7ef9451ba5a4 service nova] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] No waiting events found dispatching network-vif-unplugged-5f5b65f1-7748-4422-8b45-e1b88476716d {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:54:56 user nova-compute[74190]: DEBUG nova.compute.manager [req-43da4883-a91e-426b-a098-b54a8ba97086 req-9d18baab-930b-4ac8-9bbd-7ef9451ba5a4 service nova] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Received event network-vif-unplugged-5f5b65f1-7748-4422-8b45-e1b88476716d for instance with task_state deleting. {{(pid=74190) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 11:54:56 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:56 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:56 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a950ebb-0014-494c-aef7-a7cd32ca457f]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:54:56 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:56 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:56 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[740b6578-be72-4a31-b9b3-9dd51e48923d]: (4, ('ok\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:54:56 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Flushing IO for device /dev/sdd {{(pid=74190) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 11:54:56 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:56 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:56 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ee1a6c-1893-455f-8b87-885b65538a26]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:54:56 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74190) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 11:54:56 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:56 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.052s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:56 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[716cc9a3-856e-4edd-be7b-675c8e677860]: (4, ('1', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:54:56 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 11:54:56 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] SCSI volumes sdd have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 11:54:56 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227')] {{(pid=74190) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 11:54:56 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:56 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:56 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5ba92a6-a8c3-4b27-a290-403f11931ac0]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:54:56 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:54:56 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 -p 172.16.0.220:3260 --logout {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:56 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:56 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[396fb589-2e12-4e49-b183-7077729cadd7]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:54:56 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227, portal: 172.16.0.220,3260]
Oct 18 11:54:56 user nova-compute[74190]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227, portal: 172.16.0.220,3260] successful.
Oct 18 11:54:56 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:54:56 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 -p 172.16.0.220:3260 --op delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:56 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:56 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a1f650-c134-4998-937d-5f2cabe8ca79]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:54:56 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:54:56 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.430s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:54:56 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] <== disconnect_volume: return (433ms) None {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:54:56 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Disconnected iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 11:54:56 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 11:54:56 user nova-compute[74190]: DEBUG nova.compute.manager [req-505de144-fda2-4498-835f-7cc9038fcf81 req-7b77070b-2947-4014-bea2-10b0e2877e6b service nova] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Received event network-vif-unplugged-98016144-4b95-4e94-8ae4-581089fe4f63 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:54:56 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-505de144-fda2-4498-835f-7cc9038fcf81 req-7b77070b-2947-4014-bea2-10b0e2877e6b service nova] Acquiring lock "a9012673-826b-4be7-a55b-9bb35a227c17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:54:56 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-505de144-fda2-4498-835f-7cc9038fcf81 req-7b77070b-2947-4014-bea2-10b0e2877e6b service nova] Lock "a9012673-826b-4be7-a55b-9bb35a227c17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:54:56 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-505de144-fda2-4498-835f-7cc9038fcf81 req-7b77070b-2947-4014-bea2-10b0e2877e6b service nova] Lock "a9012673-826b-4be7-a55b-9bb35a227c17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:54:56 user nova-compute[74190]: DEBUG nova.compute.manager [req-505de144-fda2-4498-835f-7cc9038fcf81 req-7b77070b-2947-4014-bea2-10b0e2877e6b service nova] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] No waiting events found dispatching network-vif-unplugged-98016144-4b95-4e94-8ae4-581089fe4f63 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:54:56 user nova-compute[74190]: WARNING nova.compute.manager [req-505de144-fda2-4498-835f-7cc9038fcf81 req-7b77070b-2947-4014-bea2-10b0e2877e6b service nova] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Received unexpected event network-vif-unplugged-98016144-4b95-4e94-8ae4-581089fe4f63 for instance with vm_state active and task_state resize_migrating.
Oct 18 11:54:56 user nova-compute[74190]: DEBUG nova.compute.manager [req-505de144-fda2-4498-835f-7cc9038fcf81 req-7b77070b-2947-4014-bea2-10b0e2877e6b service nova] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Received event network-vif-plugged-98016144-4b95-4e94-8ae4-581089fe4f63 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:54:56 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-505de144-fda2-4498-835f-7cc9038fcf81 req-7b77070b-2947-4014-bea2-10b0e2877e6b service nova] Acquiring lock "a9012673-826b-4be7-a55b-9bb35a227c17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:54:56 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-505de144-fda2-4498-835f-7cc9038fcf81 req-7b77070b-2947-4014-bea2-10b0e2877e6b service nova] Lock "a9012673-826b-4be7-a55b-9bb35a227c17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:54:56 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-505de144-fda2-4498-835f-7cc9038fcf81 req-7b77070b-2947-4014-bea2-10b0e2877e6b service nova] Lock "a9012673-826b-4be7-a55b-9bb35a227c17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:54:56 user nova-compute[74190]: DEBUG nova.compute.manager [req-505de144-fda2-4498-835f-7cc9038fcf81 req-7b77070b-2947-4014-bea2-10b0e2877e6b service nova] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] No waiting events found dispatching network-vif-plugged-98016144-4b95-4e94-8ae4-581089fe4f63 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:54:56 user nova-compute[74190]: WARNING nova.compute.manager [req-505de144-fda2-4498-835f-7cc9038fcf81 req-7b77070b-2947-4014-bea2-10b0e2877e6b service nova] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Received unexpected event network-vif-plugged-98016144-4b95-4e94-8ae4-581089fe4f63 for instance with vm_state active and task_state resize_migrating.
Oct 18 11:54:57 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Instance destroyed successfully.
Oct 18 11:54:57 user nova-compute[74190]: DEBUG nova.objects.instance [None req-b15cee3e-c186-407a-b070-660d690403eb tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Lazy-loading 'resources' on Instance uuid bdfe420d-f46c-44ad-8773-b675f42e24ed {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:54:57 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-b15cee3e-c186-407a-b070-660d690403eb tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:45:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1652011593',display_name='tempest-ServerActionsTestOtherB-server-1652011593',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1652011593',id=13,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJf2+oC1LymyOUKrd79qlp9w/sLNNXOE0jNeE016Gw/qD1l2yX0bGo5VP+iKF1MHpeTJ2Ix6czkMyFuUdVqQvcY91kItew2KCNk3ZYu6m5FRy6Ycq3v+bQ+PiA7mcNgHFg==',key_name='tempest-keypair-1546248338',keypairs=<?>,launch_index=0,launched_at=2023-10-18T11:52:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ce179d9f22684865b577bd91bc841400',ramdisk_id='',reservation_id='r-iuitp9n6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1277618284',owner_user_name='tempest-ServerActionsTestOtherB-1277618284-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T11:52:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c5f5ddf3c4174afcbe7075b7f89b4f05',uuid=bdfe420d-f46c-44ad-8773-b675f42e24ed,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5f5b65f1-7748-4422-8b45-e1b88476716d", "address": "fa:16:3e:cb:ff:0f", "network": {"id": "7be8675d-326a-4184-9b3e-fbaa02a4e1fc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-468552750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce179d9f22684865b577bd91bc841400", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5b65f1-77", "ovs_interfaceid": "5f5b65f1-7748-4422-8b45-e1b88476716d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 11:54:57 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-b15cee3e-c186-407a-b070-660d690403eb tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Converting VIF {"id": "5f5b65f1-7748-4422-8b45-e1b88476716d", "address": "fa:16:3e:cb:ff:0f", "network": {"id": "7be8675d-326a-4184-9b3e-fbaa02a4e1fc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-468552750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce179d9f22684865b577bd91bc841400", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5b65f1-77", "ovs_interfaceid": "5f5b65f1-7748-4422-8b45-e1b88476716d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:54:57 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-b15cee3e-c186-407a-b070-660d690403eb tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cb:ff:0f,bridge_name='br-int',has_traffic_filtering=True,id=5f5b65f1-7748-4422-8b45-e1b88476716d,network=Network(7be8675d-326a-4184-9b3e-fbaa02a4e1fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f5b65f1-77') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:54:57 user nova-compute[74190]: DEBUG os_vif [None req-b15cee3e-c186-407a-b070-660d690403eb tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cb:ff:0f,bridge_name='br-int',has_traffic_filtering=True,id=5f5b65f1-7748-4422-8b45-e1b88476716d,network=Network(7be8675d-326a-4184-9b3e-fbaa02a4e1fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f5b65f1-77') {{(pid=74190) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 11:54:57 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:57 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5f5b65f1-77, bridge=br-int, if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:54:57 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:57 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:57 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:57 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=72b5760c-1fc9-4873-aedf-a42f411a8e3f) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:54:57 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:54:57 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:54:57 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:54:57 user nova-compute[74190]: INFO os_vif [None req-b15cee3e-c186-407a-b070-660d690403eb tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cb:ff:0f,bridge_name='br-int',has_traffic_filtering=True,id=5f5b65f1-7748-4422-8b45-e1b88476716d,network=Network(7be8675d-326a-4184-9b3e-fbaa02a4e1fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f5b65f1-77')
Oct 18 11:54:57 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b15cee3e-c186-407a-b070-660d690403eb tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] calling os-brick to detach iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 11:54:57 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-b15cee3e-c186-407a-b070-660d690403eb tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, {'target_iqn': 'iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HmdgMSxP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:54:57 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-b15cee3e-c186-407a-b070-660d690403eb tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:54:57 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-b15cee3e-c186-407a-b070-660d690403eb tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:54:57 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-b15cee3e-c186-407a-b070-660d690403eb tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:54:57 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:57 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:57 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[68b00fe0-9c4f-4397-9b4f-5d48d0e55ad3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:26d7d20b-7f34-4e38-b6fc-66570f1e4250\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c03633a-f8e8-41ca-be64-1261c907bb2b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:54:57 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-b15cee3e-c186-407a-b070-660d690403eb tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 11:54:57 user nova-compute[74190]: No targets found.
Oct 18 11:54:57 user nova-compute[74190]: iSNS:
Oct 18 11:54:57 user nova-compute[74190]: No targets found.
Oct 18 11:54:57 user nova-compute[74190]: STATIC:
Oct 18 11:54:57 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:26d7d20b-7f34-4e38-b6fc-66570f1e4250
Oct 18 11:54:57 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:54:57 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:54:57 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa
Oct 18 11:54:57 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:54:57 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:54:57 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7
Oct 18 11:54:57 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:54:57 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:54:57 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71
Oct 18 11:54:57 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:54:57 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:54:57 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:7c03633a-f8e8-41ca-be64-1261c907bb2b
Oct 18 11:54:57 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:54:57 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:54:57 user nova-compute[74190]: FIRMWARE:
Oct 18 11:54:57 user nova-compute[74190]: No targets found.
Oct 18 11:54:57 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:54:57 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-b15cee3e-c186-407a-b070-660d690403eb tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 11:54:57 user nova-compute[74190]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 11:54:57 user nova-compute[74190]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74190) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 11:54:57 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-b15cee3e-c186-407a-b070-660d690403eb tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71', 0)] {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 11:54:57 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:57 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:57 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[add3b37b-21d6-4018-8ef3-448331d94903]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26d7d20b-7f34-4e38-b6fc-66570f1e4250\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c03633a-f8e8-41ca-be64-1261c907bb2b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:54:57 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:57 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:57 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f9e4da4-eb15-41f4-a005-1f57be5102c6]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26d7d20b-7f34-4e38-b6fc-66570f1e4250 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c03633a-f8e8-41ca-be64-1261c907bb2b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7 (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:54:57 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-b15cee3e-c186-407a-b070-660d690403eb tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 11:54:57 user nova-compute[74190]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 (non-flash)
Oct 18 11:54:57 user nova-compute[74190]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26d7d20b-7f34-4e38-b6fc-66570f1e4250 (non-flash)
Oct 18 11:54:57 user nova-compute[74190]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c03633a-f8e8-41ca-be64-1261c907bb2b (non-flash)
Oct 18 11:54:57 user nova-compute[74190]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7 (non-flash)
Oct 18 11:54:57 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:54:57 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-b15cee3e-c186-407a-b070-660d690403eb tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 11:54:57 user nova-compute[74190]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 (non-flash)
Oct 18 11:54:57 user nova-compute[74190]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26d7d20b-7f34-4e38-b6fc-66570f1e4250 (non-flash)
Oct 18 11:54:57 user nova-compute[74190]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c03633a-f8e8-41ca-be64-1261c907bb2b (non-flash)
Oct 18 11:54:57 user nova-compute[74190]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7 (non-flash)
Oct 18 11:54:57 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:54:57 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-b15cee3e-c186-407a-b070-660d690403eb tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1f446fd090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71'): ({'sdb'}, set())}) {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 11:54:57 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-b15cee3e-c186-407a-b070-660d690403eb tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Removing single pathed devices sdb {{(pid=74190) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 11:54:57 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:57 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:57 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[165057c8-2b8a-4f0d-ad55-2b17cd11843b]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:54:57 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:57 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:57 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[784dd48a-f5d5-41ac-8014-a95da3049f98]: (4, ('ok\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:54:57 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-b15cee3e-c186-407a-b070-660d690403eb tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Flushing IO for device /dev/sdb {{(pid=74190) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 11:54:57 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:57 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:57 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a9d866d-8e86-4889-a8cb-04a86c30ef8e]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:54:57 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-b15cee3e-c186-407a-b070-660d690403eb tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74190) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 11:54:57 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:57 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:57 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[48953e64-2afc-47c7-b504-53bafc17853c]: (4, ('1', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:54:57 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-b15cee3e-c186-407a-b070-660d690403eb tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 11:54:57 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-b15cee3e-c186-407a-b070-660d690403eb tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] SCSI volumes sdb have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 11:54:57 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-b15cee3e-c186-407a-b070-660d690403eb tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71')] {{(pid=74190) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 11:54:57 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:57 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:57 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[98bdef33-b787-491d-9096-3b53fa7b924a]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:54:57 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-b15cee3e-c186-407a-b070-660d690403eb tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:54:57 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 -p 172.16.0.220:3260 --logout {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:57 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:57 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee70a739-72b1-4cd2-ae6d-87c444064e46]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:54:57 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-b15cee3e-c186-407a-b070-660d690403eb tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71, portal: 172.16.0.220,3260]
Oct 18 11:54:57 user nova-compute[74190]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71, portal: 172.16.0.220,3260] successful.
Oct 18 11:54:57 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:54:57 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 -p 172.16.0.220:3260 --op delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:57 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7316be11-03d9-47f3-bf3c-2563c3a92c71 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:57 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[e011c663-5b09-4d02-84ef-565d92748e74]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:54:57 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-b15cee3e-c186-407a-b070-660d690403eb tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:54:57 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-b15cee3e-c186-407a-b070-660d690403eb tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:54:57 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-b15cee3e-c186-407a-b070-660d690403eb tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] <== disconnect_volume: return (345ms) None {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:54:57 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b15cee3e-c186-407a-b070-660d690403eb tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Disconnected iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 11:54:57 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-b15cee3e-c186-407a-b070-660d690403eb tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Deleting instance files /opt/stack/data/nova/instances/bdfe420d-f46c-44ad-8773-b675f42e24ed_del
Oct 18 11:54:57 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-b15cee3e-c186-407a-b070-660d690403eb tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Deletion of /opt/stack/data/nova/instances/bdfe420d-f46c-44ad-8773-b675f42e24ed_del complete
Oct 18 11:54:57 user nova-compute[74190]: INFO nova.compute.manager [None req-b15cee3e-c186-407a-b070-660d690403eb tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Took 1.28 seconds to destroy the instance on the hypervisor.
Oct 18 11:54:57 user nova-compute[74190]: DEBUG oslo.service.loopingcall [None req-b15cee3e-c186-407a-b070-660d690403eb tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74190) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 11:54:57 user nova-compute[74190]: DEBUG nova.compute.manager [-] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Deallocating network for instance {{(pid=74190) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 11:54:57 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] deallocate_for_instance() {{(pid=74190) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 11:54:58 user nova-compute[74190]: DEBUG nova.network.neutron [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Port 98016144-4b95-4e94-8ae4-581089fe4f63 binding to destination host user is already ACTIVE {{(pid=74190) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Oct 18 11:54:58 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:54:58 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:54:58 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74190) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 11:54:58 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Acquiring lock "a9012673-826b-4be7-a55b-9bb35a227c17-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:54:58 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lock "a9012673-826b-4be7-a55b-9bb35a227c17-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:54:58 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lock "a9012673-826b-4be7-a55b-9bb35a227c17-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:54:58 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Acquiring lock "refresh_cache-a9012673-826b-4be7-a55b-9bb35a227c17" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:54:58 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Acquired lock "refresh_cache-a9012673-826b-4be7-a55b-9bb35a227c17" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:54:58 user nova-compute[74190]: DEBUG nova.network.neutron [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Building network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 11:54:58 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Updating instance_info_cache with network_info: [] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:54:58 user nova-compute[74190]: INFO nova.compute.manager [-] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Took 1.14 seconds to deallocate network for instance.
Oct 18 11:54:58 user nova-compute[74190]: DEBUG nova.compute.manager [req-76a69dbe-64a6-4ae9-8f57-9bfea6a67f8a req-94f52008-2ab5-4504-b0e7-6713846dca6f service nova] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Received event network-vif-deleted-5f5b65f1-7748-4422-8b45-e1b88476716d {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:54:58 user nova-compute[74190]: INFO nova.compute.manager [req-76a69dbe-64a6-4ae9-8f57-9bfea6a67f8a req-94f52008-2ab5-4504-b0e7-6713846dca6f service nova] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Neutron deleted interface 5f5b65f1-7748-4422-8b45-e1b88476716d; detaching it from the instance and deleting it from the info cache
Oct 18 11:54:58 user nova-compute[74190]: DEBUG nova.network.neutron [req-76a69dbe-64a6-4ae9-8f57-9bfea6a67f8a req-94f52008-2ab5-4504-b0e7-6713846dca6f service nova] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Updating instance_info_cache with network_info: [] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:54:58 user nova-compute[74190]: DEBUG nova.compute.manager [req-76a69dbe-64a6-4ae9-8f57-9bfea6a67f8a req-94f52008-2ab5-4504-b0e7-6713846dca6f service nova] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Detach interface failed, port_id=5f5b65f1-7748-4422-8b45-e1b88476716d, reason: Instance bdfe420d-f46c-44ad-8773-b675f42e24ed could not be found. {{(pid=74190) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 18 11:54:58 user nova-compute[74190]: DEBUG nova.compute.manager [req-9c5e7809-f21e-4d09-b6b8-d737d06914a0 req-f7d6c6fe-9a00-4d35-a86f-8fee567f2363 service nova] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Received event network-vif-plugged-5f5b65f1-7748-4422-8b45-e1b88476716d {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:54:58 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-9c5e7809-f21e-4d09-b6b8-d737d06914a0 req-f7d6c6fe-9a00-4d35-a86f-8fee567f2363 service nova] Acquiring lock "bdfe420d-f46c-44ad-8773-b675f42e24ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:54:58 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-9c5e7809-f21e-4d09-b6b8-d737d06914a0 req-f7d6c6fe-9a00-4d35-a86f-8fee567f2363 service nova] Lock "bdfe420d-f46c-44ad-8773-b675f42e24ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:54:58 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-9c5e7809-f21e-4d09-b6b8-d737d06914a0 req-f7d6c6fe-9a00-4d35-a86f-8fee567f2363 service nova] Lock "bdfe420d-f46c-44ad-8773-b675f42e24ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:54:58 user nova-compute[74190]: DEBUG nova.compute.manager [req-9c5e7809-f21e-4d09-b6b8-d737d06914a0 req-f7d6c6fe-9a00-4d35-a86f-8fee567f2363 service nova] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] No waiting events found dispatching network-vif-plugged-5f5b65f1-7748-4422-8b45-e1b88476716d {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:54:58 user nova-compute[74190]: WARNING nova.compute.manager [req-9c5e7809-f21e-4d09-b6b8-d737d06914a0 req-f7d6c6fe-9a00-4d35-a86f-8fee567f2363 service nova] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Received unexpected event network-vif-plugged-5f5b65f1-7748-4422-8b45-e1b88476716d for instance with vm_state active and task_state deleting.
Oct 18 11:54:58 user nova-compute[74190]: DEBUG nova.network.neutron [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Updating instance_info_cache with network_info: [{"id": "98016144-4b95-4e94-8ae4-581089fe4f63", "address": "fa:16:3e:ea:1d:55", "network": {"id": "f5ab7da4-2b07-4465-9a89-a07eb053ba91", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1315695374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08cf52ce927443158aa731367f08bd57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98016144-4b", "ovs_interfaceid": "98016144-4b95-4e94-8ae4-581089fe4f63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:54:58 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Releasing lock "refresh_cache-a9012673-826b-4be7-a55b-9bb35a227c17" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:54:58 user nova-compute[74190]: DEBUG os_brick.utils [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:54:58 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:58 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:58 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[1700aad3-812e-4ebd-bb12-d6180faa2611]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cff158e257e1\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:54:58 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:58 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:58 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ecdf44-6b96-4c44-8e51-a3f8bead491a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:54:58 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:58 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:54:58 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d7ed7c6-76fb-4f67-b488-7c5b48e201f8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:54:58 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[36bbcc29-b11e-4f8b-9ae3-83792729290e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:54:58 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Running cmd (subprocess): nvme version {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:59 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] 'nvme version' failed. Not Retrying. {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 11:54:59 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] nvme not present on system {{(pid=74190) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 11:54:59 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:54:59 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 11:54:59 user nova-compute[74190]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 11:54:59 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ddfc70d-1c32-4e7f-b7b7-96b913b9519e]: (4, '') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:54:59 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74190) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 11:54:59 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 11:54:59 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] LIGHTOS: no hostnqn found. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 11:54:59 user nova-compute[74190]: DEBUG os_brick.utils [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cff158e257e1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:54:59 user nova-compute[74190]: INFO nova.compute.manager [None req-b15cee3e-c186-407a-b070-660d690403eb tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] [instance: bdfe420d-f46c-44ad-8773-b675f42e24ed] Took 0.89 seconds to detach 1 volumes for instance.
Oct 18 11:54:59 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b15cee3e-c186-407a-b070-660d690403eb tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:54:59 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b15cee3e-c186-407a-b070-660d690403eb tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:54:59 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-28c81087-77f5-4da9-aaf0-be899c1c323b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Acquiring lock "7eaf6c32-1860-4732-9e50-3a8e04b95be8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:54:59 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-28c81087-77f5-4da9-aaf0-be899c1c323b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "7eaf6c32-1860-4732-9e50-3a8e04b95be8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:54:59 user nova-compute[74190]: DEBUG nova.compute.manager [None req-28c81087-77f5-4da9-aaf0-be899c1c323b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: 7eaf6c32-1860-4732-9e50-3a8e04b95be8] Starting instance... {{(pid=74190) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 11:54:59 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-28c81087-77f5-4da9-aaf0-be899c1c323b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:54:59 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-b15cee3e-c186-407a-b070-660d690403eb tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 11:54:59 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-b15cee3e-c186-407a-b070-660d690403eb tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 11:54:59 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b15cee3e-c186-407a-b070-660d690403eb tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.401s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:55:00 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-28c81087-77f5-4da9-aaf0-be899c1c323b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.231s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:55:00 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-28c81087-77f5-4da9-aaf0-be899c1c323b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74190) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 11:55:00 user nova-compute[74190]: INFO nova.compute.claims [None req-28c81087-77f5-4da9-aaf0-be899c1c323b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: 7eaf6c32-1860-4732-9e50-3a8e04b95be8] Claim successful on node user
Oct 18 11:55:00 user nova-compute[74190]: INFO nova.scheduler.client.report [None req-b15cee3e-c186-407a-b070-660d690403eb tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Deleted allocations for instance bdfe420d-f46c-44ad-8773-b675f42e24ed
Oct 18 11:55:00 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:55:00 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:55:00 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:55:00 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b15cee3e-c186-407a-b070-660d690403eb tempest-ServerActionsTestOtherB-1277618284 tempest-ServerActionsTestOtherB-1277618284-project-member] Lock "bdfe420d-f46c-44ad-8773-b675f42e24ed" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.917s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:55:00 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-28c81087-77f5-4da9-aaf0-be899c1c323b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 11:55:00 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-28c81087-77f5-4da9-aaf0-be899c1c323b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 11:55:00 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-28c81087-77f5-4da9-aaf0-be899c1c323b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.514s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:55:00 user nova-compute[74190]: DEBUG nova.compute.manager [None req-28c81087-77f5-4da9-aaf0-be899c1c323b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: 7eaf6c32-1860-4732-9e50-3a8e04b95be8] Start building networks asynchronously for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 11:55:00 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.432s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:55:00 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:55:00 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Auditing locally available compute resources for user (node: user) {{(pid=74190) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 11:55:00 user nova-compute[74190]: DEBUG nova.compute.manager [None req-28c81087-77f5-4da9-aaf0-be899c1c323b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: 7eaf6c32-1860-4732-9e50-3a8e04b95be8] Allocating IP information in the background. {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 11:55:00 user nova-compute[74190]: DEBUG nova.network.neutron [None req-28c81087-77f5-4da9-aaf0-be899c1c323b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: 7eaf6c32-1860-4732-9e50-3a8e04b95be8] allocate_for_instance() {{(pid=74190) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 11:55:00 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-28c81087-77f5-4da9-aaf0-be899c1c323b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: 7eaf6c32-1860-4732-9e50-3a8e04b95be8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 11:55:00 user nova-compute[74190]: DEBUG nova.compute.manager [None req-28c81087-77f5-4da9-aaf0-be899c1c323b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: 7eaf6c32-1860-4732-9e50-3a8e04b95be8] Start building block device mappings for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 11:55:00 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31a86ab2-d72d-4274-b5a6-84c5c4bdfc01/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:55:00 user nova-compute[74190]: DEBUG nova.compute.manager [None req-28c81087-77f5-4da9-aaf0-be899c1c323b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: 7eaf6c32-1860-4732-9e50-3a8e04b95be8] Start spawning the instance on the hypervisor. {{(pid=74190) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 11:55:00 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-28c81087-77f5-4da9-aaf0-be899c1c323b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: 7eaf6c32-1860-4732-9e50-3a8e04b95be8] Creating instance directory {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 11:55:00 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-28c81087-77f5-4da9-aaf0-be899c1c323b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: 7eaf6c32-1860-4732-9e50-3a8e04b95be8] Creating image(s)
Oct 18 11:55:00 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-28c81087-77f5-4da9-aaf0-be899c1c323b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Acquiring lock "/opt/stack/data/nova/instances/7eaf6c32-1860-4732-9e50-3a8e04b95be8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:55:00 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-28c81087-77f5-4da9-aaf0-be899c1c323b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "/opt/stack/data/nova/instances/7eaf6c32-1860-4732-9e50-3a8e04b95be8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:55:00 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-28c81087-77f5-4da9-aaf0-be899c1c323b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "/opt/stack/data/nova/instances/7eaf6c32-1860-4732-9e50-3a8e04b95be8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:55:00 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-28c81087-77f5-4da9-aaf0-be899c1c323b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:55:00 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31a86ab2-d72d-4274-b5a6-84c5c4bdfc01/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:55:00 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31a86ab2-d72d-4274-b5a6-84c5c4bdfc01/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:55:01 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-28c81087-77f5-4da9-aaf0-be899c1c323b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.196s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:55:01 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-28c81087-77f5-4da9-aaf0-be899c1c323b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Acquiring lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:55:01 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-28c81087-77f5-4da9-aaf0-be899c1c323b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:55:01 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-28c81087-77f5-4da9-aaf0-be899c1c323b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:55:01 user nova-compute[74190]: DEBUG nova.policy [None req-28c81087-77f5-4da9-aaf0-be899c1c323b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7d6bb993153245daabfc59215abbf7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df06c4b010434e3da9ba4ea41f26befa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74190) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 11:55:01 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31a86ab2-d72d-4274-b5a6-84c5c4bdfc01/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:55:01 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:55:01 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-28c81087-77f5-4da9-aaf0-be899c1c323b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.196s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:55:01 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-28c81087-77f5-4da9-aaf0-be899c1c323b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f,backing_fmt=raw /opt/stack/data/nova/instances/7eaf6c32-1860-4732-9e50-3a8e04b95be8/disk 1073741824 {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:55:01 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-36aa86a3-733d-4caa-a345-090b6e4ca6b0 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8eec9cde-3553-4fc8-9162-cda963d1a81e is timed out.
Oct 18 11:55:01 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-28c81087-77f5-4da9-aaf0-be899c1c323b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f,backing_fmt=raw /opt/stack/data/nova/instances/7eaf6c32-1860-4732-9e50-3a8e04b95be8/disk 1073741824" returned: 0 in 0.052s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:55:01 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-28c81087-77f5-4da9-aaf0-be899c1c323b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:55:01 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-28c81087-77f5-4da9-aaf0-be899c1c323b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:55:01 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-36aa86a3-733d-4caa-a345-090b6e4ca6b0 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Successfully detached device vdb from instance 8eec9cde-3553-4fc8-9162-cda963d1a81e from the live domain config.
Oct 18 11:55:01 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36aa86a3-733d-4caa-a345-090b6e4ca6b0 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] calling os-brick to detach iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 11:55:01 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-36aa86a3-733d-4caa-a345-090b6e4ca6b0 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, {'target_iqn': 'iqn.2010-10.org.openstack:26d7d20b-7f34-4e38-b6fc-66570f1e4250', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PyoCbhdz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:55:01 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-36aa86a3-733d-4caa-a345-090b6e4ca6b0 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:55:01 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-36aa86a3-733d-4caa-a345-090b6e4ca6b0 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:55:01 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-36aa86a3-733d-4caa-a345-090b6e4ca6b0 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:55:01 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:55:01 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:55:01 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d7c537-2322-4d35-a4e2-961e173f862f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:26d7d20b-7f34-4e38-b6fc-66570f1e4250\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c03633a-f8e8-41ca-be64-1261c907bb2b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:55:01 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-36aa86a3-733d-4caa-a345-090b6e4ca6b0 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 11:55:01 user nova-compute[74190]: No targets found.
Oct 18 11:55:01 user nova-compute[74190]: iSNS:
Oct 18 11:55:01 user nova-compute[74190]: No targets found.
Oct 18 11:55:01 user nova-compute[74190]: STATIC:
Oct 18 11:55:01 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:26d7d20b-7f34-4e38-b6fc-66570f1e4250
Oct 18 11:55:01 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:55:01 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:55:01 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa
Oct 18 11:55:01 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:55:01 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:55:01 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7
Oct 18 11:55:01 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:55:01 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:55:01 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:7c03633a-f8e8-41ca-be64-1261c907bb2b
Oct 18 11:55:01 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:55:01 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:55:01 user nova-compute[74190]: FIRMWARE:
Oct 18 11:55:01 user nova-compute[74190]: No targets found.
Oct 18 11:55:01 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:55:01 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-36aa86a3-733d-4caa-a345-090b6e4ca6b0 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 11:55:01 user nova-compute[74190]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 11:55:01 user nova-compute[74190]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74190) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 11:55:01 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-36aa86a3-733d-4caa-a345-090b6e4ca6b0 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26d7d20b-7f34-4e38-b6fc-66570f1e4250', 0)] {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 11:55:01 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:55:01 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:55:01 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:55:01 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:55:01 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[47fc7a21-7b2f-4437-a13b-3b999e2d2cdd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26d7d20b-7f34-4e38-b6fc-66570f1e4250\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c03633a-f8e8-41ca-be64-1261c907bb2b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:55:01 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:55:01 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:55:01 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e25a241-29da-46a6-bc65-befe7614dedf]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26d7d20b-7f34-4e38-b6fc-66570f1e4250 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c03633a-f8e8-41ca-be64-1261c907bb2b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7 (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:55:01 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-36aa86a3-733d-4caa-a345-090b6e4ca6b0 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 11:55:01 user nova-compute[74190]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26d7d20b-7f34-4e38-b6fc-66570f1e4250 (non-flash)
Oct 18 11:55:01 user nova-compute[74190]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c03633a-f8e8-41ca-be64-1261c907bb2b (non-flash)
Oct 18 11:55:01 user nova-compute[74190]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7 (non-flash)
Oct 18 11:55:01 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:55:01 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-36aa86a3-733d-4caa-a345-090b6e4ca6b0 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 11:55:01 user nova-compute[74190]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26d7d20b-7f34-4e38-b6fc-66570f1e4250 (non-flash)
Oct 18 11:55:01 user nova-compute[74190]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c03633a-f8e8-41ca-be64-1261c907bb2b (non-flash)
Oct 18 11:55:01 user nova-compute[74190]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7 (non-flash)
Oct 18 11:55:01 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:55:01 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-36aa86a3-733d-4caa-a345-090b6e4ca6b0 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1f5404cdc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26d7d20b-7f34-4e38-b6fc-66570f1e4250'): ({'sde'}, set())}) {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 11:55:01 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-36aa86a3-733d-4caa-a345-090b6e4ca6b0 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Removing single pathed devices sde {{(pid=74190) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 11:55:01 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:55:01 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:55:01 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[210d4f57-9b44-401b-abd6-f86a0dbfa88a]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:55:01 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:55:01 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:55:01 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e215e92-7a82-4a76-825a-1507f7f1abf5]: (4, ('ok\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:55:01 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-36aa86a3-733d-4caa-a345-090b6e4ca6b0 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Flushing IO for device /dev/sde {{(pid=74190) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 11:55:01 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-28c81087-77f5-4da9-aaf0-be899c1c323b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.208s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:55:01 user nova-compute[74190]: DEBUG nova.virt.disk.api [None req-28c81087-77f5-4da9-aaf0-be899c1c323b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7eaf6c32-1860-4732-9e50-3a8e04b95be8/disk. size=1073741824 {{(pid=74190) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 18 11:55:01 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-28c81087-77f5-4da9-aaf0-be899c1c323b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eaf6c32-1860-4732-9e50-3a8e04b95be8/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:55:01 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:55:01 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:55:01 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a61b74-1608-4740-bfa0-5ce21a5c5c07]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:55:01 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-36aa86a3-733d-4caa-a345-090b6e4ca6b0 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74190) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 11:55:01 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:55:01 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:55:01 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eec9cde-3553-4fc8-9162-cda963d1a81e/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:55:01 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.048s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:55:01 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[08af28de-a7bd-4800-83f0-512cfb5a5597]: (4, ('1', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:55:01 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-36aa86a3-733d-4caa-a345-090b6e4ca6b0 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 11:55:01 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-36aa86a3-733d-4caa-a345-090b6e4ca6b0 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] SCSI volumes sde have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 11:55:01 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-36aa86a3-733d-4caa-a345-090b6e4ca6b0 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26d7d20b-7f34-4e38-b6fc-66570f1e4250')] {{(pid=74190) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 11:55:01 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26d7d20b-7f34-4e38-b6fc-66570f1e4250 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:55:01 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26d7d20b-7f34-4e38-b6fc-66570f1e4250 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:55:01 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[8018a99e-b8ed-47ed-8d8c-6fb9c14c850a]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:55:01 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-36aa86a3-733d-4caa-a345-090b6e4ca6b0 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:55:01 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26d7d20b-7f34-4e38-b6fc-66570f1e4250 -p 172.16.0.220:3260 --logout {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:55:01 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-28c81087-77f5-4da9-aaf0-be899c1c323b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eaf6c32-1860-4732-9e50-3a8e04b95be8/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:55:01 user nova-compute[74190]: DEBUG nova.virt.disk.api [None req-28c81087-77f5-4da9-aaf0-be899c1c323b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Cannot resize image /opt/stack/data/nova/instances/7eaf6c32-1860-4732-9e50-3a8e04b95be8/disk to a smaller size. {{(pid=74190) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 18 11:55:01 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-28c81087-77f5-4da9-aaf0-be899c1c323b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: 7eaf6c32-1860-4732-9e50-3a8e04b95be8] Created local disks {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 11:55:01 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-28c81087-77f5-4da9-aaf0-be899c1c323b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: 7eaf6c32-1860-4732-9e50-3a8e04b95be8] Ensure instance console log exists: /opt/stack/data/nova/instances/7eaf6c32-1860-4732-9e50-3a8e04b95be8/console.log {{(pid=74190) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 11:55:01 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-28c81087-77f5-4da9-aaf0-be899c1c323b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:55:01 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-28c81087-77f5-4da9-aaf0-be899c1c323b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:55:01 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-28c81087-77f5-4da9-aaf0-be899c1c323b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:55:01 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26d7d20b-7f34-4e38-b6fc-66570f1e4250 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:55:01 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[8edf8e78-e8ff-49b5-9e12-0fea11c60eee]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:26d7d20b-7f34-4e38-b6fc-66570f1e4250, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:26d7d20b-7f34-4e38-b6fc-66570f1e4250, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:55:01 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-36aa86a3-733d-4caa-a345-090b6e4ca6b0 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:26d7d20b-7f34-4e38-b6fc-66570f1e4250, portal: 172.16.0.220,3260]
Oct 18 11:55:01 user nova-compute[74190]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:26d7d20b-7f34-4e38-b6fc-66570f1e4250, portal: 172.16.0.220,3260] successful.
Oct 18 11:55:01 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:55:01 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26d7d20b-7f34-4e38-b6fc-66570f1e4250 -p 172.16.0.220:3260 --op delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:55:01 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26d7d20b-7f34-4e38-b6fc-66570f1e4250 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:55:01 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f8a0063-577d-47b8-9835-896e29134850]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:55:01 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-36aa86a3-733d-4caa-a345-090b6e4ca6b0 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:55:01 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-36aa86a3-733d-4caa-a345-090b6e4ca6b0 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.401s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:55:01 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-36aa86a3-733d-4caa-a345-090b6e4ca6b0 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] <== disconnect_volume: return (403ms) None {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:55:01 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36aa86a3-733d-4caa-a345-090b6e4ca6b0 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] Disconnected iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 11:55:01 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eec9cde-3553-4fc8-9162-cda963d1a81e/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:55:01 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eec9cde-3553-4fc8-9162-cda963d1a81e/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:55:01 user nova-compute[74190]: DEBUG nova.network.neutron [None req-28c81087-77f5-4da9-aaf0-be899c1c323b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: 7eaf6c32-1860-4732-9e50-3a8e04b95be8] Successfully created port: b7a4aa3c-47ee-4696-bd4b-abef2654f2ab {{(pid=74190) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 11:55:01 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eec9cde-3553-4fc8-9162-cda963d1a81e/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:55:02 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b200eb6a-be24-4a8f-be23-4e36f7b7b26e/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:55:02 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:55:02 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b200eb6a-be24-4a8f-be23-4e36f7b7b26e/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:55:02 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b200eb6a-be24-4a8f-be23-4e36f7b7b26e/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:55:02 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b200eb6a-be24-4a8f-be23-4e36f7b7b26e/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:55:02 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 11:55:02 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 11:55:02 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47ed3fb0-c159-484f-8380-79b5564d0ac1/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:55:02 user nova-compute[74190]: DEBUG nova.network.neutron [None req-28c81087-77f5-4da9-aaf0-be899c1c323b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: 7eaf6c32-1860-4732-9e50-3a8e04b95be8] Successfully updated port: b7a4aa3c-47ee-4696-bd4b-abef2654f2ab {{(pid=74190) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 11:55:02 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-28c81087-77f5-4da9-aaf0-be899c1c323b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Acquiring lock "refresh_cache-7eaf6c32-1860-4732-9e50-3a8e04b95be8" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:55:02 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-28c81087-77f5-4da9-aaf0-be899c1c323b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Acquired lock "refresh_cache-7eaf6c32-1860-4732-9e50-3a8e04b95be8" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:55:02 user nova-compute[74190]: DEBUG nova.network.neutron [None req-28c81087-77f5-4da9-aaf0-be899c1c323b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: 7eaf6c32-1860-4732-9e50-3a8e04b95be8] Building network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 11:55:02 user nova-compute[74190]: DEBUG nova.compute.manager [req-f14f6dbb-58bf-4336-a006-4f41fc444240 req-f418af5b-6877-47f3-bdbc-4f9fbac69040 service nova] [instance: 7eaf6c32-1860-4732-9e50-3a8e04b95be8] Received event network-changed-b7a4aa3c-47ee-4696-bd4b-abef2654f2ab {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:55:02 user nova-compute[74190]: DEBUG nova.compute.manager [req-f14f6dbb-58bf-4336-a006-4f41fc444240 req-f418af5b-6877-47f3-bdbc-4f9fbac69040 service nova] [instance: 7eaf6c32-1860-4732-9e50-3a8e04b95be8] Refreshing instance network info cache due to event network-changed-b7a4aa3c-47ee-4696-bd4b-abef2654f2ab. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 11:55:02 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-f14f6dbb-58bf-4336-a006-4f41fc444240 req-f418af5b-6877-47f3-bdbc-4f9fbac69040 service nova] Acquiring lock "refresh_cache-7eaf6c32-1860-4732-9e50-3a8e04b95be8" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:55:02 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47ed3fb0-c159-484f-8380-79b5564d0ac1/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:55:02 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47ed3fb0-c159-484f-8380-79b5564d0ac1/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:55:02 user nova-compute[74190]: DEBUG nova.network.neutron [None req-28c81087-77f5-4da9-aaf0-be899c1c323b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: 7eaf6c32-1860-4732-9e50-3a8e04b95be8] Instance cache missing network info. {{(pid=74190) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 11:55:02 user nova-compute[74190]: DEBUG nova.objects.instance [None req-36aa86a3-733d-4caa-a345-090b6e4ca6b0 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Lazy-loading 'flavor' on Instance uuid 8eec9cde-3553-4fc8-9162-cda963d1a81e {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:55:02 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-36aa86a3-733d-4caa-a345-090b6e4ca6b0 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Lock "8eec9cde-3553-4fc8-9162-cda963d1a81e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.363s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:55:02 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47ed3fb0-c159-484f-8380-79b5564d0ac1/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:55:02 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 11:55:02 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0209c824-88a7-4976-83bf-8a72437f0cc2/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:55:03 user nova-compute[74190]: DEBUG nova.network.neutron [None req-28c81087-77f5-4da9-aaf0-be899c1c323b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: 7eaf6c32-1860-4732-9e50-3a8e04b95be8] Updating instance_info_cache with network_info: [{"id": "b7a4aa3c-47ee-4696-bd4b-abef2654f2ab", "address": "fa:16:3e:05:90:6b", "network": {"id": "25e0d6f5-497d-4898-8181-5b4848950f16", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-245925644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df06c4b010434e3da9ba4ea41f26befa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7a4aa3c-47", "ovs_interfaceid": "b7a4aa3c-47ee-4696-bd4b-abef2654f2ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:55:03 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-28c81087-77f5-4da9-aaf0-be899c1c323b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Releasing lock "refresh_cache-7eaf6c32-1860-4732-9e50-3a8e04b95be8" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:55:03 user nova-compute[74190]: DEBUG nova.compute.manager [None req-28c81087-77f5-4da9-aaf0-be899c1c323b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: 7eaf6c32-1860-4732-9e50-3a8e04b95be8] Instance network_info: |[{"id": "b7a4aa3c-47ee-4696-bd4b-abef2654f2ab", "address": "fa:16:3e:05:90:6b", "network": {"id": "25e0d6f5-497d-4898-8181-5b4848950f16", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-245925644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df06c4b010434e3da9ba4ea41f26befa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7a4aa3c-47", "ovs_interfaceid": "b7a4aa3c-47ee-4696-bd4b-abef2654f2ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 11:55:03 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-f14f6dbb-58bf-4336-a006-4f41fc444240 req-f418af5b-6877-47f3-bdbc-4f9fbac69040 service nova] Acquired lock "refresh_cache-7eaf6c32-1860-4732-9e50-3a8e04b95be8" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:55:03 user nova-compute[74190]: DEBUG nova.network.neutron [req-f14f6dbb-58bf-4336-a006-4f41fc444240 req-f418af5b-6877-47f3-bdbc-4f9fbac69040 service nova] [instance: 7eaf6c32-1860-4732-9e50-3a8e04b95be8] Refreshing network info cache for port b7a4aa3c-47ee-4696-bd4b-abef2654f2ab {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 11:55:03 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-28c81087-77f5-4da9-aaf0-be899c1c323b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: 7eaf6c32-1860-4732-9e50-3a8e04b95be8] Start _get_guest_xml network_info=[{"id": "b7a4aa3c-47ee-4696-bd4b-abef2654f2ab", "address": "fa:16:3e:05:90:6b", "network": {"id": "25e0d6f5-497d-4898-8181-5b4848950f16", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-245925644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df06c4b010434e3da9ba4ea41f26befa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7a4aa3c-47", "ovs_interfaceid": "b7a4aa3c-47ee-4696-bd4b-abef2654f2ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'image_id': '6e88bbf0-6e78-49a8-b3c5-9453d22a89df'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 11:55:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0209c824-88a7-4976-83bf-8a72437f0cc2/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:55:03 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-28c81087-77f5-4da9-aaf0-be899c1c323b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:55:03 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-28c81087-77f5-4da9-aaf0-be899c1c323b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:55:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0209c824-88a7-4976-83bf-8a72437f0cc2/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:55:03 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-28c81087-77f5-4da9-aaf0-be899c1c323b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 11:55:03 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-28c81087-77f5-4da9-aaf0-be899c1c323b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] CPU controller missing on host. {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 11:55:03 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-28c81087-77f5-4da9-aaf0-be899c1c323b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 11:55:03 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-28c81087-77f5-4da9-aaf0-be899c1c323b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] CPU controller found on host. {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 11:55:03 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-28c81087-77f5-4da9-aaf0-be899c1c323b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74190) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 11:55:03 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-28c81087-77f5-4da9-aaf0-be899c1c323b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T11:37:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 11:55:03 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-28c81087-77f5-4da9-aaf0-be899c1c323b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Flavor limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 11:55:03 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-28c81087-77f5-4da9-aaf0-be899c1c323b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Image limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 11:55:03 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-28c81087-77f5-4da9-aaf0-be899c1c323b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Flavor pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 11:55:03 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-28c81087-77f5-4da9-aaf0-be899c1c323b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Image pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 11:55:03 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-28c81087-77f5-4da9-aaf0-be899c1c323b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 11:55:03 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-28c81087-77f5-4da9-aaf0-be899c1c323b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 11:55:03 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-28c81087-77f5-4da9-aaf0-be899c1c323b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 11:55:03 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-28c81087-77f5-4da9-aaf0-be899c1c323b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Got 1 possible topologies {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 11:55:03 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-28c81087-77f5-4da9-aaf0-be899c1c323b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 11:55:03 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-28c81087-77f5-4da9-aaf0-be899c1c323b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 11:55:03 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-28c81087-77f5-4da9-aaf0-be899c1c323b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:54:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-912642604',display_name='tempest-AttachVolumeNegativeTest-server-912642604',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-912642604',id=27,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNgJOsUvz97ASmXIOkilmICwfv85HkLciQhEC+X5IxtwPfMdA/v+ak4ckJVE8To+Wk0/MXLqfoutrKCd0UniuOJL0UZpq4RB1qSJAlViQ9SL0Ws+VlSu0APDMWGSetwP/A==',key_name='tempest-keypair-382322684',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df06c4b010434e3da9ba4ea41f26befa',ramdisk_id='',reservation_id='r-bp6jgwxs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1730208605',owner_user_name='tempest-AttachVolumeNegativeTest-1730208605-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:55:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d6bb993153245daabfc59215abbf7a1',uuid=7eaf6c32-1860-4732-9e50-3a8e04b95be8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7a4aa3c-47ee-4696-bd4b-abef2654f2ab", "address": "fa:16:3e:05:90:6b", "network": {"id": "25e0d6f5-497d-4898-8181-5b4848950f16", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-245925644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df06c4b010434e3da9ba4ea41f26befa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7a4aa3c-47", "ovs_interfaceid": "b7a4aa3c-47ee-4696-bd4b-abef2654f2ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74190) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 11:55:03 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-28c81087-77f5-4da9-aaf0-be899c1c323b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Converting VIF {"id": "b7a4aa3c-47ee-4696-bd4b-abef2654f2ab", "address": "fa:16:3e:05:90:6b", "network": {"id": "25e0d6f5-497d-4898-8181-5b4848950f16", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-245925644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df06c4b010434e3da9ba4ea41f26befa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7a4aa3c-47", "ovs_interfaceid": "b7a4aa3c-47ee-4696-bd4b-abef2654f2ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:55:03 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-28c81087-77f5-4da9-aaf0-be899c1c323b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:90:6b,bridge_name='br-int',has_traffic_filtering=True,id=b7a4aa3c-47ee-4696-bd4b-abef2654f2ab,network=Network(25e0d6f5-497d-4898-8181-5b4848950f16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7a4aa3c-47') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:55:03 user nova-compute[74190]: DEBUG nova.objects.instance [None req-28c81087-77f5-4da9-aaf0-be899c1c323b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lazy-loading 'pci_devices' on Instance uuid 7eaf6c32-1860-4732-9e50-3a8e04b95be8 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:55:03 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-28c81087-77f5-4da9-aaf0-be899c1c323b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: 7eaf6c32-1860-4732-9e50-3a8e04b95be8] End _get_guest_xml xml=<domain type="kvm">
Oct 18 11:55:03 user nova-compute[74190]:   <uuid>7eaf6c32-1860-4732-9e50-3a8e04b95be8</uuid>
Oct 18 11:55:03 user nova-compute[74190]:   <name>instance-0000001b</name>
Oct 18 11:55:03 user nova-compute[74190]:   <memory>524288</memory>
Oct 18 11:55:03 user nova-compute[74190]:   <vcpu>1</vcpu>
Oct 18 11:55:03 user nova-compute[74190]:   <metadata>
Oct 18 11:55:03 user nova-compute[74190]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 11:55:03 user nova-compute[74190]:       <nova:package version="0.0.0"/>
Oct 18 11:55:03 user nova-compute[74190]:       <nova:name>tempest-AttachVolumeNegativeTest-server-912642604</nova:name>
Oct 18 11:55:03 user nova-compute[74190]:       <nova:creationTime>2023-10-18 11:55:03</nova:creationTime>
Oct 18 11:55:03 user nova-compute[74190]:       <nova:flavor name="m1.tiny">
Oct 18 11:55:03 user nova-compute[74190]:         <nova:memory>512</nova:memory>
Oct 18 11:55:03 user nova-compute[74190]:         <nova:disk>1</nova:disk>
Oct 18 11:55:03 user nova-compute[74190]:         <nova:swap>0</nova:swap>
Oct 18 11:55:03 user nova-compute[74190]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 11:55:03 user nova-compute[74190]:         <nova:vcpus>1</nova:vcpus>
Oct 18 11:55:03 user nova-compute[74190]:       </nova:flavor>
Oct 18 11:55:03 user nova-compute[74190]:       <nova:owner>
Oct 18 11:55:03 user nova-compute[74190]:         <nova:user uuid="7d6bb993153245daabfc59215abbf7a1">tempest-AttachVolumeNegativeTest-1730208605-project-member</nova:user>
Oct 18 11:55:03 user nova-compute[74190]:         <nova:project uuid="df06c4b010434e3da9ba4ea41f26befa">tempest-AttachVolumeNegativeTest-1730208605</nova:project>
Oct 18 11:55:03 user nova-compute[74190]:       </nova:owner>
Oct 18 11:55:03 user nova-compute[74190]:       <nova:root type="image" uuid="6e88bbf0-6e78-49a8-b3c5-9453d22a89df"/>
Oct 18 11:55:03 user nova-compute[74190]:       <nova:ports>
Oct 18 11:55:03 user nova-compute[74190]:         <nova:port uuid="b7a4aa3c-47ee-4696-bd4b-abef2654f2ab">
Oct 18 11:55:03 user nova-compute[74190]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 18 11:55:03 user nova-compute[74190]:         </nova:port>
Oct 18 11:55:03 user nova-compute[74190]:       </nova:ports>
Oct 18 11:55:03 user nova-compute[74190]:     </nova:instance>
Oct 18 11:55:03 user nova-compute[74190]:   </metadata>
Oct 18 11:55:03 user nova-compute[74190]:   <sysinfo type="smbios">
Oct 18 11:55:03 user nova-compute[74190]:     <system>
Oct 18 11:55:03 user nova-compute[74190]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 11:55:03 user nova-compute[74190]:       <entry name="product">OpenStack Nova</entry>
Oct 18 11:55:03 user nova-compute[74190]:       <entry name="version">0.0.0</entry>
Oct 18 11:55:03 user nova-compute[74190]:       <entry name="serial">7eaf6c32-1860-4732-9e50-3a8e04b95be8</entry>
Oct 18 11:55:03 user nova-compute[74190]:       <entry name="uuid">7eaf6c32-1860-4732-9e50-3a8e04b95be8</entry>
Oct 18 11:55:03 user nova-compute[74190]:       <entry name="family">Virtual Machine</entry>
Oct 18 11:55:03 user nova-compute[74190]:     </system>
Oct 18 11:55:03 user nova-compute[74190]:   </sysinfo>
Oct 18 11:55:03 user nova-compute[74190]:   <os>
Oct 18 11:55:03 user nova-compute[74190]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 11:55:03 user nova-compute[74190]:     <boot dev="hd"/>
Oct 18 11:55:03 user nova-compute[74190]:     <smbios mode="sysinfo"/>
Oct 18 11:55:03 user nova-compute[74190]:   </os>
Oct 18 11:55:03 user nova-compute[74190]:   <features>
Oct 18 11:55:03 user nova-compute[74190]:     <acpi/>
Oct 18 11:55:03 user nova-compute[74190]:     <apic/>
Oct 18 11:55:03 user nova-compute[74190]:     <vmcoreinfo/>
Oct 18 11:55:03 user nova-compute[74190]:   </features>
Oct 18 11:55:03 user nova-compute[74190]:   <clock offset="utc">
Oct 18 11:55:03 user nova-compute[74190]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 11:55:03 user nova-compute[74190]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 11:55:03 user nova-compute[74190]:     <timer name="hpet" present="no"/>
Oct 18 11:55:03 user nova-compute[74190]:   </clock>
Oct 18 11:55:03 user nova-compute[74190]:   <cpu mode="custom" match="exact">
Oct 18 11:55:03 user nova-compute[74190]:     <model>Nehalem</model>
Oct 18 11:55:03 user nova-compute[74190]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 11:55:03 user nova-compute[74190]:   </cpu>
Oct 18 11:55:03 user nova-compute[74190]:   <devices>
Oct 18 11:55:03 user nova-compute[74190]:     <disk type="file" device="disk">
Oct 18 11:55:03 user nova-compute[74190]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 11:55:03 user nova-compute[74190]:       <source file="/opt/stack/data/nova/instances/7eaf6c32-1860-4732-9e50-3a8e04b95be8/disk"/>
Oct 18 11:55:03 user nova-compute[74190]:       <target dev="vda" bus="virtio"/>
Oct 18 11:55:03 user nova-compute[74190]:     </disk>
Oct 18 11:55:03 user nova-compute[74190]:     <interface type="ethernet">
Oct 18 11:55:03 user nova-compute[74190]:       <mac address="fa:16:3e:05:90:6b"/>
Oct 18 11:55:03 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:55:03 user nova-compute[74190]:       <mtu size="1442"/>
Oct 18 11:55:03 user nova-compute[74190]:       <target dev="tapb7a4aa3c-47"/>
Oct 18 11:55:03 user nova-compute[74190]:     </interface>
Oct 18 11:55:03 user nova-compute[74190]:     <serial type="pty">
Oct 18 11:55:03 user nova-compute[74190]:       <log file="/opt/stack/data/nova/instances/7eaf6c32-1860-4732-9e50-3a8e04b95be8/console.log" append="off"/>
Oct 18 11:55:03 user nova-compute[74190]:     </serial>
Oct 18 11:55:03 user nova-compute[74190]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 11:55:03 user nova-compute[74190]:     <video>
Oct 18 11:55:03 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:55:03 user nova-compute[74190]:     </video>
Oct 18 11:55:03 user nova-compute[74190]:     <rng model="virtio">
Oct 18 11:55:03 user nova-compute[74190]:       <backend model="random">/dev/urandom</backend>
Oct 18 11:55:03 user nova-compute[74190]:     </rng>
Oct 18 11:55:03 user nova-compute[74190]:     <controller type="usb" index="0" model="none"/>
Oct 18 11:55:03 user nova-compute[74190]:     <memballoon model="virtio">
Oct 18 11:55:03 user nova-compute[74190]:       <stats period="10"/>
Oct 18 11:55:03 user nova-compute[74190]:     </memballoon>
Oct 18 11:55:03 user nova-compute[74190]:   </devices>
Oct 18 11:55:03 user nova-compute[74190]: </domain>
Oct 18 11:55:03 user nova-compute[74190]:  {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 11:55:03 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-28c81087-77f5-4da9-aaf0-be899c1c323b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:54:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-912642604',display_name='tempest-AttachVolumeNegativeTest-server-912642604',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-912642604',id=27,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNgJOsUvz97ASmXIOkilmICwfv85HkLciQhEC+X5IxtwPfMdA/v+ak4ckJVE8To+Wk0/MXLqfoutrKCd0UniuOJL0UZpq4RB1qSJAlViQ9SL0Ws+VlSu0APDMWGSetwP/A==',key_name='tempest-keypair-382322684',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df06c4b010434e3da9ba4ea41f26befa',ramdisk_id='',reservation_id='r-bp6jgwxs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1730208605',owner_user_name='tempest-AttachVolumeNegativeTest-1730208605-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:55:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d6bb993153245daabfc59215abbf7a1',uuid=7eaf6c32-1860-4732-9e50-3a8e04b95be8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7a4aa3c-47ee-4696-bd4b-abef2654f2ab", "address": "fa:16:3e:05:90:6b", "network": {"id": "25e0d6f5-497d-4898-8181-5b4848950f16", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-245925644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df06c4b010434e3da9ba4ea41f26befa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7a4aa3c-47", "ovs_interfaceid": "b7a4aa3c-47ee-4696-bd4b-abef2654f2ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 11:55:03 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-28c81087-77f5-4da9-aaf0-be899c1c323b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Converting VIF {"id": "b7a4aa3c-47ee-4696-bd4b-abef2654f2ab", "address": "fa:16:3e:05:90:6b", "network": {"id": "25e0d6f5-497d-4898-8181-5b4848950f16", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-245925644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df06c4b010434e3da9ba4ea41f26befa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7a4aa3c-47", "ovs_interfaceid": "b7a4aa3c-47ee-4696-bd4b-abef2654f2ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:55:03 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-28c81087-77f5-4da9-aaf0-be899c1c323b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:90:6b,bridge_name='br-int',has_traffic_filtering=True,id=b7a4aa3c-47ee-4696-bd4b-abef2654f2ab,network=Network(25e0d6f5-497d-4898-8181-5b4848950f16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7a4aa3c-47') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:55:03 user nova-compute[74190]: DEBUG os_vif [None req-28c81087-77f5-4da9-aaf0-be899c1c323b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:90:6b,bridge_name='br-int',has_traffic_filtering=True,id=b7a4aa3c-47ee-4696-bd4b-abef2654f2ab,network=Network(25e0d6f5-497d-4898-8181-5b4848950f16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7a4aa3c-47') {{(pid=74190) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 11:55:03 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:55:03 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:55:03 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 11:55:03 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:55:03 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '32181c73-a1ff-51f9-a4de-eb7cbf19f782', '_type': 'linux-noop'}}, row=False) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:55:03 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:55:03 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:55:03 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:55:03 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb7a4aa3c-47, may_exist=True, interface_attrs={}) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:55:03 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb7a4aa3c-47, col_values=(('qos', UUID('d831209f-b152-4019-a3e3-391fb197ba70')),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:55:03 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb7a4aa3c-47, col_values=(('external_ids', {'iface-id': 'b7a4aa3c-47ee-4696-bd4b-abef2654f2ab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:90:6b', 'vm-uuid': '7eaf6c32-1860-4732-9e50-3a8e04b95be8'}),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:55:03 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:55:03 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:55:03 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:55:03 user nova-compute[74190]: INFO os_vif [None req-28c81087-77f5-4da9-aaf0-be899c1c323b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:90:6b,bridge_name='br-int',has_traffic_filtering=True,id=b7a4aa3c-47ee-4696-bd4b-abef2654f2ab,network=Network(25e0d6f5-497d-4898-8181-5b4848950f16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7a4aa3c-47')
Oct 18 11:55:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0209c824-88a7-4976-83bf-8a72437f0cc2/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:55:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:55:03 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-28c81087-77f5-4da9-aaf0-be899c1c323b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] No BDM found with device name vda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 11:55:03 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-28c81087-77f5-4da9-aaf0-be899c1c323b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] No VIF found with MAC fa:16:3e:05:90:6b, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 11:55:03 user nova-compute[74190]: DEBUG nova.network.neutron [req-f14f6dbb-58bf-4336-a006-4f41fc444240 req-f418af5b-6877-47f3-bdbc-4f9fbac69040 service nova] [instance: 7eaf6c32-1860-4732-9e50-3a8e04b95be8] Updated VIF entry in instance network info cache for port b7a4aa3c-47ee-4696-bd4b-abef2654f2ab. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 11:55:03 user nova-compute[74190]: DEBUG nova.network.neutron [req-f14f6dbb-58bf-4336-a006-4f41fc444240 req-f418af5b-6877-47f3-bdbc-4f9fbac69040 service nova] [instance: 7eaf6c32-1860-4732-9e50-3a8e04b95be8] Updating instance_info_cache with network_info: [{"id": "b7a4aa3c-47ee-4696-bd4b-abef2654f2ab", "address": "fa:16:3e:05:90:6b", "network": {"id": "25e0d6f5-497d-4898-8181-5b4848950f16", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-245925644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df06c4b010434e3da9ba4ea41f26befa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7a4aa3c-47", "ovs_interfaceid": "b7a4aa3c-47ee-4696-bd4b-abef2654f2ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:55:03 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-f14f6dbb-58bf-4336-a006-4f41fc444240 req-f418af5b-6877-47f3-bdbc-4f9fbac69040 service nova] Releasing lock "refresh_cache-7eaf6c32-1860-4732-9e50-3a8e04b95be8" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:55:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:55:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:55:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:55:03 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 11:55:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:55:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:55:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:55:04 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:55:07 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:55:07 user nova-compute[74190]: DEBUG nova.compute.manager [req-a1ff4adc-f700-4468-a8bc-e90d72c499b2 req-221026cf-8b92-4500-8cb7-5f8927740aae service nova] [instance: 7eaf6c32-1860-4732-9e50-3a8e04b95be8] Received event network-vif-plugged-b7a4aa3c-47ee-4696-bd4b-abef2654f2ab {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:55:07 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-a1ff4adc-f700-4468-a8bc-e90d72c499b2 req-221026cf-8b92-4500-8cb7-5f8927740aae service nova] Acquiring lock "7eaf6c32-1860-4732-9e50-3a8e04b95be8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:55:07 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-a1ff4adc-f700-4468-a8bc-e90d72c499b2 req-221026cf-8b92-4500-8cb7-5f8927740aae service nova] Lock "7eaf6c32-1860-4732-9e50-3a8e04b95be8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:55:07 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-a1ff4adc-f700-4468-a8bc-e90d72c499b2 req-221026cf-8b92-4500-8cb7-5f8927740aae service nova] Lock "7eaf6c32-1860-4732-9e50-3a8e04b95be8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:55:07 user nova-compute[74190]: DEBUG nova.compute.manager [req-a1ff4adc-f700-4468-a8bc-e90d72c499b2 req-221026cf-8b92-4500-8cb7-5f8927740aae service nova] [instance: 7eaf6c32-1860-4732-9e50-3a8e04b95be8] No waiting events found dispatching network-vif-plugged-b7a4aa3c-47ee-4696-bd4b-abef2654f2ab {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:55:07 user nova-compute[74190]: WARNING nova.compute.manager [req-a1ff4adc-f700-4468-a8bc-e90d72c499b2 req-221026cf-8b92-4500-8cb7-5f8927740aae service nova] [instance: 7eaf6c32-1860-4732-9e50-3a8e04b95be8] Received unexpected event network-vif-plugged-b7a4aa3c-47ee-4696-bd4b-abef2654f2ab for instance with vm_state building and task_state spawning.
Oct 18 11:55:07 user nova-compute[74190]: DEBUG nova.compute.manager [req-2d6d4a5e-356d-4f77-9610-e18d33ecd2e4 req-18a86f0e-e7d4-47f9-a6de-e4fc7eb2fa8a service nova] [instance: 7eaf6c32-1860-4732-9e50-3a8e04b95be8] Received event network-vif-plugged-b7a4aa3c-47ee-4696-bd4b-abef2654f2ab {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:55:07 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-2d6d4a5e-356d-4f77-9610-e18d33ecd2e4 req-18a86f0e-e7d4-47f9-a6de-e4fc7eb2fa8a service nova] Acquiring lock "7eaf6c32-1860-4732-9e50-3a8e04b95be8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:55:07 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-2d6d4a5e-356d-4f77-9610-e18d33ecd2e4 req-18a86f0e-e7d4-47f9-a6de-e4fc7eb2fa8a service nova] Lock "7eaf6c32-1860-4732-9e50-3a8e04b95be8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:55:07 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-2d6d4a5e-356d-4f77-9610-e18d33ecd2e4 req-18a86f0e-e7d4-47f9-a6de-e4fc7eb2fa8a service nova] Lock "7eaf6c32-1860-4732-9e50-3a8e04b95be8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:55:07 user nova-compute[74190]: DEBUG nova.compute.manager [req-2d6d4a5e-356d-4f77-9610-e18d33ecd2e4 req-18a86f0e-e7d4-47f9-a6de-e4fc7eb2fa8a service nova] [instance: 7eaf6c32-1860-4732-9e50-3a8e04b95be8] No waiting events found dispatching network-vif-plugged-b7a4aa3c-47ee-4696-bd4b-abef2654f2ab {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:55:07 user nova-compute[74190]: WARNING nova.compute.manager [req-2d6d4a5e-356d-4f77-9610-e18d33ecd2e4 req-18a86f0e-e7d4-47f9-a6de-e4fc7eb2fa8a service nova] [instance: 7eaf6c32-1860-4732-9e50-3a8e04b95be8] Received unexpected event network-vif-plugged-b7a4aa3c-47ee-4696-bd4b-abef2654f2ab for instance with vm_state building and task_state spawning.
Oct 18 11:55:07 user nova-compute[74190]: DEBUG nova.compute.manager [None req-28c81087-77f5-4da9-aaf0-be899c1c323b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: 7eaf6c32-1860-4732-9e50-3a8e04b95be8] Instance event wait completed in 0 seconds for  {{(pid=74190) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 11:55:07 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-28c81087-77f5-4da9-aaf0-be899c1c323b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: 7eaf6c32-1860-4732-9e50-3a8e04b95be8] Guest created on hypervisor {{(pid=74190) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 11:55:07 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8757507-6f7d-4d26-b5e9-da9fcbbd2e40 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: 47ed3fb0-c159-484f-8380-79b5564d0ac1] Calling os-brick to attach iSCSI Volume {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 11:55:07 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8757507-6f7d-4d26-b5e9-da9fcbbd2e40 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f9e5036f-2095-4ea5-bcf5-e4d952b21ab1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zXMBhRGv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:55:07 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-d8757507-6f7d-4d26-b5e9-da9fcbbd2e40 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:55:07 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-d8757507-6f7d-4d26-b5e9-da9fcbbd2e40 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:55:07 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-d8757507-6f7d-4d26-b5e9-da9fcbbd2e40 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:55:07 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-d8757507-6f7d-4d26-b5e9-da9fcbbd2e40 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:55:07 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-d8757507-6f7d-4d26-b5e9-da9fcbbd2e40 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f9e5036f-2095-4ea5-bcf5-e4d952b21ab1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:55:07 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-d8757507-6f7d-4d26-b5e9-da9fcbbd2e40 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f9e5036f-2095-4ea5-bcf5-e4d952b21ab1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:55:07 user nova-compute[74190]: INFO os_brick.initiator.connectors.iscsi [None req-d8757507-6f7d-4d26-b5e9-da9fcbbd2e40 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 11:55:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9e5036f-2095-4ea5-bcf5-e4d952b21ab1 -p 172.16.0.220:3260 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:55:07 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:55:07 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:55:07 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Hypervisor/Node resource view: name=user free_ram=7553MB free_disk=25.31414031982422GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74190) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 11:55:07 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:55:07 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:55:07 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 7eaf6c32-1860-4732-9e50-3a8e04b95be8] Instance spawned successfully.
Oct 18 11:55:07 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-28c81087-77f5-4da9-aaf0-be899c1c323b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: 7eaf6c32-1860-4732-9e50-3a8e04b95be8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 11:55:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9e5036f-2095-4ea5-bcf5-e4d952b21ab1 -p 172.16.0.220:3260" returned: 21 in 0.029s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:55:07 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce209be-4551-4449-b009-6f006368d935]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:55:07 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8757507-6f7d-4d26-b5e9-da9fcbbd2e40 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 11:55:07 user nova-compute[74190]:  {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:55:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9e5036f-2095-4ea5-bcf5-e4d952b21ab1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:55:07 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-28c81087-77f5-4da9-aaf0-be899c1c323b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: 7eaf6c32-1860-4732-9e50-3a8e04b95be8] Found default for hw_cdrom_bus of ide {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:55:07 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-28c81087-77f5-4da9-aaf0-be899c1c323b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: 7eaf6c32-1860-4732-9e50-3a8e04b95be8] Found default for hw_disk_bus of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:55:07 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-28c81087-77f5-4da9-aaf0-be899c1c323b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: 7eaf6c32-1860-4732-9e50-3a8e04b95be8] Found default for hw_input_bus of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:55:07 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-28c81087-77f5-4da9-aaf0-be899c1c323b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: 7eaf6c32-1860-4732-9e50-3a8e04b95be8] Found default for hw_pointer_model of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:55:07 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-28c81087-77f5-4da9-aaf0-be899c1c323b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: 7eaf6c32-1860-4732-9e50-3a8e04b95be8] Found default for hw_video_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:55:07 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-28c81087-77f5-4da9-aaf0-be899c1c323b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: 7eaf6c32-1860-4732-9e50-3a8e04b95be8] Found default for hw_vif_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:55:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9e5036f-2095-4ea5-bcf5-e4d952b21ab1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:55:07 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b11d9df-6506-451f-a0c3-77f0375efad0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f9e5036f-2095-4ea5-bcf5-e4d952b21ab1] added\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:55:07 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8757507-6f7d-4d26-b5e9-da9fcbbd2e40 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f9e5036f-2095-4ea5-bcf5-e4d952b21ab1] added
Oct 18 11:55:07 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:55:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9e5036f-2095-4ea5-bcf5-e4d952b21ab1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:55:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9e5036f-2095-4ea5-bcf5-e4d952b21ab1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:55:07 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d884e75-c979-4e5c-ab77-ba6639ab15b5]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:55:07 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8757507-6f7d-4d26-b5e9-da9fcbbd2e40 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:55:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9e5036f-2095-4ea5-bcf5-e4d952b21ab1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:55:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9e5036f-2095-4ea5-bcf5-e4d952b21ab1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:55:07 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[a20ebe81-b175-4cd9-9b5f-cbad393c21f2]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:55:07 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8757507-6f7d-4d26-b5e9-da9fcbbd2e40 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:55:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9e5036f-2095-4ea5-bcf5-e4d952b21ab1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zXMBhRGv {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:55:07 user nova-compute[74190]: INFO nova.compute.manager [None req-28c81087-77f5-4da9-aaf0-be899c1c323b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: 7eaf6c32-1860-4732-9e50-3a8e04b95be8] Took 6.45 seconds to spawn the instance on the hypervisor.
Oct 18 11:55:07 user nova-compute[74190]: DEBUG nova.compute.manager [None req-28c81087-77f5-4da9-aaf0-be899c1c323b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: 7eaf6c32-1860-4732-9e50-3a8e04b95be8] Checking state {{(pid=74190) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 11:55:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9e5036f-2095-4ea5-bcf5-e4d952b21ab1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zXMBhRGv" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:55:07 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cbe9a08-ca6f-4258-83eb-bf80a33e4866]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:55:07 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8757507-6f7d-4d26-b5e9-da9fcbbd2e40 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zXMBhRGv'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:55:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9e5036f-2095-4ea5-bcf5-e4d952b21ab1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:55:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9e5036f-2095-4ea5-bcf5-e4d952b21ab1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:55:07 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Applying migration context for instance a9012673-826b-4be7-a55b-9bb35a227c17 as it has an incoming, in-progress migration 721bcb36-1ad7-4025-baa0-50a8a0705c76. Migration status is post-migrating {{(pid=74190) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 18 11:55:07 user nova-compute[74190]: INFO nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Updating resource usage from migration 721bcb36-1ad7-4025-baa0-50a8a0705c76
Oct 18 11:55:07 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ea8d3f-0705-4ff4-946c-fab7c77b817f]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:55:07 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8757507-6f7d-4d26-b5e9-da9fcbbd2e40 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:55:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:55:07 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 0209c824-88a7-4976-83bf-8a72437f0cc2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:55:07 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 4e916d24-9f9d-4289-87ce-f65d2499fcd9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:55:07 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 47ed3fb0-c159-484f-8380-79b5564d0ac1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:55:07 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 8eec9cde-3553-4fc8-9162-cda963d1a81e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:55:07 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance b200eb6a-be24-4a8f-be23-4e36f7b7b26e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:55:07 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 95ca0697-22b5-4109-868f-ca5556015a1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:55:07 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 42413a94-9973-4e8d-83b6-207a4e7847c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:55:07 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 31a86ab2-d72d-4274-b5a6-84c5c4bdfc01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:55:07 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Migration 721bcb36-1ad7-4025-baa0-50a8a0705c76 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 18 11:55:07 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance a9012673-826b-4be7-a55b-9bb35a227c17 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:55:07 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 7eaf6c32-1860-4732-9e50-3a8e04b95be8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:55:07 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 11:55:07 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 11:55:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:55:07 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b11456-2d64-46a1-9272-177bd7919887]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c03633a-f8e8-41ca-be64-1261c907bb2b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7 (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:55:07 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8757507-6f7d-4d26-b5e9-da9fcbbd2e40 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 11:55:07 user nova-compute[74190]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c03633a-f8e8-41ca-be64-1261c907bb2b (non-flash)
Oct 18 11:55:07 user nova-compute[74190]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7 (non-flash)
Oct 18 11:55:07 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:55:07 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8757507-6f7d-4d26-b5e9-da9fcbbd2e40 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 11:55:07 user nova-compute[74190]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c03633a-f8e8-41ca-be64-1261c907bb2b (non-flash)
Oct 18 11:55:07 user nova-compute[74190]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7 (non-flash)
Oct 18 11:55:07 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:55:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9e5036f-2095-4ea5-bcf5-e4d952b21ab1 -p 172.16.0.220:3260 --login {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:55:07 user nova-compute[74190]: INFO nova.compute.manager [None req-28c81087-77f5-4da9-aaf0-be899c1c323b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: 7eaf6c32-1860-4732-9e50-3a8e04b95be8] Took 7.65 seconds to build instance.
Oct 18 11:55:07 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-28c81087-77f5-4da9-aaf0-be899c1c323b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "7eaf6c32-1860-4732-9e50-3a8e04b95be8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.762s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:55:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9e5036f-2095-4ea5-bcf5-e4d952b21ab1 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:55:07 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab15c20b-1b69-402b-9966-7f3e1484a577]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f9e5036f-2095-4ea5-bcf5-e4d952b21ab1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f9e5036f-2095-4ea5-bcf5-e4d952b21ab1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:55:07 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8757507-6f7d-4d26-b5e9-da9fcbbd2e40 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f9e5036f-2095-4ea5-bcf5-e4d952b21ab1, portal: 172.16.0.220,3260]
Oct 18 11:55:07 user nova-compute[74190]: Login to [iface: default, target: iqn.2010-10.org.openstack:f9e5036f-2095-4ea5-bcf5-e4d952b21ab1, portal: 172.16.0.220,3260] successful.
Oct 18 11:55:07 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:55:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9e5036f-2095-4ea5-bcf5-e4d952b21ab1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:55:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9e5036f-2095-4ea5-bcf5-e4d952b21ab1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:55:07 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[d590a02f-7839-4d83-b967-74d8e9c2d93e]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:55:07 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8757507-6f7d-4d26-b5e9-da9fcbbd2e40 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:55:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:55:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:55:07 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[9acaf542-0bb0-4c0b-adcc-f1e50ab5fc04]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c03633a-f8e8-41ca-be64-1261c907bb2b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e5036f-2095-4ea5-bcf5-e4d952b21ab1 (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:55:07 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8757507-6f7d-4d26-b5e9-da9fcbbd2e40 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 11:55:07 user nova-compute[74190]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c03633a-f8e8-41ca-be64-1261c907bb2b (non-flash)
Oct 18 11:55:07 user nova-compute[74190]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7 (non-flash)
Oct 18 11:55:07 user nova-compute[74190]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e5036f-2095-4ea5-bcf5-e4d952b21ab1 (non-flash)
Oct 18 11:55:07 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:55:07 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8757507-6f7d-4d26-b5e9-da9fcbbd2e40 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 11:55:07 user nova-compute[74190]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c03633a-f8e8-41ca-be64-1261c907bb2b (non-flash)
Oct 18 11:55:07 user nova-compute[74190]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7 (non-flash)
Oct 18 11:55:07 user nova-compute[74190]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e5036f-2095-4ea5-bcf5-e4d952b21ab1 (non-flash)
Oct 18 11:55:07 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:55:07 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-d8757507-6f7d-4d26-b5e9-da9fcbbd2e40 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f9e5036f-2095-4ea5-bcf5-e4d952b21ab1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.375s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:55:07 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8757507-6f7d-4d26-b5e9-da9fcbbd2e40 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Connected to 172.16.0.220:3260 {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 11:55:07 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-d8757507-6f7d-4d26-b5e9-da9fcbbd2e40 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] HCTL ('33', '-', '-', 0) found on session 33 with lun 0 {{(pid=74190) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 11:55:07 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-d8757507-6f7d-4d26-b5e9-da9fcbbd2e40 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74190) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 11:55:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:55:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:55:07 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[4594f6e6-2549-48bf-bc86-8860d3c983f1]: (4, ('- - 0', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:55:07 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-d8757507-6f7d-4d26-b5e9-da9fcbbd2e40 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Searching for a device in session 33 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74190) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 11:55:07 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8757507-6f7d-4d26-b5e9-da9fcbbd2e40 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f9e5036f-2095-4ea5-bcf5-e4d952b21ab1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zXMBhRGv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 11:55:07 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 11:55:07 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 11:55:07 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Compute_service record updated for user:user {{(pid=74190) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 11:55:07 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.587s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:55:08 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:55:08 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-d8757507-6f7d-4d26-b5e9-da9fcbbd2e40 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.420s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:55:08 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8757507-6f7d-4d26-b5e9-da9fcbbd2e40 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] <== connect_volume: return (1422ms) {'type': 'block', 'scsi_wwn': '26235376233316165', 'path': '/dev/sdb'} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:55:08 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8757507-6f7d-4d26-b5e9-da9fcbbd2e40 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: 47ed3fb0-c159-484f-8380-79b5564d0ac1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26235376233316165', 'path': '/dev/sdb'} {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 11:55:08 user nova-compute[74190]: DEBUG nova.objects.instance [None req-d8757507-6f7d-4d26-b5e9-da9fcbbd2e40 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lazy-loading 'flavor' on Instance uuid 47ed3fb0-c159-484f-8380-79b5564d0ac1 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:55:08 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-d8757507-6f7d-4d26-b5e9-da9fcbbd2e40 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] attach device xml: <disk type="block" device="disk">
Oct 18 11:55:08 user nova-compute[74190]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 11:55:08 user nova-compute[74190]:   <source dev="/dev/sdb"/>
Oct 18 11:55:08 user nova-compute[74190]:   <target dev="vdc" bus="virtio"/>
Oct 18 11:55:08 user nova-compute[74190]:   <serial>f9e5036f-2095-4ea5-bcf5-e4d952b21ab1</serial>
Oct 18 11:55:08 user nova-compute[74190]: </disk>
Oct 18 11:55:08 user nova-compute[74190]:  {{(pid=74190) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 18 11:55:08 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:55:08 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:55:08 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:55:08 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Starting heal instance info cache {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 11:55:08 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Didn't find any instances for network info cache update. {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 18 11:55:08 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:55:08 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:55:09 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-d8757507-6f7d-4d26-b5e9-da9fcbbd2e40 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] No BDM found with device name vda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 11:55:09 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-d8757507-6f7d-4d26-b5e9-da9fcbbd2e40 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 11:55:09 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-d8757507-6f7d-4d26-b5e9-da9fcbbd2e40 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 11:55:09 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-d8757507-6f7d-4d26-b5e9-da9fcbbd2e40 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] No VIF found with MAC fa:16:3e:4b:2c:c3, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 11:55:09 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-d8757507-6f7d-4d26-b5e9-da9fcbbd2e40 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lock "47ed3fb0-c159-484f-8380-79b5564d0ac1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.292s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:55:09 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-d377a8ed-ba71-4d46-85e4-656658d6b142 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Acquiring lock "47ed3fb0-c159-484f-8380-79b5564d0ac1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:55:09 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-d377a8ed-ba71-4d46-85e4-656658d6b142 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lock "47ed3fb0-c159-484f-8380-79b5564d0ac1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:55:09 user nova-compute[74190]: INFO nova.compute.manager [None req-d377a8ed-ba71-4d46-85e4-656658d6b142 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: 47ed3fb0-c159-484f-8380-79b5564d0ac1] Detaching volume 7c03633a-f8e8-41ca-be64-1261c907bb2b
Oct 18 11:55:09 user nova-compute[74190]: INFO nova.virt.block_device [None req-d377a8ed-ba71-4d46-85e4-656658d6b142 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: 47ed3fb0-c159-484f-8380-79b5564d0ac1] Attempting to driver detach volume 7c03633a-f8e8-41ca-be64-1261c907bb2b from mountpoint /dev/vdb
Oct 18 11:55:09 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-d377a8ed-ba71-4d46-85e4-656658d6b142 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Attempting to detach device vdb from instance 47ed3fb0-c159-484f-8380-79b5564d0ac1 from the persistent domain config. {{(pid=74190) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 18 11:55:09 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-d377a8ed-ba71-4d46-85e4-656658d6b142 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 11:55:09 user nova-compute[74190]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 11:55:09 user nova-compute[74190]:   <source dev="/dev/sdf"/>
Oct 18 11:55:09 user nova-compute[74190]:   <target dev="vdb" bus="virtio"/>
Oct 18 11:55:09 user nova-compute[74190]:   <serial>7c03633a-f8e8-41ca-be64-1261c907bb2b</serial>
Oct 18 11:55:09 user nova-compute[74190]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 18 11:55:09 user nova-compute[74190]: </disk>
Oct 18 11:55:09 user nova-compute[74190]:  {{(pid=74190) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 11:55:09 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-d377a8ed-ba71-4d46-85e4-656658d6b142 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Successfully detached device vdb from instance 47ed3fb0-c159-484f-8380-79b5564d0ac1 from the persistent domain config.
Oct 18 11:55:09 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-d377a8ed-ba71-4d46-85e4-656658d6b142 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 47ed3fb0-c159-484f-8380-79b5564d0ac1 from the live domain config. {{(pid=74190) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 18 11:55:09 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-d377a8ed-ba71-4d46-85e4-656658d6b142 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 11:55:09 user nova-compute[74190]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 11:55:09 user nova-compute[74190]:   <source dev="/dev/sdf"/>
Oct 18 11:55:09 user nova-compute[74190]:   <target dev="vdb" bus="virtio"/>
Oct 18 11:55:09 user nova-compute[74190]:   <serial>7c03633a-f8e8-41ca-be64-1261c907bb2b</serial>
Oct 18 11:55:09 user nova-compute[74190]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 18 11:55:09 user nova-compute[74190]: </disk>
Oct 18 11:55:09 user nova-compute[74190]:  {{(pid=74190) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 11:55:09 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:55:10 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-d377a8ed-ba71-4d46-85e4-656658d6b142 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 47ed3fb0-c159-484f-8380-79b5564d0ac1 {{(pid=74190) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 18 11:55:13 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:55:14 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:55:17 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Starting finish_migration {{(pid=74190) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Oct 18 11:55:17 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Instance directory exists: not creating {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 18 11:55:17 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Creating image(s)
Oct 18 11:55:17 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Did not create local disks {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 18 11:55:17 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Ensure instance console log exists: /opt/stack/data/nova/instances/a9012673-826b-4be7-a55b-9bb35a227c17/console.log {{(pid=74190) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 11:55:17 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:55:17 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:55:17 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:55:17 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Start _get_guest_xml network_info=[{"id": "98016144-4b95-4e94-8ae4-581089fe4f63", "address": "fa:16:3e:ea:1d:55", "network": {"id": "f5ab7da4-2b07-4465-9a89-a07eb053ba91", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1315695374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1315695374-network", "vif_mac": "fa:16:3e:ea:1d:55"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08cf52ce927443158aa731367f08bd57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98016144-4b", "ovs_interfaceid": "98016144-4b95-4e94-8ae4-581089fe4f63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qAZlmtWu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'a9012673-826b-4be7-a55b-9bb35a227c17', 'attached_at': '2023-10-18T11:55:17.000000', 'detached_at': '', 'volume_id': 'cc26cf8b-df01-4da0-a6d0-9013e888d227', 'serial': 'cc26cf8b-df01-4da0-a6d0-9013e888d227'}, 'delete_on_termination': True, 'guest_format': None, 'attachment_id': 'c99a604d-2c23-4d92-8fec-1df16931af0b', 'volume_type': None} {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 11:55:17 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:55:17 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:55:17 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 11:55:17 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] CPU controller missing on host. {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 11:55:17 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 11:55:17 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] CPU controller found on host. {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 11:55:17 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74190) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 11:55:17 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T11:37:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 11:55:17 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Flavor limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 11:55:17 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Image limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 11:55:17 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Flavor pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 11:55:17 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Image pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 11:55:17 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 11:55:17 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 11:55:17 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 11:55:17 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Got 1 possible topologies {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 11:55:17 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 11:55:17 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 11:55:17 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Calling os-brick to attach iSCSI Volume {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 11:55:17 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qAZlmtWu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:55:17 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:55:17 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:55:17 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:55:17 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:55:17 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:55:17 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:55:17 user nova-compute[74190]: INFO os_brick.initiator.connectors.iscsi [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 11:55:17 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 -p 172.16.0.220:3260 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:55:17 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:55:17 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c2f7eb5-20be-427c-ad66-78b467f70bdc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:55:17 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 11:55:17 user nova-compute[74190]:  {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:55:17 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 -p 172.16.0.220:3260 --interface default --op new {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:55:17 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:55:17 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f34c7b-af85-42cd-a5b7-36994d2b09d6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227] added\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:55:17 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227] added
Oct 18 11:55:17 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:55:17 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:55:17 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:55:17 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[37903d37-114d-4bf6-8dcc-3bdd88ea476b]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:55:17 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:55:17 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:55:17 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:55:17 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d56e13-ff80-4110-bca5-8d735566c2c0]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:55:17 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:55:17 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qAZlmtWu {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:55:17 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qAZlmtWu" returned: 0 in 0.024s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:55:17 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[c48f599f-f8d8-4b42-83d6-a82b42c4ba61]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:55:17 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qAZlmtWu'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:55:17 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:55:17 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:55:17 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[df623594-b22c-48ed-bfd6-077f9e13e943]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:55:17 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:55:17 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:55:17 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:55:17 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3ba8704-0f08-4c2f-a9d2-431b6349771e]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c03633a-f8e8-41ca-be64-1261c907bb2b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e5036f-2095-4ea5-bcf5-e4d952b21ab1 (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:55:17 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 11:55:17 user nova-compute[74190]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c03633a-f8e8-41ca-be64-1261c907bb2b (non-flash)
Oct 18 11:55:17 user nova-compute[74190]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7 (non-flash)
Oct 18 11:55:17 user nova-compute[74190]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e5036f-2095-4ea5-bcf5-e4d952b21ab1 (non-flash)
Oct 18 11:55:17 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:55:17 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 11:55:17 user nova-compute[74190]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c03633a-f8e8-41ca-be64-1261c907bb2b (non-flash)
Oct 18 11:55:17 user nova-compute[74190]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7 (non-flash)
Oct 18 11:55:17 user nova-compute[74190]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e5036f-2095-4ea5-bcf5-e4d952b21ab1 (non-flash)
Oct 18 11:55:17 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:55:17 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 -p 172.16.0.220:3260 --login {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:55:17 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:55:17 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d8a61b3-9b57-4f3d-884b-ab3434e02b2d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:55:17 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227, portal: 172.16.0.220,3260]
Oct 18 11:55:17 user nova-compute[74190]: Login to [iface: default, target: iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227, portal: 172.16.0.220,3260] successful.
Oct 18 11:55:17 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:55:17 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:55:17 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:55:17 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[956ae33b-83f6-4d71-b951-31a5b9b1cd4e]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:55:17 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:55:17 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:55:17 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:55:17 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[563a6c1b-726d-47e7-8972-9ac45790d31b]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c03633a-f8e8-41ca-be64-1261c907bb2b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e5036f-2095-4ea5-bcf5-e4d952b21ab1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:55:17 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 11:55:17 user nova-compute[74190]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c03633a-f8e8-41ca-be64-1261c907bb2b (non-flash)
Oct 18 11:55:17 user nova-compute[74190]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7 (non-flash)
Oct 18 11:55:17 user nova-compute[74190]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e5036f-2095-4ea5-bcf5-e4d952b21ab1 (non-flash)
Oct 18 11:55:17 user nova-compute[74190]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 (non-flash)
Oct 18 11:55:17 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:55:17 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 11:55:17 user nova-compute[74190]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c03633a-f8e8-41ca-be64-1261c907bb2b (non-flash)
Oct 18 11:55:17 user nova-compute[74190]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7 (non-flash)
Oct 18 11:55:17 user nova-compute[74190]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e5036f-2095-4ea5-bcf5-e4d952b21ab1 (non-flash)
Oct 18 11:55:17 user nova-compute[74190]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 (non-flash)
Oct 18 11:55:17 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:55:17 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:55:17 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Connected to 172.16.0.220:3260 {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 11:55:17 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] HCTL ('35', '-', '-', 0) found on session 34 with lun 0 {{(pid=74190) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 11:55:17 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74190) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 11:55:17 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:55:17 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:55:17 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb422052-d0d1-4f09-a90e-c8b8e2e4209a]: (4, ('- - 0', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:55:17 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Searching for a device in session 34 and hctl ['35', '*', '*', 0] yield: None {{(pid=74190) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 11:55:18 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:55:18 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Searching for a device in session 34 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74190) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 11:55:18 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qAZlmtWu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 11:55:18 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:55:18 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '26234386438336635', 'path': '/dev/sdd'} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:55:18 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26234386438336635', 'path': '/dev/sdd'} {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 11:55:18 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:53:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1490971997',display_name='tempest-ServerActionsTestOtherA-server-1490971997',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1490971997',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOQBzNTv9LZg0yq/3lf4kmMEAFSSxHvdpQtvKWiUtvrhz9NgEirvm+N8Tqx31x38AF1/g3O4be21YeguWgKCS7N36Oy8ZZWxYYR46ATEkZPMIr3HhNKcU83cECzcDD++0g==',key_name='tempest-keypair-1511789347',keypairs=<?>,launch_index=0,launched_at=2023-10-18T11:53:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='08cf52ce927443158aa731367f08bd57',ramdisk_id='',reservation_id='r-0xda3q9d',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1288544694',owner_user_name='tempest-ServerActionsTestOtherA-1288544694-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:54:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b771e627a76b4540bf8de665df3d7787',uuid=a9012673-826b-4be7-a55b-9bb35a227c17,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "98016144-4b95-4e94-8ae4-581089fe4f63", "address": "fa:16:3e:ea:1d:55", "network": {"id": "f5ab7da4-2b07-4465-9a89-a07eb053ba91", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1315695374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1315695374-network", "vif_mac": "fa:16:3e:ea:1d:55"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08cf52ce927443158aa731367f08bd57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98016144-4b", "ovs_interfaceid": "98016144-4b95-4e94-8ae4-581089fe4f63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74190) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 11:55:18 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Converting VIF {"id": "98016144-4b95-4e94-8ae4-581089fe4f63", "address": "fa:16:3e:ea:1d:55", "network": {"id": "f5ab7da4-2b07-4465-9a89-a07eb053ba91", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1315695374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1315695374-network", "vif_mac": "fa:16:3e:ea:1d:55"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08cf52ce927443158aa731367f08bd57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98016144-4b", "ovs_interfaceid": "98016144-4b95-4e94-8ae4-581089fe4f63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:55:18 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:1d:55,bridge_name='br-int',has_traffic_filtering=True,id=98016144-4b95-4e94-8ae4-581089fe4f63,network=Network(f5ab7da4-2b07-4465-9a89-a07eb053ba91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98016144-4b') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:55:18 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] End _get_guest_xml xml=<domain type="kvm">
Oct 18 11:55:18 user nova-compute[74190]:   <uuid>a9012673-826b-4be7-a55b-9bb35a227c17</uuid>
Oct 18 11:55:18 user nova-compute[74190]:   <name>instance-00000017</name>
Oct 18 11:55:18 user nova-compute[74190]:   <memory>2097152</memory>
Oct 18 11:55:18 user nova-compute[74190]:   <vcpu>1</vcpu>
Oct 18 11:55:18 user nova-compute[74190]:   <metadata>
Oct 18 11:55:18 user nova-compute[74190]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 11:55:18 user nova-compute[74190]:       <nova:package version="0.0.0"/>
Oct 18 11:55:18 user nova-compute[74190]:       <nova:name>tempest-ServerActionsTestOtherA-server-1490971997</nova:name>
Oct 18 11:55:18 user nova-compute[74190]:       <nova:creationTime>2023-10-18 11:55:17</nova:creationTime>
Oct 18 11:55:18 user nova-compute[74190]:       <nova:flavor name="m1.small">
Oct 18 11:55:18 user nova-compute[74190]:         <nova:memory>2048</nova:memory>
Oct 18 11:55:18 user nova-compute[74190]:         <nova:disk>20</nova:disk>
Oct 18 11:55:18 user nova-compute[74190]:         <nova:swap>0</nova:swap>
Oct 18 11:55:18 user nova-compute[74190]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 11:55:18 user nova-compute[74190]:         <nova:vcpus>1</nova:vcpus>
Oct 18 11:55:18 user nova-compute[74190]:       </nova:flavor>
Oct 18 11:55:18 user nova-compute[74190]:       <nova:owner>
Oct 18 11:55:18 user nova-compute[74190]:         <nova:user uuid="b771e627a76b4540bf8de665df3d7787">tempest-ServerActionsTestOtherA-1288544694-project-member</nova:user>
Oct 18 11:55:18 user nova-compute[74190]:         <nova:project uuid="08cf52ce927443158aa731367f08bd57">tempest-ServerActionsTestOtherA-1288544694</nova:project>
Oct 18 11:55:18 user nova-compute[74190]:       </nova:owner>
Oct 18 11:55:18 user nova-compute[74190]:       <nova:ports>
Oct 18 11:55:18 user nova-compute[74190]:         <nova:port uuid="98016144-4b95-4e94-8ae4-581089fe4f63">
Oct 18 11:55:18 user nova-compute[74190]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 18 11:55:18 user nova-compute[74190]:         </nova:port>
Oct 18 11:55:18 user nova-compute[74190]:       </nova:ports>
Oct 18 11:55:18 user nova-compute[74190]:     </nova:instance>
Oct 18 11:55:18 user nova-compute[74190]:   </metadata>
Oct 18 11:55:18 user nova-compute[74190]:   <sysinfo type="smbios">
Oct 18 11:55:18 user nova-compute[74190]:     <system>
Oct 18 11:55:18 user nova-compute[74190]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 11:55:18 user nova-compute[74190]:       <entry name="product">OpenStack Nova</entry>
Oct 18 11:55:18 user nova-compute[74190]:       <entry name="version">0.0.0</entry>
Oct 18 11:55:18 user nova-compute[74190]:       <entry name="serial">a9012673-826b-4be7-a55b-9bb35a227c17</entry>
Oct 18 11:55:18 user nova-compute[74190]:       <entry name="uuid">a9012673-826b-4be7-a55b-9bb35a227c17</entry>
Oct 18 11:55:18 user nova-compute[74190]:       <entry name="family">Virtual Machine</entry>
Oct 18 11:55:18 user nova-compute[74190]:     </system>
Oct 18 11:55:18 user nova-compute[74190]:   </sysinfo>
Oct 18 11:55:18 user nova-compute[74190]:   <os>
Oct 18 11:55:18 user nova-compute[74190]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 11:55:18 user nova-compute[74190]:     <boot dev="hd"/>
Oct 18 11:55:18 user nova-compute[74190]:     <smbios mode="sysinfo"/>
Oct 18 11:55:18 user nova-compute[74190]:   </os>
Oct 18 11:55:18 user nova-compute[74190]:   <features>
Oct 18 11:55:18 user nova-compute[74190]:     <acpi/>
Oct 18 11:55:18 user nova-compute[74190]:     <apic/>
Oct 18 11:55:18 user nova-compute[74190]:     <vmcoreinfo/>
Oct 18 11:55:18 user nova-compute[74190]:   </features>
Oct 18 11:55:18 user nova-compute[74190]:   <clock offset="utc">
Oct 18 11:55:18 user nova-compute[74190]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 11:55:18 user nova-compute[74190]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 11:55:18 user nova-compute[74190]:     <timer name="hpet" present="no"/>
Oct 18 11:55:18 user nova-compute[74190]:   </clock>
Oct 18 11:55:18 user nova-compute[74190]:   <cpu mode="custom" match="exact">
Oct 18 11:55:18 user nova-compute[74190]:     <model>Nehalem</model>
Oct 18 11:55:18 user nova-compute[74190]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 11:55:18 user nova-compute[74190]:   </cpu>
Oct 18 11:55:18 user nova-compute[74190]:   <devices>
Oct 18 11:55:18 user nova-compute[74190]:     <disk type="block" device="disk">
Oct 18 11:55:18 user nova-compute[74190]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 11:55:18 user nova-compute[74190]:       <source dev="/dev/sdd"/>
Oct 18 11:55:18 user nova-compute[74190]:       <target dev="vda" bus="virtio"/>
Oct 18 11:55:18 user nova-compute[74190]:       <serial>cc26cf8b-df01-4da0-a6d0-9013e888d227</serial>
Oct 18 11:55:18 user nova-compute[74190]:     </disk>
Oct 18 11:55:18 user nova-compute[74190]:     <interface type="ethernet">
Oct 18 11:55:18 user nova-compute[74190]:       <mac address="fa:16:3e:ea:1d:55"/>
Oct 18 11:55:18 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:55:18 user nova-compute[74190]:       <mtu size="1442"/>
Oct 18 11:55:18 user nova-compute[74190]:       <target dev="tap98016144-4b"/>
Oct 18 11:55:18 user nova-compute[74190]:     </interface>
Oct 18 11:55:18 user nova-compute[74190]:     <serial type="pty">
Oct 18 11:55:18 user nova-compute[74190]:       <log file="/opt/stack/data/nova/instances/a9012673-826b-4be7-a55b-9bb35a227c17/console.log" append="off"/>
Oct 18 11:55:18 user nova-compute[74190]:     </serial>
Oct 18 11:55:18 user nova-compute[74190]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 11:55:18 user nova-compute[74190]:     <video>
Oct 18 11:55:18 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:55:18 user nova-compute[74190]:     </video>
Oct 18 11:55:18 user nova-compute[74190]:     <rng model="virtio">
Oct 18 11:55:18 user nova-compute[74190]:       <backend model="random">/dev/urandom</backend>
Oct 18 11:55:18 user nova-compute[74190]:     </rng>
Oct 18 11:55:18 user nova-compute[74190]:     <controller type="usb" index="0" model="none"/>
Oct 18 11:55:18 user nova-compute[74190]:     <memballoon model="virtio">
Oct 18 11:55:18 user nova-compute[74190]:       <stats period="10"/>
Oct 18 11:55:18 user nova-compute[74190]:     </memballoon>
Oct 18 11:55:18 user nova-compute[74190]:   </devices>
Oct 18 11:55:18 user nova-compute[74190]: </domain>
Oct 18 11:55:18 user nova-compute[74190]:  {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 11:55:18 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:53:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1490971997',display_name='tempest-ServerActionsTestOtherA-server-1490971997',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1490971997',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOQBzNTv9LZg0yq/3lf4kmMEAFSSxHvdpQtvKWiUtvrhz9NgEirvm+N8Tqx31x38AF1/g3O4be21YeguWgKCS7N36Oy8ZZWxYYR46ATEkZPMIr3HhNKcU83cECzcDD++0g==',key_name='tempest-keypair-1511789347',keypairs=<?>,launch_index=0,launched_at=2023-10-18T11:53:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='08cf52ce927443158aa731367f08bd57',ramdisk_id='',reservation_id='r-0xda3q9d',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1288544694',owner_user_name='tempest-ServerActionsTestOtherA-1288544694-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:54:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b771e627a76b4540bf8de665df3d7787',uuid=a9012673-826b-4be7-a55b-9bb35a227c17,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "98016144-4b95-4e94-8ae4-581089fe4f63", "address": "fa:16:3e:ea:1d:55", "network": {"id": "f5ab7da4-2b07-4465-9a89-a07eb053ba91", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1315695374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1315695374-network", "vif_mac": "fa:16:3e:ea:1d:55"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08cf52ce927443158aa731367f08bd57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98016144-4b", "ovs_interfaceid": "98016144-4b95-4e94-8ae4-581089fe4f63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 11:55:18 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Converting VIF {"id": "98016144-4b95-4e94-8ae4-581089fe4f63", "address": "fa:16:3e:ea:1d:55", "network": {"id": "f5ab7da4-2b07-4465-9a89-a07eb053ba91", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1315695374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1315695374-network", "vif_mac": "fa:16:3e:ea:1d:55"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08cf52ce927443158aa731367f08bd57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98016144-4b", "ovs_interfaceid": "98016144-4b95-4e94-8ae4-581089fe4f63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:55:18 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:1d:55,bridge_name='br-int',has_traffic_filtering=True,id=98016144-4b95-4e94-8ae4-581089fe4f63,network=Network(f5ab7da4-2b07-4465-9a89-a07eb053ba91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98016144-4b') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:55:18 user nova-compute[74190]: DEBUG os_vif [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:1d:55,bridge_name='br-int',has_traffic_filtering=True,id=98016144-4b95-4e94-8ae4-581089fe4f63,network=Network(f5ab7da4-2b07-4465-9a89-a07eb053ba91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98016144-4b') {{(pid=74190) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 11:55:18 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:55:18 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:55:18 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 11:55:18 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:55:18 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '47a61e6d-c36e-5934-ad57-41d2e5d40d2f', '_type': 'linux-noop'}}, row=False) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:55:18 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:55:18 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:55:18 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:55:18 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap98016144-4b, may_exist=True, interface_attrs={}) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:55:18 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap98016144-4b, col_values=(('qos', UUID('f4e3657b-6f4f-4210-b7f4-b11fb04da6b3')),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:55:18 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap98016144-4b, col_values=(('external_ids', {'iface-id': '98016144-4b95-4e94-8ae4-581089fe4f63', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:1d:55', 'vm-uuid': 'a9012673-826b-4be7-a55b-9bb35a227c17'}),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:55:18 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:55:18 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:55:18 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:55:18 user nova-compute[74190]: INFO os_vif [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:1d:55,bridge_name='br-int',has_traffic_filtering=True,id=98016144-4b95-4e94-8ae4-581089fe4f63,network=Network(f5ab7da4-2b07-4465-9a89-a07eb053ba91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98016144-4b')
Oct 18 11:55:18 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] No BDM found with device name vda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 11:55:18 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] No VIF found with MAC fa:16:3e:ea:1d:55, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 11:55:19 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:55:19 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:55:19 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:55:19 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:55:19 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:55:20 user nova-compute[74190]: DEBUG nova.compute.manager [req-5b9e3ec6-12f0-4feb-9858-298bb05b5165 req-ef9b0b63-79b1-4a8f-9a76-d04005d51ccf service nova] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Received event network-vif-plugged-98016144-4b95-4e94-8ae4-581089fe4f63 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:55:20 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-5b9e3ec6-12f0-4feb-9858-298bb05b5165 req-ef9b0b63-79b1-4a8f-9a76-d04005d51ccf service nova] Acquiring lock "a9012673-826b-4be7-a55b-9bb35a227c17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:55:20 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-5b9e3ec6-12f0-4feb-9858-298bb05b5165 req-ef9b0b63-79b1-4a8f-9a76-d04005d51ccf service nova] Lock "a9012673-826b-4be7-a55b-9bb35a227c17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:55:20 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-5b9e3ec6-12f0-4feb-9858-298bb05b5165 req-ef9b0b63-79b1-4a8f-9a76-d04005d51ccf service nova] Lock "a9012673-826b-4be7-a55b-9bb35a227c17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:55:20 user nova-compute[74190]: DEBUG nova.compute.manager [req-5b9e3ec6-12f0-4feb-9858-298bb05b5165 req-ef9b0b63-79b1-4a8f-9a76-d04005d51ccf service nova] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] No waiting events found dispatching network-vif-plugged-98016144-4b95-4e94-8ae4-581089fe4f63 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:55:20 user nova-compute[74190]: WARNING nova.compute.manager [req-5b9e3ec6-12f0-4feb-9858-298bb05b5165 req-ef9b0b63-79b1-4a8f-9a76-d04005d51ccf service nova] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Received unexpected event network-vif-plugged-98016144-4b95-4e94-8ae4-581089fe4f63 for instance with vm_state active and task_state resize_finish.
Oct 18 11:55:20 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:55:22 user nova-compute[74190]: DEBUG nova.compute.manager [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Instance event wait completed in 0 seconds for  {{(pid=74190) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 11:55:22 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Instance running successfully.
Oct 18 11:55:22 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Failed to set time: agent not configured {{(pid=74190) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Oct 18 11:55:22 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-3d25cba2-a59f-4a1c-b594-a500745619ad tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] finish_migration finished successfully. {{(pid=74190) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Oct 18 11:55:22 user nova-compute[74190]: DEBUG nova.compute.manager [req-95ac9c00-7160-4331-8449-203a294d810b req-d75bb3f2-07ea-4bb8-b9cc-4f4b8fc5539e service nova] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Received event network-vif-plugged-98016144-4b95-4e94-8ae4-581089fe4f63 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:55:22 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-95ac9c00-7160-4331-8449-203a294d810b req-d75bb3f2-07ea-4bb8-b9cc-4f4b8fc5539e service nova] Acquiring lock "a9012673-826b-4be7-a55b-9bb35a227c17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:55:22 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-95ac9c00-7160-4331-8449-203a294d810b req-d75bb3f2-07ea-4bb8-b9cc-4f4b8fc5539e service nova] Lock "a9012673-826b-4be7-a55b-9bb35a227c17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:55:22 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-95ac9c00-7160-4331-8449-203a294d810b req-d75bb3f2-07ea-4bb8-b9cc-4f4b8fc5539e service nova] Lock "a9012673-826b-4be7-a55b-9bb35a227c17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:55:22 user nova-compute[74190]: DEBUG nova.compute.manager [req-95ac9c00-7160-4331-8449-203a294d810b req-d75bb3f2-07ea-4bb8-b9cc-4f4b8fc5539e service nova] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] No waiting events found dispatching network-vif-plugged-98016144-4b95-4e94-8ae4-581089fe4f63 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:55:22 user nova-compute[74190]: WARNING nova.compute.manager [req-95ac9c00-7160-4331-8449-203a294d810b req-d75bb3f2-07ea-4bb8-b9cc-4f4b8fc5539e service nova] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Received unexpected event network-vif-plugged-98016144-4b95-4e94-8ae4-581089fe4f63 for instance with vm_state active and task_state resize_finish.
Oct 18 11:55:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:55:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:55:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:55:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:55:30 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-d377a8ed-ba71-4d46-85e4-656658d6b142 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 47ed3fb0-c159-484f-8380-79b5564d0ac1 is timed out.
Oct 18 11:55:30 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-d377a8ed-ba71-4d46-85e4-656658d6b142 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Successfully detached device vdb from instance 47ed3fb0-c159-484f-8380-79b5564d0ac1 from the live domain config.
Oct 18 11:55:30 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d377a8ed-ba71-4d46-85e4-656658d6b142 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: 47ed3fb0-c159-484f-8380-79b5564d0ac1] calling os-brick to detach iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 11:55:30 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-d377a8ed-ba71-4d46-85e4-656658d6b142 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, {'target_iqn': 'iqn.2010-10.org.openstack:7c03633a-f8e8-41ca-be64-1261c907bb2b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ULlkTqjN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:55:30 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-d377a8ed-ba71-4d46-85e4-656658d6b142 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:55:30 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-d377a8ed-ba71-4d46-85e4-656658d6b142 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:55:30 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-d377a8ed-ba71-4d46-85e4-656658d6b142 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:55:30 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:55:30 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.032s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:55:30 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af940db-1477-4f14-9631-544cb2856ec3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f9e5036f-2095-4ea5-bcf5-e4d952b21ab1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c03633a-f8e8-41ca-be64-1261c907bb2b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:55:30 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-d377a8ed-ba71-4d46-85e4-656658d6b142 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 11:55:30 user nova-compute[74190]: No targets found.
Oct 18 11:55:30 user nova-compute[74190]: iSNS:
Oct 18 11:55:30 user nova-compute[74190]: No targets found.
Oct 18 11:55:30 user nova-compute[74190]: STATIC:
Oct 18 11:55:30 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227
Oct 18 11:55:30 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:55:30 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:55:30 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa
Oct 18 11:55:30 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:55:30 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:55:30 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:f9e5036f-2095-4ea5-bcf5-e4d952b21ab1
Oct 18 11:55:30 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:55:30 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:55:30 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7
Oct 18 11:55:30 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:55:30 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:55:30 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:7c03633a-f8e8-41ca-be64-1261c907bb2b
Oct 18 11:55:30 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:55:30 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:55:30 user nova-compute[74190]: FIRMWARE:
Oct 18 11:55:30 user nova-compute[74190]: No targets found.
Oct 18 11:55:30 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:55:30 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-d377a8ed-ba71-4d46-85e4-656658d6b142 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 11:55:30 user nova-compute[74190]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 11:55:30 user nova-compute[74190]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74190) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 11:55:30 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-d377a8ed-ba71-4d46-85e4-656658d6b142 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c03633a-f8e8-41ca-be64-1261c907bb2b', 0)] {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 11:55:30 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:55:30 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:55:30 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e2bab0-9347-4483-9660-15c65d06ed3d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c03633a-f8e8-41ca-be64-1261c907bb2b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9e5036f-2095-4ea5-bcf5-e4d952b21ab1\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:55:30 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:55:30 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:55:30 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc41ec2b-21a5-4ba4-afd2-dc76bf2cf025]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c03633a-f8e8-41ca-be64-1261c907bb2b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e5036f-2095-4ea5-bcf5-e4d952b21ab1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:55:30 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-d377a8ed-ba71-4d46-85e4-656658d6b142 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 11:55:30 user nova-compute[74190]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c03633a-f8e8-41ca-be64-1261c907bb2b (non-flash)
Oct 18 11:55:30 user nova-compute[74190]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7 (non-flash)
Oct 18 11:55:30 user nova-compute[74190]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e5036f-2095-4ea5-bcf5-e4d952b21ab1 (non-flash)
Oct 18 11:55:30 user nova-compute[74190]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 (non-flash)
Oct 18 11:55:30 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:55:30 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-d377a8ed-ba71-4d46-85e4-656658d6b142 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 11:55:30 user nova-compute[74190]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c03633a-f8e8-41ca-be64-1261c907bb2b (non-flash)
Oct 18 11:55:30 user nova-compute[74190]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7 (non-flash)
Oct 18 11:55:30 user nova-compute[74190]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e5036f-2095-4ea5-bcf5-e4d952b21ab1 (non-flash)
Oct 18 11:55:30 user nova-compute[74190]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 (non-flash)
Oct 18 11:55:30 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:55:30 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-d377a8ed-ba71-4d46-85e4-656658d6b142 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1f44676200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c03633a-f8e8-41ca-be64-1261c907bb2b'): ({'sdf'}, set())}) {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 11:55:30 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-d377a8ed-ba71-4d46-85e4-656658d6b142 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Removing single pathed devices sdf {{(pid=74190) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 11:55:30 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:55:30 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:55:30 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[737bbac4-725f-4726-8eef-5c10f8305b0c]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:55:30 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:55:30 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:55:30 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[60723f76-ad19-4fc9-9bf6-dab3f2739089]: (4, ('ok\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:55:30 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-d377a8ed-ba71-4d46-85e4-656658d6b142 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Flushing IO for device /dev/sdf {{(pid=74190) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 11:55:30 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:55:30 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:55:30 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[24af210b-fb04-4681-b722-52a279412715]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:55:30 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-d377a8ed-ba71-4d46-85e4-656658d6b142 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74190) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 11:55:30 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:55:30 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.041s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:55:30 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e93999-c8b6-4d21-a9fe-9ad8a86c61ee]: (4, ('1', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:55:30 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-d377a8ed-ba71-4d46-85e4-656658d6b142 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 11:55:30 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-d377a8ed-ba71-4d46-85e4-656658d6b142 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] SCSI volumes sdf have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 11:55:30 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-d377a8ed-ba71-4d46-85e4-656658d6b142 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c03633a-f8e8-41ca-be64-1261c907bb2b')] {{(pid=74190) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 11:55:30 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c03633a-f8e8-41ca-be64-1261c907bb2b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:55:30 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c03633a-f8e8-41ca-be64-1261c907bb2b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:55:30 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f491993-c036-4d3b-a742-2211ce1400d5]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:55:30 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-d377a8ed-ba71-4d46-85e4-656658d6b142 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:55:30 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c03633a-f8e8-41ca-be64-1261c907bb2b -p 172.16.0.220:3260 --logout {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:55:30 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c03633a-f8e8-41ca-be64-1261c907bb2b -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:55:30 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e2936b1-6e2b-4ee4-a43e-1a4282b9a247]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:7c03633a-f8e8-41ca-be64-1261c907bb2b, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:7c03633a-f8e8-41ca-be64-1261c907bb2b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:55:30 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-d377a8ed-ba71-4d46-85e4-656658d6b142 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:7c03633a-f8e8-41ca-be64-1261c907bb2b, portal: 172.16.0.220,3260]
Oct 18 11:55:30 user nova-compute[74190]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:7c03633a-f8e8-41ca-be64-1261c907bb2b, portal: 172.16.0.220,3260] successful.
Oct 18 11:55:30 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:55:30 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c03633a-f8e8-41ca-be64-1261c907bb2b -p 172.16.0.220:3260 --op delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:55:30 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c03633a-f8e8-41ca-be64-1261c907bb2b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:55:30 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc20dfa9-d405-4e47-9991-8b640a5f116b]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:55:30 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-d377a8ed-ba71-4d46-85e4-656658d6b142 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:55:30 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-d377a8ed-ba71-4d46-85e4-656658d6b142 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:55:30 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-d377a8ed-ba71-4d46-85e4-656658d6b142 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] <== disconnect_volume: return (356ms) None {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:55:30 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d377a8ed-ba71-4d46-85e4-656658d6b142 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: 47ed3fb0-c159-484f-8380-79b5564d0ac1] Disconnected iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 11:55:31 user nova-compute[74190]: DEBUG nova.objects.instance [None req-d377a8ed-ba71-4d46-85e4-656658d6b142 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lazy-loading 'flavor' on Instance uuid 47ed3fb0-c159-484f-8380-79b5564d0ac1 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:55:31 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-d377a8ed-ba71-4d46-85e4-656658d6b142 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lock "47ed3fb0-c159-484f-8380-79b5564d0ac1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.930s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:55:32 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-1b916f0c-4481-4797-9586-c2f493d273f9 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Acquiring lock "47ed3fb0-c159-484f-8380-79b5564d0ac1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:55:32 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-1b916f0c-4481-4797-9586-c2f493d273f9 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lock "47ed3fb0-c159-484f-8380-79b5564d0ac1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:55:32 user nova-compute[74190]: INFO nova.compute.manager [None req-1b916f0c-4481-4797-9586-c2f493d273f9 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: 47ed3fb0-c159-484f-8380-79b5564d0ac1] Detaching volume f9e5036f-2095-4ea5-bcf5-e4d952b21ab1
Oct 18 11:55:32 user nova-compute[74190]: INFO nova.virt.block_device [None req-1b916f0c-4481-4797-9586-c2f493d273f9 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: 47ed3fb0-c159-484f-8380-79b5564d0ac1] Attempting to driver detach volume f9e5036f-2095-4ea5-bcf5-e4d952b21ab1 from mountpoint /dev/vdc
Oct 18 11:55:32 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-1b916f0c-4481-4797-9586-c2f493d273f9 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Attempting to detach device vdc from instance 47ed3fb0-c159-484f-8380-79b5564d0ac1 from the persistent domain config. {{(pid=74190) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 18 11:55:32 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-1b916f0c-4481-4797-9586-c2f493d273f9 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 11:55:32 user nova-compute[74190]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 11:55:32 user nova-compute[74190]:   <source dev="/dev/sdb"/>
Oct 18 11:55:32 user nova-compute[74190]:   <target dev="vdc" bus="virtio"/>
Oct 18 11:55:32 user nova-compute[74190]:   <serial>f9e5036f-2095-4ea5-bcf5-e4d952b21ab1</serial>
Oct 18 11:55:32 user nova-compute[74190]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 18 11:55:32 user nova-compute[74190]: </disk>
Oct 18 11:55:32 user nova-compute[74190]:  {{(pid=74190) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 11:55:32 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-1b916f0c-4481-4797-9586-c2f493d273f9 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Successfully detached device vdc from instance 47ed3fb0-c159-484f-8380-79b5564d0ac1 from the persistent domain config.
Oct 18 11:55:32 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-1b916f0c-4481-4797-9586-c2f493d273f9 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 47ed3fb0-c159-484f-8380-79b5564d0ac1 from the live domain config. {{(pid=74190) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 18 11:55:32 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-1b916f0c-4481-4797-9586-c2f493d273f9 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 11:55:32 user nova-compute[74190]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 11:55:32 user nova-compute[74190]:   <source dev="/dev/sdb"/>
Oct 18 11:55:32 user nova-compute[74190]:   <target dev="vdc" bus="virtio"/>
Oct 18 11:55:32 user nova-compute[74190]:   <serial>f9e5036f-2095-4ea5-bcf5-e4d952b21ab1</serial>
Oct 18 11:55:32 user nova-compute[74190]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 18 11:55:32 user nova-compute[74190]: </disk>
Oct 18 11:55:32 user nova-compute[74190]:  {{(pid=74190) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 11:55:33 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-1b916f0c-4481-4797-9586-c2f493d273f9 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 47ed3fb0-c159-484f-8380-79b5564d0ac1 {{(pid=74190) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 18 11:55:33 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:55:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:55:38 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:55:38 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:55:39 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:55:40 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:55:41 user nova-compute[74190]: DEBUG nova.compute.manager [None req-e3b2551c-1111-4e04-a7ca-69cf2f8ec26b tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] Checking state {{(pid=74190) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 11:55:41 user nova-compute[74190]: INFO nova.compute.manager [None req-e3b2551c-1111-4e04-a7ca-69cf2f8ec26b tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] instance snapshotting
Oct 18 11:55:41 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-e3b2551c-1111-4e04-a7ca-69cf2f8ec26b tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] Beginning live snapshot process
Oct 18 11:55:41 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-e3b2551c-1111-4e04-a7ca-69cf2f8ec26b tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eec9cde-3553-4fc8-9162-cda963d1a81e/disk --force-share --output=json -f qcow2 {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:55:41 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-e3b2551c-1111-4e04-a7ca-69cf2f8ec26b tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eec9cde-3553-4fc8-9162-cda963d1a81e/disk --force-share --output=json -f qcow2" returned: 0 in 0.197s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:55:41 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-e3b2551c-1111-4e04-a7ca-69cf2f8ec26b tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eec9cde-3553-4fc8-9162-cda963d1a81e/disk --force-share --output=json -f qcow2 {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:55:41 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-e3b2551c-1111-4e04-a7ca-69cf2f8ec26b tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eec9cde-3553-4fc8-9162-cda963d1a81e/disk --force-share --output=json -f qcow2" returned: 0 in 0.186s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:55:41 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-e3b2551c-1111-4e04-a7ca-69cf2f8ec26b tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:55:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-e3b2551c-1111-4e04-a7ca-69cf2f8ec26b tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.170s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:55:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-e3b2551c-1111-4e04-a7ca-69cf2f8ec26b tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmppwtkg3pk/1f77518ca7944a3dbe04359638fbc034.delta 1073741824 {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:55:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-e3b2551c-1111-4e04-a7ca-69cf2f8ec26b tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmppwtkg3pk/1f77518ca7944a3dbe04359638fbc034.delta 1073741824" returned: 0 in 0.049s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:55:42 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-e3b2551c-1111-4e04-a7ca-69cf2f8ec26b tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 18 11:55:42 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-e3b2551c-1111-4e04-a7ca-69cf2f8ec26b tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=74190) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 18 11:55:43 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-e3b2551c-1111-4e04-a7ca-69cf2f8ec26b tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=74190) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 18 11:55:43 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-e3b2551c-1111-4e04-a7ca-69cf2f8ec26b tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 18 11:55:43 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:55:43 user nova-compute[74190]: DEBUG nova.privsep.utils [None req-e3b2551c-1111-4e04-a7ca-69cf2f8ec26b tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74190) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 18 11:55:43 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-e3b2551c-1111-4e04-a7ca-69cf2f8ec26b tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmppwtkg3pk/1f77518ca7944a3dbe04359638fbc034.delta /opt/stack/data/nova/instances/snapshots/tmppwtkg3pk/1f77518ca7944a3dbe04359638fbc034 {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:55:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-e3b2551c-1111-4e04-a7ca-69cf2f8ec26b tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmppwtkg3pk/1f77518ca7944a3dbe04359638fbc034.delta /opt/stack/data/nova/instances/snapshots/tmppwtkg3pk/1f77518ca7944a3dbe04359638fbc034" returned: 0 in 0.872s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:55:44 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-e3b2551c-1111-4e04-a7ca-69cf2f8ec26b tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] Snapshot extracted, beginning image upload
Oct 18 11:55:44 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:55:46 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-e3b2551c-1111-4e04-a7ca-69cf2f8ec26b tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] Snapshot image upload complete
Oct 18 11:55:46 user nova-compute[74190]: INFO nova.compute.manager [None req-e3b2551c-1111-4e04-a7ca-69cf2f8ec26b tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] Took 5.61 seconds to snapshot the instance on the hypervisor.
Oct 18 11:55:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:55:49 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Acquiring lock "95933a75-03d9-4b34-b751-69e3622f23c7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:55:49 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Lock "95933a75-03d9-4b34-b751-69e3622f23c7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:55:49 user nova-compute[74190]: DEBUG nova.compute.manager [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] [instance: 95933a75-03d9-4b34-b751-69e3622f23c7] Starting instance... {{(pid=74190) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 11:55:49 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:55:49 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:55:49 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74190) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 11:55:49 user nova-compute[74190]: INFO nova.compute.claims [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] [instance: 95933a75-03d9-4b34-b751-69e3622f23c7] Claim successful on node user
Oct 18 11:55:49 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 11:55:49 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 11:55:49 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.457s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:55:49 user nova-compute[74190]: DEBUG nova.compute.manager [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] [instance: 95933a75-03d9-4b34-b751-69e3622f23c7] Start building networks asynchronously for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 11:55:49 user nova-compute[74190]: DEBUG nova.compute.manager [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] [instance: 95933a75-03d9-4b34-b751-69e3622f23c7] Allocating IP information in the background. {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 11:55:49 user nova-compute[74190]: DEBUG nova.network.neutron [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] [instance: 95933a75-03d9-4b34-b751-69e3622f23c7] allocate_for_instance() {{(pid=74190) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 11:55:49 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] [instance: 95933a75-03d9-4b34-b751-69e3622f23c7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 11:55:49 user nova-compute[74190]: DEBUG nova.compute.manager [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] [instance: 95933a75-03d9-4b34-b751-69e3622f23c7] Start building block device mappings for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 11:55:49 user nova-compute[74190]: DEBUG nova.policy [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a252f2c479b740a29a1adc79e6346b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389e1c2dbc904130ba08b137f0b2e837', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74190) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 11:55:49 user nova-compute[74190]: DEBUG nova.compute.manager [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] [instance: 95933a75-03d9-4b34-b751-69e3622f23c7] Start spawning the instance on the hypervisor. {{(pid=74190) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 11:55:49 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] [instance: 95933a75-03d9-4b34-b751-69e3622f23c7] Creating instance directory {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 11:55:49 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] [instance: 95933a75-03d9-4b34-b751-69e3622f23c7] Creating image(s)
Oct 18 11:55:49 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Acquiring lock "/opt/stack/data/nova/instances/95933a75-03d9-4b34-b751-69e3622f23c7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:55:49 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Lock "/opt/stack/data/nova/instances/95933a75-03d9-4b34-b751-69e3622f23c7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:55:49 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Lock "/opt/stack/data/nova/instances/95933a75-03d9-4b34-b751-69e3622f23c7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:55:49 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Acquiring lock "0e79c1037d0d32946cb46779e632ecf3472e53b3" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:55:49 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Lock "0e79c1037d0d32946cb46779e632ecf3472e53b3" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:55:50 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:55:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0e79c1037d0d32946cb46779e632ecf3472e53b3.part --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:55:50 user nova-compute[74190]: INFO nova.compute.manager [None req-af7dc939-a455-4bcf-a275-449ff1f27105 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 42413a94-9973-4e8d-83b6-207a4e7847c1] Rescuing
Oct 18 11:55:50 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-af7dc939-a455-4bcf-a275-449ff1f27105 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Acquiring lock "refresh_cache-42413a94-9973-4e8d-83b6-207a4e7847c1" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:55:50 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-af7dc939-a455-4bcf-a275-449ff1f27105 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Acquired lock "refresh_cache-42413a94-9973-4e8d-83b6-207a4e7847c1" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:55:50 user nova-compute[74190]: DEBUG nova.network.neutron [None req-af7dc939-a455-4bcf-a275-449ff1f27105 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 42413a94-9973-4e8d-83b6-207a4e7847c1] Building network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 11:55:51 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0e79c1037d0d32946cb46779e632ecf3472e53b3.part --force-share --output=json" returned: 0 in 0.246s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:55:51 user nova-compute[74190]: DEBUG nova.virt.images [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] b3020345-cdef-415e-be91-a3f2326e784c was qcow2, converting to raw {{(pid=74190) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 18 11:55:51 user nova-compute[74190]: DEBUG nova.privsep.utils [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74190) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 18 11:55:51 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0e79c1037d0d32946cb46779e632ecf3472e53b3.part /opt/stack/data/nova/instances/_base/0e79c1037d0d32946cb46779e632ecf3472e53b3.converted {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:55:51 user nova-compute[74190]: DEBUG nova.network.neutron [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] [instance: 95933a75-03d9-4b34-b751-69e3622f23c7] Successfully created port: 0660e8c4-71b8-45e5-a54e-7a9f1775061f {{(pid=74190) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 11:55:51 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0e79c1037d0d32946cb46779e632ecf3472e53b3.part /opt/stack/data/nova/instances/_base/0e79c1037d0d32946cb46779e632ecf3472e53b3.converted" returned: 0 in 0.274s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:55:51 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0e79c1037d0d32946cb46779e632ecf3472e53b3.converted --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:55:51 user nova-compute[74190]: DEBUG nova.network.neutron [None req-af7dc939-a455-4bcf-a275-449ff1f27105 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 42413a94-9973-4e8d-83b6-207a4e7847c1] Updating instance_info_cache with network_info: [{"id": "1bad07b8-897d-4280-9eac-ea800fd1cf5a", "address": "fa:16:3e:0f:dd:a5", "network": {"id": "130f7948-11e4-49b4-9d4a-dffb2b48bdcd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595419292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ffa18c02b8a4117ab1ccc52aca64f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bad07b8-89", "ovs_interfaceid": "1bad07b8-897d-4280-9eac-ea800fd1cf5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:55:51 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-af7dc939-a455-4bcf-a275-449ff1f27105 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Releasing lock "refresh_cache-42413a94-9973-4e8d-83b6-207a4e7847c1" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:55:51 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0e79c1037d0d32946cb46779e632ecf3472e53b3.converted --force-share --output=json" returned: 0 in 0.197s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:55:51 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Lock "0e79c1037d0d32946cb46779e632ecf3472e53b3" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.653s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:55:51 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0e79c1037d0d32946cb46779e632ecf3472e53b3 --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:55:51 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:55:51 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0e79c1037d0d32946cb46779e632ecf3472e53b3 --force-share --output=json" returned: 0 in 0.194s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:55:51 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Acquiring lock "0e79c1037d0d32946cb46779e632ecf3472e53b3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:55:51 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Lock "0e79c1037d0d32946cb46779e632ecf3472e53b3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:55:51 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0e79c1037d0d32946cb46779e632ecf3472e53b3 --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:55:51 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:55:51 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0e79c1037d0d32946cb46779e632ecf3472e53b3 --force-share --output=json" returned: 0 in 0.228s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:55:51 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0e79c1037d0d32946cb46779e632ecf3472e53b3,backing_fmt=raw /opt/stack/data/nova/instances/95933a75-03d9-4b34-b751-69e3622f23c7/disk 1073741824 {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:55:51 user nova-compute[74190]: DEBUG nova.compute.manager [req-dbf59d0f-7e33-4a83-afeb-6700a57b99d6 req-5b020172-6849-4546-8e37-367a985d2533 service nova] [instance: 42413a94-9973-4e8d-83b6-207a4e7847c1] Received event network-vif-unplugged-1bad07b8-897d-4280-9eac-ea800fd1cf5a {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:55:51 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-dbf59d0f-7e33-4a83-afeb-6700a57b99d6 req-5b020172-6849-4546-8e37-367a985d2533 service nova] Acquiring lock "42413a94-9973-4e8d-83b6-207a4e7847c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-dbf59d0f-7e33-4a83-afeb-6700a57b99d6 req-5b020172-6849-4546-8e37-367a985d2533 service nova] Lock "42413a94-9973-4e8d-83b6-207a4e7847c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-dbf59d0f-7e33-4a83-afeb-6700a57b99d6 req-5b020172-6849-4546-8e37-367a985d2533 service nova] Lock "42413a94-9973-4e8d-83b6-207a4e7847c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG nova.compute.manager [req-dbf59d0f-7e33-4a83-afeb-6700a57b99d6 req-5b020172-6849-4546-8e37-367a985d2533 service nova] [instance: 42413a94-9973-4e8d-83b6-207a4e7847c1] No waiting events found dispatching network-vif-unplugged-1bad07b8-897d-4280-9eac-ea800fd1cf5a {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:55:52 user nova-compute[74190]: WARNING nova.compute.manager [req-dbf59d0f-7e33-4a83-afeb-6700a57b99d6 req-5b020172-6849-4546-8e37-367a985d2533 service nova] [instance: 42413a94-9973-4e8d-83b6-207a4e7847c1] Received unexpected event network-vif-unplugged-1bad07b8-897d-4280-9eac-ea800fd1cf5a for instance with vm_state active and task_state rescuing.
Oct 18 11:55:52 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG nova.network.neutron [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] [instance: 95933a75-03d9-4b34-b751-69e3622f23c7] Successfully updated port: 0660e8c4-71b8-45e5-a54e-7a9f1775061f {{(pid=74190) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0e79c1037d0d32946cb46779e632ecf3472e53b3,backing_fmt=raw /opt/stack/data/nova/instances/95933a75-03d9-4b34-b751-69e3622f23c7/disk 1073741824" returned: 0 in 0.081s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Lock "0e79c1037d0d32946cb46779e632ecf3472e53b3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.313s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0e79c1037d0d32946cb46779e632ecf3472e53b3 --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG nova.compute.manager [req-9001881f-d371-4dba-9d46-e2903eadac78 req-42ccfa5d-c85d-4e1c-9f5c-ece99b1810b7 service nova] [instance: 95933a75-03d9-4b34-b751-69e3622f23c7] Received event network-changed-0660e8c4-71b8-45e5-a54e-7a9f1775061f {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG nova.compute.manager [req-9001881f-d371-4dba-9d46-e2903eadac78 req-42ccfa5d-c85d-4e1c-9f5c-ece99b1810b7 service nova] [instance: 95933a75-03d9-4b34-b751-69e3622f23c7] Refreshing instance network info cache due to event network-changed-0660e8c4-71b8-45e5-a54e-7a9f1775061f. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-9001881f-d371-4dba-9d46-e2903eadac78 req-42ccfa5d-c85d-4e1c-9f5c-ece99b1810b7 service nova] Acquiring lock "refresh_cache-95933a75-03d9-4b34-b751-69e3622f23c7" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-9001881f-d371-4dba-9d46-e2903eadac78 req-42ccfa5d-c85d-4e1c-9f5c-ece99b1810b7 service nova] Acquired lock "refresh_cache-95933a75-03d9-4b34-b751-69e3622f23c7" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG nova.network.neutron [req-9001881f-d371-4dba-9d46-e2903eadac78 req-42ccfa5d-c85d-4e1c-9f5c-ece99b1810b7 service nova] [instance: 95933a75-03d9-4b34-b751-69e3622f23c7] Refreshing network info cache for port 0660e8c4-71b8-45e5-a54e-7a9f1775061f {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Acquiring lock "refresh_cache-95933a75-03d9-4b34-b751-69e3622f23c7" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG nova.network.neutron [req-9001881f-d371-4dba-9d46-e2903eadac78 req-42ccfa5d-c85d-4e1c-9f5c-ece99b1810b7 service nova] [instance: 95933a75-03d9-4b34-b751-69e3622f23c7] Instance cache missing network info. {{(pid=74190) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0e79c1037d0d32946cb46779e632ecf3472e53b3 --force-share --output=json" returned: 0 in 0.215s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] [instance: 95933a75-03d9-4b34-b751-69e3622f23c7] Created local disks {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] [instance: 95933a75-03d9-4b34-b751-69e3622f23c7] Ensure instance console log exists: /opt/stack/data/nova/instances/95933a75-03d9-4b34-b751-69e3622f23c7/console.log {{(pid=74190) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG nova.network.neutron [req-9001881f-d371-4dba-9d46-e2903eadac78 req-42ccfa5d-c85d-4e1c-9f5c-ece99b1810b7 service nova] [instance: 95933a75-03d9-4b34-b751-69e3622f23c7] Updating instance_info_cache with network_info: [] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-9001881f-d371-4dba-9d46-e2903eadac78 req-42ccfa5d-c85d-4e1c-9f5c-ece99b1810b7 service nova] Releasing lock "refresh_cache-95933a75-03d9-4b34-b751-69e3622f23c7" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Acquired lock "refresh_cache-95933a75-03d9-4b34-b751-69e3622f23c7" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG nova.network.neutron [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] [instance: 95933a75-03d9-4b34-b751-69e3622f23c7] Building network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 11:55:52 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 42413a94-9973-4e8d-83b6-207a4e7847c1] Instance destroyed successfully.
Oct 18 11:55:52 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-af7dc939-a455-4bcf-a275-449ff1f27105 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 42413a94-9973-4e8d-83b6-207a4e7847c1] Attempting rescue
Oct 18 11:55:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-af7dc939-a455-4bcf-a275-449ff1f27105 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74190) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-af7dc939-a455-4bcf-a275-449ff1f27105 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 42413a94-9973-4e8d-83b6-207a4e7847c1] Instance directory exists: not creating {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 18 11:55:52 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-af7dc939-a455-4bcf-a275-449ff1f27105 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 42413a94-9973-4e8d-83b6-207a4e7847c1] Creating image(s)
Oct 18 11:55:52 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-af7dc939-a455-4bcf-a275-449ff1f27105 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Acquiring lock "/opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-af7dc939-a455-4bcf-a275-449ff1f27105 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lock "/opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-af7dc939-a455-4bcf-a275-449ff1f27105 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lock "/opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG nova.objects.instance [None req-af7dc939-a455-4bcf-a275-449ff1f27105 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lazy-loading 'trusted_certs' on Instance uuid 42413a94-9973-4e8d-83b6-207a4e7847c1 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG nova.network.neutron [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] [instance: 95933a75-03d9-4b34-b751-69e3622f23c7] Instance cache missing network info. {{(pid=74190) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-af7dc939-a455-4bcf-a275-449ff1f27105 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Acquiring lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-af7dc939-a455-4bcf-a275-449ff1f27105 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-af7dc939-a455-4bcf-a275-449ff1f27105 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-af7dc939-a455-4bcf-a275-449ff1f27105 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.170s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-af7dc939-a455-4bcf-a275-449ff1f27105 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f,backing_fmt=raw /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk.rescue {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-af7dc939-a455-4bcf-a275-449ff1f27105 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f,backing_fmt=raw /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk.rescue" returned: 0 in 0.049s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-af7dc939-a455-4bcf-a275-449ff1f27105 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG nova.objects.instance [None req-af7dc939-a455-4bcf-a275-449ff1f27105 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lazy-loading 'migration_context' on Instance uuid 42413a94-9973-4e8d-83b6-207a4e7847c1 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG nova.network.neutron [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] [instance: 95933a75-03d9-4b34-b751-69e3622f23c7] Updating instance_info_cache with network_info: [{"id": "0660e8c4-71b8-45e5-a54e-7a9f1775061f", "address": "fa:16:3e:b3:8a:60", "network": {"id": "56026ce6-77fb-40c7-9976-732e745c219d", "bridge": "br-int", "label": "tempest-TestStampPattern-989787934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "389e1c2dbc904130ba08b137f0b2e837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0660e8c4-71", "ovs_interfaceid": "0660e8c4-71b8-45e5-a54e-7a9f1775061f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG nova.objects.base [None req-af7dc939-a455-4bcf-a275-449ff1f27105 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Object Instance<42413a94-9973-4e8d-83b6-207a4e7847c1> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74190) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-af7dc939-a455-4bcf-a275-449ff1f27105 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 42413a94-9973-4e8d-83b6-207a4e7847c1] Created local disks {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-af7dc939-a455-4bcf-a275-449ff1f27105 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 42413a94-9973-4e8d-83b6-207a4e7847c1] Start _get_guest_xml network_info=[{"id": "1bad07b8-897d-4280-9eac-ea800fd1cf5a", "address": "fa:16:3e:0f:dd:a5", "network": {"id": "130f7948-11e4-49b4-9d4a-dffb2b48bdcd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595419292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-595419292-network", "vif_mac": "fa:16:3e:0f:dd:a5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ffa18c02b8a4117ab1ccc52aca64f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bad07b8-89", "ovs_interfaceid": "1bad07b8-897d-4280-9eac-ea800fd1cf5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '6e88bbf0-6e78-49a8-b3c5-9453d22a89df', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG nova.objects.instance [None req-af7dc939-a455-4bcf-a275-449ff1f27105 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lazy-loading 'resources' on Instance uuid 42413a94-9973-4e8d-83b6-207a4e7847c1 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG nova.objects.base [None req-af7dc939-a455-4bcf-a275-449ff1f27105 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Object Instance<42413a94-9973-4e8d-83b6-207a4e7847c1> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74190) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG nova.objects.instance [None req-af7dc939-a455-4bcf-a275-449ff1f27105 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lazy-loading 'numa_topology' on Instance uuid 42413a94-9973-4e8d-83b6-207a4e7847c1 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Releasing lock "refresh_cache-95933a75-03d9-4b34-b751-69e3622f23c7" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG nova.compute.manager [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] [instance: 95933a75-03d9-4b34-b751-69e3622f23c7] Instance network_info: |[{"id": "0660e8c4-71b8-45e5-a54e-7a9f1775061f", "address": "fa:16:3e:b3:8a:60", "network": {"id": "56026ce6-77fb-40c7-9976-732e745c219d", "bridge": "br-int", "label": "tempest-TestStampPattern-989787934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "389e1c2dbc904130ba08b137f0b2e837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0660e8c4-71", "ovs_interfaceid": "0660e8c4-71b8-45e5-a54e-7a9f1775061f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] [instance: 95933a75-03d9-4b34-b751-69e3622f23c7] Start _get_guest_xml network_info=[{"id": "0660e8c4-71b8-45e5-a54e-7a9f1775061f", "address": "fa:16:3e:b3:8a:60", "network": {"id": "56026ce6-77fb-40c7-9976-732e745c219d", "bridge": "br-int", "label": "tempest-TestStampPattern-989787934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "389e1c2dbc904130ba08b137f0b2e837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0660e8c4-71", "ovs_interfaceid": "0660e8c4-71b8-45e5-a54e-7a9f1775061f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d5688e553f45210aae18c8ad021e3ec1',container_format='bare',created_at=2023-10-18T11:55:41Z,direct_url=<?>,disk_format='qcow2',id=b3020345-cdef-415e-be91-a3f2326e784c,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1276191114',owner='389e1c2dbc904130ba08b137f0b2e837',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-18T11:55:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'image_id': 'b3020345-cdef-415e-be91-a3f2326e784c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG nova.objects.base [None req-af7dc939-a455-4bcf-a275-449ff1f27105 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Object Instance<42413a94-9973-4e8d-83b6-207a4e7847c1> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74190) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 11:55:52 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:55:52 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:55:52 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-af7dc939-a455-4bcf-a275-449ff1f27105 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:55:52 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-af7dc939-a455-4bcf-a275-449ff1f27105 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:55:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] CPU controller missing on host. {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-af7dc939-a455-4bcf-a275-449ff1f27105 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-af7dc939-a455-4bcf-a275-449ff1f27105 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] CPU controller missing on host. {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] CPU controller found on host. {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74190) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T11:37:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d5688e553f45210aae18c8ad021e3ec1',container_format='bare',created_at=2023-10-18T11:55:41Z,direct_url=<?>,disk_format='qcow2',id=b3020345-cdef-415e-be91-a3f2326e784c,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1276191114',owner='389e1c2dbc904130ba08b137f0b2e837',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-18T11:55:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Flavor limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Image limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Flavor pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Image pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Got 1 possible topologies {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:55:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-759608543',display_name='tempest-TestStampPattern-server-759608543',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-759608543',id=28,image_ref='b3020345-cdef-415e-be91-a3f2326e784c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIWsfXQkdYGPKym2GX8abBzSE1TgaUSMy3GxYdQVyxTc9qElJuld8J6hiVUfhDnJocQnssGij1BqYm1SJS/pWo5ybDXV8dLSSiMAGmlRDARneJEWLLFP/+ol+LaeplXvXg==',key_name='tempest-TestStampPattern-1418984438',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='389e1c2dbc904130ba08b137f0b2e837',ramdisk_id='',reservation_id='r-hk68eg8z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='8eec9cde-3553-4fc8-9162-cda963d1a81e',image_min_disk='1',image_min_ram='0',image_owner_id='389e1c2dbc904130ba08b137f0b2e837',image_owner_project_name='tempest-TestStampPattern-2116730913',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-2116730913-project-member',image_user_id='a252f2c479b740a29a1adc79e6346b20',network_allocated='True',owner_project_name='tempest-TestStampPattern-2116730913',owner_user_name='tempest-TestStampPattern-2116730913-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:55:50Z,user_data=None,user_id='a252f2c479b740a29a1adc79e6346b20',uuid=95933a75-03d9-4b34-b751-69e3622f23c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0660e8c4-71b8-45e5-a54e-7a9f1775061f", "address": "fa:16:3e:b3:8a:60", "network": {"id": "56026ce6-77fb-40c7-9976-732e745c219d", "bridge": "br-int", "label": "tempest-TestStampPattern-989787934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "389e1c2dbc904130ba08b137f0b2e837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0660e8c4-71", "ovs_interfaceid": "0660e8c4-71b8-45e5-a54e-7a9f1775061f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74190) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Converting VIF {"id": "0660e8c4-71b8-45e5-a54e-7a9f1775061f", "address": "fa:16:3e:b3:8a:60", "network": {"id": "56026ce6-77fb-40c7-9976-732e745c219d", "bridge": "br-int", "label": "tempest-TestStampPattern-989787934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "389e1c2dbc904130ba08b137f0b2e837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0660e8c4-71", "ovs_interfaceid": "0660e8c4-71b8-45e5-a54e-7a9f1775061f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:8a:60,bridge_name='br-int',has_traffic_filtering=True,id=0660e8c4-71b8-45e5-a54e-7a9f1775061f,network=Network(56026ce6-77fb-40c7-9976-732e745c219d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0660e8c4-71') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG nova.objects.instance [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Lazy-loading 'pci_devices' on Instance uuid 95933a75-03d9-4b34-b751-69e3622f23c7 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-af7dc939-a455-4bcf-a275-449ff1f27105 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-af7dc939-a455-4bcf-a275-449ff1f27105 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] CPU controller found on host. {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-af7dc939-a455-4bcf-a275-449ff1f27105 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74190) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-af7dc939-a455-4bcf-a275-449ff1f27105 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T11:37:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-af7dc939-a455-4bcf-a275-449ff1f27105 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Flavor limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-af7dc939-a455-4bcf-a275-449ff1f27105 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Image limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-af7dc939-a455-4bcf-a275-449ff1f27105 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Flavor pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-af7dc939-a455-4bcf-a275-449ff1f27105 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Image pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-af7dc939-a455-4bcf-a275-449ff1f27105 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-af7dc939-a455-4bcf-a275-449ff1f27105 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-af7dc939-a455-4bcf-a275-449ff1f27105 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-af7dc939-a455-4bcf-a275-449ff1f27105 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Got 1 possible topologies {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-af7dc939-a455-4bcf-a275-449ff1f27105 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-af7dc939-a455-4bcf-a275-449ff1f27105 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG nova.objects.instance [None req-af7dc939-a455-4bcf-a275-449ff1f27105 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lazy-loading 'vcpu_model' on Instance uuid 42413a94-9973-4e8d-83b6-207a4e7847c1 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] [instance: 95933a75-03d9-4b34-b751-69e3622f23c7] End _get_guest_xml xml=<domain type="kvm">
Oct 18 11:55:52 user nova-compute[74190]:   <uuid>95933a75-03d9-4b34-b751-69e3622f23c7</uuid>
Oct 18 11:55:52 user nova-compute[74190]:   <name>instance-0000001c</name>
Oct 18 11:55:52 user nova-compute[74190]:   <memory>524288</memory>
Oct 18 11:55:52 user nova-compute[74190]:   <vcpu>1</vcpu>
Oct 18 11:55:52 user nova-compute[74190]:   <metadata>
Oct 18 11:55:52 user nova-compute[74190]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 11:55:52 user nova-compute[74190]:       <nova:package version="0.0.0"/>
Oct 18 11:55:52 user nova-compute[74190]:       <nova:name>tempest-TestStampPattern-server-759608543</nova:name>
Oct 18 11:55:52 user nova-compute[74190]:       <nova:creationTime>2023-10-18 11:55:52</nova:creationTime>
Oct 18 11:55:52 user nova-compute[74190]:       <nova:flavor name="m1.tiny">
Oct 18 11:55:52 user nova-compute[74190]:         <nova:memory>512</nova:memory>
Oct 18 11:55:52 user nova-compute[74190]:         <nova:disk>1</nova:disk>
Oct 18 11:55:52 user nova-compute[74190]:         <nova:swap>0</nova:swap>
Oct 18 11:55:52 user nova-compute[74190]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 11:55:52 user nova-compute[74190]:         <nova:vcpus>1</nova:vcpus>
Oct 18 11:55:52 user nova-compute[74190]:       </nova:flavor>
Oct 18 11:55:52 user nova-compute[74190]:       <nova:owner>
Oct 18 11:55:52 user nova-compute[74190]:         <nova:user uuid="a252f2c479b740a29a1adc79e6346b20">tempest-TestStampPattern-2116730913-project-member</nova:user>
Oct 18 11:55:52 user nova-compute[74190]:         <nova:project uuid="389e1c2dbc904130ba08b137f0b2e837">tempest-TestStampPattern-2116730913</nova:project>
Oct 18 11:55:52 user nova-compute[74190]:       </nova:owner>
Oct 18 11:55:52 user nova-compute[74190]:       <nova:root type="image" uuid="b3020345-cdef-415e-be91-a3f2326e784c"/>
Oct 18 11:55:52 user nova-compute[74190]:       <nova:ports>
Oct 18 11:55:52 user nova-compute[74190]:         <nova:port uuid="0660e8c4-71b8-45e5-a54e-7a9f1775061f">
Oct 18 11:55:52 user nova-compute[74190]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 18 11:55:52 user nova-compute[74190]:         </nova:port>
Oct 18 11:55:52 user nova-compute[74190]:       </nova:ports>
Oct 18 11:55:52 user nova-compute[74190]:     </nova:instance>
Oct 18 11:55:52 user nova-compute[74190]:   </metadata>
Oct 18 11:55:52 user nova-compute[74190]:   <sysinfo type="smbios">
Oct 18 11:55:52 user nova-compute[74190]:     <system>
Oct 18 11:55:52 user nova-compute[74190]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 11:55:52 user nova-compute[74190]:       <entry name="product">OpenStack Nova</entry>
Oct 18 11:55:52 user nova-compute[74190]:       <entry name="version">0.0.0</entry>
Oct 18 11:55:52 user nova-compute[74190]:       <entry name="serial">95933a75-03d9-4b34-b751-69e3622f23c7</entry>
Oct 18 11:55:52 user nova-compute[74190]:       <entry name="uuid">95933a75-03d9-4b34-b751-69e3622f23c7</entry>
Oct 18 11:55:52 user nova-compute[74190]:       <entry name="family">Virtual Machine</entry>
Oct 18 11:55:52 user nova-compute[74190]:     </system>
Oct 18 11:55:52 user nova-compute[74190]:   </sysinfo>
Oct 18 11:55:52 user nova-compute[74190]:   <os>
Oct 18 11:55:52 user nova-compute[74190]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 11:55:52 user nova-compute[74190]:     <boot dev="hd"/>
Oct 18 11:55:52 user nova-compute[74190]:     <smbios mode="sysinfo"/>
Oct 18 11:55:52 user nova-compute[74190]:   </os>
Oct 18 11:55:52 user nova-compute[74190]:   <features>
Oct 18 11:55:52 user nova-compute[74190]:     <acpi/>
Oct 18 11:55:52 user nova-compute[74190]:     <apic/>
Oct 18 11:55:52 user nova-compute[74190]:     <vmcoreinfo/>
Oct 18 11:55:52 user nova-compute[74190]:   </features>
Oct 18 11:55:52 user nova-compute[74190]:   <clock offset="utc">
Oct 18 11:55:52 user nova-compute[74190]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 11:55:52 user nova-compute[74190]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 11:55:52 user nova-compute[74190]:     <timer name="hpet" present="no"/>
Oct 18 11:55:52 user nova-compute[74190]:   </clock>
Oct 18 11:55:52 user nova-compute[74190]:   <cpu mode="custom" match="exact">
Oct 18 11:55:52 user nova-compute[74190]:     <model>Nehalem</model>
Oct 18 11:55:52 user nova-compute[74190]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 11:55:52 user nova-compute[74190]:   </cpu>
Oct 18 11:55:52 user nova-compute[74190]:   <devices>
Oct 18 11:55:52 user nova-compute[74190]:     <disk type="file" device="disk">
Oct 18 11:55:52 user nova-compute[74190]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 11:55:52 user nova-compute[74190]:       <source file="/opt/stack/data/nova/instances/95933a75-03d9-4b34-b751-69e3622f23c7/disk"/>
Oct 18 11:55:52 user nova-compute[74190]:       <target dev="vda" bus="virtio"/>
Oct 18 11:55:52 user nova-compute[74190]:     </disk>
Oct 18 11:55:52 user nova-compute[74190]:     <interface type="ethernet">
Oct 18 11:55:52 user nova-compute[74190]:       <mac address="fa:16:3e:b3:8a:60"/>
Oct 18 11:55:52 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:55:52 user nova-compute[74190]:       <mtu size="1442"/>
Oct 18 11:55:52 user nova-compute[74190]:       <target dev="tap0660e8c4-71"/>
Oct 18 11:55:52 user nova-compute[74190]:     </interface>
Oct 18 11:55:52 user nova-compute[74190]:     <serial type="pty">
Oct 18 11:55:52 user nova-compute[74190]:       <log file="/opt/stack/data/nova/instances/95933a75-03d9-4b34-b751-69e3622f23c7/console.log" append="off"/>
Oct 18 11:55:52 user nova-compute[74190]:     </serial>
Oct 18 11:55:52 user nova-compute[74190]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 11:55:52 user nova-compute[74190]:     <video>
Oct 18 11:55:52 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:55:52 user nova-compute[74190]:     </video>
Oct 18 11:55:52 user nova-compute[74190]:     <rng model="virtio">
Oct 18 11:55:52 user nova-compute[74190]:       <backend model="random">/dev/urandom</backend>
Oct 18 11:55:52 user nova-compute[74190]:     </rng>
Oct 18 11:55:52 user nova-compute[74190]:     <controller type="usb" index="0" model="none"/>
Oct 18 11:55:52 user nova-compute[74190]:     <memballoon model="virtio">
Oct 18 11:55:52 user nova-compute[74190]:       <stats period="10"/>
Oct 18 11:55:52 user nova-compute[74190]:     </memballoon>
Oct 18 11:55:52 user nova-compute[74190]:   </devices>
Oct 18 11:55:52 user nova-compute[74190]: </domain>
Oct 18 11:55:52 user nova-compute[74190]:  {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:55:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-759608543',display_name='tempest-TestStampPattern-server-759608543',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-759608543',id=28,image_ref='b3020345-cdef-415e-be91-a3f2326e784c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIWsfXQkdYGPKym2GX8abBzSE1TgaUSMy3GxYdQVyxTc9qElJuld8J6hiVUfhDnJocQnssGij1BqYm1SJS/pWo5ybDXV8dLSSiMAGmlRDARneJEWLLFP/+ol+LaeplXvXg==',key_name='tempest-TestStampPattern-1418984438',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='389e1c2dbc904130ba08b137f0b2e837',ramdisk_id='',reservation_id='r-hk68eg8z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='8eec9cde-3553-4fc8-9162-cda963d1a81e',image_min_disk='1',image_min_ram='0',image_owner_id='389e1c2dbc904130ba08b137f0b2e837',image_owner_project_name='tempest-TestStampPattern-2116730913',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-2116730913-project-member',image_user_id='a252f2c479b740a29a1adc79e6346b20',network_allocated='True',owner_project_name='tempest-TestStampPattern-2116730913',owner_user_name='tempest-TestStampPattern-2116730913-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:55:50Z,user_data=None,user_id='a252f2c479b740a29a1adc79e6346b20',uuid=95933a75-03d9-4b34-b751-69e3622f23c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0660e8c4-71b8-45e5-a54e-7a9f1775061f", "address": "fa:16:3e:b3:8a:60", "network": {"id": "56026ce6-77fb-40c7-9976-732e745c219d", "bridge": "br-int", "label": "tempest-TestStampPattern-989787934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "389e1c2dbc904130ba08b137f0b2e837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0660e8c4-71", "ovs_interfaceid": "0660e8c4-71b8-45e5-a54e-7a9f1775061f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Converting VIF {"id": "0660e8c4-71b8-45e5-a54e-7a9f1775061f", "address": "fa:16:3e:b3:8a:60", "network": {"id": "56026ce6-77fb-40c7-9976-732e745c219d", "bridge": "br-int", "label": "tempest-TestStampPattern-989787934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "389e1c2dbc904130ba08b137f0b2e837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0660e8c4-71", "ovs_interfaceid": "0660e8c4-71b8-45e5-a54e-7a9f1775061f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:8a:60,bridge_name='br-int',has_traffic_filtering=True,id=0660e8c4-71b8-45e5-a54e-7a9f1775061f,network=Network(56026ce6-77fb-40c7-9976-732e745c219d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0660e8c4-71') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG os_vif [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:8a:60,bridge_name='br-int',has_traffic_filtering=True,id=0660e8c4-71b8-45e5-a54e-7a9f1775061f,network=Network(56026ce6-77fb-40c7-9976-732e745c219d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0660e8c4-71') {{(pid=74190) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '35401247-c655-5b63-a772-165be6208a0b', '_type': 'linux-noop'}}, row=False) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG nova.objects.base [None req-af7dc939-a455-4bcf-a275-449ff1f27105 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Object Instance<42413a94-9973-4e8d-83b6-207a4e7847c1> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74190) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-af7dc939-a455-4bcf-a275-449ff1f27105 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:53:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1737897040',display_name='tempest-ServerRescueNegativeTestJSON-server-1737897040',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1737897040',id=25,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-18T11:54:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1ffa18c02b8a4117ab1ccc52aca64f06',ramdisk_id='',reservation_id='r-4ho14m2i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1266902394',owner_user_name='tempest-ServerRescueNegativeTestJSON-1266902394-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:54:12Z,user_data=None,user_id='9db2d65206e24d0aa1428b9bcaa0a86e',uuid=42413a94-9973-4e8d-83b6-207a4e7847c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1bad07b8-897d-4280-9eac-ea800fd1cf5a", "address": "fa:16:3e:0f:dd:a5", "network": {"id": "130f7948-11e4-49b4-9d4a-dffb2b48bdcd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595419292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-595419292-network", "vif_mac": "fa:16:3e:0f:dd:a5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ffa18c02b8a4117ab1ccc52aca64f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bad07b8-89", "ovs_interfaceid": "1bad07b8-897d-4280-9eac-ea800fd1cf5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74190) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-af7dc939-a455-4bcf-a275-449ff1f27105 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Converting VIF {"id": "1bad07b8-897d-4280-9eac-ea800fd1cf5a", "address": "fa:16:3e:0f:dd:a5", "network": {"id": "130f7948-11e4-49b4-9d4a-dffb2b48bdcd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595419292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-595419292-network", "vif_mac": "fa:16:3e:0f:dd:a5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ffa18c02b8a4117ab1ccc52aca64f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bad07b8-89", "ovs_interfaceid": "1bad07b8-897d-4280-9eac-ea800fd1cf5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-af7dc939-a455-4bcf-a275-449ff1f27105 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0f:dd:a5,bridge_name='br-int',has_traffic_filtering=True,id=1bad07b8-897d-4280-9eac-ea800fd1cf5a,network=Network(130f7948-11e4-49b4-9d4a-dffb2b48bdcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bad07b8-89') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG nova.objects.instance [None req-af7dc939-a455-4bcf-a275-449ff1f27105 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lazy-loading 'pci_devices' on Instance uuid 42413a94-9973-4e8d-83b6-207a4e7847c1 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0660e8c4-71, may_exist=True, interface_attrs={}) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0660e8c4-71, col_values=(('qos', UUID('923bd4ab-4c71-4815-b384-d75392d9dfd8')),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0660e8c4-71, col_values=(('external_ids', {'iface-id': '0660e8c4-71b8-45e5-a54e-7a9f1775061f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:8a:60', 'vm-uuid': '95933a75-03d9-4b34-b751-69e3622f23c7'}),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG nova.objects.base [None req-af7dc939-a455-4bcf-a275-449ff1f27105 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Object Instance<42413a94-9973-4e8d-83b6-207a4e7847c1> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74190) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-af7dc939-a455-4bcf-a275-449ff1f27105 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 42413a94-9973-4e8d-83b6-207a4e7847c1] End _get_guest_xml xml=<domain type="kvm">
Oct 18 11:55:52 user nova-compute[74190]:   <uuid>42413a94-9973-4e8d-83b6-207a4e7847c1</uuid>
Oct 18 11:55:52 user nova-compute[74190]:   <name>instance-00000019</name>
Oct 18 11:55:52 user nova-compute[74190]:   <memory>524288</memory>
Oct 18 11:55:52 user nova-compute[74190]:   <vcpu>1</vcpu>
Oct 18 11:55:52 user nova-compute[74190]:   <metadata>
Oct 18 11:55:52 user nova-compute[74190]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 11:55:52 user nova-compute[74190]:       <nova:package version="0.0.0"/>
Oct 18 11:55:52 user nova-compute[74190]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1737897040</nova:name>
Oct 18 11:55:52 user nova-compute[74190]:       <nova:creationTime>2023-10-18 11:55:52</nova:creationTime>
Oct 18 11:55:52 user nova-compute[74190]:       <nova:flavor name="m1.tiny">
Oct 18 11:55:52 user nova-compute[74190]:         <nova:memory>512</nova:memory>
Oct 18 11:55:52 user nova-compute[74190]:         <nova:disk>1</nova:disk>
Oct 18 11:55:52 user nova-compute[74190]:         <nova:swap>0</nova:swap>
Oct 18 11:55:52 user nova-compute[74190]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 11:55:52 user nova-compute[74190]:         <nova:vcpus>1</nova:vcpus>
Oct 18 11:55:52 user nova-compute[74190]:       </nova:flavor>
Oct 18 11:55:52 user nova-compute[74190]:       <nova:owner>
Oct 18 11:55:52 user nova-compute[74190]:         <nova:user uuid="9db2d65206e24d0aa1428b9bcaa0a86e">tempest-ServerRescueNegativeTestJSON-1266902394-project-member</nova:user>
Oct 18 11:55:52 user nova-compute[74190]:         <nova:project uuid="1ffa18c02b8a4117ab1ccc52aca64f06">tempest-ServerRescueNegativeTestJSON-1266902394</nova:project>
Oct 18 11:55:52 user nova-compute[74190]:       </nova:owner>
Oct 18 11:55:52 user nova-compute[74190]:       <nova:root type="image" uuid="6e88bbf0-6e78-49a8-b3c5-9453d22a89df"/>
Oct 18 11:55:52 user nova-compute[74190]:       <nova:ports>
Oct 18 11:55:52 user nova-compute[74190]:         <nova:port uuid="1bad07b8-897d-4280-9eac-ea800fd1cf5a">
Oct 18 11:55:52 user nova-compute[74190]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 18 11:55:52 user nova-compute[74190]:         </nova:port>
Oct 18 11:55:52 user nova-compute[74190]:       </nova:ports>
Oct 18 11:55:52 user nova-compute[74190]:     </nova:instance>
Oct 18 11:55:52 user nova-compute[74190]:   </metadata>
Oct 18 11:55:52 user nova-compute[74190]:   <sysinfo type="smbios">
Oct 18 11:55:52 user nova-compute[74190]:     <system>
Oct 18 11:55:52 user nova-compute[74190]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 11:55:52 user nova-compute[74190]:       <entry name="product">OpenStack Nova</entry>
Oct 18 11:55:52 user nova-compute[74190]:       <entry name="version">0.0.0</entry>
Oct 18 11:55:52 user nova-compute[74190]:       <entry name="serial">42413a94-9973-4e8d-83b6-207a4e7847c1</entry>
Oct 18 11:55:52 user nova-compute[74190]:       <entry name="uuid">42413a94-9973-4e8d-83b6-207a4e7847c1</entry>
Oct 18 11:55:52 user nova-compute[74190]:       <entry name="family">Virtual Machine</entry>
Oct 18 11:55:52 user nova-compute[74190]:     </system>
Oct 18 11:55:52 user nova-compute[74190]:   </sysinfo>
Oct 18 11:55:52 user nova-compute[74190]:   <os>
Oct 18 11:55:52 user nova-compute[74190]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 11:55:52 user nova-compute[74190]:     <smbios mode="sysinfo"/>
Oct 18 11:55:52 user nova-compute[74190]:   </os>
Oct 18 11:55:52 user nova-compute[74190]:   <features>
Oct 18 11:55:52 user nova-compute[74190]:     <acpi/>
Oct 18 11:55:52 user nova-compute[74190]:     <apic/>
Oct 18 11:55:52 user nova-compute[74190]:     <vmcoreinfo/>
Oct 18 11:55:52 user nova-compute[74190]:   </features>
Oct 18 11:55:52 user nova-compute[74190]:   <clock offset="utc">
Oct 18 11:55:52 user nova-compute[74190]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 11:55:52 user nova-compute[74190]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 11:55:52 user nova-compute[74190]:     <timer name="hpet" present="no"/>
Oct 18 11:55:52 user nova-compute[74190]:   </clock>
Oct 18 11:55:52 user nova-compute[74190]:   <cpu mode="custom" match="exact">
Oct 18 11:55:52 user nova-compute[74190]:     <model>Nehalem</model>
Oct 18 11:55:52 user nova-compute[74190]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 11:55:52 user nova-compute[74190]:   </cpu>
Oct 18 11:55:52 user nova-compute[74190]:   <devices>
Oct 18 11:55:52 user nova-compute[74190]:     <disk type="file" device="disk">
Oct 18 11:55:52 user nova-compute[74190]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 11:55:52 user nova-compute[74190]:       <source file="/opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk.rescue"/>
Oct 18 11:55:52 user nova-compute[74190]:       <target dev="vda" bus="virtio"/>
Oct 18 11:55:52 user nova-compute[74190]:     </disk>
Oct 18 11:55:52 user nova-compute[74190]:     <disk type="file" device="disk">
Oct 18 11:55:52 user nova-compute[74190]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 11:55:52 user nova-compute[74190]:       <source file="/opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk"/>
Oct 18 11:55:52 user nova-compute[74190]:       <target dev="vdb" bus="virtio"/>
Oct 18 11:55:52 user nova-compute[74190]:     </disk>
Oct 18 11:55:52 user nova-compute[74190]:     <interface type="ethernet">
Oct 18 11:55:52 user nova-compute[74190]:       <mac address="fa:16:3e:0f:dd:a5"/>
Oct 18 11:55:52 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:55:52 user nova-compute[74190]:       <mtu size="1442"/>
Oct 18 11:55:52 user nova-compute[74190]:       <target dev="tap1bad07b8-89"/>
Oct 18 11:55:52 user nova-compute[74190]:     </interface>
Oct 18 11:55:52 user nova-compute[74190]:     <serial type="pty">
Oct 18 11:55:52 user nova-compute[74190]:       <log file="/opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/console.log" append="off"/>
Oct 18 11:55:52 user nova-compute[74190]:     </serial>
Oct 18 11:55:52 user nova-compute[74190]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 11:55:52 user nova-compute[74190]:     <video>
Oct 18 11:55:52 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:55:52 user nova-compute[74190]:     </video>
Oct 18 11:55:52 user nova-compute[74190]:     <rng model="virtio">
Oct 18 11:55:52 user nova-compute[74190]:       <backend model="random">/dev/urandom</backend>
Oct 18 11:55:52 user nova-compute[74190]:     </rng>
Oct 18 11:55:52 user nova-compute[74190]:     <controller type="usb" index="0" model="none"/>
Oct 18 11:55:52 user nova-compute[74190]:     <memballoon model="virtio">
Oct 18 11:55:52 user nova-compute[74190]:       <stats period="10"/>
Oct 18 11:55:52 user nova-compute[74190]:     </memballoon>
Oct 18 11:55:52 user nova-compute[74190]:   </devices>
Oct 18 11:55:52 user nova-compute[74190]: </domain>
Oct 18 11:55:52 user nova-compute[74190]:  {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:55:52 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 42413a94-9973-4e8d-83b6-207a4e7847c1] Instance destroyed successfully.
Oct 18 11:55:52 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:55:52 user nova-compute[74190]: INFO os_vif [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:8a:60,bridge_name='br-int',has_traffic_filtering=True,id=0660e8c4-71b8-45e5-a54e-7a9f1775061f,network=Network(56026ce6-77fb-40c7-9976-732e745c219d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0660e8c4-71')
Oct 18 11:55:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] No BDM found with device name vda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] No VIF found with MAC fa:16:3e:b3:8a:60, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-af7dc939-a455-4bcf-a275-449ff1f27105 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] No BDM found with device name vda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-af7dc939-a455-4bcf-a275-449ff1f27105 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 11:55:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-af7dc939-a455-4bcf-a275-449ff1f27105 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] No VIF found with MAC fa:16:3e:0f:dd:a5, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 11:55:53 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-1b916f0c-4481-4797-9586-c2f493d273f9 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 47ed3fb0-c159-484f-8380-79b5564d0ac1 is timed out.
Oct 18 11:55:53 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-1b916f0c-4481-4797-9586-c2f493d273f9 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Successfully detached device vdc from instance 47ed3fb0-c159-484f-8380-79b5564d0ac1 from the live domain config.
Oct 18 11:55:53 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b916f0c-4481-4797-9586-c2f493d273f9 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: 47ed3fb0-c159-484f-8380-79b5564d0ac1] calling os-brick to detach iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 11:55:53 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b916f0c-4481-4797-9586-c2f493d273f9 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, {'target_iqn': 'iqn.2010-10.org.openstack:f9e5036f-2095-4ea5-bcf5-e4d952b21ab1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zXMBhRGv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:55:53 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-1b916f0c-4481-4797-9586-c2f493d273f9 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:55:53 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-1b916f0c-4481-4797-9586-c2f493d273f9 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:55:53 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-1b916f0c-4481-4797-9586-c2f493d273f9 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:55:53 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:55:53 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:55:53 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c17ee9-e02a-4514-9169-92768a818a98]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f9e5036f-2095-4ea5-bcf5-e4d952b21ab1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:55:53 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b916f0c-4481-4797-9586-c2f493d273f9 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 11:55:53 user nova-compute[74190]: No targets found.
Oct 18 11:55:53 user nova-compute[74190]: iSNS:
Oct 18 11:55:53 user nova-compute[74190]: No targets found.
Oct 18 11:55:53 user nova-compute[74190]: STATIC:
Oct 18 11:55:53 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227
Oct 18 11:55:53 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:55:53 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:55:53 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa
Oct 18 11:55:53 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:55:53 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:55:53 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:f9e5036f-2095-4ea5-bcf5-e4d952b21ab1
Oct 18 11:55:53 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:55:53 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:55:53 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7
Oct 18 11:55:53 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:55:53 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:55:53 user nova-compute[74190]: FIRMWARE:
Oct 18 11:55:53 user nova-compute[74190]: No targets found.
Oct 18 11:55:53 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:55:53 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b916f0c-4481-4797-9586-c2f493d273f9 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 11:55:53 user nova-compute[74190]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 11:55:53 user nova-compute[74190]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74190) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 11:55:53 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b916f0c-4481-4797-9586-c2f493d273f9 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f9e5036f-2095-4ea5-bcf5-e4d952b21ab1', 0)] {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 11:55:53 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:55:53 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:55:53 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[86057109-cbb5-41d1-a8a8-5e97f44b5aa4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9e5036f-2095-4ea5-bcf5-e4d952b21ab1\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:55:53 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:55:53 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:55:53 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a2dfc8-9f06-44e2-92c4-247e560c9089]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e5036f-2095-4ea5-bcf5-e4d952b21ab1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:55:53 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b916f0c-4481-4797-9586-c2f493d273f9 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 11:55:53 user nova-compute[74190]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7 (non-flash)
Oct 18 11:55:53 user nova-compute[74190]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e5036f-2095-4ea5-bcf5-e4d952b21ab1 (non-flash)
Oct 18 11:55:53 user nova-compute[74190]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 (non-flash)
Oct 18 11:55:53 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:55:53 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b916f0c-4481-4797-9586-c2f493d273f9 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 11:55:53 user nova-compute[74190]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7 (non-flash)
Oct 18 11:55:53 user nova-compute[74190]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e5036f-2095-4ea5-bcf5-e4d952b21ab1 (non-flash)
Oct 18 11:55:53 user nova-compute[74190]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 (non-flash)
Oct 18 11:55:53 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:55:53 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b916f0c-4481-4797-9586-c2f493d273f9 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1f247cf5b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f9e5036f-2095-4ea5-bcf5-e4d952b21ab1'): ({'sdb'}, set())}) {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 11:55:53 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-1b916f0c-4481-4797-9586-c2f493d273f9 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Removing single pathed devices sdb {{(pid=74190) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 11:55:53 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:55:53 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:55:53 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c8b5fd7-0c08-4119-84bc-a47974b97a6d]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:55:53 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:55:53 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:55:53 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f0eb03-8781-4f15-ad80-2737709bfe92]: (4, ('ok\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:55:53 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-1b916f0c-4481-4797-9586-c2f493d273f9 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Flushing IO for device /dev/sdb {{(pid=74190) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 11:55:53 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:55:53 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:55:53 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[a47abf64-558e-438c-b543-c70fd18fb13f]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:55:53 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-1b916f0c-4481-4797-9586-c2f493d273f9 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74190) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 11:55:53 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:55:53 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:55:53 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb87fb8d-0fe0-4469-bdf9-b88e47a74720]: (4, ('1', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:55:53 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-1b916f0c-4481-4797-9586-c2f493d273f9 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 11:55:53 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-1b916f0c-4481-4797-9586-c2f493d273f9 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] SCSI volumes sdb have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 11:55:53 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b916f0c-4481-4797-9586-c2f493d273f9 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f9e5036f-2095-4ea5-bcf5-e4d952b21ab1')] {{(pid=74190) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 11:55:53 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9e5036f-2095-4ea5-bcf5-e4d952b21ab1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:55:53 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9e5036f-2095-4ea5-bcf5-e4d952b21ab1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:55:53 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[8352023b-54da-4970-b422-4b322b214315]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:55:53 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b916f0c-4481-4797-9586-c2f493d273f9 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:55:53 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9e5036f-2095-4ea5-bcf5-e4d952b21ab1 -p 172.16.0.220:3260 --logout {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:55:53 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9e5036f-2095-4ea5-bcf5-e4d952b21ab1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:55:53 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e9de54-eea7-457a-b49e-b8a415daaaa8]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:f9e5036f-2095-4ea5-bcf5-e4d952b21ab1, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:f9e5036f-2095-4ea5-bcf5-e4d952b21ab1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:55:53 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b916f0c-4481-4797-9586-c2f493d273f9 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:f9e5036f-2095-4ea5-bcf5-e4d952b21ab1, portal: 172.16.0.220,3260]
Oct 18 11:55:53 user nova-compute[74190]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:f9e5036f-2095-4ea5-bcf5-e4d952b21ab1, portal: 172.16.0.220,3260] successful.
Oct 18 11:55:53 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:55:53 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9e5036f-2095-4ea5-bcf5-e4d952b21ab1 -p 172.16.0.220:3260 --op delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:55:53 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9e5036f-2095-4ea5-bcf5-e4d952b21ab1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:55:53 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f244563-cc6f-452d-b296-6b63a4185eed]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:55:53 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b916f0c-4481-4797-9586-c2f493d273f9 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:55:53 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-1b916f0c-4481-4797-9586-c2f493d273f9 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:55:53 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b916f0c-4481-4797-9586-c2f493d273f9 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] <== disconnect_volume: return (303ms) None {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:55:53 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b916f0c-4481-4797-9586-c2f493d273f9 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: 47ed3fb0-c159-484f-8380-79b5564d0ac1] Disconnected iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 11:55:53 user nova-compute[74190]: DEBUG nova.compute.manager [req-2c381161-deb0-44bc-85cb-e446c5eb5551 req-894c3c2c-7016-454f-be22-7ccba32121ea service nova] [instance: 42413a94-9973-4e8d-83b6-207a4e7847c1] Received event network-vif-plugged-1bad07b8-897d-4280-9eac-ea800fd1cf5a {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:55:54 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-2c381161-deb0-44bc-85cb-e446c5eb5551 req-894c3c2c-7016-454f-be22-7ccba32121ea service nova] Acquiring lock "42413a94-9973-4e8d-83b6-207a4e7847c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:55:54 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-2c381161-deb0-44bc-85cb-e446c5eb5551 req-894c3c2c-7016-454f-be22-7ccba32121ea service nova] Lock "42413a94-9973-4e8d-83b6-207a4e7847c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:55:54 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-2c381161-deb0-44bc-85cb-e446c5eb5551 req-894c3c2c-7016-454f-be22-7ccba32121ea service nova] Lock "42413a94-9973-4e8d-83b6-207a4e7847c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:55:54 user nova-compute[74190]: DEBUG nova.compute.manager [req-2c381161-deb0-44bc-85cb-e446c5eb5551 req-894c3c2c-7016-454f-be22-7ccba32121ea service nova] [instance: 42413a94-9973-4e8d-83b6-207a4e7847c1] No waiting events found dispatching network-vif-plugged-1bad07b8-897d-4280-9eac-ea800fd1cf5a {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:55:54 user nova-compute[74190]: WARNING nova.compute.manager [req-2c381161-deb0-44bc-85cb-e446c5eb5551 req-894c3c2c-7016-454f-be22-7ccba32121ea service nova] [instance: 42413a94-9973-4e8d-83b6-207a4e7847c1] Received unexpected event network-vif-plugged-1bad07b8-897d-4280-9eac-ea800fd1cf5a for instance with vm_state active and task_state rescuing.
Oct 18 11:55:54 user nova-compute[74190]: DEBUG nova.objects.instance [None req-1b916f0c-4481-4797-9586-c2f493d273f9 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lazy-loading 'flavor' on Instance uuid 47ed3fb0-c159-484f-8380-79b5564d0ac1 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:55:54 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-1b916f0c-4481-4797-9586-c2f493d273f9 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lock "47ed3fb0-c159-484f-8380-79b5564d0ac1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.744s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:55:54 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:55:55 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:55:55 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:55:55 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:55:55 user nova-compute[74190]: DEBUG nova.compute.manager [req-6be3091f-2f27-4f37-b5b1-b6b887139308 req-1ec84406-10cd-433e-9dd3-34d61af74680 service nova] [instance: 95933a75-03d9-4b34-b751-69e3622f23c7] Received event network-vif-plugged-0660e8c4-71b8-45e5-a54e-7a9f1775061f {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:55:55 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-6be3091f-2f27-4f37-b5b1-b6b887139308 req-1ec84406-10cd-433e-9dd3-34d61af74680 service nova] Acquiring lock "95933a75-03d9-4b34-b751-69e3622f23c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:55:55 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-6be3091f-2f27-4f37-b5b1-b6b887139308 req-1ec84406-10cd-433e-9dd3-34d61af74680 service nova] Lock "95933a75-03d9-4b34-b751-69e3622f23c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:55:55 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-6be3091f-2f27-4f37-b5b1-b6b887139308 req-1ec84406-10cd-433e-9dd3-34d61af74680 service nova] Lock "95933a75-03d9-4b34-b751-69e3622f23c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:55:55 user nova-compute[74190]: DEBUG nova.compute.manager [req-6be3091f-2f27-4f37-b5b1-b6b887139308 req-1ec84406-10cd-433e-9dd3-34d61af74680 service nova] [instance: 95933a75-03d9-4b34-b751-69e3622f23c7] No waiting events found dispatching network-vif-plugged-0660e8c4-71b8-45e5-a54e-7a9f1775061f {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:55:55 user nova-compute[74190]: WARNING nova.compute.manager [req-6be3091f-2f27-4f37-b5b1-b6b887139308 req-1ec84406-10cd-433e-9dd3-34d61af74680 service nova] [instance: 95933a75-03d9-4b34-b751-69e3622f23c7] Received unexpected event network-vif-plugged-0660e8c4-71b8-45e5-a54e-7a9f1775061f for instance with vm_state building and task_state spawning.
Oct 18 11:55:55 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:55:55 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:55:55 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:55:55 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:55:55 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-31251bf1-c537-45f2-988f-03e9bfbe5ba9 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Acquiring lock "47ed3fb0-c159-484f-8380-79b5564d0ac1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:55:55 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-31251bf1-c537-45f2-988f-03e9bfbe5ba9 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lock "47ed3fb0-c159-484f-8380-79b5564d0ac1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:55:55 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-31251bf1-c537-45f2-988f-03e9bfbe5ba9 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Acquiring lock "47ed3fb0-c159-484f-8380-79b5564d0ac1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:55:55 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-31251bf1-c537-45f2-988f-03e9bfbe5ba9 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lock "47ed3fb0-c159-484f-8380-79b5564d0ac1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:55:55 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-31251bf1-c537-45f2-988f-03e9bfbe5ba9 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lock "47ed3fb0-c159-484f-8380-79b5564d0ac1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:55:55 user nova-compute[74190]: INFO nova.compute.manager [None req-31251bf1-c537-45f2-988f-03e9bfbe5ba9 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: 47ed3fb0-c159-484f-8380-79b5564d0ac1] Terminating instance
Oct 18 11:55:55 user nova-compute[74190]: DEBUG nova.compute.manager [None req-31251bf1-c537-45f2-988f-03e9bfbe5ba9 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: 47ed3fb0-c159-484f-8380-79b5564d0ac1] Start destroying the instance on the hypervisor. {{(pid=74190) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 11:55:55 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:55:55 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:55:55 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:55:55 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:55:55 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:55:55 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:55:56 user nova-compute[74190]: DEBUG nova.compute.manager [req-e4d4d918-c218-43a0-9cec-55ece1ea14e6 req-46c48739-30a2-4379-b1b7-e8eb115c66b0 service nova] [instance: 42413a94-9973-4e8d-83b6-207a4e7847c1] Received event network-vif-plugged-1bad07b8-897d-4280-9eac-ea800fd1cf5a {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:55:56 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-e4d4d918-c218-43a0-9cec-55ece1ea14e6 req-46c48739-30a2-4379-b1b7-e8eb115c66b0 service nova] Acquiring lock "42413a94-9973-4e8d-83b6-207a4e7847c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:55:56 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-e4d4d918-c218-43a0-9cec-55ece1ea14e6 req-46c48739-30a2-4379-b1b7-e8eb115c66b0 service nova] Lock "42413a94-9973-4e8d-83b6-207a4e7847c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:55:56 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-e4d4d918-c218-43a0-9cec-55ece1ea14e6 req-46c48739-30a2-4379-b1b7-e8eb115c66b0 service nova] Lock "42413a94-9973-4e8d-83b6-207a4e7847c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:55:56 user nova-compute[74190]: DEBUG nova.compute.manager [req-e4d4d918-c218-43a0-9cec-55ece1ea14e6 req-46c48739-30a2-4379-b1b7-e8eb115c66b0 service nova] [instance: 42413a94-9973-4e8d-83b6-207a4e7847c1] No waiting events found dispatching network-vif-plugged-1bad07b8-897d-4280-9eac-ea800fd1cf5a {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:55:56 user nova-compute[74190]: WARNING nova.compute.manager [req-e4d4d918-c218-43a0-9cec-55ece1ea14e6 req-46c48739-30a2-4379-b1b7-e8eb115c66b0 service nova] [instance: 42413a94-9973-4e8d-83b6-207a4e7847c1] Received unexpected event network-vif-plugged-1bad07b8-897d-4280-9eac-ea800fd1cf5a for instance with vm_state active and task_state rescuing.
Oct 18 11:55:56 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 47ed3fb0-c159-484f-8380-79b5564d0ac1] Instance destroyed successfully.
Oct 18 11:55:56 user nova-compute[74190]: DEBUG nova.objects.instance [None req-31251bf1-c537-45f2-988f-03e9bfbe5ba9 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lazy-loading 'resources' on Instance uuid 47ed3fb0-c159-484f-8380-79b5564d0ac1 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:55:56 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-31251bf1-c537-45f2-988f-03e9bfbe5ba9 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:52:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-456038629',display_name='tempest-AttachVolumeTestJSON-server-456038629',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-456038629',id=20,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBkgFytixGjsjs/C1VxYydi/VmFlzQx03eXWvil/WfHYEFf8RVJiRUoA22chhGmvUuOxPuOWK93Bmu7ldGrtzJ/Hm1HU7mPE3T0sLniuJZRStzEYProGy2VdfSBuWO2F2A==',key_name='tempest-keypair-343955058',keypairs=<?>,launch_index=0,launched_at=2023-10-18T11:52:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='99cf8d4d4f504e82868ed295e054644c',ramdisk_id='',reservation_id='r-ffhxqcn6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2125017306',owner_user_name='tempest-AttachVolumeTestJSON-2125017306-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T11:52:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='852309a19f1b4d49a4974c3be53f67cb',uuid=47ed3fb0-c159-484f-8380-79b5564d0ac1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "693871aa-4bc1-41f8-aa49-4882800b9592", "address": "fa:16:3e:4b:2c:c3", "network": {"id": "cf0a4705-3fff-4716-87ac-b0ca7700e11c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1739631852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cf8d4d4f504e82868ed295e054644c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap693871aa-4b", "ovs_interfaceid": "693871aa-4bc1-41f8-aa49-4882800b9592", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 11:55:56 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-31251bf1-c537-45f2-988f-03e9bfbe5ba9 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Converting VIF {"id": "693871aa-4bc1-41f8-aa49-4882800b9592", "address": "fa:16:3e:4b:2c:c3", "network": {"id": "cf0a4705-3fff-4716-87ac-b0ca7700e11c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1739631852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99cf8d4d4f504e82868ed295e054644c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap693871aa-4b", "ovs_interfaceid": "693871aa-4bc1-41f8-aa49-4882800b9592", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:55:56 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-31251bf1-c537-45f2-988f-03e9bfbe5ba9 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4b:2c:c3,bridge_name='br-int',has_traffic_filtering=True,id=693871aa-4bc1-41f8-aa49-4882800b9592,network=Network(cf0a4705-3fff-4716-87ac-b0ca7700e11c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap693871aa-4b') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:55:56 user nova-compute[74190]: DEBUG os_vif [None req-31251bf1-c537-45f2-988f-03e9bfbe5ba9 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:2c:c3,bridge_name='br-int',has_traffic_filtering=True,id=693871aa-4bc1-41f8-aa49-4882800b9592,network=Network(cf0a4705-3fff-4716-87ac-b0ca7700e11c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap693871aa-4b') {{(pid=74190) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 11:55:56 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:55:56 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap693871aa-4b, bridge=br-int, if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:55:56 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:55:56 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:55:56 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:55:56 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9ff4a270-0b09-4f5a-8c9a-7e4d6ca61277) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:55:56 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:55:56 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:55:56 user nova-compute[74190]: INFO os_vif [None req-31251bf1-c537-45f2-988f-03e9bfbe5ba9 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:2c:c3,bridge_name='br-int',has_traffic_filtering=True,id=693871aa-4bc1-41f8-aa49-4882800b9592,network=Network(cf0a4705-3fff-4716-87ac-b0ca7700e11c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap693871aa-4b')
Oct 18 11:55:56 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-31251bf1-c537-45f2-988f-03e9bfbe5ba9 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: 47ed3fb0-c159-484f-8380-79b5564d0ac1] Deleting instance files /opt/stack/data/nova/instances/47ed3fb0-c159-484f-8380-79b5564d0ac1_del
Oct 18 11:55:56 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-31251bf1-c537-45f2-988f-03e9bfbe5ba9 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: 47ed3fb0-c159-484f-8380-79b5564d0ac1] Deletion of /opt/stack/data/nova/instances/47ed3fb0-c159-484f-8380-79b5564d0ac1_del complete
Oct 18 11:55:56 user nova-compute[74190]: INFO nova.compute.manager [None req-31251bf1-c537-45f2-988f-03e9bfbe5ba9 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] [instance: 47ed3fb0-c159-484f-8380-79b5564d0ac1] Took 1.21 seconds to destroy the instance on the hypervisor.
Oct 18 11:55:56 user nova-compute[74190]: DEBUG oslo.service.loopingcall [None req-31251bf1-c537-45f2-988f-03e9bfbe5ba9 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74190) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 11:55:56 user nova-compute[74190]: DEBUG nova.compute.manager [-] [instance: 47ed3fb0-c159-484f-8380-79b5564d0ac1] Deallocating network for instance {{(pid=74190) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 11:55:56 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: 47ed3fb0-c159-484f-8380-79b5564d0ac1] deallocate_for_instance() {{(pid=74190) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 11:55:57 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:55:57 user nova-compute[74190]: DEBUG nova.compute.manager [req-a9acbb2f-8283-4eb8-a6a7-ee9a0577eb7d req-32817ef2-6471-4257-aaf1-66d7fa212645 service nova] [instance: 95933a75-03d9-4b34-b751-69e3622f23c7] Received event network-vif-plugged-0660e8c4-71b8-45e5-a54e-7a9f1775061f {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:55:57 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-a9acbb2f-8283-4eb8-a6a7-ee9a0577eb7d req-32817ef2-6471-4257-aaf1-66d7fa212645 service nova] Acquiring lock "95933a75-03d9-4b34-b751-69e3622f23c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:55:57 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-a9acbb2f-8283-4eb8-a6a7-ee9a0577eb7d req-32817ef2-6471-4257-aaf1-66d7fa212645 service nova] Lock "95933a75-03d9-4b34-b751-69e3622f23c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:55:57 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-a9acbb2f-8283-4eb8-a6a7-ee9a0577eb7d req-32817ef2-6471-4257-aaf1-66d7fa212645 service nova] Lock "95933a75-03d9-4b34-b751-69e3622f23c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:55:57 user nova-compute[74190]: DEBUG nova.compute.manager [req-a9acbb2f-8283-4eb8-a6a7-ee9a0577eb7d req-32817ef2-6471-4257-aaf1-66d7fa212645 service nova] [instance: 95933a75-03d9-4b34-b751-69e3622f23c7] No waiting events found dispatching network-vif-plugged-0660e8c4-71b8-45e5-a54e-7a9f1775061f {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:55:57 user nova-compute[74190]: WARNING nova.compute.manager [req-a9acbb2f-8283-4eb8-a6a7-ee9a0577eb7d req-32817ef2-6471-4257-aaf1-66d7fa212645 service nova] [instance: 95933a75-03d9-4b34-b751-69e3622f23c7] Received unexpected event network-vif-plugged-0660e8c4-71b8-45e5-a54e-7a9f1775061f for instance with vm_state building and task_state spawning.
Oct 18 11:55:57 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: 47ed3fb0-c159-484f-8380-79b5564d0ac1] Updating instance_info_cache with network_info: [] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:55:57 user nova-compute[74190]: DEBUG nova.compute.manager [req-8521bc39-a250-445a-a8c4-0a91f84834b5 req-c4dee37c-a0bd-47ab-8ab1-2242900dde1a service nova] [instance: 47ed3fb0-c159-484f-8380-79b5564d0ac1] Received event network-vif-deleted-693871aa-4bc1-41f8-aa49-4882800b9592 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:55:57 user nova-compute[74190]: INFO nova.compute.manager [req-8521bc39-a250-445a-a8c4-0a91f84834b5 req-c4dee37c-a0bd-47ab-8ab1-2242900dde1a service nova] [instance: 47ed3fb0-c159-484f-8380-79b5564d0ac1] Neutron deleted interface 693871aa-4bc1-41f8-aa49-4882800b9592; detaching it from the instance and deleting it from the info cache
Oct 18 11:55:57 user nova-compute[74190]: DEBUG nova.network.neutron [req-8521bc39-a250-445a-a8c4-0a91f84834b5 req-c4dee37c-a0bd-47ab-8ab1-2242900dde1a service nova] [instance: 47ed3fb0-c159-484f-8380-79b5564d0ac1] Updating instance_info_cache with network_info: [] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:55:57 user nova-compute[74190]: INFO nova.compute.manager [-] [instance: 47ed3fb0-c159-484f-8380-79b5564d0ac1] Took 0.86 seconds to deallocate network for instance.
Oct 18 11:55:57 user nova-compute[74190]: DEBUG nova.compute.manager [req-8521bc39-a250-445a-a8c4-0a91f84834b5 req-c4dee37c-a0bd-47ab-8ab1-2242900dde1a service nova] [instance: 47ed3fb0-c159-484f-8380-79b5564d0ac1] Detach interface failed, port_id=693871aa-4bc1-41f8-aa49-4882800b9592, reason: Instance 47ed3fb0-c159-484f-8380-79b5564d0ac1 could not be found. {{(pid=74190) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 18 11:55:57 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-31251bf1-c537-45f2-988f-03e9bfbe5ba9 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:55:57 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-31251bf1-c537-45f2-988f-03e9bfbe5ba9 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:55:58 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:55:58 user nova-compute[74190]: DEBUG nova.compute.manager [req-c44ef3b5-2893-4a46-b4ce-d1de1a65936d req-a677675d-934d-4fcf-9e1b-b7fd995c2373 service nova] [instance: 42413a94-9973-4e8d-83b6-207a4e7847c1] Received event network-vif-plugged-1bad07b8-897d-4280-9eac-ea800fd1cf5a {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:55:58 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-c44ef3b5-2893-4a46-b4ce-d1de1a65936d req-a677675d-934d-4fcf-9e1b-b7fd995c2373 service nova] Acquiring lock "42413a94-9973-4e8d-83b6-207a4e7847c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:55:58 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-c44ef3b5-2893-4a46-b4ce-d1de1a65936d req-a677675d-934d-4fcf-9e1b-b7fd995c2373 service nova] Lock "42413a94-9973-4e8d-83b6-207a4e7847c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:55:58 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-c44ef3b5-2893-4a46-b4ce-d1de1a65936d req-a677675d-934d-4fcf-9e1b-b7fd995c2373 service nova] Lock "42413a94-9973-4e8d-83b6-207a4e7847c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:55:58 user nova-compute[74190]: DEBUG nova.compute.manager [req-c44ef3b5-2893-4a46-b4ce-d1de1a65936d req-a677675d-934d-4fcf-9e1b-b7fd995c2373 service nova] [instance: 42413a94-9973-4e8d-83b6-207a4e7847c1] No waiting events found dispatching network-vif-plugged-1bad07b8-897d-4280-9eac-ea800fd1cf5a {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:55:58 user nova-compute[74190]: WARNING nova.compute.manager [req-c44ef3b5-2893-4a46-b4ce-d1de1a65936d req-a677675d-934d-4fcf-9e1b-b7fd995c2373 service nova] [instance: 42413a94-9973-4e8d-83b6-207a4e7847c1] Received unexpected event network-vif-plugged-1bad07b8-897d-4280-9eac-ea800fd1cf5a for instance with vm_state active and task_state rescuing.
Oct 18 11:55:58 user nova-compute[74190]: DEBUG nova.compute.manager [req-c44ef3b5-2893-4a46-b4ce-d1de1a65936d req-a677675d-934d-4fcf-9e1b-b7fd995c2373 service nova] [instance: 47ed3fb0-c159-484f-8380-79b5564d0ac1] Received event network-vif-unplugged-693871aa-4bc1-41f8-aa49-4882800b9592 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:55:58 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-c44ef3b5-2893-4a46-b4ce-d1de1a65936d req-a677675d-934d-4fcf-9e1b-b7fd995c2373 service nova] Acquiring lock "47ed3fb0-c159-484f-8380-79b5564d0ac1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:55:58 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-c44ef3b5-2893-4a46-b4ce-d1de1a65936d req-a677675d-934d-4fcf-9e1b-b7fd995c2373 service nova] Lock "47ed3fb0-c159-484f-8380-79b5564d0ac1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:55:58 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-c44ef3b5-2893-4a46-b4ce-d1de1a65936d req-a677675d-934d-4fcf-9e1b-b7fd995c2373 service nova] Lock "47ed3fb0-c159-484f-8380-79b5564d0ac1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:55:58 user nova-compute[74190]: DEBUG nova.compute.manager [req-c44ef3b5-2893-4a46-b4ce-d1de1a65936d req-a677675d-934d-4fcf-9e1b-b7fd995c2373 service nova] [instance: 47ed3fb0-c159-484f-8380-79b5564d0ac1] No waiting events found dispatching network-vif-unplugged-693871aa-4bc1-41f8-aa49-4882800b9592 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:55:58 user nova-compute[74190]: WARNING nova.compute.manager [req-c44ef3b5-2893-4a46-b4ce-d1de1a65936d req-a677675d-934d-4fcf-9e1b-b7fd995c2373 service nova] [instance: 47ed3fb0-c159-484f-8380-79b5564d0ac1] Received unexpected event network-vif-unplugged-693871aa-4bc1-41f8-aa49-4882800b9592 for instance with vm_state deleted and task_state None.
Oct 18 11:55:58 user nova-compute[74190]: DEBUG nova.compute.manager [req-c44ef3b5-2893-4a46-b4ce-d1de1a65936d req-a677675d-934d-4fcf-9e1b-b7fd995c2373 service nova] [instance: 47ed3fb0-c159-484f-8380-79b5564d0ac1] Received event network-vif-plugged-693871aa-4bc1-41f8-aa49-4882800b9592 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:55:58 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-c44ef3b5-2893-4a46-b4ce-d1de1a65936d req-a677675d-934d-4fcf-9e1b-b7fd995c2373 service nova] Acquiring lock "47ed3fb0-c159-484f-8380-79b5564d0ac1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:55:58 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-c44ef3b5-2893-4a46-b4ce-d1de1a65936d req-a677675d-934d-4fcf-9e1b-b7fd995c2373 service nova] Lock "47ed3fb0-c159-484f-8380-79b5564d0ac1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:55:58 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-c44ef3b5-2893-4a46-b4ce-d1de1a65936d req-a677675d-934d-4fcf-9e1b-b7fd995c2373 service nova] Lock "47ed3fb0-c159-484f-8380-79b5564d0ac1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:55:58 user nova-compute[74190]: DEBUG nova.compute.manager [req-c44ef3b5-2893-4a46-b4ce-d1de1a65936d req-a677675d-934d-4fcf-9e1b-b7fd995c2373 service nova] [instance: 47ed3fb0-c159-484f-8380-79b5564d0ac1] No waiting events found dispatching network-vif-plugged-693871aa-4bc1-41f8-aa49-4882800b9592 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:55:58 user nova-compute[74190]: WARNING nova.compute.manager [req-c44ef3b5-2893-4a46-b4ce-d1de1a65936d req-a677675d-934d-4fcf-9e1b-b7fd995c2373 service nova] [instance: 47ed3fb0-c159-484f-8380-79b5564d0ac1] Received unexpected event network-vif-plugged-693871aa-4bc1-41f8-aa49-4882800b9592 for instance with vm_state deleted and task_state None.
Oct 18 11:55:58 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-31251bf1-c537-45f2-988f-03e9bfbe5ba9 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 11:55:58 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-31251bf1-c537-45f2-988f-03e9bfbe5ba9 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 11:55:58 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-31251bf1-c537-45f2-988f-03e9bfbe5ba9 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.362s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:55:58 user nova-compute[74190]: INFO nova.scheduler.client.report [None req-31251bf1-c537-45f2-988f-03e9bfbe5ba9 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Deleted allocations for instance 47ed3fb0-c159-484f-8380-79b5564d0ac1
Oct 18 11:55:58 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-31251bf1-c537-45f2-988f-03e9bfbe5ba9 tempest-AttachVolumeTestJSON-2125017306 tempest-AttachVolumeTestJSON-2125017306-project-member] Lock "47ed3fb0-c159-484f-8380-79b5564d0ac1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.671s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:55:58 user nova-compute[74190]: DEBUG nova.compute.manager [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] [instance: 95933a75-03d9-4b34-b751-69e3622f23c7] Instance event wait completed in 0 seconds for  {{(pid=74190) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 11:55:58 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] [instance: 95933a75-03d9-4b34-b751-69e3622f23c7] Guest created on hypervisor {{(pid=74190) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 11:55:58 user nova-compute[74190]: DEBUG nova.compute.manager [None req-af7dc939-a455-4bcf-a275-449ff1f27105 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 42413a94-9973-4e8d-83b6-207a4e7847c1] Checking state {{(pid=74190) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 11:55:58 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 95933a75-03d9-4b34-b751-69e3622f23c7] Instance spawned successfully.
Oct 18 11:55:58 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] [instance: 95933a75-03d9-4b34-b751-69e3622f23c7] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 11:55:58 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] [instance: 95933a75-03d9-4b34-b751-69e3622f23c7] Found default for hw_input_bus of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:55:58 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] [instance: 95933a75-03d9-4b34-b751-69e3622f23c7] Found default for hw_pointer_model of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:55:58 user nova-compute[74190]: INFO nova.compute.manager [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] [instance: 95933a75-03d9-4b34-b751-69e3622f23c7] Took 8.99 seconds to spawn the instance on the hypervisor.
Oct 18 11:55:58 user nova-compute[74190]: DEBUG nova.compute.manager [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] [instance: 95933a75-03d9-4b34-b751-69e3622f23c7] Checking state {{(pid=74190) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 11:55:58 user nova-compute[74190]: INFO nova.compute.manager [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] [instance: 95933a75-03d9-4b34-b751-69e3622f23c7] Took 9.83 seconds to build instance.
Oct 18 11:55:58 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-cafc2016-a7bb-40a4-b7b3-2cc5f9ae6831 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Lock "95933a75-03d9-4b34-b751-69e3622f23c7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.944s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:55:59 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:56:00 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:56:00 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74190) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 11:56:00 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:56:01 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:56:01 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:56:02 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:56:02 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:56:02 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:56:02 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:56:02 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:56:02 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Auditing locally available compute resources for user (node: user) {{(pid=74190) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 11:56:02 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31a86ab2-d72d-4274-b5a6-84c5c4bdfc01/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:56:02 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31a86ab2-d72d-4274-b5a6-84c5c4bdfc01/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:56:02 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31a86ab2-d72d-4274-b5a6-84c5c4bdfc01/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:56:02 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31a86ab2-d72d-4274-b5a6-84c5c4bdfc01/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:56:02 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eaf6c32-1860-4732-9e50-3a8e04b95be8/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:56:02 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eaf6c32-1860-4732-9e50-3a8e04b95be8/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:56:02 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eaf6c32-1860-4732-9e50-3a8e04b95be8/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:56:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eaf6c32-1860-4732-9e50-3a8e04b95be8/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:56:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:56:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:56:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:56:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:56:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eec9cde-3553-4fc8-9162-cda963d1a81e/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:56:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eec9cde-3553-4fc8-9162-cda963d1a81e/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:56:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eec9cde-3553-4fc8-9162-cda963d1a81e/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:56:04 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eec9cde-3553-4fc8-9162-cda963d1a81e/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:56:04 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b200eb6a-be24-4a8f-be23-4e36f7b7b26e/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:56:04 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b200eb6a-be24-4a8f-be23-4e36f7b7b26e/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:56:04 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b200eb6a-be24-4a8f-be23-4e36f7b7b26e/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:56:04 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b200eb6a-be24-4a8f-be23-4e36f7b7b26e/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:56:04 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 11:56:04 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 11:56:04 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0209c824-88a7-4976-83bf-8a72437f0cc2/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:56:04 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0209c824-88a7-4976-83bf-8a72437f0cc2/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:56:04 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0209c824-88a7-4976-83bf-8a72437f0cc2/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:56:04 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0209c824-88a7-4976-83bf-8a72437f0cc2/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:56:04 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:56:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:56:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:56:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:56:05 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 11:56:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk.rescue --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:56:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:56:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk.rescue --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:56:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:56:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:56:06 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:56:06 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:56:06 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:56:06 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95933a75-03d9-4b34-b751-69e3622f23c7/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:56:06 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95933a75-03d9-4b34-b751-69e3622f23c7/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:56:06 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95933a75-03d9-4b34-b751-69e3622f23c7/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:56:06 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:56:06 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95933a75-03d9-4b34-b751-69e3622f23c7/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:56:07 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:56:07 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:56:07 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:56:07 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Hypervisor/Node resource view: name=user free_ram=7481MB free_disk=25.128665924072266GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74190) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 11:56:07 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:56:07 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:56:07 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Applying migration context for instance a9012673-826b-4be7-a55b-9bb35a227c17 as it has an incoming, in-progress migration 721bcb36-1ad7-4025-baa0-50a8a0705c76. Migration status is finished {{(pid=74190) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 18 11:56:07 user nova-compute[74190]: INFO nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Updating resource usage from migration 721bcb36-1ad7-4025-baa0-50a8a0705c76
Oct 18 11:56:07 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 0209c824-88a7-4976-83bf-8a72437f0cc2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:56:07 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 4e916d24-9f9d-4289-87ce-f65d2499fcd9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:56:07 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 8eec9cde-3553-4fc8-9162-cda963d1a81e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:56:07 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance b200eb6a-be24-4a8f-be23-4e36f7b7b26e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:56:07 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 95ca0697-22b5-4109-868f-ca5556015a1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:56:07 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 42413a94-9973-4e8d-83b6-207a4e7847c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:56:07 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 31a86ab2-d72d-4274-b5a6-84c5c4bdfc01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:56:07 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Migration 721bcb36-1ad7-4025-baa0-50a8a0705c76 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 18 11:56:07 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance a9012673-826b-4be7-a55b-9bb35a227c17 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:56:07 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 7eaf6c32-1860-4732-9e50-3a8e04b95be8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:56:07 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 95933a75-03d9-4b34-b751-69e3622f23c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:56:07 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 11:56:07 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 11:56:07 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 11:56:07 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 11:56:07 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Compute_service record updated for user:user {{(pid=74190) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 11:56:07 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.698s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:56:08 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:56:09 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:56:10 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-063babb8-556f-4ffb-9aa3-b2fa089fe64c tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Acquiring lock "772b126c-2148-4ca8-90f2-69d6eb4b7db7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:56:10 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-063babb8-556f-4ffb-9aa3-b2fa089fe64c tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lock "772b126c-2148-4ca8-90f2-69d6eb4b7db7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:56:10 user nova-compute[74190]: DEBUG nova.compute.manager [None req-063babb8-556f-4ffb-9aa3-b2fa089fe64c tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 772b126c-2148-4ca8-90f2-69d6eb4b7db7] Starting instance... {{(pid=74190) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 11:56:10 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-063babb8-556f-4ffb-9aa3-b2fa089fe64c tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:56:10 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-063babb8-556f-4ffb-9aa3-b2fa089fe64c tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:56:10 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-063babb8-556f-4ffb-9aa3-b2fa089fe64c tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74190) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 11:56:10 user nova-compute[74190]: INFO nova.compute.claims [None req-063babb8-556f-4ffb-9aa3-b2fa089fe64c tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 772b126c-2148-4ca8-90f2-69d6eb4b7db7] Claim successful on node user
Oct 18 11:56:10 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-063babb8-556f-4ffb-9aa3-b2fa089fe64c tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 11:56:10 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-063babb8-556f-4ffb-9aa3-b2fa089fe64c tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 11:56:10 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-063babb8-556f-4ffb-9aa3-b2fa089fe64c tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.472s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:56:10 user nova-compute[74190]: DEBUG nova.compute.manager [None req-063babb8-556f-4ffb-9aa3-b2fa089fe64c tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 772b126c-2148-4ca8-90f2-69d6eb4b7db7] Start building networks asynchronously for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 11:56:10 user nova-compute[74190]: DEBUG nova.compute.manager [None req-063babb8-556f-4ffb-9aa3-b2fa089fe64c tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 772b126c-2148-4ca8-90f2-69d6eb4b7db7] Allocating IP information in the background. {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 11:56:10 user nova-compute[74190]: DEBUG nova.network.neutron [None req-063babb8-556f-4ffb-9aa3-b2fa089fe64c tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 772b126c-2148-4ca8-90f2-69d6eb4b7db7] allocate_for_instance() {{(pid=74190) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 11:56:10 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-063babb8-556f-4ffb-9aa3-b2fa089fe64c tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 772b126c-2148-4ca8-90f2-69d6eb4b7db7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 11:56:10 user nova-compute[74190]: DEBUG nova.compute.manager [None req-063babb8-556f-4ffb-9aa3-b2fa089fe64c tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 772b126c-2148-4ca8-90f2-69d6eb4b7db7] Start building block device mappings for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 11:56:10 user nova-compute[74190]: DEBUG nova.policy [None req-063babb8-556f-4ffb-9aa3-b2fa089fe64c tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7fa675b6803f4e21b090295b51fb9ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d994366010142519ff367fa7ca77e61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74190) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 11:56:10 user nova-compute[74190]: DEBUG nova.compute.manager [None req-063babb8-556f-4ffb-9aa3-b2fa089fe64c tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 772b126c-2148-4ca8-90f2-69d6eb4b7db7] Start spawning the instance on the hypervisor. {{(pid=74190) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 11:56:10 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-063babb8-556f-4ffb-9aa3-b2fa089fe64c tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 772b126c-2148-4ca8-90f2-69d6eb4b7db7] Creating instance directory {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 11:56:10 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-063babb8-556f-4ffb-9aa3-b2fa089fe64c tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 772b126c-2148-4ca8-90f2-69d6eb4b7db7] Creating image(s)
Oct 18 11:56:10 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-063babb8-556f-4ffb-9aa3-b2fa089fe64c tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Acquiring lock "/opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:56:10 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-063babb8-556f-4ffb-9aa3-b2fa089fe64c tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lock "/opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:56:10 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-063babb8-556f-4ffb-9aa3-b2fa089fe64c tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lock "/opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:56:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-063babb8-556f-4ffb-9aa3-b2fa089fe64c tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:56:10 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:56:10 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:56:10 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Starting heal instance info cache {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 11:56:10 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Rebuilding the list of instances to heal {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 18 11:56:10 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 772b126c-2148-4ca8-90f2-69d6eb4b7db7] Skipping network cache update for instance because it is Building. {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 18 11:56:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-063babb8-556f-4ffb-9aa3-b2fa089fe64c tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.180s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:56:11 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-063babb8-556f-4ffb-9aa3-b2fa089fe64c tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Acquiring lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:56:11 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-063babb8-556f-4ffb-9aa3-b2fa089fe64c tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:56:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-063babb8-556f-4ffb-9aa3-b2fa089fe64c tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:56:11 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "refresh_cache-0209c824-88a7-4976-83bf-8a72437f0cc2" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:56:11 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquired lock "refresh_cache-0209c824-88a7-4976-83bf-8a72437f0cc2" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:56:11 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] Forcefully refreshing network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 18 11:56:11 user nova-compute[74190]: DEBUG nova.objects.instance [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lazy-loading 'info_cache' on Instance uuid 0209c824-88a7-4976-83bf-8a72437f0cc2 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:56:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-063babb8-556f-4ffb-9aa3-b2fa089fe64c tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.214s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:56:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-063babb8-556f-4ffb-9aa3-b2fa089fe64c tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f,backing_fmt=raw /opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/disk 1073741824 {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:56:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-063babb8-556f-4ffb-9aa3-b2fa089fe64c tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f,backing_fmt=raw /opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/disk 1073741824" returned: 0 in 0.069s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:56:11 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-063babb8-556f-4ffb-9aa3-b2fa089fe64c tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.290s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:56:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-063babb8-556f-4ffb-9aa3-b2fa089fe64c tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:56:11 user nova-compute[74190]: DEBUG nova.network.neutron [None req-063babb8-556f-4ffb-9aa3-b2fa089fe64c tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 772b126c-2148-4ca8-90f2-69d6eb4b7db7] Successfully created port: 5470a91d-fa0f-4018-afa9-8e0a604cfca3 {{(pid=74190) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 11:56:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-063babb8-556f-4ffb-9aa3-b2fa089fe64c tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.183s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:56:11 user nova-compute[74190]: DEBUG nova.virt.disk.api [None req-063babb8-556f-4ffb-9aa3-b2fa089fe64c tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Checking if we can resize image /opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/disk. size=1073741824 {{(pid=74190) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 18 11:56:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-063babb8-556f-4ffb-9aa3-b2fa089fe64c tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:56:11 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:56:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-063babb8-556f-4ffb-9aa3-b2fa089fe64c tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:56:11 user nova-compute[74190]: DEBUG nova.virt.disk.api [None req-063babb8-556f-4ffb-9aa3-b2fa089fe64c tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Cannot resize image /opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/disk to a smaller size. {{(pid=74190) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 18 11:56:11 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-063babb8-556f-4ffb-9aa3-b2fa089fe64c tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 772b126c-2148-4ca8-90f2-69d6eb4b7db7] Created local disks {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 11:56:11 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-063babb8-556f-4ffb-9aa3-b2fa089fe64c tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 772b126c-2148-4ca8-90f2-69d6eb4b7db7] Ensure instance console log exists: /opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/console.log {{(pid=74190) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 11:56:11 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-063babb8-556f-4ffb-9aa3-b2fa089fe64c tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:56:11 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-063babb8-556f-4ffb-9aa3-b2fa089fe64c tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:56:11 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-063babb8-556f-4ffb-9aa3-b2fa089fe64c tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:56:11 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] Updating instance_info_cache with network_info: [{"id": "5e4eb783-7e7c-4501-bf99-33472454f4ac", "address": "fa:16:3e:7e:d2:03", "network": {"id": "f5ab7da4-2b07-4465-9a89-a07eb053ba91", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1315695374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08cf52ce927443158aa731367f08bd57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e4eb783-7e", "ovs_interfaceid": "5e4eb783-7e7c-4501-bf99-33472454f4ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:56:11 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Releasing lock "refresh_cache-0209c824-88a7-4976-83bf-8a72437f0cc2" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:56:11 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] Updated the network info_cache for instance {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 18 11:56:11 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:56:12 user nova-compute[74190]: DEBUG nova.network.neutron [None req-063babb8-556f-4ffb-9aa3-b2fa089fe64c tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 772b126c-2148-4ca8-90f2-69d6eb4b7db7] Successfully updated port: 5470a91d-fa0f-4018-afa9-8e0a604cfca3 {{(pid=74190) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 11:56:12 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-063babb8-556f-4ffb-9aa3-b2fa089fe64c tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Acquiring lock "refresh_cache-772b126c-2148-4ca8-90f2-69d6eb4b7db7" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:56:12 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-063babb8-556f-4ffb-9aa3-b2fa089fe64c tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Acquired lock "refresh_cache-772b126c-2148-4ca8-90f2-69d6eb4b7db7" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:56:12 user nova-compute[74190]: DEBUG nova.network.neutron [None req-063babb8-556f-4ffb-9aa3-b2fa089fe64c tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 772b126c-2148-4ca8-90f2-69d6eb4b7db7] Building network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 11:56:12 user nova-compute[74190]: DEBUG nova.compute.manager [req-571d0f50-36f4-4db3-a9e3-b383a984b4ae req-b35fd3ce-d2ba-493c-807f-f46915034a7a service nova] [instance: 772b126c-2148-4ca8-90f2-69d6eb4b7db7] Received event network-changed-5470a91d-fa0f-4018-afa9-8e0a604cfca3 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:56:12 user nova-compute[74190]: DEBUG nova.compute.manager [req-571d0f50-36f4-4db3-a9e3-b383a984b4ae req-b35fd3ce-d2ba-493c-807f-f46915034a7a service nova] [instance: 772b126c-2148-4ca8-90f2-69d6eb4b7db7] Refreshing instance network info cache due to event network-changed-5470a91d-fa0f-4018-afa9-8e0a604cfca3. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 11:56:12 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-571d0f50-36f4-4db3-a9e3-b383a984b4ae req-b35fd3ce-d2ba-493c-807f-f46915034a7a service nova] Acquiring lock "refresh_cache-772b126c-2148-4ca8-90f2-69d6eb4b7db7" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:56:12 user nova-compute[74190]: DEBUG nova.network.neutron [None req-063babb8-556f-4ffb-9aa3-b2fa089fe64c tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 772b126c-2148-4ca8-90f2-69d6eb4b7db7] Instance cache missing network info. {{(pid=74190) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 11:56:12 user nova-compute[74190]: DEBUG nova.network.neutron [None req-063babb8-556f-4ffb-9aa3-b2fa089fe64c tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 772b126c-2148-4ca8-90f2-69d6eb4b7db7] Updating instance_info_cache with network_info: [{"id": "5470a91d-fa0f-4018-afa9-8e0a604cfca3", "address": "fa:16:3e:aa:5e:3e", "network": {"id": "c2dbbd24-f1d2-47a2-835f-0f9b24b585f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-920140900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d994366010142519ff367fa7ca77e61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5470a91d-fa", "ovs_interfaceid": "5470a91d-fa0f-4018-afa9-8e0a604cfca3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:56:12 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-063babb8-556f-4ffb-9aa3-b2fa089fe64c tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Releasing lock "refresh_cache-772b126c-2148-4ca8-90f2-69d6eb4b7db7" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:56:12 user nova-compute[74190]: DEBUG nova.compute.manager [None req-063babb8-556f-4ffb-9aa3-b2fa089fe64c tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 772b126c-2148-4ca8-90f2-69d6eb4b7db7] Instance network_info: |[{"id": "5470a91d-fa0f-4018-afa9-8e0a604cfca3", "address": "fa:16:3e:aa:5e:3e", "network": {"id": "c2dbbd24-f1d2-47a2-835f-0f9b24b585f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-920140900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d994366010142519ff367fa7ca77e61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5470a91d-fa", "ovs_interfaceid": "5470a91d-fa0f-4018-afa9-8e0a604cfca3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 11:56:12 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-571d0f50-36f4-4db3-a9e3-b383a984b4ae req-b35fd3ce-d2ba-493c-807f-f46915034a7a service nova] Acquired lock "refresh_cache-772b126c-2148-4ca8-90f2-69d6eb4b7db7" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:56:12 user nova-compute[74190]: DEBUG nova.network.neutron [req-571d0f50-36f4-4db3-a9e3-b383a984b4ae req-b35fd3ce-d2ba-493c-807f-f46915034a7a service nova] [instance: 772b126c-2148-4ca8-90f2-69d6eb4b7db7] Refreshing network info cache for port 5470a91d-fa0f-4018-afa9-8e0a604cfca3 {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 11:56:12 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-063babb8-556f-4ffb-9aa3-b2fa089fe64c tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 772b126c-2148-4ca8-90f2-69d6eb4b7db7] Start _get_guest_xml network_info=[{"id": "5470a91d-fa0f-4018-afa9-8e0a604cfca3", "address": "fa:16:3e:aa:5e:3e", "network": {"id": "c2dbbd24-f1d2-47a2-835f-0f9b24b585f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-920140900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d994366010142519ff367fa7ca77e61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5470a91d-fa", "ovs_interfaceid": "5470a91d-fa0f-4018-afa9-8e0a604cfca3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'image_id': '6e88bbf0-6e78-49a8-b3c5-9453d22a89df'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 11:56:12 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-063babb8-556f-4ffb-9aa3-b2fa089fe64c tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:56:12 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-063babb8-556f-4ffb-9aa3-b2fa089fe64c tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:56:12 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-063babb8-556f-4ffb-9aa3-b2fa089fe64c tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 11:56:12 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-063babb8-556f-4ffb-9aa3-b2fa089fe64c tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] CPU controller missing on host. {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 11:56:12 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-063babb8-556f-4ffb-9aa3-b2fa089fe64c tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 11:56:12 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-063babb8-556f-4ffb-9aa3-b2fa089fe64c tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] CPU controller found on host. {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 11:56:12 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-063babb8-556f-4ffb-9aa3-b2fa089fe64c tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74190) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 11:56:12 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-063babb8-556f-4ffb-9aa3-b2fa089fe64c tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T11:37:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 11:56:12 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-063babb8-556f-4ffb-9aa3-b2fa089fe64c tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Flavor limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 11:56:12 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-063babb8-556f-4ffb-9aa3-b2fa089fe64c tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Image limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 11:56:12 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-063babb8-556f-4ffb-9aa3-b2fa089fe64c tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Flavor pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 11:56:12 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-063babb8-556f-4ffb-9aa3-b2fa089fe64c tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Image pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 11:56:12 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-063babb8-556f-4ffb-9aa3-b2fa089fe64c tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 11:56:12 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-063babb8-556f-4ffb-9aa3-b2fa089fe64c tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 11:56:12 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-063babb8-556f-4ffb-9aa3-b2fa089fe64c tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 11:56:12 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-063babb8-556f-4ffb-9aa3-b2fa089fe64c tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Got 1 possible topologies {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 11:56:12 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-063babb8-556f-4ffb-9aa3-b2fa089fe64c tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 11:56:12 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-063babb8-556f-4ffb-9aa3-b2fa089fe64c tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 11:56:13 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-063babb8-556f-4ffb-9aa3-b2fa089fe64c tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:56:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-836086720',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-836086720',id=29,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d994366010142519ff367fa7ca77e61',ramdisk_id='',reservation_id='r-zepk67v0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1815510380',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:56:11Z,user_data=None,user_id='7fa675b6803f4e21b090295b51fb9ceb',uuid=772b126c-2148-4ca8-90f2-69d6eb4b7db7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5470a91d-fa0f-4018-afa9-8e0a604cfca3", "address": "fa:16:3e:aa:5e:3e", "network": {"id": "c2dbbd24-f1d2-47a2-835f-0f9b24b585f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-920140900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d994366010142519ff367fa7ca77e61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5470a91d-fa", "ovs_interfaceid": "5470a91d-fa0f-4018-afa9-8e0a604cfca3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74190) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 11:56:13 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-063babb8-556f-4ffb-9aa3-b2fa089fe64c tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Converting VIF {"id": "5470a91d-fa0f-4018-afa9-8e0a604cfca3", "address": "fa:16:3e:aa:5e:3e", "network": {"id": "c2dbbd24-f1d2-47a2-835f-0f9b24b585f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-920140900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d994366010142519ff367fa7ca77e61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5470a91d-fa", "ovs_interfaceid": "5470a91d-fa0f-4018-afa9-8e0a604cfca3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:56:13 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-063babb8-556f-4ffb-9aa3-b2fa089fe64c tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:5e:3e,bridge_name='br-int',has_traffic_filtering=True,id=5470a91d-fa0f-4018-afa9-8e0a604cfca3,network=Network(c2dbbd24-f1d2-47a2-835f-0f9b24b585f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5470a91d-fa') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:56:13 user nova-compute[74190]: DEBUG nova.objects.instance [None req-063babb8-556f-4ffb-9aa3-b2fa089fe64c tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lazy-loading 'pci_devices' on Instance uuid 772b126c-2148-4ca8-90f2-69d6eb4b7db7 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:56:13 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-063babb8-556f-4ffb-9aa3-b2fa089fe64c tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 772b126c-2148-4ca8-90f2-69d6eb4b7db7] End _get_guest_xml xml=<domain type="kvm">
Oct 18 11:56:13 user nova-compute[74190]:   <uuid>772b126c-2148-4ca8-90f2-69d6eb4b7db7</uuid>
Oct 18 11:56:13 user nova-compute[74190]:   <name>instance-0000001d</name>
Oct 18 11:56:13 user nova-compute[74190]:   <memory>524288</memory>
Oct 18 11:56:13 user nova-compute[74190]:   <vcpu>1</vcpu>
Oct 18 11:56:13 user nova-compute[74190]:   <metadata>
Oct 18 11:56:13 user nova-compute[74190]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 11:56:13 user nova-compute[74190]:       <nova:package version="0.0.0"/>
Oct 18 11:56:13 user nova-compute[74190]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-836086720</nova:name>
Oct 18 11:56:13 user nova-compute[74190]:       <nova:creationTime>2023-10-18 11:56:12</nova:creationTime>
Oct 18 11:56:13 user nova-compute[74190]:       <nova:flavor name="m1.tiny">
Oct 18 11:56:13 user nova-compute[74190]:         <nova:memory>512</nova:memory>
Oct 18 11:56:13 user nova-compute[74190]:         <nova:disk>1</nova:disk>
Oct 18 11:56:13 user nova-compute[74190]:         <nova:swap>0</nova:swap>
Oct 18 11:56:13 user nova-compute[74190]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 11:56:13 user nova-compute[74190]:         <nova:vcpus>1</nova:vcpus>
Oct 18 11:56:13 user nova-compute[74190]:       </nova:flavor>
Oct 18 11:56:13 user nova-compute[74190]:       <nova:owner>
Oct 18 11:56:13 user nova-compute[74190]:         <nova:user uuid="7fa675b6803f4e21b090295b51fb9ceb">tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member</nova:user>
Oct 18 11:56:13 user nova-compute[74190]:         <nova:project uuid="6d994366010142519ff367fa7ca77e61">tempest-ServerBootFromVolumeStableRescueTest-1815510380</nova:project>
Oct 18 11:56:13 user nova-compute[74190]:       </nova:owner>
Oct 18 11:56:13 user nova-compute[74190]:       <nova:root type="image" uuid="6e88bbf0-6e78-49a8-b3c5-9453d22a89df"/>
Oct 18 11:56:13 user nova-compute[74190]:       <nova:ports>
Oct 18 11:56:13 user nova-compute[74190]:         <nova:port uuid="5470a91d-fa0f-4018-afa9-8e0a604cfca3">
Oct 18 11:56:13 user nova-compute[74190]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 18 11:56:13 user nova-compute[74190]:         </nova:port>
Oct 18 11:56:13 user nova-compute[74190]:       </nova:ports>
Oct 18 11:56:13 user nova-compute[74190]:     </nova:instance>
Oct 18 11:56:13 user nova-compute[74190]:   </metadata>
Oct 18 11:56:13 user nova-compute[74190]:   <sysinfo type="smbios">
Oct 18 11:56:13 user nova-compute[74190]:     <system>
Oct 18 11:56:13 user nova-compute[74190]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 11:56:13 user nova-compute[74190]:       <entry name="product">OpenStack Nova</entry>
Oct 18 11:56:13 user nova-compute[74190]:       <entry name="version">0.0.0</entry>
Oct 18 11:56:13 user nova-compute[74190]:       <entry name="serial">772b126c-2148-4ca8-90f2-69d6eb4b7db7</entry>
Oct 18 11:56:13 user nova-compute[74190]:       <entry name="uuid">772b126c-2148-4ca8-90f2-69d6eb4b7db7</entry>
Oct 18 11:56:13 user nova-compute[74190]:       <entry name="family">Virtual Machine</entry>
Oct 18 11:56:13 user nova-compute[74190]:     </system>
Oct 18 11:56:13 user nova-compute[74190]:   </sysinfo>
Oct 18 11:56:13 user nova-compute[74190]:   <os>
Oct 18 11:56:13 user nova-compute[74190]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 11:56:13 user nova-compute[74190]:     <boot dev="hd"/>
Oct 18 11:56:13 user nova-compute[74190]:     <smbios mode="sysinfo"/>
Oct 18 11:56:13 user nova-compute[74190]:   </os>
Oct 18 11:56:13 user nova-compute[74190]:   <features>
Oct 18 11:56:13 user nova-compute[74190]:     <acpi/>
Oct 18 11:56:13 user nova-compute[74190]:     <apic/>
Oct 18 11:56:13 user nova-compute[74190]:     <vmcoreinfo/>
Oct 18 11:56:13 user nova-compute[74190]:   </features>
Oct 18 11:56:13 user nova-compute[74190]:   <clock offset="utc">
Oct 18 11:56:13 user nova-compute[74190]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 11:56:13 user nova-compute[74190]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 11:56:13 user nova-compute[74190]:     <timer name="hpet" present="no"/>
Oct 18 11:56:13 user nova-compute[74190]:   </clock>
Oct 18 11:56:13 user nova-compute[74190]:   <cpu mode="custom" match="exact">
Oct 18 11:56:13 user nova-compute[74190]:     <model>Nehalem</model>
Oct 18 11:56:13 user nova-compute[74190]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 11:56:13 user nova-compute[74190]:   </cpu>
Oct 18 11:56:13 user nova-compute[74190]:   <devices>
Oct 18 11:56:13 user nova-compute[74190]:     <disk type="file" device="disk">
Oct 18 11:56:13 user nova-compute[74190]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 11:56:13 user nova-compute[74190]:       <source file="/opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/disk"/>
Oct 18 11:56:13 user nova-compute[74190]:       <target dev="vda" bus="virtio"/>
Oct 18 11:56:13 user nova-compute[74190]:     </disk>
Oct 18 11:56:13 user nova-compute[74190]:     <interface type="ethernet">
Oct 18 11:56:13 user nova-compute[74190]:       <mac address="fa:16:3e:aa:5e:3e"/>
Oct 18 11:56:13 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:56:13 user nova-compute[74190]:       <mtu size="1442"/>
Oct 18 11:56:13 user nova-compute[74190]:       <target dev="tap5470a91d-fa"/>
Oct 18 11:56:13 user nova-compute[74190]:     </interface>
Oct 18 11:56:13 user nova-compute[74190]:     <serial type="pty">
Oct 18 11:56:13 user nova-compute[74190]:       <log file="/opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/console.log" append="off"/>
Oct 18 11:56:13 user nova-compute[74190]:     </serial>
Oct 18 11:56:13 user nova-compute[74190]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 11:56:13 user nova-compute[74190]:     <video>
Oct 18 11:56:13 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:56:13 user nova-compute[74190]:     </video>
Oct 18 11:56:13 user nova-compute[74190]:     <rng model="virtio">
Oct 18 11:56:13 user nova-compute[74190]:       <backend model="random">/dev/urandom</backend>
Oct 18 11:56:13 user nova-compute[74190]:     </rng>
Oct 18 11:56:13 user nova-compute[74190]:     <controller type="usb" index="0" model="none"/>
Oct 18 11:56:13 user nova-compute[74190]:     <memballoon model="virtio">
Oct 18 11:56:13 user nova-compute[74190]:       <stats period="10"/>
Oct 18 11:56:13 user nova-compute[74190]:     </memballoon>
Oct 18 11:56:13 user nova-compute[74190]:   </devices>
Oct 18 11:56:13 user nova-compute[74190]: </domain>
Oct 18 11:56:13 user nova-compute[74190]:  {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 11:56:13 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-063babb8-556f-4ffb-9aa3-b2fa089fe64c tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:56:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-836086720',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-836086720',id=29,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d994366010142519ff367fa7ca77e61',ramdisk_id='',reservation_id='r-zepk67v0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1815510380',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:56:11Z,user_data=None,user_id='7fa675b6803f4e21b090295b51fb9ceb',uuid=772b126c-2148-4ca8-90f2-69d6eb4b7db7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5470a91d-fa0f-4018-afa9-8e0a604cfca3", "address": "fa:16:3e:aa:5e:3e", "network": {"id": "c2dbbd24-f1d2-47a2-835f-0f9b24b585f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-920140900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d994366010142519ff367fa7ca77e61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5470a91d-fa", "ovs_interfaceid": "5470a91d-fa0f-4018-afa9-8e0a604cfca3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 11:56:13 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-063babb8-556f-4ffb-9aa3-b2fa089fe64c tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Converting VIF {"id": "5470a91d-fa0f-4018-afa9-8e0a604cfca3", "address": "fa:16:3e:aa:5e:3e", "network": {"id": "c2dbbd24-f1d2-47a2-835f-0f9b24b585f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-920140900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d994366010142519ff367fa7ca77e61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5470a91d-fa", "ovs_interfaceid": "5470a91d-fa0f-4018-afa9-8e0a604cfca3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:56:13 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-063babb8-556f-4ffb-9aa3-b2fa089fe64c tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:5e:3e,bridge_name='br-int',has_traffic_filtering=True,id=5470a91d-fa0f-4018-afa9-8e0a604cfca3,network=Network(c2dbbd24-f1d2-47a2-835f-0f9b24b585f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5470a91d-fa') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:56:13 user nova-compute[74190]: DEBUG os_vif [None req-063babb8-556f-4ffb-9aa3-b2fa089fe64c tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:5e:3e,bridge_name='br-int',has_traffic_filtering=True,id=5470a91d-fa0f-4018-afa9-8e0a604cfca3,network=Network(c2dbbd24-f1d2-47a2-835f-0f9b24b585f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5470a91d-fa') {{(pid=74190) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 11:56:13 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:56:13 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:56:13 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 11:56:13 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:56:13 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1deb14aa-89bd-5969-b92c-372cc1077e3f', '_type': 'linux-noop'}}, row=False) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:56:13 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:56:13 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:56:13 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:56:13 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5470a91d-fa, may_exist=True, interface_attrs={}) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:56:13 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5470a91d-fa, col_values=(('qos', UUID('76023a74-879f-488c-9b81-e0cdd877a707')),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:56:13 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5470a91d-fa, col_values=(('external_ids', {'iface-id': '5470a91d-fa0f-4018-afa9-8e0a604cfca3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:aa:5e:3e', 'vm-uuid': '772b126c-2148-4ca8-90f2-69d6eb4b7db7'}),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:56:13 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:56:13 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:56:13 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:56:13 user nova-compute[74190]: INFO os_vif [None req-063babb8-556f-4ffb-9aa3-b2fa089fe64c tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:5e:3e,bridge_name='br-int',has_traffic_filtering=True,id=5470a91d-fa0f-4018-afa9-8e0a604cfca3,network=Network(c2dbbd24-f1d2-47a2-835f-0f9b24b585f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5470a91d-fa')
Oct 18 11:56:13 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-063babb8-556f-4ffb-9aa3-b2fa089fe64c tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] No BDM found with device name vda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 11:56:13 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-063babb8-556f-4ffb-9aa3-b2fa089fe64c tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] No VIF found with MAC fa:16:3e:aa:5e:3e, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 11:56:13 user nova-compute[74190]: DEBUG nova.network.neutron [req-571d0f50-36f4-4db3-a9e3-b383a984b4ae req-b35fd3ce-d2ba-493c-807f-f46915034a7a service nova] [instance: 772b126c-2148-4ca8-90f2-69d6eb4b7db7] Updated VIF entry in instance network info cache for port 5470a91d-fa0f-4018-afa9-8e0a604cfca3. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 11:56:13 user nova-compute[74190]: DEBUG nova.network.neutron [req-571d0f50-36f4-4db3-a9e3-b383a984b4ae req-b35fd3ce-d2ba-493c-807f-f46915034a7a service nova] [instance: 772b126c-2148-4ca8-90f2-69d6eb4b7db7] Updating instance_info_cache with network_info: [{"id": "5470a91d-fa0f-4018-afa9-8e0a604cfca3", "address": "fa:16:3e:aa:5e:3e", "network": {"id": "c2dbbd24-f1d2-47a2-835f-0f9b24b585f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-920140900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d994366010142519ff367fa7ca77e61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5470a91d-fa", "ovs_interfaceid": "5470a91d-fa0f-4018-afa9-8e0a604cfca3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:56:13 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-571d0f50-36f4-4db3-a9e3-b383a984b4ae req-b35fd3ce-d2ba-493c-807f-f46915034a7a service nova] Releasing lock "refresh_cache-772b126c-2148-4ca8-90f2-69d6eb4b7db7" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:56:14 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:56:14 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:56:14 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:56:14 user nova-compute[74190]: DEBUG nova.compute.manager [req-88f50e2a-a3a9-468e-a22e-1cad63623d0a req-4a820ca8-449c-4128-b19b-43e11ce0609e service nova] [instance: 772b126c-2148-4ca8-90f2-69d6eb4b7db7] Received event network-vif-plugged-5470a91d-fa0f-4018-afa9-8e0a604cfca3 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:56:14 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-88f50e2a-a3a9-468e-a22e-1cad63623d0a req-4a820ca8-449c-4128-b19b-43e11ce0609e service nova] Acquiring lock "772b126c-2148-4ca8-90f2-69d6eb4b7db7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:56:14 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-88f50e2a-a3a9-468e-a22e-1cad63623d0a req-4a820ca8-449c-4128-b19b-43e11ce0609e service nova] Lock "772b126c-2148-4ca8-90f2-69d6eb4b7db7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:56:14 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-88f50e2a-a3a9-468e-a22e-1cad63623d0a req-4a820ca8-449c-4128-b19b-43e11ce0609e service nova] Lock "772b126c-2148-4ca8-90f2-69d6eb4b7db7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:56:14 user nova-compute[74190]: DEBUG nova.compute.manager [req-88f50e2a-a3a9-468e-a22e-1cad63623d0a req-4a820ca8-449c-4128-b19b-43e11ce0609e service nova] [instance: 772b126c-2148-4ca8-90f2-69d6eb4b7db7] No waiting events found dispatching network-vif-plugged-5470a91d-fa0f-4018-afa9-8e0a604cfca3 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:56:14 user nova-compute[74190]: WARNING nova.compute.manager [req-88f50e2a-a3a9-468e-a22e-1cad63623d0a req-4a820ca8-449c-4128-b19b-43e11ce0609e service nova] [instance: 772b126c-2148-4ca8-90f2-69d6eb4b7db7] Received unexpected event network-vif-plugged-5470a91d-fa0f-4018-afa9-8e0a604cfca3 for instance with vm_state building and task_state spawning.
Oct 18 11:56:14 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:56:15 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:56:15 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:56:15 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:56:16 user nova-compute[74190]: DEBUG nova.compute.manager [None req-063babb8-556f-4ffb-9aa3-b2fa089fe64c tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 772b126c-2148-4ca8-90f2-69d6eb4b7db7] Instance event wait completed in 0 seconds for  {{(pid=74190) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 11:56:16 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-063babb8-556f-4ffb-9aa3-b2fa089fe64c tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 772b126c-2148-4ca8-90f2-69d6eb4b7db7] Guest created on hypervisor {{(pid=74190) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 11:56:16 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 772b126c-2148-4ca8-90f2-69d6eb4b7db7] Instance spawned successfully.
Oct 18 11:56:16 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-063babb8-556f-4ffb-9aa3-b2fa089fe64c tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 772b126c-2148-4ca8-90f2-69d6eb4b7db7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 11:56:16 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-063babb8-556f-4ffb-9aa3-b2fa089fe64c tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 772b126c-2148-4ca8-90f2-69d6eb4b7db7] Found default for hw_cdrom_bus of ide {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:56:16 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-063babb8-556f-4ffb-9aa3-b2fa089fe64c tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 772b126c-2148-4ca8-90f2-69d6eb4b7db7] Found default for hw_disk_bus of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:56:16 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-063babb8-556f-4ffb-9aa3-b2fa089fe64c tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 772b126c-2148-4ca8-90f2-69d6eb4b7db7] Found default for hw_input_bus of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:56:16 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-063babb8-556f-4ffb-9aa3-b2fa089fe64c tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 772b126c-2148-4ca8-90f2-69d6eb4b7db7] Found default for hw_pointer_model of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:56:16 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-063babb8-556f-4ffb-9aa3-b2fa089fe64c tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 772b126c-2148-4ca8-90f2-69d6eb4b7db7] Found default for hw_video_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:56:16 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-063babb8-556f-4ffb-9aa3-b2fa089fe64c tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 772b126c-2148-4ca8-90f2-69d6eb4b7db7] Found default for hw_vif_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:56:16 user nova-compute[74190]: DEBUG nova.compute.manager [req-3561ae6c-090e-45be-a988-99c622e5e62d req-560831a7-3d25-40c1-a61e-58cb52641d2e service nova] [instance: 772b126c-2148-4ca8-90f2-69d6eb4b7db7] Received event network-vif-plugged-5470a91d-fa0f-4018-afa9-8e0a604cfca3 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:56:16 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-3561ae6c-090e-45be-a988-99c622e5e62d req-560831a7-3d25-40c1-a61e-58cb52641d2e service nova] Acquiring lock "772b126c-2148-4ca8-90f2-69d6eb4b7db7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:56:16 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-3561ae6c-090e-45be-a988-99c622e5e62d req-560831a7-3d25-40c1-a61e-58cb52641d2e service nova] Lock "772b126c-2148-4ca8-90f2-69d6eb4b7db7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:56:16 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-3561ae6c-090e-45be-a988-99c622e5e62d req-560831a7-3d25-40c1-a61e-58cb52641d2e service nova] Lock "772b126c-2148-4ca8-90f2-69d6eb4b7db7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:56:16 user nova-compute[74190]: DEBUG nova.compute.manager [req-3561ae6c-090e-45be-a988-99c622e5e62d req-560831a7-3d25-40c1-a61e-58cb52641d2e service nova] [instance: 772b126c-2148-4ca8-90f2-69d6eb4b7db7] No waiting events found dispatching network-vif-plugged-5470a91d-fa0f-4018-afa9-8e0a604cfca3 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:56:16 user nova-compute[74190]: WARNING nova.compute.manager [req-3561ae6c-090e-45be-a988-99c622e5e62d req-560831a7-3d25-40c1-a61e-58cb52641d2e service nova] [instance: 772b126c-2148-4ca8-90f2-69d6eb4b7db7] Received unexpected event network-vif-plugged-5470a91d-fa0f-4018-afa9-8e0a604cfca3 for instance with vm_state building and task_state spawning.
Oct 18 11:56:16 user nova-compute[74190]: INFO nova.compute.manager [None req-063babb8-556f-4ffb-9aa3-b2fa089fe64c tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 772b126c-2148-4ca8-90f2-69d6eb4b7db7] Took 5.96 seconds to spawn the instance on the hypervisor.
Oct 18 11:56:16 user nova-compute[74190]: DEBUG nova.compute.manager [None req-063babb8-556f-4ffb-9aa3-b2fa089fe64c tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 772b126c-2148-4ca8-90f2-69d6eb4b7db7] Checking state {{(pid=74190) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 11:56:16 user nova-compute[74190]: INFO nova.compute.manager [None req-063babb8-556f-4ffb-9aa3-b2fa089fe64c tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 772b126c-2148-4ca8-90f2-69d6eb4b7db7] Took 6.80 seconds to build instance.
Oct 18 11:56:16 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-063babb8-556f-4ffb-9aa3-b2fa089fe64c tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lock "772b126c-2148-4ca8-90f2-69d6eb4b7db7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.908s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:56:18 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:56:19 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:56:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:56:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:56:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:56:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:56:33 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:56:34 user nova-compute[74190]: DEBUG nova.compute.manager [req-bd9661ca-3834-4b71-834d-080afbfb1dec req-7ea6415c-9ce2-4c8e-9065-ef602a328634 service nova] [instance: 31a86ab2-d72d-4274-b5a6-84c5c4bdfc01] Received event network-changed-5c59d9a0-1a31-4096-a5aa-ca1e4f46d0fc {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:56:34 user nova-compute[74190]: DEBUG nova.compute.manager [req-bd9661ca-3834-4b71-834d-080afbfb1dec req-7ea6415c-9ce2-4c8e-9065-ef602a328634 service nova] [instance: 31a86ab2-d72d-4274-b5a6-84c5c4bdfc01] Refreshing instance network info cache due to event network-changed-5c59d9a0-1a31-4096-a5aa-ca1e4f46d0fc. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 11:56:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-bd9661ca-3834-4b71-834d-080afbfb1dec req-7ea6415c-9ce2-4c8e-9065-ef602a328634 service nova] Acquiring lock "refresh_cache-31a86ab2-d72d-4274-b5a6-84c5c4bdfc01" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:56:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-bd9661ca-3834-4b71-834d-080afbfb1dec req-7ea6415c-9ce2-4c8e-9065-ef602a328634 service nova] Acquired lock "refresh_cache-31a86ab2-d72d-4274-b5a6-84c5c4bdfc01" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:56:34 user nova-compute[74190]: DEBUG nova.network.neutron [req-bd9661ca-3834-4b71-834d-080afbfb1dec req-7ea6415c-9ce2-4c8e-9065-ef602a328634 service nova] [instance: 31a86ab2-d72d-4274-b5a6-84c5c4bdfc01] Refreshing network info cache for port 5c59d9a0-1a31-4096-a5aa-ca1e4f46d0fc {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 11:56:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:56:35 user nova-compute[74190]: DEBUG nova.network.neutron [req-bd9661ca-3834-4b71-834d-080afbfb1dec req-7ea6415c-9ce2-4c8e-9065-ef602a328634 service nova] [instance: 31a86ab2-d72d-4274-b5a6-84c5c4bdfc01] Updated VIF entry in instance network info cache for port 5c59d9a0-1a31-4096-a5aa-ca1e4f46d0fc. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 11:56:35 user nova-compute[74190]: DEBUG nova.network.neutron [req-bd9661ca-3834-4b71-834d-080afbfb1dec req-7ea6415c-9ce2-4c8e-9065-ef602a328634 service nova] [instance: 31a86ab2-d72d-4274-b5a6-84c5c4bdfc01] Updating instance_info_cache with network_info: [{"id": "5c59d9a0-1a31-4096-a5aa-ca1e4f46d0fc", "address": "fa:16:3e:25:cc:e5", "network": {"id": "0a2d5316-a012-43d3-a7c7-54b8cff14dca", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1175284376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c49002c1f5044a13b4c70aa5cc9bf45e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c59d9a0-1a", "ovs_interfaceid": "5c59d9a0-1a31-4096-a5aa-ca1e4f46d0fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:56:35 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-bd9661ca-3834-4b71-834d-080afbfb1dec req-7ea6415c-9ce2-4c8e-9065-ef602a328634 service nova] Releasing lock "refresh_cache-31a86ab2-d72d-4274-b5a6-84c5c4bdfc01" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:56:38 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:56:39 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:56:39 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:56:40 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-bc14f635-6dcb-47b6-8f83-b46a6a4a67d3 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Acquiring lock "31a86ab2-d72d-4274-b5a6-84c5c4bdfc01" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:56:40 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-bc14f635-6dcb-47b6-8f83-b46a6a4a67d3 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Lock "31a86ab2-d72d-4274-b5a6-84c5c4bdfc01" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:56:40 user nova-compute[74190]: DEBUG nova.objects.instance [None req-bc14f635-6dcb-47b6-8f83-b46a6a4a67d3 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Lazy-loading 'flavor' on Instance uuid 31a86ab2-d72d-4274-b5a6-84c5c4bdfc01 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:56:40 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-bc14f635-6dcb-47b6-8f83-b46a6a4a67d3 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Lock "31a86ab2-d72d-4274-b5a6-84c5c4bdfc01" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:56:40 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-bc14f635-6dcb-47b6-8f83-b46a6a4a67d3 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Acquiring lock "31a86ab2-d72d-4274-b5a6-84c5c4bdfc01" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:56:40 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-bc14f635-6dcb-47b6-8f83-b46a6a4a67d3 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Lock "31a86ab2-d72d-4274-b5a6-84c5c4bdfc01" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:56:40 user nova-compute[74190]: INFO nova.compute.manager [None req-bc14f635-6dcb-47b6-8f83-b46a6a4a67d3 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] [instance: 31a86ab2-d72d-4274-b5a6-84c5c4bdfc01] Attaching volume 514bbf1e-63ad-4d0b-aa66-419f112e5555 to /dev/vdb
Oct 18 11:56:40 user nova-compute[74190]: DEBUG os_brick.utils [None req-bc14f635-6dcb-47b6-8f83-b46a6a4a67d3 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:56:40 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:56:40 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:56:40 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb3524a1-229d-4e28-b817-38aef012f195]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cff158e257e1\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:56:40 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:56:40 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:56:40 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca6884e-c197-4f09-9121-90da18a446b9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:56:40 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:56:40 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:56:40 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ccb0bf0-493d-4ebd-b0fd-4b5bc84d40f2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:56:40 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ff72ac-22a6-4b6c-8f1c-2d743924682a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:56:40 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-bc14f635-6dcb-47b6-8f83-b46a6a4a67d3 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Running cmd (subprocess): nvme version {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:56:40 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-bc14f635-6dcb-47b6-8f83-b46a6a4a67d3 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] 'nvme version' failed. Not Retrying. {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 11:56:40 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bc14f635-6dcb-47b6-8f83-b46a6a4a67d3 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] nvme not present on system {{(pid=74190) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 11:56:40 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:56:40 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 11:56:40 user nova-compute[74190]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 11:56:40 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee16cf4-6b45-421d-b70b-4f10fdc81281]: (4, '') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:56:40 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-bc14f635-6dcb-47b6-8f83-b46a6a4a67d3 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74190) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 11:56:40 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-bc14f635-6dcb-47b6-8f83-b46a6a4a67d3 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 11:56:40 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-bc14f635-6dcb-47b6-8f83-b46a6a4a67d3 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] LIGHTOS: no hostnqn found. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 11:56:40 user nova-compute[74190]: DEBUG os_brick.utils [None req-bc14f635-6dcb-47b6-8f83-b46a6a4a67d3 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cff158e257e1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:56:40 user nova-compute[74190]: DEBUG nova.virt.block_device [None req-bc14f635-6dcb-47b6-8f83-b46a6a4a67d3 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] [instance: 31a86ab2-d72d-4274-b5a6-84c5c4bdfc01] Updating existing volume attachment record: 0195332c-e520-46bc-aa7a-a27e982d8ecf {{(pid=74190) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 11:56:43 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:56:44 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-5edcfbc9-4305-4037-b59e-8dae6299f067 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Acquiring lock "a9012673-826b-4be7-a55b-9bb35a227c17" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:56:44 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-5edcfbc9-4305-4037-b59e-8dae6299f067 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lock "a9012673-826b-4be7-a55b-9bb35a227c17" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:56:44 user nova-compute[74190]: DEBUG nova.compute.manager [None req-5edcfbc9-4305-4037-b59e-8dae6299f067 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Going to confirm migration 2 {{(pid=74190) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4773}}
Oct 18 11:56:44 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-5edcfbc9-4305-4037-b59e-8dae6299f067 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Acquiring lock "refresh_cache-a9012673-826b-4be7-a55b-9bb35a227c17" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:56:44 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-5edcfbc9-4305-4037-b59e-8dae6299f067 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Acquired lock "refresh_cache-a9012673-826b-4be7-a55b-9bb35a227c17" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:56:44 user nova-compute[74190]: DEBUG nova.network.neutron [None req-5edcfbc9-4305-4037-b59e-8dae6299f067 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Building network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 11:56:44 user nova-compute[74190]: DEBUG nova.objects.instance [None req-5edcfbc9-4305-4037-b59e-8dae6299f067 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lazy-loading 'info_cache' on Instance uuid a9012673-826b-4be7-a55b-9bb35a227c17 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:56:44 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:56:45 user nova-compute[74190]: DEBUG nova.network.neutron [None req-5edcfbc9-4305-4037-b59e-8dae6299f067 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Updating instance_info_cache with network_info: [{"id": "98016144-4b95-4e94-8ae4-581089fe4f63", "address": "fa:16:3e:ea:1d:55", "network": {"id": "f5ab7da4-2b07-4465-9a89-a07eb053ba91", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1315695374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08cf52ce927443158aa731367f08bd57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98016144-4b", "ovs_interfaceid": "98016144-4b95-4e94-8ae4-581089fe4f63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:56:45 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-5edcfbc9-4305-4037-b59e-8dae6299f067 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Releasing lock "refresh_cache-a9012673-826b-4be7-a55b-9bb35a227c17" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:56:45 user nova-compute[74190]: DEBUG nova.objects.instance [None req-5edcfbc9-4305-4037-b59e-8dae6299f067 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lazy-loading 'migration_context' on Instance uuid a9012673-826b-4be7-a55b-9bb35a227c17 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:56:45 user nova-compute[74190]: DEBUG nova.objects.base [None req-5edcfbc9-4305-4037-b59e-8dae6299f067 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Object Instance<a9012673-826b-4be7-a55b-9bb35a227c17> lazy-loaded attributes: info_cache,migration_context {{(pid=74190) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 11:56:45 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-5edcfbc9-4305-4037-b59e-8dae6299f067 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:56:45 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-5edcfbc9-4305-4037-b59e-8dae6299f067 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:56:45 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-5edcfbc9-4305-4037-b59e-8dae6299f067 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 11:56:45 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-5edcfbc9-4305-4037-b59e-8dae6299f067 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 11:56:45 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-5edcfbc9-4305-4037-b59e-8dae6299f067 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.472s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:56:46 user nova-compute[74190]: INFO nova.scheduler.client.report [None req-5edcfbc9-4305-4037-b59e-8dae6299f067 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Deleted allocation for migration 721bcb36-1ad7-4025-baa0-50a8a0705c76
Oct 18 11:56:46 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-5edcfbc9-4305-4037-b59e-8dae6299f067 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lock "a9012673-826b-4be7-a55b-9bb35a227c17" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.512s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:56:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:56:49 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:56:50 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:56:50 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Cleaning up deleted instances {{(pid=74190) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 18 11:56:50 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] There are 0 instances to clean {{(pid=74190) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 18 11:56:50 user nova-compute[74190]: DEBUG nova.compute.manager [req-e1966f72-ef4a-4ddb-95b2-a9275b9c3d22 req-e0f53bbd-3832-424b-b6e8-ea56e632a186 service nova] [instance: 7eaf6c32-1860-4732-9e50-3a8e04b95be8] Received event network-changed-b7a4aa3c-47ee-4696-bd4b-abef2654f2ab {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:56:50 user nova-compute[74190]: DEBUG nova.compute.manager [req-e1966f72-ef4a-4ddb-95b2-a9275b9c3d22 req-e0f53bbd-3832-424b-b6e8-ea56e632a186 service nova] [instance: 7eaf6c32-1860-4732-9e50-3a8e04b95be8] Refreshing instance network info cache due to event network-changed-b7a4aa3c-47ee-4696-bd4b-abef2654f2ab. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 11:56:50 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-e1966f72-ef4a-4ddb-95b2-a9275b9c3d22 req-e0f53bbd-3832-424b-b6e8-ea56e632a186 service nova] Acquiring lock "refresh_cache-7eaf6c32-1860-4732-9e50-3a8e04b95be8" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:56:50 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-e1966f72-ef4a-4ddb-95b2-a9275b9c3d22 req-e0f53bbd-3832-424b-b6e8-ea56e632a186 service nova] Acquired lock "refresh_cache-7eaf6c32-1860-4732-9e50-3a8e04b95be8" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:56:50 user nova-compute[74190]: DEBUG nova.network.neutron [req-e1966f72-ef4a-4ddb-95b2-a9275b9c3d22 req-e0f53bbd-3832-424b-b6e8-ea56e632a186 service nova] [instance: 7eaf6c32-1860-4732-9e50-3a8e04b95be8] Refreshing network info cache for port b7a4aa3c-47ee-4696-bd4b-abef2654f2ab {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 11:56:51 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-11951b92-0139-44a7-8078-29f7d2974b85 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Acquiring lock "7eaf6c32-1860-4732-9e50-3a8e04b95be8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:56:51 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-11951b92-0139-44a7-8078-29f7d2974b85 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "7eaf6c32-1860-4732-9e50-3a8e04b95be8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:56:51 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-11951b92-0139-44a7-8078-29f7d2974b85 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Acquiring lock "7eaf6c32-1860-4732-9e50-3a8e04b95be8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:56:51 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-11951b92-0139-44a7-8078-29f7d2974b85 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "7eaf6c32-1860-4732-9e50-3a8e04b95be8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:56:51 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-11951b92-0139-44a7-8078-29f7d2974b85 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "7eaf6c32-1860-4732-9e50-3a8e04b95be8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:56:51 user nova-compute[74190]: INFO nova.compute.manager [None req-11951b92-0139-44a7-8078-29f7d2974b85 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: 7eaf6c32-1860-4732-9e50-3a8e04b95be8] Terminating instance
Oct 18 11:56:51 user nova-compute[74190]: DEBUG nova.compute.manager [None req-11951b92-0139-44a7-8078-29f7d2974b85 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: 7eaf6c32-1860-4732-9e50-3a8e04b95be8] Start destroying the instance on the hypervisor. {{(pid=74190) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 11:56:51 user nova-compute[74190]: DEBUG nova.network.neutron [req-e1966f72-ef4a-4ddb-95b2-a9275b9c3d22 req-e0f53bbd-3832-424b-b6e8-ea56e632a186 service nova] [instance: 7eaf6c32-1860-4732-9e50-3a8e04b95be8] Updated VIF entry in instance network info cache for port b7a4aa3c-47ee-4696-bd4b-abef2654f2ab. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 11:56:51 user nova-compute[74190]: DEBUG nova.network.neutron [req-e1966f72-ef4a-4ddb-95b2-a9275b9c3d22 req-e0f53bbd-3832-424b-b6e8-ea56e632a186 service nova] [instance: 7eaf6c32-1860-4732-9e50-3a8e04b95be8] Updating instance_info_cache with network_info: [{"id": "b7a4aa3c-47ee-4696-bd4b-abef2654f2ab", "address": "fa:16:3e:05:90:6b", "network": {"id": "25e0d6f5-497d-4898-8181-5b4848950f16", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-245925644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df06c4b010434e3da9ba4ea41f26befa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7a4aa3c-47", "ovs_interfaceid": "b7a4aa3c-47ee-4696-bd4b-abef2654f2ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:56:51 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-e1966f72-ef4a-4ddb-95b2-a9275b9c3d22 req-e0f53bbd-3832-424b-b6e8-ea56e632a186 service nova] Releasing lock "refresh_cache-7eaf6c32-1860-4732-9e50-3a8e04b95be8" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:56:51 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:56:51 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:56:51 user nova-compute[74190]: DEBUG nova.compute.manager [req-1c6204c8-4303-4d24-8b89-b3ed691d6289 req-7c1a7684-dcc6-453f-9063-1161777f74e5 service nova] [instance: 7eaf6c32-1860-4732-9e50-3a8e04b95be8] Received event network-vif-unplugged-b7a4aa3c-47ee-4696-bd4b-abef2654f2ab {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:56:51 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-1c6204c8-4303-4d24-8b89-b3ed691d6289 req-7c1a7684-dcc6-453f-9063-1161777f74e5 service nova] Acquiring lock "7eaf6c32-1860-4732-9e50-3a8e04b95be8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:56:51 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-1c6204c8-4303-4d24-8b89-b3ed691d6289 req-7c1a7684-dcc6-453f-9063-1161777f74e5 service nova] Lock "7eaf6c32-1860-4732-9e50-3a8e04b95be8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:56:51 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-1c6204c8-4303-4d24-8b89-b3ed691d6289 req-7c1a7684-dcc6-453f-9063-1161777f74e5 service nova] Lock "7eaf6c32-1860-4732-9e50-3a8e04b95be8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:56:51 user nova-compute[74190]: DEBUG nova.compute.manager [req-1c6204c8-4303-4d24-8b89-b3ed691d6289 req-7c1a7684-dcc6-453f-9063-1161777f74e5 service nova] [instance: 7eaf6c32-1860-4732-9e50-3a8e04b95be8] No waiting events found dispatching network-vif-unplugged-b7a4aa3c-47ee-4696-bd4b-abef2654f2ab {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:56:51 user nova-compute[74190]: DEBUG nova.compute.manager [req-1c6204c8-4303-4d24-8b89-b3ed691d6289 req-7c1a7684-dcc6-453f-9063-1161777f74e5 service nova] [instance: 7eaf6c32-1860-4732-9e50-3a8e04b95be8] Received event network-vif-unplugged-b7a4aa3c-47ee-4696-bd4b-abef2654f2ab for instance with task_state deleting. {{(pid=74190) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 11:56:51 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:56:51 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:56:51 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 7eaf6c32-1860-4732-9e50-3a8e04b95be8] Instance destroyed successfully.
Oct 18 11:56:51 user nova-compute[74190]: DEBUG nova.objects.instance [None req-11951b92-0139-44a7-8078-29f7d2974b85 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lazy-loading 'resources' on Instance uuid 7eaf6c32-1860-4732-9e50-3a8e04b95be8 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:56:51 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-11951b92-0139-44a7-8078-29f7d2974b85 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:54:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-912642604',display_name='tempest-AttachVolumeNegativeTest-server-912642604',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-912642604',id=27,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNgJOsUvz97ASmXIOkilmICwfv85HkLciQhEC+X5IxtwPfMdA/v+ak4ckJVE8To+Wk0/MXLqfoutrKCd0UniuOJL0UZpq4RB1qSJAlViQ9SL0Ws+VlSu0APDMWGSetwP/A==',key_name='tempest-keypair-382322684',keypairs=<?>,launch_index=0,launched_at=2023-10-18T11:55:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='df06c4b010434e3da9ba4ea41f26befa',ramdisk_id='',reservation_id='r-bp6jgwxs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1730208605',owner_user_name='tempest-AttachVolumeNegativeTest-1730208605-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T11:55:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d6bb993153245daabfc59215abbf7a1',uuid=7eaf6c32-1860-4732-9e50-3a8e04b95be8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b7a4aa3c-47ee-4696-bd4b-abef2654f2ab", "address": "fa:16:3e:05:90:6b", "network": {"id": "25e0d6f5-497d-4898-8181-5b4848950f16", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-245925644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df06c4b010434e3da9ba4ea41f26befa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7a4aa3c-47", "ovs_interfaceid": "b7a4aa3c-47ee-4696-bd4b-abef2654f2ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 11:56:51 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-11951b92-0139-44a7-8078-29f7d2974b85 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Converting VIF {"id": "b7a4aa3c-47ee-4696-bd4b-abef2654f2ab", "address": "fa:16:3e:05:90:6b", "network": {"id": "25e0d6f5-497d-4898-8181-5b4848950f16", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-245925644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df06c4b010434e3da9ba4ea41f26befa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7a4aa3c-47", "ovs_interfaceid": "b7a4aa3c-47ee-4696-bd4b-abef2654f2ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:56:51 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-11951b92-0139-44a7-8078-29f7d2974b85 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:90:6b,bridge_name='br-int',has_traffic_filtering=True,id=b7a4aa3c-47ee-4696-bd4b-abef2654f2ab,network=Network(25e0d6f5-497d-4898-8181-5b4848950f16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7a4aa3c-47') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:56:51 user nova-compute[74190]: DEBUG os_vif [None req-11951b92-0139-44a7-8078-29f7d2974b85 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:90:6b,bridge_name='br-int',has_traffic_filtering=True,id=b7a4aa3c-47ee-4696-bd4b-abef2654f2ab,network=Network(25e0d6f5-497d-4898-8181-5b4848950f16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7a4aa3c-47') {{(pid=74190) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 11:56:51 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:56:51 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb7a4aa3c-47, bridge=br-int, if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:56:51 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:56:51 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:56:51 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:56:51 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d831209f-b152-4019-a3e3-391fb197ba70) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:56:51 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:56:51 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:56:51 user nova-compute[74190]: INFO os_vif [None req-11951b92-0139-44a7-8078-29f7d2974b85 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:90:6b,bridge_name='br-int',has_traffic_filtering=True,id=b7a4aa3c-47ee-4696-bd4b-abef2654f2ab,network=Network(25e0d6f5-497d-4898-8181-5b4848950f16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7a4aa3c-47')
Oct 18 11:56:51 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-11951b92-0139-44a7-8078-29f7d2974b85 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: 7eaf6c32-1860-4732-9e50-3a8e04b95be8] Deleting instance files /opt/stack/data/nova/instances/7eaf6c32-1860-4732-9e50-3a8e04b95be8_del
Oct 18 11:56:51 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-11951b92-0139-44a7-8078-29f7d2974b85 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: 7eaf6c32-1860-4732-9e50-3a8e04b95be8] Deletion of /opt/stack/data/nova/instances/7eaf6c32-1860-4732-9e50-3a8e04b95be8_del complete
Oct 18 11:56:52 user nova-compute[74190]: INFO nova.compute.manager [None req-11951b92-0139-44a7-8078-29f7d2974b85 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: 7eaf6c32-1860-4732-9e50-3a8e04b95be8] Took 0.92 seconds to destroy the instance on the hypervisor.
Oct 18 11:56:52 user nova-compute[74190]: DEBUG oslo.service.loopingcall [None req-11951b92-0139-44a7-8078-29f7d2974b85 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74190) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 11:56:52 user nova-compute[74190]: DEBUG nova.compute.manager [-] [instance: 7eaf6c32-1860-4732-9e50-3a8e04b95be8] Deallocating network for instance {{(pid=74190) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 11:56:52 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: 7eaf6c32-1860-4732-9e50-3a8e04b95be8] deallocate_for_instance() {{(pid=74190) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 11:56:52 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: 7eaf6c32-1860-4732-9e50-3a8e04b95be8] Updating instance_info_cache with network_info: [] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:56:52 user nova-compute[74190]: INFO nova.compute.manager [-] [instance: 7eaf6c32-1860-4732-9e50-3a8e04b95be8] Took 0.78 seconds to deallocate network for instance.
Oct 18 11:56:52 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-11951b92-0139-44a7-8078-29f7d2974b85 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:56:52 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-11951b92-0139-44a7-8078-29f7d2974b85 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:56:53 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-11951b92-0139-44a7-8078-29f7d2974b85 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 11:56:53 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-11951b92-0139-44a7-8078-29f7d2974b85 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 11:56:53 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-11951b92-0139-44a7-8078-29f7d2974b85 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.387s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:56:53 user nova-compute[74190]: INFO nova.scheduler.client.report [None req-11951b92-0139-44a7-8078-29f7d2974b85 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Deleted allocations for instance 7eaf6c32-1860-4732-9e50-3a8e04b95be8
Oct 18 11:56:53 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-11951b92-0139-44a7-8078-29f7d2974b85 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "7eaf6c32-1860-4732-9e50-3a8e04b95be8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.275s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:56:53 user nova-compute[74190]: DEBUG nova.compute.manager [req-9ee3fb16-3c82-42ec-888b-9d100f50b489 req-8b379eac-dc21-47f0-9733-df1827461bf3 service nova] [instance: 7eaf6c32-1860-4732-9e50-3a8e04b95be8] Received event network-vif-plugged-b7a4aa3c-47ee-4696-bd4b-abef2654f2ab {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:56:53 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-9ee3fb16-3c82-42ec-888b-9d100f50b489 req-8b379eac-dc21-47f0-9733-df1827461bf3 service nova] Acquiring lock "7eaf6c32-1860-4732-9e50-3a8e04b95be8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:56:53 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-9ee3fb16-3c82-42ec-888b-9d100f50b489 req-8b379eac-dc21-47f0-9733-df1827461bf3 service nova] Lock "7eaf6c32-1860-4732-9e50-3a8e04b95be8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:56:53 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-9ee3fb16-3c82-42ec-888b-9d100f50b489 req-8b379eac-dc21-47f0-9733-df1827461bf3 service nova] Lock "7eaf6c32-1860-4732-9e50-3a8e04b95be8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:56:53 user nova-compute[74190]: DEBUG nova.compute.manager [req-9ee3fb16-3c82-42ec-888b-9d100f50b489 req-8b379eac-dc21-47f0-9733-df1827461bf3 service nova] [instance: 7eaf6c32-1860-4732-9e50-3a8e04b95be8] No waiting events found dispatching network-vif-plugged-b7a4aa3c-47ee-4696-bd4b-abef2654f2ab {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:56:53 user nova-compute[74190]: WARNING nova.compute.manager [req-9ee3fb16-3c82-42ec-888b-9d100f50b489 req-8b379eac-dc21-47f0-9733-df1827461bf3 service nova] [instance: 7eaf6c32-1860-4732-9e50-3a8e04b95be8] Received unexpected event network-vif-plugged-b7a4aa3c-47ee-4696-bd4b-abef2654f2ab for instance with vm_state deleted and task_state None.
Oct 18 11:56:53 user nova-compute[74190]: DEBUG nova.compute.manager [req-9ee3fb16-3c82-42ec-888b-9d100f50b489 req-8b379eac-dc21-47f0-9733-df1827461bf3 service nova] [instance: 7eaf6c32-1860-4732-9e50-3a8e04b95be8] Received event network-vif-deleted-b7a4aa3c-47ee-4696-bd4b-abef2654f2ab {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:56:54 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:56:56 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:56:58 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:56:59 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:57:00 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:57:00 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74190) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 11:57:01 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:57:02 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:57:04 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:57:04 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:57:04 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:57:04 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:57:04 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:57:04 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:57:04 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Auditing locally available compute resources for user (node: user) {{(pid=74190) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 11:57:04 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31a86ab2-d72d-4274-b5a6-84c5c4bdfc01/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:57:04 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31a86ab2-d72d-4274-b5a6-84c5c4bdfc01/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:57:04 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31a86ab2-d72d-4274-b5a6-84c5c4bdfc01/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:57:04 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31a86ab2-d72d-4274-b5a6-84c5c4bdfc01/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:57:04 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:57:04 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:57:04 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:57:04 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:57:04 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eec9cde-3553-4fc8-9162-cda963d1a81e/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:57:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eec9cde-3553-4fc8-9162-cda963d1a81e/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:57:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eec9cde-3553-4fc8-9162-cda963d1a81e/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:57:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eec9cde-3553-4fc8-9162-cda963d1a81e/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:57:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b200eb6a-be24-4a8f-be23-4e36f7b7b26e/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:57:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b200eb6a-be24-4a8f-be23-4e36f7b7b26e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:57:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b200eb6a-be24-4a8f-be23-4e36f7b7b26e/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:57:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b200eb6a-be24-4a8f-be23-4e36f7b7b26e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:57:05 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 11:57:05 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 11:57:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:57:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:57:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:57:06 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:57:06 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0209c824-88a7-4976-83bf-8a72437f0cc2/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:57:06 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0209c824-88a7-4976-83bf-8a72437f0cc2/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:57:06 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0209c824-88a7-4976-83bf-8a72437f0cc2/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:57:06 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0209c824-88a7-4976-83bf-8a72437f0cc2/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:57:06 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:57:06 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:57:06 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:57:06 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:57:06 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 11:57:06 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk.rescue --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:57:06 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:57:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:57:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk.rescue --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:57:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:57:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:57:07 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc14f635-6dcb-47b6-8f83-b46a6a4a67d3 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] [instance: 31a86ab2-d72d-4274-b5a6-84c5c4bdfc01] Calling os-brick to attach iSCSI Volume {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 11:57:07 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc14f635-6dcb-47b6-8f83-b46a6a4a67d3 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:514bbf1e-63ad-4d0b-aa66-419f112e5555', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aPyilwdY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:57:07 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-bc14f635-6dcb-47b6-8f83-b46a6a4a67d3 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:57:07 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-bc14f635-6dcb-47b6-8f83-b46a6a4a67d3 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:57:07 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-bc14f635-6dcb-47b6-8f83-b46a6a4a67d3 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:57:07 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-bc14f635-6dcb-47b6-8f83-b46a6a4a67d3 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:57:07 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-bc14f635-6dcb-47b6-8f83-b46a6a4a67d3 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:514bbf1e-63ad-4d0b-aa66-419f112e5555" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:57:07 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-bc14f635-6dcb-47b6-8f83-b46a6a4a67d3 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:514bbf1e-63ad-4d0b-aa66-419f112e5555" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:57:07 user nova-compute[74190]: INFO os_brick.initiator.connectors.iscsi [None req-bc14f635-6dcb-47b6-8f83-b46a6a4a67d3 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 11:57:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:514bbf1e-63ad-4d0b-aa66-419f112e5555 -p 172.16.0.220:3260 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:57:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:514bbf1e-63ad-4d0b-aa66-419f112e5555 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:57:07 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b0f0cd-4e47-4238-beb4-c933351cc88e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:57:07 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc14f635-6dcb-47b6-8f83-b46a6a4a67d3 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 11:57:07 user nova-compute[74190]:  {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:57:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:514bbf1e-63ad-4d0b-aa66-419f112e5555 -p 172.16.0.220:3260 --interface default --op new {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:57:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:514bbf1e-63ad-4d0b-aa66-419f112e5555 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:57:07 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b049eb-dce6-4ab5-92b0-4329b422822c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:514bbf1e-63ad-4d0b-aa66-419f112e5555] added\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:57:07 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc14f635-6dcb-47b6-8f83-b46a6a4a67d3 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:514bbf1e-63ad-4d0b-aa66-419f112e5555] added
Oct 18 11:57:07 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:57:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:514bbf1e-63ad-4d0b-aa66-419f112e5555 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:57:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:514bbf1e-63ad-4d0b-aa66-419f112e5555 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:57:07 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d1290fb-55bd-456d-9721-b42592953961]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:57:07 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc14f635-6dcb-47b6-8f83-b46a6a4a67d3 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:57:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:514bbf1e-63ad-4d0b-aa66-419f112e5555 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:57:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:514bbf1e-63ad-4d0b-aa66-419f112e5555 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:57:07 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[a62f390c-fe6f-4e93-86a5-f5d3f6fce402]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:57:07 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc14f635-6dcb-47b6-8f83-b46a6a4a67d3 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:57:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:514bbf1e-63ad-4d0b-aa66-419f112e5555 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aPyilwdY {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:57:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:57:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:57:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:514bbf1e-63ad-4d0b-aa66-419f112e5555 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aPyilwdY" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:57:07 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c220ace-39d0-4d3f-885e-c5f6710f6f77]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:57:07 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc14f635-6dcb-47b6-8f83-b46a6a4a67d3 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aPyilwdY'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:57:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:514bbf1e-63ad-4d0b-aa66-419f112e5555 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:57:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:514bbf1e-63ad-4d0b-aa66-419f112e5555 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:57:07 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bdee7ef-7b0d-45a6-990c-a56b8e24b11b]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:57:07 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc14f635-6dcb-47b6-8f83-b46a6a4a67d3 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:57:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:57:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:57:07 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf576c63-f881-4242-8827-948856d7c86a]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:57:07 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc14f635-6dcb-47b6-8f83-b46a6a4a67d3 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 11:57:07 user nova-compute[74190]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7 (non-flash)
Oct 18 11:57:07 user nova-compute[74190]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 (non-flash)
Oct 18 11:57:07 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:57:07 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc14f635-6dcb-47b6-8f83-b46a6a4a67d3 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 11:57:07 user nova-compute[74190]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7 (non-flash)
Oct 18 11:57:07 user nova-compute[74190]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 (non-flash)
Oct 18 11:57:07 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:57:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:514bbf1e-63ad-4d0b-aa66-419f112e5555 -p 172.16.0.220:3260 --login {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:57:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:514bbf1e-63ad-4d0b-aa66-419f112e5555 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:57:07 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2dabff5-fd19-4881-9a4a-5c9fc7099a50]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:514bbf1e-63ad-4d0b-aa66-419f112e5555, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:514bbf1e-63ad-4d0b-aa66-419f112e5555, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:57:07 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc14f635-6dcb-47b6-8f83-b46a6a4a67d3 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:514bbf1e-63ad-4d0b-aa66-419f112e5555, portal: 172.16.0.220,3260]
Oct 18 11:57:07 user nova-compute[74190]: Login to [iface: default, target: iqn.2010-10.org.openstack:514bbf1e-63ad-4d0b-aa66-419f112e5555, portal: 172.16.0.220,3260] successful.
Oct 18 11:57:07 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:57:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:514bbf1e-63ad-4d0b-aa66-419f112e5555 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:57:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:514bbf1e-63ad-4d0b-aa66-419f112e5555 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:57:07 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[61738b3b-cffb-4a85-b58e-89f54dc83d4b]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:57:07 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc14f635-6dcb-47b6-8f83-b46a6a4a67d3 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:57:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:57:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:57:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95933a75-03d9-4b34-b751-69e3622f23c7/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:57:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:57:07 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[84193e43-aea3-4abd-95d1-b21f1939bcab]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514bbf1e-63ad-4d0b-aa66-419f112e5555 (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:57:07 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc14f635-6dcb-47b6-8f83-b46a6a4a67d3 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 11:57:07 user nova-compute[74190]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7 (non-flash)
Oct 18 11:57:07 user nova-compute[74190]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 (non-flash)
Oct 18 11:57:07 user nova-compute[74190]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514bbf1e-63ad-4d0b-aa66-419f112e5555 (non-flash)
Oct 18 11:57:07 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:57:07 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc14f635-6dcb-47b6-8f83-b46a6a4a67d3 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 11:57:07 user nova-compute[74190]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7 (non-flash)
Oct 18 11:57:07 user nova-compute[74190]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 (non-flash)
Oct 18 11:57:07 user nova-compute[74190]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514bbf1e-63ad-4d0b-aa66-419f112e5555 (non-flash)
Oct 18 11:57:07 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:57:07 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-bc14f635-6dcb-47b6-8f83-b46a6a4a67d3 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:514bbf1e-63ad-4d0b-aa66-419f112e5555" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.378s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:57:07 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc14f635-6dcb-47b6-8f83-b46a6a4a67d3 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Connected to 172.16.0.220:3260 {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 11:57:07 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-bc14f635-6dcb-47b6-8f83-b46a6a4a67d3 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] HCTL ('33', '-', '-', 0) found on session 35 with lun 0 {{(pid=74190) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 11:57:07 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-bc14f635-6dcb-47b6-8f83-b46a6a4a67d3 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74190) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 11:57:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:57:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:57:07 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c370226-f2ec-4089-973a-bb6bac8ac64b]: (4, ('- - 0', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:57:07 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-bc14f635-6dcb-47b6-8f83-b46a6a4a67d3 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Searching for a device in session 35 and hctl ['33', '*', '*', 0] yield: None {{(pid=74190) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 11:57:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95933a75-03d9-4b34-b751-69e3622f23c7/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:57:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95933a75-03d9-4b34-b751-69e3622f23c7/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:57:08 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95933a75-03d9-4b34-b751-69e3622f23c7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:57:08 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:57:08 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:57:08 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Hypervisor/Node resource view: name=user free_ram=7333MB free_disk=25.115428924560547GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74190) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 11:57:08 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:57:08 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:57:08 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-bc14f635-6dcb-47b6-8f83-b46a6a4a67d3 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Searching for a device in session 35 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74190) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 11:57:08 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc14f635-6dcb-47b6-8f83-b46a6a4a67d3 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:514bbf1e-63ad-4d0b-aa66-419f112e5555', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aPyilwdY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 11:57:08 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-bc14f635-6dcb-47b6-8f83-b46a6a4a67d3 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.410s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:57:08 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc14f635-6dcb-47b6-8f83-b46a6a4a67d3 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] <== connect_volume: return (1412ms) {'type': 'block', 'scsi_wwn': '23038363366653864', 'path': '/dev/sdb'} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:57:08 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc14f635-6dcb-47b6-8f83-b46a6a4a67d3 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] [instance: 31a86ab2-d72d-4274-b5a6-84c5c4bdfc01] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23038363366653864', 'path': '/dev/sdb'} {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 11:57:08 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 0209c824-88a7-4976-83bf-8a72437f0cc2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:57:08 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 4e916d24-9f9d-4289-87ce-f65d2499fcd9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:57:08 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 8eec9cde-3553-4fc8-9162-cda963d1a81e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:57:08 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance b200eb6a-be24-4a8f-be23-4e36f7b7b26e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:57:08 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 95ca0697-22b5-4109-868f-ca5556015a1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:57:08 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 42413a94-9973-4e8d-83b6-207a4e7847c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:57:08 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 31a86ab2-d72d-4274-b5a6-84c5c4bdfc01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:57:08 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance a9012673-826b-4be7-a55b-9bb35a227c17 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:57:08 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 95933a75-03d9-4b34-b751-69e3622f23c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:57:08 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 772b126c-2148-4ca8-90f2-69d6eb4b7db7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:57:08 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 11:57:08 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 11:57:08 user nova-compute[74190]: DEBUG nova.objects.instance [None req-bc14f635-6dcb-47b6-8f83-b46a6a4a67d3 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Lazy-loading 'flavor' on Instance uuid 31a86ab2-d72d-4274-b5a6-84c5c4bdfc01 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:57:08 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-bc14f635-6dcb-47b6-8f83-b46a6a4a67d3 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] attach device xml: <disk type="block" device="disk">
Oct 18 11:57:08 user nova-compute[74190]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 11:57:08 user nova-compute[74190]:   <source dev="/dev/sdb"/>
Oct 18 11:57:08 user nova-compute[74190]:   <target dev="vdb" bus="virtio"/>
Oct 18 11:57:08 user nova-compute[74190]:   <serial>514bbf1e-63ad-4d0b-aa66-419f112e5555</serial>
Oct 18 11:57:08 user nova-compute[74190]: </disk>
Oct 18 11:57:08 user nova-compute[74190]:  {{(pid=74190) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 18 11:57:09 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 11:57:09 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 11:57:09 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Compute_service record updated for user:user {{(pid=74190) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 11:57:09 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.595s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:57:09 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:57:09 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74190) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 18 11:57:09 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-bc14f635-6dcb-47b6-8f83-b46a6a4a67d3 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] No BDM found with device name vda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 11:57:09 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-bc14f635-6dcb-47b6-8f83-b46a6a4a67d3 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 11:57:09 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-bc14f635-6dcb-47b6-8f83-b46a6a4a67d3 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] No VIF found with MAC fa:16:3e:25:cc:e5, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 11:57:09 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-bc14f635-6dcb-47b6-8f83-b46a6a4a67d3 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Lock "31a86ab2-d72d-4274-b5a6-84c5c4bdfc01" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 28.916s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:57:10 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:57:10 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:57:10 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:57:10 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Starting heal instance info cache {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 11:57:10 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "refresh_cache-4e916d24-9f9d-4289-87ce-f65d2499fcd9" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:57:10 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquired lock "refresh_cache-4e916d24-9f9d-4289-87ce-f65d2499fcd9" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:57:10 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Forcefully refreshing network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 18 11:57:10 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Updating instance_info_cache with network_info: [{"id": "7cee893b-5ac8-45f8-a1f8-5374b49cc3b5", "address": "fa:16:3e:15:15:1d", "network": {"id": "4609cfba-1e8b-4740-bdf6-642b196097a3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1019354168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a4f041e58144d54a458a01074eb35a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cee893b-5a", "ovs_interfaceid": "7cee893b-5ac8-45f8-a1f8-5374b49cc3b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:57:10 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Releasing lock "refresh_cache-4e916d24-9f9d-4289-87ce-f65d2499fcd9" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:57:10 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Updated the network info_cache for instance {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 18 11:57:10 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:57:11 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-a113b6df-9b0f-438c-9bfd-71530e3855ff tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Acquiring lock "31a86ab2-d72d-4274-b5a6-84c5c4bdfc01" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:57:11 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-a113b6df-9b0f-438c-9bfd-71530e3855ff tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Lock "31a86ab2-d72d-4274-b5a6-84c5c4bdfc01" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:57:11 user nova-compute[74190]: INFO nova.compute.manager [None req-a113b6df-9b0f-438c-9bfd-71530e3855ff tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] [instance: 31a86ab2-d72d-4274-b5a6-84c5c4bdfc01] Detaching volume 514bbf1e-63ad-4d0b-aa66-419f112e5555
Oct 18 11:57:11 user nova-compute[74190]: INFO nova.virt.block_device [None req-a113b6df-9b0f-438c-9bfd-71530e3855ff tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] [instance: 31a86ab2-d72d-4274-b5a6-84c5c4bdfc01] Attempting to driver detach volume 514bbf1e-63ad-4d0b-aa66-419f112e5555 from mountpoint /dev/vdb
Oct 18 11:57:11 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-a113b6df-9b0f-438c-9bfd-71530e3855ff tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Attempting to detach device vdb from instance 31a86ab2-d72d-4274-b5a6-84c5c4bdfc01 from the persistent domain config. {{(pid=74190) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 18 11:57:11 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-a113b6df-9b0f-438c-9bfd-71530e3855ff tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 11:57:11 user nova-compute[74190]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 11:57:11 user nova-compute[74190]:   <source dev="/dev/sdb"/>
Oct 18 11:57:11 user nova-compute[74190]:   <target dev="vdb" bus="virtio"/>
Oct 18 11:57:11 user nova-compute[74190]:   <serial>514bbf1e-63ad-4d0b-aa66-419f112e5555</serial>
Oct 18 11:57:11 user nova-compute[74190]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 18 11:57:11 user nova-compute[74190]: </disk>
Oct 18 11:57:11 user nova-compute[74190]:  {{(pid=74190) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 11:57:11 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-a113b6df-9b0f-438c-9bfd-71530e3855ff tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Successfully detached device vdb from instance 31a86ab2-d72d-4274-b5a6-84c5c4bdfc01 from the persistent domain config.
Oct 18 11:57:11 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-a113b6df-9b0f-438c-9bfd-71530e3855ff tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 31a86ab2-d72d-4274-b5a6-84c5c4bdfc01 from the live domain config. {{(pid=74190) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 18 11:57:11 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-a113b6df-9b0f-438c-9bfd-71530e3855ff tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 11:57:11 user nova-compute[74190]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 11:57:11 user nova-compute[74190]:   <source dev="/dev/sdb"/>
Oct 18 11:57:11 user nova-compute[74190]:   <target dev="vdb" bus="virtio"/>
Oct 18 11:57:11 user nova-compute[74190]:   <serial>514bbf1e-63ad-4d0b-aa66-419f112e5555</serial>
Oct 18 11:57:11 user nova-compute[74190]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 18 11:57:11 user nova-compute[74190]: </disk>
Oct 18 11:57:11 user nova-compute[74190]:  {{(pid=74190) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 11:57:11 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-a113b6df-9b0f-438c-9bfd-71530e3855ff tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 31a86ab2-d72d-4274-b5a6-84c5c4bdfc01 {{(pid=74190) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 18 11:57:11 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:57:12 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:57:16 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:57:21 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:57:21 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Triggering sync for uuid 0209c824-88a7-4976-83bf-8a72437f0cc2 {{(pid=74190) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 18 11:57:21 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Triggering sync for uuid 4e916d24-9f9d-4289-87ce-f65d2499fcd9 {{(pid=74190) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 18 11:57:21 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Triggering sync for uuid 8eec9cde-3553-4fc8-9162-cda963d1a81e {{(pid=74190) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 18 11:57:21 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Triggering sync for uuid b200eb6a-be24-4a8f-be23-4e36f7b7b26e {{(pid=74190) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 18 11:57:21 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Triggering sync for uuid a9012673-826b-4be7-a55b-9bb35a227c17 {{(pid=74190) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 18 11:57:21 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Triggering sync for uuid 95ca0697-22b5-4109-868f-ca5556015a1f {{(pid=74190) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 18 11:57:21 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Triggering sync for uuid 42413a94-9973-4e8d-83b6-207a4e7847c1 {{(pid=74190) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 18 11:57:21 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Triggering sync for uuid 31a86ab2-d72d-4274-b5a6-84c5c4bdfc01 {{(pid=74190) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 18 11:57:21 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Triggering sync for uuid 95933a75-03d9-4b34-b751-69e3622f23c7 {{(pid=74190) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 18 11:57:21 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Triggering sync for uuid 772b126c-2148-4ca8-90f2-69d6eb4b7db7 {{(pid=74190) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 18 11:57:21 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "0209c824-88a7-4976-83bf-8a72437f0cc2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:57:21 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "0209c824-88a7-4976-83bf-8a72437f0cc2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:57:21 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "4e916d24-9f9d-4289-87ce-f65d2499fcd9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:57:21 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "4e916d24-9f9d-4289-87ce-f65d2499fcd9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:57:21 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "8eec9cde-3553-4fc8-9162-cda963d1a81e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:57:21 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "8eec9cde-3553-4fc8-9162-cda963d1a81e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:57:21 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "b200eb6a-be24-4a8f-be23-4e36f7b7b26e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:57:21 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "b200eb6a-be24-4a8f-be23-4e36f7b7b26e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:57:21 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "a9012673-826b-4be7-a55b-9bb35a227c17" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:57:21 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "a9012673-826b-4be7-a55b-9bb35a227c17" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:57:21 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "95ca0697-22b5-4109-868f-ca5556015a1f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:57:21 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "95ca0697-22b5-4109-868f-ca5556015a1f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:57:21 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "42413a94-9973-4e8d-83b6-207a4e7847c1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:57:21 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "42413a94-9973-4e8d-83b6-207a4e7847c1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:57:21 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "31a86ab2-d72d-4274-b5a6-84c5c4bdfc01" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:57:21 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "95933a75-03d9-4b34-b751-69e3622f23c7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:57:21 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "95933a75-03d9-4b34-b751-69e3622f23c7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:57:21 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "772b126c-2148-4ca8-90f2-69d6eb4b7db7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:57:21 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "772b126c-2148-4ca8-90f2-69d6eb4b7db7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:57:21 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "4e916d24-9f9d-4289-87ce-f65d2499fcd9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.041s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:57:21 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "8eec9cde-3553-4fc8-9162-cda963d1a81e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.040s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:57:21 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "a9012673-826b-4be7-a55b-9bb35a227c17" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.055s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:57:21 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "95ca0697-22b5-4109-868f-ca5556015a1f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.056s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:57:21 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "0209c824-88a7-4976-83bf-8a72437f0cc2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.061s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:57:21 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "b200eb6a-be24-4a8f-be23-4e36f7b7b26e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.070s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:57:21 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "772b126c-2148-4ca8-90f2-69d6eb4b7db7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.069s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:57:21 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "95933a75-03d9-4b34-b751-69e3622f23c7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.072s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:57:21 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "42413a94-9973-4e8d-83b6-207a4e7847c1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.082s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:57:21 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:57:26 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:57:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:57:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:57:31 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-a113b6df-9b0f-438c-9bfd-71530e3855ff tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 31a86ab2-d72d-4274-b5a6-84c5c4bdfc01 is timed out.
Oct 18 11:57:31 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-a113b6df-9b0f-438c-9bfd-71530e3855ff tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Successfully detached device vdb from instance 31a86ab2-d72d-4274-b5a6-84c5c4bdfc01 from the live domain config.
Oct 18 11:57:31 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a113b6df-9b0f-438c-9bfd-71530e3855ff tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] [instance: 31a86ab2-d72d-4274-b5a6-84c5c4bdfc01] calling os-brick to detach iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 11:57:31 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-a113b6df-9b0f-438c-9bfd-71530e3855ff tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, {'target_iqn': 'iqn.2010-10.org.openstack:514bbf1e-63ad-4d0b-aa66-419f112e5555', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aPyilwdY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:57:31 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-a113b6df-9b0f-438c-9bfd-71530e3855ff tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:57:31 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-a113b6df-9b0f-438c-9bfd-71530e3855ff tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:57:31 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-a113b6df-9b0f-438c-9bfd-71530e3855ff tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:57:31 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:57:31 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:57:31 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[a76bb5a1-89f8-4057-847c-964355288de6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:514bbf1e-63ad-4d0b-aa66-419f112e5555\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:57:31 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-a113b6df-9b0f-438c-9bfd-71530e3855ff tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 11:57:31 user nova-compute[74190]: No targets found.
Oct 18 11:57:31 user nova-compute[74190]: iSNS:
Oct 18 11:57:31 user nova-compute[74190]: No targets found.
Oct 18 11:57:31 user nova-compute[74190]: STATIC:
Oct 18 11:57:31 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227
Oct 18 11:57:31 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:57:31 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:57:31 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa
Oct 18 11:57:31 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:57:31 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:57:31 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7
Oct 18 11:57:31 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:57:31 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:57:31 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:514bbf1e-63ad-4d0b-aa66-419f112e5555
Oct 18 11:57:31 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:57:31 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:57:31 user nova-compute[74190]: FIRMWARE:
Oct 18 11:57:31 user nova-compute[74190]: No targets found.
Oct 18 11:57:31 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:57:31 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-a113b6df-9b0f-438c-9bfd-71530e3855ff tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 11:57:31 user nova-compute[74190]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 11:57:31 user nova-compute[74190]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74190) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 11:57:31 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-a113b6df-9b0f-438c-9bfd-71530e3855ff tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:514bbf1e-63ad-4d0b-aa66-419f112e5555', 0)] {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 11:57:31 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:57:31 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:57:31 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[2860750f-3ac5-4616-9c0a-41515581474e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:514bbf1e-63ad-4d0b-aa66-419f112e5555\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:57:31 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:57:31 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:57:31 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[fedc7363-0651-4210-8afa-5e7389ff6cb1]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514bbf1e-63ad-4d0b-aa66-419f112e5555 (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:57:31 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-a113b6df-9b0f-438c-9bfd-71530e3855ff tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 11:57:31 user nova-compute[74190]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7 (non-flash)
Oct 18 11:57:31 user nova-compute[74190]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 (non-flash)
Oct 18 11:57:31 user nova-compute[74190]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514bbf1e-63ad-4d0b-aa66-419f112e5555 (non-flash)
Oct 18 11:57:31 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:57:31 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-a113b6df-9b0f-438c-9bfd-71530e3855ff tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 11:57:31 user nova-compute[74190]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7 (non-flash)
Oct 18 11:57:31 user nova-compute[74190]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 (non-flash)
Oct 18 11:57:31 user nova-compute[74190]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514bbf1e-63ad-4d0b-aa66-419f112e5555 (non-flash)
Oct 18 11:57:31 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:57:31 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-a113b6df-9b0f-438c-9bfd-71530e3855ff tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1f542acf70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:514bbf1e-63ad-4d0b-aa66-419f112e5555'): ({'sdb'}, set())}) {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 11:57:31 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-a113b6df-9b0f-438c-9bfd-71530e3855ff tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Removing single pathed devices sdb {{(pid=74190) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 11:57:31 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:57:31 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:57:31 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[924c9f21-7e32-4ba2-adfb-4ad7eabefaaf]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:57:31 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:57:31 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:57:31 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a74865-fbdc-4905-8195-1905ad059131]: (4, ('ok\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:57:31 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-a113b6df-9b0f-438c-9bfd-71530e3855ff tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Flushing IO for device /dev/sdb {{(pid=74190) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 11:57:31 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:57:31 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:57:31 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ecac32b-e896-4fa3-a82a-9f4e4056414a]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:57:31 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-a113b6df-9b0f-438c-9bfd-71530e3855ff tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74190) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 11:57:31 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:57:31 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:57:31 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[41921dfc-54df-4c48-b4e5-04e11b09e7ae]: (4, ('1', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:57:31 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-a113b6df-9b0f-438c-9bfd-71530e3855ff tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 11:57:31 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-a113b6df-9b0f-438c-9bfd-71530e3855ff tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] SCSI volumes sdb have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 11:57:31 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-a113b6df-9b0f-438c-9bfd-71530e3855ff tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:514bbf1e-63ad-4d0b-aa66-419f112e5555')] {{(pid=74190) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 11:57:31 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:514bbf1e-63ad-4d0b-aa66-419f112e5555 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:57:31 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:514bbf1e-63ad-4d0b-aa66-419f112e5555 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:57:31 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f1d55a-9e67-478e-aa88-8a22e360f6c2]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:57:31 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-a113b6df-9b0f-438c-9bfd-71530e3855ff tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:57:31 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:514bbf1e-63ad-4d0b-aa66-419f112e5555 -p 172.16.0.220:3260 --logout {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:57:31 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:514bbf1e-63ad-4d0b-aa66-419f112e5555 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:57:31 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec1ac860-4668-43ed-8d88-d712fac9de4a]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:514bbf1e-63ad-4d0b-aa66-419f112e5555, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:514bbf1e-63ad-4d0b-aa66-419f112e5555, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:57:31 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-a113b6df-9b0f-438c-9bfd-71530e3855ff tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:514bbf1e-63ad-4d0b-aa66-419f112e5555, portal: 172.16.0.220,3260]
Oct 18 11:57:31 user nova-compute[74190]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:514bbf1e-63ad-4d0b-aa66-419f112e5555, portal: 172.16.0.220,3260] successful.
Oct 18 11:57:31 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:57:31 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:514bbf1e-63ad-4d0b-aa66-419f112e5555 -p 172.16.0.220:3260 --op delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:57:31 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:514bbf1e-63ad-4d0b-aa66-419f112e5555 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:57:31 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[898826f2-0293-4855-8613-1553a46022b7]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:57:31 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-a113b6df-9b0f-438c-9bfd-71530e3855ff tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:57:31 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-a113b6df-9b0f-438c-9bfd-71530e3855ff tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:57:31 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-a113b6df-9b0f-438c-9bfd-71530e3855ff tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] <== disconnect_volume: return (311ms) None {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:57:31 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a113b6df-9b0f-438c-9bfd-71530e3855ff tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] [instance: 31a86ab2-d72d-4274-b5a6-84c5c4bdfc01] Disconnected iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 11:57:31 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:57:32 user nova-compute[74190]: DEBUG nova.objects.instance [None req-a113b6df-9b0f-438c-9bfd-71530e3855ff tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Lazy-loading 'flavor' on Instance uuid 31a86ab2-d72d-4274-b5a6-84c5c4bdfc01 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:57:32 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-a113b6df-9b0f-438c-9bfd-71530e3855ff tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Lock "31a86ab2-d72d-4274-b5a6-84c5c4bdfc01" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.807s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:57:32 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "31a86ab2-d72d-4274-b5a6-84c5c4bdfc01" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 11.531s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:57:32 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "31a86ab2-d72d-4274-b5a6-84c5c4bdfc01" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:57:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:57:40 user nova-compute[74190]: DEBUG nova.compute.manager [req-277b6927-0176-4b5d-b7ad-ac0fa438c6ed req-cddcf156-0d44-4e20-b421-069ec676ecb2 service nova] [instance: 95933a75-03d9-4b34-b751-69e3622f23c7] Received event network-changed-0660e8c4-71b8-45e5-a54e-7a9f1775061f {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:57:40 user nova-compute[74190]: DEBUG nova.compute.manager [req-277b6927-0176-4b5d-b7ad-ac0fa438c6ed req-cddcf156-0d44-4e20-b421-069ec676ecb2 service nova] [instance: 95933a75-03d9-4b34-b751-69e3622f23c7] Refreshing instance network info cache due to event network-changed-0660e8c4-71b8-45e5-a54e-7a9f1775061f. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 11:57:40 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-277b6927-0176-4b5d-b7ad-ac0fa438c6ed req-cddcf156-0d44-4e20-b421-069ec676ecb2 service nova] Acquiring lock "refresh_cache-95933a75-03d9-4b34-b751-69e3622f23c7" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:57:40 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-277b6927-0176-4b5d-b7ad-ac0fa438c6ed req-cddcf156-0d44-4e20-b421-069ec676ecb2 service nova] Acquired lock "refresh_cache-95933a75-03d9-4b34-b751-69e3622f23c7" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:57:40 user nova-compute[74190]: DEBUG nova.network.neutron [req-277b6927-0176-4b5d-b7ad-ac0fa438c6ed req-cddcf156-0d44-4e20-b421-069ec676ecb2 service nova] [instance: 95933a75-03d9-4b34-b751-69e3622f23c7] Refreshing network info cache for port 0660e8c4-71b8-45e5-a54e-7a9f1775061f {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 11:57:41 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-a5bea17c-6147-4211-8daf-d2bfc3a8b536 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Acquiring lock "95933a75-03d9-4b34-b751-69e3622f23c7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:57:41 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-a5bea17c-6147-4211-8daf-d2bfc3a8b536 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Lock "95933a75-03d9-4b34-b751-69e3622f23c7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:57:41 user nova-compute[74190]: DEBUG nova.objects.instance [None req-a5bea17c-6147-4211-8daf-d2bfc3a8b536 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Lazy-loading 'flavor' on Instance uuid 95933a75-03d9-4b34-b751-69e3622f23c7 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:57:41 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-a5bea17c-6147-4211-8daf-d2bfc3a8b536 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Lock "95933a75-03d9-4b34-b751-69e3622f23c7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:57:41 user nova-compute[74190]: DEBUG nova.network.neutron [req-277b6927-0176-4b5d-b7ad-ac0fa438c6ed req-cddcf156-0d44-4e20-b421-069ec676ecb2 service nova] [instance: 95933a75-03d9-4b34-b751-69e3622f23c7] Updated VIF entry in instance network info cache for port 0660e8c4-71b8-45e5-a54e-7a9f1775061f. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 11:57:41 user nova-compute[74190]: DEBUG nova.network.neutron [req-277b6927-0176-4b5d-b7ad-ac0fa438c6ed req-cddcf156-0d44-4e20-b421-069ec676ecb2 service nova] [instance: 95933a75-03d9-4b34-b751-69e3622f23c7] Updating instance_info_cache with network_info: [{"id": "0660e8c4-71b8-45e5-a54e-7a9f1775061f", "address": "fa:16:3e:b3:8a:60", "network": {"id": "56026ce6-77fb-40c7-9976-732e745c219d", "bridge": "br-int", "label": "tempest-TestStampPattern-989787934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "389e1c2dbc904130ba08b137f0b2e837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0660e8c4-71", "ovs_interfaceid": "0660e8c4-71b8-45e5-a54e-7a9f1775061f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:57:41 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-277b6927-0176-4b5d-b7ad-ac0fa438c6ed req-cddcf156-0d44-4e20-b421-069ec676ecb2 service nova] Releasing lock "refresh_cache-95933a75-03d9-4b34-b751-69e3622f23c7" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:57:41 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-a5bea17c-6147-4211-8daf-d2bfc3a8b536 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Acquiring lock "95933a75-03d9-4b34-b751-69e3622f23c7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:57:41 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-a5bea17c-6147-4211-8daf-d2bfc3a8b536 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Lock "95933a75-03d9-4b34-b751-69e3622f23c7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:57:41 user nova-compute[74190]: INFO nova.compute.manager [None req-a5bea17c-6147-4211-8daf-d2bfc3a8b536 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] [instance: 95933a75-03d9-4b34-b751-69e3622f23c7] Attaching volume 9c772d30-9cad-4b3d-b0d4-f269a3c196c5 to /dev/vdb
Oct 18 11:57:41 user nova-compute[74190]: DEBUG os_brick.utils [None req-a5bea17c-6147-4211-8daf-d2bfc3a8b536 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:57:41 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:57:41 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:57:41 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d0d8543-b75c-4c82-88d8-284dafa7e6f5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cff158e257e1\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:57:41 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:57:41 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:57:41 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f7fa86-d89a-4318-9286-ee476036a4ae]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:57:41 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:57:41 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:57:41 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be471c9-95dd-4050-abfb-7518f8b6f8d6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:57:41 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[674bccb8-dc00-4df8-ad5b-24448aaf7475]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:57:41 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-a5bea17c-6147-4211-8daf-d2bfc3a8b536 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Running cmd (subprocess): nvme version {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:57:41 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-a5bea17c-6147-4211-8daf-d2bfc3a8b536 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] 'nvme version' failed. Not Retrying. {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 11:57:41 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a5bea17c-6147-4211-8daf-d2bfc3a8b536 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] nvme not present on system {{(pid=74190) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 11:57:41 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:57:41 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 11:57:41 user nova-compute[74190]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 11:57:41 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[b367b718-6bcf-4beb-a4e4-f5a885dd5cf5]: (4, '') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:57:41 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-a5bea17c-6147-4211-8daf-d2bfc3a8b536 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74190) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 11:57:41 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-a5bea17c-6147-4211-8daf-d2bfc3a8b536 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 11:57:41 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-a5bea17c-6147-4211-8daf-d2bfc3a8b536 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] LIGHTOS: no hostnqn found. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 11:57:41 user nova-compute[74190]: DEBUG os_brick.utils [None req-a5bea17c-6147-4211-8daf-d2bfc3a8b536 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cff158e257e1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:57:41 user nova-compute[74190]: DEBUG nova.virt.block_device [None req-a5bea17c-6147-4211-8daf-d2bfc3a8b536 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] [instance: 95933a75-03d9-4b34-b751-69e3622f23c7] Updating existing volume attachment record: 1d2457fc-734f-413e-aa27-87e60589d829 {{(pid=74190) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 11:57:41 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:57:42 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-979c9bde-e0b3-413c-823e-c28f04154e20 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Acquiring lock "b200eb6a-be24-4a8f-be23-4e36f7b7b26e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:57:42 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-979c9bde-e0b3-413c-823e-c28f04154e20 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "b200eb6a-be24-4a8f-be23-4e36f7b7b26e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:57:42 user nova-compute[74190]: INFO nova.compute.manager [None req-979c9bde-e0b3-413c-823e-c28f04154e20 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: b200eb6a-be24-4a8f-be23-4e36f7b7b26e] Detaching volume f859861f-19fb-4f6a-abd3-2160677199a7
Oct 18 11:57:42 user nova-compute[74190]: INFO nova.virt.block_device [None req-979c9bde-e0b3-413c-823e-c28f04154e20 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: b200eb6a-be24-4a8f-be23-4e36f7b7b26e] Attempting to driver detach volume f859861f-19fb-4f6a-abd3-2160677199a7 from mountpoint /dev/vdb
Oct 18 11:57:42 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-979c9bde-e0b3-413c-823e-c28f04154e20 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Attempting to detach device vdb from instance b200eb6a-be24-4a8f-be23-4e36f7b7b26e from the persistent domain config. {{(pid=74190) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 18 11:57:42 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-979c9bde-e0b3-413c-823e-c28f04154e20 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 11:57:42 user nova-compute[74190]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 11:57:42 user nova-compute[74190]:   <source dev="/dev/sdg"/>
Oct 18 11:57:42 user nova-compute[74190]:   <target dev="vdb" bus="virtio"/>
Oct 18 11:57:42 user nova-compute[74190]:   <serial>f859861f-19fb-4f6a-abd3-2160677199a7</serial>
Oct 18 11:57:42 user nova-compute[74190]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 18 11:57:42 user nova-compute[74190]: </disk>
Oct 18 11:57:42 user nova-compute[74190]:  {{(pid=74190) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 11:57:42 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-979c9bde-e0b3-413c-823e-c28f04154e20 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Successfully detached device vdb from instance b200eb6a-be24-4a8f-be23-4e36f7b7b26e from the persistent domain config.
Oct 18 11:57:42 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-979c9bde-e0b3-413c-823e-c28f04154e20 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b200eb6a-be24-4a8f-be23-4e36f7b7b26e from the live domain config. {{(pid=74190) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 18 11:57:42 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-979c9bde-e0b3-413c-823e-c28f04154e20 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 11:57:42 user nova-compute[74190]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 11:57:42 user nova-compute[74190]:   <source dev="/dev/sdg"/>
Oct 18 11:57:42 user nova-compute[74190]:   <target dev="vdb" bus="virtio"/>
Oct 18 11:57:42 user nova-compute[74190]:   <serial>f859861f-19fb-4f6a-abd3-2160677199a7</serial>
Oct 18 11:57:42 user nova-compute[74190]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 18 11:57:42 user nova-compute[74190]: </disk>
Oct 18 11:57:42 user nova-compute[74190]:  {{(pid=74190) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 11:57:43 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-979c9bde-e0b3-413c-823e-c28f04154e20 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b200eb6a-be24-4a8f-be23-4e36f7b7b26e {{(pid=74190) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 18 11:57:45 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:57:46 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:57:50 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:57:51 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:57:56 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:57:58 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:57:59 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:57:59 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5bea17c-6147-4211-8daf-d2bfc3a8b536 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] [instance: 95933a75-03d9-4b34-b751-69e3622f23c7] Calling os-brick to attach iSCSI Volume {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 11:57:59 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5bea17c-6147-4211-8daf-d2bfc3a8b536 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9c772d30-9cad-4b3d-b0d4-f269a3c196c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tangqAIp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:57:59 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-a5bea17c-6147-4211-8daf-d2bfc3a8b536 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:57:59 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-a5bea17c-6147-4211-8daf-d2bfc3a8b536 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:57:59 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-a5bea17c-6147-4211-8daf-d2bfc3a8b536 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:57:59 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-a5bea17c-6147-4211-8daf-d2bfc3a8b536 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:57:59 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-a5bea17c-6147-4211-8daf-d2bfc3a8b536 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c772d30-9cad-4b3d-b0d4-f269a3c196c5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:57:59 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-a5bea17c-6147-4211-8daf-d2bfc3a8b536 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c772d30-9cad-4b3d-b0d4-f269a3c196c5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:57:59 user nova-compute[74190]: INFO os_brick.initiator.connectors.iscsi [None req-a5bea17c-6147-4211-8daf-d2bfc3a8b536 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 11:57:59 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c772d30-9cad-4b3d-b0d4-f269a3c196c5 -p 172.16.0.220:3260 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:57:59 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c772d30-9cad-4b3d-b0d4-f269a3c196c5 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:57:59 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8662c72-dd3c-4159-8604-56e7fe6b0baa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:57:59 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5bea17c-6147-4211-8daf-d2bfc3a8b536 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 11:57:59 user nova-compute[74190]:  {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:57:59 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c772d30-9cad-4b3d-b0d4-f269a3c196c5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:57:59 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c772d30-9cad-4b3d-b0d4-f269a3c196c5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:57:59 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[692c6861-0c0a-4a20-bebe-f0849a061a72]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9c772d30-9cad-4b3d-b0d4-f269a3c196c5] added\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:57:59 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5bea17c-6147-4211-8daf-d2bfc3a8b536 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9c772d30-9cad-4b3d-b0d4-f269a3c196c5] added
Oct 18 11:57:59 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:57:59 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c772d30-9cad-4b3d-b0d4-f269a3c196c5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:57:59 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c772d30-9cad-4b3d-b0d4-f269a3c196c5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:57:59 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[44201696-650c-4381-bee6-9310cb68cff4]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:57:59 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5bea17c-6147-4211-8daf-d2bfc3a8b536 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:57:59 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c772d30-9cad-4b3d-b0d4-f269a3c196c5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:57:59 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c772d30-9cad-4b3d-b0d4-f269a3c196c5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:57:59 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc922a9-a1c8-4102-9214-621330d14c7e]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:57:59 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5bea17c-6147-4211-8daf-d2bfc3a8b536 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:57:59 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c772d30-9cad-4b3d-b0d4-f269a3c196c5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tangqAIp {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:57:59 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c772d30-9cad-4b3d-b0d4-f269a3c196c5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tangqAIp" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:57:59 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[6119c97b-e0b1-4c48-8515-5acb3545edac]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:57:59 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5bea17c-6147-4211-8daf-d2bfc3a8b536 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tangqAIp'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:57:59 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c772d30-9cad-4b3d-b0d4-f269a3c196c5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:57:59 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c772d30-9cad-4b3d-b0d4-f269a3c196c5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:57:59 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a64840-3c0f-4eb8-bff9-3acf73692d51]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:57:59 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5bea17c-6147-4211-8daf-d2bfc3a8b536 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:57:59 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:57:59 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:57:59 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[a93bcb62-7c52-4f1e-b708-109a32d3717e]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:57:59 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5bea17c-6147-4211-8daf-d2bfc3a8b536 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 11:57:59 user nova-compute[74190]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7 (non-flash)
Oct 18 11:57:59 user nova-compute[74190]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 (non-flash)
Oct 18 11:57:59 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:57:59 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5bea17c-6147-4211-8daf-d2bfc3a8b536 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 11:57:59 user nova-compute[74190]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7 (non-flash)
Oct 18 11:57:59 user nova-compute[74190]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 (non-flash)
Oct 18 11:57:59 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:57:59 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c772d30-9cad-4b3d-b0d4-f269a3c196c5 -p 172.16.0.220:3260 --login {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:57:59 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c772d30-9cad-4b3d-b0d4-f269a3c196c5 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:57:59 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b5578e1-5ea8-4ae5-85dc-8c0747aa6a65]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9c772d30-9cad-4b3d-b0d4-f269a3c196c5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9c772d30-9cad-4b3d-b0d4-f269a3c196c5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:57:59 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5bea17c-6147-4211-8daf-d2bfc3a8b536 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9c772d30-9cad-4b3d-b0d4-f269a3c196c5, portal: 172.16.0.220,3260]
Oct 18 11:57:59 user nova-compute[74190]: Login to [iface: default, target: iqn.2010-10.org.openstack:9c772d30-9cad-4b3d-b0d4-f269a3c196c5, portal: 172.16.0.220,3260] successful.
Oct 18 11:57:59 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:57:59 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c772d30-9cad-4b3d-b0d4-f269a3c196c5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:57:59 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c772d30-9cad-4b3d-b0d4-f269a3c196c5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:57:59 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[dab598e6-de65-44ee-a357-591bfe79c40b]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:57:59 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5bea17c-6147-4211-8daf-d2bfc3a8b536 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:57:59 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:57:59 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:57:59 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[b281ee85-cf02-41de-bedf-a0dd0bca1a33]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c772d30-9cad-4b3d-b0d4-f269a3c196c5 (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:57:59 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5bea17c-6147-4211-8daf-d2bfc3a8b536 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 11:57:59 user nova-compute[74190]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7 (non-flash)
Oct 18 11:57:59 user nova-compute[74190]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 (non-flash)
Oct 18 11:57:59 user nova-compute[74190]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c772d30-9cad-4b3d-b0d4-f269a3c196c5 (non-flash)
Oct 18 11:57:59 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:57:59 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5bea17c-6147-4211-8daf-d2bfc3a8b536 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 11:57:59 user nova-compute[74190]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7 (non-flash)
Oct 18 11:57:59 user nova-compute[74190]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 (non-flash)
Oct 18 11:57:59 user nova-compute[74190]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c772d30-9cad-4b3d-b0d4-f269a3c196c5 (non-flash)
Oct 18 11:57:59 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:57:59 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-a5bea17c-6147-4211-8daf-d2bfc3a8b536 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c772d30-9cad-4b3d-b0d4-f269a3c196c5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:57:59 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5bea17c-6147-4211-8daf-d2bfc3a8b536 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Connected to 172.16.0.220:3260 {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 11:57:59 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-a5bea17c-6147-4211-8daf-d2bfc3a8b536 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] HCTL ('33', '-', '-', 0) found on session 36 with lun 0 {{(pid=74190) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 11:57:59 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-a5bea17c-6147-4211-8daf-d2bfc3a8b536 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74190) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 11:57:59 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:57:59 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:57:59 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e99bd50-d1e0-4f20-9788-82941fe1e1f0]: (4, ('- - 0', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:57:59 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-a5bea17c-6147-4211-8daf-d2bfc3a8b536 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Searching for a device in session 36 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74190) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 11:57:59 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5bea17c-6147-4211-8daf-d2bfc3a8b536 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9c772d30-9cad-4b3d-b0d4-f269a3c196c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tangqAIp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 11:58:00 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:58:00 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:58:00 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74190) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 11:58:00 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-a5bea17c-6147-4211-8daf-d2bfc3a8b536 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:58:00 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5bea17c-6147-4211-8daf-d2bfc3a8b536 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '23537656164306631', 'path': '/dev/sdb'} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:58:00 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5bea17c-6147-4211-8daf-d2bfc3a8b536 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] [instance: 95933a75-03d9-4b34-b751-69e3622f23c7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23537656164306631', 'path': '/dev/sdb'} {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 11:58:00 user nova-compute[74190]: DEBUG nova.objects.instance [None req-a5bea17c-6147-4211-8daf-d2bfc3a8b536 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Lazy-loading 'flavor' on Instance uuid 95933a75-03d9-4b34-b751-69e3622f23c7 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:58:00 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-a5bea17c-6147-4211-8daf-d2bfc3a8b536 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] attach device xml: <disk type="block" device="disk">
Oct 18 11:58:00 user nova-compute[74190]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 11:58:00 user nova-compute[74190]:   <source dev="/dev/sdb"/>
Oct 18 11:58:00 user nova-compute[74190]:   <target dev="vdb" bus="virtio"/>
Oct 18 11:58:00 user nova-compute[74190]:   <serial>9c772d30-9cad-4b3d-b0d4-f269a3c196c5</serial>
Oct 18 11:58:00 user nova-compute[74190]: </disk>
Oct 18 11:58:00 user nova-compute[74190]:  {{(pid=74190) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 18 11:58:00 user nova-compute[74190]: DEBUG nova.compute.manager [None req-f65e4976-8444-4545-936a-98115bd7f0fc tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 772b126c-2148-4ca8-90f2-69d6eb4b7db7] Checking state {{(pid=74190) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 11:58:00 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-a5bea17c-6147-4211-8daf-d2bfc3a8b536 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] No BDM found with device name vda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 11:58:00 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-a5bea17c-6147-4211-8daf-d2bfc3a8b536 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 11:58:00 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-a5bea17c-6147-4211-8daf-d2bfc3a8b536 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] No VIF found with MAC fa:16:3e:b3:8a:60, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 11:58:01 user nova-compute[74190]: INFO nova.compute.manager [None req-f65e4976-8444-4545-936a-98115bd7f0fc tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 772b126c-2148-4ca8-90f2-69d6eb4b7db7] instance snapshotting
Oct 18 11:58:01 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-f65e4976-8444-4545-936a-98115bd7f0fc tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 772b126c-2148-4ca8-90f2-69d6eb4b7db7] Beginning live snapshot process
Oct 18 11:58:01 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-a5bea17c-6147-4211-8daf-d2bfc3a8b536 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Lock "95933a75-03d9-4b34-b751-69e3622f23c7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.580s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:58:01 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-f65e4976-8444-4545-936a-98115bd7f0fc tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/disk --force-share --output=json -f qcow2 {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:58:01 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-f65e4976-8444-4545-936a-98115bd7f0fc tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/disk --force-share --output=json -f qcow2" returned: 0 in 0.258s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:58:01 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-f65e4976-8444-4545-936a-98115bd7f0fc tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/disk --force-share --output=json -f qcow2 {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:58:01 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-f65e4976-8444-4545-936a-98115bd7f0fc tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/disk --force-share --output=json -f qcow2" returned: 0 in 0.183s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:58:01 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-f65e4976-8444-4545-936a-98115bd7f0fc tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:58:01 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-f65e4976-8444-4545-936a-98115bd7f0fc tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.182s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:58:01 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-f65e4976-8444-4545-936a-98115bd7f0fc tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpouv04kyr/885a9074593b4ba3b4e5727585aad302.delta 1073741824 {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:58:02 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:58:02 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-f65e4976-8444-4545-936a-98115bd7f0fc tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpouv04kyr/885a9074593b4ba3b4e5727585aad302.delta 1073741824" returned: 0 in 0.057s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:58:02 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-f65e4976-8444-4545-936a-98115bd7f0fc tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 772b126c-2148-4ca8-90f2-69d6eb4b7db7] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 18 11:58:02 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-f65e4976-8444-4545-936a-98115bd7f0fc tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74190) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 18 11:58:03 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-979c9bde-e0b3-413c-823e-c28f04154e20 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b200eb6a-be24-4a8f-be23-4e36f7b7b26e is timed out.
Oct 18 11:58:03 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-979c9bde-e0b3-413c-823e-c28f04154e20 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Successfully detached device vdb from instance b200eb6a-be24-4a8f-be23-4e36f7b7b26e from the live domain config.
Oct 18 11:58:03 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-979c9bde-e0b3-413c-823e-c28f04154e20 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: b200eb6a-be24-4a8f-be23-4e36f7b7b26e] calling os-brick to detach iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 11:58:03 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-979c9bde-e0b3-413c-823e-c28f04154e20 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, {'target_iqn': 'iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dLCemaps', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:58:03 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-979c9bde-e0b3-413c-823e-c28f04154e20 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:58:03 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-979c9bde-e0b3-413c-823e-c28f04154e20 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:58:03 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-979c9bde-e0b3-413c-823e-c28f04154e20 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:58:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:58:03 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-26be6c56-7ad7-4c18-b14e-174067d4f8c5 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Acquiring lock "95933a75-03d9-4b34-b751-69e3622f23c7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:58:03 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-26be6c56-7ad7-4c18-b14e-174067d4f8c5 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Lock "95933a75-03d9-4b34-b751-69e3622f23c7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:58:03 user nova-compute[74190]: INFO nova.compute.manager [None req-26be6c56-7ad7-4c18-b14e-174067d4f8c5 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] [instance: 95933a75-03d9-4b34-b751-69e3622f23c7] Detaching volume 9c772d30-9cad-4b3d-b0d4-f269a3c196c5
Oct 18 11:58:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:58:03 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[104476dd-b2a5-499c-bc95-70807655b9ce]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9c772d30-9cad-4b3d-b0d4-f269a3c196c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:58:03 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-979c9bde-e0b3-413c-823e-c28f04154e20 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 11:58:03 user nova-compute[74190]: No targets found.
Oct 18 11:58:03 user nova-compute[74190]: iSNS:
Oct 18 11:58:03 user nova-compute[74190]: No targets found.
Oct 18 11:58:03 user nova-compute[74190]: STATIC:
Oct 18 11:58:03 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:9c772d30-9cad-4b3d-b0d4-f269a3c196c5
Oct 18 11:58:03 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:58:03 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:58:03 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227
Oct 18 11:58:03 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:58:03 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:58:03 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa
Oct 18 11:58:03 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:58:03 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:58:03 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7
Oct 18 11:58:03 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:58:03 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:58:03 user nova-compute[74190]: FIRMWARE:
Oct 18 11:58:03 user nova-compute[74190]: No targets found.
Oct 18 11:58:03 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:58:03 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-979c9bde-e0b3-413c-823e-c28f04154e20 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 11:58:03 user nova-compute[74190]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 11:58:03 user nova-compute[74190]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74190) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 11:58:03 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-979c9bde-e0b3-413c-823e-c28f04154e20 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7', 0)] {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 11:58:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:58:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:58:03 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bfb5b04-3bf0-4f87-8ada-aa2d06cf3ceb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c772d30-9cad-4b3d-b0d4-f269a3c196c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:58:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:58:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:58:03 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[e796d591-b865-4e94-96d1-50bde5439331]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c772d30-9cad-4b3d-b0d4-f269a3c196c5 (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:58:03 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-979c9bde-e0b3-413c-823e-c28f04154e20 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 11:58:03 user nova-compute[74190]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7 (non-flash)
Oct 18 11:58:03 user nova-compute[74190]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 (non-flash)
Oct 18 11:58:03 user nova-compute[74190]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c772d30-9cad-4b3d-b0d4-f269a3c196c5 (non-flash)
Oct 18 11:58:03 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:58:03 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-979c9bde-e0b3-413c-823e-c28f04154e20 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 11:58:03 user nova-compute[74190]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7 (non-flash)
Oct 18 11:58:03 user nova-compute[74190]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 (non-flash)
Oct 18 11:58:03 user nova-compute[74190]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c772d30-9cad-4b3d-b0d4-f269a3c196c5 (non-flash)
Oct 18 11:58:03 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:58:03 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-979c9bde-e0b3-413c-823e-c28f04154e20 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1f24794ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7'): ({'sdg'}, set())}) {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 11:58:03 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-979c9bde-e0b3-413c-823e-c28f04154e20 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Removing single pathed devices sdg {{(pid=74190) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 11:58:03 user nova-compute[74190]: INFO nova.virt.block_device [None req-26be6c56-7ad7-4c18-b14e-174067d4f8c5 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] [instance: 95933a75-03d9-4b34-b751-69e3622f23c7] Attempting to driver detach volume 9c772d30-9cad-4b3d-b0d4-f269a3c196c5 from mountpoint /dev/vdb
Oct 18 11:58:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:58:03 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-f65e4976-8444-4545-936a-98115bd7f0fc tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74190) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 18 11:58:03 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-f65e4976-8444-4545-936a-98115bd7f0fc tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 772b126c-2148-4ca8-90f2-69d6eb4b7db7] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 18 11:58:03 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-26be6c56-7ad7-4c18-b14e-174067d4f8c5 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Attempting to detach device vdb from instance 95933a75-03d9-4b34-b751-69e3622f23c7 from the persistent domain config. {{(pid=74190) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 18 11:58:03 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-26be6c56-7ad7-4c18-b14e-174067d4f8c5 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 11:58:03 user nova-compute[74190]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 11:58:03 user nova-compute[74190]:   <source dev="/dev/sdb"/>
Oct 18 11:58:03 user nova-compute[74190]:   <target dev="vdb" bus="virtio"/>
Oct 18 11:58:03 user nova-compute[74190]:   <serial>9c772d30-9cad-4b3d-b0d4-f269a3c196c5</serial>
Oct 18 11:58:03 user nova-compute[74190]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 18 11:58:03 user nova-compute[74190]: </disk>
Oct 18 11:58:03 user nova-compute[74190]:  {{(pid=74190) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 11:58:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:58:03 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[61f84c07-a1af-45de-abe6-4cccb72b4d94]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:58:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:58:03 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-26be6c56-7ad7-4c18-b14e-174067d4f8c5 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Successfully detached device vdb from instance 95933a75-03d9-4b34-b751-69e3622f23c7 from the persistent domain config.
Oct 18 11:58:03 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-26be6c56-7ad7-4c18-b14e-174067d4f8c5 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 95933a75-03d9-4b34-b751-69e3622f23c7 from the live domain config. {{(pid=74190) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 18 11:58:03 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-26be6c56-7ad7-4c18-b14e-174067d4f8c5 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 11:58:03 user nova-compute[74190]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 11:58:03 user nova-compute[74190]:   <source dev="/dev/sdb"/>
Oct 18 11:58:03 user nova-compute[74190]:   <target dev="vdb" bus="virtio"/>
Oct 18 11:58:03 user nova-compute[74190]:   <serial>9c772d30-9cad-4b3d-b0d4-f269a3c196c5</serial>
Oct 18 11:58:03 user nova-compute[74190]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 18 11:58:03 user nova-compute[74190]: </disk>
Oct 18 11:58:03 user nova-compute[74190]:  {{(pid=74190) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 11:58:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.026s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:58:03 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf086ffc-2b91-4b43-8577-5857e2eb114d]: (4, ('ok\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:58:03 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-979c9bde-e0b3-413c-823e-c28f04154e20 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Flushing IO for device /dev/sdg {{(pid=74190) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 11:58:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:58:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:58:03 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[614979cc-6238-42c2-8e52-1afd45faefe6]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:58:03 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-979c9bde-e0b3-413c-823e-c28f04154e20 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74190) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 11:58:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:58:03 user nova-compute[74190]: DEBUG nova.privsep.utils [None req-f65e4976-8444-4545-936a-98115bd7f0fc tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74190) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 18 11:58:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-f65e4976-8444-4545-936a-98115bd7f0fc tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpouv04kyr/885a9074593b4ba3b4e5727585aad302.delta /opt/stack/data/nova/instances/snapshots/tmpouv04kyr/885a9074593b4ba3b4e5727585aad302 {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:58:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.049s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:58:03 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[f30ea1c4-563a-4743-b0f9-8787fece03af]: (4, ('1', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:58:03 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-979c9bde-e0b3-413c-823e-c28f04154e20 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 11:58:03 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-979c9bde-e0b3-413c-823e-c28f04154e20 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] SCSI volumes sdg have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 11:58:03 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-979c9bde-e0b3-413c-823e-c28f04154e20 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7')] {{(pid=74190) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 11:58:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:58:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:58:03 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[c75b4fbe-433c-45a9-aa7f-edb8a2e88ff2]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:58:03 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-979c9bde-e0b3-413c-823e-c28f04154e20 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:58:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7 -p 172.16.0.220:3260 --logout {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:58:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:58:03 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[95fc63cd-9610-4a6b-8791-3a1b418076b6]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:58:03 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-979c9bde-e0b3-413c-823e-c28f04154e20 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7, portal: 172.16.0.220,3260]
Oct 18 11:58:03 user nova-compute[74190]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7, portal: 172.16.0.220,3260] successful.
Oct 18 11:58:03 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:58:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7 -p 172.16.0.220:3260 --op delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:58:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f859861f-19fb-4f6a-abd3-2160677199a7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:58:03 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e20fa27-94af-417b-95ce-8dccc9d05c9c]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:58:03 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-979c9bde-e0b3-413c-823e-c28f04154e20 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:58:03 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-979c9bde-e0b3-413c-823e-c28f04154e20 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.434s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:58:03 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-979c9bde-e0b3-413c-823e-c28f04154e20 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] <== disconnect_volume: return (437ms) None {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:58:03 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-979c9bde-e0b3-413c-823e-c28f04154e20 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: b200eb6a-be24-4a8f-be23-4e36f7b7b26e] Disconnected iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 11:58:03 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-26be6c56-7ad7-4c18-b14e-174067d4f8c5 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 95933a75-03d9-4b34-b751-69e3622f23c7 {{(pid=74190) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 18 11:58:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-f65e4976-8444-4545-936a-98115bd7f0fc tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpouv04kyr/885a9074593b4ba3b4e5727585aad302.delta /opt/stack/data/nova/instances/snapshots/tmpouv04kyr/885a9074593b4ba3b4e5727585aad302" returned: 0 in 0.506s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:58:04 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-f65e4976-8444-4545-936a-98115bd7f0fc tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 772b126c-2148-4ca8-90f2-69d6eb4b7db7] Snapshot extracted, beginning image upload
Oct 18 11:58:04 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:58:04 user nova-compute[74190]: DEBUG nova.objects.instance [None req-979c9bde-e0b3-413c-823e-c28f04154e20 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lazy-loading 'flavor' on Instance uuid b200eb6a-be24-4a8f-be23-4e36f7b7b26e {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:58:04 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-979c9bde-e0b3-413c-823e-c28f04154e20 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "b200eb6a-be24-4a8f-be23-4e36f7b7b26e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.006s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:58:05 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:58:05 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:58:05 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Starting heal instance info cache {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 11:58:05 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "refresh_cache-8eec9cde-3553-4fc8-9162-cda963d1a81e" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:58:05 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquired lock "refresh_cache-8eec9cde-3553-4fc8-9162-cda963d1a81e" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:58:05 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] Forcefully refreshing network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 18 11:58:05 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] Updating instance_info_cache with network_info: [{"id": "1a9d494b-8515-4508-b0d8-387e20c897bb", "address": "fa:16:3e:41:d4:c9", "network": {"id": "56026ce6-77fb-40c7-9976-732e745c219d", "bridge": "br-int", "label": "tempest-TestStampPattern-989787934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "389e1c2dbc904130ba08b137f0b2e837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a9d494b-85", "ovs_interfaceid": "1a9d494b-8515-4508-b0d8-387e20c897bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:58:05 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Releasing lock "refresh_cache-8eec9cde-3553-4fc8-9162-cda963d1a81e" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:58:05 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] Updated the network info_cache for instance {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 18 11:58:06 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:58:06 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:58:06 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:58:06 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:58:06 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:58:06 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Auditing locally available compute resources for user (node: user) {{(pid=74190) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 11:58:06 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31a86ab2-d72d-4274-b5a6-84c5c4bdfc01/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:58:06 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31a86ab2-d72d-4274-b5a6-84c5c4bdfc01/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:58:06 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31a86ab2-d72d-4274-b5a6-84c5c4bdfc01/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:58:06 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31a86ab2-d72d-4274-b5a6-84c5c4bdfc01/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:58:06 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:58:06 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-f65e4976-8444-4545-936a-98115bd7f0fc tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 772b126c-2148-4ca8-90f2-69d6eb4b7db7] Snapshot image upload complete
Oct 18 11:58:06 user nova-compute[74190]: INFO nova.compute.manager [None req-f65e4976-8444-4545-936a-98115bd7f0fc tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 772b126c-2148-4ca8-90f2-69d6eb4b7db7] Took 5.72 seconds to snapshot the instance on the hypervisor.
Oct 18 11:58:06 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:58:06 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:58:07 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:58:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:58:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eec9cde-3553-4fc8-9162-cda963d1a81e/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:58:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eec9cde-3553-4fc8-9162-cda963d1a81e/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:58:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eec9cde-3553-4fc8-9162-cda963d1a81e/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:58:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eec9cde-3553-4fc8-9162-cda963d1a81e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:58:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b200eb6a-be24-4a8f-be23-4e36f7b7b26e/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:58:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b200eb6a-be24-4a8f-be23-4e36f7b7b26e/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:58:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b200eb6a-be24-4a8f-be23-4e36f7b7b26e/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:58:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b200eb6a-be24-4a8f-be23-4e36f7b7b26e/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:58:07 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 11:58:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:58:08 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:58:08 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:58:08 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:58:08 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0209c824-88a7-4976-83bf-8a72437f0cc2/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:58:08 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0209c824-88a7-4976-83bf-8a72437f0cc2/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:58:08 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0209c824-88a7-4976-83bf-8a72437f0cc2/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:58:08 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0209c824-88a7-4976-83bf-8a72437f0cc2/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:58:08 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:58:08 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:58:08 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:58:09 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:58:09 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 11:58:09 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk.rescue --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:58:09 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:58:09 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk.rescue --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:58:09 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:58:09 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:58:09 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:58:09 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:58:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:58:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95933a75-03d9-4b34-b751-69e3622f23c7/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:58:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95933a75-03d9-4b34-b751-69e3622f23c7/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:58:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95933a75-03d9-4b34-b751-69e3622f23c7/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:58:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95933a75-03d9-4b34-b751-69e3622f23c7/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:58:10 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:58:10 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:58:10 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Hypervisor/Node resource view: name=user free_ram=7561MB free_disk=25.048995971679688GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74190) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 11:58:10 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:58:10 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:58:10 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:58:10 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 0209c824-88a7-4976-83bf-8a72437f0cc2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:58:10 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 4e916d24-9f9d-4289-87ce-f65d2499fcd9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:58:10 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 8eec9cde-3553-4fc8-9162-cda963d1a81e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:58:10 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance b200eb6a-be24-4a8f-be23-4e36f7b7b26e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:58:10 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 95ca0697-22b5-4109-868f-ca5556015a1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:58:10 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 42413a94-9973-4e8d-83b6-207a4e7847c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:58:10 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 31a86ab2-d72d-4274-b5a6-84c5c4bdfc01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:58:10 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance a9012673-826b-4be7-a55b-9bb35a227c17 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:58:10 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 95933a75-03d9-4b34-b751-69e3622f23c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:58:10 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 772b126c-2148-4ca8-90f2-69d6eb4b7db7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:58:10 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 11:58:10 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 11:58:11 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Refreshing inventories for resource provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 18 11:58:11 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Updating ProviderTree inventory for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 18 11:58:11 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Updating inventory in ProviderTree for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 18 11:58:11 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Refreshing aggregate associations for resource provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66, aggregates: None {{(pid=74190) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 18 11:58:11 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Refreshing trait associations for resource provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66, traits: COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE42,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_ACCELERATORS,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=74190) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 18 11:58:11 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 11:58:11 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 11:58:11 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Compute_service record updated for user:user {{(pid=74190) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 11:58:11 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.833s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:58:12 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:58:12 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-5b621508-97f2-44f7-91e8-ac4a6e1ac251 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Acquiring lock "31a86ab2-d72d-4274-b5a6-84c5c4bdfc01" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:58:12 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-5b621508-97f2-44f7-91e8-ac4a6e1ac251 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Lock "31a86ab2-d72d-4274-b5a6-84c5c4bdfc01" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:58:12 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-5b621508-97f2-44f7-91e8-ac4a6e1ac251 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Acquiring lock "31a86ab2-d72d-4274-b5a6-84c5c4bdfc01-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:58:12 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-5b621508-97f2-44f7-91e8-ac4a6e1ac251 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Lock "31a86ab2-d72d-4274-b5a6-84c5c4bdfc01-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:58:12 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-5b621508-97f2-44f7-91e8-ac4a6e1ac251 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Lock "31a86ab2-d72d-4274-b5a6-84c5c4bdfc01-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:58:12 user nova-compute[74190]: INFO nova.compute.manager [None req-5b621508-97f2-44f7-91e8-ac4a6e1ac251 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] [instance: 31a86ab2-d72d-4274-b5a6-84c5c4bdfc01] Terminating instance
Oct 18 11:58:12 user nova-compute[74190]: DEBUG nova.compute.manager [None req-5b621508-97f2-44f7-91e8-ac4a6e1ac251 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] [instance: 31a86ab2-d72d-4274-b5a6-84c5c4bdfc01] Start destroying the instance on the hypervisor. {{(pid=74190) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 11:58:12 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:58:12 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:58:12 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:58:12 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:58:12 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:58:12 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:58:13 user nova-compute[74190]: DEBUG nova.compute.manager [req-f8ee47ff-f604-477e-ba1a-acb8b55f8061 req-dd840f2b-35c1-474e-9973-467d883b7d11 service nova] [instance: 31a86ab2-d72d-4274-b5a6-84c5c4bdfc01] Received event network-vif-unplugged-5c59d9a0-1a31-4096-a5aa-ca1e4f46d0fc {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:58:13 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-f8ee47ff-f604-477e-ba1a-acb8b55f8061 req-dd840f2b-35c1-474e-9973-467d883b7d11 service nova] Acquiring lock "31a86ab2-d72d-4274-b5a6-84c5c4bdfc01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:58:13 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-f8ee47ff-f604-477e-ba1a-acb8b55f8061 req-dd840f2b-35c1-474e-9973-467d883b7d11 service nova] Lock "31a86ab2-d72d-4274-b5a6-84c5c4bdfc01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:58:13 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-f8ee47ff-f604-477e-ba1a-acb8b55f8061 req-dd840f2b-35c1-474e-9973-467d883b7d11 service nova] Lock "31a86ab2-d72d-4274-b5a6-84c5c4bdfc01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:58:13 user nova-compute[74190]: DEBUG nova.compute.manager [req-f8ee47ff-f604-477e-ba1a-acb8b55f8061 req-dd840f2b-35c1-474e-9973-467d883b7d11 service nova] [instance: 31a86ab2-d72d-4274-b5a6-84c5c4bdfc01] No waiting events found dispatching network-vif-unplugged-5c59d9a0-1a31-4096-a5aa-ca1e4f46d0fc {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:58:13 user nova-compute[74190]: DEBUG nova.compute.manager [req-f8ee47ff-f604-477e-ba1a-acb8b55f8061 req-dd840f2b-35c1-474e-9973-467d883b7d11 service nova] [instance: 31a86ab2-d72d-4274-b5a6-84c5c4bdfc01] Received event network-vif-unplugged-5c59d9a0-1a31-4096-a5aa-ca1e4f46d0fc for instance with task_state deleting. {{(pid=74190) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 11:58:13 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 31a86ab2-d72d-4274-b5a6-84c5c4bdfc01] Instance destroyed successfully.
Oct 18 11:58:13 user nova-compute[74190]: DEBUG nova.objects.instance [None req-5b621508-97f2-44f7-91e8-ac4a6e1ac251 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Lazy-loading 'resources' on Instance uuid 31a86ab2-d72d-4274-b5a6-84c5c4bdfc01 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:58:13 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-5b621508-97f2-44f7-91e8-ac4a6e1ac251 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:54:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1987002089',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1987002089',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1987002',id=26,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAp1pyualrt+ClKnRPPGTl9IqX5o+FXRgWE2Anaz/U3+mO/cfgwkEem3BGWxgaKTCFw/B19g1u7AupjN2mjHajBqQNfxbk7e5EWfS5S5bbUkxpwb+w5+dI/yfcNzSls4XQ==',key_name='tempest-keypair-738545322',keypairs=<?>,launch_index=0,launched_at=2023-10-18T11:54:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c49002c1f5044a13b4c70aa5cc9bf45e',ramdisk_id='',reservation_id='r-orx2sciz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1464642078',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T11:54:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='adbb4169207e403187eeb180b304b632',uuid=31a86ab2-d72d-4274-b5a6-84c5c4bdfc01,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5c59d9a0-1a31-4096-a5aa-ca1e4f46d0fc", "address": "fa:16:3e:25:cc:e5", "network": {"id": "0a2d5316-a012-43d3-a7c7-54b8cff14dca", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1175284376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c49002c1f5044a13b4c70aa5cc9bf45e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c59d9a0-1a", "ovs_interfaceid": "5c59d9a0-1a31-4096-a5aa-ca1e4f46d0fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 11:58:13 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-5b621508-97f2-44f7-91e8-ac4a6e1ac251 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Converting VIF {"id": "5c59d9a0-1a31-4096-a5aa-ca1e4f46d0fc", "address": "fa:16:3e:25:cc:e5", "network": {"id": "0a2d5316-a012-43d3-a7c7-54b8cff14dca", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1175284376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c49002c1f5044a13b4c70aa5cc9bf45e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c59d9a0-1a", "ovs_interfaceid": "5c59d9a0-1a31-4096-a5aa-ca1e4f46d0fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:58:13 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-5b621508-97f2-44f7-91e8-ac4a6e1ac251 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:25:cc:e5,bridge_name='br-int',has_traffic_filtering=True,id=5c59d9a0-1a31-4096-a5aa-ca1e4f46d0fc,network=Network(0a2d5316-a012-43d3-a7c7-54b8cff14dca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c59d9a0-1a') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:58:13 user nova-compute[74190]: DEBUG os_vif [None req-5b621508-97f2-44f7-91e8-ac4a6e1ac251 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:25:cc:e5,bridge_name='br-int',has_traffic_filtering=True,id=5c59d9a0-1a31-4096-a5aa-ca1e4f46d0fc,network=Network(0a2d5316-a012-43d3-a7c7-54b8cff14dca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c59d9a0-1a') {{(pid=74190) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 11:58:13 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:58:13 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5c59d9a0-1a, bridge=br-int, if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:58:13 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:58:13 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:58:13 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=edb27d67-4d48-4330-ac3e-6241483ae390) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:58:13 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:58:13 user nova-compute[74190]: INFO os_vif [None req-5b621508-97f2-44f7-91e8-ac4a6e1ac251 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:25:cc:e5,bridge_name='br-int',has_traffic_filtering=True,id=5c59d9a0-1a31-4096-a5aa-ca1e4f46d0fc,network=Network(0a2d5316-a012-43d3-a7c7-54b8cff14dca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c59d9a0-1a')
Oct 18 11:58:13 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-5b621508-97f2-44f7-91e8-ac4a6e1ac251 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] [instance: 31a86ab2-d72d-4274-b5a6-84c5c4bdfc01] Deleting instance files /opt/stack/data/nova/instances/31a86ab2-d72d-4274-b5a6-84c5c4bdfc01_del
Oct 18 11:58:13 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-5b621508-97f2-44f7-91e8-ac4a6e1ac251 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] [instance: 31a86ab2-d72d-4274-b5a6-84c5c4bdfc01] Deletion of /opt/stack/data/nova/instances/31a86ab2-d72d-4274-b5a6-84c5c4bdfc01_del complete
Oct 18 11:58:13 user nova-compute[74190]: INFO nova.compute.manager [None req-5b621508-97f2-44f7-91e8-ac4a6e1ac251 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] [instance: 31a86ab2-d72d-4274-b5a6-84c5c4bdfc01] Took 0.94 seconds to destroy the instance on the hypervisor.
Oct 18 11:58:13 user nova-compute[74190]: DEBUG oslo.service.loopingcall [None req-5b621508-97f2-44f7-91e8-ac4a6e1ac251 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74190) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 11:58:13 user nova-compute[74190]: DEBUG nova.compute.manager [-] [instance: 31a86ab2-d72d-4274-b5a6-84c5c4bdfc01] Deallocating network for instance {{(pid=74190) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 11:58:13 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: 31a86ab2-d72d-4274-b5a6-84c5c4bdfc01] deallocate_for_instance() {{(pid=74190) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 11:58:14 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: 31a86ab2-d72d-4274-b5a6-84c5c4bdfc01] Updating instance_info_cache with network_info: [] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:58:14 user nova-compute[74190]: INFO nova.compute.manager [-] [instance: 31a86ab2-d72d-4274-b5a6-84c5c4bdfc01] Took 0.81 seconds to deallocate network for instance.
Oct 18 11:58:14 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-5b621508-97f2-44f7-91e8-ac4a6e1ac251 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:58:14 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-5b621508-97f2-44f7-91e8-ac4a6e1ac251 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:58:14 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-5b621508-97f2-44f7-91e8-ac4a6e1ac251 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 11:58:14 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-5b621508-97f2-44f7-91e8-ac4a6e1ac251 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 11:58:14 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-5b621508-97f2-44f7-91e8-ac4a6e1ac251 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.320s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:58:14 user nova-compute[74190]: INFO nova.scheduler.client.report [None req-5b621508-97f2-44f7-91e8-ac4a6e1ac251 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Deleted allocations for instance 31a86ab2-d72d-4274-b5a6-84c5c4bdfc01
Oct 18 11:58:14 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-5b621508-97f2-44f7-91e8-ac4a6e1ac251 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078 tempest-TestServerVolumeAttachScenarioOldVersion-1464642078-project-member] Lock "31a86ab2-d72d-4274-b5a6-84c5c4bdfc01" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.249s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:58:15 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:58:15 user nova-compute[74190]: DEBUG nova.compute.manager [req-d173c797-5e64-41fa-871b-8cdf91dc8fa0 req-e94fa41b-a7ab-42f0-bb19-db95a281a962 service nova] [instance: 31a86ab2-d72d-4274-b5a6-84c5c4bdfc01] Received event network-vif-plugged-5c59d9a0-1a31-4096-a5aa-ca1e4f46d0fc {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:58:15 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d173c797-5e64-41fa-871b-8cdf91dc8fa0 req-e94fa41b-a7ab-42f0-bb19-db95a281a962 service nova] Acquiring lock "31a86ab2-d72d-4274-b5a6-84c5c4bdfc01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:58:15 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d173c797-5e64-41fa-871b-8cdf91dc8fa0 req-e94fa41b-a7ab-42f0-bb19-db95a281a962 service nova] Lock "31a86ab2-d72d-4274-b5a6-84c5c4bdfc01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:58:15 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d173c797-5e64-41fa-871b-8cdf91dc8fa0 req-e94fa41b-a7ab-42f0-bb19-db95a281a962 service nova] Lock "31a86ab2-d72d-4274-b5a6-84c5c4bdfc01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:58:15 user nova-compute[74190]: DEBUG nova.compute.manager [req-d173c797-5e64-41fa-871b-8cdf91dc8fa0 req-e94fa41b-a7ab-42f0-bb19-db95a281a962 service nova] [instance: 31a86ab2-d72d-4274-b5a6-84c5c4bdfc01] No waiting events found dispatching network-vif-plugged-5c59d9a0-1a31-4096-a5aa-ca1e4f46d0fc {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:58:15 user nova-compute[74190]: WARNING nova.compute.manager [req-d173c797-5e64-41fa-871b-8cdf91dc8fa0 req-e94fa41b-a7ab-42f0-bb19-db95a281a962 service nova] [instance: 31a86ab2-d72d-4274-b5a6-84c5c4bdfc01] Received unexpected event network-vif-plugged-5c59d9a0-1a31-4096-a5aa-ca1e4f46d0fc for instance with vm_state deleted and task_state None.
Oct 18 11:58:15 user nova-compute[74190]: DEBUG nova.compute.manager [req-d173c797-5e64-41fa-871b-8cdf91dc8fa0 req-e94fa41b-a7ab-42f0-bb19-db95a281a962 service nova] [instance: 31a86ab2-d72d-4274-b5a6-84c5c4bdfc01] Received event network-vif-deleted-5c59d9a0-1a31-4096-a5aa-ca1e4f46d0fc {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:58:18 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:58:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:58:23 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-26be6c56-7ad7-4c18-b14e-174067d4f8c5 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 95933a75-03d9-4b34-b751-69e3622f23c7 is timed out.
Oct 18 11:58:23 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-26be6c56-7ad7-4c18-b14e-174067d4f8c5 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Successfully detached device vdb from instance 95933a75-03d9-4b34-b751-69e3622f23c7 from the live domain config.
Oct 18 11:58:23 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26be6c56-7ad7-4c18-b14e-174067d4f8c5 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] [instance: 95933a75-03d9-4b34-b751-69e3622f23c7] calling os-brick to detach iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 11:58:23 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-26be6c56-7ad7-4c18-b14e-174067d4f8c5 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, {'target_iqn': 'iqn.2010-10.org.openstack:9c772d30-9cad-4b3d-b0d4-f269a3c196c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tangqAIp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:58:23 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-26be6c56-7ad7-4c18-b14e-174067d4f8c5 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:58:23 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-26be6c56-7ad7-4c18-b14e-174067d4f8c5 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:58:23 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-26be6c56-7ad7-4c18-b14e-174067d4f8c5 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:58:23 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:58:23 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:58:23 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c35761-7dd7-4685-ad59-cf2c87a486d3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9c772d30-9cad-4b3d-b0d4-f269a3c196c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:58:23 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-26be6c56-7ad7-4c18-b14e-174067d4f8c5 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 11:58:23 user nova-compute[74190]: No targets found.
Oct 18 11:58:23 user nova-compute[74190]: iSNS:
Oct 18 11:58:23 user nova-compute[74190]: No targets found.
Oct 18 11:58:23 user nova-compute[74190]: STATIC:
Oct 18 11:58:23 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:9c772d30-9cad-4b3d-b0d4-f269a3c196c5
Oct 18 11:58:23 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:58:23 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:58:23 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227
Oct 18 11:58:23 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:58:23 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:58:23 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa
Oct 18 11:58:23 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:58:23 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:58:23 user nova-compute[74190]: FIRMWARE:
Oct 18 11:58:23 user nova-compute[74190]: No targets found.
Oct 18 11:58:23 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:58:23 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-26be6c56-7ad7-4c18-b14e-174067d4f8c5 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 11:58:23 user nova-compute[74190]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 11:58:23 user nova-compute[74190]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74190) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 11:58:23 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-26be6c56-7ad7-4c18-b14e-174067d4f8c5 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c772d30-9cad-4b3d-b0d4-f269a3c196c5', 0)] {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 11:58:23 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:58:23 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:58:23 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[2168415e-ee3f-48a9-9397-d234e788f675]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c772d30-9cad-4b3d-b0d4-f269a3c196c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:58:23 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:58:24 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:58:24 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[3924ccc1-1a6d-41e0-b3b5-f16da7693990]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c772d30-9cad-4b3d-b0d4-f269a3c196c5 (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:58:24 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-26be6c56-7ad7-4c18-b14e-174067d4f8c5 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 11:58:24 user nova-compute[74190]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 (non-flash)
Oct 18 11:58:24 user nova-compute[74190]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c772d30-9cad-4b3d-b0d4-f269a3c196c5 (non-flash)
Oct 18 11:58:24 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:58:24 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-26be6c56-7ad7-4c18-b14e-174067d4f8c5 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 11:58:24 user nova-compute[74190]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 (non-flash)
Oct 18 11:58:24 user nova-compute[74190]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c772d30-9cad-4b3d-b0d4-f269a3c196c5 (non-flash)
Oct 18 11:58:24 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:58:24 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-26be6c56-7ad7-4c18-b14e-174067d4f8c5 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1f44784280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c772d30-9cad-4b3d-b0d4-f269a3c196c5'): ({'sdb'}, set())}) {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 11:58:24 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-26be6c56-7ad7-4c18-b14e-174067d4f8c5 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Removing single pathed devices sdb {{(pid=74190) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 11:58:24 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:58:24 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:58:24 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ebaadfc-6587-45c6-a763-7e55d2a21699]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:58:24 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:58:24 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:58:24 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[451d04d4-c552-4bc4-86a9-f97498f4e883]: (4, ('ok\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:58:24 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-26be6c56-7ad7-4c18-b14e-174067d4f8c5 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Flushing IO for device /dev/sdb {{(pid=74190) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 11:58:24 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:58:24 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:58:24 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[15512868-12dc-4c3c-9578-444db3664ee2]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:58:24 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-26be6c56-7ad7-4c18-b14e-174067d4f8c5 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74190) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 11:58:24 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:58:24 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:58:24 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[610d3f8c-6385-4503-b195-311c6e501874]: (4, ('1', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:58:24 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-26be6c56-7ad7-4c18-b14e-174067d4f8c5 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 11:58:24 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-26be6c56-7ad7-4c18-b14e-174067d4f8c5 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] SCSI volumes sdb have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 11:58:24 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-26be6c56-7ad7-4c18-b14e-174067d4f8c5 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c772d30-9cad-4b3d-b0d4-f269a3c196c5')] {{(pid=74190) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 11:58:24 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c772d30-9cad-4b3d-b0d4-f269a3c196c5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:58:24 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c772d30-9cad-4b3d-b0d4-f269a3c196c5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:58:24 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[500e050e-d7cf-44ed-a08a-eea1c6b452ae]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:58:24 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-26be6c56-7ad7-4c18-b14e-174067d4f8c5 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:58:24 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c772d30-9cad-4b3d-b0d4-f269a3c196c5 -p 172.16.0.220:3260 --logout {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:58:24 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c772d30-9cad-4b3d-b0d4-f269a3c196c5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:58:24 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f5122d4-8cf4-488e-ad56-5fac2643e3d2]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:9c772d30-9cad-4b3d-b0d4-f269a3c196c5, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:9c772d30-9cad-4b3d-b0d4-f269a3c196c5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:58:24 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-26be6c56-7ad7-4c18-b14e-174067d4f8c5 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:9c772d30-9cad-4b3d-b0d4-f269a3c196c5, portal: 172.16.0.220,3260]
Oct 18 11:58:24 user nova-compute[74190]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:9c772d30-9cad-4b3d-b0d4-f269a3c196c5, portal: 172.16.0.220,3260] successful.
Oct 18 11:58:24 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:58:24 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c772d30-9cad-4b3d-b0d4-f269a3c196c5 -p 172.16.0.220:3260 --op delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:58:24 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c772d30-9cad-4b3d-b0d4-f269a3c196c5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:58:24 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ca1c03-634a-47c1-9f60-2aa9a8b7b941]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:58:24 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-26be6c56-7ad7-4c18-b14e-174067d4f8c5 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:58:24 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-26be6c56-7ad7-4c18-b14e-174067d4f8c5 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:58:24 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-26be6c56-7ad7-4c18-b14e-174067d4f8c5 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] <== disconnect_volume: return (297ms) None {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:58:24 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26be6c56-7ad7-4c18-b14e-174067d4f8c5 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] [instance: 95933a75-03d9-4b34-b751-69e3622f23c7] Disconnected iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 11:58:25 user nova-compute[74190]: DEBUG nova.objects.instance [None req-26be6c56-7ad7-4c18-b14e-174067d4f8c5 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Lazy-loading 'flavor' on Instance uuid 95933a75-03d9-4b34-b751-69e3622f23c7 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:58:25 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-26be6c56-7ad7-4c18-b14e-174067d4f8c5 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Lock "95933a75-03d9-4b34-b751-69e3622f23c7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.813s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:58:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:58:33 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-aeac6674-4df2-4b47-aa9d-57e6ee21062b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Acquiring lock "b200eb6a-be24-4a8f-be23-4e36f7b7b26e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:58:33 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-aeac6674-4df2-4b47-aa9d-57e6ee21062b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "b200eb6a-be24-4a8f-be23-4e36f7b7b26e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:58:33 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-aeac6674-4df2-4b47-aa9d-57e6ee21062b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Acquiring lock "b200eb6a-be24-4a8f-be23-4e36f7b7b26e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:58:33 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-aeac6674-4df2-4b47-aa9d-57e6ee21062b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "b200eb6a-be24-4a8f-be23-4e36f7b7b26e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:58:33 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-aeac6674-4df2-4b47-aa9d-57e6ee21062b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "b200eb6a-be24-4a8f-be23-4e36f7b7b26e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:58:33 user nova-compute[74190]: INFO nova.compute.manager [None req-aeac6674-4df2-4b47-aa9d-57e6ee21062b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: b200eb6a-be24-4a8f-be23-4e36f7b7b26e] Terminating instance
Oct 18 11:58:33 user nova-compute[74190]: DEBUG nova.compute.manager [None req-aeac6674-4df2-4b47-aa9d-57e6ee21062b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: b200eb6a-be24-4a8f-be23-4e36f7b7b26e] Start destroying the instance on the hypervisor. {{(pid=74190) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 11:58:33 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:58:33 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:58:33 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:58:33 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:58:33 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:58:33 user nova-compute[74190]: DEBUG nova.compute.manager [req-71d94192-71c7-4714-a063-92ec1b1865fb req-9b044f9d-5357-4881-b874-cd6d8b258c8d service nova] [instance: b200eb6a-be24-4a8f-be23-4e36f7b7b26e] Received event network-vif-unplugged-c9514478-3402-47b2-b649-0b8b762c1a35 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:58:33 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-71d94192-71c7-4714-a063-92ec1b1865fb req-9b044f9d-5357-4881-b874-cd6d8b258c8d service nova] Acquiring lock "b200eb6a-be24-4a8f-be23-4e36f7b7b26e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:58:33 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-71d94192-71c7-4714-a063-92ec1b1865fb req-9b044f9d-5357-4881-b874-cd6d8b258c8d service nova] Lock "b200eb6a-be24-4a8f-be23-4e36f7b7b26e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:58:33 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-71d94192-71c7-4714-a063-92ec1b1865fb req-9b044f9d-5357-4881-b874-cd6d8b258c8d service nova] Lock "b200eb6a-be24-4a8f-be23-4e36f7b7b26e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:58:33 user nova-compute[74190]: DEBUG nova.compute.manager [req-71d94192-71c7-4714-a063-92ec1b1865fb req-9b044f9d-5357-4881-b874-cd6d8b258c8d service nova] [instance: b200eb6a-be24-4a8f-be23-4e36f7b7b26e] No waiting events found dispatching network-vif-unplugged-c9514478-3402-47b2-b649-0b8b762c1a35 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:58:33 user nova-compute[74190]: DEBUG nova.compute.manager [req-71d94192-71c7-4714-a063-92ec1b1865fb req-9b044f9d-5357-4881-b874-cd6d8b258c8d service nova] [instance: b200eb6a-be24-4a8f-be23-4e36f7b7b26e] Received event network-vif-unplugged-c9514478-3402-47b2-b649-0b8b762c1a35 for instance with task_state deleting. {{(pid=74190) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 11:58:33 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: b200eb6a-be24-4a8f-be23-4e36f7b7b26e] Instance destroyed successfully.
Oct 18 11:58:33 user nova-compute[74190]: DEBUG nova.objects.instance [None req-aeac6674-4df2-4b47-aa9d-57e6ee21062b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lazy-loading 'resources' on Instance uuid b200eb6a-be24-4a8f-be23-4e36f7b7b26e {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:58:33 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-aeac6674-4df2-4b47-aa9d-57e6ee21062b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:52:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1988495736',display_name='tempest-AttachVolumeNegativeTest-server-1988495736',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1988495736',id=22,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+VhIsnrQ1pBl9gGgofPIbSrQYqk/GismLcdAftsesKJUpwN7y1HwqWfeEUHaJv9CXbqXOJ3xxgxfB7vWEIeDeGCahXw/27YEUII2L9wGgWPQrN7JoAQEEpUGSp4sdOOA==',key_name='tempest-keypair-2102343167',keypairs=<?>,launch_index=0,launched_at=2023-10-18T11:52:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='df06c4b010434e3da9ba4ea41f26befa',ramdisk_id='',reservation_id='r-ye714lsh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1730208605',owner_user_name='tempest-AttachVolumeNegativeTest-1730208605-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T11:52:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d6bb993153245daabfc59215abbf7a1',uuid=b200eb6a-be24-4a8f-be23-4e36f7b7b26e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c9514478-3402-47b2-b649-0b8b762c1a35", "address": "fa:16:3e:5a:49:f4", "network": {"id": "25e0d6f5-497d-4898-8181-5b4848950f16", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-245925644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df06c4b010434e3da9ba4ea41f26befa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9514478-34", "ovs_interfaceid": "c9514478-3402-47b2-b649-0b8b762c1a35", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 11:58:33 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-aeac6674-4df2-4b47-aa9d-57e6ee21062b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Converting VIF {"id": "c9514478-3402-47b2-b649-0b8b762c1a35", "address": "fa:16:3e:5a:49:f4", "network": {"id": "25e0d6f5-497d-4898-8181-5b4848950f16", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-245925644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df06c4b010434e3da9ba4ea41f26befa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9514478-34", "ovs_interfaceid": "c9514478-3402-47b2-b649-0b8b762c1a35", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:58:33 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-aeac6674-4df2-4b47-aa9d-57e6ee21062b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5a:49:f4,bridge_name='br-int',has_traffic_filtering=True,id=c9514478-3402-47b2-b649-0b8b762c1a35,network=Network(25e0d6f5-497d-4898-8181-5b4848950f16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9514478-34') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:58:33 user nova-compute[74190]: DEBUG os_vif [None req-aeac6674-4df2-4b47-aa9d-57e6ee21062b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:49:f4,bridge_name='br-int',has_traffic_filtering=True,id=c9514478-3402-47b2-b649-0b8b762c1a35,network=Network(25e0d6f5-497d-4898-8181-5b4848950f16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9514478-34') {{(pid=74190) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 11:58:33 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:58:33 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc9514478-34, bridge=br-int, if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:58:33 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:58:33 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:58:33 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:58:33 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=35e52b62-e329-4b0a-aa8b-ebfa8320ee95) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:58:33 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:58:33 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:58:33 user nova-compute[74190]: INFO os_vif [None req-aeac6674-4df2-4b47-aa9d-57e6ee21062b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:49:f4,bridge_name='br-int',has_traffic_filtering=True,id=c9514478-3402-47b2-b649-0b8b762c1a35,network=Network(25e0d6f5-497d-4898-8181-5b4848950f16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9514478-34')
Oct 18 11:58:33 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-aeac6674-4df2-4b47-aa9d-57e6ee21062b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: b200eb6a-be24-4a8f-be23-4e36f7b7b26e] Deleting instance files /opt/stack/data/nova/instances/b200eb6a-be24-4a8f-be23-4e36f7b7b26e_del
Oct 18 11:58:33 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-aeac6674-4df2-4b47-aa9d-57e6ee21062b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: b200eb6a-be24-4a8f-be23-4e36f7b7b26e] Deletion of /opt/stack/data/nova/instances/b200eb6a-be24-4a8f-be23-4e36f7b7b26e_del complete
Oct 18 11:58:33 user nova-compute[74190]: INFO nova.compute.manager [None req-aeac6674-4df2-4b47-aa9d-57e6ee21062b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: b200eb6a-be24-4a8f-be23-4e36f7b7b26e] Took 0.84 seconds to destroy the instance on the hypervisor.
Oct 18 11:58:33 user nova-compute[74190]: DEBUG oslo.service.loopingcall [None req-aeac6674-4df2-4b47-aa9d-57e6ee21062b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74190) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 11:58:33 user nova-compute[74190]: DEBUG nova.compute.manager [-] [instance: b200eb6a-be24-4a8f-be23-4e36f7b7b26e] Deallocating network for instance {{(pid=74190) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 11:58:33 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: b200eb6a-be24-4a8f-be23-4e36f7b7b26e] deallocate_for_instance() {{(pid=74190) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 11:58:34 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: b200eb6a-be24-4a8f-be23-4e36f7b7b26e] Updating instance_info_cache with network_info: [] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:58:34 user nova-compute[74190]: INFO nova.compute.manager [-] [instance: b200eb6a-be24-4a8f-be23-4e36f7b7b26e] Took 0.61 seconds to deallocate network for instance.
Oct 18 11:58:34 user nova-compute[74190]: DEBUG nova.compute.manager [req-f7075c3f-380b-486c-b86d-679966f04489 req-3cf741cb-c5ec-4a99-8799-c65f117df6e2 service nova] [instance: b200eb6a-be24-4a8f-be23-4e36f7b7b26e] Received event network-vif-deleted-c9514478-3402-47b2-b649-0b8b762c1a35 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:58:34 user nova-compute[74190]: INFO nova.compute.manager [req-f7075c3f-380b-486c-b86d-679966f04489 req-3cf741cb-c5ec-4a99-8799-c65f117df6e2 service nova] [instance: b200eb6a-be24-4a8f-be23-4e36f7b7b26e] Neutron deleted interface c9514478-3402-47b2-b649-0b8b762c1a35; detaching it from the instance and deleting it from the info cache
Oct 18 11:58:34 user nova-compute[74190]: DEBUG nova.network.neutron [req-f7075c3f-380b-486c-b86d-679966f04489 req-3cf741cb-c5ec-4a99-8799-c65f117df6e2 service nova] [instance: b200eb6a-be24-4a8f-be23-4e36f7b7b26e] Updating instance_info_cache with network_info: [] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:58:34 user nova-compute[74190]: DEBUG nova.compute.manager [req-f7075c3f-380b-486c-b86d-679966f04489 req-3cf741cb-c5ec-4a99-8799-c65f117df6e2 service nova] [instance: b200eb6a-be24-4a8f-be23-4e36f7b7b26e] Detach interface failed, port_id=c9514478-3402-47b2-b649-0b8b762c1a35, reason: Instance b200eb6a-be24-4a8f-be23-4e36f7b7b26e could not be found. {{(pid=74190) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 18 11:58:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-aeac6674-4df2-4b47-aa9d-57e6ee21062b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:58:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-aeac6674-4df2-4b47-aa9d-57e6ee21062b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:58:34 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-aeac6674-4df2-4b47-aa9d-57e6ee21062b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 11:58:34 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-aeac6674-4df2-4b47-aa9d-57e6ee21062b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 11:58:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-aeac6674-4df2-4b47-aa9d-57e6ee21062b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.298s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:58:34 user nova-compute[74190]: INFO nova.scheduler.client.report [None req-aeac6674-4df2-4b47-aa9d-57e6ee21062b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Deleted allocations for instance b200eb6a-be24-4a8f-be23-4e36f7b7b26e
Oct 18 11:58:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-aeac6674-4df2-4b47-aa9d-57e6ee21062b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "b200eb6a-be24-4a8f-be23-4e36f7b7b26e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.954s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:58:35 user nova-compute[74190]: INFO nova.compute.manager [None req-9b174fff-e6a0-405d-8787-852e291d04ee tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Get console output
Oct 18 11:58:35 user nova-compute[74190]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Oct 18 11:58:35 user nova-compute[74190]: DEBUG nova.compute.manager [req-197297d9-a4f4-4850-8ea6-9354f5a2db27 req-aaf3ee39-1b62-40ad-b14b-f07ef06a3099 service nova] [instance: b200eb6a-be24-4a8f-be23-4e36f7b7b26e] Received event network-vif-plugged-c9514478-3402-47b2-b649-0b8b762c1a35 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:58:35 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-197297d9-a4f4-4850-8ea6-9354f5a2db27 req-aaf3ee39-1b62-40ad-b14b-f07ef06a3099 service nova] Acquiring lock "b200eb6a-be24-4a8f-be23-4e36f7b7b26e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:58:35 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-197297d9-a4f4-4850-8ea6-9354f5a2db27 req-aaf3ee39-1b62-40ad-b14b-f07ef06a3099 service nova] Lock "b200eb6a-be24-4a8f-be23-4e36f7b7b26e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:58:35 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-197297d9-a4f4-4850-8ea6-9354f5a2db27 req-aaf3ee39-1b62-40ad-b14b-f07ef06a3099 service nova] Lock "b200eb6a-be24-4a8f-be23-4e36f7b7b26e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:58:35 user nova-compute[74190]: DEBUG nova.compute.manager [req-197297d9-a4f4-4850-8ea6-9354f5a2db27 req-aaf3ee39-1b62-40ad-b14b-f07ef06a3099 service nova] [instance: b200eb6a-be24-4a8f-be23-4e36f7b7b26e] No waiting events found dispatching network-vif-plugged-c9514478-3402-47b2-b649-0b8b762c1a35 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:58:35 user nova-compute[74190]: WARNING nova.compute.manager [req-197297d9-a4f4-4850-8ea6-9354f5a2db27 req-aaf3ee39-1b62-40ad-b14b-f07ef06a3099 service nova] [instance: b200eb6a-be24-4a8f-be23-4e36f7b7b26e] Received unexpected event network-vif-plugged-c9514478-3402-47b2-b649-0b8b762c1a35 for instance with vm_state deleted and task_state None.
Oct 18 11:58:38 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:58:40 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:58:43 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:58:46 user nova-compute[74190]: INFO nova.compute.manager [None req-526e9d77-6bb3-4610-adcf-b2abf6d6c0c8 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] Rescuing
Oct 18 11:58:46 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-526e9d77-6bb3-4610-adcf-b2abf6d6c0c8 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Acquiring lock "refresh_cache-95ca0697-22b5-4109-868f-ca5556015a1f" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:58:46 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-526e9d77-6bb3-4610-adcf-b2abf6d6c0c8 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Acquired lock "refresh_cache-95ca0697-22b5-4109-868f-ca5556015a1f" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:58:46 user nova-compute[74190]: DEBUG nova.network.neutron [None req-526e9d77-6bb3-4610-adcf-b2abf6d6c0c8 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] Building network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 11:58:46 user nova-compute[74190]: DEBUG nova.network.neutron [None req-526e9d77-6bb3-4610-adcf-b2abf6d6c0c8 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] Updating instance_info_cache with network_info: [{"id": "58c81983-46ab-4026-b712-775ae319a09f", "address": "fa:16:3e:dd:c9:17", "network": {"id": "130f7948-11e4-49b4-9d4a-dffb2b48bdcd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595419292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ffa18c02b8a4117ab1ccc52aca64f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58c81983-46", "ovs_interfaceid": "58c81983-46ab-4026-b712-775ae319a09f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:58:46 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-526e9d77-6bb3-4610-adcf-b2abf6d6c0c8 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Releasing lock "refresh_cache-95ca0697-22b5-4109-868f-ca5556015a1f" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:58:46 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:58:46 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:58:47 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:58:47 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:58:47 user nova-compute[74190]: DEBUG nova.compute.manager [req-11783870-874e-4db5-a1bb-5afab5a41cfc req-14fdc0ca-6a4d-4978-bcce-96407aaa4259 service nova] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] Received event network-vif-unplugged-58c81983-46ab-4026-b712-775ae319a09f {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:58:47 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-11783870-874e-4db5-a1bb-5afab5a41cfc req-14fdc0ca-6a4d-4978-bcce-96407aaa4259 service nova] Acquiring lock "95ca0697-22b5-4109-868f-ca5556015a1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:58:47 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-11783870-874e-4db5-a1bb-5afab5a41cfc req-14fdc0ca-6a4d-4978-bcce-96407aaa4259 service nova] Lock "95ca0697-22b5-4109-868f-ca5556015a1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:58:47 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-11783870-874e-4db5-a1bb-5afab5a41cfc req-14fdc0ca-6a4d-4978-bcce-96407aaa4259 service nova] Lock "95ca0697-22b5-4109-868f-ca5556015a1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:58:47 user nova-compute[74190]: DEBUG nova.compute.manager [req-11783870-874e-4db5-a1bb-5afab5a41cfc req-14fdc0ca-6a4d-4978-bcce-96407aaa4259 service nova] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] No waiting events found dispatching network-vif-unplugged-58c81983-46ab-4026-b712-775ae319a09f {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:58:47 user nova-compute[74190]: WARNING nova.compute.manager [req-11783870-874e-4db5-a1bb-5afab5a41cfc req-14fdc0ca-6a4d-4978-bcce-96407aaa4259 service nova] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] Received unexpected event network-vif-unplugged-58c81983-46ab-4026-b712-775ae319a09f for instance with vm_state active and task_state rescuing.
Oct 18 11:58:47 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] Instance destroyed successfully.
Oct 18 11:58:47 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-526e9d77-6bb3-4610-adcf-b2abf6d6c0c8 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] Attempting rescue
Oct 18 11:58:47 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-526e9d77-6bb3-4610-adcf-b2abf6d6c0c8 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74190) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 18 11:58:47 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-526e9d77-6bb3-4610-adcf-b2abf6d6c0c8 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] Instance directory exists: not creating {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 18 11:58:47 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-526e9d77-6bb3-4610-adcf-b2abf6d6c0c8 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] Creating image(s)
Oct 18 11:58:47 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-526e9d77-6bb3-4610-adcf-b2abf6d6c0c8 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Acquiring lock "/opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:58:47 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-526e9d77-6bb3-4610-adcf-b2abf6d6c0c8 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lock "/opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:58:47 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-526e9d77-6bb3-4610-adcf-b2abf6d6c0c8 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lock "/opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:58:47 user nova-compute[74190]: DEBUG nova.objects.instance [None req-526e9d77-6bb3-4610-adcf-b2abf6d6c0c8 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lazy-loading 'trusted_certs' on Instance uuid 95ca0697-22b5-4109-868f-ca5556015a1f {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:58:47 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-526e9d77-6bb3-4610-adcf-b2abf6d6c0c8 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Acquiring lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:58:47 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-526e9d77-6bb3-4610-adcf-b2abf6d6c0c8 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:58:47 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-526e9d77-6bb3-4610-adcf-b2abf6d6c0c8 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:58:47 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-526e9d77-6bb3-4610-adcf-b2abf6d6c0c8 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.183s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:58:47 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-526e9d77-6bb3-4610-adcf-b2abf6d6c0c8 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f,backing_fmt=raw /opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/disk.rescue {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:58:47 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-526e9d77-6bb3-4610-adcf-b2abf6d6c0c8 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f,backing_fmt=raw /opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/disk.rescue" returned: 0 in 0.071s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:58:47 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-526e9d77-6bb3-4610-adcf-b2abf6d6c0c8 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:58:47 user nova-compute[74190]: DEBUG nova.objects.instance [None req-526e9d77-6bb3-4610-adcf-b2abf6d6c0c8 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lazy-loading 'migration_context' on Instance uuid 95ca0697-22b5-4109-868f-ca5556015a1f {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:58:47 user nova-compute[74190]: DEBUG nova.objects.base [None req-526e9d77-6bb3-4610-adcf-b2abf6d6c0c8 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Object Instance<95ca0697-22b5-4109-868f-ca5556015a1f> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74190) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 11:58:47 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-526e9d77-6bb3-4610-adcf-b2abf6d6c0c8 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] Created local disks {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 11:58:47 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-526e9d77-6bb3-4610-adcf-b2abf6d6c0c8 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] Start _get_guest_xml network_info=[{"id": "58c81983-46ab-4026-b712-775ae319a09f", "address": "fa:16:3e:dd:c9:17", "network": {"id": "130f7948-11e4-49b4-9d4a-dffb2b48bdcd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595419292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-595419292-network", "vif_mac": "fa:16:3e:dd:c9:17"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ffa18c02b8a4117ab1ccc52aca64f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58c81983-46", "ovs_interfaceid": "58c81983-46ab-4026-b712-775ae319a09f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '6e88bbf0-6e78-49a8-b3c5-9453d22a89df', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 11:58:47 user nova-compute[74190]: DEBUG nova.objects.instance [None req-526e9d77-6bb3-4610-adcf-b2abf6d6c0c8 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lazy-loading 'resources' on Instance uuid 95ca0697-22b5-4109-868f-ca5556015a1f {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:58:47 user nova-compute[74190]: DEBUG nova.objects.base [None req-526e9d77-6bb3-4610-adcf-b2abf6d6c0c8 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Object Instance<95ca0697-22b5-4109-868f-ca5556015a1f> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74190) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 11:58:47 user nova-compute[74190]: DEBUG nova.objects.instance [None req-526e9d77-6bb3-4610-adcf-b2abf6d6c0c8 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lazy-loading 'numa_topology' on Instance uuid 95ca0697-22b5-4109-868f-ca5556015a1f {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:58:47 user nova-compute[74190]: DEBUG nova.objects.base [None req-526e9d77-6bb3-4610-adcf-b2abf6d6c0c8 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Object Instance<95ca0697-22b5-4109-868f-ca5556015a1f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74190) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 11:58:47 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-526e9d77-6bb3-4610-adcf-b2abf6d6c0c8 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:58:47 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-526e9d77-6bb3-4610-adcf-b2abf6d6c0c8 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:58:47 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-526e9d77-6bb3-4610-adcf-b2abf6d6c0c8 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 11:58:47 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-526e9d77-6bb3-4610-adcf-b2abf6d6c0c8 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] CPU controller missing on host. {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 11:58:47 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-526e9d77-6bb3-4610-adcf-b2abf6d6c0c8 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 11:58:47 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-526e9d77-6bb3-4610-adcf-b2abf6d6c0c8 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] CPU controller found on host. {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 11:58:47 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-526e9d77-6bb3-4610-adcf-b2abf6d6c0c8 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74190) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 11:58:47 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-526e9d77-6bb3-4610-adcf-b2abf6d6c0c8 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T11:37:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 11:58:47 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-526e9d77-6bb3-4610-adcf-b2abf6d6c0c8 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Flavor limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 11:58:47 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-526e9d77-6bb3-4610-adcf-b2abf6d6c0c8 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Image limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 11:58:47 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-526e9d77-6bb3-4610-adcf-b2abf6d6c0c8 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Flavor pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 11:58:47 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-526e9d77-6bb3-4610-adcf-b2abf6d6c0c8 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Image pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 11:58:47 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-526e9d77-6bb3-4610-adcf-b2abf6d6c0c8 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 11:58:47 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-526e9d77-6bb3-4610-adcf-b2abf6d6c0c8 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 11:58:47 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-526e9d77-6bb3-4610-adcf-b2abf6d6c0c8 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 11:58:47 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-526e9d77-6bb3-4610-adcf-b2abf6d6c0c8 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Got 1 possible topologies {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 11:58:47 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-526e9d77-6bb3-4610-adcf-b2abf6d6c0c8 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 11:58:47 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-526e9d77-6bb3-4610-adcf-b2abf6d6c0c8 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 11:58:47 user nova-compute[74190]: DEBUG nova.objects.instance [None req-526e9d77-6bb3-4610-adcf-b2abf6d6c0c8 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lazy-loading 'vcpu_model' on Instance uuid 95ca0697-22b5-4109-868f-ca5556015a1f {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:58:47 user nova-compute[74190]: DEBUG nova.objects.base [None req-526e9d77-6bb3-4610-adcf-b2abf6d6c0c8 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Object Instance<95ca0697-22b5-4109-868f-ca5556015a1f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74190) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 11:58:47 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-526e9d77-6bb3-4610-adcf-b2abf6d6c0c8 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:53:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1133778819',display_name='tempest-ServerRescueNegativeTestJSON-server-1133778819',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1133778819',id=24,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-18T11:54:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1ffa18c02b8a4117ab1ccc52aca64f06',ramdisk_id='',reservation_id='r-nbj7z5hd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1266902394',owner_user_name='tempest-ServerRescueNegativeTestJSON-1266902394-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:54:07Z,user_data=None,user_id='9db2d65206e24d0aa1428b9bcaa0a86e',uuid=95ca0697-22b5-4109-868f-ca5556015a1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "58c81983-46ab-4026-b712-775ae319a09f", "address": "fa:16:3e:dd:c9:17", "network": {"id": "130f7948-11e4-49b4-9d4a-dffb2b48bdcd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595419292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-595419292-network", "vif_mac": "fa:16:3e:dd:c9:17"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ffa18c02b8a4117ab1ccc52aca64f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58c81983-46", "ovs_interfaceid": "58c81983-46ab-4026-b712-775ae319a09f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74190) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 11:58:47 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-526e9d77-6bb3-4610-adcf-b2abf6d6c0c8 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Converting VIF {"id": "58c81983-46ab-4026-b712-775ae319a09f", "address": "fa:16:3e:dd:c9:17", "network": {"id": "130f7948-11e4-49b4-9d4a-dffb2b48bdcd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595419292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-595419292-network", "vif_mac": "fa:16:3e:dd:c9:17"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ffa18c02b8a4117ab1ccc52aca64f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58c81983-46", "ovs_interfaceid": "58c81983-46ab-4026-b712-775ae319a09f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:58:47 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-526e9d77-6bb3-4610-adcf-b2abf6d6c0c8 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dd:c9:17,bridge_name='br-int',has_traffic_filtering=True,id=58c81983-46ab-4026-b712-775ae319a09f,network=Network(130f7948-11e4-49b4-9d4a-dffb2b48bdcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58c81983-46') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:58:47 user nova-compute[74190]: DEBUG nova.objects.instance [None req-526e9d77-6bb3-4610-adcf-b2abf6d6c0c8 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lazy-loading 'pci_devices' on Instance uuid 95ca0697-22b5-4109-868f-ca5556015a1f {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:58:47 user nova-compute[74190]: DEBUG nova.objects.base [None req-526e9d77-6bb3-4610-adcf-b2abf6d6c0c8 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Object Instance<95ca0697-22b5-4109-868f-ca5556015a1f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74190) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 11:58:47 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-526e9d77-6bb3-4610-adcf-b2abf6d6c0c8 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] End _get_guest_xml xml=<domain type="kvm">
Oct 18 11:58:47 user nova-compute[74190]:   <uuid>95ca0697-22b5-4109-868f-ca5556015a1f</uuid>
Oct 18 11:58:47 user nova-compute[74190]:   <name>instance-00000018</name>
Oct 18 11:58:47 user nova-compute[74190]:   <memory>524288</memory>
Oct 18 11:58:47 user nova-compute[74190]:   <vcpu>1</vcpu>
Oct 18 11:58:47 user nova-compute[74190]:   <metadata>
Oct 18 11:58:47 user nova-compute[74190]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 11:58:47 user nova-compute[74190]:       <nova:package version="0.0.0"/>
Oct 18 11:58:47 user nova-compute[74190]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1133778819</nova:name>
Oct 18 11:58:47 user nova-compute[74190]:       <nova:creationTime>2023-10-18 11:58:47</nova:creationTime>
Oct 18 11:58:47 user nova-compute[74190]:       <nova:flavor name="m1.tiny">
Oct 18 11:58:47 user nova-compute[74190]:         <nova:memory>512</nova:memory>
Oct 18 11:58:47 user nova-compute[74190]:         <nova:disk>1</nova:disk>
Oct 18 11:58:47 user nova-compute[74190]:         <nova:swap>0</nova:swap>
Oct 18 11:58:47 user nova-compute[74190]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 11:58:47 user nova-compute[74190]:         <nova:vcpus>1</nova:vcpus>
Oct 18 11:58:47 user nova-compute[74190]:       </nova:flavor>
Oct 18 11:58:47 user nova-compute[74190]:       <nova:owner>
Oct 18 11:58:47 user nova-compute[74190]:         <nova:user uuid="9db2d65206e24d0aa1428b9bcaa0a86e">tempest-ServerRescueNegativeTestJSON-1266902394-project-member</nova:user>
Oct 18 11:58:47 user nova-compute[74190]:         <nova:project uuid="1ffa18c02b8a4117ab1ccc52aca64f06">tempest-ServerRescueNegativeTestJSON-1266902394</nova:project>
Oct 18 11:58:47 user nova-compute[74190]:       </nova:owner>
Oct 18 11:58:47 user nova-compute[74190]:       <nova:root type="image" uuid="6e88bbf0-6e78-49a8-b3c5-9453d22a89df"/>
Oct 18 11:58:47 user nova-compute[74190]:       <nova:ports>
Oct 18 11:58:47 user nova-compute[74190]:         <nova:port uuid="58c81983-46ab-4026-b712-775ae319a09f">
Oct 18 11:58:47 user nova-compute[74190]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 18 11:58:47 user nova-compute[74190]:         </nova:port>
Oct 18 11:58:47 user nova-compute[74190]:       </nova:ports>
Oct 18 11:58:47 user nova-compute[74190]:     </nova:instance>
Oct 18 11:58:47 user nova-compute[74190]:   </metadata>
Oct 18 11:58:47 user nova-compute[74190]:   <sysinfo type="smbios">
Oct 18 11:58:47 user nova-compute[74190]:     <system>
Oct 18 11:58:47 user nova-compute[74190]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 11:58:47 user nova-compute[74190]:       <entry name="product">OpenStack Nova</entry>
Oct 18 11:58:47 user nova-compute[74190]:       <entry name="version">0.0.0</entry>
Oct 18 11:58:47 user nova-compute[74190]:       <entry name="serial">95ca0697-22b5-4109-868f-ca5556015a1f</entry>
Oct 18 11:58:47 user nova-compute[74190]:       <entry name="uuid">95ca0697-22b5-4109-868f-ca5556015a1f</entry>
Oct 18 11:58:47 user nova-compute[74190]:       <entry name="family">Virtual Machine</entry>
Oct 18 11:58:47 user nova-compute[74190]:     </system>
Oct 18 11:58:47 user nova-compute[74190]:   </sysinfo>
Oct 18 11:58:47 user nova-compute[74190]:   <os>
Oct 18 11:58:47 user nova-compute[74190]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 11:58:47 user nova-compute[74190]:     <smbios mode="sysinfo"/>
Oct 18 11:58:47 user nova-compute[74190]:   </os>
Oct 18 11:58:47 user nova-compute[74190]:   <features>
Oct 18 11:58:47 user nova-compute[74190]:     <acpi/>
Oct 18 11:58:47 user nova-compute[74190]:     <apic/>
Oct 18 11:58:47 user nova-compute[74190]:     <vmcoreinfo/>
Oct 18 11:58:47 user nova-compute[74190]:   </features>
Oct 18 11:58:47 user nova-compute[74190]:   <clock offset="utc">
Oct 18 11:58:47 user nova-compute[74190]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 11:58:47 user nova-compute[74190]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 11:58:47 user nova-compute[74190]:     <timer name="hpet" present="no"/>
Oct 18 11:58:47 user nova-compute[74190]:   </clock>
Oct 18 11:58:47 user nova-compute[74190]:   <cpu mode="custom" match="exact">
Oct 18 11:58:47 user nova-compute[74190]:     <model>Nehalem</model>
Oct 18 11:58:47 user nova-compute[74190]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 11:58:47 user nova-compute[74190]:   </cpu>
Oct 18 11:58:47 user nova-compute[74190]:   <devices>
Oct 18 11:58:47 user nova-compute[74190]:     <disk type="file" device="disk">
Oct 18 11:58:47 user nova-compute[74190]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 11:58:47 user nova-compute[74190]:       <source file="/opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/disk.rescue"/>
Oct 18 11:58:47 user nova-compute[74190]:       <target dev="vda" bus="virtio"/>
Oct 18 11:58:47 user nova-compute[74190]:     </disk>
Oct 18 11:58:47 user nova-compute[74190]:     <disk type="file" device="disk">
Oct 18 11:58:47 user nova-compute[74190]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 11:58:47 user nova-compute[74190]:       <source file="/opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/disk"/>
Oct 18 11:58:47 user nova-compute[74190]:       <target dev="vdb" bus="virtio"/>
Oct 18 11:58:47 user nova-compute[74190]:     </disk>
Oct 18 11:58:47 user nova-compute[74190]:     <interface type="ethernet">
Oct 18 11:58:47 user nova-compute[74190]:       <mac address="fa:16:3e:dd:c9:17"/>
Oct 18 11:58:47 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:58:47 user nova-compute[74190]:       <mtu size="1442"/>
Oct 18 11:58:47 user nova-compute[74190]:       <target dev="tap58c81983-46"/>
Oct 18 11:58:47 user nova-compute[74190]:     </interface>
Oct 18 11:58:47 user nova-compute[74190]:     <serial type="pty">
Oct 18 11:58:47 user nova-compute[74190]:       <log file="/opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/console.log" append="off"/>
Oct 18 11:58:47 user nova-compute[74190]:     </serial>
Oct 18 11:58:47 user nova-compute[74190]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 11:58:47 user nova-compute[74190]:     <video>
Oct 18 11:58:47 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:58:47 user nova-compute[74190]:     </video>
Oct 18 11:58:47 user nova-compute[74190]:     <rng model="virtio">
Oct 18 11:58:47 user nova-compute[74190]:       <backend model="random">/dev/urandom</backend>
Oct 18 11:58:47 user nova-compute[74190]:     </rng>
Oct 18 11:58:47 user nova-compute[74190]:     <controller type="usb" index="0" model="none"/>
Oct 18 11:58:47 user nova-compute[74190]:     <memballoon model="virtio">
Oct 18 11:58:47 user nova-compute[74190]:       <stats period="10"/>
Oct 18 11:58:47 user nova-compute[74190]:     </memballoon>
Oct 18 11:58:47 user nova-compute[74190]:   </devices>
Oct 18 11:58:47 user nova-compute[74190]: </domain>
Oct 18 11:58:47 user nova-compute[74190]:  {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 11:58:47 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] Instance destroyed successfully.
Oct 18 11:58:48 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-526e9d77-6bb3-4610-adcf-b2abf6d6c0c8 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] No BDM found with device name vda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 11:58:48 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-526e9d77-6bb3-4610-adcf-b2abf6d6c0c8 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 11:58:48 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-526e9d77-6bb3-4610-adcf-b2abf6d6c0c8 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] No VIF found with MAC fa:16:3e:dd:c9:17, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 11:58:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:58:49 user nova-compute[74190]: DEBUG nova.compute.manager [req-31fededc-33f7-4c5b-bb03-0790b42e60c8 req-6137e996-8c63-40e1-83bd-ea844d7a18b1 service nova] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] Received event network-vif-plugged-58c81983-46ab-4026-b712-775ae319a09f {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:58:49 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-31fededc-33f7-4c5b-bb03-0790b42e60c8 req-6137e996-8c63-40e1-83bd-ea844d7a18b1 service nova] Acquiring lock "95ca0697-22b5-4109-868f-ca5556015a1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:58:49 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-31fededc-33f7-4c5b-bb03-0790b42e60c8 req-6137e996-8c63-40e1-83bd-ea844d7a18b1 service nova] Lock "95ca0697-22b5-4109-868f-ca5556015a1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:58:49 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-31fededc-33f7-4c5b-bb03-0790b42e60c8 req-6137e996-8c63-40e1-83bd-ea844d7a18b1 service nova] Lock "95ca0697-22b5-4109-868f-ca5556015a1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:58:49 user nova-compute[74190]: DEBUG nova.compute.manager [req-31fededc-33f7-4c5b-bb03-0790b42e60c8 req-6137e996-8c63-40e1-83bd-ea844d7a18b1 service nova] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] No waiting events found dispatching network-vif-plugged-58c81983-46ab-4026-b712-775ae319a09f {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:58:49 user nova-compute[74190]: WARNING nova.compute.manager [req-31fededc-33f7-4c5b-bb03-0790b42e60c8 req-6137e996-8c63-40e1-83bd-ea844d7a18b1 service nova] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] Received unexpected event network-vif-plugged-58c81983-46ab-4026-b712-775ae319a09f for instance with vm_state active and task_state rescuing.
Oct 18 11:58:49 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:58:49 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:58:49 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:58:49 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:58:49 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:58:50 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:58:51 user nova-compute[74190]: DEBUG nova.compute.manager [req-d4d78e30-7683-49b4-a5da-c460a245a23f req-5e827689-f03d-4bad-aa87-500e80926f08 service nova] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] Received event network-vif-plugged-58c81983-46ab-4026-b712-775ae319a09f {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:58:51 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d4d78e30-7683-49b4-a5da-c460a245a23f req-5e827689-f03d-4bad-aa87-500e80926f08 service nova] Acquiring lock "95ca0697-22b5-4109-868f-ca5556015a1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:58:51 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d4d78e30-7683-49b4-a5da-c460a245a23f req-5e827689-f03d-4bad-aa87-500e80926f08 service nova] Lock "95ca0697-22b5-4109-868f-ca5556015a1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:58:51 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d4d78e30-7683-49b4-a5da-c460a245a23f req-5e827689-f03d-4bad-aa87-500e80926f08 service nova] Lock "95ca0697-22b5-4109-868f-ca5556015a1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:58:51 user nova-compute[74190]: DEBUG nova.compute.manager [req-d4d78e30-7683-49b4-a5da-c460a245a23f req-5e827689-f03d-4bad-aa87-500e80926f08 service nova] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] No waiting events found dispatching network-vif-plugged-58c81983-46ab-4026-b712-775ae319a09f {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:58:51 user nova-compute[74190]: WARNING nova.compute.manager [req-d4d78e30-7683-49b4-a5da-c460a245a23f req-5e827689-f03d-4bad-aa87-500e80926f08 service nova] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] Received unexpected event network-vif-plugged-58c81983-46ab-4026-b712-775ae319a09f for instance with vm_state active and task_state rescuing.
Oct 18 11:58:51 user nova-compute[74190]: DEBUG nova.compute.manager [req-d4d78e30-7683-49b4-a5da-c460a245a23f req-5e827689-f03d-4bad-aa87-500e80926f08 service nova] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] Received event network-vif-plugged-58c81983-46ab-4026-b712-775ae319a09f {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:58:51 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d4d78e30-7683-49b4-a5da-c460a245a23f req-5e827689-f03d-4bad-aa87-500e80926f08 service nova] Acquiring lock "95ca0697-22b5-4109-868f-ca5556015a1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:58:51 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d4d78e30-7683-49b4-a5da-c460a245a23f req-5e827689-f03d-4bad-aa87-500e80926f08 service nova] Lock "95ca0697-22b5-4109-868f-ca5556015a1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:58:51 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d4d78e30-7683-49b4-a5da-c460a245a23f req-5e827689-f03d-4bad-aa87-500e80926f08 service nova] Lock "95ca0697-22b5-4109-868f-ca5556015a1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:58:51 user nova-compute[74190]: DEBUG nova.compute.manager [req-d4d78e30-7683-49b4-a5da-c460a245a23f req-5e827689-f03d-4bad-aa87-500e80926f08 service nova] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] No waiting events found dispatching network-vif-plugged-58c81983-46ab-4026-b712-775ae319a09f {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:58:51 user nova-compute[74190]: WARNING nova.compute.manager [req-d4d78e30-7683-49b4-a5da-c460a245a23f req-5e827689-f03d-4bad-aa87-500e80926f08 service nova] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] Received unexpected event network-vif-plugged-58c81983-46ab-4026-b712-775ae319a09f for instance with vm_state active and task_state rescuing.
Oct 18 11:58:51 user nova-compute[74190]: DEBUG nova.compute.manager [None req-526e9d77-6bb3-4610-adcf-b2abf6d6c0c8 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] Checking state {{(pid=74190) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 11:58:52 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:58:53 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:58:54 user nova-compute[74190]: DEBUG nova.compute.manager [req-f3bb534c-510d-4d9f-8120-d96fa63ddc08 req-e439029c-bcf4-47e2-861b-2771cb77252b service nova] [instance: 95933a75-03d9-4b34-b751-69e3622f23c7] Received event network-changed-0660e8c4-71b8-45e5-a54e-7a9f1775061f {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:58:54 user nova-compute[74190]: DEBUG nova.compute.manager [req-f3bb534c-510d-4d9f-8120-d96fa63ddc08 req-e439029c-bcf4-47e2-861b-2771cb77252b service nova] [instance: 95933a75-03d9-4b34-b751-69e3622f23c7] Refreshing instance network info cache due to event network-changed-0660e8c4-71b8-45e5-a54e-7a9f1775061f. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 11:58:54 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-f3bb534c-510d-4d9f-8120-d96fa63ddc08 req-e439029c-bcf4-47e2-861b-2771cb77252b service nova] Acquiring lock "refresh_cache-95933a75-03d9-4b34-b751-69e3622f23c7" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:58:54 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-f3bb534c-510d-4d9f-8120-d96fa63ddc08 req-e439029c-bcf4-47e2-861b-2771cb77252b service nova] Acquired lock "refresh_cache-95933a75-03d9-4b34-b751-69e3622f23c7" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:58:54 user nova-compute[74190]: DEBUG nova.network.neutron [req-f3bb534c-510d-4d9f-8120-d96fa63ddc08 req-e439029c-bcf4-47e2-861b-2771cb77252b service nova] [instance: 95933a75-03d9-4b34-b751-69e3622f23c7] Refreshing network info cache for port 0660e8c4-71b8-45e5-a54e-7a9f1775061f {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 11:58:54 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-bd985795-bc98-45ba-a675-ecc3b75a9ac5 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Acquiring lock "95933a75-03d9-4b34-b751-69e3622f23c7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:58:54 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-bd985795-bc98-45ba-a675-ecc3b75a9ac5 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Lock "95933a75-03d9-4b34-b751-69e3622f23c7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:58:54 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-bd985795-bc98-45ba-a675-ecc3b75a9ac5 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Acquiring lock "95933a75-03d9-4b34-b751-69e3622f23c7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:58:54 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-bd985795-bc98-45ba-a675-ecc3b75a9ac5 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Lock "95933a75-03d9-4b34-b751-69e3622f23c7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:58:54 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-bd985795-bc98-45ba-a675-ecc3b75a9ac5 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Lock "95933a75-03d9-4b34-b751-69e3622f23c7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:58:54 user nova-compute[74190]: INFO nova.compute.manager [None req-bd985795-bc98-45ba-a675-ecc3b75a9ac5 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] [instance: 95933a75-03d9-4b34-b751-69e3622f23c7] Terminating instance
Oct 18 11:58:54 user nova-compute[74190]: DEBUG nova.compute.manager [None req-bd985795-bc98-45ba-a675-ecc3b75a9ac5 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] [instance: 95933a75-03d9-4b34-b751-69e3622f23c7] Start destroying the instance on the hypervisor. {{(pid=74190) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 11:58:54 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:58:54 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:58:54 user nova-compute[74190]: DEBUG nova.network.neutron [req-f3bb534c-510d-4d9f-8120-d96fa63ddc08 req-e439029c-bcf4-47e2-861b-2771cb77252b service nova] [instance: 95933a75-03d9-4b34-b751-69e3622f23c7] Updated VIF entry in instance network info cache for port 0660e8c4-71b8-45e5-a54e-7a9f1775061f. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 11:58:54 user nova-compute[74190]: DEBUG nova.network.neutron [req-f3bb534c-510d-4d9f-8120-d96fa63ddc08 req-e439029c-bcf4-47e2-861b-2771cb77252b service nova] [instance: 95933a75-03d9-4b34-b751-69e3622f23c7] Updating instance_info_cache with network_info: [{"id": "0660e8c4-71b8-45e5-a54e-7a9f1775061f", "address": "fa:16:3e:b3:8a:60", "network": {"id": "56026ce6-77fb-40c7-9976-732e745c219d", "bridge": "br-int", "label": "tempest-TestStampPattern-989787934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "389e1c2dbc904130ba08b137f0b2e837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0660e8c4-71", "ovs_interfaceid": "0660e8c4-71b8-45e5-a54e-7a9f1775061f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:58:54 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-f3bb534c-510d-4d9f-8120-d96fa63ddc08 req-e439029c-bcf4-47e2-861b-2771cb77252b service nova] Releasing lock "refresh_cache-95933a75-03d9-4b34-b751-69e3622f23c7" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:58:54 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:58:54 user nova-compute[74190]: DEBUG nova.compute.manager [req-5ef43e1d-7dd8-44bd-8316-dff6396724dc req-b6d8849a-140b-4459-b71c-92e37a1b534c service nova] [instance: 95933a75-03d9-4b34-b751-69e3622f23c7] Received event network-vif-unplugged-0660e8c4-71b8-45e5-a54e-7a9f1775061f {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:58:54 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-5ef43e1d-7dd8-44bd-8316-dff6396724dc req-b6d8849a-140b-4459-b71c-92e37a1b534c service nova] Acquiring lock "95933a75-03d9-4b34-b751-69e3622f23c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:58:54 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-5ef43e1d-7dd8-44bd-8316-dff6396724dc req-b6d8849a-140b-4459-b71c-92e37a1b534c service nova] Lock "95933a75-03d9-4b34-b751-69e3622f23c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:58:54 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-5ef43e1d-7dd8-44bd-8316-dff6396724dc req-b6d8849a-140b-4459-b71c-92e37a1b534c service nova] Lock "95933a75-03d9-4b34-b751-69e3622f23c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:58:54 user nova-compute[74190]: DEBUG nova.compute.manager [req-5ef43e1d-7dd8-44bd-8316-dff6396724dc req-b6d8849a-140b-4459-b71c-92e37a1b534c service nova] [instance: 95933a75-03d9-4b34-b751-69e3622f23c7] No waiting events found dispatching network-vif-unplugged-0660e8c4-71b8-45e5-a54e-7a9f1775061f {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:58:54 user nova-compute[74190]: DEBUG nova.compute.manager [req-5ef43e1d-7dd8-44bd-8316-dff6396724dc req-b6d8849a-140b-4459-b71c-92e37a1b534c service nova] [instance: 95933a75-03d9-4b34-b751-69e3622f23c7] Received event network-vif-unplugged-0660e8c4-71b8-45e5-a54e-7a9f1775061f for instance with task_state deleting. {{(pid=74190) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 11:58:54 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:58:55 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 95933a75-03d9-4b34-b751-69e3622f23c7] Instance destroyed successfully.
Oct 18 11:58:55 user nova-compute[74190]: DEBUG nova.objects.instance [None req-bd985795-bc98-45ba-a675-ecc3b75a9ac5 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Lazy-loading 'resources' on Instance uuid 95933a75-03d9-4b34-b751-69e3622f23c7 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:58:55 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-bd985795-bc98-45ba-a675-ecc3b75a9ac5 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:55:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-759608543',display_name='tempest-TestStampPattern-server-759608543',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-759608543',id=28,image_ref='b3020345-cdef-415e-be91-a3f2326e784c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIWsfXQkdYGPKym2GX8abBzSE1TgaUSMy3GxYdQVyxTc9qElJuld8J6hiVUfhDnJocQnssGij1BqYm1SJS/pWo5ybDXV8dLSSiMAGmlRDARneJEWLLFP/+ol+LaeplXvXg==',key_name='tempest-TestStampPattern-1418984438',keypairs=<?>,launch_index=0,launched_at=2023-10-18T11:55:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='389e1c2dbc904130ba08b137f0b2e837',ramdisk_id='',reservation_id='r-hk68eg8z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='8eec9cde-3553-4fc8-9162-cda963d1a81e',image_min_disk='1',image_min_ram='0',image_owner_id='389e1c2dbc904130ba08b137f0b2e837',image_owner_project_name='tempest-TestStampPattern-2116730913',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-2116730913-project-member',image_user_id='a252f2c479b740a29a1adc79e6346b20',owner_project_name='tempest-TestStampPattern-2116730913',owner_user_name='tempest-TestStampPattern-2116730913-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T11:55:59Z,user_data=None,user_id='a252f2c479b740a29a1adc79e6346b20',uuid=95933a75-03d9-4b34-b751-69e3622f23c7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0660e8c4-71b8-45e5-a54e-7a9f1775061f", "address": "fa:16:3e:b3:8a:60", "network": {"id": "56026ce6-77fb-40c7-9976-732e745c219d", "bridge": "br-int", "label": "tempest-TestStampPattern-989787934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "389e1c2dbc904130ba08b137f0b2e837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0660e8c4-71", "ovs_interfaceid": "0660e8c4-71b8-45e5-a54e-7a9f1775061f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 11:58:55 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-bd985795-bc98-45ba-a675-ecc3b75a9ac5 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Converting VIF {"id": "0660e8c4-71b8-45e5-a54e-7a9f1775061f", "address": "fa:16:3e:b3:8a:60", "network": {"id": "56026ce6-77fb-40c7-9976-732e745c219d", "bridge": "br-int", "label": "tempest-TestStampPattern-989787934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "389e1c2dbc904130ba08b137f0b2e837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0660e8c4-71", "ovs_interfaceid": "0660e8c4-71b8-45e5-a54e-7a9f1775061f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:58:55 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-bd985795-bc98-45ba-a675-ecc3b75a9ac5 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b3:8a:60,bridge_name='br-int',has_traffic_filtering=True,id=0660e8c4-71b8-45e5-a54e-7a9f1775061f,network=Network(56026ce6-77fb-40c7-9976-732e745c219d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0660e8c4-71') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:58:55 user nova-compute[74190]: DEBUG os_vif [None req-bd985795-bc98-45ba-a675-ecc3b75a9ac5 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:8a:60,bridge_name='br-int',has_traffic_filtering=True,id=0660e8c4-71b8-45e5-a54e-7a9f1775061f,network=Network(56026ce6-77fb-40c7-9976-732e745c219d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0660e8c4-71') {{(pid=74190) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 11:58:55 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:58:55 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0660e8c4-71, bridge=br-int, if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:58:55 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:58:55 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:58:55 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:58:55 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=923bd4ab-4c71-4815-b384-d75392d9dfd8) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:58:55 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:58:55 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:58:55 user nova-compute[74190]: INFO os_vif [None req-bd985795-bc98-45ba-a675-ecc3b75a9ac5 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:8a:60,bridge_name='br-int',has_traffic_filtering=True,id=0660e8c4-71b8-45e5-a54e-7a9f1775061f,network=Network(56026ce6-77fb-40c7-9976-732e745c219d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0660e8c4-71')
Oct 18 11:58:55 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-bd985795-bc98-45ba-a675-ecc3b75a9ac5 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] [instance: 95933a75-03d9-4b34-b751-69e3622f23c7] Deleting instance files /opt/stack/data/nova/instances/95933a75-03d9-4b34-b751-69e3622f23c7_del
Oct 18 11:58:55 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-bd985795-bc98-45ba-a675-ecc3b75a9ac5 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] [instance: 95933a75-03d9-4b34-b751-69e3622f23c7] Deletion of /opt/stack/data/nova/instances/95933a75-03d9-4b34-b751-69e3622f23c7_del complete
Oct 18 11:58:55 user nova-compute[74190]: INFO nova.compute.manager [None req-bd985795-bc98-45ba-a675-ecc3b75a9ac5 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] [instance: 95933a75-03d9-4b34-b751-69e3622f23c7] Took 1.00 seconds to destroy the instance on the hypervisor.
Oct 18 11:58:55 user nova-compute[74190]: DEBUG oslo.service.loopingcall [None req-bd985795-bc98-45ba-a675-ecc3b75a9ac5 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74190) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 11:58:55 user nova-compute[74190]: DEBUG nova.compute.manager [-] [instance: 95933a75-03d9-4b34-b751-69e3622f23c7] Deallocating network for instance {{(pid=74190) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 11:58:55 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: 95933a75-03d9-4b34-b751-69e3622f23c7] deallocate_for_instance() {{(pid=74190) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 11:58:55 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: 95933a75-03d9-4b34-b751-69e3622f23c7] Updating instance_info_cache with network_info: [] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:58:56 user nova-compute[74190]: INFO nova.compute.manager [-] [instance: 95933a75-03d9-4b34-b751-69e3622f23c7] Took 0.48 seconds to deallocate network for instance.
Oct 18 11:58:56 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-bd985795-bc98-45ba-a675-ecc3b75a9ac5 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:58:56 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-bd985795-bc98-45ba-a675-ecc3b75a9ac5 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:58:56 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-bd985795-bc98-45ba-a675-ecc3b75a9ac5 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 11:58:56 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-bd985795-bc98-45ba-a675-ecc3b75a9ac5 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 11:58:56 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-bd985795-bc98-45ba-a675-ecc3b75a9ac5 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.321s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:58:56 user nova-compute[74190]: DEBUG nova.compute.manager [req-b57d17e5-d16f-4bdc-97c6-55e8d9ef8494 req-69609d55-f262-43b8-92d2-412b2187ccaf service nova] [instance: 95933a75-03d9-4b34-b751-69e3622f23c7] Received event network-vif-deleted-0660e8c4-71b8-45e5-a54e-7a9f1775061f {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:58:56 user nova-compute[74190]: INFO nova.scheduler.client.report [None req-bd985795-bc98-45ba-a675-ecc3b75a9ac5 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Deleted allocations for instance 95933a75-03d9-4b34-b751-69e3622f23c7
Oct 18 11:58:56 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-bd985795-bc98-45ba-a675-ecc3b75a9ac5 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Lock "95933a75-03d9-4b34-b751-69e3622f23c7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.048s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:58:56 user nova-compute[74190]: DEBUG nova.compute.manager [req-e8310682-486b-4e49-9c4a-e9c7e441e455 req-705d2a51-3bb4-4c8d-9c1c-3203f7411d61 service nova] [instance: 95933a75-03d9-4b34-b751-69e3622f23c7] Received event network-vif-plugged-0660e8c4-71b8-45e5-a54e-7a9f1775061f {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:58:56 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-e8310682-486b-4e49-9c4a-e9c7e441e455 req-705d2a51-3bb4-4c8d-9c1c-3203f7411d61 service nova] Acquiring lock "95933a75-03d9-4b34-b751-69e3622f23c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:58:56 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-e8310682-486b-4e49-9c4a-e9c7e441e455 req-705d2a51-3bb4-4c8d-9c1c-3203f7411d61 service nova] Lock "95933a75-03d9-4b34-b751-69e3622f23c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:58:56 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-e8310682-486b-4e49-9c4a-e9c7e441e455 req-705d2a51-3bb4-4c8d-9c1c-3203f7411d61 service nova] Lock "95933a75-03d9-4b34-b751-69e3622f23c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:58:56 user nova-compute[74190]: DEBUG nova.compute.manager [req-e8310682-486b-4e49-9c4a-e9c7e441e455 req-705d2a51-3bb4-4c8d-9c1c-3203f7411d61 service nova] [instance: 95933a75-03d9-4b34-b751-69e3622f23c7] No waiting events found dispatching network-vif-plugged-0660e8c4-71b8-45e5-a54e-7a9f1775061f {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:58:56 user nova-compute[74190]: WARNING nova.compute.manager [req-e8310682-486b-4e49-9c4a-e9c7e441e455 req-705d2a51-3bb4-4c8d-9c1c-3203f7411d61 service nova] [instance: 95933a75-03d9-4b34-b751-69e3622f23c7] Received unexpected event network-vif-plugged-0660e8c4-71b8-45e5-a54e-7a9f1775061f for instance with vm_state deleted and task_state None.
Oct 18 11:58:58 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:58:58 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:58:59 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:59:00 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:59:00 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:59:00 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:59:02 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:59:02 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74190) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 11:59:05 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:59:05 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:59:05 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:59:06 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:59:06 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:59:06 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Starting heal instance info cache {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 11:59:06 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "refresh_cache-a9012673-826b-4be7-a55b-9bb35a227c17" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:59:06 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquired lock "refresh_cache-a9012673-826b-4be7-a55b-9bb35a227c17" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:59:06 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Forcefully refreshing network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 18 11:59:06 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Updating instance_info_cache with network_info: [{"id": "98016144-4b95-4e94-8ae4-581089fe4f63", "address": "fa:16:3e:ea:1d:55", "network": {"id": "f5ab7da4-2b07-4465-9a89-a07eb053ba91", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1315695374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08cf52ce927443158aa731367f08bd57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98016144-4b", "ovs_interfaceid": "98016144-4b95-4e94-8ae4-581089fe4f63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:59:06 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Releasing lock "refresh_cache-a9012673-826b-4be7-a55b-9bb35a227c17" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:59:06 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Updated the network info_cache for instance {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 18 11:59:06 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-712cb469-18e5-401f-b6fa-74b61c2387a1 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Acquiring lock "dcea54d1-e5e8-4079-8c59-499c82404088" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:59:06 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-712cb469-18e5-401f-b6fa-74b61c2387a1 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Lock "dcea54d1-e5e8-4079-8c59-499c82404088" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:59:06 user nova-compute[74190]: DEBUG nova.compute.manager [None req-712cb469-18e5-401f-b6fa-74b61c2387a1 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] [instance: dcea54d1-e5e8-4079-8c59-499c82404088] Starting instance... {{(pid=74190) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 11:59:06 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-712cb469-18e5-401f-b6fa-74b61c2387a1 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:59:06 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-712cb469-18e5-401f-b6fa-74b61c2387a1 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:59:06 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-712cb469-18e5-401f-b6fa-74b61c2387a1 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74190) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 11:59:06 user nova-compute[74190]: INFO nova.compute.claims [None req-712cb469-18e5-401f-b6fa-74b61c2387a1 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] [instance: dcea54d1-e5e8-4079-8c59-499c82404088] Claim successful on node user
Oct 18 11:59:07 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-712cb469-18e5-401f-b6fa-74b61c2387a1 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 11:59:07 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-712cb469-18e5-401f-b6fa-74b61c2387a1 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 11:59:07 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-712cb469-18e5-401f-b6fa-74b61c2387a1 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.347s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:59:07 user nova-compute[74190]: DEBUG nova.compute.manager [None req-712cb469-18e5-401f-b6fa-74b61c2387a1 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] [instance: dcea54d1-e5e8-4079-8c59-499c82404088] Start building networks asynchronously for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 11:59:07 user nova-compute[74190]: DEBUG nova.compute.manager [None req-712cb469-18e5-401f-b6fa-74b61c2387a1 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] [instance: dcea54d1-e5e8-4079-8c59-499c82404088] Allocating IP information in the background. {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 11:59:07 user nova-compute[74190]: DEBUG nova.network.neutron [None req-712cb469-18e5-401f-b6fa-74b61c2387a1 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] [instance: dcea54d1-e5e8-4079-8c59-499c82404088] allocate_for_instance() {{(pid=74190) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 11:59:07 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-712cb469-18e5-401f-b6fa-74b61c2387a1 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] [instance: dcea54d1-e5e8-4079-8c59-499c82404088] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 11:59:07 user nova-compute[74190]: DEBUG nova.compute.manager [None req-712cb469-18e5-401f-b6fa-74b61c2387a1 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] [instance: dcea54d1-e5e8-4079-8c59-499c82404088] Start building block device mappings for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 11:59:07 user nova-compute[74190]: DEBUG nova.policy [None req-712cb469-18e5-401f-b6fa-74b61c2387a1 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b0ef25ad27f64ac8a423b867e0f7b836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ed99f026894d569a13d0854fab0a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74190) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 11:59:07 user nova-compute[74190]: DEBUG nova.compute.manager [None req-712cb469-18e5-401f-b6fa-74b61c2387a1 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] [instance: dcea54d1-e5e8-4079-8c59-499c82404088] Start spawning the instance on the hypervisor. {{(pid=74190) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 11:59:07 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-712cb469-18e5-401f-b6fa-74b61c2387a1 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] [instance: dcea54d1-e5e8-4079-8c59-499c82404088] Creating instance directory {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 11:59:07 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-712cb469-18e5-401f-b6fa-74b61c2387a1 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] [instance: dcea54d1-e5e8-4079-8c59-499c82404088] Creating image(s)
Oct 18 11:59:07 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-712cb469-18e5-401f-b6fa-74b61c2387a1 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Acquiring lock "/opt/stack/data/nova/instances/dcea54d1-e5e8-4079-8c59-499c82404088/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:59:07 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-712cb469-18e5-401f-b6fa-74b61c2387a1 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Lock "/opt/stack/data/nova/instances/dcea54d1-e5e8-4079-8c59-499c82404088/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:59:07 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-712cb469-18e5-401f-b6fa-74b61c2387a1 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Lock "/opt/stack/data/nova/instances/dcea54d1-e5e8-4079-8c59-499c82404088/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:59:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-712cb469-18e5-401f-b6fa-74b61c2387a1 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:59:07 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:59:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-712cb469-18e5-401f-b6fa-74b61c2387a1 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.199s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:59:07 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-712cb469-18e5-401f-b6fa-74b61c2387a1 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Acquiring lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:59:07 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-712cb469-18e5-401f-b6fa-74b61c2387a1 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:59:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-712cb469-18e5-401f-b6fa-74b61c2387a1 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:59:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-712cb469-18e5-401f-b6fa-74b61c2387a1 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.187s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:59:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-712cb469-18e5-401f-b6fa-74b61c2387a1 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f,backing_fmt=raw /opt/stack/data/nova/instances/dcea54d1-e5e8-4079-8c59-499c82404088/disk 1073741824 {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:59:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-712cb469-18e5-401f-b6fa-74b61c2387a1 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f,backing_fmt=raw /opt/stack/data/nova/instances/dcea54d1-e5e8-4079-8c59-499c82404088/disk 1073741824" returned: 0 in 0.061s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:59:07 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-712cb469-18e5-401f-b6fa-74b61c2387a1 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:59:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-712cb469-18e5-401f-b6fa-74b61c2387a1 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:59:08 user nova-compute[74190]: DEBUG nova.network.neutron [None req-712cb469-18e5-401f-b6fa-74b61c2387a1 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] [instance: dcea54d1-e5e8-4079-8c59-499c82404088] Successfully created port: 8f38bbc7-5909-4f37-a35b-aeba01946e4d {{(pid=74190) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 11:59:08 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:59:08 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:59:08 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:59:08 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.003s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:59:08 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:59:08 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Auditing locally available compute resources for user (node: user) {{(pid=74190) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 11:59:08 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-712cb469-18e5-401f-b6fa-74b61c2387a1 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.191s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:59:08 user nova-compute[74190]: DEBUG nova.virt.disk.api [None req-712cb469-18e5-401f-b6fa-74b61c2387a1 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dcea54d1-e5e8-4079-8c59-499c82404088/disk. size=1073741824 {{(pid=74190) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 18 11:59:08 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-712cb469-18e5-401f-b6fa-74b61c2387a1 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcea54d1-e5e8-4079-8c59-499c82404088/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:59:08 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/disk.rescue --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:59:08 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-712cb469-18e5-401f-b6fa-74b61c2387a1 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcea54d1-e5e8-4079-8c59-499c82404088/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:59:08 user nova-compute[74190]: DEBUG nova.virt.disk.api [None req-712cb469-18e5-401f-b6fa-74b61c2387a1 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Cannot resize image /opt/stack/data/nova/instances/dcea54d1-e5e8-4079-8c59-499c82404088/disk to a smaller size. {{(pid=74190) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 18 11:59:08 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-712cb469-18e5-401f-b6fa-74b61c2387a1 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] [instance: dcea54d1-e5e8-4079-8c59-499c82404088] Created local disks {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 11:59:08 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-712cb469-18e5-401f-b6fa-74b61c2387a1 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] [instance: dcea54d1-e5e8-4079-8c59-499c82404088] Ensure instance console log exists: /opt/stack/data/nova/instances/dcea54d1-e5e8-4079-8c59-499c82404088/console.log {{(pid=74190) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 11:59:08 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-712cb469-18e5-401f-b6fa-74b61c2387a1 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:59:08 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-712cb469-18e5-401f-b6fa-74b61c2387a1 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:59:08 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-712cb469-18e5-401f-b6fa-74b61c2387a1 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:59:08 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:59:08 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/disk.rescue --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:59:08 user nova-compute[74190]: DEBUG nova.network.neutron [None req-712cb469-18e5-401f-b6fa-74b61c2387a1 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] [instance: dcea54d1-e5e8-4079-8c59-499c82404088] Successfully updated port: 8f38bbc7-5909-4f37-a35b-aeba01946e4d {{(pid=74190) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 11:59:08 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Acquiring lock "0382820d-a678-4593-85df-168f42fc4ce4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:59:08 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lock "0382820d-a678-4593-85df-168f42fc4ce4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:59:08 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/disk.rescue --force-share --output=json" returned: 0 in 0.212s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:59:08 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:59:08 user nova-compute[74190]: DEBUG nova.compute.manager [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Starting instance... {{(pid=74190) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 11:59:08 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-712cb469-18e5-401f-b6fa-74b61c2387a1 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Acquiring lock "refresh_cache-dcea54d1-e5e8-4079-8c59-499c82404088" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:59:08 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-712cb469-18e5-401f-b6fa-74b61c2387a1 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Acquired lock "refresh_cache-dcea54d1-e5e8-4079-8c59-499c82404088" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:59:08 user nova-compute[74190]: DEBUG nova.network.neutron [None req-712cb469-18e5-401f-b6fa-74b61c2387a1 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] [instance: dcea54d1-e5e8-4079-8c59-499c82404088] Building network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 11:59:08 user nova-compute[74190]: DEBUG nova.compute.manager [req-2aad1964-a559-49d1-b1c1-c89ed728166b req-02105c5f-2a77-47ab-9ea5-5d733b4f05a5 service nova] [instance: dcea54d1-e5e8-4079-8c59-499c82404088] Received event network-changed-8f38bbc7-5909-4f37-a35b-aeba01946e4d {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:59:08 user nova-compute[74190]: DEBUG nova.compute.manager [req-2aad1964-a559-49d1-b1c1-c89ed728166b req-02105c5f-2a77-47ab-9ea5-5d733b4f05a5 service nova] [instance: dcea54d1-e5e8-4079-8c59-499c82404088] Refreshing instance network info cache due to event network-changed-8f38bbc7-5909-4f37-a35b-aeba01946e4d. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 11:59:08 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-2aad1964-a559-49d1-b1c1-c89ed728166b req-02105c5f-2a77-47ab-9ea5-5d733b4f05a5 service nova] Acquiring lock "refresh_cache-dcea54d1-e5e8-4079-8c59-499c82404088" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:59:08 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:59:08 user nova-compute[74190]: DEBUG nova.network.neutron [None req-712cb469-18e5-401f-b6fa-74b61c2387a1 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] [instance: dcea54d1-e5e8-4079-8c59-499c82404088] Instance cache missing network info. {{(pid=74190) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 11:59:08 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:59:08 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:59:08 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74190) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 11:59:08 user nova-compute[74190]: INFO nova.compute.claims [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Claim successful on node user
Oct 18 11:59:08 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:59:08 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:59:09 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:59:09 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eec9cde-3553-4fc8-9162-cda963d1a81e/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:59:09 user nova-compute[74190]: DEBUG nova.network.neutron [None req-712cb469-18e5-401f-b6fa-74b61c2387a1 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] [instance: dcea54d1-e5e8-4079-8c59-499c82404088] Updating instance_info_cache with network_info: [{"id": "8f38bbc7-5909-4f37-a35b-aeba01946e4d", "address": "fa:16:3e:1e:d7:b2", "network": {"id": "d143b91a-fbcd-40d0-b199-381c523b8a0c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-175467972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62ed99f026894d569a13d0854fab0a17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f38bbc7-59", "ovs_interfaceid": "8f38bbc7-5909-4f37-a35b-aeba01946e4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:59:09 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-712cb469-18e5-401f-b6fa-74b61c2387a1 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Releasing lock "refresh_cache-dcea54d1-e5e8-4079-8c59-499c82404088" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:59:09 user nova-compute[74190]: DEBUG nova.compute.manager [None req-712cb469-18e5-401f-b6fa-74b61c2387a1 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] [instance: dcea54d1-e5e8-4079-8c59-499c82404088] Instance network_info: |[{"id": "8f38bbc7-5909-4f37-a35b-aeba01946e4d", "address": "fa:16:3e:1e:d7:b2", "network": {"id": "d143b91a-fbcd-40d0-b199-381c523b8a0c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-175467972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62ed99f026894d569a13d0854fab0a17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f38bbc7-59", "ovs_interfaceid": "8f38bbc7-5909-4f37-a35b-aeba01946e4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 11:59:09 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-2aad1964-a559-49d1-b1c1-c89ed728166b req-02105c5f-2a77-47ab-9ea5-5d733b4f05a5 service nova] Acquired lock "refresh_cache-dcea54d1-e5e8-4079-8c59-499c82404088" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:59:09 user nova-compute[74190]: DEBUG nova.network.neutron [req-2aad1964-a559-49d1-b1c1-c89ed728166b req-02105c5f-2a77-47ab-9ea5-5d733b4f05a5 service nova] [instance: dcea54d1-e5e8-4079-8c59-499c82404088] Refreshing network info cache for port 8f38bbc7-5909-4f37-a35b-aeba01946e4d {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 11:59:09 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-712cb469-18e5-401f-b6fa-74b61c2387a1 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] [instance: dcea54d1-e5e8-4079-8c59-499c82404088] Start _get_guest_xml network_info=[{"id": "8f38bbc7-5909-4f37-a35b-aeba01946e4d", "address": "fa:16:3e:1e:d7:b2", "network": {"id": "d143b91a-fbcd-40d0-b199-381c523b8a0c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-175467972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62ed99f026894d569a13d0854fab0a17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f38bbc7-59", "ovs_interfaceid": "8f38bbc7-5909-4f37-a35b-aeba01946e4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'image_id': '6e88bbf0-6e78-49a8-b3c5-9453d22a89df'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 11:59:09 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-712cb469-18e5-401f-b6fa-74b61c2387a1 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:59:09 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-712cb469-18e5-401f-b6fa-74b61c2387a1 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:59:09 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-712cb469-18e5-401f-b6fa-74b61c2387a1 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 11:59:09 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-712cb469-18e5-401f-b6fa-74b61c2387a1 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] CPU controller missing on host. {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 11:59:09 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-712cb469-18e5-401f-b6fa-74b61c2387a1 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 11:59:09 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-712cb469-18e5-401f-b6fa-74b61c2387a1 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] CPU controller found on host. {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 11:59:09 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-712cb469-18e5-401f-b6fa-74b61c2387a1 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74190) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 11:59:09 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-712cb469-18e5-401f-b6fa-74b61c2387a1 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T11:37:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 11:59:09 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-712cb469-18e5-401f-b6fa-74b61c2387a1 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Flavor limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 11:59:09 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-712cb469-18e5-401f-b6fa-74b61c2387a1 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Image limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 11:59:09 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-712cb469-18e5-401f-b6fa-74b61c2387a1 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Flavor pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 11:59:09 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-712cb469-18e5-401f-b6fa-74b61c2387a1 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Image pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 11:59:09 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-712cb469-18e5-401f-b6fa-74b61c2387a1 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 11:59:09 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-712cb469-18e5-401f-b6fa-74b61c2387a1 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 11:59:09 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-712cb469-18e5-401f-b6fa-74b61c2387a1 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 11:59:09 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-712cb469-18e5-401f-b6fa-74b61c2387a1 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Got 1 possible topologies {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 11:59:09 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-712cb469-18e5-401f-b6fa-74b61c2387a1 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 11:59:09 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-712cb469-18e5-401f-b6fa-74b61c2387a1 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 11:59:09 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-712cb469-18e5-401f-b6fa-74b61c2387a1 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:59:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1466284603',display_name='tempest-VolumesActionsTest-instance-1466284603',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1466284603',id=30,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62ed99f026894d569a13d0854fab0a17',ramdisk_id='',reservation_id='r-tmjgl0z3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-563901414',owner_user_name='tempest-VolumesActionsTest-563901414-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:59:07Z,user_data=None,user_id='b0ef25ad27f64ac8a423b867e0f7b836',uuid=dcea54d1-e5e8-4079-8c59-499c82404088,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f38bbc7-5909-4f37-a35b-aeba01946e4d", "address": "fa:16:3e:1e:d7:b2", "network": {"id": "d143b91a-fbcd-40d0-b199-381c523b8a0c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-175467972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62ed99f026894d569a13d0854fab0a17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f38bbc7-59", "ovs_interfaceid": "8f38bbc7-5909-4f37-a35b-aeba01946e4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74190) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 11:59:09 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-712cb469-18e5-401f-b6fa-74b61c2387a1 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Converting VIF {"id": "8f38bbc7-5909-4f37-a35b-aeba01946e4d", "address": "fa:16:3e:1e:d7:b2", "network": {"id": "d143b91a-fbcd-40d0-b199-381c523b8a0c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-175467972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62ed99f026894d569a13d0854fab0a17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f38bbc7-59", "ovs_interfaceid": "8f38bbc7-5909-4f37-a35b-aeba01946e4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:59:09 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-712cb469-18e5-401f-b6fa-74b61c2387a1 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:d7:b2,bridge_name='br-int',has_traffic_filtering=True,id=8f38bbc7-5909-4f37-a35b-aeba01946e4d,network=Network(d143b91a-fbcd-40d0-b199-381c523b8a0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f38bbc7-59') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:59:09 user nova-compute[74190]: DEBUG nova.objects.instance [None req-712cb469-18e5-401f-b6fa-74b61c2387a1 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Lazy-loading 'pci_devices' on Instance uuid dcea54d1-e5e8-4079-8c59-499c82404088 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:59:09 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-712cb469-18e5-401f-b6fa-74b61c2387a1 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] [instance: dcea54d1-e5e8-4079-8c59-499c82404088] End _get_guest_xml xml=<domain type="kvm">
Oct 18 11:59:09 user nova-compute[74190]:   <uuid>dcea54d1-e5e8-4079-8c59-499c82404088</uuid>
Oct 18 11:59:09 user nova-compute[74190]:   <name>instance-0000001e</name>
Oct 18 11:59:09 user nova-compute[74190]:   <memory>524288</memory>
Oct 18 11:59:09 user nova-compute[74190]:   <vcpu>1</vcpu>
Oct 18 11:59:09 user nova-compute[74190]:   <metadata>
Oct 18 11:59:09 user nova-compute[74190]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 11:59:09 user nova-compute[74190]:       <nova:package version="0.0.0"/>
Oct 18 11:59:09 user nova-compute[74190]:       <nova:name>tempest-VolumesActionsTest-instance-1466284603</nova:name>
Oct 18 11:59:09 user nova-compute[74190]:       <nova:creationTime>2023-10-18 11:59:09</nova:creationTime>
Oct 18 11:59:09 user nova-compute[74190]:       <nova:flavor name="m1.tiny">
Oct 18 11:59:09 user nova-compute[74190]:         <nova:memory>512</nova:memory>
Oct 18 11:59:09 user nova-compute[74190]:         <nova:disk>1</nova:disk>
Oct 18 11:59:09 user nova-compute[74190]:         <nova:swap>0</nova:swap>
Oct 18 11:59:09 user nova-compute[74190]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 11:59:09 user nova-compute[74190]:         <nova:vcpus>1</nova:vcpus>
Oct 18 11:59:09 user nova-compute[74190]:       </nova:flavor>
Oct 18 11:59:09 user nova-compute[74190]:       <nova:owner>
Oct 18 11:59:09 user nova-compute[74190]:         <nova:user uuid="b0ef25ad27f64ac8a423b867e0f7b836">tempest-VolumesActionsTest-563901414-project-member</nova:user>
Oct 18 11:59:09 user nova-compute[74190]:         <nova:project uuid="62ed99f026894d569a13d0854fab0a17">tempest-VolumesActionsTest-563901414</nova:project>
Oct 18 11:59:09 user nova-compute[74190]:       </nova:owner>
Oct 18 11:59:09 user nova-compute[74190]:       <nova:root type="image" uuid="6e88bbf0-6e78-49a8-b3c5-9453d22a89df"/>
Oct 18 11:59:09 user nova-compute[74190]:       <nova:ports>
Oct 18 11:59:09 user nova-compute[74190]:         <nova:port uuid="8f38bbc7-5909-4f37-a35b-aeba01946e4d">
Oct 18 11:59:09 user nova-compute[74190]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 18 11:59:09 user nova-compute[74190]:         </nova:port>
Oct 18 11:59:09 user nova-compute[74190]:       </nova:ports>
Oct 18 11:59:09 user nova-compute[74190]:     </nova:instance>
Oct 18 11:59:09 user nova-compute[74190]:   </metadata>
Oct 18 11:59:09 user nova-compute[74190]:   <sysinfo type="smbios">
Oct 18 11:59:09 user nova-compute[74190]:     <system>
Oct 18 11:59:09 user nova-compute[74190]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 11:59:09 user nova-compute[74190]:       <entry name="product">OpenStack Nova</entry>
Oct 18 11:59:09 user nova-compute[74190]:       <entry name="version">0.0.0</entry>
Oct 18 11:59:09 user nova-compute[74190]:       <entry name="serial">dcea54d1-e5e8-4079-8c59-499c82404088</entry>
Oct 18 11:59:09 user nova-compute[74190]:       <entry name="uuid">dcea54d1-e5e8-4079-8c59-499c82404088</entry>
Oct 18 11:59:09 user nova-compute[74190]:       <entry name="family">Virtual Machine</entry>
Oct 18 11:59:09 user nova-compute[74190]:     </system>
Oct 18 11:59:09 user nova-compute[74190]:   </sysinfo>
Oct 18 11:59:09 user nova-compute[74190]:   <os>
Oct 18 11:59:09 user nova-compute[74190]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 11:59:09 user nova-compute[74190]:     <boot dev="hd"/>
Oct 18 11:59:09 user nova-compute[74190]:     <smbios mode="sysinfo"/>
Oct 18 11:59:09 user nova-compute[74190]:   </os>
Oct 18 11:59:09 user nova-compute[74190]:   <features>
Oct 18 11:59:09 user nova-compute[74190]:     <acpi/>
Oct 18 11:59:09 user nova-compute[74190]:     <apic/>
Oct 18 11:59:09 user nova-compute[74190]:     <vmcoreinfo/>
Oct 18 11:59:09 user nova-compute[74190]:   </features>
Oct 18 11:59:09 user nova-compute[74190]:   <clock offset="utc">
Oct 18 11:59:09 user nova-compute[74190]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 11:59:09 user nova-compute[74190]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 11:59:09 user nova-compute[74190]:     <timer name="hpet" present="no"/>
Oct 18 11:59:09 user nova-compute[74190]:   </clock>
Oct 18 11:59:09 user nova-compute[74190]:   <cpu mode="custom" match="exact">
Oct 18 11:59:09 user nova-compute[74190]:     <model>Nehalem</model>
Oct 18 11:59:09 user nova-compute[74190]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 11:59:09 user nova-compute[74190]:   </cpu>
Oct 18 11:59:09 user nova-compute[74190]:   <devices>
Oct 18 11:59:09 user nova-compute[74190]:     <disk type="file" device="disk">
Oct 18 11:59:09 user nova-compute[74190]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 11:59:09 user nova-compute[74190]:       <source file="/opt/stack/data/nova/instances/dcea54d1-e5e8-4079-8c59-499c82404088/disk"/>
Oct 18 11:59:09 user nova-compute[74190]:       <target dev="vda" bus="virtio"/>
Oct 18 11:59:09 user nova-compute[74190]:     </disk>
Oct 18 11:59:09 user nova-compute[74190]:     <interface type="ethernet">
Oct 18 11:59:09 user nova-compute[74190]:       <mac address="fa:16:3e:1e:d7:b2"/>
Oct 18 11:59:09 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:59:09 user nova-compute[74190]:       <mtu size="1442"/>
Oct 18 11:59:09 user nova-compute[74190]:       <target dev="tap8f38bbc7-59"/>
Oct 18 11:59:09 user nova-compute[74190]:     </interface>
Oct 18 11:59:09 user nova-compute[74190]:     <serial type="pty">
Oct 18 11:59:09 user nova-compute[74190]:       <log file="/opt/stack/data/nova/instances/dcea54d1-e5e8-4079-8c59-499c82404088/console.log" append="off"/>
Oct 18 11:59:09 user nova-compute[74190]:     </serial>
Oct 18 11:59:09 user nova-compute[74190]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 11:59:09 user nova-compute[74190]:     <video>
Oct 18 11:59:09 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:59:09 user nova-compute[74190]:     </video>
Oct 18 11:59:09 user nova-compute[74190]:     <rng model="virtio">
Oct 18 11:59:09 user nova-compute[74190]:       <backend model="random">/dev/urandom</backend>
Oct 18 11:59:09 user nova-compute[74190]:     </rng>
Oct 18 11:59:09 user nova-compute[74190]:     <controller type="usb" index="0" model="none"/>
Oct 18 11:59:09 user nova-compute[74190]:     <memballoon model="virtio">
Oct 18 11:59:09 user nova-compute[74190]:       <stats period="10"/>
Oct 18 11:59:09 user nova-compute[74190]:     </memballoon>
Oct 18 11:59:09 user nova-compute[74190]:   </devices>
Oct 18 11:59:09 user nova-compute[74190]: </domain>
Oct 18 11:59:09 user nova-compute[74190]:  {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 11:59:09 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-712cb469-18e5-401f-b6fa-74b61c2387a1 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:59:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1466284603',display_name='tempest-VolumesActionsTest-instance-1466284603',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1466284603',id=30,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62ed99f026894d569a13d0854fab0a17',ramdisk_id='',reservation_id='r-tmjgl0z3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-563901414',owner_user_name='tempest-VolumesActionsTest-563901414-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:59:07Z,user_data=None,user_id='b0ef25ad27f64ac8a423b867e0f7b836',uuid=dcea54d1-e5e8-4079-8c59-499c82404088,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f38bbc7-5909-4f37-a35b-aeba01946e4d", "address": "fa:16:3e:1e:d7:b2", "network": {"id": "d143b91a-fbcd-40d0-b199-381c523b8a0c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-175467972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62ed99f026894d569a13d0854fab0a17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f38bbc7-59", "ovs_interfaceid": "8f38bbc7-5909-4f37-a35b-aeba01946e4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 11:59:09 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-712cb469-18e5-401f-b6fa-74b61c2387a1 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Converting VIF {"id": "8f38bbc7-5909-4f37-a35b-aeba01946e4d", "address": "fa:16:3e:1e:d7:b2", "network": {"id": "d143b91a-fbcd-40d0-b199-381c523b8a0c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-175467972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62ed99f026894d569a13d0854fab0a17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f38bbc7-59", "ovs_interfaceid": "8f38bbc7-5909-4f37-a35b-aeba01946e4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:59:09 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-712cb469-18e5-401f-b6fa-74b61c2387a1 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:d7:b2,bridge_name='br-int',has_traffic_filtering=True,id=8f38bbc7-5909-4f37-a35b-aeba01946e4d,network=Network(d143b91a-fbcd-40d0-b199-381c523b8a0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f38bbc7-59') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:59:09 user nova-compute[74190]: DEBUG os_vif [None req-712cb469-18e5-401f-b6fa-74b61c2387a1 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:d7:b2,bridge_name='br-int',has_traffic_filtering=True,id=8f38bbc7-5909-4f37-a35b-aeba01946e4d,network=Network(d143b91a-fbcd-40d0-b199-381c523b8a0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f38bbc7-59') {{(pid=74190) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 11:59:09 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:59:09 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:59:09 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 11:59:09 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:59:09 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '98fc6805-99f5-56ca-9ceb-c8571111bcd9', '_type': 'linux-noop'}}, row=False) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:59:09 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eec9cde-3553-4fc8-9162-cda963d1a81e/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:59:09 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eec9cde-3553-4fc8-9162-cda963d1a81e/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:59:09 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:59:09 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:59:09 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:59:09 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8f38bbc7-59, may_exist=True, interface_attrs={}) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:59:09 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8f38bbc7-59, col_values=(('qos', UUID('6bc78b84-a2c3-435a-8693-1bc40a50eb02')),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:59:09 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8f38bbc7-59, col_values=(('external_ids', {'iface-id': '8f38bbc7-5909-4f37-a35b-aeba01946e4d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1e:d7:b2', 'vm-uuid': 'dcea54d1-e5e8-4079-8c59-499c82404088'}),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:59:09 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:59:09 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:59:09 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:59:09 user nova-compute[74190]: INFO os_vif [None req-712cb469-18e5-401f-b6fa-74b61c2387a1 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:d7:b2,bridge_name='br-int',has_traffic_filtering=True,id=8f38bbc7-5909-4f37-a35b-aeba01946e4d,network=Network(d143b91a-fbcd-40d0-b199-381c523b8a0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f38bbc7-59')
Oct 18 11:59:09 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 11:59:09 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 11:59:09 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-712cb469-18e5-401f-b6fa-74b61c2387a1 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] No BDM found with device name vda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 11:59:09 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-712cb469-18e5-401f-b6fa-74b61c2387a1 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] No VIF found with MAC fa:16:3e:1e:d7:b2, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 11:59:09 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.578s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:59:09 user nova-compute[74190]: DEBUG nova.compute.manager [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Start building networks asynchronously for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 11:59:09 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eec9cde-3553-4fc8-9162-cda963d1a81e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:59:09 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 11:59:09 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:59:09 user nova-compute[74190]: DEBUG nova.compute.manager [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Allocating IP information in the background. {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 11:59:09 user nova-compute[74190]: DEBUG nova.network.neutron [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] allocate_for_instance() {{(pid=74190) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 11:59:09 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 11:59:09 user nova-compute[74190]: DEBUG nova.compute.manager [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Start building block device mappings for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 11:59:09 user nova-compute[74190]: DEBUG nova.network.neutron [req-2aad1964-a559-49d1-b1c1-c89ed728166b req-02105c5f-2a77-47ab-9ea5-5d733b4f05a5 service nova] [instance: dcea54d1-e5e8-4079-8c59-499c82404088] Updated VIF entry in instance network info cache for port 8f38bbc7-5909-4f37-a35b-aeba01946e4d. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 11:59:09 user nova-compute[74190]: DEBUG nova.network.neutron [req-2aad1964-a559-49d1-b1c1-c89ed728166b req-02105c5f-2a77-47ab-9ea5-5d733b4f05a5 service nova] [instance: dcea54d1-e5e8-4079-8c59-499c82404088] Updating instance_info_cache with network_info: [{"id": "8f38bbc7-5909-4f37-a35b-aeba01946e4d", "address": "fa:16:3e:1e:d7:b2", "network": {"id": "d143b91a-fbcd-40d0-b199-381c523b8a0c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-175467972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62ed99f026894d569a13d0854fab0a17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f38bbc7-59", "ovs_interfaceid": "8f38bbc7-5909-4f37-a35b-aeba01946e4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:59:09 user nova-compute[74190]: INFO nova.virt.block_device [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Booting with blank volume at /dev/vda
Oct 18 11:59:09 user nova-compute[74190]: DEBUG nova.policy [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7fa675b6803f4e21b090295b51fb9ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d994366010142519ff367fa7ca77e61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74190) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 11:59:09 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-2aad1964-a559-49d1-b1c1-c89ed728166b req-02105c5f-2a77-47ab-9ea5-5d733b4f05a5 service nova] Releasing lock "refresh_cache-dcea54d1-e5e8-4079-8c59-499c82404088" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:59:09 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:59:09 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:59:09 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:59:09 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0209c824-88a7-4976-83bf-8a72437f0cc2/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:59:10 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:59:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0209c824-88a7-4976-83bf-8a72437f0cc2/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:59:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0209c824-88a7-4976-83bf-8a72437f0cc2/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:59:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0209c824-88a7-4976-83bf-8a72437f0cc2/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:59:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:59:10 user nova-compute[74190]: DEBUG nova.network.neutron [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Successfully created port: a32b81a2-7b02-48ed-9550-d392be5e221e {{(pid=74190) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 11:59:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:59:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:59:10 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:59:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:59:10 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 11:59:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk.rescue --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:59:10 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:59:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk.rescue --force-share --output=json" returned: 0 in 0.219s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:59:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk.rescue --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:59:11 user nova-compute[74190]: DEBUG nova.network.neutron [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Successfully updated port: a32b81a2-7b02-48ed-9550-d392be5e221e {{(pid=74190) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 11:59:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:59:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:59:11 user nova-compute[74190]: DEBUG nova.compute.manager [req-c3705819-5ed7-4351-a1c0-7d593c8e0535 req-a4420019-a043-4d0c-a6bd-0cc53ad014c6 service nova] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Received event network-changed-a32b81a2-7b02-48ed-9550-d392be5e221e {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:59:11 user nova-compute[74190]: DEBUG nova.compute.manager [req-c3705819-5ed7-4351-a1c0-7d593c8e0535 req-a4420019-a043-4d0c-a6bd-0cc53ad014c6 service nova] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Refreshing instance network info cache due to event network-changed-a32b81a2-7b02-48ed-9550-d392be5e221e. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 11:59:11 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-c3705819-5ed7-4351-a1c0-7d593c8e0535 req-a4420019-a043-4d0c-a6bd-0cc53ad014c6 service nova] Acquiring lock "refresh_cache-0382820d-a678-4593-85df-168f42fc4ce4" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:59:11 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-c3705819-5ed7-4351-a1c0-7d593c8e0535 req-a4420019-a043-4d0c-a6bd-0cc53ad014c6 service nova] Acquired lock "refresh_cache-0382820d-a678-4593-85df-168f42fc4ce4" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:59:11 user nova-compute[74190]: DEBUG nova.network.neutron [req-c3705819-5ed7-4351-a1c0-7d593c8e0535 req-a4420019-a043-4d0c-a6bd-0cc53ad014c6 service nova] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Refreshing network info cache for port a32b81a2-7b02-48ed-9550-d392be5e221e {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 11:59:11 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Acquiring lock "refresh_cache-0382820d-a678-4593-85df-168f42fc4ce4" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:59:11 user nova-compute[74190]: DEBUG nova.network.neutron [req-c3705819-5ed7-4351-a1c0-7d593c8e0535 req-a4420019-a043-4d0c-a6bd-0cc53ad014c6 service nova] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Instance cache missing network info. {{(pid=74190) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 11:59:11 user nova-compute[74190]: DEBUG nova.compute.manager [req-0c3f6e7f-8a89-4db5-9160-23200fbf9274 req-bb61f383-b7c5-4f97-8883-05eae0b2eb7d service nova] [instance: dcea54d1-e5e8-4079-8c59-499c82404088] Received event network-vif-plugged-8f38bbc7-5909-4f37-a35b-aeba01946e4d {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:59:11 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-0c3f6e7f-8a89-4db5-9160-23200fbf9274 req-bb61f383-b7c5-4f97-8883-05eae0b2eb7d service nova] Acquiring lock "dcea54d1-e5e8-4079-8c59-499c82404088-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:59:11 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-0c3f6e7f-8a89-4db5-9160-23200fbf9274 req-bb61f383-b7c5-4f97-8883-05eae0b2eb7d service nova] Lock "dcea54d1-e5e8-4079-8c59-499c82404088-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:59:11 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-0c3f6e7f-8a89-4db5-9160-23200fbf9274 req-bb61f383-b7c5-4f97-8883-05eae0b2eb7d service nova] Lock "dcea54d1-e5e8-4079-8c59-499c82404088-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:59:11 user nova-compute[74190]: DEBUG nova.compute.manager [req-0c3f6e7f-8a89-4db5-9160-23200fbf9274 req-bb61f383-b7c5-4f97-8883-05eae0b2eb7d service nova] [instance: dcea54d1-e5e8-4079-8c59-499c82404088] No waiting events found dispatching network-vif-plugged-8f38bbc7-5909-4f37-a35b-aeba01946e4d {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:59:11 user nova-compute[74190]: WARNING nova.compute.manager [req-0c3f6e7f-8a89-4db5-9160-23200fbf9274 req-bb61f383-b7c5-4f97-8883-05eae0b2eb7d service nova] [instance: dcea54d1-e5e8-4079-8c59-499c82404088] Received unexpected event network-vif-plugged-8f38bbc7-5909-4f37-a35b-aeba01946e4d for instance with vm_state building and task_state spawning.
Oct 18 11:59:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:59:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:59:11 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:59:11 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:59:11 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:59:11 user nova-compute[74190]: DEBUG nova.network.neutron [req-c3705819-5ed7-4351-a1c0-7d593c8e0535 req-a4420019-a043-4d0c-a6bd-0cc53ad014c6 service nova] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Updating instance_info_cache with network_info: [] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:59:11 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-c3705819-5ed7-4351-a1c0-7d593c8e0535 req-a4420019-a043-4d0c-a6bd-0cc53ad014c6 service nova] Releasing lock "refresh_cache-0382820d-a678-4593-85df-168f42fc4ce4" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:59:11 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Acquired lock "refresh_cache-0382820d-a678-4593-85df-168f42fc4ce4" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:59:11 user nova-compute[74190]: DEBUG nova.network.neutron [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Building network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 11:59:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:59:11 user nova-compute[74190]: DEBUG nova.network.neutron [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Instance cache missing network info. {{(pid=74190) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 11:59:13 user nova-compute[74190]: DEBUG nova.compute.manager [None req-712cb469-18e5-401f-b6fa-74b61c2387a1 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] [instance: dcea54d1-e5e8-4079-8c59-499c82404088] Instance event wait completed in 0 seconds for  {{(pid=74190) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 11:59:13 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-712cb469-18e5-401f-b6fa-74b61c2387a1 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] [instance: dcea54d1-e5e8-4079-8c59-499c82404088] Guest created on hypervisor {{(pid=74190) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 11:59:13 user nova-compute[74190]: DEBUG nova.compute.manager [req-5c28357f-b15a-42ef-9c7a-7bc4a536b327 req-1e0d941b-d5dc-446c-8de4-c7d9c034043d service nova] [instance: dcea54d1-e5e8-4079-8c59-499c82404088] Received event network-vif-plugged-8f38bbc7-5909-4f37-a35b-aeba01946e4d {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:59:13 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-5c28357f-b15a-42ef-9c7a-7bc4a536b327 req-1e0d941b-d5dc-446c-8de4-c7d9c034043d service nova] Acquiring lock "dcea54d1-e5e8-4079-8c59-499c82404088-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:59:13 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-5c28357f-b15a-42ef-9c7a-7bc4a536b327 req-1e0d941b-d5dc-446c-8de4-c7d9c034043d service nova] Lock "dcea54d1-e5e8-4079-8c59-499c82404088-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:59:13 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-5c28357f-b15a-42ef-9c7a-7bc4a536b327 req-1e0d941b-d5dc-446c-8de4-c7d9c034043d service nova] Lock "dcea54d1-e5e8-4079-8c59-499c82404088-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:59:13 user nova-compute[74190]: DEBUG nova.compute.manager [req-5c28357f-b15a-42ef-9c7a-7bc4a536b327 req-1e0d941b-d5dc-446c-8de4-c7d9c034043d service nova] [instance: dcea54d1-e5e8-4079-8c59-499c82404088] No waiting events found dispatching network-vif-plugged-8f38bbc7-5909-4f37-a35b-aeba01946e4d {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:59:13 user nova-compute[74190]: WARNING nova.compute.manager [req-5c28357f-b15a-42ef-9c7a-7bc4a536b327 req-1e0d941b-d5dc-446c-8de4-c7d9c034043d service nova] [instance: dcea54d1-e5e8-4079-8c59-499c82404088] Received unexpected event network-vif-plugged-8f38bbc7-5909-4f37-a35b-aeba01946e4d for instance with vm_state building and task_state spawning.
Oct 18 11:59:13 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:59:13 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:59:13 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Hypervisor/Node resource view: name=user free_ram=7879MB free_disk=25.10634994506836GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74190) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 11:59:13 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:59:13 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:59:13 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: dcea54d1-e5e8-4079-8c59-499c82404088] Instance spawned successfully.
Oct 18 11:59:13 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-712cb469-18e5-401f-b6fa-74b61c2387a1 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] [instance: dcea54d1-e5e8-4079-8c59-499c82404088] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 11:59:13 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-712cb469-18e5-401f-b6fa-74b61c2387a1 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] [instance: dcea54d1-e5e8-4079-8c59-499c82404088] Found default for hw_cdrom_bus of ide {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:59:13 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-712cb469-18e5-401f-b6fa-74b61c2387a1 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] [instance: dcea54d1-e5e8-4079-8c59-499c82404088] Found default for hw_disk_bus of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:59:13 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-712cb469-18e5-401f-b6fa-74b61c2387a1 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] [instance: dcea54d1-e5e8-4079-8c59-499c82404088] Found default for hw_input_bus of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:59:13 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-712cb469-18e5-401f-b6fa-74b61c2387a1 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] [instance: dcea54d1-e5e8-4079-8c59-499c82404088] Found default for hw_pointer_model of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:59:13 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-712cb469-18e5-401f-b6fa-74b61c2387a1 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] [instance: dcea54d1-e5e8-4079-8c59-499c82404088] Found default for hw_video_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:59:13 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-712cb469-18e5-401f-b6fa-74b61c2387a1 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] [instance: dcea54d1-e5e8-4079-8c59-499c82404088] Found default for hw_vif_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:59:13 user nova-compute[74190]: INFO nova.compute.manager [None req-712cb469-18e5-401f-b6fa-74b61c2387a1 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] [instance: dcea54d1-e5e8-4079-8c59-499c82404088] Took 6.06 seconds to spawn the instance on the hypervisor.
Oct 18 11:59:13 user nova-compute[74190]: DEBUG nova.compute.manager [None req-712cb469-18e5-401f-b6fa-74b61c2387a1 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] [instance: dcea54d1-e5e8-4079-8c59-499c82404088] Checking state {{(pid=74190) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 11:59:13 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 0209c824-88a7-4976-83bf-8a72437f0cc2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:59:13 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 4e916d24-9f9d-4289-87ce-f65d2499fcd9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:59:13 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 8eec9cde-3553-4fc8-9162-cda963d1a81e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:59:13 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 95ca0697-22b5-4109-868f-ca5556015a1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:59:13 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 42413a94-9973-4e8d-83b6-207a4e7847c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:59:13 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance a9012673-826b-4be7-a55b-9bb35a227c17 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:59:13 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 772b126c-2148-4ca8-90f2-69d6eb4b7db7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:59:13 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance dcea54d1-e5e8-4079-8c59-499c82404088 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:59:13 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 0382820d-a678-4593-85df-168f42fc4ce4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 11:59:13 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 11:59:13 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 11:59:13 user nova-compute[74190]: DEBUG nova.network.neutron [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Updating instance_info_cache with network_info: [{"id": "a32b81a2-7b02-48ed-9550-d392be5e221e", "address": "fa:16:3e:e7:d8:e5", "network": {"id": "c2dbbd24-f1d2-47a2-835f-0f9b24b585f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-920140900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d994366010142519ff367fa7ca77e61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa32b81a2-7b", "ovs_interfaceid": "a32b81a2-7b02-48ed-9550-d392be5e221e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:59:13 user nova-compute[74190]: INFO nova.compute.manager [None req-712cb469-18e5-401f-b6fa-74b61c2387a1 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] [instance: dcea54d1-e5e8-4079-8c59-499c82404088] Took 6.82 seconds to build instance.
Oct 18 11:59:13 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Releasing lock "refresh_cache-0382820d-a678-4593-85df-168f42fc4ce4" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:59:13 user nova-compute[74190]: DEBUG nova.compute.manager [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Instance network_info: |[{"id": "a32b81a2-7b02-48ed-9550-d392be5e221e", "address": "fa:16:3e:e7:d8:e5", "network": {"id": "c2dbbd24-f1d2-47a2-835f-0f9b24b585f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-920140900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d994366010142519ff367fa7ca77e61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa32b81a2-7b", "ovs_interfaceid": "a32b81a2-7b02-48ed-9550-d392be5e221e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 11:59:13 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-712cb469-18e5-401f-b6fa-74b61c2387a1 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Lock "dcea54d1-e5e8-4079-8c59-499c82404088" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.953s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:59:13 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 11:59:13 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 11:59:13 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Compute_service record updated for user:user {{(pid=74190) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 11:59:13 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.506s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:59:14 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:59:14 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:59:14 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 11:59:15 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:59:15 user nova-compute[74190]: DEBUG os_brick.utils [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:59:15 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:59:15 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:59:15 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[de26fd21-cb89-4e76-a271-521ab1bf336a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cff158e257e1\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:59:15 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:59:15 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:59:15 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec70efe2-0aee-4c8b-a973-eacd3af4f06d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:59:15 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:59:15 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:59:15 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcdd7f1d-e455-4f9b-8f86-0cddb1d4ab4b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:59:15 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[8605e60a-a5ef-4ce9-886c-69d75b44ceac]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:59:15 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Running cmd (subprocess): nvme version {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:59:15 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] 'nvme version' failed. Not Retrying. {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 11:59:15 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] nvme not present on system {{(pid=74190) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 11:59:15 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:59:15 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 11:59:15 user nova-compute[74190]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 11:59:15 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da5faab-6d81-40b0-bb6b-89e5f992edbf]: (4, '') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:59:15 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74190) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 11:59:15 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 11:59:15 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] LIGHTOS: no hostnqn found. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 11:59:15 user nova-compute[74190]: DEBUG os_brick.utils [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cff158e257e1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:59:15 user nova-compute[74190]: DEBUG nova.virt.block_device [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Updating existing volume attachment record: f776cc27-fc43-47e4-959d-8c312a1a7aa8 {{(pid=74190) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 11:59:19 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:59:20 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:59:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:59:25 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:59:26 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-4edd8ad0-cbce-4b2a-a24f-e50de7ec4a0d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Acquiring lock "7128c4e8-0118-4138-b421-9b1d610d7454" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:59:26 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-4edd8ad0-cbce-4b2a-a24f-e50de7ec4a0d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "7128c4e8-0118-4138-b421-9b1d610d7454" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.005s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:59:26 user nova-compute[74190]: DEBUG nova.compute.manager [None req-4edd8ad0-cbce-4b2a-a24f-e50de7ec4a0d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: 7128c4e8-0118-4138-b421-9b1d610d7454] Starting instance... {{(pid=74190) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 11:59:27 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-4edd8ad0-cbce-4b2a-a24f-e50de7ec4a0d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:59:27 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-4edd8ad0-cbce-4b2a-a24f-e50de7ec4a0d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:59:27 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-4edd8ad0-cbce-4b2a-a24f-e50de7ec4a0d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74190) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 11:59:27 user nova-compute[74190]: INFO nova.compute.claims [None req-4edd8ad0-cbce-4b2a-a24f-e50de7ec4a0d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: 7128c4e8-0118-4138-b421-9b1d610d7454] Claim successful on node user
Oct 18 11:59:27 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-4edd8ad0-cbce-4b2a-a24f-e50de7ec4a0d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 11:59:27 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-4edd8ad0-cbce-4b2a-a24f-e50de7ec4a0d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 11:59:27 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-4edd8ad0-cbce-4b2a-a24f-e50de7ec4a0d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.408s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:59:27 user nova-compute[74190]: DEBUG nova.compute.manager [None req-4edd8ad0-cbce-4b2a-a24f-e50de7ec4a0d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: 7128c4e8-0118-4138-b421-9b1d610d7454] Start building networks asynchronously for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 11:59:27 user nova-compute[74190]: DEBUG nova.compute.manager [None req-4edd8ad0-cbce-4b2a-a24f-e50de7ec4a0d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: 7128c4e8-0118-4138-b421-9b1d610d7454] Allocating IP information in the background. {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 11:59:27 user nova-compute[74190]: DEBUG nova.network.neutron [None req-4edd8ad0-cbce-4b2a-a24f-e50de7ec4a0d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: 7128c4e8-0118-4138-b421-9b1d610d7454] allocate_for_instance() {{(pid=74190) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 11:59:27 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-4edd8ad0-cbce-4b2a-a24f-e50de7ec4a0d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: 7128c4e8-0118-4138-b421-9b1d610d7454] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 11:59:27 user nova-compute[74190]: DEBUG nova.compute.manager [None req-4edd8ad0-cbce-4b2a-a24f-e50de7ec4a0d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: 7128c4e8-0118-4138-b421-9b1d610d7454] Start building block device mappings for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 11:59:27 user nova-compute[74190]: DEBUG nova.policy [None req-4edd8ad0-cbce-4b2a-a24f-e50de7ec4a0d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7d6bb993153245daabfc59215abbf7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df06c4b010434e3da9ba4ea41f26befa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74190) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 11:59:27 user nova-compute[74190]: DEBUG nova.compute.manager [None req-4edd8ad0-cbce-4b2a-a24f-e50de7ec4a0d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: 7128c4e8-0118-4138-b421-9b1d610d7454] Start spawning the instance on the hypervisor. {{(pid=74190) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 11:59:27 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-4edd8ad0-cbce-4b2a-a24f-e50de7ec4a0d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: 7128c4e8-0118-4138-b421-9b1d610d7454] Creating instance directory {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 11:59:27 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-4edd8ad0-cbce-4b2a-a24f-e50de7ec4a0d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: 7128c4e8-0118-4138-b421-9b1d610d7454] Creating image(s)
Oct 18 11:59:27 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-4edd8ad0-cbce-4b2a-a24f-e50de7ec4a0d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Acquiring lock "/opt/stack/data/nova/instances/7128c4e8-0118-4138-b421-9b1d610d7454/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:59:27 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-4edd8ad0-cbce-4b2a-a24f-e50de7ec4a0d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "/opt/stack/data/nova/instances/7128c4e8-0118-4138-b421-9b1d610d7454/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:59:27 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-4edd8ad0-cbce-4b2a-a24f-e50de7ec4a0d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "/opt/stack/data/nova/instances/7128c4e8-0118-4138-b421-9b1d610d7454/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:59:27 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-4edd8ad0-cbce-4b2a-a24f-e50de7ec4a0d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:59:27 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-4edd8ad0-cbce-4b2a-a24f-e50de7ec4a0d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.188s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:59:27 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-4edd8ad0-cbce-4b2a-a24f-e50de7ec4a0d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Acquiring lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:59:27 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-4edd8ad0-cbce-4b2a-a24f-e50de7ec4a0d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:59:27 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-4edd8ad0-cbce-4b2a-a24f-e50de7ec4a0d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:59:28 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-4edd8ad0-cbce-4b2a-a24f-e50de7ec4a0d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.184s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:59:28 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-4edd8ad0-cbce-4b2a-a24f-e50de7ec4a0d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f,backing_fmt=raw /opt/stack/data/nova/instances/7128c4e8-0118-4138-b421-9b1d610d7454/disk 1073741824 {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:59:28 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-4edd8ad0-cbce-4b2a-a24f-e50de7ec4a0d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f,backing_fmt=raw /opt/stack/data/nova/instances/7128c4e8-0118-4138-b421-9b1d610d7454/disk 1073741824" returned: 0 in 0.057s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:59:28 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-4edd8ad0-cbce-4b2a-a24f-e50de7ec4a0d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:59:28 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-4edd8ad0-cbce-4b2a-a24f-e50de7ec4a0d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:59:28 user nova-compute[74190]: DEBUG nova.network.neutron [None req-4edd8ad0-cbce-4b2a-a24f-e50de7ec4a0d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: 7128c4e8-0118-4138-b421-9b1d610d7454] Successfully created port: bc81c313-cdfc-4ef9-9c98-6efba1603301 {{(pid=74190) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 11:59:28 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-4edd8ad0-cbce-4b2a-a24f-e50de7ec4a0d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.182s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:59:28 user nova-compute[74190]: DEBUG nova.virt.disk.api [None req-4edd8ad0-cbce-4b2a-a24f-e50de7ec4a0d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7128c4e8-0118-4138-b421-9b1d610d7454/disk. size=1073741824 {{(pid=74190) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 18 11:59:28 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-4edd8ad0-cbce-4b2a-a24f-e50de7ec4a0d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7128c4e8-0118-4138-b421-9b1d610d7454/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:59:28 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-4edd8ad0-cbce-4b2a-a24f-e50de7ec4a0d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7128c4e8-0118-4138-b421-9b1d610d7454/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:59:28 user nova-compute[74190]: DEBUG nova.virt.disk.api [None req-4edd8ad0-cbce-4b2a-a24f-e50de7ec4a0d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Cannot resize image /opt/stack/data/nova/instances/7128c4e8-0118-4138-b421-9b1d610d7454/disk to a smaller size. {{(pid=74190) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 18 11:59:28 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-4edd8ad0-cbce-4b2a-a24f-e50de7ec4a0d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: 7128c4e8-0118-4138-b421-9b1d610d7454] Created local disks {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 11:59:28 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-4edd8ad0-cbce-4b2a-a24f-e50de7ec4a0d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: 7128c4e8-0118-4138-b421-9b1d610d7454] Ensure instance console log exists: /opt/stack/data/nova/instances/7128c4e8-0118-4138-b421-9b1d610d7454/console.log {{(pid=74190) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 11:59:28 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-4edd8ad0-cbce-4b2a-a24f-e50de7ec4a0d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:59:28 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-4edd8ad0-cbce-4b2a-a24f-e50de7ec4a0d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:59:28 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-4edd8ad0-cbce-4b2a-a24f-e50de7ec4a0d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:59:28 user nova-compute[74190]: DEBUG nova.network.neutron [None req-4edd8ad0-cbce-4b2a-a24f-e50de7ec4a0d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: 7128c4e8-0118-4138-b421-9b1d610d7454] Successfully updated port: bc81c313-cdfc-4ef9-9c98-6efba1603301 {{(pid=74190) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 11:59:28 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-4edd8ad0-cbce-4b2a-a24f-e50de7ec4a0d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Acquiring lock "refresh_cache-7128c4e8-0118-4138-b421-9b1d610d7454" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:59:28 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-4edd8ad0-cbce-4b2a-a24f-e50de7ec4a0d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Acquired lock "refresh_cache-7128c4e8-0118-4138-b421-9b1d610d7454" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:59:28 user nova-compute[74190]: DEBUG nova.network.neutron [None req-4edd8ad0-cbce-4b2a-a24f-e50de7ec4a0d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: 7128c4e8-0118-4138-b421-9b1d610d7454] Building network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 11:59:28 user nova-compute[74190]: DEBUG nova.compute.manager [req-af96af22-b95c-4d81-8233-5c3fdfd74111 req-e4ec923d-820a-4ee3-8c9f-f7fbb6759dc2 service nova] [instance: 7128c4e8-0118-4138-b421-9b1d610d7454] Received event network-changed-bc81c313-cdfc-4ef9-9c98-6efba1603301 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:59:28 user nova-compute[74190]: DEBUG nova.compute.manager [req-af96af22-b95c-4d81-8233-5c3fdfd74111 req-e4ec923d-820a-4ee3-8c9f-f7fbb6759dc2 service nova] [instance: 7128c4e8-0118-4138-b421-9b1d610d7454] Refreshing instance network info cache due to event network-changed-bc81c313-cdfc-4ef9-9c98-6efba1603301. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 11:59:28 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-af96af22-b95c-4d81-8233-5c3fdfd74111 req-e4ec923d-820a-4ee3-8c9f-f7fbb6759dc2 service nova] Acquiring lock "refresh_cache-7128c4e8-0118-4138-b421-9b1d610d7454" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 11:59:29 user nova-compute[74190]: DEBUG nova.network.neutron [None req-4edd8ad0-cbce-4b2a-a24f-e50de7ec4a0d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: 7128c4e8-0118-4138-b421-9b1d610d7454] Instance cache missing network info. {{(pid=74190) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 11:59:29 user nova-compute[74190]: DEBUG nova.network.neutron [None req-4edd8ad0-cbce-4b2a-a24f-e50de7ec4a0d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: 7128c4e8-0118-4138-b421-9b1d610d7454] Updating instance_info_cache with network_info: [{"id": "bc81c313-cdfc-4ef9-9c98-6efba1603301", "address": "fa:16:3e:d1:de:c2", "network": {"id": "25e0d6f5-497d-4898-8181-5b4848950f16", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-245925644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df06c4b010434e3da9ba4ea41f26befa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc81c313-cd", "ovs_interfaceid": "bc81c313-cdfc-4ef9-9c98-6efba1603301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:59:29 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-4edd8ad0-cbce-4b2a-a24f-e50de7ec4a0d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Releasing lock "refresh_cache-7128c4e8-0118-4138-b421-9b1d610d7454" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:59:29 user nova-compute[74190]: DEBUG nova.compute.manager [None req-4edd8ad0-cbce-4b2a-a24f-e50de7ec4a0d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: 7128c4e8-0118-4138-b421-9b1d610d7454] Instance network_info: |[{"id": "bc81c313-cdfc-4ef9-9c98-6efba1603301", "address": "fa:16:3e:d1:de:c2", "network": {"id": "25e0d6f5-497d-4898-8181-5b4848950f16", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-245925644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df06c4b010434e3da9ba4ea41f26befa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc81c313-cd", "ovs_interfaceid": "bc81c313-cdfc-4ef9-9c98-6efba1603301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 11:59:29 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-af96af22-b95c-4d81-8233-5c3fdfd74111 req-e4ec923d-820a-4ee3-8c9f-f7fbb6759dc2 service nova] Acquired lock "refresh_cache-7128c4e8-0118-4138-b421-9b1d610d7454" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 11:59:29 user nova-compute[74190]: DEBUG nova.network.neutron [req-af96af22-b95c-4d81-8233-5c3fdfd74111 req-e4ec923d-820a-4ee3-8c9f-f7fbb6759dc2 service nova] [instance: 7128c4e8-0118-4138-b421-9b1d610d7454] Refreshing network info cache for port bc81c313-cdfc-4ef9-9c98-6efba1603301 {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 11:59:29 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-4edd8ad0-cbce-4b2a-a24f-e50de7ec4a0d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: 7128c4e8-0118-4138-b421-9b1d610d7454] Start _get_guest_xml network_info=[{"id": "bc81c313-cdfc-4ef9-9c98-6efba1603301", "address": "fa:16:3e:d1:de:c2", "network": {"id": "25e0d6f5-497d-4898-8181-5b4848950f16", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-245925644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df06c4b010434e3da9ba4ea41f26befa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc81c313-cd", "ovs_interfaceid": "bc81c313-cdfc-4ef9-9c98-6efba1603301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'image_id': '6e88bbf0-6e78-49a8-b3c5-9453d22a89df'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 11:59:29 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-4edd8ad0-cbce-4b2a-a24f-e50de7ec4a0d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:59:29 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-4edd8ad0-cbce-4b2a-a24f-e50de7ec4a0d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:59:29 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-4edd8ad0-cbce-4b2a-a24f-e50de7ec4a0d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 11:59:29 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-4edd8ad0-cbce-4b2a-a24f-e50de7ec4a0d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] CPU controller missing on host. {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 11:59:29 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-4edd8ad0-cbce-4b2a-a24f-e50de7ec4a0d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 11:59:29 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-4edd8ad0-cbce-4b2a-a24f-e50de7ec4a0d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] CPU controller found on host. {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 11:59:29 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-4edd8ad0-cbce-4b2a-a24f-e50de7ec4a0d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74190) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 11:59:29 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-4edd8ad0-cbce-4b2a-a24f-e50de7ec4a0d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T11:37:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 11:59:29 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-4edd8ad0-cbce-4b2a-a24f-e50de7ec4a0d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Flavor limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 11:59:29 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-4edd8ad0-cbce-4b2a-a24f-e50de7ec4a0d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Image limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 11:59:29 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-4edd8ad0-cbce-4b2a-a24f-e50de7ec4a0d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Flavor pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 11:59:29 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-4edd8ad0-cbce-4b2a-a24f-e50de7ec4a0d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Image pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 11:59:29 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-4edd8ad0-cbce-4b2a-a24f-e50de7ec4a0d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 11:59:29 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-4edd8ad0-cbce-4b2a-a24f-e50de7ec4a0d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 11:59:29 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-4edd8ad0-cbce-4b2a-a24f-e50de7ec4a0d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 11:59:29 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-4edd8ad0-cbce-4b2a-a24f-e50de7ec4a0d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Got 1 possible topologies {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 11:59:29 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-4edd8ad0-cbce-4b2a-a24f-e50de7ec4a0d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 11:59:29 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-4edd8ad0-cbce-4b2a-a24f-e50de7ec4a0d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 11:59:29 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-4edd8ad0-cbce-4b2a-a24f-e50de7ec4a0d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:59:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-78526681',display_name='tempest-AttachVolumeNegativeTest-server-78526681',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-78526681',id=32,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGHpX6pNGSXj2Dh6qmvnk8TzDprfMG0ku/74hC8gzYaiTscVO9KdQI7iLHX9m1z4rzTeJzELXcMd21TokrPU7bfbNpyzpbRJ0Jg33ifD66h8tRM7k270FRSlTn3m7/8iHQ==',key_name='tempest-keypair-1203749121',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df06c4b010434e3da9ba4ea41f26befa',ramdisk_id='',reservation_id='r-qy1zsitm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1730208605',owner_user_name='tempest-AttachVolumeNegativeTest-1730208605-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:59:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d6bb993153245daabfc59215abbf7a1',uuid=7128c4e8-0118-4138-b421-9b1d610d7454,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bc81c313-cdfc-4ef9-9c98-6efba1603301", "address": "fa:16:3e:d1:de:c2", "network": {"id": "25e0d6f5-497d-4898-8181-5b4848950f16", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-245925644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df06c4b010434e3da9ba4ea41f26befa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc81c313-cd", "ovs_interfaceid": "bc81c313-cdfc-4ef9-9c98-6efba1603301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74190) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 11:59:29 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-4edd8ad0-cbce-4b2a-a24f-e50de7ec4a0d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Converting VIF {"id": "bc81c313-cdfc-4ef9-9c98-6efba1603301", "address": "fa:16:3e:d1:de:c2", "network": {"id": "25e0d6f5-497d-4898-8181-5b4848950f16", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-245925644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df06c4b010434e3da9ba4ea41f26befa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc81c313-cd", "ovs_interfaceid": "bc81c313-cdfc-4ef9-9c98-6efba1603301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:59:29 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-4edd8ad0-cbce-4b2a-a24f-e50de7ec4a0d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:de:c2,bridge_name='br-int',has_traffic_filtering=True,id=bc81c313-cdfc-4ef9-9c98-6efba1603301,network=Network(25e0d6f5-497d-4898-8181-5b4848950f16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc81c313-cd') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:59:29 user nova-compute[74190]: DEBUG nova.objects.instance [None req-4edd8ad0-cbce-4b2a-a24f-e50de7ec4a0d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lazy-loading 'pci_devices' on Instance uuid 7128c4e8-0118-4138-b421-9b1d610d7454 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:59:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:59:29 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-4edd8ad0-cbce-4b2a-a24f-e50de7ec4a0d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: 7128c4e8-0118-4138-b421-9b1d610d7454] End _get_guest_xml xml=<domain type="kvm">
Oct 18 11:59:29 user nova-compute[74190]:   <uuid>7128c4e8-0118-4138-b421-9b1d610d7454</uuid>
Oct 18 11:59:29 user nova-compute[74190]:   <name>instance-00000020</name>
Oct 18 11:59:29 user nova-compute[74190]:   <memory>524288</memory>
Oct 18 11:59:29 user nova-compute[74190]:   <vcpu>1</vcpu>
Oct 18 11:59:29 user nova-compute[74190]:   <metadata>
Oct 18 11:59:29 user nova-compute[74190]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 11:59:29 user nova-compute[74190]:       <nova:package version="0.0.0"/>
Oct 18 11:59:29 user nova-compute[74190]:       <nova:name>tempest-AttachVolumeNegativeTest-server-78526681</nova:name>
Oct 18 11:59:29 user nova-compute[74190]:       <nova:creationTime>2023-10-18 11:59:29</nova:creationTime>
Oct 18 11:59:29 user nova-compute[74190]:       <nova:flavor name="m1.tiny">
Oct 18 11:59:29 user nova-compute[74190]:         <nova:memory>512</nova:memory>
Oct 18 11:59:29 user nova-compute[74190]:         <nova:disk>1</nova:disk>
Oct 18 11:59:29 user nova-compute[74190]:         <nova:swap>0</nova:swap>
Oct 18 11:59:29 user nova-compute[74190]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 11:59:29 user nova-compute[74190]:         <nova:vcpus>1</nova:vcpus>
Oct 18 11:59:29 user nova-compute[74190]:       </nova:flavor>
Oct 18 11:59:29 user nova-compute[74190]:       <nova:owner>
Oct 18 11:59:29 user nova-compute[74190]:         <nova:user uuid="7d6bb993153245daabfc59215abbf7a1">tempest-AttachVolumeNegativeTest-1730208605-project-member</nova:user>
Oct 18 11:59:29 user nova-compute[74190]:         <nova:project uuid="df06c4b010434e3da9ba4ea41f26befa">tempest-AttachVolumeNegativeTest-1730208605</nova:project>
Oct 18 11:59:29 user nova-compute[74190]:       </nova:owner>
Oct 18 11:59:29 user nova-compute[74190]:       <nova:root type="image" uuid="6e88bbf0-6e78-49a8-b3c5-9453d22a89df"/>
Oct 18 11:59:29 user nova-compute[74190]:       <nova:ports>
Oct 18 11:59:29 user nova-compute[74190]:         <nova:port uuid="bc81c313-cdfc-4ef9-9c98-6efba1603301">
Oct 18 11:59:29 user nova-compute[74190]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 18 11:59:29 user nova-compute[74190]:         </nova:port>
Oct 18 11:59:29 user nova-compute[74190]:       </nova:ports>
Oct 18 11:59:29 user nova-compute[74190]:     </nova:instance>
Oct 18 11:59:29 user nova-compute[74190]:   </metadata>
Oct 18 11:59:29 user nova-compute[74190]:   <sysinfo type="smbios">
Oct 18 11:59:29 user nova-compute[74190]:     <system>
Oct 18 11:59:29 user nova-compute[74190]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 11:59:29 user nova-compute[74190]:       <entry name="product">OpenStack Nova</entry>
Oct 18 11:59:29 user nova-compute[74190]:       <entry name="version">0.0.0</entry>
Oct 18 11:59:29 user nova-compute[74190]:       <entry name="serial">7128c4e8-0118-4138-b421-9b1d610d7454</entry>
Oct 18 11:59:29 user nova-compute[74190]:       <entry name="uuid">7128c4e8-0118-4138-b421-9b1d610d7454</entry>
Oct 18 11:59:29 user nova-compute[74190]:       <entry name="family">Virtual Machine</entry>
Oct 18 11:59:29 user nova-compute[74190]:     </system>
Oct 18 11:59:29 user nova-compute[74190]:   </sysinfo>
Oct 18 11:59:29 user nova-compute[74190]:   <os>
Oct 18 11:59:29 user nova-compute[74190]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 11:59:29 user nova-compute[74190]:     <boot dev="hd"/>
Oct 18 11:59:29 user nova-compute[74190]:     <smbios mode="sysinfo"/>
Oct 18 11:59:29 user nova-compute[74190]:   </os>
Oct 18 11:59:29 user nova-compute[74190]:   <features>
Oct 18 11:59:29 user nova-compute[74190]:     <acpi/>
Oct 18 11:59:29 user nova-compute[74190]:     <apic/>
Oct 18 11:59:29 user nova-compute[74190]:     <vmcoreinfo/>
Oct 18 11:59:29 user nova-compute[74190]:   </features>
Oct 18 11:59:29 user nova-compute[74190]:   <clock offset="utc">
Oct 18 11:59:29 user nova-compute[74190]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 11:59:29 user nova-compute[74190]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 11:59:29 user nova-compute[74190]:     <timer name="hpet" present="no"/>
Oct 18 11:59:29 user nova-compute[74190]:   </clock>
Oct 18 11:59:29 user nova-compute[74190]:   <cpu mode="custom" match="exact">
Oct 18 11:59:29 user nova-compute[74190]:     <model>Nehalem</model>
Oct 18 11:59:29 user nova-compute[74190]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 11:59:29 user nova-compute[74190]:   </cpu>
Oct 18 11:59:29 user nova-compute[74190]:   <devices>
Oct 18 11:59:29 user nova-compute[74190]:     <disk type="file" device="disk">
Oct 18 11:59:29 user nova-compute[74190]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 11:59:29 user nova-compute[74190]:       <source file="/opt/stack/data/nova/instances/7128c4e8-0118-4138-b421-9b1d610d7454/disk"/>
Oct 18 11:59:29 user nova-compute[74190]:       <target dev="vda" bus="virtio"/>
Oct 18 11:59:29 user nova-compute[74190]:     </disk>
Oct 18 11:59:29 user nova-compute[74190]:     <interface type="ethernet">
Oct 18 11:59:29 user nova-compute[74190]:       <mac address="fa:16:3e:d1:de:c2"/>
Oct 18 11:59:29 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:59:29 user nova-compute[74190]:       <mtu size="1442"/>
Oct 18 11:59:29 user nova-compute[74190]:       <target dev="tapbc81c313-cd"/>
Oct 18 11:59:29 user nova-compute[74190]:     </interface>
Oct 18 11:59:29 user nova-compute[74190]:     <serial type="pty">
Oct 18 11:59:29 user nova-compute[74190]:       <log file="/opt/stack/data/nova/instances/7128c4e8-0118-4138-b421-9b1d610d7454/console.log" append="off"/>
Oct 18 11:59:29 user nova-compute[74190]:     </serial>
Oct 18 11:59:29 user nova-compute[74190]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 11:59:29 user nova-compute[74190]:     <video>
Oct 18 11:59:29 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:59:29 user nova-compute[74190]:     </video>
Oct 18 11:59:29 user nova-compute[74190]:     <rng model="virtio">
Oct 18 11:59:29 user nova-compute[74190]:       <backend model="random">/dev/urandom</backend>
Oct 18 11:59:29 user nova-compute[74190]:     </rng>
Oct 18 11:59:29 user nova-compute[74190]:     <controller type="usb" index="0" model="none"/>
Oct 18 11:59:29 user nova-compute[74190]:     <memballoon model="virtio">
Oct 18 11:59:29 user nova-compute[74190]:       <stats period="10"/>
Oct 18 11:59:29 user nova-compute[74190]:     </memballoon>
Oct 18 11:59:29 user nova-compute[74190]:   </devices>
Oct 18 11:59:29 user nova-compute[74190]: </domain>
Oct 18 11:59:29 user nova-compute[74190]:  {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 11:59:29 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-4edd8ad0-cbce-4b2a-a24f-e50de7ec4a0d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:59:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-78526681',display_name='tempest-AttachVolumeNegativeTest-server-78526681',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-78526681',id=32,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGHpX6pNGSXj2Dh6qmvnk8TzDprfMG0ku/74hC8gzYaiTscVO9KdQI7iLHX9m1z4rzTeJzELXcMd21TokrPU7bfbNpyzpbRJ0Jg33ifD66h8tRM7k270FRSlTn3m7/8iHQ==',key_name='tempest-keypair-1203749121',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df06c4b010434e3da9ba4ea41f26befa',ramdisk_id='',reservation_id='r-qy1zsitm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1730208605',owner_user_name='tempest-AttachVolumeNegativeTest-1730208605-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:59:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d6bb993153245daabfc59215abbf7a1',uuid=7128c4e8-0118-4138-b421-9b1d610d7454,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bc81c313-cdfc-4ef9-9c98-6efba1603301", "address": "fa:16:3e:d1:de:c2", "network": {"id": "25e0d6f5-497d-4898-8181-5b4848950f16", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-245925644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df06c4b010434e3da9ba4ea41f26befa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc81c313-cd", "ovs_interfaceid": "bc81c313-cdfc-4ef9-9c98-6efba1603301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 11:59:29 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-4edd8ad0-cbce-4b2a-a24f-e50de7ec4a0d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Converting VIF {"id": "bc81c313-cdfc-4ef9-9c98-6efba1603301", "address": "fa:16:3e:d1:de:c2", "network": {"id": "25e0d6f5-497d-4898-8181-5b4848950f16", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-245925644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df06c4b010434e3da9ba4ea41f26befa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc81c313-cd", "ovs_interfaceid": "bc81c313-cdfc-4ef9-9c98-6efba1603301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:59:29 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-4edd8ad0-cbce-4b2a-a24f-e50de7ec4a0d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:de:c2,bridge_name='br-int',has_traffic_filtering=True,id=bc81c313-cdfc-4ef9-9c98-6efba1603301,network=Network(25e0d6f5-497d-4898-8181-5b4848950f16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc81c313-cd') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:59:29 user nova-compute[74190]: DEBUG os_vif [None req-4edd8ad0-cbce-4b2a-a24f-e50de7ec4a0d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:de:c2,bridge_name='br-int',has_traffic_filtering=True,id=bc81c313-cdfc-4ef9-9c98-6efba1603301,network=Network(25e0d6f5-497d-4898-8181-5b4848950f16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc81c313-cd') {{(pid=74190) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 11:59:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:59:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:59:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 11:59:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:59:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '591c5c4d-8206-5ed1-96c1-849ce4d51d33', '_type': 'linux-noop'}}, row=False) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:59:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:59:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:59:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:59:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbc81c313-cd, may_exist=True, interface_attrs={}) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:59:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbc81c313-cd, col_values=(('qos', UUID('8e4028f0-ecc5-4dc8-9168-f7b257350856')),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:59:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbc81c313-cd, col_values=(('external_ids', {'iface-id': 'bc81c313-cdfc-4ef9-9c98-6efba1603301', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d1:de:c2', 'vm-uuid': '7128c4e8-0118-4138-b421-9b1d610d7454'}),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:59:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:59:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:59:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:59:29 user nova-compute[74190]: INFO os_vif [None req-4edd8ad0-cbce-4b2a-a24f-e50de7ec4a0d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:de:c2,bridge_name='br-int',has_traffic_filtering=True,id=bc81c313-cdfc-4ef9-9c98-6efba1603301,network=Network(25e0d6f5-497d-4898-8181-5b4848950f16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc81c313-cd')
Oct 18 11:59:29 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-4edd8ad0-cbce-4b2a-a24f-e50de7ec4a0d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] No BDM found with device name vda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 11:59:29 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-4edd8ad0-cbce-4b2a-a24f-e50de7ec4a0d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] No VIF found with MAC fa:16:3e:d1:de:c2, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 11:59:29 user nova-compute[74190]: DEBUG nova.network.neutron [req-af96af22-b95c-4d81-8233-5c3fdfd74111 req-e4ec923d-820a-4ee3-8c9f-f7fbb6759dc2 service nova] [instance: 7128c4e8-0118-4138-b421-9b1d610d7454] Updated VIF entry in instance network info cache for port bc81c313-cdfc-4ef9-9c98-6efba1603301. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 11:59:29 user nova-compute[74190]: DEBUG nova.network.neutron [req-af96af22-b95c-4d81-8233-5c3fdfd74111 req-e4ec923d-820a-4ee3-8c9f-f7fbb6759dc2 service nova] [instance: 7128c4e8-0118-4138-b421-9b1d610d7454] Updating instance_info_cache with network_info: [{"id": "bc81c313-cdfc-4ef9-9c98-6efba1603301", "address": "fa:16:3e:d1:de:c2", "network": {"id": "25e0d6f5-497d-4898-8181-5b4848950f16", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-245925644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df06c4b010434e3da9ba4ea41f26befa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc81c313-cd", "ovs_interfaceid": "bc81c313-cdfc-4ef9-9c98-6efba1603301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:59:29 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-af96af22-b95c-4d81-8233-5c3fdfd74111 req-e4ec923d-820a-4ee3-8c9f-f7fbb6759dc2 service nova] Releasing lock "refresh_cache-7128c4e8-0118-4138-b421-9b1d610d7454" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 11:59:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:59:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:59:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:59:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:59:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:59:30 user nova-compute[74190]: DEBUG nova.compute.manager [req-3962de1d-4cb7-4f65-adcd-d66122534901 req-ed0f7a08-21cd-455b-be0d-c74eef86a7c1 service nova] [instance: 7128c4e8-0118-4138-b421-9b1d610d7454] Received event network-vif-plugged-bc81c313-cdfc-4ef9-9c98-6efba1603301 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:59:30 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-3962de1d-4cb7-4f65-adcd-d66122534901 req-ed0f7a08-21cd-455b-be0d-c74eef86a7c1 service nova] Acquiring lock "7128c4e8-0118-4138-b421-9b1d610d7454-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:59:30 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-3962de1d-4cb7-4f65-adcd-d66122534901 req-ed0f7a08-21cd-455b-be0d-c74eef86a7c1 service nova] Lock "7128c4e8-0118-4138-b421-9b1d610d7454-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:59:30 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-3962de1d-4cb7-4f65-adcd-d66122534901 req-ed0f7a08-21cd-455b-be0d-c74eef86a7c1 service nova] Lock "7128c4e8-0118-4138-b421-9b1d610d7454-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:59:30 user nova-compute[74190]: DEBUG nova.compute.manager [req-3962de1d-4cb7-4f65-adcd-d66122534901 req-ed0f7a08-21cd-455b-be0d-c74eef86a7c1 service nova] [instance: 7128c4e8-0118-4138-b421-9b1d610d7454] No waiting events found dispatching network-vif-plugged-bc81c313-cdfc-4ef9-9c98-6efba1603301 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:59:30 user nova-compute[74190]: WARNING nova.compute.manager [req-3962de1d-4cb7-4f65-adcd-d66122534901 req-ed0f7a08-21cd-455b-be0d-c74eef86a7c1 service nova] [instance: 7128c4e8-0118-4138-b421-9b1d610d7454] Received unexpected event network-vif-plugged-bc81c313-cdfc-4ef9-9c98-6efba1603301 for instance with vm_state building and task_state spawning.
Oct 18 11:59:31 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:59:31 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:59:31 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:59:31 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:59:32 user nova-compute[74190]: DEBUG nova.compute.manager [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Start spawning the instance on the hypervisor. {{(pid=74190) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 11:59:32 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Creating instance directory {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 11:59:32 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Creating image(s)
Oct 18 11:59:32 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Did not create local disks {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 18 11:59:32 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Ensure instance console log exists: /opt/stack/data/nova/instances/0382820d-a678-4593-85df-168f42fc4ce4/console.log {{(pid=74190) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 11:59:32 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:59:32 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:59:32 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:59:32 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Start _get_guest_xml network_info=[{"id": "a32b81a2-7b02-48ed-9550-d392be5e221e", "address": "fa:16:3e:e7:d8:e5", "network": {"id": "c2dbbd24-f1d2-47a2-835f-0f9b24b585f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-920140900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d994366010142519ff367fa7ca77e61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa32b81a2-7b", "ovs_interfaceid": "a32b81a2-7b02-48ed-9550-d392be5e221e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OucnFekJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0382820d-a678-4593-85df-168f42fc4ce4', 'attached_at': '', 'detached_at': '', 'volume_id': 'e27e2099-8328-4194-b582-65ca0cdad07f', 'serial': 'e27e2099-8328-4194-b582-65ca0cdad07f'}, 'delete_on_termination': False, 'guest_format': None, 'attachment_id': 'f776cc27-fc43-47e4-959d-8c312a1a7aa8', 'volume_type': None} {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 11:59:32 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:59:32 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 11:59:32 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 11:59:32 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] CPU controller missing on host. {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 11:59:32 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 11:59:32 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] CPU controller found on host. {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 11:59:32 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74190) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 11:59:32 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T11:37:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 11:59:32 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Flavor limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 11:59:32 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Image limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 11:59:32 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Flavor pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 11:59:32 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Image pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 11:59:32 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 11:59:32 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 11:59:32 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 11:59:32 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Got 1 possible topologies {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 11:59:32 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 11:59:32 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 11:59:32 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Calling os-brick to attach iSCSI Volume {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 11:59:32 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OucnFekJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:59:32 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:59:32 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:59:32 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:59:32 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:59:32 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:59:32 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:59:32 user nova-compute[74190]: INFO os_brick.initiator.connectors.iscsi [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 11:59:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f -p 172.16.0.220:3260 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:59:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f -p 172.16.0.220:3260" returned: 21 in 0.051s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:59:32 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb3ee68-3a16-4fb4-ac2b-6178ca0c1e69]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:59:32 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 11:59:32 user nova-compute[74190]:  {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:59:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f -p 172.16.0.220:3260 --interface default --op new {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:59:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:59:32 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[463ce566-0e49-4b03-8b90-6ed05d3e67d6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f] added\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:59:32 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f] added
Oct 18 11:59:32 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:59:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:59:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:59:32 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e7ff5d5-da3f-4c69-ada9-9c5764b620bd]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:59:32 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:59:32 user nova-compute[74190]: DEBUG nova.compute.manager [None req-4edd8ad0-cbce-4b2a-a24f-e50de7ec4a0d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: 7128c4e8-0118-4138-b421-9b1d610d7454] Instance event wait completed in 0 seconds for  {{(pid=74190) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 11:59:32 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-4edd8ad0-cbce-4b2a-a24f-e50de7ec4a0d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: 7128c4e8-0118-4138-b421-9b1d610d7454] Guest created on hypervisor {{(pid=74190) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 11:59:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:59:32 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 7128c4e8-0118-4138-b421-9b1d610d7454] Instance spawned successfully.
Oct 18 11:59:32 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-4edd8ad0-cbce-4b2a-a24f-e50de7ec4a0d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: 7128c4e8-0118-4138-b421-9b1d610d7454] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 11:59:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:59:32 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b157b28-2db4-4179-91fc-49668b6e83c1]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:59:32 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:59:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OucnFekJ {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:59:32 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-4edd8ad0-cbce-4b2a-a24f-e50de7ec4a0d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: 7128c4e8-0118-4138-b421-9b1d610d7454] Found default for hw_cdrom_bus of ide {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:59:32 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-4edd8ad0-cbce-4b2a-a24f-e50de7ec4a0d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: 7128c4e8-0118-4138-b421-9b1d610d7454] Found default for hw_disk_bus of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:59:32 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-4edd8ad0-cbce-4b2a-a24f-e50de7ec4a0d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: 7128c4e8-0118-4138-b421-9b1d610d7454] Found default for hw_input_bus of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:59:32 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-4edd8ad0-cbce-4b2a-a24f-e50de7ec4a0d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: 7128c4e8-0118-4138-b421-9b1d610d7454] Found default for hw_pointer_model of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:59:32 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-4edd8ad0-cbce-4b2a-a24f-e50de7ec4a0d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: 7128c4e8-0118-4138-b421-9b1d610d7454] Found default for hw_video_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:59:32 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-4edd8ad0-cbce-4b2a-a24f-e50de7ec4a0d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: 7128c4e8-0118-4138-b421-9b1d610d7454] Found default for hw_vif_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:59:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OucnFekJ" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:59:32 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b12728b-070c-4dd8-a410-0f5cfcfd119f]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:59:32 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OucnFekJ'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:59:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:59:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:59:32 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ecbcce9-f4e0-44a1-bd8b-61da8153a30e]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:59:32 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:59:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:59:33 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:59:33 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e63db7-0e99-4dbd-b87c-078276d4515a]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:59:33 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 11:59:33 user nova-compute[74190]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 (non-flash)
Oct 18 11:59:33 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:59:33 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 11:59:33 user nova-compute[74190]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 (non-flash)
Oct 18 11:59:33 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:59:33 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f -p 172.16.0.220:3260 --login {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:59:33 user nova-compute[74190]: INFO nova.compute.manager [None req-4edd8ad0-cbce-4b2a-a24f-e50de7ec4a0d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: 7128c4e8-0118-4138-b421-9b1d610d7454] Took 5.40 seconds to spawn the instance on the hypervisor.
Oct 18 11:59:33 user nova-compute[74190]: DEBUG nova.compute.manager [None req-4edd8ad0-cbce-4b2a-a24f-e50de7ec4a0d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: 7128c4e8-0118-4138-b421-9b1d610d7454] Checking state {{(pid=74190) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 11:59:33 user nova-compute[74190]: DEBUG nova.compute.manager [req-ca3e7313-e22a-43c8-9865-965e236be5d5 req-6a6ef1f0-6a96-4cdd-80e6-aa3398d67abc service nova] [instance: 7128c4e8-0118-4138-b421-9b1d610d7454] Received event network-vif-plugged-bc81c313-cdfc-4ef9-9c98-6efba1603301 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:59:33 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-ca3e7313-e22a-43c8-9865-965e236be5d5 req-6a6ef1f0-6a96-4cdd-80e6-aa3398d67abc service nova] Acquiring lock "7128c4e8-0118-4138-b421-9b1d610d7454-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:59:33 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-ca3e7313-e22a-43c8-9865-965e236be5d5 req-6a6ef1f0-6a96-4cdd-80e6-aa3398d67abc service nova] Lock "7128c4e8-0118-4138-b421-9b1d610d7454-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:59:33 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-ca3e7313-e22a-43c8-9865-965e236be5d5 req-6a6ef1f0-6a96-4cdd-80e6-aa3398d67abc service nova] Lock "7128c4e8-0118-4138-b421-9b1d610d7454-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:59:33 user nova-compute[74190]: DEBUG nova.compute.manager [req-ca3e7313-e22a-43c8-9865-965e236be5d5 req-6a6ef1f0-6a96-4cdd-80e6-aa3398d67abc service nova] [instance: 7128c4e8-0118-4138-b421-9b1d610d7454] No waiting events found dispatching network-vif-plugged-bc81c313-cdfc-4ef9-9c98-6efba1603301 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:59:33 user nova-compute[74190]: WARNING nova.compute.manager [req-ca3e7313-e22a-43c8-9865-965e236be5d5 req-6a6ef1f0-6a96-4cdd-80e6-aa3398d67abc service nova] [instance: 7128c4e8-0118-4138-b421-9b1d610d7454] Received unexpected event network-vif-plugged-bc81c313-cdfc-4ef9-9c98-6efba1603301 for instance with vm_state building and task_state spawning.
Oct 18 11:59:33 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:59:33 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af3c5c3-4927-44de-98ea-b83d226f8923]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:59:33 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f, portal: 172.16.0.220,3260]
Oct 18 11:59:33 user nova-compute[74190]: Login to [iface: default, target: iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f, portal: 172.16.0.220,3260] successful.
Oct 18 11:59:33 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:59:33 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:59:33 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:59:33 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[afe67656-b136-49c2-9200-4920fdc925a7]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:59:33 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:59:33 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:59:33 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:59:33 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f54ea9-047d-4f03-aa00-58b44fe4e167]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:59:33 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 11:59:33 user nova-compute[74190]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 (non-flash)
Oct 18 11:59:33 user nova-compute[74190]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)
Oct 18 11:59:33 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:59:33 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 11:59:33 user nova-compute[74190]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 (non-flash)
Oct 18 11:59:33 user nova-compute[74190]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)
Oct 18 11:59:33 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:59:33 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.344s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:59:33 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Connected to 172.16.0.220:3260 {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 11:59:33 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] HCTL ('33', '-', '-', 0) found on session 37 with lun 0 {{(pid=74190) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 11:59:33 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74190) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 11:59:33 user nova-compute[74190]: INFO nova.compute.manager [None req-4edd8ad0-cbce-4b2a-a24f-e50de7ec4a0d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: 7128c4e8-0118-4138-b421-9b1d610d7454] Took 6.18 seconds to build instance.
Oct 18 11:59:33 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:59:33 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:59:33 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[007650a3-c2a6-45e0-95cd-24edb7b48c19]: (4, ('- - 0', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:59:33 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Searching for a device in session 37 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74190) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 11:59:33 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OucnFekJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 11:59:33 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-4edd8ad0-cbce-4b2a-a24f-e50de7ec4a0d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "7128c4e8-0118-4138-b421-9b1d610d7454" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.302s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:59:34 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.381s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:59:34 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] <== connect_volume: return (1382ms) {'type': 'block', 'scsi_wwn': '23533306339613561', 'path': '/dev/sdb'} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:59:34 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23533306339613561', 'path': '/dev/sdb'} {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 11:59:34 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:59:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1554082096',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1554082096',id=31,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d994366010142519ff367fa7ca77e61',ramdisk_id='',reservation_id='r-2rfy2zbm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1815510380',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:59:10Z,user_data=None,user_id='7fa675b6803f4e21b090295b51fb9ceb',uuid=0382820d-a678-4593-85df-168f42fc4ce4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a32b81a2-7b02-48ed-9550-d392be5e221e", "address": "fa:16:3e:e7:d8:e5", "network": {"id": "c2dbbd24-f1d2-47a2-835f-0f9b24b585f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-920140900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d994366010142519ff367fa7ca77e61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa32b81a2-7b", "ovs_interfaceid": "a32b81a2-7b02-48ed-9550-d392be5e221e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74190) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 11:59:34 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Converting VIF {"id": "a32b81a2-7b02-48ed-9550-d392be5e221e", "address": "fa:16:3e:e7:d8:e5", "network": {"id": "c2dbbd24-f1d2-47a2-835f-0f9b24b585f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-920140900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d994366010142519ff367fa7ca77e61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa32b81a2-7b", "ovs_interfaceid": "a32b81a2-7b02-48ed-9550-d392be5e221e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:59:34 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:d8:e5,bridge_name='br-int',has_traffic_filtering=True,id=a32b81a2-7b02-48ed-9550-d392be5e221e,network=Network(c2dbbd24-f1d2-47a2-835f-0f9b24b585f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa32b81a2-7b') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:59:34 user nova-compute[74190]: DEBUG nova.objects.instance [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lazy-loading 'pci_devices' on Instance uuid 0382820d-a678-4593-85df-168f42fc4ce4 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:59:34 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] End _get_guest_xml xml=<domain type="kvm">
Oct 18 11:59:34 user nova-compute[74190]:   <uuid>0382820d-a678-4593-85df-168f42fc4ce4</uuid>
Oct 18 11:59:34 user nova-compute[74190]:   <name>instance-0000001f</name>
Oct 18 11:59:34 user nova-compute[74190]:   <memory>524288</memory>
Oct 18 11:59:34 user nova-compute[74190]:   <vcpu>1</vcpu>
Oct 18 11:59:34 user nova-compute[74190]:   <metadata>
Oct 18 11:59:34 user nova-compute[74190]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 11:59:34 user nova-compute[74190]:       <nova:package version="0.0.0"/>
Oct 18 11:59:34 user nova-compute[74190]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1554082096</nova:name>
Oct 18 11:59:34 user nova-compute[74190]:       <nova:creationTime>2023-10-18 11:59:32</nova:creationTime>
Oct 18 11:59:34 user nova-compute[74190]:       <nova:flavor name="m1.tiny">
Oct 18 11:59:34 user nova-compute[74190]:         <nova:memory>512</nova:memory>
Oct 18 11:59:34 user nova-compute[74190]:         <nova:disk>1</nova:disk>
Oct 18 11:59:34 user nova-compute[74190]:         <nova:swap>0</nova:swap>
Oct 18 11:59:34 user nova-compute[74190]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 11:59:34 user nova-compute[74190]:         <nova:vcpus>1</nova:vcpus>
Oct 18 11:59:34 user nova-compute[74190]:       </nova:flavor>
Oct 18 11:59:34 user nova-compute[74190]:       <nova:owner>
Oct 18 11:59:34 user nova-compute[74190]:         <nova:user uuid="7fa675b6803f4e21b090295b51fb9ceb">tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member</nova:user>
Oct 18 11:59:34 user nova-compute[74190]:         <nova:project uuid="6d994366010142519ff367fa7ca77e61">tempest-ServerBootFromVolumeStableRescueTest-1815510380</nova:project>
Oct 18 11:59:34 user nova-compute[74190]:       </nova:owner>
Oct 18 11:59:34 user nova-compute[74190]:       <nova:root type="image" uuid="6e88bbf0-6e78-49a8-b3c5-9453d22a89df"/>
Oct 18 11:59:34 user nova-compute[74190]:       <nova:ports>
Oct 18 11:59:34 user nova-compute[74190]:         <nova:port uuid="a32b81a2-7b02-48ed-9550-d392be5e221e">
Oct 18 11:59:34 user nova-compute[74190]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 18 11:59:34 user nova-compute[74190]:         </nova:port>
Oct 18 11:59:34 user nova-compute[74190]:       </nova:ports>
Oct 18 11:59:34 user nova-compute[74190]:     </nova:instance>
Oct 18 11:59:34 user nova-compute[74190]:   </metadata>
Oct 18 11:59:34 user nova-compute[74190]:   <sysinfo type="smbios">
Oct 18 11:59:34 user nova-compute[74190]:     <system>
Oct 18 11:59:34 user nova-compute[74190]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 11:59:34 user nova-compute[74190]:       <entry name="product">OpenStack Nova</entry>
Oct 18 11:59:34 user nova-compute[74190]:       <entry name="version">0.0.0</entry>
Oct 18 11:59:34 user nova-compute[74190]:       <entry name="serial">0382820d-a678-4593-85df-168f42fc4ce4</entry>
Oct 18 11:59:34 user nova-compute[74190]:       <entry name="uuid">0382820d-a678-4593-85df-168f42fc4ce4</entry>
Oct 18 11:59:34 user nova-compute[74190]:       <entry name="family">Virtual Machine</entry>
Oct 18 11:59:34 user nova-compute[74190]:     </system>
Oct 18 11:59:34 user nova-compute[74190]:   </sysinfo>
Oct 18 11:59:34 user nova-compute[74190]:   <os>
Oct 18 11:59:34 user nova-compute[74190]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 11:59:34 user nova-compute[74190]:     <boot dev="hd"/>
Oct 18 11:59:34 user nova-compute[74190]:     <smbios mode="sysinfo"/>
Oct 18 11:59:34 user nova-compute[74190]:   </os>
Oct 18 11:59:34 user nova-compute[74190]:   <features>
Oct 18 11:59:34 user nova-compute[74190]:     <acpi/>
Oct 18 11:59:34 user nova-compute[74190]:     <apic/>
Oct 18 11:59:34 user nova-compute[74190]:     <vmcoreinfo/>
Oct 18 11:59:34 user nova-compute[74190]:   </features>
Oct 18 11:59:34 user nova-compute[74190]:   <clock offset="utc">
Oct 18 11:59:34 user nova-compute[74190]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 11:59:34 user nova-compute[74190]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 11:59:34 user nova-compute[74190]:     <timer name="hpet" present="no"/>
Oct 18 11:59:34 user nova-compute[74190]:   </clock>
Oct 18 11:59:34 user nova-compute[74190]:   <cpu mode="custom" match="exact">
Oct 18 11:59:34 user nova-compute[74190]:     <model>Nehalem</model>
Oct 18 11:59:34 user nova-compute[74190]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 11:59:34 user nova-compute[74190]:   </cpu>
Oct 18 11:59:34 user nova-compute[74190]:   <devices>
Oct 18 11:59:34 user nova-compute[74190]:     <disk type="block" device="disk">
Oct 18 11:59:34 user nova-compute[74190]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 11:59:34 user nova-compute[74190]:       <source dev="/dev/sdb"/>
Oct 18 11:59:34 user nova-compute[74190]:       <target dev="vda" bus="virtio"/>
Oct 18 11:59:34 user nova-compute[74190]:       <serial>e27e2099-8328-4194-b582-65ca0cdad07f</serial>
Oct 18 11:59:34 user nova-compute[74190]:     </disk>
Oct 18 11:59:34 user nova-compute[74190]:     <interface type="ethernet">
Oct 18 11:59:34 user nova-compute[74190]:       <mac address="fa:16:3e:e7:d8:e5"/>
Oct 18 11:59:34 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:59:34 user nova-compute[74190]:       <mtu size="1442"/>
Oct 18 11:59:34 user nova-compute[74190]:       <target dev="tapa32b81a2-7b"/>
Oct 18 11:59:34 user nova-compute[74190]:     </interface>
Oct 18 11:59:34 user nova-compute[74190]:     <serial type="pty">
Oct 18 11:59:34 user nova-compute[74190]:       <log file="/opt/stack/data/nova/instances/0382820d-a678-4593-85df-168f42fc4ce4/console.log" append="off"/>
Oct 18 11:59:34 user nova-compute[74190]:     </serial>
Oct 18 11:59:34 user nova-compute[74190]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 11:59:34 user nova-compute[74190]:     <video>
Oct 18 11:59:34 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 11:59:34 user nova-compute[74190]:     </video>
Oct 18 11:59:34 user nova-compute[74190]:     <rng model="virtio">
Oct 18 11:59:34 user nova-compute[74190]:       <backend model="random">/dev/urandom</backend>
Oct 18 11:59:34 user nova-compute[74190]:     </rng>
Oct 18 11:59:34 user nova-compute[74190]:     <controller type="usb" index="0" model="none"/>
Oct 18 11:59:34 user nova-compute[74190]:     <memballoon model="virtio">
Oct 18 11:59:34 user nova-compute[74190]:       <stats period="10"/>
Oct 18 11:59:34 user nova-compute[74190]:     </memballoon>
Oct 18 11:59:34 user nova-compute[74190]:   </devices>
Oct 18 11:59:34 user nova-compute[74190]: </domain>
Oct 18 11:59:34 user nova-compute[74190]:  {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 11:59:34 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:59:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1554082096',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1554082096',id=31,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d994366010142519ff367fa7ca77e61',ramdisk_id='',reservation_id='r-2rfy2zbm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1815510380',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:59:10Z,user_data=None,user_id='7fa675b6803f4e21b090295b51fb9ceb',uuid=0382820d-a678-4593-85df-168f42fc4ce4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a32b81a2-7b02-48ed-9550-d392be5e221e", "address": "fa:16:3e:e7:d8:e5", "network": {"id": "c2dbbd24-f1d2-47a2-835f-0f9b24b585f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-920140900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d994366010142519ff367fa7ca77e61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa32b81a2-7b", "ovs_interfaceid": "a32b81a2-7b02-48ed-9550-d392be5e221e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 11:59:34 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Converting VIF {"id": "a32b81a2-7b02-48ed-9550-d392be5e221e", "address": "fa:16:3e:e7:d8:e5", "network": {"id": "c2dbbd24-f1d2-47a2-835f-0f9b24b585f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-920140900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d994366010142519ff367fa7ca77e61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa32b81a2-7b", "ovs_interfaceid": "a32b81a2-7b02-48ed-9550-d392be5e221e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:59:34 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:d8:e5,bridge_name='br-int',has_traffic_filtering=True,id=a32b81a2-7b02-48ed-9550-d392be5e221e,network=Network(c2dbbd24-f1d2-47a2-835f-0f9b24b585f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa32b81a2-7b') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:59:34 user nova-compute[74190]: DEBUG os_vif [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:d8:e5,bridge_name='br-int',has_traffic_filtering=True,id=a32b81a2-7b02-48ed-9550-d392be5e221e,network=Network(c2dbbd24-f1d2-47a2-835f-0f9b24b585f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa32b81a2-7b') {{(pid=74190) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 11:59:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:59:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:59:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 11:59:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:59:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '01a25729-e731-5192-aade-4412e0829ac7', '_type': 'linux-noop'}}, row=False) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:59:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:59:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:59:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:59:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa32b81a2-7b, may_exist=True, interface_attrs={}) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:59:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa32b81a2-7b, col_values=(('qos', UUID('be8e79b7-d808-45df-b49e-261a3a3ccc25')),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:59:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa32b81a2-7b, col_values=(('external_ids', {'iface-id': 'a32b81a2-7b02-48ed-9550-d392be5e221e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:d8:e5', 'vm-uuid': '0382820d-a678-4593-85df-168f42fc4ce4'}),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:59:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:59:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:59:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:59:34 user nova-compute[74190]: INFO os_vif [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:d8:e5,bridge_name='br-int',has_traffic_filtering=True,id=a32b81a2-7b02-48ed-9550-d392be5e221e,network=Network(c2dbbd24-f1d2-47a2-835f-0f9b24b585f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa32b81a2-7b')
Oct 18 11:59:34 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] No BDM found with device name vda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 11:59:34 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] No VIF found with MAC fa:16:3e:e7:d8:e5, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 11:59:35 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:59:35 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:59:35 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:59:35 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:59:35 user nova-compute[74190]: DEBUG nova.compute.manager [req-37167bef-6aca-4937-808c-9fe5276e88e8 req-888a23f5-72a6-4cc7-aaba-ea85a7121772 service nova] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Received event network-vif-plugged-a32b81a2-7b02-48ed-9550-d392be5e221e {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:59:35 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-37167bef-6aca-4937-808c-9fe5276e88e8 req-888a23f5-72a6-4cc7-aaba-ea85a7121772 service nova] Acquiring lock "0382820d-a678-4593-85df-168f42fc4ce4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:59:35 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-37167bef-6aca-4937-808c-9fe5276e88e8 req-888a23f5-72a6-4cc7-aaba-ea85a7121772 service nova] Lock "0382820d-a678-4593-85df-168f42fc4ce4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:59:35 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-37167bef-6aca-4937-808c-9fe5276e88e8 req-888a23f5-72a6-4cc7-aaba-ea85a7121772 service nova] Lock "0382820d-a678-4593-85df-168f42fc4ce4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:59:35 user nova-compute[74190]: DEBUG nova.compute.manager [req-37167bef-6aca-4937-808c-9fe5276e88e8 req-888a23f5-72a6-4cc7-aaba-ea85a7121772 service nova] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] No waiting events found dispatching network-vif-plugged-a32b81a2-7b02-48ed-9550-d392be5e221e {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:59:35 user nova-compute[74190]: WARNING nova.compute.manager [req-37167bef-6aca-4937-808c-9fe5276e88e8 req-888a23f5-72a6-4cc7-aaba-ea85a7121772 service nova] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Received unexpected event network-vif-plugged-a32b81a2-7b02-48ed-9550-d392be5e221e for instance with vm_state building and task_state spawning.
Oct 18 11:59:35 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:59:35 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:59:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-8096292a-4e4c-4d66-8640-32a3c008fd21 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Acquiring lock "a9012673-826b-4be7-a55b-9bb35a227c17" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:59:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-8096292a-4e4c-4d66-8640-32a3c008fd21 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lock "a9012673-826b-4be7-a55b-9bb35a227c17" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:59:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-8096292a-4e4c-4d66-8640-32a3c008fd21 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Acquiring lock "a9012673-826b-4be7-a55b-9bb35a227c17-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:59:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-8096292a-4e4c-4d66-8640-32a3c008fd21 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lock "a9012673-826b-4be7-a55b-9bb35a227c17-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:59:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-8096292a-4e4c-4d66-8640-32a3c008fd21 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lock "a9012673-826b-4be7-a55b-9bb35a227c17-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:59:36 user nova-compute[74190]: INFO nova.compute.manager [None req-8096292a-4e4c-4d66-8640-32a3c008fd21 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Terminating instance
Oct 18 11:59:36 user nova-compute[74190]: DEBUG nova.compute.manager [None req-8096292a-4e4c-4d66-8640-32a3c008fd21 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Start destroying the instance on the hypervisor. {{(pid=74190) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 11:59:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:59:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:59:36 user nova-compute[74190]: DEBUG nova.compute.manager [req-730d4072-7b06-4f83-a415-abe34e13e379 req-7417f759-7baf-4304-b7a2-028b8f38feef service nova] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Received event network-vif-unplugged-98016144-4b95-4e94-8ae4-581089fe4f63 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:59:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-730d4072-7b06-4f83-a415-abe34e13e379 req-7417f759-7baf-4304-b7a2-028b8f38feef service nova] Acquiring lock "a9012673-826b-4be7-a55b-9bb35a227c17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:59:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-730d4072-7b06-4f83-a415-abe34e13e379 req-7417f759-7baf-4304-b7a2-028b8f38feef service nova] Lock "a9012673-826b-4be7-a55b-9bb35a227c17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:59:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-730d4072-7b06-4f83-a415-abe34e13e379 req-7417f759-7baf-4304-b7a2-028b8f38feef service nova] Lock "a9012673-826b-4be7-a55b-9bb35a227c17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:59:36 user nova-compute[74190]: DEBUG nova.compute.manager [req-730d4072-7b06-4f83-a415-abe34e13e379 req-7417f759-7baf-4304-b7a2-028b8f38feef service nova] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] No waiting events found dispatching network-vif-unplugged-98016144-4b95-4e94-8ae4-581089fe4f63 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:59:36 user nova-compute[74190]: DEBUG nova.compute.manager [req-730d4072-7b06-4f83-a415-abe34e13e379 req-7417f759-7baf-4304-b7a2-028b8f38feef service nova] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Received event network-vif-unplugged-98016144-4b95-4e94-8ae4-581089fe4f63 for instance with task_state deleting. {{(pid=74190) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 11:59:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:59:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:59:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:59:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:59:37 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Instance destroyed successfully.
Oct 18 11:59:37 user nova-compute[74190]: DEBUG nova.objects.instance [None req-8096292a-4e4c-4d66-8640-32a3c008fd21 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lazy-loading 'resources' on Instance uuid a9012673-826b-4be7-a55b-9bb35a227c17 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 11:59:37 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-8096292a-4e4c-4d66-8640-32a3c008fd21 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:53:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1490971997',display_name='tempest-ServerActionsTestOtherA-server-1490971997',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1490971997',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOQBzNTv9LZg0yq/3lf4kmMEAFSSxHvdpQtvKWiUtvrhz9NgEirvm+N8Tqx31x38AF1/g3O4be21YeguWgKCS7N36Oy8ZZWxYYR46ATEkZPMIr3HhNKcU83cECzcDD++0g==',key_name='tempest-keypair-1511789347',keypairs=<?>,launch_index=0,launched_at=2023-10-18T11:55:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='08cf52ce927443158aa731367f08bd57',ramdisk_id='',reservation_id='r-0xda3q9d',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1288544694',owner_user_name='tempest-ServerActionsTestOtherA-1288544694-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T11:56:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b771e627a76b4540bf8de665df3d7787',uuid=a9012673-826b-4be7-a55b-9bb35a227c17,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "98016144-4b95-4e94-8ae4-581089fe4f63", "address": "fa:16:3e:ea:1d:55", "network": {"id": "f5ab7da4-2b07-4465-9a89-a07eb053ba91", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1315695374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08cf52ce927443158aa731367f08bd57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98016144-4b", "ovs_interfaceid": "98016144-4b95-4e94-8ae4-581089fe4f63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 11:59:37 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-8096292a-4e4c-4d66-8640-32a3c008fd21 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Converting VIF {"id": "98016144-4b95-4e94-8ae4-581089fe4f63", "address": "fa:16:3e:ea:1d:55", "network": {"id": "f5ab7da4-2b07-4465-9a89-a07eb053ba91", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1315695374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08cf52ce927443158aa731367f08bd57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98016144-4b", "ovs_interfaceid": "98016144-4b95-4e94-8ae4-581089fe4f63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 11:59:37 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-8096292a-4e4c-4d66-8640-32a3c008fd21 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ea:1d:55,bridge_name='br-int',has_traffic_filtering=True,id=98016144-4b95-4e94-8ae4-581089fe4f63,network=Network(f5ab7da4-2b07-4465-9a89-a07eb053ba91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98016144-4b') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 11:59:37 user nova-compute[74190]: DEBUG os_vif [None req-8096292a-4e4c-4d66-8640-32a3c008fd21 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:1d:55,bridge_name='br-int',has_traffic_filtering=True,id=98016144-4b95-4e94-8ae4-581089fe4f63,network=Network(f5ab7da4-2b07-4465-9a89-a07eb053ba91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98016144-4b') {{(pid=74190) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 11:59:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:59:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap98016144-4b, bridge=br-int, if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:59:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:59:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:59:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f4e3657b-6f4f-4210-b7f4-b11fb04da6b3) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 11:59:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 11:59:37 user nova-compute[74190]: INFO os_vif [None req-8096292a-4e4c-4d66-8640-32a3c008fd21 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:1d:55,bridge_name='br-int',has_traffic_filtering=True,id=98016144-4b95-4e94-8ae4-581089fe4f63,network=Network(f5ab7da4-2b07-4465-9a89-a07eb053ba91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98016144-4b')
Oct 18 11:59:37 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8096292a-4e4c-4d66-8640-32a3c008fd21 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] calling os-brick to detach iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 11:59:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-8096292a-4e4c-4d66-8640-32a3c008fd21 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, {'target_iqn': 'iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qAZlmtWu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 11:59:37 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-8096292a-4e4c-4d66-8640-32a3c008fd21 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 11:59:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-8096292a-4e4c-4d66-8640-32a3c008fd21 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 11:59:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-8096292a-4e4c-4d66-8640-32a3c008fd21 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 11:59:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:59:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.032s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:59:37 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca5ea9b-edbb-496f-b90b-4f56c952aa06]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:59:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-8096292a-4e4c-4d66-8640-32a3c008fd21 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 11:59:37 user nova-compute[74190]: No targets found.
Oct 18 11:59:37 user nova-compute[74190]: iSNS:
Oct 18 11:59:37 user nova-compute[74190]: No targets found.
Oct 18 11:59:37 user nova-compute[74190]: STATIC:
Oct 18 11:59:37 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227
Oct 18 11:59:37 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:59:37 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:59:37 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa
Oct 18 11:59:37 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:59:37 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:59:37 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f
Oct 18 11:59:37 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 11:59:37 user nova-compute[74190]:                 Iface Name: default
Oct 18 11:59:37 user nova-compute[74190]: FIRMWARE:
Oct 18 11:59:37 user nova-compute[74190]: No targets found.
Oct 18 11:59:37 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:59:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-8096292a-4e4c-4d66-8640-32a3c008fd21 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 11:59:37 user nova-compute[74190]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 11:59:37 user nova-compute[74190]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74190) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 11:59:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-8096292a-4e4c-4d66-8640-32a3c008fd21 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227', 0)] {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 11:59:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:59:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:59:37 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b094b2-60ae-422a-a5f5-bf48351c13ec]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:59:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:59:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:59:37 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d4e679-41ba-4733-b1e8-6f39c2d0fa73]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:59:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-8096292a-4e4c-4d66-8640-32a3c008fd21 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 11:59:37 user nova-compute[74190]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 (non-flash)
Oct 18 11:59:37 user nova-compute[74190]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)
Oct 18 11:59:37 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 11:59:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-8096292a-4e4c-4d66-8640-32a3c008fd21 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 11:59:37 user nova-compute[74190]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 (non-flash)
Oct 18 11:59:37 user nova-compute[74190]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)
Oct 18 11:59:37 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 11:59:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-8096292a-4e4c-4d66-8640-32a3c008fd21 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1f54083f40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227'): ({'sdd'}, set())}) {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 11:59:37 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-8096292a-4e4c-4d66-8640-32a3c008fd21 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Removing single pathed devices sdd {{(pid=74190) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 11:59:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:59:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:59:37 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[708a394b-8052-4446-8734-1489f520b4d3]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:59:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:59:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:59:37 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc2ea175-84a5-4315-b353-c2b04cf814b9]: (4, ('ok\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:59:37 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-8096292a-4e4c-4d66-8640-32a3c008fd21 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Flushing IO for device /dev/sdd {{(pid=74190) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 11:59:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:59:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:59:37 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[c910e865-cf88-4f93-9108-529bbc9cb41b]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:59:37 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-8096292a-4e4c-4d66-8640-32a3c008fd21 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74190) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 11:59:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:59:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:59:37 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[87494d19-9010-4d88-84f3-9980f0d37eed]: (4, ('1', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:59:37 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-8096292a-4e4c-4d66-8640-32a3c008fd21 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 11:59:37 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-8096292a-4e4c-4d66-8640-32a3c008fd21 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] SCSI volumes sdd have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 11:59:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-8096292a-4e4c-4d66-8640-32a3c008fd21 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227')] {{(pid=74190) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 11:59:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:59:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:59:37 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[c530d2c4-866b-490d-9410-7daf772942b7]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:59:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-8096292a-4e4c-4d66-8640-32a3c008fd21 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:59:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 -p 172.16.0.220:3260 --logout {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:59:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:59:37 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d8eca21-61b1-4d12-935c-d23ecec22d01]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:59:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-8096292a-4e4c-4d66-8640-32a3c008fd21 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227, portal: 172.16.0.220,3260]
Oct 18 11:59:37 user nova-compute[74190]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227, portal: 172.16.0.220,3260] successful.
Oct 18 11:59:37 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:59:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 -p 172.16.0.220:3260 --op delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 11:59:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc26cf8b-df01-4da0-a6d0-9013e888d227 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 11:59:37 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[83928e69-efe2-4317-a637-cb66ef117ab4]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 11:59:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-8096292a-4e4c-4d66-8640-32a3c008fd21 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 11:59:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-8096292a-4e4c-4d66-8640-32a3c008fd21 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 11:59:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-8096292a-4e4c-4d66-8640-32a3c008fd21 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] <== disconnect_volume: return (337ms) None {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 11:59:37 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8096292a-4e4c-4d66-8640-32a3c008fd21 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Disconnected iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 11:59:37 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-8096292a-4e4c-4d66-8640-32a3c008fd21 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Deleting instance files /opt/stack/data/nova/instances/a9012673-826b-4be7-a55b-9bb35a227c17_del
Oct 18 11:59:37 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-8096292a-4e4c-4d66-8640-32a3c008fd21 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Deletion of /opt/stack/data/nova/instances/a9012673-826b-4be7-a55b-9bb35a227c17_del complete
Oct 18 11:59:37 user nova-compute[74190]: INFO nova.compute.manager [None req-8096292a-4e4c-4d66-8640-32a3c008fd21 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Took 1.25 seconds to destroy the instance on the hypervisor.
Oct 18 11:59:37 user nova-compute[74190]: DEBUG oslo.service.loopingcall [None req-8096292a-4e4c-4d66-8640-32a3c008fd21 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74190) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 11:59:37 user nova-compute[74190]: DEBUG nova.compute.manager [-] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Deallocating network for instance {{(pid=74190) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 11:59:37 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] deallocate_for_instance() {{(pid=74190) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 11:59:37 user nova-compute[74190]: DEBUG nova.compute.manager [req-b0328130-8489-49d3-8e48-d137cecfb0f6 req-7725200d-7449-4f58-8d24-0ee0b4ca9401 service nova] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Received event network-vif-plugged-a32b81a2-7b02-48ed-9550-d392be5e221e {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:59:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-b0328130-8489-49d3-8e48-d137cecfb0f6 req-7725200d-7449-4f58-8d24-0ee0b4ca9401 service nova] Acquiring lock "0382820d-a678-4593-85df-168f42fc4ce4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:59:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-b0328130-8489-49d3-8e48-d137cecfb0f6 req-7725200d-7449-4f58-8d24-0ee0b4ca9401 service nova] Lock "0382820d-a678-4593-85df-168f42fc4ce4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:59:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-b0328130-8489-49d3-8e48-d137cecfb0f6 req-7725200d-7449-4f58-8d24-0ee0b4ca9401 service nova] Lock "0382820d-a678-4593-85df-168f42fc4ce4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:59:37 user nova-compute[74190]: DEBUG nova.compute.manager [req-b0328130-8489-49d3-8e48-d137cecfb0f6 req-7725200d-7449-4f58-8d24-0ee0b4ca9401 service nova] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] No waiting events found dispatching network-vif-plugged-a32b81a2-7b02-48ed-9550-d392be5e221e {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:59:37 user nova-compute[74190]: WARNING nova.compute.manager [req-b0328130-8489-49d3-8e48-d137cecfb0f6 req-7725200d-7449-4f58-8d24-0ee0b4ca9401 service nova] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Received unexpected event network-vif-plugged-a32b81a2-7b02-48ed-9550-d392be5e221e for instance with vm_state building and task_state spawning.
Oct 18 11:59:37 user nova-compute[74190]: DEBUG nova.compute.manager [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Instance event wait completed in 0 seconds for  {{(pid=74190) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 11:59:37 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Guest created on hypervisor {{(pid=74190) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 11:59:37 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Instance spawned successfully.
Oct 18 11:59:37 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 11:59:37 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Found default for hw_cdrom_bus of ide {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:59:37 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Found default for hw_disk_bus of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:59:37 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Found default for hw_input_bus of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:59:37 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Found default for hw_pointer_model of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:59:37 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Found default for hw_video_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:59:37 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Found default for hw_vif_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 11:59:37 user nova-compute[74190]: INFO nova.compute.manager [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Took 5.29 seconds to spawn the instance on the hypervisor.
Oct 18 11:59:37 user nova-compute[74190]: DEBUG nova.compute.manager [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Checking state {{(pid=74190) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 11:59:38 user nova-compute[74190]: INFO nova.compute.manager [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Took 29.25 seconds to build instance.
Oct 18 11:59:38 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-7dea2f7c-727e-4456-9ca3-71e42932ce98 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lock "0382820d-a678-4593-85df-168f42fc4ce4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 29.426s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:59:38 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:59:38 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Updating instance_info_cache with network_info: [] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:59:38 user nova-compute[74190]: INFO nova.compute.manager [-] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Took 0.76 seconds to deallocate network for instance.
Oct 18 11:59:38 user nova-compute[74190]: DEBUG nova.compute.manager [req-e7ff2eac-56e2-4093-b9df-9c768a9d14a8 req-15fe25eb-e21d-4eb2-b48c-8f8d5671543e service nova] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Received event network-vif-deleted-98016144-4b95-4e94-8ae4-581089fe4f63 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:59:38 user nova-compute[74190]: INFO nova.compute.manager [req-e7ff2eac-56e2-4093-b9df-9c768a9d14a8 req-15fe25eb-e21d-4eb2-b48c-8f8d5671543e service nova] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Neutron deleted interface 98016144-4b95-4e94-8ae4-581089fe4f63; detaching it from the instance and deleting it from the info cache
Oct 18 11:59:38 user nova-compute[74190]: DEBUG nova.network.neutron [req-e7ff2eac-56e2-4093-b9df-9c768a9d14a8 req-15fe25eb-e21d-4eb2-b48c-8f8d5671543e service nova] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Updating instance_info_cache with network_info: [] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 11:59:38 user nova-compute[74190]: DEBUG nova.compute.manager [req-e7ff2eac-56e2-4093-b9df-9c768a9d14a8 req-15fe25eb-e21d-4eb2-b48c-8f8d5671543e service nova] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Detach interface failed, port_id=98016144-4b95-4e94-8ae4-581089fe4f63, reason: Instance a9012673-826b-4be7-a55b-9bb35a227c17 could not be found. {{(pid=74190) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 18 11:59:38 user nova-compute[74190]: DEBUG nova.compute.manager [req-70ce198c-99ee-48fc-a74c-9cf6ad4c2308 req-8c72b269-7ad9-4a75-a090-d8bc93395016 service nova] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Received event network-vif-plugged-98016144-4b95-4e94-8ae4-581089fe4f63 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 11:59:38 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-70ce198c-99ee-48fc-a74c-9cf6ad4c2308 req-8c72b269-7ad9-4a75-a090-d8bc93395016 service nova] Acquiring lock "a9012673-826b-4be7-a55b-9bb35a227c17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:59:38 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-70ce198c-99ee-48fc-a74c-9cf6ad4c2308 req-8c72b269-7ad9-4a75-a090-d8bc93395016 service nova] Lock "a9012673-826b-4be7-a55b-9bb35a227c17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:59:38 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-70ce198c-99ee-48fc-a74c-9cf6ad4c2308 req-8c72b269-7ad9-4a75-a090-d8bc93395016 service nova] Lock "a9012673-826b-4be7-a55b-9bb35a227c17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:59:38 user nova-compute[74190]: DEBUG nova.compute.manager [req-70ce198c-99ee-48fc-a74c-9cf6ad4c2308 req-8c72b269-7ad9-4a75-a090-d8bc93395016 service nova] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] No waiting events found dispatching network-vif-plugged-98016144-4b95-4e94-8ae4-581089fe4f63 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 11:59:38 user nova-compute[74190]: WARNING nova.compute.manager [req-70ce198c-99ee-48fc-a74c-9cf6ad4c2308 req-8c72b269-7ad9-4a75-a090-d8bc93395016 service nova] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Received unexpected event network-vif-plugged-98016144-4b95-4e94-8ae4-581089fe4f63 for instance with vm_state active and task_state deleting.
Oct 18 11:59:39 user nova-compute[74190]: INFO nova.compute.manager [None req-8096292a-4e4c-4d66-8640-32a3c008fd21 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Took 0.78 seconds to detach 1 volumes for instance.
Oct 18 11:59:39 user nova-compute[74190]: DEBUG nova.compute.manager [None req-8096292a-4e4c-4d66-8640-32a3c008fd21 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: a9012673-826b-4be7-a55b-9bb35a227c17] Deleting volume: cc26cf8b-df01-4da0-a6d0-9013e888d227 {{(pid=74190) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 18 11:59:39 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-8096292a-4e4c-4d66-8640-32a3c008fd21 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 11:59:39 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-8096292a-4e4c-4d66-8640-32a3c008fd21 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 11:59:39 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-8096292a-4e4c-4d66-8640-32a3c008fd21 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 11:59:39 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-8096292a-4e4c-4d66-8640-32a3c008fd21 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 11:59:39 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-8096292a-4e4c-4d66-8640-32a3c008fd21 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.302s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:59:39 user nova-compute[74190]: INFO nova.scheduler.client.report [None req-8096292a-4e4c-4d66-8640-32a3c008fd21 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Deleted allocations for instance a9012673-826b-4be7-a55b-9bb35a227c17
Oct 18 11:59:39 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-8096292a-4e4c-4d66-8640-32a3c008fd21 tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lock "a9012673-826b-4be7-a55b-9bb35a227c17" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.337s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 11:59:40 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:59:42 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:59:45 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:59:47 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:59:50 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:59:52 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:59:55 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 11:59:57 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:00:00 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:00:00 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:00:01 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:00:02 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:00:03 user nova-compute[74190]: DEBUG nova.compute.manager [req-f9cc87bf-bba7-49fb-805b-d4c3db284f07 req-70224b02-3e2e-4652-b08d-63370a30a66e service nova] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] Received event network-changed-1a9d494b-8515-4508-b0d8-387e20c897bb {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:00:03 user nova-compute[74190]: DEBUG nova.compute.manager [req-f9cc87bf-bba7-49fb-805b-d4c3db284f07 req-70224b02-3e2e-4652-b08d-63370a30a66e service nova] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] Refreshing instance network info cache due to event network-changed-1a9d494b-8515-4508-b0d8-387e20c897bb. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 12:00:03 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-f9cc87bf-bba7-49fb-805b-d4c3db284f07 req-70224b02-3e2e-4652-b08d-63370a30a66e service nova] Acquiring lock "refresh_cache-8eec9cde-3553-4fc8-9162-cda963d1a81e" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:00:03 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-f9cc87bf-bba7-49fb-805b-d4c3db284f07 req-70224b02-3e2e-4652-b08d-63370a30a66e service nova] Acquired lock "refresh_cache-8eec9cde-3553-4fc8-9162-cda963d1a81e" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:00:03 user nova-compute[74190]: DEBUG nova.network.neutron [req-f9cc87bf-bba7-49fb-805b-d4c3db284f07 req-70224b02-3e2e-4652-b08d-63370a30a66e service nova] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] Refreshing network info cache for port 1a9d494b-8515-4508-b0d8-387e20c897bb {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 12:00:04 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-dca320b3-5553-4036-ba61-dbc770d34819 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Acquiring lock "8eec9cde-3553-4fc8-9162-cda963d1a81e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:00:04 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-dca320b3-5553-4036-ba61-dbc770d34819 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Lock "8eec9cde-3553-4fc8-9162-cda963d1a81e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:00:04 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-dca320b3-5553-4036-ba61-dbc770d34819 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Acquiring lock "8eec9cde-3553-4fc8-9162-cda963d1a81e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:00:04 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-dca320b3-5553-4036-ba61-dbc770d34819 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Lock "8eec9cde-3553-4fc8-9162-cda963d1a81e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:00:04 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-dca320b3-5553-4036-ba61-dbc770d34819 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Lock "8eec9cde-3553-4fc8-9162-cda963d1a81e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:00:04 user nova-compute[74190]: INFO nova.compute.manager [None req-dca320b3-5553-4036-ba61-dbc770d34819 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] Terminating instance
Oct 18 12:00:04 user nova-compute[74190]: DEBUG nova.compute.manager [None req-dca320b3-5553-4036-ba61-dbc770d34819 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] Start destroying the instance on the hypervisor. {{(pid=74190) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 12:00:04 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:00:04 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74190) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 12:00:04 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:00:04 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:00:04 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:00:04 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:00:04 user nova-compute[74190]: DEBUG nova.network.neutron [req-f9cc87bf-bba7-49fb-805b-d4c3db284f07 req-70224b02-3e2e-4652-b08d-63370a30a66e service nova] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] Updated VIF entry in instance network info cache for port 1a9d494b-8515-4508-b0d8-387e20c897bb. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 12:00:04 user nova-compute[74190]: DEBUG nova.network.neutron [req-f9cc87bf-bba7-49fb-805b-d4c3db284f07 req-70224b02-3e2e-4652-b08d-63370a30a66e service nova] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] Updating instance_info_cache with network_info: [{"id": "1a9d494b-8515-4508-b0d8-387e20c897bb", "address": "fa:16:3e:41:d4:c9", "network": {"id": "56026ce6-77fb-40c7-9976-732e745c219d", "bridge": "br-int", "label": "tempest-TestStampPattern-989787934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "389e1c2dbc904130ba08b137f0b2e837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a9d494b-85", "ovs_interfaceid": "1a9d494b-8515-4508-b0d8-387e20c897bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:00:04 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-f9cc87bf-bba7-49fb-805b-d4c3db284f07 req-70224b02-3e2e-4652-b08d-63370a30a66e service nova] Releasing lock "refresh_cache-8eec9cde-3553-4fc8-9162-cda963d1a81e" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:00:04 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:00:04 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:00:04 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] Instance destroyed successfully.
Oct 18 12:00:04 user nova-compute[74190]: DEBUG nova.objects.instance [None req-dca320b3-5553-4036-ba61-dbc770d34819 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Lazy-loading 'resources' on Instance uuid 8eec9cde-3553-4fc8-9162-cda963d1a81e {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:00:04 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:00:04 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-dca320b3-5553-4036-ba61-dbc770d34819 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:52:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-542376931',display_name='tempest-TestStampPattern-server-542376931',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-542376931',id=21,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIWsfXQkdYGPKym2GX8abBzSE1TgaUSMy3GxYdQVyxTc9qElJuld8J6hiVUfhDnJocQnssGij1BqYm1SJS/pWo5ybDXV8dLSSiMAGmlRDARneJEWLLFP/+ol+LaeplXvXg==',key_name='tempest-TestStampPattern-1418984438',keypairs=<?>,launch_index=0,launched_at=2023-10-18T11:52:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='389e1c2dbc904130ba08b137f0b2e837',ramdisk_id='',reservation_id='r-yopd55yn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-2116730913',owner_user_name='tempest-TestStampPattern-2116730913-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T11:55:47Z,user_data=None,user_id='a252f2c479b740a29a1adc79e6346b20',uuid=8eec9cde-3553-4fc8-9162-cda963d1a81e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1a9d494b-8515-4508-b0d8-387e20c897bb", "address": "fa:16:3e:41:d4:c9", "network": {"id": "56026ce6-77fb-40c7-9976-732e745c219d", "bridge": "br-int", "label": "tempest-TestStampPattern-989787934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "389e1c2dbc904130ba08b137f0b2e837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a9d494b-85", "ovs_interfaceid": "1a9d494b-8515-4508-b0d8-387e20c897bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 12:00:04 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-dca320b3-5553-4036-ba61-dbc770d34819 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Converting VIF {"id": "1a9d494b-8515-4508-b0d8-387e20c897bb", "address": "fa:16:3e:41:d4:c9", "network": {"id": "56026ce6-77fb-40c7-9976-732e745c219d", "bridge": "br-int", "label": "tempest-TestStampPattern-989787934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "389e1c2dbc904130ba08b137f0b2e837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a9d494b-85", "ovs_interfaceid": "1a9d494b-8515-4508-b0d8-387e20c897bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 12:00:04 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-dca320b3-5553-4036-ba61-dbc770d34819 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:41:d4:c9,bridge_name='br-int',has_traffic_filtering=True,id=1a9d494b-8515-4508-b0d8-387e20c897bb,network=Network(56026ce6-77fb-40c7-9976-732e745c219d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a9d494b-85') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 12:00:04 user nova-compute[74190]: DEBUG os_vif [None req-dca320b3-5553-4036-ba61-dbc770d34819 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:d4:c9,bridge_name='br-int',has_traffic_filtering=True,id=1a9d494b-8515-4508-b0d8-387e20c897bb,network=Network(56026ce6-77fb-40c7-9976-732e745c219d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a9d494b-85') {{(pid=74190) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 12:00:04 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:00:04 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1a9d494b-85, bridge=br-int, if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:00:04 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:00:04 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:00:04 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:00:04 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=68141a98-5dad-40a6-bf6a-0338dbb347ba) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:00:04 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:00:04 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:00:04 user nova-compute[74190]: INFO os_vif [None req-dca320b3-5553-4036-ba61-dbc770d34819 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:d4:c9,bridge_name='br-int',has_traffic_filtering=True,id=1a9d494b-8515-4508-b0d8-387e20c897bb,network=Network(56026ce6-77fb-40c7-9976-732e745c219d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a9d494b-85')
Oct 18 12:00:04 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-dca320b3-5553-4036-ba61-dbc770d34819 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] Deleting instance files /opt/stack/data/nova/instances/8eec9cde-3553-4fc8-9162-cda963d1a81e_del
Oct 18 12:00:04 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-dca320b3-5553-4036-ba61-dbc770d34819 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] Deletion of /opt/stack/data/nova/instances/8eec9cde-3553-4fc8-9162-cda963d1a81e_del complete
Oct 18 12:00:04 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:00:04 user nova-compute[74190]: INFO nova.compute.manager [None req-dca320b3-5553-4036-ba61-dbc770d34819 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] Took 0.87 seconds to destroy the instance on the hypervisor.
Oct 18 12:00:04 user nova-compute[74190]: DEBUG oslo.service.loopingcall [None req-dca320b3-5553-4036-ba61-dbc770d34819 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74190) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 12:00:04 user nova-compute[74190]: DEBUG nova.compute.manager [-] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] Deallocating network for instance {{(pid=74190) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 12:00:04 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] deallocate_for_instance() {{(pid=74190) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 12:00:05 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:00:05 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:00:05 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:00:05 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:00:05 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:00:05 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] Updating instance_info_cache with network_info: [] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:00:05 user nova-compute[74190]: INFO nova.compute.manager [-] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] Took 0.80 seconds to deallocate network for instance.
Oct 18 12:00:05 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-dca320b3-5553-4036-ba61-dbc770d34819 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:00:05 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-dca320b3-5553-4036-ba61-dbc770d34819 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:00:05 user nova-compute[74190]: DEBUG nova.compute.manager [req-47e272dd-fdfe-4d76-b971-38cdbf4fd73c req-959bc110-57db-49cf-80ff-3702152fa1a8 service nova] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] Received event network-vif-unplugged-1a9d494b-8515-4508-b0d8-387e20c897bb {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:00:05 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-47e272dd-fdfe-4d76-b971-38cdbf4fd73c req-959bc110-57db-49cf-80ff-3702152fa1a8 service nova] Acquiring lock "8eec9cde-3553-4fc8-9162-cda963d1a81e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:00:05 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-47e272dd-fdfe-4d76-b971-38cdbf4fd73c req-959bc110-57db-49cf-80ff-3702152fa1a8 service nova] Lock "8eec9cde-3553-4fc8-9162-cda963d1a81e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:00:06 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-47e272dd-fdfe-4d76-b971-38cdbf4fd73c req-959bc110-57db-49cf-80ff-3702152fa1a8 service nova] Lock "8eec9cde-3553-4fc8-9162-cda963d1a81e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:00:06 user nova-compute[74190]: DEBUG nova.compute.manager [req-47e272dd-fdfe-4d76-b971-38cdbf4fd73c req-959bc110-57db-49cf-80ff-3702152fa1a8 service nova] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] No waiting events found dispatching network-vif-unplugged-1a9d494b-8515-4508-b0d8-387e20c897bb {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:00:06 user nova-compute[74190]: WARNING nova.compute.manager [req-47e272dd-fdfe-4d76-b971-38cdbf4fd73c req-959bc110-57db-49cf-80ff-3702152fa1a8 service nova] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] Received unexpected event network-vif-unplugged-1a9d494b-8515-4508-b0d8-387e20c897bb for instance with vm_state deleted and task_state None.
Oct 18 12:00:06 user nova-compute[74190]: DEBUG nova.compute.manager [req-47e272dd-fdfe-4d76-b971-38cdbf4fd73c req-959bc110-57db-49cf-80ff-3702152fa1a8 service nova] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] Received event network-vif-plugged-1a9d494b-8515-4508-b0d8-387e20c897bb {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:00:06 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-47e272dd-fdfe-4d76-b971-38cdbf4fd73c req-959bc110-57db-49cf-80ff-3702152fa1a8 service nova] Acquiring lock "8eec9cde-3553-4fc8-9162-cda963d1a81e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:00:06 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-47e272dd-fdfe-4d76-b971-38cdbf4fd73c req-959bc110-57db-49cf-80ff-3702152fa1a8 service nova] Lock "8eec9cde-3553-4fc8-9162-cda963d1a81e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:00:06 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-47e272dd-fdfe-4d76-b971-38cdbf4fd73c req-959bc110-57db-49cf-80ff-3702152fa1a8 service nova] Lock "8eec9cde-3553-4fc8-9162-cda963d1a81e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:00:06 user nova-compute[74190]: DEBUG nova.compute.manager [req-47e272dd-fdfe-4d76-b971-38cdbf4fd73c req-959bc110-57db-49cf-80ff-3702152fa1a8 service nova] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] No waiting events found dispatching network-vif-plugged-1a9d494b-8515-4508-b0d8-387e20c897bb {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:00:06 user nova-compute[74190]: WARNING nova.compute.manager [req-47e272dd-fdfe-4d76-b971-38cdbf4fd73c req-959bc110-57db-49cf-80ff-3702152fa1a8 service nova] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] Received unexpected event network-vif-plugged-1a9d494b-8515-4508-b0d8-387e20c897bb for instance with vm_state deleted and task_state None.
Oct 18 12:00:06 user nova-compute[74190]: DEBUG nova.compute.manager [req-47e272dd-fdfe-4d76-b971-38cdbf4fd73c req-959bc110-57db-49cf-80ff-3702152fa1a8 service nova] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] Received event network-vif-plugged-1a9d494b-8515-4508-b0d8-387e20c897bb {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:00:06 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-47e272dd-fdfe-4d76-b971-38cdbf4fd73c req-959bc110-57db-49cf-80ff-3702152fa1a8 service nova] Acquiring lock "8eec9cde-3553-4fc8-9162-cda963d1a81e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:00:06 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-47e272dd-fdfe-4d76-b971-38cdbf4fd73c req-959bc110-57db-49cf-80ff-3702152fa1a8 service nova] Lock "8eec9cde-3553-4fc8-9162-cda963d1a81e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:00:06 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-47e272dd-fdfe-4d76-b971-38cdbf4fd73c req-959bc110-57db-49cf-80ff-3702152fa1a8 service nova] Lock "8eec9cde-3553-4fc8-9162-cda963d1a81e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:00:06 user nova-compute[74190]: DEBUG nova.compute.manager [req-47e272dd-fdfe-4d76-b971-38cdbf4fd73c req-959bc110-57db-49cf-80ff-3702152fa1a8 service nova] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] No waiting events found dispatching network-vif-plugged-1a9d494b-8515-4508-b0d8-387e20c897bb {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:00:06 user nova-compute[74190]: WARNING nova.compute.manager [req-47e272dd-fdfe-4d76-b971-38cdbf4fd73c req-959bc110-57db-49cf-80ff-3702152fa1a8 service nova] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] Received unexpected event network-vif-plugged-1a9d494b-8515-4508-b0d8-387e20c897bb for instance with vm_state deleted and task_state None.
Oct 18 12:00:06 user nova-compute[74190]: DEBUG nova.compute.manager [req-47e272dd-fdfe-4d76-b971-38cdbf4fd73c req-959bc110-57db-49cf-80ff-3702152fa1a8 service nova] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] Received event network-vif-plugged-1a9d494b-8515-4508-b0d8-387e20c897bb {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:00:06 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-47e272dd-fdfe-4d76-b971-38cdbf4fd73c req-959bc110-57db-49cf-80ff-3702152fa1a8 service nova] Acquiring lock "8eec9cde-3553-4fc8-9162-cda963d1a81e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:00:06 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-47e272dd-fdfe-4d76-b971-38cdbf4fd73c req-959bc110-57db-49cf-80ff-3702152fa1a8 service nova] Lock "8eec9cde-3553-4fc8-9162-cda963d1a81e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:00:06 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-47e272dd-fdfe-4d76-b971-38cdbf4fd73c req-959bc110-57db-49cf-80ff-3702152fa1a8 service nova] Lock "8eec9cde-3553-4fc8-9162-cda963d1a81e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:00:06 user nova-compute[74190]: DEBUG nova.compute.manager [req-47e272dd-fdfe-4d76-b971-38cdbf4fd73c req-959bc110-57db-49cf-80ff-3702152fa1a8 service nova] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] No waiting events found dispatching network-vif-plugged-1a9d494b-8515-4508-b0d8-387e20c897bb {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:00:06 user nova-compute[74190]: WARNING nova.compute.manager [req-47e272dd-fdfe-4d76-b971-38cdbf4fd73c req-959bc110-57db-49cf-80ff-3702152fa1a8 service nova] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] Received unexpected event network-vif-plugged-1a9d494b-8515-4508-b0d8-387e20c897bb for instance with vm_state deleted and task_state None.
Oct 18 12:00:06 user nova-compute[74190]: DEBUG nova.compute.manager [req-47e272dd-fdfe-4d76-b971-38cdbf4fd73c req-959bc110-57db-49cf-80ff-3702152fa1a8 service nova] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] Received event network-vif-unplugged-1a9d494b-8515-4508-b0d8-387e20c897bb {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:00:06 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-47e272dd-fdfe-4d76-b971-38cdbf4fd73c req-959bc110-57db-49cf-80ff-3702152fa1a8 service nova] Acquiring lock "8eec9cde-3553-4fc8-9162-cda963d1a81e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:00:06 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-47e272dd-fdfe-4d76-b971-38cdbf4fd73c req-959bc110-57db-49cf-80ff-3702152fa1a8 service nova] Lock "8eec9cde-3553-4fc8-9162-cda963d1a81e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:00:06 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-47e272dd-fdfe-4d76-b971-38cdbf4fd73c req-959bc110-57db-49cf-80ff-3702152fa1a8 service nova] Lock "8eec9cde-3553-4fc8-9162-cda963d1a81e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:00:06 user nova-compute[74190]: DEBUG nova.compute.manager [req-47e272dd-fdfe-4d76-b971-38cdbf4fd73c req-959bc110-57db-49cf-80ff-3702152fa1a8 service nova] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] No waiting events found dispatching network-vif-unplugged-1a9d494b-8515-4508-b0d8-387e20c897bb {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:00:06 user nova-compute[74190]: WARNING nova.compute.manager [req-47e272dd-fdfe-4d76-b971-38cdbf4fd73c req-959bc110-57db-49cf-80ff-3702152fa1a8 service nova] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] Received unexpected event network-vif-unplugged-1a9d494b-8515-4508-b0d8-387e20c897bb for instance with vm_state deleted and task_state None.
Oct 18 12:00:06 user nova-compute[74190]: DEBUG nova.compute.manager [req-47e272dd-fdfe-4d76-b971-38cdbf4fd73c req-959bc110-57db-49cf-80ff-3702152fa1a8 service nova] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] Received event network-vif-plugged-1a9d494b-8515-4508-b0d8-387e20c897bb {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:00:06 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-47e272dd-fdfe-4d76-b971-38cdbf4fd73c req-959bc110-57db-49cf-80ff-3702152fa1a8 service nova] Acquiring lock "8eec9cde-3553-4fc8-9162-cda963d1a81e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:00:06 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-47e272dd-fdfe-4d76-b971-38cdbf4fd73c req-959bc110-57db-49cf-80ff-3702152fa1a8 service nova] Lock "8eec9cde-3553-4fc8-9162-cda963d1a81e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:00:06 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-47e272dd-fdfe-4d76-b971-38cdbf4fd73c req-959bc110-57db-49cf-80ff-3702152fa1a8 service nova] Lock "8eec9cde-3553-4fc8-9162-cda963d1a81e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:00:06 user nova-compute[74190]: DEBUG nova.compute.manager [req-47e272dd-fdfe-4d76-b971-38cdbf4fd73c req-959bc110-57db-49cf-80ff-3702152fa1a8 service nova] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] No waiting events found dispatching network-vif-plugged-1a9d494b-8515-4508-b0d8-387e20c897bb {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:00:06 user nova-compute[74190]: WARNING nova.compute.manager [req-47e272dd-fdfe-4d76-b971-38cdbf4fd73c req-959bc110-57db-49cf-80ff-3702152fa1a8 service nova] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] Received unexpected event network-vif-plugged-1a9d494b-8515-4508-b0d8-387e20c897bb for instance with vm_state deleted and task_state None.
Oct 18 12:00:06 user nova-compute[74190]: DEBUG nova.compute.manager [req-47e272dd-fdfe-4d76-b971-38cdbf4fd73c req-959bc110-57db-49cf-80ff-3702152fa1a8 service nova] [instance: 8eec9cde-3553-4fc8-9162-cda963d1a81e] Received event network-vif-deleted-1a9d494b-8515-4508-b0d8-387e20c897bb {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:00:06 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-dca320b3-5553-4036-ba61-dbc770d34819 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 12:00:06 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:00:06 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Starting heal instance info cache {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 12:00:06 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-dca320b3-5553-4036-ba61-dbc770d34819 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 12:00:06 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-dca320b3-5553-4036-ba61-dbc770d34819 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.329s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:00:06 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "refresh_cache-95ca0697-22b5-4109-868f-ca5556015a1f" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:00:06 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquired lock "refresh_cache-95ca0697-22b5-4109-868f-ca5556015a1f" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:00:06 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] Forcefully refreshing network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 18 12:00:06 user nova-compute[74190]: INFO nova.scheduler.client.report [None req-dca320b3-5553-4036-ba61-dbc770d34819 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Deleted allocations for instance 8eec9cde-3553-4fc8-9162-cda963d1a81e
Oct 18 12:00:06 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-dca320b3-5553-4036-ba61-dbc770d34819 tempest-TestStampPattern-2116730913 tempest-TestStampPattern-2116730913-project-member] Lock "8eec9cde-3553-4fc8-9162-cda963d1a81e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.179s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:00:06 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] Updating instance_info_cache with network_info: [{"id": "58c81983-46ab-4026-b712-775ae319a09f", "address": "fa:16:3e:dd:c9:17", "network": {"id": "130f7948-11e4-49b4-9d4a-dffb2b48bdcd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595419292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ffa18c02b8a4117ab1ccc52aca64f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58c81983-46", "ovs_interfaceid": "58c81983-46ab-4026-b712-775ae319a09f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:00:06 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Releasing lock "refresh_cache-95ca0697-22b5-4109-868f-ca5556015a1f" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:00:06 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] Updated the network info_cache for instance {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 18 12:00:06 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:00:08 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:00:08 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:00:08 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:00:08 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:00:08 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:00:08 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Auditing locally available compute resources for user (node: user) {{(pid=74190) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 12:00:08 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/disk.rescue --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:00:08 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:00:08 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/disk.rescue --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:00:08 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:00:08 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:00:08 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:00:08 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:00:08 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:00:08 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:00:09 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:00:09 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:00:09 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:00:09 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0209c824-88a7-4976-83bf-8a72437f0cc2/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:00:09 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0209c824-88a7-4976-83bf-8a72437f0cc2/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:00:09 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0209c824-88a7-4976-83bf-8a72437f0cc2/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:00:09 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0209c824-88a7-4976-83bf-8a72437f0cc2/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:00:09 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7128c4e8-0118-4138-b421-9b1d610d7454/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:00:09 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:00:09 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7128c4e8-0118-4138-b421-9b1d610d7454/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:00:09 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7128c4e8-0118-4138-b421-9b1d610d7454/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:00:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7128c4e8-0118-4138-b421-9b1d610d7454/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:00:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:00:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:00:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:00:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:00:10 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 12:00:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcea54d1-e5e8-4079-8c59-499c82404088/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:00:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcea54d1-e5e8-4079-8c59-499c82404088/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:00:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcea54d1-e5e8-4079-8c59-499c82404088/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:00:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcea54d1-e5e8-4079-8c59-499c82404088/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:00:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk.rescue --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:00:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:00:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk.rescue --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:00:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:00:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:00:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:00:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:00:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:00:11 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 12:00:12 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:00:12 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:00:12 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Hypervisor/Node resource view: name=user free_ram=7878MB free_disk=25.16350555419922GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74190) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 12:00:12 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:00:12 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:00:12 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 0209c824-88a7-4976-83bf-8a72437f0cc2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:00:12 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 4e916d24-9f9d-4289-87ce-f65d2499fcd9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:00:12 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 95ca0697-22b5-4109-868f-ca5556015a1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:00:12 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 42413a94-9973-4e8d-83b6-207a4e7847c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:00:12 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 772b126c-2148-4ca8-90f2-69d6eb4b7db7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:00:12 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance dcea54d1-e5e8-4079-8c59-499c82404088 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:00:12 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 0382820d-a678-4593-85df-168f42fc4ce4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:00:12 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 7128c4e8-0118-4138-b421-9b1d610d7454 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:00:12 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 12:00:12 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 12:00:12 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 12:00:12 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 12:00:12 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Compute_service record updated for user:user {{(pid=74190) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 12:00:12 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.558s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:00:14 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:00:14 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:00:14 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:00:14 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:00:14 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74190) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 12:00:14 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:00:14 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:00:14 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:00:19 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:00:19 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:00:19 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74190) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 12:00:19 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:00:19 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:00:19 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:00:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:00:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:00:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74190) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 12:00:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:00:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:00:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:00:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:00:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:00:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:00:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74190) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 12:00:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:00:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:00:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:00:35 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-1cf17b03-4355-4fe4-8ceb-b12102ff1dca tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Acquiring lock "0209c824-88a7-4976-83bf-8a72437f0cc2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:00:35 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-1cf17b03-4355-4fe4-8ceb-b12102ff1dca tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lock "0209c824-88a7-4976-83bf-8a72437f0cc2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:00:35 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-1cf17b03-4355-4fe4-8ceb-b12102ff1dca tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Acquiring lock "0209c824-88a7-4976-83bf-8a72437f0cc2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:00:35 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-1cf17b03-4355-4fe4-8ceb-b12102ff1dca tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lock "0209c824-88a7-4976-83bf-8a72437f0cc2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:00:35 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-1cf17b03-4355-4fe4-8ceb-b12102ff1dca tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lock "0209c824-88a7-4976-83bf-8a72437f0cc2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:00:35 user nova-compute[74190]: INFO nova.compute.manager [None req-1cf17b03-4355-4fe4-8ceb-b12102ff1dca tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] Terminating instance
Oct 18 12:00:35 user nova-compute[74190]: DEBUG nova.compute.manager [None req-1cf17b03-4355-4fe4-8ceb-b12102ff1dca tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] Start destroying the instance on the hypervisor. {{(pid=74190) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 12:00:35 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:00:35 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:00:35 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:00:35 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:00:35 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:00:35 user nova-compute[74190]: DEBUG nova.compute.manager [req-23433763-2dd2-4d4b-8a9b-71539ac3c31b req-ccfab8b0-c1d4-49ca-9b95-dcc5cbeeed35 service nova] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] Received event network-vif-unplugged-5e4eb783-7e7c-4501-bf99-33472454f4ac {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:00:35 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-23433763-2dd2-4d4b-8a9b-71539ac3c31b req-ccfab8b0-c1d4-49ca-9b95-dcc5cbeeed35 service nova] Acquiring lock "0209c824-88a7-4976-83bf-8a72437f0cc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:00:35 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-23433763-2dd2-4d4b-8a9b-71539ac3c31b req-ccfab8b0-c1d4-49ca-9b95-dcc5cbeeed35 service nova] Lock "0209c824-88a7-4976-83bf-8a72437f0cc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:00:35 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-23433763-2dd2-4d4b-8a9b-71539ac3c31b req-ccfab8b0-c1d4-49ca-9b95-dcc5cbeeed35 service nova] Lock "0209c824-88a7-4976-83bf-8a72437f0cc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:00:35 user nova-compute[74190]: DEBUG nova.compute.manager [req-23433763-2dd2-4d4b-8a9b-71539ac3c31b req-ccfab8b0-c1d4-49ca-9b95-dcc5cbeeed35 service nova] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] No waiting events found dispatching network-vif-unplugged-5e4eb783-7e7c-4501-bf99-33472454f4ac {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:00:35 user nova-compute[74190]: DEBUG nova.compute.manager [req-23433763-2dd2-4d4b-8a9b-71539ac3c31b req-ccfab8b0-c1d4-49ca-9b95-dcc5cbeeed35 service nova] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] Received event network-vif-unplugged-5e4eb783-7e7c-4501-bf99-33472454f4ac for instance with task_state deleting. {{(pid=74190) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 12:00:35 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:00:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:00:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:00:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:00:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:00:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:00:36 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] Instance destroyed successfully.
Oct 18 12:00:36 user nova-compute[74190]: DEBUG nova.objects.instance [None req-1cf17b03-4355-4fe4-8ceb-b12102ff1dca tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lazy-loading 'resources' on Instance uuid 0209c824-88a7-4976-83bf-8a72437f0cc2 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:00:36 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-1cf17b03-4355-4fe4-8ceb-b12102ff1dca tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:41:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1277453661',display_name='tempest-ServerActionsTestOtherA-server-1277453661',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1277453661',id=3,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOQBzNTv9LZg0yq/3lf4kmMEAFSSxHvdpQtvKWiUtvrhz9NgEirvm+N8Tqx31x38AF1/g3O4be21YeguWgKCS7N36Oy8ZZWxYYR46ATEkZPMIr3HhNKcU83cECzcDD++0g==',key_name='tempest-keypair-1511789347',keypairs=<?>,launch_index=0,launched_at=2023-10-18T11:41:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='08cf52ce927443158aa731367f08bd57',ramdisk_id='',reservation_id='r-4v08wavi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1288544694',owner_user_name='tempest-ServerActionsTestOtherA-1288544694-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T11:41:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b771e627a76b4540bf8de665df3d7787',uuid=0209c824-88a7-4976-83bf-8a72437f0cc2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5e4eb783-7e7c-4501-bf99-33472454f4ac", "address": "fa:16:3e:7e:d2:03", "network": {"id": "f5ab7da4-2b07-4465-9a89-a07eb053ba91", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1315695374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08cf52ce927443158aa731367f08bd57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e4eb783-7e", "ovs_interfaceid": "5e4eb783-7e7c-4501-bf99-33472454f4ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 12:00:36 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-1cf17b03-4355-4fe4-8ceb-b12102ff1dca tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Converting VIF {"id": "5e4eb783-7e7c-4501-bf99-33472454f4ac", "address": "fa:16:3e:7e:d2:03", "network": {"id": "f5ab7da4-2b07-4465-9a89-a07eb053ba91", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1315695374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08cf52ce927443158aa731367f08bd57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e4eb783-7e", "ovs_interfaceid": "5e4eb783-7e7c-4501-bf99-33472454f4ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 12:00:36 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-1cf17b03-4355-4fe4-8ceb-b12102ff1dca tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7e:d2:03,bridge_name='br-int',has_traffic_filtering=True,id=5e4eb783-7e7c-4501-bf99-33472454f4ac,network=Network(f5ab7da4-2b07-4465-9a89-a07eb053ba91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e4eb783-7e') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 12:00:36 user nova-compute[74190]: DEBUG os_vif [None req-1cf17b03-4355-4fe4-8ceb-b12102ff1dca tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:d2:03,bridge_name='br-int',has_traffic_filtering=True,id=5e4eb783-7e7c-4501-bf99-33472454f4ac,network=Network(f5ab7da4-2b07-4465-9a89-a07eb053ba91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e4eb783-7e') {{(pid=74190) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 12:00:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:00:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5e4eb783-7e, bridge=br-int, if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:00:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:00:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:00:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:00:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eb536aea-f82d-4116-a481-c593038bc647) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:00:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:00:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:00:36 user nova-compute[74190]: INFO os_vif [None req-1cf17b03-4355-4fe4-8ceb-b12102ff1dca tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:d2:03,bridge_name='br-int',has_traffic_filtering=True,id=5e4eb783-7e7c-4501-bf99-33472454f4ac,network=Network(f5ab7da4-2b07-4465-9a89-a07eb053ba91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e4eb783-7e')
Oct 18 12:00:36 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-1cf17b03-4355-4fe4-8ceb-b12102ff1dca tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] Deleting instance files /opt/stack/data/nova/instances/0209c824-88a7-4976-83bf-8a72437f0cc2_del
Oct 18 12:00:36 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-1cf17b03-4355-4fe4-8ceb-b12102ff1dca tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] Deletion of /opt/stack/data/nova/instances/0209c824-88a7-4976-83bf-8a72437f0cc2_del complete
Oct 18 12:00:36 user nova-compute[74190]: INFO nova.compute.manager [None req-1cf17b03-4355-4fe4-8ceb-b12102ff1dca tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] Took 0.89 seconds to destroy the instance on the hypervisor.
Oct 18 12:00:36 user nova-compute[74190]: DEBUG oslo.service.loopingcall [None req-1cf17b03-4355-4fe4-8ceb-b12102ff1dca tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74190) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 12:00:36 user nova-compute[74190]: DEBUG nova.compute.manager [-] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] Deallocating network for instance {{(pid=74190) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 12:00:36 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] deallocate_for_instance() {{(pid=74190) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 12:00:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:00:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:00:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:00:36 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] Updating instance_info_cache with network_info: [] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:00:36 user nova-compute[74190]: INFO nova.compute.manager [-] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] Took 0.58 seconds to deallocate network for instance.
Oct 18 12:00:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:00:36 user nova-compute[74190]: DEBUG nova.compute.manager [req-9f1a6f4c-7cb3-4ec2-bf42-e173ab98cef6 req-c6a815dc-3139-44fe-bf7e-e311486b6d27 service nova] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] Received event network-vif-deleted-5e4eb783-7e7c-4501-bf99-33472454f4ac {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:00:36 user nova-compute[74190]: INFO nova.compute.manager [req-9f1a6f4c-7cb3-4ec2-bf42-e173ab98cef6 req-c6a815dc-3139-44fe-bf7e-e311486b6d27 service nova] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] Neutron deleted interface 5e4eb783-7e7c-4501-bf99-33472454f4ac; detaching it from the instance and deleting it from the info cache
Oct 18 12:00:36 user nova-compute[74190]: DEBUG nova.network.neutron [req-9f1a6f4c-7cb3-4ec2-bf42-e173ab98cef6 req-c6a815dc-3139-44fe-bf7e-e311486b6d27 service nova] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] Updating instance_info_cache with network_info: [] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:00:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:00:36 user nova-compute[74190]: DEBUG nova.compute.manager [req-9f1a6f4c-7cb3-4ec2-bf42-e173ab98cef6 req-c6a815dc-3139-44fe-bf7e-e311486b6d27 service nova] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] Detach interface failed, port_id=5e4eb783-7e7c-4501-bf99-33472454f4ac, reason: Instance 0209c824-88a7-4976-83bf-8a72437f0cc2 could not be found. {{(pid=74190) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 18 12:00:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-1cf17b03-4355-4fe4-8ceb-b12102ff1dca tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:00:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-1cf17b03-4355-4fe4-8ceb-b12102ff1dca tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:00:37 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-1cf17b03-4355-4fe4-8ceb-b12102ff1dca tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 12:00:37 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-1cf17b03-4355-4fe4-8ceb-b12102ff1dca tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 12:00:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-1cf17b03-4355-4fe4-8ceb-b12102ff1dca tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.311s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:00:37 user nova-compute[74190]: INFO nova.scheduler.client.report [None req-1cf17b03-4355-4fe4-8ceb-b12102ff1dca tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Deleted allocations for instance 0209c824-88a7-4976-83bf-8a72437f0cc2
Oct 18 12:00:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-1cf17b03-4355-4fe4-8ceb-b12102ff1dca tempest-ServerActionsTestOtherA-1288544694 tempest-ServerActionsTestOtherA-1288544694-project-member] Lock "0209c824-88a7-4976-83bf-8a72437f0cc2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.008s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:00:37 user nova-compute[74190]: INFO nova.compute.manager [None req-57992924-35e7-40d7-997c-a635e61191ae tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] Unrescuing
Oct 18 12:00:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-57992924-35e7-40d7-997c-a635e61191ae tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Acquiring lock "refresh_cache-95ca0697-22b5-4109-868f-ca5556015a1f" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:00:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-57992924-35e7-40d7-997c-a635e61191ae tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Acquired lock "refresh_cache-95ca0697-22b5-4109-868f-ca5556015a1f" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:00:37 user nova-compute[74190]: DEBUG nova.network.neutron [None req-57992924-35e7-40d7-997c-a635e61191ae tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] Building network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 12:00:37 user nova-compute[74190]: DEBUG nova.compute.manager [req-e01e11bc-fc36-44b1-ab0d-4f1499ab9da7 req-f6d84f84-a051-48b6-b4f3-fbfaa0f95e27 service nova] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] Received event network-vif-plugged-5e4eb783-7e7c-4501-bf99-33472454f4ac {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:00:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-e01e11bc-fc36-44b1-ab0d-4f1499ab9da7 req-f6d84f84-a051-48b6-b4f3-fbfaa0f95e27 service nova] Acquiring lock "0209c824-88a7-4976-83bf-8a72437f0cc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:00:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-e01e11bc-fc36-44b1-ab0d-4f1499ab9da7 req-f6d84f84-a051-48b6-b4f3-fbfaa0f95e27 service nova] Lock "0209c824-88a7-4976-83bf-8a72437f0cc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:00:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-e01e11bc-fc36-44b1-ab0d-4f1499ab9da7 req-f6d84f84-a051-48b6-b4f3-fbfaa0f95e27 service nova] Lock "0209c824-88a7-4976-83bf-8a72437f0cc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:00:37 user nova-compute[74190]: DEBUG nova.compute.manager [req-e01e11bc-fc36-44b1-ab0d-4f1499ab9da7 req-f6d84f84-a051-48b6-b4f3-fbfaa0f95e27 service nova] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] No waiting events found dispatching network-vif-plugged-5e4eb783-7e7c-4501-bf99-33472454f4ac {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:00:37 user nova-compute[74190]: WARNING nova.compute.manager [req-e01e11bc-fc36-44b1-ab0d-4f1499ab9da7 req-f6d84f84-a051-48b6-b4f3-fbfaa0f95e27 service nova] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] Received unexpected event network-vif-plugged-5e4eb783-7e7c-4501-bf99-33472454f4ac for instance with vm_state deleted and task_state None.
Oct 18 12:00:37 user nova-compute[74190]: DEBUG nova.compute.manager [req-e01e11bc-fc36-44b1-ab0d-4f1499ab9da7 req-f6d84f84-a051-48b6-b4f3-fbfaa0f95e27 service nova] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] Received event network-vif-plugged-5e4eb783-7e7c-4501-bf99-33472454f4ac {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:00:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-e01e11bc-fc36-44b1-ab0d-4f1499ab9da7 req-f6d84f84-a051-48b6-b4f3-fbfaa0f95e27 service nova] Acquiring lock "0209c824-88a7-4976-83bf-8a72437f0cc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:00:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-e01e11bc-fc36-44b1-ab0d-4f1499ab9da7 req-f6d84f84-a051-48b6-b4f3-fbfaa0f95e27 service nova] Lock "0209c824-88a7-4976-83bf-8a72437f0cc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:00:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-e01e11bc-fc36-44b1-ab0d-4f1499ab9da7 req-f6d84f84-a051-48b6-b4f3-fbfaa0f95e27 service nova] Lock "0209c824-88a7-4976-83bf-8a72437f0cc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:00:37 user nova-compute[74190]: DEBUG nova.compute.manager [req-e01e11bc-fc36-44b1-ab0d-4f1499ab9da7 req-f6d84f84-a051-48b6-b4f3-fbfaa0f95e27 service nova] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] No waiting events found dispatching network-vif-plugged-5e4eb783-7e7c-4501-bf99-33472454f4ac {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:00:37 user nova-compute[74190]: WARNING nova.compute.manager [req-e01e11bc-fc36-44b1-ab0d-4f1499ab9da7 req-f6d84f84-a051-48b6-b4f3-fbfaa0f95e27 service nova] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] Received unexpected event network-vif-plugged-5e4eb783-7e7c-4501-bf99-33472454f4ac for instance with vm_state deleted and task_state None.
Oct 18 12:00:37 user nova-compute[74190]: DEBUG nova.compute.manager [req-e01e11bc-fc36-44b1-ab0d-4f1499ab9da7 req-f6d84f84-a051-48b6-b4f3-fbfaa0f95e27 service nova] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] Received event network-vif-plugged-5e4eb783-7e7c-4501-bf99-33472454f4ac {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:00:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-e01e11bc-fc36-44b1-ab0d-4f1499ab9da7 req-f6d84f84-a051-48b6-b4f3-fbfaa0f95e27 service nova] Acquiring lock "0209c824-88a7-4976-83bf-8a72437f0cc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:00:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-e01e11bc-fc36-44b1-ab0d-4f1499ab9da7 req-f6d84f84-a051-48b6-b4f3-fbfaa0f95e27 service nova] Lock "0209c824-88a7-4976-83bf-8a72437f0cc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:00:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-e01e11bc-fc36-44b1-ab0d-4f1499ab9da7 req-f6d84f84-a051-48b6-b4f3-fbfaa0f95e27 service nova] Lock "0209c824-88a7-4976-83bf-8a72437f0cc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:00:37 user nova-compute[74190]: DEBUG nova.compute.manager [req-e01e11bc-fc36-44b1-ab0d-4f1499ab9da7 req-f6d84f84-a051-48b6-b4f3-fbfaa0f95e27 service nova] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] No waiting events found dispatching network-vif-plugged-5e4eb783-7e7c-4501-bf99-33472454f4ac {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:00:37 user nova-compute[74190]: WARNING nova.compute.manager [req-e01e11bc-fc36-44b1-ab0d-4f1499ab9da7 req-f6d84f84-a051-48b6-b4f3-fbfaa0f95e27 service nova] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] Received unexpected event network-vif-plugged-5e4eb783-7e7c-4501-bf99-33472454f4ac for instance with vm_state deleted and task_state None.
Oct 18 12:00:37 user nova-compute[74190]: DEBUG nova.compute.manager [req-e01e11bc-fc36-44b1-ab0d-4f1499ab9da7 req-f6d84f84-a051-48b6-b4f3-fbfaa0f95e27 service nova] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] Received event network-vif-unplugged-5e4eb783-7e7c-4501-bf99-33472454f4ac {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:00:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-e01e11bc-fc36-44b1-ab0d-4f1499ab9da7 req-f6d84f84-a051-48b6-b4f3-fbfaa0f95e27 service nova] Acquiring lock "0209c824-88a7-4976-83bf-8a72437f0cc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:00:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-e01e11bc-fc36-44b1-ab0d-4f1499ab9da7 req-f6d84f84-a051-48b6-b4f3-fbfaa0f95e27 service nova] Lock "0209c824-88a7-4976-83bf-8a72437f0cc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:00:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-e01e11bc-fc36-44b1-ab0d-4f1499ab9da7 req-f6d84f84-a051-48b6-b4f3-fbfaa0f95e27 service nova] Lock "0209c824-88a7-4976-83bf-8a72437f0cc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:00:37 user nova-compute[74190]: DEBUG nova.compute.manager [req-e01e11bc-fc36-44b1-ab0d-4f1499ab9da7 req-f6d84f84-a051-48b6-b4f3-fbfaa0f95e27 service nova] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] No waiting events found dispatching network-vif-unplugged-5e4eb783-7e7c-4501-bf99-33472454f4ac {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:00:37 user nova-compute[74190]: WARNING nova.compute.manager [req-e01e11bc-fc36-44b1-ab0d-4f1499ab9da7 req-f6d84f84-a051-48b6-b4f3-fbfaa0f95e27 service nova] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] Received unexpected event network-vif-unplugged-5e4eb783-7e7c-4501-bf99-33472454f4ac for instance with vm_state deleted and task_state None.
Oct 18 12:00:37 user nova-compute[74190]: DEBUG nova.compute.manager [req-e01e11bc-fc36-44b1-ab0d-4f1499ab9da7 req-f6d84f84-a051-48b6-b4f3-fbfaa0f95e27 service nova] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] Received event network-vif-plugged-5e4eb783-7e7c-4501-bf99-33472454f4ac {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:00:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-e01e11bc-fc36-44b1-ab0d-4f1499ab9da7 req-f6d84f84-a051-48b6-b4f3-fbfaa0f95e27 service nova] Acquiring lock "0209c824-88a7-4976-83bf-8a72437f0cc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:00:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-e01e11bc-fc36-44b1-ab0d-4f1499ab9da7 req-f6d84f84-a051-48b6-b4f3-fbfaa0f95e27 service nova] Lock "0209c824-88a7-4976-83bf-8a72437f0cc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:00:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-e01e11bc-fc36-44b1-ab0d-4f1499ab9da7 req-f6d84f84-a051-48b6-b4f3-fbfaa0f95e27 service nova] Lock "0209c824-88a7-4976-83bf-8a72437f0cc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:00:37 user nova-compute[74190]: DEBUG nova.compute.manager [req-e01e11bc-fc36-44b1-ab0d-4f1499ab9da7 req-f6d84f84-a051-48b6-b4f3-fbfaa0f95e27 service nova] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] No waiting events found dispatching network-vif-plugged-5e4eb783-7e7c-4501-bf99-33472454f4ac {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:00:37 user nova-compute[74190]: WARNING nova.compute.manager [req-e01e11bc-fc36-44b1-ab0d-4f1499ab9da7 req-f6d84f84-a051-48b6-b4f3-fbfaa0f95e27 service nova] [instance: 0209c824-88a7-4976-83bf-8a72437f0cc2] Received unexpected event network-vif-plugged-5e4eb783-7e7c-4501-bf99-33472454f4ac for instance with vm_state deleted and task_state None.
Oct 18 12:00:37 user nova-compute[74190]: DEBUG nova.network.neutron [None req-57992924-35e7-40d7-997c-a635e61191ae tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] Updating instance_info_cache with network_info: [{"id": "58c81983-46ab-4026-b712-775ae319a09f", "address": "fa:16:3e:dd:c9:17", "network": {"id": "130f7948-11e4-49b4-9d4a-dffb2b48bdcd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595419292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ffa18c02b8a4117ab1ccc52aca64f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58c81983-46", "ovs_interfaceid": "58c81983-46ab-4026-b712-775ae319a09f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:00:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-57992924-35e7-40d7-997c-a635e61191ae tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Releasing lock "refresh_cache-95ca0697-22b5-4109-868f-ca5556015a1f" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:00:37 user nova-compute[74190]: DEBUG nova.objects.instance [None req-57992924-35e7-40d7-997c-a635e61191ae tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lazy-loading 'flavor' on Instance uuid 95ca0697-22b5-4109-868f-ca5556015a1f {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:00:38 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:00:38 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:00:38 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:00:38 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:00:38 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] Instance destroyed successfully.
Oct 18 12:00:38 user nova-compute[74190]: DEBUG nova.compute.manager [req-0a82f290-0894-4754-a7da-540ced88c850 req-e3425c1c-f7e9-4f52-9f39-c99c49b33f89 service nova] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] Received event network-vif-unplugged-58c81983-46ab-4026-b712-775ae319a09f {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:00:38 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-0a82f290-0894-4754-a7da-540ced88c850 req-e3425c1c-f7e9-4f52-9f39-c99c49b33f89 service nova] Acquiring lock "95ca0697-22b5-4109-868f-ca5556015a1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:00:38 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-0a82f290-0894-4754-a7da-540ced88c850 req-e3425c1c-f7e9-4f52-9f39-c99c49b33f89 service nova] Lock "95ca0697-22b5-4109-868f-ca5556015a1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:00:38 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-0a82f290-0894-4754-a7da-540ced88c850 req-e3425c1c-f7e9-4f52-9f39-c99c49b33f89 service nova] Lock "95ca0697-22b5-4109-868f-ca5556015a1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:00:38 user nova-compute[74190]: DEBUG nova.compute.manager [req-0a82f290-0894-4754-a7da-540ced88c850 req-e3425c1c-f7e9-4f52-9f39-c99c49b33f89 service nova] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] No waiting events found dispatching network-vif-unplugged-58c81983-46ab-4026-b712-775ae319a09f {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:00:38 user nova-compute[74190]: WARNING nova.compute.manager [req-0a82f290-0894-4754-a7da-540ced88c850 req-e3425c1c-f7e9-4f52-9f39-c99c49b33f89 service nova] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] Received unexpected event network-vif-unplugged-58c81983-46ab-4026-b712-775ae319a09f for instance with vm_state rescued and task_state unrescuing.
Oct 18 12:00:38 user nova-compute[74190]: DEBUG nova.compute.manager [req-0a82f290-0894-4754-a7da-540ced88c850 req-e3425c1c-f7e9-4f52-9f39-c99c49b33f89 service nova] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] Received event network-vif-plugged-58c81983-46ab-4026-b712-775ae319a09f {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:00:38 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-0a82f290-0894-4754-a7da-540ced88c850 req-e3425c1c-f7e9-4f52-9f39-c99c49b33f89 service nova] Acquiring lock "95ca0697-22b5-4109-868f-ca5556015a1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:00:38 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-0a82f290-0894-4754-a7da-540ced88c850 req-e3425c1c-f7e9-4f52-9f39-c99c49b33f89 service nova] Lock "95ca0697-22b5-4109-868f-ca5556015a1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:00:38 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-0a82f290-0894-4754-a7da-540ced88c850 req-e3425c1c-f7e9-4f52-9f39-c99c49b33f89 service nova] Lock "95ca0697-22b5-4109-868f-ca5556015a1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:00:38 user nova-compute[74190]: DEBUG nova.compute.manager [req-0a82f290-0894-4754-a7da-540ced88c850 req-e3425c1c-f7e9-4f52-9f39-c99c49b33f89 service nova] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] No waiting events found dispatching network-vif-plugged-58c81983-46ab-4026-b712-775ae319a09f {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:00:38 user nova-compute[74190]: WARNING nova.compute.manager [req-0a82f290-0894-4754-a7da-540ced88c850 req-e3425c1c-f7e9-4f52-9f39-c99c49b33f89 service nova] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] Received unexpected event network-vif-plugged-58c81983-46ab-4026-b712-775ae319a09f for instance with vm_state rescued and task_state unrescuing.
Oct 18 12:00:40 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:00:40 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:00:40 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:00:40 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:00:40 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:00:40 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:00:41 user nova-compute[74190]: DEBUG nova.compute.manager [req-c2d651a4-462f-467e-8edf-1c0fedac54ba req-76f93979-e963-40ff-bc75-990e79a00e9a service nova] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] Received event network-vif-plugged-58c81983-46ab-4026-b712-775ae319a09f {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:00:41 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-c2d651a4-462f-467e-8edf-1c0fedac54ba req-76f93979-e963-40ff-bc75-990e79a00e9a service nova] Acquiring lock "95ca0697-22b5-4109-868f-ca5556015a1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:00:41 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-c2d651a4-462f-467e-8edf-1c0fedac54ba req-76f93979-e963-40ff-bc75-990e79a00e9a service nova] Lock "95ca0697-22b5-4109-868f-ca5556015a1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:00:41 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-c2d651a4-462f-467e-8edf-1c0fedac54ba req-76f93979-e963-40ff-bc75-990e79a00e9a service nova] Lock "95ca0697-22b5-4109-868f-ca5556015a1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:00:41 user nova-compute[74190]: DEBUG nova.compute.manager [req-c2d651a4-462f-467e-8edf-1c0fedac54ba req-76f93979-e963-40ff-bc75-990e79a00e9a service nova] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] No waiting events found dispatching network-vif-plugged-58c81983-46ab-4026-b712-775ae319a09f {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:00:41 user nova-compute[74190]: WARNING nova.compute.manager [req-c2d651a4-462f-467e-8edf-1c0fedac54ba req-76f93979-e963-40ff-bc75-990e79a00e9a service nova] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] Received unexpected event network-vif-plugged-58c81983-46ab-4026-b712-775ae319a09f for instance with vm_state rescued and task_state unrescuing.
Oct 18 12:00:41 user nova-compute[74190]: DEBUG nova.compute.manager [req-c2d651a4-462f-467e-8edf-1c0fedac54ba req-76f93979-e963-40ff-bc75-990e79a00e9a service nova] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] Received event network-vif-plugged-58c81983-46ab-4026-b712-775ae319a09f {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:00:41 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-c2d651a4-462f-467e-8edf-1c0fedac54ba req-76f93979-e963-40ff-bc75-990e79a00e9a service nova] Acquiring lock "95ca0697-22b5-4109-868f-ca5556015a1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:00:41 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-c2d651a4-462f-467e-8edf-1c0fedac54ba req-76f93979-e963-40ff-bc75-990e79a00e9a service nova] Lock "95ca0697-22b5-4109-868f-ca5556015a1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:00:41 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-c2d651a4-462f-467e-8edf-1c0fedac54ba req-76f93979-e963-40ff-bc75-990e79a00e9a service nova] Lock "95ca0697-22b5-4109-868f-ca5556015a1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:00:41 user nova-compute[74190]: DEBUG nova.compute.manager [req-c2d651a4-462f-467e-8edf-1c0fedac54ba req-76f93979-e963-40ff-bc75-990e79a00e9a service nova] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] No waiting events found dispatching network-vif-plugged-58c81983-46ab-4026-b712-775ae319a09f {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:00:41 user nova-compute[74190]: WARNING nova.compute.manager [req-c2d651a4-462f-467e-8edf-1c0fedac54ba req-76f93979-e963-40ff-bc75-990e79a00e9a service nova] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] Received unexpected event network-vif-plugged-58c81983-46ab-4026-b712-775ae319a09f for instance with vm_state rescued and task_state unrescuing.
Oct 18 12:00:41 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:00:42 user nova-compute[74190]: DEBUG nova.compute.manager [None req-57992924-35e7-40d7-997c-a635e61191ae tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] Checking state {{(pid=74190) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 12:00:45 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:00:46 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:00:51 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:00:51 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:00:51 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74190) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 12:00:51 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:00:51 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:00:51 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:00:56 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:00:57 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-7c96fa68-8e5b-4195-a806-57c0f10317e5 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Acquiring lock "dcea54d1-e5e8-4079-8c59-499c82404088" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:00:57 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-7c96fa68-8e5b-4195-a806-57c0f10317e5 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Lock "dcea54d1-e5e8-4079-8c59-499c82404088" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:00:57 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-7c96fa68-8e5b-4195-a806-57c0f10317e5 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Acquiring lock "dcea54d1-e5e8-4079-8c59-499c82404088-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:00:57 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-7c96fa68-8e5b-4195-a806-57c0f10317e5 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Lock "dcea54d1-e5e8-4079-8c59-499c82404088-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:00:57 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-7c96fa68-8e5b-4195-a806-57c0f10317e5 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Lock "dcea54d1-e5e8-4079-8c59-499c82404088-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:00:57 user nova-compute[74190]: INFO nova.compute.manager [None req-7c96fa68-8e5b-4195-a806-57c0f10317e5 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] [instance: dcea54d1-e5e8-4079-8c59-499c82404088] Terminating instance
Oct 18 12:00:57 user nova-compute[74190]: DEBUG nova.compute.manager [None req-7c96fa68-8e5b-4195-a806-57c0f10317e5 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] [instance: dcea54d1-e5e8-4079-8c59-499c82404088] Start destroying the instance on the hypervisor. {{(pid=74190) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 12:00:57 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:00:57 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:00:57 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:00:57 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:00:57 user nova-compute[74190]: DEBUG nova.compute.manager [req-02b1a557-79d8-4bfb-9961-1088f143f197 req-0d56adcf-7109-4c06-9a81-b61f87766d73 service nova] [instance: dcea54d1-e5e8-4079-8c59-499c82404088] Received event network-vif-unplugged-8f38bbc7-5909-4f37-a35b-aeba01946e4d {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:00:57 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-02b1a557-79d8-4bfb-9961-1088f143f197 req-0d56adcf-7109-4c06-9a81-b61f87766d73 service nova] Acquiring lock "dcea54d1-e5e8-4079-8c59-499c82404088-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:00:57 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-02b1a557-79d8-4bfb-9961-1088f143f197 req-0d56adcf-7109-4c06-9a81-b61f87766d73 service nova] Lock "dcea54d1-e5e8-4079-8c59-499c82404088-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:00:57 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-02b1a557-79d8-4bfb-9961-1088f143f197 req-0d56adcf-7109-4c06-9a81-b61f87766d73 service nova] Lock "dcea54d1-e5e8-4079-8c59-499c82404088-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:00:57 user nova-compute[74190]: DEBUG nova.compute.manager [req-02b1a557-79d8-4bfb-9961-1088f143f197 req-0d56adcf-7109-4c06-9a81-b61f87766d73 service nova] [instance: dcea54d1-e5e8-4079-8c59-499c82404088] No waiting events found dispatching network-vif-unplugged-8f38bbc7-5909-4f37-a35b-aeba01946e4d {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:00:57 user nova-compute[74190]: DEBUG nova.compute.manager [req-02b1a557-79d8-4bfb-9961-1088f143f197 req-0d56adcf-7109-4c06-9a81-b61f87766d73 service nova] [instance: dcea54d1-e5e8-4079-8c59-499c82404088] Received event network-vif-unplugged-8f38bbc7-5909-4f37-a35b-aeba01946e4d for instance with task_state deleting. {{(pid=74190) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 12:00:57 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: dcea54d1-e5e8-4079-8c59-499c82404088] Instance destroyed successfully.
Oct 18 12:00:57 user nova-compute[74190]: DEBUG nova.objects.instance [None req-7c96fa68-8e5b-4195-a806-57c0f10317e5 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Lazy-loading 'resources' on Instance uuid dcea54d1-e5e8-4079-8c59-499c82404088 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:00:57 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-7c96fa68-8e5b-4195-a806-57c0f10317e5 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:59:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1466284603',display_name='tempest-VolumesActionsTest-instance-1466284603',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1466284603',id=30,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-18T11:59:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='62ed99f026894d569a13d0854fab0a17',ramdisk_id='',reservation_id='r-tmjgl0z3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-563901414',owner_user_name='tempest-VolumesActionsTest-563901414-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T11:59:14Z,user_data=None,user_id='b0ef25ad27f64ac8a423b867e0f7b836',uuid=dcea54d1-e5e8-4079-8c59-499c82404088,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8f38bbc7-5909-4f37-a35b-aeba01946e4d", "address": "fa:16:3e:1e:d7:b2", "network": {"id": "d143b91a-fbcd-40d0-b199-381c523b8a0c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-175467972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62ed99f026894d569a13d0854fab0a17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f38bbc7-59", "ovs_interfaceid": "8f38bbc7-5909-4f37-a35b-aeba01946e4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 12:00:57 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-7c96fa68-8e5b-4195-a806-57c0f10317e5 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Converting VIF {"id": "8f38bbc7-5909-4f37-a35b-aeba01946e4d", "address": "fa:16:3e:1e:d7:b2", "network": {"id": "d143b91a-fbcd-40d0-b199-381c523b8a0c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-175467972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62ed99f026894d569a13d0854fab0a17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f38bbc7-59", "ovs_interfaceid": "8f38bbc7-5909-4f37-a35b-aeba01946e4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 12:00:57 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-7c96fa68-8e5b-4195-a806-57c0f10317e5 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:d7:b2,bridge_name='br-int',has_traffic_filtering=True,id=8f38bbc7-5909-4f37-a35b-aeba01946e4d,network=Network(d143b91a-fbcd-40d0-b199-381c523b8a0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f38bbc7-59') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 12:00:57 user nova-compute[74190]: DEBUG os_vif [None req-7c96fa68-8e5b-4195-a806-57c0f10317e5 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:d7:b2,bridge_name='br-int',has_traffic_filtering=True,id=8f38bbc7-5909-4f37-a35b-aeba01946e4d,network=Network(d143b91a-fbcd-40d0-b199-381c523b8a0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f38bbc7-59') {{(pid=74190) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 12:00:57 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:00:57 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8f38bbc7-59, bridge=br-int, if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:00:57 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:00:57 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:00:57 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:00:57 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6bc78b84-a2c3-435a-8693-1bc40a50eb02) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:00:57 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:00:57 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:00:57 user nova-compute[74190]: INFO os_vif [None req-7c96fa68-8e5b-4195-a806-57c0f10317e5 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:d7:b2,bridge_name='br-int',has_traffic_filtering=True,id=8f38bbc7-5909-4f37-a35b-aeba01946e4d,network=Network(d143b91a-fbcd-40d0-b199-381c523b8a0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f38bbc7-59')
Oct 18 12:00:57 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-7c96fa68-8e5b-4195-a806-57c0f10317e5 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] [instance: dcea54d1-e5e8-4079-8c59-499c82404088] Deleting instance files /opt/stack/data/nova/instances/dcea54d1-e5e8-4079-8c59-499c82404088_del
Oct 18 12:00:57 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-7c96fa68-8e5b-4195-a806-57c0f10317e5 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] [instance: dcea54d1-e5e8-4079-8c59-499c82404088] Deletion of /opt/stack/data/nova/instances/dcea54d1-e5e8-4079-8c59-499c82404088_del complete
Oct 18 12:00:57 user nova-compute[74190]: INFO nova.compute.manager [None req-7c96fa68-8e5b-4195-a806-57c0f10317e5 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] [instance: dcea54d1-e5e8-4079-8c59-499c82404088] Took 0.66 seconds to destroy the instance on the hypervisor.
Oct 18 12:00:57 user nova-compute[74190]: DEBUG oslo.service.loopingcall [None req-7c96fa68-8e5b-4195-a806-57c0f10317e5 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74190) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 12:00:57 user nova-compute[74190]: DEBUG nova.compute.manager [-] [instance: dcea54d1-e5e8-4079-8c59-499c82404088] Deallocating network for instance {{(pid=74190) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 12:00:57 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: dcea54d1-e5e8-4079-8c59-499c82404088] deallocate_for_instance() {{(pid=74190) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 12:00:58 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: dcea54d1-e5e8-4079-8c59-499c82404088] Updating instance_info_cache with network_info: [] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:00:58 user nova-compute[74190]: INFO nova.compute.manager [-] [instance: dcea54d1-e5e8-4079-8c59-499c82404088] Took 0.47 seconds to deallocate network for instance.
Oct 18 12:00:58 user nova-compute[74190]: DEBUG nova.compute.manager [req-ac8c7ed8-a7e2-4c96-a75d-70c89602a3ec req-e1215100-3570-4853-9440-ea0f727acee0 service nova] [instance: dcea54d1-e5e8-4079-8c59-499c82404088] Received event network-vif-deleted-8f38bbc7-5909-4f37-a35b-aeba01946e4d {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:00:58 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-7c96fa68-8e5b-4195-a806-57c0f10317e5 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:00:58 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-7c96fa68-8e5b-4195-a806-57c0f10317e5 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:00:58 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-7c96fa68-8e5b-4195-a806-57c0f10317e5 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 12:00:58 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-7c96fa68-8e5b-4195-a806-57c0f10317e5 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 12:00:58 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-7c96fa68-8e5b-4195-a806-57c0f10317e5 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.257s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:00:58 user nova-compute[74190]: INFO nova.scheduler.client.report [None req-7c96fa68-8e5b-4195-a806-57c0f10317e5 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Deleted allocations for instance dcea54d1-e5e8-4079-8c59-499c82404088
Oct 18 12:00:58 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-7c96fa68-8e5b-4195-a806-57c0f10317e5 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Lock "dcea54d1-e5e8-4079-8c59-499c82404088" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.618s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:00:59 user nova-compute[74190]: DEBUG nova.compute.manager [req-6edcc130-c8ad-4137-90bd-9a3d14daa6e5 req-b4e096e8-5e3e-4de5-aa12-37d55dd0aed1 service nova] [instance: dcea54d1-e5e8-4079-8c59-499c82404088] Received event network-vif-plugged-8f38bbc7-5909-4f37-a35b-aeba01946e4d {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:00:59 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-6edcc130-c8ad-4137-90bd-9a3d14daa6e5 req-b4e096e8-5e3e-4de5-aa12-37d55dd0aed1 service nova] Acquiring lock "dcea54d1-e5e8-4079-8c59-499c82404088-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:00:59 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-6edcc130-c8ad-4137-90bd-9a3d14daa6e5 req-b4e096e8-5e3e-4de5-aa12-37d55dd0aed1 service nova] Lock "dcea54d1-e5e8-4079-8c59-499c82404088-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:00:59 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-6edcc130-c8ad-4137-90bd-9a3d14daa6e5 req-b4e096e8-5e3e-4de5-aa12-37d55dd0aed1 service nova] Lock "dcea54d1-e5e8-4079-8c59-499c82404088-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:00:59 user nova-compute[74190]: DEBUG nova.compute.manager [req-6edcc130-c8ad-4137-90bd-9a3d14daa6e5 req-b4e096e8-5e3e-4de5-aa12-37d55dd0aed1 service nova] [instance: dcea54d1-e5e8-4079-8c59-499c82404088] No waiting events found dispatching network-vif-plugged-8f38bbc7-5909-4f37-a35b-aeba01946e4d {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:00:59 user nova-compute[74190]: WARNING nova.compute.manager [req-6edcc130-c8ad-4137-90bd-9a3d14daa6e5 req-b4e096e8-5e3e-4de5-aa12-37d55dd0aed1 service nova] [instance: dcea54d1-e5e8-4079-8c59-499c82404088] Received unexpected event network-vif-plugged-8f38bbc7-5909-4f37-a35b-aeba01946e4d for instance with vm_state deleted and task_state None.
Oct 18 12:00:59 user nova-compute[74190]: INFO nova.compute.manager [None req-c8c161a9-9fe6-483f-b014-fc337e344c99 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Rescuing
Oct 18 12:00:59 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-c8c161a9-9fe6-483f-b014-fc337e344c99 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Acquiring lock "refresh_cache-0382820d-a678-4593-85df-168f42fc4ce4" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:00:59 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-c8c161a9-9fe6-483f-b014-fc337e344c99 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Acquired lock "refresh_cache-0382820d-a678-4593-85df-168f42fc4ce4" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:00:59 user nova-compute[74190]: DEBUG nova.network.neutron [None req-c8c161a9-9fe6-483f-b014-fc337e344c99 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Building network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 12:01:00 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:01:00 user nova-compute[74190]: DEBUG nova.network.neutron [None req-c8c161a9-9fe6-483f-b014-fc337e344c99 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Updating instance_info_cache with network_info: [{"id": "a32b81a2-7b02-48ed-9550-d392be5e221e", "address": "fa:16:3e:e7:d8:e5", "network": {"id": "c2dbbd24-f1d2-47a2-835f-0f9b24b585f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-920140900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d994366010142519ff367fa7ca77e61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa32b81a2-7b", "ovs_interfaceid": "a32b81a2-7b02-48ed-9550-d392be5e221e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:01:00 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-c8c161a9-9fe6-483f-b014-fc337e344c99 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Releasing lock "refresh_cache-0382820d-a678-4593-85df-168f42fc4ce4" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:01:00 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:01:00 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:01:00 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:01:00 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:01:01 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Instance destroyed successfully.
Oct 18 12:01:01 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-c8c161a9-9fe6-483f-b014-fc337e344c99 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Attempting a stable device rescue
Oct 18 12:01:01 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-c8c161a9-9fe6-483f-b014-fc337e344c99 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74190) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 18 12:01:01 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-c8c161a9-9fe6-483f-b014-fc337e344c99 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Instance directory exists: not creating {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 18 12:01:01 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-c8c161a9-9fe6-483f-b014-fc337e344c99 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Creating image(s)
Oct 18 12:01:01 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-c8c161a9-9fe6-483f-b014-fc337e344c99 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Acquiring lock "/opt/stack/data/nova/instances/0382820d-a678-4593-85df-168f42fc4ce4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:01:01 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-c8c161a9-9fe6-483f-b014-fc337e344c99 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lock "/opt/stack/data/nova/instances/0382820d-a678-4593-85df-168f42fc4ce4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:01:01 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-c8c161a9-9fe6-483f-b014-fc337e344c99 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lock "/opt/stack/data/nova/instances/0382820d-a678-4593-85df-168f42fc4ce4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:01:01 user nova-compute[74190]: DEBUG nova.objects.instance [None req-c8c161a9-9fe6-483f-b014-fc337e344c99 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0382820d-a678-4593-85df-168f42fc4ce4 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:01:01 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-c8c161a9-9fe6-483f-b014-fc337e344c99 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Acquiring lock "82d720dd03e4ba5cc15ec2f05bb837cc27aa8ee4" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:01:01 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-c8c161a9-9fe6-483f-b014-fc337e344c99 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lock "82d720dd03e4ba5cc15ec2f05bb837cc27aa8ee4" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:01:01 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-c8c161a9-9fe6-483f-b014-fc337e344c99 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82d720dd03e4ba5cc15ec2f05bb837cc27aa8ee4.part --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:01:01 user nova-compute[74190]: DEBUG nova.compute.manager [req-ed520bdc-0ac3-4cdb-90e9-5db47dc630ec req-0da7566e-15b1-4d63-8932-601498f5375b service nova] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Received event network-vif-unplugged-a32b81a2-7b02-48ed-9550-d392be5e221e {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:01:01 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-ed520bdc-0ac3-4cdb-90e9-5db47dc630ec req-0da7566e-15b1-4d63-8932-601498f5375b service nova] Acquiring lock "0382820d-a678-4593-85df-168f42fc4ce4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:01:01 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-ed520bdc-0ac3-4cdb-90e9-5db47dc630ec req-0da7566e-15b1-4d63-8932-601498f5375b service nova] Lock "0382820d-a678-4593-85df-168f42fc4ce4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:01:01 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-ed520bdc-0ac3-4cdb-90e9-5db47dc630ec req-0da7566e-15b1-4d63-8932-601498f5375b service nova] Lock "0382820d-a678-4593-85df-168f42fc4ce4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:01:01 user nova-compute[74190]: DEBUG nova.compute.manager [req-ed520bdc-0ac3-4cdb-90e9-5db47dc630ec req-0da7566e-15b1-4d63-8932-601498f5375b service nova] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] No waiting events found dispatching network-vif-unplugged-a32b81a2-7b02-48ed-9550-d392be5e221e {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:01:01 user nova-compute[74190]: WARNING nova.compute.manager [req-ed520bdc-0ac3-4cdb-90e9-5db47dc630ec req-0da7566e-15b1-4d63-8932-601498f5375b service nova] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Received unexpected event network-vif-unplugged-a32b81a2-7b02-48ed-9550-d392be5e221e for instance with vm_state active and task_state rescuing.
Oct 18 12:01:01 user nova-compute[74190]: DEBUG nova.compute.manager [req-ed520bdc-0ac3-4cdb-90e9-5db47dc630ec req-0da7566e-15b1-4d63-8932-601498f5375b service nova] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Received event network-vif-plugged-a32b81a2-7b02-48ed-9550-d392be5e221e {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:01:01 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-ed520bdc-0ac3-4cdb-90e9-5db47dc630ec req-0da7566e-15b1-4d63-8932-601498f5375b service nova] Acquiring lock "0382820d-a678-4593-85df-168f42fc4ce4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:01:01 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-ed520bdc-0ac3-4cdb-90e9-5db47dc630ec req-0da7566e-15b1-4d63-8932-601498f5375b service nova] Lock "0382820d-a678-4593-85df-168f42fc4ce4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:01:01 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-ed520bdc-0ac3-4cdb-90e9-5db47dc630ec req-0da7566e-15b1-4d63-8932-601498f5375b service nova] Lock "0382820d-a678-4593-85df-168f42fc4ce4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:01:01 user nova-compute[74190]: DEBUG nova.compute.manager [req-ed520bdc-0ac3-4cdb-90e9-5db47dc630ec req-0da7566e-15b1-4d63-8932-601498f5375b service nova] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] No waiting events found dispatching network-vif-plugged-a32b81a2-7b02-48ed-9550-d392be5e221e {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:01:01 user nova-compute[74190]: WARNING nova.compute.manager [req-ed520bdc-0ac3-4cdb-90e9-5db47dc630ec req-0da7566e-15b1-4d63-8932-601498f5375b service nova] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Received unexpected event network-vif-plugged-a32b81a2-7b02-48ed-9550-d392be5e221e for instance with vm_state active and task_state rescuing.
Oct 18 12:01:02 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:01:02 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:01:02 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-c8c161a9-9fe6-483f-b014-fc337e344c99 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82d720dd03e4ba5cc15ec2f05bb837cc27aa8ee4.part --force-share --output=json" returned: 0 in 0.176s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:01:02 user nova-compute[74190]: DEBUG nova.virt.images [None req-c8c161a9-9fe6-483f-b014-fc337e344c99 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] f2d768fc-3456-40dd-bd91-389eaffe753f was qcow2, converting to raw {{(pid=74190) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 18 12:01:02 user nova-compute[74190]: DEBUG nova.privsep.utils [None req-c8c161a9-9fe6-483f-b014-fc337e344c99 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74190) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 18 12:01:02 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-c8c161a9-9fe6-483f-b014-fc337e344c99 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/82d720dd03e4ba5cc15ec2f05bb837cc27aa8ee4.part /opt/stack/data/nova/instances/_base/82d720dd03e4ba5cc15ec2f05bb837cc27aa8ee4.converted {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:01:02 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-c8c161a9-9fe6-483f-b014-fc337e344c99 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/82d720dd03e4ba5cc15ec2f05bb837cc27aa8ee4.part /opt/stack/data/nova/instances/_base/82d720dd03e4ba5cc15ec2f05bb837cc27aa8ee4.converted" returned: 0 in 0.466s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:01:02 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-c8c161a9-9fe6-483f-b014-fc337e344c99 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82d720dd03e4ba5cc15ec2f05bb837cc27aa8ee4.converted --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:01:02 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-c8c161a9-9fe6-483f-b014-fc337e344c99 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82d720dd03e4ba5cc15ec2f05bb837cc27aa8ee4.converted --force-share --output=json" returned: 0 in 0.172s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:01:02 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-c8c161a9-9fe6-483f-b014-fc337e344c99 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lock "82d720dd03e4ba5cc15ec2f05bb837cc27aa8ee4" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.690s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:01:02 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-c8c161a9-9fe6-483f-b014-fc337e344c99 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Acquiring lock "82d720dd03e4ba5cc15ec2f05bb837cc27aa8ee4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:01:02 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-c8c161a9-9fe6-483f-b014-fc337e344c99 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lock "82d720dd03e4ba5cc15ec2f05bb837cc27aa8ee4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:01:02 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-c8c161a9-9fe6-483f-b014-fc337e344c99 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82d720dd03e4ba5cc15ec2f05bb837cc27aa8ee4 --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:01:02 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:01:02 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-c8c161a9-9fe6-483f-b014-fc337e344c99 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82d720dd03e4ba5cc15ec2f05bb837cc27aa8ee4 --force-share --output=json" returned: 0 in 0.167s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:01:02 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-c8c161a9-9fe6-483f-b014-fc337e344c99 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82d720dd03e4ba5cc15ec2f05bb837cc27aa8ee4,backing_fmt=raw /opt/stack/data/nova/instances/0382820d-a678-4593-85df-168f42fc4ce4/disk.rescue {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:01:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-c8c161a9-9fe6-483f-b014-fc337e344c99 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82d720dd03e4ba5cc15ec2f05bb837cc27aa8ee4,backing_fmt=raw /opt/stack/data/nova/instances/0382820d-a678-4593-85df-168f42fc4ce4/disk.rescue" returned: 0 in 0.044s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:01:03 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-c8c161a9-9fe6-483f-b014-fc337e344c99 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lock "82d720dd03e4ba5cc15ec2f05bb837cc27aa8ee4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.217s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:01:03 user nova-compute[74190]: DEBUG nova.objects.instance [None req-c8c161a9-9fe6-483f-b014-fc337e344c99 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lazy-loading 'migration_context' on Instance uuid 0382820d-a678-4593-85df-168f42fc4ce4 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:01:03 user nova-compute[74190]: DEBUG nova.objects.base [None req-c8c161a9-9fe6-483f-b014-fc337e344c99 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Object Instance<0382820d-a678-4593-85df-168f42fc4ce4> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74190) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 12:01:03 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-c8c161a9-9fe6-483f-b014-fc337e344c99 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Created local disks {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 12:01:03 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-c8c161a9-9fe6-483f-b014-fc337e344c99 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Start _get_guest_xml network_info=[{"id": "a32b81a2-7b02-48ed-9550-d392be5e221e", "address": "fa:16:3e:e7:d8:e5", "network": {"id": "c2dbbd24-f1d2-47a2-835f-0f9b24b585f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-920140900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-920140900-network", "vif_mac": "fa:16:3e:e7:d8:e5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d994366010142519ff367fa7ca77e61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa32b81a2-7b", "ovs_interfaceid": "a32b81a2-7b02-48ed-9550-d392be5e221e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f2d768fc-3456-40dd-bd91-389eaffe753f', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OucnFekJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '0382820d-a678-4593-85df-168f42fc4ce4', 'attached_at': '', 'detached_at': '', 'volume_id': 'e27e2099-8328-4194-b582-65ca0cdad07f', 'serial': 'e27e2099-8328-4194-b582-65ca0cdad07f'}, 'delete_on_termination': False, 'guest_format': None, 'attachment_id': 'f776cc27-fc43-47e4-959d-8c312a1a7aa8', 'volume_type': None} {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 12:01:03 user nova-compute[74190]: DEBUG nova.objects.instance [None req-c8c161a9-9fe6-483f-b014-fc337e344c99 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lazy-loading 'resources' on Instance uuid 0382820d-a678-4593-85df-168f42fc4ce4 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:01:03 user nova-compute[74190]: DEBUG nova.objects.base [None req-c8c161a9-9fe6-483f-b014-fc337e344c99 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Object Instance<0382820d-a678-4593-85df-168f42fc4ce4> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74190) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 12:01:03 user nova-compute[74190]: DEBUG nova.objects.instance [None req-c8c161a9-9fe6-483f-b014-fc337e344c99 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lazy-loading 'numa_topology' on Instance uuid 0382820d-a678-4593-85df-168f42fc4ce4 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:01:03 user nova-compute[74190]: DEBUG nova.objects.base [None req-c8c161a9-9fe6-483f-b014-fc337e344c99 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Object Instance<0382820d-a678-4593-85df-168f42fc4ce4> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74190) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 12:01:03 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-c8c161a9-9fe6-483f-b014-fc337e344c99 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:01:03 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-c8c161a9-9fe6-483f-b014-fc337e344c99 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:01:03 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-c8c161a9-9fe6-483f-b014-fc337e344c99 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 12:01:03 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-c8c161a9-9fe6-483f-b014-fc337e344c99 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] CPU controller missing on host. {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 12:01:03 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-c8c161a9-9fe6-483f-b014-fc337e344c99 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 12:01:03 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-c8c161a9-9fe6-483f-b014-fc337e344c99 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] CPU controller found on host. {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 12:01:03 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-c8c161a9-9fe6-483f-b014-fc337e344c99 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74190) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 12:01:03 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-c8c161a9-9fe6-483f-b014-fc337e344c99 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T11:37:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 12:01:03 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-c8c161a9-9fe6-483f-b014-fc337e344c99 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Flavor limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 12:01:03 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-c8c161a9-9fe6-483f-b014-fc337e344c99 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Image limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 12:01:03 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-c8c161a9-9fe6-483f-b014-fc337e344c99 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Flavor pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 12:01:03 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-c8c161a9-9fe6-483f-b014-fc337e344c99 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Image pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 12:01:03 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-c8c161a9-9fe6-483f-b014-fc337e344c99 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 12:01:03 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-c8c161a9-9fe6-483f-b014-fc337e344c99 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 12:01:03 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-c8c161a9-9fe6-483f-b014-fc337e344c99 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 12:01:03 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-c8c161a9-9fe6-483f-b014-fc337e344c99 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Got 1 possible topologies {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 12:01:03 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-c8c161a9-9fe6-483f-b014-fc337e344c99 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 12:01:03 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-c8c161a9-9fe6-483f-b014-fc337e344c99 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 12:01:03 user nova-compute[74190]: DEBUG nova.objects.instance [None req-c8c161a9-9fe6-483f-b014-fc337e344c99 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0382820d-a678-4593-85df-168f42fc4ce4 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:01:03 user nova-compute[74190]: DEBUG nova.objects.base [None req-c8c161a9-9fe6-483f-b014-fc337e344c99 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Object Instance<0382820d-a678-4593-85df-168f42fc4ce4> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74190) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 12:01:03 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8c161a9-9fe6-483f-b014-fc337e344c99 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Calling os-brick to attach iSCSI Volume {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 12:01:03 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c161a9-9fe6-483f-b014-fc337e344c99 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OucnFekJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 12:01:03 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-c8c161a9-9fe6-483f-b014-fc337e344c99 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 12:01:03 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-c8c161a9-9fe6-483f-b014-fc337e344c99 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 12:01:03 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-c8c161a9-9fe6-483f-b014-fc337e344c99 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 12:01:03 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-c8c161a9-9fe6-483f-b014-fc337e344c99 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 12:01:03 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-c8c161a9-9fe6-483f-b014-fc337e344c99 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 12:01:03 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-c8c161a9-9fe6-483f-b014-fc337e344c99 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 12:01:03 user nova-compute[74190]: INFO os_brick.initiator.connectors.iscsi [None req-c8c161a9-9fe6-483f-b014-fc337e344c99 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 12:01:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f -p 172.16.0.220:3260 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:01:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:01:03 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[16099c16-6069-4d89-9398-cf239b641c88]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = OucnFekJ\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:01:03 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c161a9-9fe6-483f-b014-fc337e344c99 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Oct 18 12:01:03 user nova-compute[74190]: node.name = iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f
Oct 18 12:01:03 user nova-compute[74190]: node.tpgt = -1
Oct 18 12:01:03 user nova-compute[74190]: node.startup = automatic
Oct 18 12:01:03 user nova-compute[74190]: node.leading_login = No
Oct 18 12:01:03 user nova-compute[74190]: iface.iscsi_ifacename = default
Oct 18 12:01:03 user nova-compute[74190]: iface.net_ifacename = <empty>
Oct 18 12:01:03 user nova-compute[74190]: iface.ipaddress = <empty>
Oct 18 12:01:03 user nova-compute[74190]: iface.prefix_len = 0
Oct 18 12:01:03 user nova-compute[74190]: iface.hwaddress = <empty>
Oct 18 12:01:03 user nova-compute[74190]: iface.transport_name = tcp
Oct 18 12:01:03 user nova-compute[74190]: iface.initiatorname = <empty>
Oct 18 12:01:03 user nova-compute[74190]: iface.state = <empty>
Oct 18 12:01:03 user nova-compute[74190]: iface.vlan_id = 0
Oct 18 12:01:03 user nova-compute[74190]: iface.vlan_priority = 0
Oct 18 12:01:03 user nova-compute[74190]: iface.vlan_state = <empty>
Oct 18 12:01:03 user nova-compute[74190]: iface.iface_num = 0
Oct 18 12:01:03 user nova-compute[74190]: iface.mtu = 0
Oct 18 12:01:03 user nova-compute[74190]: iface.port = 0
Oct 18 12:01:03 user nova-compute[74190]: iface.bootproto = <empty>
Oct 18 12:01:03 user nova-compute[74190]: iface.subnet_mask = <empty>
Oct 18 12:01:03 user nova-compute[74190]: iface.gateway = <empty>
Oct 18 12:01:03 user nova-compute[74190]: iface.dhcp_alt_client_id_state = <empty>
Oct 18 12:01:03 user nova-compute[74190]: iface.dhcp_alt_client_id = <empty>
Oct 18 12:01:03 user nova-compute[74190]: iface.dhcp_dns = <empty>
Oct 18 12:01:03 user nova-compute[74190]: iface.dhcp_learn_iqn = <empty>
Oct 18 12:01:03 user nova-compute[74190]: iface.dhcp_req_vendor_id_state = <empty>
Oct 18 12:01:03 user nova-compute[74190]: iface.dhcp_vendor_id_state = <empty>
Oct 18 12:01:03 user nova-compute[74190]: iface.dhcp_vendor_id = <empty>
Oct 18 12:01:03 user nova-compute[74190]: iface.dhcp_slp_da = <empty>
Oct 18 12:01:03 user nova-compute[74190]: iface.fragmentation = <empty>
Oct 18 12:01:03 user nova-compute[74190]: iface.gratuitous_arp = <empty>
Oct 18 12:01:03 user nova-compute[74190]: iface.incoming_forwarding = <empty>
Oct 18 12:01:03 user nova-compute[74190]: iface.tos_state = <empty>
Oct 18 12:01:03 user nova-compute[74190]: iface.tos = 0
Oct 18 12:01:03 user nova-compute[74190]: iface.ttl = 0
Oct 18 12:01:03 user nova-compute[74190]: iface.delayed_ack = <empty>
Oct 18 12:01:03 user nova-compute[74190]: iface.tcp_nagle = <empty>
Oct 18 12:01:03 user nova-compute[74190]: iface.tcp_wsf_state = <empty>
Oct 18 12:01:03 user nova-compute[74190]: iface.tcp_wsf = 0
Oct 18 12:01:03 user nova-compute[74190]: iface.tcp_timer_scale = 0
Oct 18 12:01:03 user nova-compute[74190]: iface.tcp_timestamp = <empty>
Oct 18 12:01:03 user nova-compute[74190]: iface.redirect = <empty>
Oct 18 12:01:03 user nova-compute[74190]: iface.def_task_mgmt_timeout = 0
Oct 18 12:01:03 user nova-compute[74190]: iface.header_digest = <empty>
Oct 18 12:01:03 user nova-compute[74190]: iface.data_digest = <empty>
Oct 18 12:01:03 user nova-compute[74190]: iface.immediate_data = <empty>
Oct 18 12:01:03 user nova-compute[74190]: iface.initial_r2t = <empty>
Oct 18 12:01:03 user nova-compute[74190]: iface.data_seq_inorder = <empty>
Oct 18 12:01:03 user nova-compute[74190]: iface.data_pdu_inorder = <empty>
Oct 18 12:01:03 user nova-compute[74190]: iface.erl = 0
Oct 18 12:01:03 user nova-compute[74190]: iface.max_receive_data_len = 0
Oct 18 12:01:03 user nova-compute[74190]: iface.first_burst_len = 0
Oct 18 12:01:03 user nova-compute[74190]: iface.max_outstanding_r2t = 0
Oct 18 12:01:03 user nova-compute[74190]: iface.max_burst_len = 0
Oct 18 12:01:03 user nova-compute[74190]: iface.chap_auth = <empty>
Oct 18 12:01:03 user nova-compute[74190]: iface.bidi_chap = <empty>
Oct 18 12:01:03 user nova-compute[74190]: iface.strict_login_compliance = <empty>
Oct 18 12:01:03 user nova-compute[74190]: iface.discovery_auth = <empty>
Oct 18 12:01:03 user nova-compute[74190]: iface.discovery_logout = <empty>
Oct 18 12:01:03 user nova-compute[74190]: node.discovery_address = <empty>
Oct 18 12:01:03 user nova-compute[74190]: node.discovery_port = 0
Oct 18 12:01:03 user nova-compute[74190]: node.discovery_type = static
Oct 18 12:01:03 user nova-compute[74190]: node.session.initial_cmdsn = 0
Oct 18 12:01:03 user nova-compute[74190]: node.session.initial_login_retry_max = 8
Oct 18 12:01:03 user nova-compute[74190]: node.session.xmit_thread_priority = -20
Oct 18 12:01:03 user nova-compute[74190]: node.session.cmds_max = 128
Oct 18 12:01:03 user nova-compute[74190]: node.session.queue_depth = 32
Oct 18 12:01:03 user nova-compute[74190]: node.session.nr_sessions = 1
Oct 18 12:01:03 user nova-compute[74190]: node.session.auth.authmethod = CHAP
Oct 18 12:01:03 user nova-compute[74190]: node.session.auth.username = OucnFekJ
Oct 18 12:01:03 user nova-compute[74190]: node.session.auth.password = ***
Oct 18 12:01:03 user nova-compute[74190]: node.session.auth.username_in = <empty>
Oct 18 12:01:03 user nova-compute[74190]: node.session.auth.password_in = <empty>
Oct 18 12:01:03 user nova-compute[74190]: node.session.auth.chap_algs = MD5
Oct 18 12:01:03 user nova-compute[74190]: node.session.timeo.replacement_timeout = 120
Oct 18 12:01:03 user nova-compute[74190]: node.session.err_timeo.abort_timeout = 15
Oct 18 12:01:03 user nova-compute[74190]: node.session.err_timeo.lu_reset_timeout = 30
Oct 18 12:01:03 user nova-compute[74190]: node.session.err_timeo.tgt_reset_timeout = 30
Oct 18 12:01:03 user nova-compute[74190]: node.session.err_timeo.host_reset_timeout = 60
Oct 18 12:01:03 user nova-compute[74190]: node.session.iscsi.FastAbort = Yes
Oct 18 12:01:03 user nova-compute[74190]: node.session.iscsi.InitialR2T = No
Oct 18 12:01:03 user nova-compute[74190]: node.session.iscsi.ImmediateData = Yes
Oct 18 12:01:03 user nova-compute[74190]: node.session.iscsi.FirstBurstLength = 262144
Oct 18 12:01:03 user nova-compute[74190]: node.session.iscsi.MaxBurstLength = 16776192
Oct 18 12:01:03 user nova-compute[74190]: node.session.iscsi.DefaultTime2Retain = 0
Oct 18 12:01:03 user nova-compute[74190]: node.session.iscsi.DefaultTime2Wait = 2
Oct 18 12:01:03 user nova-compute[74190]: node.session.iscsi.MaxConnections = 1
Oct 18 12:01:03 user nova-compute[74190]: node.session.iscsi.MaxOutstandingR2T = 1
Oct 18 12:01:03 user nova-compute[74190]: node.session.iscsi.ERL = 0
Oct 18 12:01:03 user nova-compute[74190]: node.session.scan = manual
Oct 18 12:01:03 user nova-compute[74190]: node.session.reopen_max = 0
Oct 18 12:01:03 user nova-compute[74190]: node.conn[0].address = 172.16.0.220
Oct 18 12:01:03 user nova-compute[74190]: node.conn[0].port = 3260
Oct 18 12:01:03 user nova-compute[74190]: node.conn[0].startup = manual
Oct 18 12:01:03 user nova-compute[74190]: node.conn[0].tcp.window_size = 524288
Oct 18 12:01:03 user nova-compute[74190]: node.conn[0].tcp.type_of_service = 0
Oct 18 12:01:03 user nova-compute[74190]: node.conn[0].timeo.logout_timeout = 15
Oct 18 12:01:03 user nova-compute[74190]: node.conn[0].timeo.login_timeout = 15
Oct 18 12:01:03 user nova-compute[74190]: node.conn[0].timeo.auth_timeout = 45
Oct 18 12:01:03 user nova-compute[74190]: node.conn[0].timeo.noop_out_interval = 5
Oct 18 12:01:03 user nova-compute[74190]: node.conn[0].timeo.noop_out_timeout = 5
Oct 18 12:01:03 user nova-compute[74190]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Oct 18 12:01:03 user nova-compute[74190]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Oct 18 12:01:03 user nova-compute[74190]: node.conn[0].iscsi.HeaderDigest = None
Oct 18 12:01:03 user nova-compute[74190]: node.conn[0].iscsi.DataDigest = None
Oct 18 12:01:03 user nova-compute[74190]: node.conn[0].iscsi.IFMarker = No
Oct 18 12:01:03 user nova-compute[74190]: node.conn[0].iscsi.OFMarker = No
Oct 18 12:01:03 user nova-compute[74190]: # END RECORD
Oct 18 12:01:03 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:01:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:01:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:01:03 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b1522f6-3f84-4f1c-901a-debcacbe3e9b]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:01:03 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c161a9-9fe6-483f-b014-fc337e344c99 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:01:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:01:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:01:03 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[df3853b4-81b8-4b23-ba46-839012719278]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:01:03 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c161a9-9fe6-483f-b014-fc337e344c99 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:01:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OucnFekJ {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:01:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OucnFekJ" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:01:03 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b324d0-fcc5-4c34-9439-0da4e6d1c492]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:01:03 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c161a9-9fe6-483f-b014-fc337e344c99 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OucnFekJ'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:01:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:01:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:01:03 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[27307b41-b59f-420a-b888-fc5d1e193f0e]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:01:03 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c161a9-9fe6-483f-b014-fc337e344c99 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:01:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:01:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:01:03 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4977584-e5e1-4740-bf0d-12e4c28546b5]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:01:03 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c161a9-9fe6-483f-b014-fc337e344c99 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 12:01:03 user nova-compute[74190]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)
Oct 18 12:01:03 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 12:01:03 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c161a9-9fe6-483f-b014-fc337e344c99 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 12:01:03 user nova-compute[74190]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)
Oct 18 12:01:03 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 12:01:03 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-c8c161a9-9fe6-483f-b014-fc337e344c99 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.146s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 12:01:03 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c161a9-9fe6-483f-b014-fc337e344c99 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Connected to 172.16.0.220:3260 {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 12:01:03 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-c8c161a9-9fe6-483f-b014-fc337e344c99 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] HCTL ('33', '0', '0', 0) found on session 37 with lun 0 {{(pid=74190) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 12:01:03 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-c8c161a9-9fe6-483f-b014-fc337e344c99 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=74190) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 12:01:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:01:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:01:03 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[a985ceb8-0411-4d28-8654-e5a808c6e96b]: (4, ('0 0 0', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:01:03 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-c8c161a9-9fe6-483f-b014-fc337e344c99 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Searching for a device in session 37 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=74190) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 12:01:03 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c161a9-9fe6-483f-b014-fc337e344c99 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OucnFekJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 12:01:03 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-c8c161a9-9fe6-483f-b014-fc337e344c99 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.172s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 12:01:03 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c161a9-9fe6-483f-b014-fc337e344c99 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] <== connect_volume: return (173ms) {'type': 'block', 'scsi_wwn': '23533306339613561', 'path': '/dev/sdb'} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 12:01:03 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8c161a9-9fe6-483f-b014-fc337e344c99 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23533306339613561', 'path': '/dev/sdb'} {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 12:01:03 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-c8c161a9-9fe6-483f-b014-fc337e344c99 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:59:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1554082096',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1554082096',id=31,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-18T11:59:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6d994366010142519ff367fa7ca77e61',ramdisk_id='',reservation_id='r-2rfy2zbm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1815510380',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T11:59:38Z,user_data=None,user_id='7fa675b6803f4e21b090295b51fb9ceb',uuid=0382820d-a678-4593-85df-168f42fc4ce4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a32b81a2-7b02-48ed-9550-d392be5e221e", "address": "fa:16:3e:e7:d8:e5", "network": {"id": "c2dbbd24-f1d2-47a2-835f-0f9b24b585f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-920140900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-920140900-network", "vif_mac": "fa:16:3e:e7:d8:e5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d994366010142519ff367fa7ca77e61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa32b81a2-7b", "ovs_interfaceid": "a32b81a2-7b02-48ed-9550-d392be5e221e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74190) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 12:01:03 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-c8c161a9-9fe6-483f-b014-fc337e344c99 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Converting VIF {"id": "a32b81a2-7b02-48ed-9550-d392be5e221e", "address": "fa:16:3e:e7:d8:e5", "network": {"id": "c2dbbd24-f1d2-47a2-835f-0f9b24b585f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-920140900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-920140900-network", "vif_mac": "fa:16:3e:e7:d8:e5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d994366010142519ff367fa7ca77e61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa32b81a2-7b", "ovs_interfaceid": "a32b81a2-7b02-48ed-9550-d392be5e221e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 12:01:03 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-c8c161a9-9fe6-483f-b014-fc337e344c99 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e7:d8:e5,bridge_name='br-int',has_traffic_filtering=True,id=a32b81a2-7b02-48ed-9550-d392be5e221e,network=Network(c2dbbd24-f1d2-47a2-835f-0f9b24b585f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa32b81a2-7b') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 12:01:03 user nova-compute[74190]: DEBUG nova.objects.instance [None req-c8c161a9-9fe6-483f-b014-fc337e344c99 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lazy-loading 'pci_devices' on Instance uuid 0382820d-a678-4593-85df-168f42fc4ce4 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:01:03 user nova-compute[74190]: DEBUG nova.objects.base [None req-c8c161a9-9fe6-483f-b014-fc337e344c99 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Object Instance<0382820d-a678-4593-85df-168f42fc4ce4> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74190) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 12:01:03 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-c8c161a9-9fe6-483f-b014-fc337e344c99 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] End _get_guest_xml xml=<domain type="kvm">
Oct 18 12:01:03 user nova-compute[74190]:   <uuid>0382820d-a678-4593-85df-168f42fc4ce4</uuid>
Oct 18 12:01:03 user nova-compute[74190]:   <name>instance-0000001f</name>
Oct 18 12:01:03 user nova-compute[74190]:   <memory>524288</memory>
Oct 18 12:01:03 user nova-compute[74190]:   <vcpu>1</vcpu>
Oct 18 12:01:03 user nova-compute[74190]:   <metadata>
Oct 18 12:01:03 user nova-compute[74190]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 12:01:03 user nova-compute[74190]:       <nova:package version="0.0.0"/>
Oct 18 12:01:03 user nova-compute[74190]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1554082096</nova:name>
Oct 18 12:01:03 user nova-compute[74190]:       <nova:creationTime>2023-10-18 12:01:03</nova:creationTime>
Oct 18 12:01:03 user nova-compute[74190]:       <nova:flavor name="m1.tiny">
Oct 18 12:01:03 user nova-compute[74190]:         <nova:memory>512</nova:memory>
Oct 18 12:01:03 user nova-compute[74190]:         <nova:disk>1</nova:disk>
Oct 18 12:01:03 user nova-compute[74190]:         <nova:swap>0</nova:swap>
Oct 18 12:01:03 user nova-compute[74190]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 12:01:03 user nova-compute[74190]:         <nova:vcpus>1</nova:vcpus>
Oct 18 12:01:03 user nova-compute[74190]:       </nova:flavor>
Oct 18 12:01:03 user nova-compute[74190]:       <nova:owner>
Oct 18 12:01:03 user nova-compute[74190]:         <nova:user uuid="7fa675b6803f4e21b090295b51fb9ceb">tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member</nova:user>
Oct 18 12:01:03 user nova-compute[74190]:         <nova:project uuid="6d994366010142519ff367fa7ca77e61">tempest-ServerBootFromVolumeStableRescueTest-1815510380</nova:project>
Oct 18 12:01:03 user nova-compute[74190]:       </nova:owner>
Oct 18 12:01:03 user nova-compute[74190]:       <nova:root type="image" uuid="6e88bbf0-6e78-49a8-b3c5-9453d22a89df"/>
Oct 18 12:01:03 user nova-compute[74190]:       <nova:ports>
Oct 18 12:01:03 user nova-compute[74190]:         <nova:port uuid="a32b81a2-7b02-48ed-9550-d392be5e221e">
Oct 18 12:01:03 user nova-compute[74190]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 18 12:01:03 user nova-compute[74190]:         </nova:port>
Oct 18 12:01:03 user nova-compute[74190]:       </nova:ports>
Oct 18 12:01:03 user nova-compute[74190]:     </nova:instance>
Oct 18 12:01:03 user nova-compute[74190]:   </metadata>
Oct 18 12:01:03 user nova-compute[74190]:   <sysinfo type="smbios">
Oct 18 12:01:03 user nova-compute[74190]:     <system>
Oct 18 12:01:03 user nova-compute[74190]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 12:01:03 user nova-compute[74190]:       <entry name="product">OpenStack Nova</entry>
Oct 18 12:01:03 user nova-compute[74190]:       <entry name="version">0.0.0</entry>
Oct 18 12:01:03 user nova-compute[74190]:       <entry name="serial">0382820d-a678-4593-85df-168f42fc4ce4</entry>
Oct 18 12:01:03 user nova-compute[74190]:       <entry name="uuid">0382820d-a678-4593-85df-168f42fc4ce4</entry>
Oct 18 12:01:03 user nova-compute[74190]:       <entry name="family">Virtual Machine</entry>
Oct 18 12:01:03 user nova-compute[74190]:     </system>
Oct 18 12:01:03 user nova-compute[74190]:   </sysinfo>
Oct 18 12:01:03 user nova-compute[74190]:   <os>
Oct 18 12:01:03 user nova-compute[74190]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 12:01:03 user nova-compute[74190]:     <smbios mode="sysinfo"/>
Oct 18 12:01:03 user nova-compute[74190]:   </os>
Oct 18 12:01:03 user nova-compute[74190]:   <features>
Oct 18 12:01:03 user nova-compute[74190]:     <acpi/>
Oct 18 12:01:03 user nova-compute[74190]:     <apic/>
Oct 18 12:01:03 user nova-compute[74190]:     <vmcoreinfo/>
Oct 18 12:01:03 user nova-compute[74190]:   </features>
Oct 18 12:01:03 user nova-compute[74190]:   <clock offset="utc">
Oct 18 12:01:03 user nova-compute[74190]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 12:01:03 user nova-compute[74190]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 12:01:03 user nova-compute[74190]:     <timer name="hpet" present="no"/>
Oct 18 12:01:03 user nova-compute[74190]:   </clock>
Oct 18 12:01:03 user nova-compute[74190]:   <cpu mode="custom" match="exact">
Oct 18 12:01:03 user nova-compute[74190]:     <model>Nehalem</model>
Oct 18 12:01:03 user nova-compute[74190]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 12:01:03 user nova-compute[74190]:   </cpu>
Oct 18 12:01:03 user nova-compute[74190]:   <devices>
Oct 18 12:01:03 user nova-compute[74190]:     <disk type="block" device="disk">
Oct 18 12:01:03 user nova-compute[74190]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 12:01:03 user nova-compute[74190]:       <source dev="/dev/sdb"/>
Oct 18 12:01:03 user nova-compute[74190]:       <target dev="vda" bus="virtio"/>
Oct 18 12:01:03 user nova-compute[74190]:       <serial>e27e2099-8328-4194-b582-65ca0cdad07f</serial>
Oct 18 12:01:03 user nova-compute[74190]:     </disk>
Oct 18 12:01:03 user nova-compute[74190]:     <disk type="file" device="disk">
Oct 18 12:01:03 user nova-compute[74190]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 12:01:03 user nova-compute[74190]:       <source file="/opt/stack/data/nova/instances/0382820d-a678-4593-85df-168f42fc4ce4/disk.rescue"/>
Oct 18 12:01:03 user nova-compute[74190]:       <target dev="vdb" bus="virtio"/>
Oct 18 12:01:03 user nova-compute[74190]:       <boot order="1"/>
Oct 18 12:01:03 user nova-compute[74190]:     </disk>
Oct 18 12:01:03 user nova-compute[74190]:     <interface type="ethernet">
Oct 18 12:01:03 user nova-compute[74190]:       <mac address="fa:16:3e:e7:d8:e5"/>
Oct 18 12:01:03 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 12:01:03 user nova-compute[74190]:       <mtu size="1442"/>
Oct 18 12:01:03 user nova-compute[74190]:       <target dev="tapa32b81a2-7b"/>
Oct 18 12:01:03 user nova-compute[74190]:     </interface>
Oct 18 12:01:03 user nova-compute[74190]:     <serial type="pty">
Oct 18 12:01:03 user nova-compute[74190]:       <log file="/opt/stack/data/nova/instances/0382820d-a678-4593-85df-168f42fc4ce4/console.log" append="off"/>
Oct 18 12:01:03 user nova-compute[74190]:     </serial>
Oct 18 12:01:03 user nova-compute[74190]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 12:01:03 user nova-compute[74190]:     <video>
Oct 18 12:01:03 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 12:01:03 user nova-compute[74190]:     </video>
Oct 18 12:01:03 user nova-compute[74190]:     <rng model="virtio">
Oct 18 12:01:03 user nova-compute[74190]:       <backend model="random">/dev/urandom</backend>
Oct 18 12:01:03 user nova-compute[74190]:     </rng>
Oct 18 12:01:03 user nova-compute[74190]:     <controller type="usb" index="0" model="none"/>
Oct 18 12:01:03 user nova-compute[74190]:     <memballoon model="virtio">
Oct 18 12:01:03 user nova-compute[74190]:       <stats period="10"/>
Oct 18 12:01:03 user nova-compute[74190]:     </memballoon>
Oct 18 12:01:03 user nova-compute[74190]:   </devices>
Oct 18 12:01:03 user nova-compute[74190]: </domain>
Oct 18 12:01:03 user nova-compute[74190]:  {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 12:01:03 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Instance destroyed successfully.
Oct 18 12:01:03 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-c8c161a9-9fe6-483f-b014-fc337e344c99 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] No BDM found with device name vda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 12:01:03 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-c8c161a9-9fe6-483f-b014-fc337e344c99 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 12:01:03 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-c8c161a9-9fe6-483f-b014-fc337e344c99 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] No VIF found with MAC fa:16:3e:e7:d8:e5, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 12:01:04 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:01:04 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:01:04 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:01:04 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:01:04 user nova-compute[74190]: DEBUG nova.compute.manager [req-706ba81e-59fb-4973-bd0e-72ed358ae59e req-26c4d6ca-4aea-449b-9e57-eed036adc22b service nova] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Received event network-vif-plugged-a32b81a2-7b02-48ed-9550-d392be5e221e {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:01:04 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-706ba81e-59fb-4973-bd0e-72ed358ae59e req-26c4d6ca-4aea-449b-9e57-eed036adc22b service nova] Acquiring lock "0382820d-a678-4593-85df-168f42fc4ce4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:01:04 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-706ba81e-59fb-4973-bd0e-72ed358ae59e req-26c4d6ca-4aea-449b-9e57-eed036adc22b service nova] Lock "0382820d-a678-4593-85df-168f42fc4ce4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:01:04 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-706ba81e-59fb-4973-bd0e-72ed358ae59e req-26c4d6ca-4aea-449b-9e57-eed036adc22b service nova] Lock "0382820d-a678-4593-85df-168f42fc4ce4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:01:04 user nova-compute[74190]: DEBUG nova.compute.manager [req-706ba81e-59fb-4973-bd0e-72ed358ae59e req-26c4d6ca-4aea-449b-9e57-eed036adc22b service nova] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] No waiting events found dispatching network-vif-plugged-a32b81a2-7b02-48ed-9550-d392be5e221e {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:01:04 user nova-compute[74190]: WARNING nova.compute.manager [req-706ba81e-59fb-4973-bd0e-72ed358ae59e req-26c4d6ca-4aea-449b-9e57-eed036adc22b service nova] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Received unexpected event network-vif-plugged-a32b81a2-7b02-48ed-9550-d392be5e221e for instance with vm_state active and task_state rescuing.
Oct 18 12:01:04 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:01:04 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:01:05 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:01:06 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:01:06 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74190) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 12:01:06 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:01:06 user nova-compute[74190]: DEBUG nova.compute.manager [req-729626ea-96e2-4b34-8e8b-67adc6606bfd req-b3ef718a-8672-41e3-9f2e-7797e796b4b3 service nova] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Received event network-vif-plugged-a32b81a2-7b02-48ed-9550-d392be5e221e {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:01:06 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-729626ea-96e2-4b34-8e8b-67adc6606bfd req-b3ef718a-8672-41e3-9f2e-7797e796b4b3 service nova] Acquiring lock "0382820d-a678-4593-85df-168f42fc4ce4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:01:06 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-729626ea-96e2-4b34-8e8b-67adc6606bfd req-b3ef718a-8672-41e3-9f2e-7797e796b4b3 service nova] Lock "0382820d-a678-4593-85df-168f42fc4ce4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:01:06 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-729626ea-96e2-4b34-8e8b-67adc6606bfd req-b3ef718a-8672-41e3-9f2e-7797e796b4b3 service nova] Lock "0382820d-a678-4593-85df-168f42fc4ce4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:01:06 user nova-compute[74190]: DEBUG nova.compute.manager [req-729626ea-96e2-4b34-8e8b-67adc6606bfd req-b3ef718a-8672-41e3-9f2e-7797e796b4b3 service nova] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] No waiting events found dispatching network-vif-plugged-a32b81a2-7b02-48ed-9550-d392be5e221e {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:01:06 user nova-compute[74190]: WARNING nova.compute.manager [req-729626ea-96e2-4b34-8e8b-67adc6606bfd req-b3ef718a-8672-41e3-9f2e-7797e796b4b3 service nova] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Received unexpected event network-vif-plugged-a32b81a2-7b02-48ed-9550-d392be5e221e for instance with vm_state active and task_state rescuing.
Oct 18 12:01:07 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:01:07 user nova-compute[74190]: DEBUG nova.compute.manager [None req-c8c161a9-9fe6-483f-b014-fc337e344c99 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Checking state {{(pid=74190) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 12:01:07 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:01:08 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:01:08 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:01:08 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Starting heal instance info cache {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 12:01:08 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "refresh_cache-42413a94-9973-4e8d-83b6-207a4e7847c1" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:01:08 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquired lock "refresh_cache-42413a94-9973-4e8d-83b6-207a4e7847c1" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:01:08 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 42413a94-9973-4e8d-83b6-207a4e7847c1] Forcefully refreshing network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 18 12:01:08 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 42413a94-9973-4e8d-83b6-207a4e7847c1] Updating instance_info_cache with network_info: [{"id": "1bad07b8-897d-4280-9eac-ea800fd1cf5a", "address": "fa:16:3e:0f:dd:a5", "network": {"id": "130f7948-11e4-49b4-9d4a-dffb2b48bdcd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595419292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ffa18c02b8a4117ab1ccc52aca64f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bad07b8-89", "ovs_interfaceid": "1bad07b8-897d-4280-9eac-ea800fd1cf5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:01:08 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Releasing lock "refresh_cache-42413a94-9973-4e8d-83b6-207a4e7847c1" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:01:08 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 42413a94-9973-4e8d-83b6-207a4e7847c1] Updated the network info_cache for instance {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 18 12:01:09 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:01:10 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:01:10 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:01:10 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:01:10 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:01:10 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Auditing locally available compute resources for user (node: user) {{(pid=74190) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 12:01:10 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:01:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:01:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:01:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:01:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:01:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:01:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:01:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:01:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:01:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7128c4e8-0118-4138-b421-9b1d610d7454/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:01:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7128c4e8-0118-4138-b421-9b1d610d7454/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:01:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7128c4e8-0118-4138-b421-9b1d610d7454/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:01:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7128c4e8-0118-4138-b421-9b1d610d7454/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:01:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:01:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:01:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:01:12 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:01:12 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 12:01:12 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk.rescue --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:01:12 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk.rescue --force-share --output=json" returned: 0 in 0.248s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:01:12 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk.rescue --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:01:12 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk.rescue --force-share --output=json" returned: 0 in 0.223s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:01:12 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:01:12 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:01:12 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:01:12 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:01:13 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:01:13 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 12:01:13 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0382820d-a678-4593-85df-168f42fc4ce4/disk.rescue --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:01:13 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0382820d-a678-4593-85df-168f42fc4ce4/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:01:13 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0382820d-a678-4593-85df-168f42fc4ce4/disk.rescue --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:01:13 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0382820d-a678-4593-85df-168f42fc4ce4/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:01:13 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:01:13 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:01:13 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Hypervisor/Node resource view: name=user free_ram=8156MB free_disk=25.106124877929688GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74190) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 12:01:13 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:01:13 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:01:13 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 4e916d24-9f9d-4289-87ce-f65d2499fcd9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:01:13 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 95ca0697-22b5-4109-868f-ca5556015a1f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:01:13 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 42413a94-9973-4e8d-83b6-207a4e7847c1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:01:13 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 772b126c-2148-4ca8-90f2-69d6eb4b7db7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:01:13 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 0382820d-a678-4593-85df-168f42fc4ce4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:01:13 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 7128c4e8-0118-4138-b421-9b1d610d7454 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:01:13 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 12:01:13 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 12:01:14 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 12:01:14 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 12:01:14 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Compute_service record updated for user:user {{(pid=74190) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 12:01:14 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.366s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:01:15 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:01:15 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:01:15 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:01:15 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:01:16 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:01:17 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:01:18 user nova-compute[74190]: DEBUG nova.compute.manager [req-d5277a3a-5e56-4495-9d1b-b66847574a00 req-cc6c82ea-8ece-42a5-be19-9241fb6f1120 service nova] [instance: 7128c4e8-0118-4138-b421-9b1d610d7454] Received event network-changed-bc81c313-cdfc-4ef9-9c98-6efba1603301 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:01:18 user nova-compute[74190]: DEBUG nova.compute.manager [req-d5277a3a-5e56-4495-9d1b-b66847574a00 req-cc6c82ea-8ece-42a5-be19-9241fb6f1120 service nova] [instance: 7128c4e8-0118-4138-b421-9b1d610d7454] Refreshing instance network info cache due to event network-changed-bc81c313-cdfc-4ef9-9c98-6efba1603301. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 12:01:18 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d5277a3a-5e56-4495-9d1b-b66847574a00 req-cc6c82ea-8ece-42a5-be19-9241fb6f1120 service nova] Acquiring lock "refresh_cache-7128c4e8-0118-4138-b421-9b1d610d7454" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:01:18 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d5277a3a-5e56-4495-9d1b-b66847574a00 req-cc6c82ea-8ece-42a5-be19-9241fb6f1120 service nova] Acquired lock "refresh_cache-7128c4e8-0118-4138-b421-9b1d610d7454" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:01:18 user nova-compute[74190]: DEBUG nova.network.neutron [req-d5277a3a-5e56-4495-9d1b-b66847574a00 req-cc6c82ea-8ece-42a5-be19-9241fb6f1120 service nova] [instance: 7128c4e8-0118-4138-b421-9b1d610d7454] Refreshing network info cache for port bc81c313-cdfc-4ef9-9c98-6efba1603301 {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 12:01:18 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:01:18 user nova-compute[74190]: DEBUG nova.network.neutron [req-d5277a3a-5e56-4495-9d1b-b66847574a00 req-cc6c82ea-8ece-42a5-be19-9241fb6f1120 service nova] [instance: 7128c4e8-0118-4138-b421-9b1d610d7454] Updated VIF entry in instance network info cache for port bc81c313-cdfc-4ef9-9c98-6efba1603301. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 12:01:18 user nova-compute[74190]: DEBUG nova.network.neutron [req-d5277a3a-5e56-4495-9d1b-b66847574a00 req-cc6c82ea-8ece-42a5-be19-9241fb6f1120 service nova] [instance: 7128c4e8-0118-4138-b421-9b1d610d7454] Updating instance_info_cache with network_info: [{"id": "bc81c313-cdfc-4ef9-9c98-6efba1603301", "address": "fa:16:3e:d1:de:c2", "network": {"id": "25e0d6f5-497d-4898-8181-5b4848950f16", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-245925644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df06c4b010434e3da9ba4ea41f26befa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc81c313-cd", "ovs_interfaceid": "bc81c313-cdfc-4ef9-9c98-6efba1603301", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:01:18 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d5277a3a-5e56-4495-9d1b-b66847574a00 req-cc6c82ea-8ece-42a5-be19-9241fb6f1120 service nova] Releasing lock "refresh_cache-7128c4e8-0118-4138-b421-9b1d610d7454" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:01:20 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:01:21 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:01:22 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:01:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:01:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-40464fc7-8fac-46fd-a683-655f39d3746d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Acquiring lock "7128c4e8-0118-4138-b421-9b1d610d7454" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:01:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-40464fc7-8fac-46fd-a683-655f39d3746d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "7128c4e8-0118-4138-b421-9b1d610d7454" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:01:24 user nova-compute[74190]: DEBUG nova.objects.instance [None req-40464fc7-8fac-46fd-a683-655f39d3746d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lazy-loading 'flavor' on Instance uuid 7128c4e8-0118-4138-b421-9b1d610d7454 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:01:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-40464fc7-8fac-46fd-a683-655f39d3746d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "7128c4e8-0118-4138-b421-9b1d610d7454" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:01:25 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-40464fc7-8fac-46fd-a683-655f39d3746d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Acquiring lock "7128c4e8-0118-4138-b421-9b1d610d7454" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:01:25 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-40464fc7-8fac-46fd-a683-655f39d3746d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "7128c4e8-0118-4138-b421-9b1d610d7454" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:01:25 user nova-compute[74190]: INFO nova.compute.manager [None req-40464fc7-8fac-46fd-a683-655f39d3746d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: 7128c4e8-0118-4138-b421-9b1d610d7454] Attaching volume 2cec69f2-df91-41a3-83fe-235889dd0667 to /dev/vdb
Oct 18 12:01:25 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:01:25 user nova-compute[74190]: DEBUG os_brick.utils [None req-40464fc7-8fac-46fd-a683-655f39d3746d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 12:01:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:01:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:01:25 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[87739dd4-8dce-4b14-a7e1-c9c68f4e7b97]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cff158e257e1\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:01:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:01:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:01:25 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f915602-792b-4ec5-9838-d2105784a2ab]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:01:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:01:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:01:25 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d787fa-ad22-4dfd-af4a-5c2aaaca6cca]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:01:25 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d07dbd8-2282-43d7-a9a6-a22e0bb9234f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:01:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-40464fc7-8fac-46fd-a683-655f39d3746d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Running cmd (subprocess): nvme version {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:01:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-40464fc7-8fac-46fd-a683-655f39d3746d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] 'nvme version' failed. Not Retrying. {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 12:01:25 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.nvmeof [None req-40464fc7-8fac-46fd-a683-655f39d3746d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] nvme not present on system {{(pid=74190) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 12:01:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:01:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 12:01:25 user nova-compute[74190]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 12:01:25 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a9f230-57c2-4546-a80f-ef277ad8bbfe]: (4, '') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:01:25 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-40464fc7-8fac-46fd-a683-655f39d3746d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74190) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 12:01:25 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-40464fc7-8fac-46fd-a683-655f39d3746d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 12:01:25 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-40464fc7-8fac-46fd-a683-655f39d3746d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] LIGHTOS: no hostnqn found. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 12:01:25 user nova-compute[74190]: DEBUG os_brick.utils [None req-40464fc7-8fac-46fd-a683-655f39d3746d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cff158e257e1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 12:01:25 user nova-compute[74190]: DEBUG nova.virt.block_device [None req-40464fc7-8fac-46fd-a683-655f39d3746d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: 7128c4e8-0118-4138-b421-9b1d610d7454] Updating existing volume attachment record: 412f5819-1cfa-4262-888a-317bf182465c {{(pid=74190) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 12:01:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:01:28 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-32687419-1ff1-41db-892f-6b683d2402a7 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Acquiring lock "2f59adf3-9728-4d5b-87d5-2ad32c99d06e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:01:28 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-32687419-1ff1-41db-892f-6b683d2402a7 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Lock "2f59adf3-9728-4d5b-87d5-2ad32c99d06e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:01:28 user nova-compute[74190]: DEBUG nova.compute.manager [None req-32687419-1ff1-41db-892f-6b683d2402a7 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] Starting instance... {{(pid=74190) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 12:01:28 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-32687419-1ff1-41db-892f-6b683d2402a7 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:01:28 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-32687419-1ff1-41db-892f-6b683d2402a7 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:01:28 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-32687419-1ff1-41db-892f-6b683d2402a7 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74190) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 12:01:28 user nova-compute[74190]: INFO nova.compute.claims [None req-32687419-1ff1-41db-892f-6b683d2402a7 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] Claim successful on node user
Oct 18 12:01:28 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-32687419-1ff1-41db-892f-6b683d2402a7 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 12:01:28 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-32687419-1ff1-41db-892f-6b683d2402a7 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 12:01:28 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-32687419-1ff1-41db-892f-6b683d2402a7 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.326s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:01:28 user nova-compute[74190]: DEBUG nova.compute.manager [None req-32687419-1ff1-41db-892f-6b683d2402a7 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] Start building networks asynchronously for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 12:01:28 user nova-compute[74190]: DEBUG nova.compute.manager [None req-32687419-1ff1-41db-892f-6b683d2402a7 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] Allocating IP information in the background. {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 12:01:28 user nova-compute[74190]: DEBUG nova.network.neutron [None req-32687419-1ff1-41db-892f-6b683d2402a7 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] allocate_for_instance() {{(pid=74190) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 12:01:28 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-32687419-1ff1-41db-892f-6b683d2402a7 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 12:01:28 user nova-compute[74190]: DEBUG nova.compute.manager [None req-32687419-1ff1-41db-892f-6b683d2402a7 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] Start building block device mappings for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 12:01:28 user nova-compute[74190]: DEBUG nova.policy [None req-32687419-1ff1-41db-892f-6b683d2402a7 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '80066ffc27d14b658f3e0dc8aa0b9faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '423525b841c84a6f8fe6a72da9cccef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74190) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 12:01:28 user nova-compute[74190]: DEBUG nova.compute.manager [None req-32687419-1ff1-41db-892f-6b683d2402a7 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] Start spawning the instance on the hypervisor. {{(pid=74190) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 12:01:28 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-32687419-1ff1-41db-892f-6b683d2402a7 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] Creating instance directory {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 12:01:28 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-32687419-1ff1-41db-892f-6b683d2402a7 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] Creating image(s)
Oct 18 12:01:28 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-32687419-1ff1-41db-892f-6b683d2402a7 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Acquiring lock "/opt/stack/data/nova/instances/2f59adf3-9728-4d5b-87d5-2ad32c99d06e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:01:28 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-32687419-1ff1-41db-892f-6b683d2402a7 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Lock "/opt/stack/data/nova/instances/2f59adf3-9728-4d5b-87d5-2ad32c99d06e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:01:28 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-32687419-1ff1-41db-892f-6b683d2402a7 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Lock "/opt/stack/data/nova/instances/2f59adf3-9728-4d5b-87d5-2ad32c99d06e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:01:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-32687419-1ff1-41db-892f-6b683d2402a7 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:01:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-32687419-1ff1-41db-892f-6b683d2402a7 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.179s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:01:29 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-32687419-1ff1-41db-892f-6b683d2402a7 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Acquiring lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:01:29 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-32687419-1ff1-41db-892f-6b683d2402a7 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:01:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-32687419-1ff1-41db-892f-6b683d2402a7 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:01:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-32687419-1ff1-41db-892f-6b683d2402a7 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.207s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:01:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-32687419-1ff1-41db-892f-6b683d2402a7 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f,backing_fmt=raw /opt/stack/data/nova/instances/2f59adf3-9728-4d5b-87d5-2ad32c99d06e/disk 1073741824 {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:01:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-32687419-1ff1-41db-892f-6b683d2402a7 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f,backing_fmt=raw /opt/stack/data/nova/instances/2f59adf3-9728-4d5b-87d5-2ad32c99d06e/disk 1073741824" returned: 0 in 0.049s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:01:29 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-32687419-1ff1-41db-892f-6b683d2402a7 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:01:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-32687419-1ff1-41db-892f-6b683d2402a7 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:01:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-32687419-1ff1-41db-892f-6b683d2402a7 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.217s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:01:29 user nova-compute[74190]: DEBUG nova.virt.disk.api [None req-32687419-1ff1-41db-892f-6b683d2402a7 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2f59adf3-9728-4d5b-87d5-2ad32c99d06e/disk. size=1073741824 {{(pid=74190) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 18 12:01:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-32687419-1ff1-41db-892f-6b683d2402a7 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f59adf3-9728-4d5b-87d5-2ad32c99d06e/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:01:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:01:29 user nova-compute[74190]: DEBUG nova.network.neutron [None req-32687419-1ff1-41db-892f-6b683d2402a7 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] Successfully created port: 9817302c-2890-4026-86e9-061ca2d1497a {{(pid=74190) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 12:01:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-32687419-1ff1-41db-892f-6b683d2402a7 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f59adf3-9728-4d5b-87d5-2ad32c99d06e/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:01:29 user nova-compute[74190]: DEBUG nova.virt.disk.api [None req-32687419-1ff1-41db-892f-6b683d2402a7 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Cannot resize image /opt/stack/data/nova/instances/2f59adf3-9728-4d5b-87d5-2ad32c99d06e/disk to a smaller size. {{(pid=74190) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 18 12:01:29 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-32687419-1ff1-41db-892f-6b683d2402a7 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] Created local disks {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 12:01:29 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-32687419-1ff1-41db-892f-6b683d2402a7 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] Ensure instance console log exists: /opt/stack/data/nova/instances/2f59adf3-9728-4d5b-87d5-2ad32c99d06e/console.log {{(pid=74190) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 12:01:29 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-32687419-1ff1-41db-892f-6b683d2402a7 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:01:29 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-32687419-1ff1-41db-892f-6b683d2402a7 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:01:29 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-32687419-1ff1-41db-892f-6b683d2402a7 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:01:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:01:30 user nova-compute[74190]: DEBUG nova.network.neutron [None req-32687419-1ff1-41db-892f-6b683d2402a7 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] Successfully updated port: 9817302c-2890-4026-86e9-061ca2d1497a {{(pid=74190) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 12:01:30 user nova-compute[74190]: DEBUG nova.compute.manager [req-b299f4d7-b012-4562-83bc-9b30d27766f8 req-423d1f90-29d4-4f35-b2a8-e9febb63bf6a service nova] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] Received event network-changed-9817302c-2890-4026-86e9-061ca2d1497a {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:01:30 user nova-compute[74190]: DEBUG nova.compute.manager [req-b299f4d7-b012-4562-83bc-9b30d27766f8 req-423d1f90-29d4-4f35-b2a8-e9febb63bf6a service nova] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] Refreshing instance network info cache due to event network-changed-9817302c-2890-4026-86e9-061ca2d1497a. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 12:01:30 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-b299f4d7-b012-4562-83bc-9b30d27766f8 req-423d1f90-29d4-4f35-b2a8-e9febb63bf6a service nova] Acquiring lock "refresh_cache-2f59adf3-9728-4d5b-87d5-2ad32c99d06e" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:01:30 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-b299f4d7-b012-4562-83bc-9b30d27766f8 req-423d1f90-29d4-4f35-b2a8-e9febb63bf6a service nova] Acquired lock "refresh_cache-2f59adf3-9728-4d5b-87d5-2ad32c99d06e" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:01:30 user nova-compute[74190]: DEBUG nova.network.neutron [req-b299f4d7-b012-4562-83bc-9b30d27766f8 req-423d1f90-29d4-4f35-b2a8-e9febb63bf6a service nova] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] Refreshing network info cache for port 9817302c-2890-4026-86e9-061ca2d1497a {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 12:01:30 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-32687419-1ff1-41db-892f-6b683d2402a7 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Acquiring lock "refresh_cache-2f59adf3-9728-4d5b-87d5-2ad32c99d06e" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:01:30 user nova-compute[74190]: DEBUG nova.network.neutron [req-b299f4d7-b012-4562-83bc-9b30d27766f8 req-423d1f90-29d4-4f35-b2a8-e9febb63bf6a service nova] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] Instance cache missing network info. {{(pid=74190) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 12:01:30 user nova-compute[74190]: DEBUG nova.network.neutron [req-b299f4d7-b012-4562-83bc-9b30d27766f8 req-423d1f90-29d4-4f35-b2a8-e9febb63bf6a service nova] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] Updating instance_info_cache with network_info: [] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:01:30 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-b299f4d7-b012-4562-83bc-9b30d27766f8 req-423d1f90-29d4-4f35-b2a8-e9febb63bf6a service nova] Releasing lock "refresh_cache-2f59adf3-9728-4d5b-87d5-2ad32c99d06e" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:01:30 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-32687419-1ff1-41db-892f-6b683d2402a7 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Acquired lock "refresh_cache-2f59adf3-9728-4d5b-87d5-2ad32c99d06e" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:01:30 user nova-compute[74190]: DEBUG nova.network.neutron [None req-32687419-1ff1-41db-892f-6b683d2402a7 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] Building network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 12:01:30 user nova-compute[74190]: DEBUG nova.network.neutron [None req-32687419-1ff1-41db-892f-6b683d2402a7 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] Instance cache missing network info. {{(pid=74190) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 12:01:30 user nova-compute[74190]: DEBUG nova.network.neutron [None req-32687419-1ff1-41db-892f-6b683d2402a7 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] Updating instance_info_cache with network_info: [{"id": "9817302c-2890-4026-86e9-061ca2d1497a", "address": "fa:16:3e:5c:73:bc", "network": {"id": "60c208d8-33b0-4c65-8ac5-5632b2e428df", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-39693250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "423525b841c84a6f8fe6a72da9cccef2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9817302c-28", "ovs_interfaceid": "9817302c-2890-4026-86e9-061ca2d1497a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:01:30 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-32687419-1ff1-41db-892f-6b683d2402a7 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Releasing lock "refresh_cache-2f59adf3-9728-4d5b-87d5-2ad32c99d06e" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:01:30 user nova-compute[74190]: DEBUG nova.compute.manager [None req-32687419-1ff1-41db-892f-6b683d2402a7 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] Instance network_info: |[{"id": "9817302c-2890-4026-86e9-061ca2d1497a", "address": "fa:16:3e:5c:73:bc", "network": {"id": "60c208d8-33b0-4c65-8ac5-5632b2e428df", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-39693250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "423525b841c84a6f8fe6a72da9cccef2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9817302c-28", "ovs_interfaceid": "9817302c-2890-4026-86e9-061ca2d1497a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 12:01:30 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-32687419-1ff1-41db-892f-6b683d2402a7 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] Start _get_guest_xml network_info=[{"id": "9817302c-2890-4026-86e9-061ca2d1497a", "address": "fa:16:3e:5c:73:bc", "network": {"id": "60c208d8-33b0-4c65-8ac5-5632b2e428df", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-39693250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "423525b841c84a6f8fe6a72da9cccef2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9817302c-28", "ovs_interfaceid": "9817302c-2890-4026-86e9-061ca2d1497a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'image_id': '6e88bbf0-6e78-49a8-b3c5-9453d22a89df'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 12:01:30 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-32687419-1ff1-41db-892f-6b683d2402a7 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:01:30 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-32687419-1ff1-41db-892f-6b683d2402a7 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:01:30 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-32687419-1ff1-41db-892f-6b683d2402a7 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 12:01:30 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-32687419-1ff1-41db-892f-6b683d2402a7 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] CPU controller missing on host. {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 12:01:30 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-32687419-1ff1-41db-892f-6b683d2402a7 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 12:01:30 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-32687419-1ff1-41db-892f-6b683d2402a7 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] CPU controller found on host. {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 12:01:30 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-32687419-1ff1-41db-892f-6b683d2402a7 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74190) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 12:01:30 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-32687419-1ff1-41db-892f-6b683d2402a7 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T11:37:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 12:01:30 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-32687419-1ff1-41db-892f-6b683d2402a7 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Flavor limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 12:01:30 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-32687419-1ff1-41db-892f-6b683d2402a7 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Image limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 12:01:30 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-32687419-1ff1-41db-892f-6b683d2402a7 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Flavor pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 12:01:30 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-32687419-1ff1-41db-892f-6b683d2402a7 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Image pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 12:01:30 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-32687419-1ff1-41db-892f-6b683d2402a7 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 12:01:30 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-32687419-1ff1-41db-892f-6b683d2402a7 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 12:01:30 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-32687419-1ff1-41db-892f-6b683d2402a7 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 12:01:30 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-32687419-1ff1-41db-892f-6b683d2402a7 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Got 1 possible topologies {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 12:01:30 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-32687419-1ff1-41db-892f-6b683d2402a7 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 12:01:30 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-32687419-1ff1-41db-892f-6b683d2402a7 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 12:01:31 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-32687419-1ff1-41db-892f-6b683d2402a7 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T12:01:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-160859695',display_name='tempest-SnapshotDataIntegrityTests-server-160859695',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-160859695',id=33,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAoBrefW7gGTYZ1vGzIfaFns+zpBXIZgIRz/GbVz4A7rM+NPBLmG/5rvNgs+iv8r28DU+lvEZC2lHUNUDKuI1ygUsQQUo2pfGXfIbpHa2UGFmtdiPFc6hzVHt48ahrdrSA==',key_name='tempest-keypair-685467562',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='423525b841c84a6f8fe6a72da9cccef2',ramdisk_id='',reservation_id='r-7mudxhg5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-180105789',owner_user_name='tempest-SnapshotDataIntegrityTests-180105789-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T12:01:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80066ffc27d14b658f3e0dc8aa0b9faa',uuid=2f59adf3-9728-4d5b-87d5-2ad32c99d06e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9817302c-2890-4026-86e9-061ca2d1497a", "address": "fa:16:3e:5c:73:bc", "network": {"id": "60c208d8-33b0-4c65-8ac5-5632b2e428df", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-39693250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "423525b841c84a6f8fe6a72da9cccef2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9817302c-28", "ovs_interfaceid": "9817302c-2890-4026-86e9-061ca2d1497a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74190) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 12:01:31 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-32687419-1ff1-41db-892f-6b683d2402a7 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Converting VIF {"id": "9817302c-2890-4026-86e9-061ca2d1497a", "address": "fa:16:3e:5c:73:bc", "network": {"id": "60c208d8-33b0-4c65-8ac5-5632b2e428df", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-39693250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "423525b841c84a6f8fe6a72da9cccef2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9817302c-28", "ovs_interfaceid": "9817302c-2890-4026-86e9-061ca2d1497a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 12:01:31 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-32687419-1ff1-41db-892f-6b683d2402a7 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:73:bc,bridge_name='br-int',has_traffic_filtering=True,id=9817302c-2890-4026-86e9-061ca2d1497a,network=Network(60c208d8-33b0-4c65-8ac5-5632b2e428df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9817302c-28') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 12:01:31 user nova-compute[74190]: DEBUG nova.objects.instance [None req-32687419-1ff1-41db-892f-6b683d2402a7 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Lazy-loading 'pci_devices' on Instance uuid 2f59adf3-9728-4d5b-87d5-2ad32c99d06e {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:01:31 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-32687419-1ff1-41db-892f-6b683d2402a7 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] End _get_guest_xml xml=<domain type="kvm">
Oct 18 12:01:31 user nova-compute[74190]:   <uuid>2f59adf3-9728-4d5b-87d5-2ad32c99d06e</uuid>
Oct 18 12:01:31 user nova-compute[74190]:   <name>instance-00000021</name>
Oct 18 12:01:31 user nova-compute[74190]:   <memory>524288</memory>
Oct 18 12:01:31 user nova-compute[74190]:   <vcpu>1</vcpu>
Oct 18 12:01:31 user nova-compute[74190]:   <metadata>
Oct 18 12:01:31 user nova-compute[74190]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 12:01:31 user nova-compute[74190]:       <nova:package version="0.0.0"/>
Oct 18 12:01:31 user nova-compute[74190]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-160859695</nova:name>
Oct 18 12:01:31 user nova-compute[74190]:       <nova:creationTime>2023-10-18 12:01:30</nova:creationTime>
Oct 18 12:01:31 user nova-compute[74190]:       <nova:flavor name="m1.tiny">
Oct 18 12:01:31 user nova-compute[74190]:         <nova:memory>512</nova:memory>
Oct 18 12:01:31 user nova-compute[74190]:         <nova:disk>1</nova:disk>
Oct 18 12:01:31 user nova-compute[74190]:         <nova:swap>0</nova:swap>
Oct 18 12:01:31 user nova-compute[74190]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 12:01:31 user nova-compute[74190]:         <nova:vcpus>1</nova:vcpus>
Oct 18 12:01:31 user nova-compute[74190]:       </nova:flavor>
Oct 18 12:01:31 user nova-compute[74190]:       <nova:owner>
Oct 18 12:01:31 user nova-compute[74190]:         <nova:user uuid="80066ffc27d14b658f3e0dc8aa0b9faa">tempest-SnapshotDataIntegrityTests-180105789-project-member</nova:user>
Oct 18 12:01:31 user nova-compute[74190]:         <nova:project uuid="423525b841c84a6f8fe6a72da9cccef2">tempest-SnapshotDataIntegrityTests-180105789</nova:project>
Oct 18 12:01:31 user nova-compute[74190]:       </nova:owner>
Oct 18 12:01:31 user nova-compute[74190]:       <nova:root type="image" uuid="6e88bbf0-6e78-49a8-b3c5-9453d22a89df"/>
Oct 18 12:01:31 user nova-compute[74190]:       <nova:ports>
Oct 18 12:01:31 user nova-compute[74190]:         <nova:port uuid="9817302c-2890-4026-86e9-061ca2d1497a">
Oct 18 12:01:31 user nova-compute[74190]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 18 12:01:31 user nova-compute[74190]:         </nova:port>
Oct 18 12:01:31 user nova-compute[74190]:       </nova:ports>
Oct 18 12:01:31 user nova-compute[74190]:     </nova:instance>
Oct 18 12:01:31 user nova-compute[74190]:   </metadata>
Oct 18 12:01:31 user nova-compute[74190]:   <sysinfo type="smbios">
Oct 18 12:01:31 user nova-compute[74190]:     <system>
Oct 18 12:01:31 user nova-compute[74190]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 12:01:31 user nova-compute[74190]:       <entry name="product">OpenStack Nova</entry>
Oct 18 12:01:31 user nova-compute[74190]:       <entry name="version">0.0.0</entry>
Oct 18 12:01:31 user nova-compute[74190]:       <entry name="serial">2f59adf3-9728-4d5b-87d5-2ad32c99d06e</entry>
Oct 18 12:01:31 user nova-compute[74190]:       <entry name="uuid">2f59adf3-9728-4d5b-87d5-2ad32c99d06e</entry>
Oct 18 12:01:31 user nova-compute[74190]:       <entry name="family">Virtual Machine</entry>
Oct 18 12:01:31 user nova-compute[74190]:     </system>
Oct 18 12:01:31 user nova-compute[74190]:   </sysinfo>
Oct 18 12:01:31 user nova-compute[74190]:   <os>
Oct 18 12:01:31 user nova-compute[74190]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 12:01:31 user nova-compute[74190]:     <boot dev="hd"/>
Oct 18 12:01:31 user nova-compute[74190]:     <smbios mode="sysinfo"/>
Oct 18 12:01:31 user nova-compute[74190]:   </os>
Oct 18 12:01:31 user nova-compute[74190]:   <features>
Oct 18 12:01:31 user nova-compute[74190]:     <acpi/>
Oct 18 12:01:31 user nova-compute[74190]:     <apic/>
Oct 18 12:01:31 user nova-compute[74190]:     <vmcoreinfo/>
Oct 18 12:01:31 user nova-compute[74190]:   </features>
Oct 18 12:01:31 user nova-compute[74190]:   <clock offset="utc">
Oct 18 12:01:31 user nova-compute[74190]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 12:01:31 user nova-compute[74190]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 12:01:31 user nova-compute[74190]:     <timer name="hpet" present="no"/>
Oct 18 12:01:31 user nova-compute[74190]:   </clock>
Oct 18 12:01:31 user nova-compute[74190]:   <cpu mode="custom" match="exact">
Oct 18 12:01:31 user nova-compute[74190]:     <model>Nehalem</model>
Oct 18 12:01:31 user nova-compute[74190]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 12:01:31 user nova-compute[74190]:   </cpu>
Oct 18 12:01:31 user nova-compute[74190]:   <devices>
Oct 18 12:01:31 user nova-compute[74190]:     <disk type="file" device="disk">
Oct 18 12:01:31 user nova-compute[74190]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 12:01:31 user nova-compute[74190]:       <source file="/opt/stack/data/nova/instances/2f59adf3-9728-4d5b-87d5-2ad32c99d06e/disk"/>
Oct 18 12:01:31 user nova-compute[74190]:       <target dev="vda" bus="virtio"/>
Oct 18 12:01:31 user nova-compute[74190]:     </disk>
Oct 18 12:01:31 user nova-compute[74190]:     <interface type="ethernet">
Oct 18 12:01:31 user nova-compute[74190]:       <mac address="fa:16:3e:5c:73:bc"/>
Oct 18 12:01:31 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 12:01:31 user nova-compute[74190]:       <mtu size="1442"/>
Oct 18 12:01:31 user nova-compute[74190]:       <target dev="tap9817302c-28"/>
Oct 18 12:01:31 user nova-compute[74190]:     </interface>
Oct 18 12:01:31 user nova-compute[74190]:     <serial type="pty">
Oct 18 12:01:31 user nova-compute[74190]:       <log file="/opt/stack/data/nova/instances/2f59adf3-9728-4d5b-87d5-2ad32c99d06e/console.log" append="off"/>
Oct 18 12:01:31 user nova-compute[74190]:     </serial>
Oct 18 12:01:31 user nova-compute[74190]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 12:01:31 user nova-compute[74190]:     <video>
Oct 18 12:01:31 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 12:01:31 user nova-compute[74190]:     </video>
Oct 18 12:01:31 user nova-compute[74190]:     <rng model="virtio">
Oct 18 12:01:31 user nova-compute[74190]:       <backend model="random">/dev/urandom</backend>
Oct 18 12:01:31 user nova-compute[74190]:     </rng>
Oct 18 12:01:31 user nova-compute[74190]:     <controller type="usb" index="0" model="none"/>
Oct 18 12:01:31 user nova-compute[74190]:     <memballoon model="virtio">
Oct 18 12:01:31 user nova-compute[74190]:       <stats period="10"/>
Oct 18 12:01:31 user nova-compute[74190]:     </memballoon>
Oct 18 12:01:31 user nova-compute[74190]:   </devices>
Oct 18 12:01:31 user nova-compute[74190]: </domain>
Oct 18 12:01:31 user nova-compute[74190]:  {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 12:01:31 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-32687419-1ff1-41db-892f-6b683d2402a7 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T12:01:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-160859695',display_name='tempest-SnapshotDataIntegrityTests-server-160859695',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-160859695',id=33,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAoBrefW7gGTYZ1vGzIfaFns+zpBXIZgIRz/GbVz4A7rM+NPBLmG/5rvNgs+iv8r28DU+lvEZC2lHUNUDKuI1ygUsQQUo2pfGXfIbpHa2UGFmtdiPFc6hzVHt48ahrdrSA==',key_name='tempest-keypair-685467562',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='423525b841c84a6f8fe6a72da9cccef2',ramdisk_id='',reservation_id='r-7mudxhg5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-180105789',owner_user_name='tempest-SnapshotDataIntegrityTests-180105789-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T12:01:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80066ffc27d14b658f3e0dc8aa0b9faa',uuid=2f59adf3-9728-4d5b-87d5-2ad32c99d06e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9817302c-2890-4026-86e9-061ca2d1497a", "address": "fa:16:3e:5c:73:bc", "network": {"id": "60c208d8-33b0-4c65-8ac5-5632b2e428df", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-39693250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "423525b841c84a6f8fe6a72da9cccef2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9817302c-28", "ovs_interfaceid": "9817302c-2890-4026-86e9-061ca2d1497a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 12:01:31 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-32687419-1ff1-41db-892f-6b683d2402a7 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Converting VIF {"id": "9817302c-2890-4026-86e9-061ca2d1497a", "address": "fa:16:3e:5c:73:bc", "network": {"id": "60c208d8-33b0-4c65-8ac5-5632b2e428df", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-39693250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "423525b841c84a6f8fe6a72da9cccef2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9817302c-28", "ovs_interfaceid": "9817302c-2890-4026-86e9-061ca2d1497a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 12:01:31 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-32687419-1ff1-41db-892f-6b683d2402a7 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:73:bc,bridge_name='br-int',has_traffic_filtering=True,id=9817302c-2890-4026-86e9-061ca2d1497a,network=Network(60c208d8-33b0-4c65-8ac5-5632b2e428df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9817302c-28') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 12:01:31 user nova-compute[74190]: DEBUG os_vif [None req-32687419-1ff1-41db-892f-6b683d2402a7 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:73:bc,bridge_name='br-int',has_traffic_filtering=True,id=9817302c-2890-4026-86e9-061ca2d1497a,network=Network(60c208d8-33b0-4c65-8ac5-5632b2e428df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9817302c-28') {{(pid=74190) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 12:01:31 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:01:31 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:01:31 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 12:01:31 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:01:31 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '180325fe-e276-5af1-bde0-9723dffcf24a', '_type': 'linux-noop'}}, row=False) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:01:31 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:01:31 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:01:31 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:01:31 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9817302c-28, may_exist=True, interface_attrs={}) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:01:31 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9817302c-28, col_values=(('qos', UUID('5b8d6f47-a34e-43a6-baf1-6efd9d2f6ecd')),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:01:31 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9817302c-28, col_values=(('external_ids', {'iface-id': '9817302c-2890-4026-86e9-061ca2d1497a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:73:bc', 'vm-uuid': '2f59adf3-9728-4d5b-87d5-2ad32c99d06e'}),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:01:31 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:01:31 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:01:31 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:01:31 user nova-compute[74190]: INFO os_vif [None req-32687419-1ff1-41db-892f-6b683d2402a7 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:73:bc,bridge_name='br-int',has_traffic_filtering=True,id=9817302c-2890-4026-86e9-061ca2d1497a,network=Network(60c208d8-33b0-4c65-8ac5-5632b2e428df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9817302c-28')
Oct 18 12:01:31 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-32687419-1ff1-41db-892f-6b683d2402a7 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] No BDM found with device name vda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 12:01:31 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-32687419-1ff1-41db-892f-6b683d2402a7 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] No VIF found with MAC fa:16:3e:5c:73:bc, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 12:01:32 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:01:32 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:01:32 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:01:32 user nova-compute[74190]: DEBUG nova.compute.manager [req-1f40f32e-00bf-4b9a-b0ca-e3c057e3abb9 req-99fdf877-f400-4bdf-901a-f5c770d707a9 service nova] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] Received event network-vif-plugged-9817302c-2890-4026-86e9-061ca2d1497a {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:01:32 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-1f40f32e-00bf-4b9a-b0ca-e3c057e3abb9 req-99fdf877-f400-4bdf-901a-f5c770d707a9 service nova] Acquiring lock "2f59adf3-9728-4d5b-87d5-2ad32c99d06e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:01:32 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-1f40f32e-00bf-4b9a-b0ca-e3c057e3abb9 req-99fdf877-f400-4bdf-901a-f5c770d707a9 service nova] Lock "2f59adf3-9728-4d5b-87d5-2ad32c99d06e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:01:32 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-1f40f32e-00bf-4b9a-b0ca-e3c057e3abb9 req-99fdf877-f400-4bdf-901a-f5c770d707a9 service nova] Lock "2f59adf3-9728-4d5b-87d5-2ad32c99d06e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:01:32 user nova-compute[74190]: DEBUG nova.compute.manager [req-1f40f32e-00bf-4b9a-b0ca-e3c057e3abb9 req-99fdf877-f400-4bdf-901a-f5c770d707a9 service nova] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] No waiting events found dispatching network-vif-plugged-9817302c-2890-4026-86e9-061ca2d1497a {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:01:32 user nova-compute[74190]: WARNING nova.compute.manager [req-1f40f32e-00bf-4b9a-b0ca-e3c057e3abb9 req-99fdf877-f400-4bdf-901a-f5c770d707a9 service nova] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] Received unexpected event network-vif-plugged-9817302c-2890-4026-86e9-061ca2d1497a for instance with vm_state building and task_state spawning.
Oct 18 12:01:33 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:01:33 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:01:33 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:01:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:01:34 user nova-compute[74190]: DEBUG nova.compute.manager [None req-32687419-1ff1-41db-892f-6b683d2402a7 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] Instance event wait completed in 0 seconds for  {{(pid=74190) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 12:01:34 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-32687419-1ff1-41db-892f-6b683d2402a7 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] Guest created on hypervisor {{(pid=74190) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 12:01:34 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] Instance spawned successfully.
Oct 18 12:01:34 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-32687419-1ff1-41db-892f-6b683d2402a7 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 12:01:34 user nova-compute[74190]: DEBUG nova.compute.manager [req-7875f864-123e-428f-895c-cbcdd0d8fe87 req-830562e9-f2cb-485f-9aca-6150c87fdc3a service nova] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] Received event network-vif-plugged-9817302c-2890-4026-86e9-061ca2d1497a {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:01:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-7875f864-123e-428f-895c-cbcdd0d8fe87 req-830562e9-f2cb-485f-9aca-6150c87fdc3a service nova] Acquiring lock "2f59adf3-9728-4d5b-87d5-2ad32c99d06e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:01:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-7875f864-123e-428f-895c-cbcdd0d8fe87 req-830562e9-f2cb-485f-9aca-6150c87fdc3a service nova] Lock "2f59adf3-9728-4d5b-87d5-2ad32c99d06e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:01:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-7875f864-123e-428f-895c-cbcdd0d8fe87 req-830562e9-f2cb-485f-9aca-6150c87fdc3a service nova] Lock "2f59adf3-9728-4d5b-87d5-2ad32c99d06e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:01:34 user nova-compute[74190]: DEBUG nova.compute.manager [req-7875f864-123e-428f-895c-cbcdd0d8fe87 req-830562e9-f2cb-485f-9aca-6150c87fdc3a service nova] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] No waiting events found dispatching network-vif-plugged-9817302c-2890-4026-86e9-061ca2d1497a {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:01:34 user nova-compute[74190]: WARNING nova.compute.manager [req-7875f864-123e-428f-895c-cbcdd0d8fe87 req-830562e9-f2cb-485f-9aca-6150c87fdc3a service nova] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] Received unexpected event network-vif-plugged-9817302c-2890-4026-86e9-061ca2d1497a for instance with vm_state building and task_state spawning.
Oct 18 12:01:34 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-32687419-1ff1-41db-892f-6b683d2402a7 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] Found default for hw_cdrom_bus of ide {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:01:34 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-32687419-1ff1-41db-892f-6b683d2402a7 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] Found default for hw_disk_bus of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:01:34 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-32687419-1ff1-41db-892f-6b683d2402a7 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] Found default for hw_input_bus of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:01:34 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-32687419-1ff1-41db-892f-6b683d2402a7 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] Found default for hw_pointer_model of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:01:34 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-32687419-1ff1-41db-892f-6b683d2402a7 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] Found default for hw_video_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:01:34 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-32687419-1ff1-41db-892f-6b683d2402a7 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] Found default for hw_vif_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:01:34 user nova-compute[74190]: INFO nova.compute.manager [None req-32687419-1ff1-41db-892f-6b683d2402a7 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] Took 5.95 seconds to spawn the instance on the hypervisor.
Oct 18 12:01:34 user nova-compute[74190]: DEBUG nova.compute.manager [None req-32687419-1ff1-41db-892f-6b683d2402a7 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] Checking state {{(pid=74190) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 12:01:35 user nova-compute[74190]: INFO nova.compute.manager [None req-32687419-1ff1-41db-892f-6b683d2402a7 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] Took 6.68 seconds to build instance.
Oct 18 12:01:35 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-32687419-1ff1-41db-892f-6b683d2402a7 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Lock "2f59adf3-9728-4d5b-87d5-2ad32c99d06e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.777s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:01:35 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:01:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:01:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:01:40 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:01:40 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:01:41 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:01:42 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40464fc7-8fac-46fd-a683-655f39d3746d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: 7128c4e8-0118-4138-b421-9b1d610d7454] Calling os-brick to attach iSCSI Volume {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 12:01:42 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-40464fc7-8fac-46fd-a683-655f39d3746d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2cec69f2-df91-41a3-83fe-235889dd0667', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZESUpiyX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 12:01:42 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-40464fc7-8fac-46fd-a683-655f39d3746d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 12:01:42 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-40464fc7-8fac-46fd-a683-655f39d3746d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 12:01:42 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-40464fc7-8fac-46fd-a683-655f39d3746d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 12:01:42 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-40464fc7-8fac-46fd-a683-655f39d3746d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 12:01:42 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-40464fc7-8fac-46fd-a683-655f39d3746d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2cec69f2-df91-41a3-83fe-235889dd0667" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 12:01:42 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-40464fc7-8fac-46fd-a683-655f39d3746d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2cec69f2-df91-41a3-83fe-235889dd0667" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 12:01:42 user nova-compute[74190]: INFO os_brick.initiator.connectors.iscsi [None req-40464fc7-8fac-46fd-a683-655f39d3746d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 12:01:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cec69f2-df91-41a3-83fe-235889dd0667 -p 172.16.0.220:3260 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:01:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cec69f2-df91-41a3-83fe-235889dd0667 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:01:42 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[6369141d-9249-445b-8155-5e2c6f0ceb58]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:01:42 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-40464fc7-8fac-46fd-a683-655f39d3746d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 12:01:42 user nova-compute[74190]:  {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:01:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cec69f2-df91-41a3-83fe-235889dd0667 -p 172.16.0.220:3260 --interface default --op new {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:01:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cec69f2-df91-41a3-83fe-235889dd0667 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:01:42 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a20b4e0-4081-4112-96cd-3d077ae2f851]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2cec69f2-df91-41a3-83fe-235889dd0667] added\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:01:42 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-40464fc7-8fac-46fd-a683-655f39d3746d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2cec69f2-df91-41a3-83fe-235889dd0667] added
Oct 18 12:01:42 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:01:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cec69f2-df91-41a3-83fe-235889dd0667 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:01:42 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:01:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cec69f2-df91-41a3-83fe-235889dd0667 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:01:42 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2c3cec-822c-45c6-928c-acaaddeee8f9]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:01:42 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-40464fc7-8fac-46fd-a683-655f39d3746d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:01:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cec69f2-df91-41a3-83fe-235889dd0667 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:01:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cec69f2-df91-41a3-83fe-235889dd0667 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:01:42 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[9515a7ec-5928-421f-bf51-7b32ea70977c]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:01:42 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-40464fc7-8fac-46fd-a683-655f39d3746d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:01:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cec69f2-df91-41a3-83fe-235889dd0667 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZESUpiyX {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:01:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cec69f2-df91-41a3-83fe-235889dd0667 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZESUpiyX" returned: 0 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:01:42 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be6cc3b-199e-48c6-bf44-78fcaa8b27fd]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:01:42 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-40464fc7-8fac-46fd-a683-655f39d3746d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZESUpiyX'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:01:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cec69f2-df91-41a3-83fe-235889dd0667 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:01:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cec69f2-df91-41a3-83fe-235889dd0667 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:01:42 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b1d9d52-874b-4f4e-9d0c-eeb9641cee7a]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:01:42 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-40464fc7-8fac-46fd-a683-655f39d3746d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:01:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:01:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:01:42 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff9ee2d3-89b7-48d9-950c-d5f8c3643d6d]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:01:42 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-40464fc7-8fac-46fd-a683-655f39d3746d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 12:01:42 user nova-compute[74190]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)
Oct 18 12:01:42 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 12:01:42 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-40464fc7-8fac-46fd-a683-655f39d3746d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 12:01:42 user nova-compute[74190]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)
Oct 18 12:01:42 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 12:01:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cec69f2-df91-41a3-83fe-235889dd0667 -p 172.16.0.220:3260 --login {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:01:43 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cec69f2-df91-41a3-83fe-235889dd0667 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:01:43 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[c394e616-be19-412c-9c62-438077b7856b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2cec69f2-df91-41a3-83fe-235889dd0667, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2cec69f2-df91-41a3-83fe-235889dd0667, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:01:43 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-40464fc7-8fac-46fd-a683-655f39d3746d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2cec69f2-df91-41a3-83fe-235889dd0667, portal: 172.16.0.220,3260]
Oct 18 12:01:43 user nova-compute[74190]: Login to [iface: default, target: iqn.2010-10.org.openstack:2cec69f2-df91-41a3-83fe-235889dd0667, portal: 172.16.0.220,3260] successful.
Oct 18 12:01:43 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:01:43 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cec69f2-df91-41a3-83fe-235889dd0667 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:01:43 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cec69f2-df91-41a3-83fe-235889dd0667 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:01:43 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df2237b-77f2-44db-a93e-a778e40bdaa7]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:01:43 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-40464fc7-8fac-46fd-a683-655f39d3746d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:01:43 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:01:43 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:01:43 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[5902bd5f-21ce-4618-acb0-f6f17e17361c]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cec69f2-df91-41a3-83fe-235889dd0667 (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:01:43 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-40464fc7-8fac-46fd-a683-655f39d3746d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 12:01:43 user nova-compute[74190]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)
Oct 18 12:01:43 user nova-compute[74190]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cec69f2-df91-41a3-83fe-235889dd0667 (non-flash)
Oct 18 12:01:43 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 12:01:43 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-40464fc7-8fac-46fd-a683-655f39d3746d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 12:01:43 user nova-compute[74190]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)
Oct 18 12:01:43 user nova-compute[74190]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cec69f2-df91-41a3-83fe-235889dd0667 (non-flash)
Oct 18 12:01:43 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 12:01:43 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-40464fc7-8fac-46fd-a683-655f39d3746d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2cec69f2-df91-41a3-83fe-235889dd0667" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 12:01:43 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-40464fc7-8fac-46fd-a683-655f39d3746d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Connected to 172.16.0.220:3260 {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 12:01:43 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-40464fc7-8fac-46fd-a683-655f39d3746d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] HCTL ('35', '-', '-', 0) found on session 38 with lun 0 {{(pid=74190) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 12:01:43 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-40464fc7-8fac-46fd-a683-655f39d3746d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74190) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 12:01:43 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:01:43 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:01:43 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f3987fe-0cc8-457d-8daf-41d0210f393e]: (4, ('- - 0', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:01:43 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-40464fc7-8fac-46fd-a683-655f39d3746d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Searching for a device in session 38 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74190) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 12:01:43 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-40464fc7-8fac-46fd-a683-655f39d3746d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:2cec69f2-df91-41a3-83fe-235889dd0667', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZESUpiyX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 12:01:44 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-40464fc7-8fac-46fd-a683-655f39d3746d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 12:01:44 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-40464fc7-8fac-46fd-a683-655f39d3746d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '26437626561333636', 'path': '/dev/sdd'} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 12:01:44 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40464fc7-8fac-46fd-a683-655f39d3746d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: 7128c4e8-0118-4138-b421-9b1d610d7454] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26437626561333636', 'path': '/dev/sdd'} {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 12:01:44 user nova-compute[74190]: DEBUG nova.objects.instance [None req-40464fc7-8fac-46fd-a683-655f39d3746d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lazy-loading 'flavor' on Instance uuid 7128c4e8-0118-4138-b421-9b1d610d7454 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:01:44 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-40464fc7-8fac-46fd-a683-655f39d3746d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] attach device xml: <disk type="block" device="disk">
Oct 18 12:01:44 user nova-compute[74190]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 12:01:44 user nova-compute[74190]:   <source dev="/dev/sdd"/>
Oct 18 12:01:44 user nova-compute[74190]:   <target dev="vdb" bus="virtio"/>
Oct 18 12:01:44 user nova-compute[74190]:   <serial>2cec69f2-df91-41a3-83fe-235889dd0667</serial>
Oct 18 12:01:44 user nova-compute[74190]: </disk>
Oct 18 12:01:44 user nova-compute[74190]:  {{(pid=74190) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 18 12:01:44 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-0e13ad73-986b-40d4-82eb-6b8a798d0002 tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] Acquiring lock "14ba5fe8-567e-40c8-9d69-b54af521b2bc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:01:44 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-0e13ad73-986b-40d4-82eb-6b8a798d0002 tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] Lock "14ba5fe8-567e-40c8-9d69-b54af521b2bc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:01:44 user nova-compute[74190]: DEBUG nova.compute.manager [None req-0e13ad73-986b-40d4-82eb-6b8a798d0002 tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] [instance: 14ba5fe8-567e-40c8-9d69-b54af521b2bc] Starting instance... {{(pid=74190) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 12:01:44 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-0e13ad73-986b-40d4-82eb-6b8a798d0002 tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:01:44 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-0e13ad73-986b-40d4-82eb-6b8a798d0002 tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:01:44 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-0e13ad73-986b-40d4-82eb-6b8a798d0002 tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74190) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 12:01:44 user nova-compute[74190]: INFO nova.compute.claims [None req-0e13ad73-986b-40d4-82eb-6b8a798d0002 tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] [instance: 14ba5fe8-567e-40c8-9d69-b54af521b2bc] Claim successful on node user
Oct 18 12:01:44 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-40464fc7-8fac-46fd-a683-655f39d3746d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] No BDM found with device name vda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 12:01:44 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-40464fc7-8fac-46fd-a683-655f39d3746d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 12:01:44 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-40464fc7-8fac-46fd-a683-655f39d3746d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] No VIF found with MAC fa:16:3e:d1:de:c2, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 12:01:44 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-0e13ad73-986b-40d4-82eb-6b8a798d0002 tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 12:01:44 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-0e13ad73-986b-40d4-82eb-6b8a798d0002 tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 12:01:44 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-40464fc7-8fac-46fd-a683-655f39d3746d tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "7128c4e8-0118-4138-b421-9b1d610d7454" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.605s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:01:44 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-0e13ad73-986b-40d4-82eb-6b8a798d0002 tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.363s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:01:44 user nova-compute[74190]: DEBUG nova.compute.manager [None req-0e13ad73-986b-40d4-82eb-6b8a798d0002 tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] [instance: 14ba5fe8-567e-40c8-9d69-b54af521b2bc] Start building networks asynchronously for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 12:01:44 user nova-compute[74190]: DEBUG nova.compute.manager [None req-0e13ad73-986b-40d4-82eb-6b8a798d0002 tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] [instance: 14ba5fe8-567e-40c8-9d69-b54af521b2bc] Allocating IP information in the background. {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 12:01:44 user nova-compute[74190]: DEBUG nova.network.neutron [None req-0e13ad73-986b-40d4-82eb-6b8a798d0002 tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] [instance: 14ba5fe8-567e-40c8-9d69-b54af521b2bc] allocate_for_instance() {{(pid=74190) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 12:01:44 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-0e13ad73-986b-40d4-82eb-6b8a798d0002 tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] [instance: 14ba5fe8-567e-40c8-9d69-b54af521b2bc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 12:01:44 user nova-compute[74190]: DEBUG nova.compute.manager [None req-0e13ad73-986b-40d4-82eb-6b8a798d0002 tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] [instance: 14ba5fe8-567e-40c8-9d69-b54af521b2bc] Start building block device mappings for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 12:01:44 user nova-compute[74190]: DEBUG nova.policy [None req-0e13ad73-986b-40d4-82eb-6b8a798d0002 tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '72efa980b59f48c0943f3de85181ff4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0bf9fda5ac74ffc8bbdb02d9073bb3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74190) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 12:01:44 user nova-compute[74190]: DEBUG nova.compute.manager [None req-0e13ad73-986b-40d4-82eb-6b8a798d0002 tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] [instance: 14ba5fe8-567e-40c8-9d69-b54af521b2bc] Start spawning the instance on the hypervisor. {{(pid=74190) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 12:01:44 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-0e13ad73-986b-40d4-82eb-6b8a798d0002 tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] [instance: 14ba5fe8-567e-40c8-9d69-b54af521b2bc] Creating instance directory {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 12:01:44 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-0e13ad73-986b-40d4-82eb-6b8a798d0002 tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] [instance: 14ba5fe8-567e-40c8-9d69-b54af521b2bc] Creating image(s)
Oct 18 12:01:44 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-0e13ad73-986b-40d4-82eb-6b8a798d0002 tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] Acquiring lock "/opt/stack/data/nova/instances/14ba5fe8-567e-40c8-9d69-b54af521b2bc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:01:44 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-0e13ad73-986b-40d4-82eb-6b8a798d0002 tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] Lock "/opt/stack/data/nova/instances/14ba5fe8-567e-40c8-9d69-b54af521b2bc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:01:44 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-0e13ad73-986b-40d4-82eb-6b8a798d0002 tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] Lock "/opt/stack/data/nova/instances/14ba5fe8-567e-40c8-9d69-b54af521b2bc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:01:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-0e13ad73-986b-40d4-82eb-6b8a798d0002 tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:01:45 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:01:45 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-0e13ad73-986b-40d4-82eb-6b8a798d0002 tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.191s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:01:45 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-0e13ad73-986b-40d4-82eb-6b8a798d0002 tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] Acquiring lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:01:45 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-0e13ad73-986b-40d4-82eb-6b8a798d0002 tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] Lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:01:45 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-0e13ad73-986b-40d4-82eb-6b8a798d0002 tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:01:45 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-0e13ad73-986b-40d4-82eb-6b8a798d0002 tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.186s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:01:45 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-0e13ad73-986b-40d4-82eb-6b8a798d0002 tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f,backing_fmt=raw /opt/stack/data/nova/instances/14ba5fe8-567e-40c8-9d69-b54af521b2bc/disk 1073741824 {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:01:45 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:01:45 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-0e13ad73-986b-40d4-82eb-6b8a798d0002 tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f,backing_fmt=raw /opt/stack/data/nova/instances/14ba5fe8-567e-40c8-9d69-b54af521b2bc/disk 1073741824" returned: 0 in 0.058s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:01:45 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-0e13ad73-986b-40d4-82eb-6b8a798d0002 tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] Lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:01:45 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-0e13ad73-986b-40d4-82eb-6b8a798d0002 tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:01:45 user nova-compute[74190]: DEBUG nova.network.neutron [None req-0e13ad73-986b-40d4-82eb-6b8a798d0002 tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] [instance: 14ba5fe8-567e-40c8-9d69-b54af521b2bc] Successfully created port: cb5a7e63-9321-4ca6-b619-61c96cf114dc {{(pid=74190) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 12:01:45 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-0e13ad73-986b-40d4-82eb-6b8a798d0002 tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.175s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:01:45 user nova-compute[74190]: DEBUG nova.virt.disk.api [None req-0e13ad73-986b-40d4-82eb-6b8a798d0002 tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] Checking if we can resize image /opt/stack/data/nova/instances/14ba5fe8-567e-40c8-9d69-b54af521b2bc/disk. size=1073741824 {{(pid=74190) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 18 12:01:45 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-0e13ad73-986b-40d4-82eb-6b8a798d0002 tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14ba5fe8-567e-40c8-9d69-b54af521b2bc/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:01:45 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-0e13ad73-986b-40d4-82eb-6b8a798d0002 tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14ba5fe8-567e-40c8-9d69-b54af521b2bc/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:01:45 user nova-compute[74190]: DEBUG nova.virt.disk.api [None req-0e13ad73-986b-40d4-82eb-6b8a798d0002 tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] Cannot resize image /opt/stack/data/nova/instances/14ba5fe8-567e-40c8-9d69-b54af521b2bc/disk to a smaller size. {{(pid=74190) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 18 12:01:45 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-0e13ad73-986b-40d4-82eb-6b8a798d0002 tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] [instance: 14ba5fe8-567e-40c8-9d69-b54af521b2bc] Created local disks {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 12:01:45 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-0e13ad73-986b-40d4-82eb-6b8a798d0002 tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] [instance: 14ba5fe8-567e-40c8-9d69-b54af521b2bc] Ensure instance console log exists: /opt/stack/data/nova/instances/14ba5fe8-567e-40c8-9d69-b54af521b2bc/console.log {{(pid=74190) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 12:01:45 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-0e13ad73-986b-40d4-82eb-6b8a798d0002 tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:01:45 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-0e13ad73-986b-40d4-82eb-6b8a798d0002 tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:01:45 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-0e13ad73-986b-40d4-82eb-6b8a798d0002 tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:01:46 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:01:46 user nova-compute[74190]: DEBUG nova.network.neutron [None req-0e13ad73-986b-40d4-82eb-6b8a798d0002 tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] [instance: 14ba5fe8-567e-40c8-9d69-b54af521b2bc] Successfully updated port: cb5a7e63-9321-4ca6-b619-61c96cf114dc {{(pid=74190) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 12:01:46 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-cec24f9c-5e7d-49f1-a5e0-26735b1b8fbc tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Acquiring lock "7128c4e8-0118-4138-b421-9b1d610d7454" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:01:46 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-cec24f9c-5e7d-49f1-a5e0-26735b1b8fbc tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "7128c4e8-0118-4138-b421-9b1d610d7454" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:01:46 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-0e13ad73-986b-40d4-82eb-6b8a798d0002 tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] Acquiring lock "refresh_cache-14ba5fe8-567e-40c8-9d69-b54af521b2bc" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:01:46 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-0e13ad73-986b-40d4-82eb-6b8a798d0002 tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] Acquired lock "refresh_cache-14ba5fe8-567e-40c8-9d69-b54af521b2bc" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:01:46 user nova-compute[74190]: DEBUG nova.network.neutron [None req-0e13ad73-986b-40d4-82eb-6b8a798d0002 tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] [instance: 14ba5fe8-567e-40c8-9d69-b54af521b2bc] Building network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 12:01:46 user nova-compute[74190]: DEBUG nova.compute.manager [req-091a007b-d42e-451b-b6d0-550d49f46e51 req-a3da926a-dc12-4d12-86b9-5193e29204f7 service nova] [instance: 14ba5fe8-567e-40c8-9d69-b54af521b2bc] Received event network-changed-cb5a7e63-9321-4ca6-b619-61c96cf114dc {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:01:46 user nova-compute[74190]: DEBUG nova.compute.manager [req-091a007b-d42e-451b-b6d0-550d49f46e51 req-a3da926a-dc12-4d12-86b9-5193e29204f7 service nova] [instance: 14ba5fe8-567e-40c8-9d69-b54af521b2bc] Refreshing instance network info cache due to event network-changed-cb5a7e63-9321-4ca6-b619-61c96cf114dc. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 12:01:46 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-091a007b-d42e-451b-b6d0-550d49f46e51 req-a3da926a-dc12-4d12-86b9-5193e29204f7 service nova] Acquiring lock "refresh_cache-14ba5fe8-567e-40c8-9d69-b54af521b2bc" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:01:46 user nova-compute[74190]: INFO nova.compute.manager [None req-cec24f9c-5e7d-49f1-a5e0-26735b1b8fbc tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: 7128c4e8-0118-4138-b421-9b1d610d7454] Detaching volume 2cec69f2-df91-41a3-83fe-235889dd0667
Oct 18 12:01:46 user nova-compute[74190]: DEBUG nova.network.neutron [None req-0e13ad73-986b-40d4-82eb-6b8a798d0002 tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] [instance: 14ba5fe8-567e-40c8-9d69-b54af521b2bc] Instance cache missing network info. {{(pid=74190) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 12:01:46 user nova-compute[74190]: INFO nova.virt.block_device [None req-cec24f9c-5e7d-49f1-a5e0-26735b1b8fbc tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: 7128c4e8-0118-4138-b421-9b1d610d7454] Attempting to driver detach volume 2cec69f2-df91-41a3-83fe-235889dd0667 from mountpoint /dev/vdb
Oct 18 12:01:46 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-cec24f9c-5e7d-49f1-a5e0-26735b1b8fbc tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Attempting to detach device vdb from instance 7128c4e8-0118-4138-b421-9b1d610d7454 from the persistent domain config. {{(pid=74190) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 18 12:01:46 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-cec24f9c-5e7d-49f1-a5e0-26735b1b8fbc tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 12:01:46 user nova-compute[74190]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 12:01:46 user nova-compute[74190]:   <source dev="/dev/sdd"/>
Oct 18 12:01:46 user nova-compute[74190]:   <target dev="vdb" bus="virtio"/>
Oct 18 12:01:46 user nova-compute[74190]:   <serial>2cec69f2-df91-41a3-83fe-235889dd0667</serial>
Oct 18 12:01:46 user nova-compute[74190]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 18 12:01:46 user nova-compute[74190]: </disk>
Oct 18 12:01:46 user nova-compute[74190]:  {{(pid=74190) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 12:01:46 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-cec24f9c-5e7d-49f1-a5e0-26735b1b8fbc tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Successfully detached device vdb from instance 7128c4e8-0118-4138-b421-9b1d610d7454 from the persistent domain config.
Oct 18 12:01:46 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-cec24f9c-5e7d-49f1-a5e0-26735b1b8fbc tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7128c4e8-0118-4138-b421-9b1d610d7454 from the live domain config. {{(pid=74190) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 18 12:01:46 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-cec24f9c-5e7d-49f1-a5e0-26735b1b8fbc tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 12:01:46 user nova-compute[74190]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 12:01:46 user nova-compute[74190]:   <source dev="/dev/sdd"/>
Oct 18 12:01:46 user nova-compute[74190]:   <target dev="vdb" bus="virtio"/>
Oct 18 12:01:46 user nova-compute[74190]:   <serial>2cec69f2-df91-41a3-83fe-235889dd0667</serial>
Oct 18 12:01:46 user nova-compute[74190]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 18 12:01:46 user nova-compute[74190]: </disk>
Oct 18 12:01:46 user nova-compute[74190]:  {{(pid=74190) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 12:01:46 user nova-compute[74190]: DEBUG nova.network.neutron [None req-0e13ad73-986b-40d4-82eb-6b8a798d0002 tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] [instance: 14ba5fe8-567e-40c8-9d69-b54af521b2bc] Updating instance_info_cache with network_info: [{"id": "cb5a7e63-9321-4ca6-b619-61c96cf114dc", "address": "fa:16:3e:b1:a3:69", "network": {"id": "5376a65d-deb9-42e1-abe5-29deda5fd3ad", "bridge": "br-int", "label": "tempest-VolumesActionsTest-589402019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0bf9fda5ac74ffc8bbdb02d9073bb3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb5a7e63-93", "ovs_interfaceid": "cb5a7e63-9321-4ca6-b619-61c96cf114dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:01:46 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-0e13ad73-986b-40d4-82eb-6b8a798d0002 tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] Releasing lock "refresh_cache-14ba5fe8-567e-40c8-9d69-b54af521b2bc" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:01:46 user nova-compute[74190]: DEBUG nova.compute.manager [None req-0e13ad73-986b-40d4-82eb-6b8a798d0002 tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] [instance: 14ba5fe8-567e-40c8-9d69-b54af521b2bc] Instance network_info: |[{"id": "cb5a7e63-9321-4ca6-b619-61c96cf114dc", "address": "fa:16:3e:b1:a3:69", "network": {"id": "5376a65d-deb9-42e1-abe5-29deda5fd3ad", "bridge": "br-int", "label": "tempest-VolumesActionsTest-589402019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0bf9fda5ac74ffc8bbdb02d9073bb3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb5a7e63-93", "ovs_interfaceid": "cb5a7e63-9321-4ca6-b619-61c96cf114dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 12:01:46 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-091a007b-d42e-451b-b6d0-550d49f46e51 req-a3da926a-dc12-4d12-86b9-5193e29204f7 service nova] Acquired lock "refresh_cache-14ba5fe8-567e-40c8-9d69-b54af521b2bc" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:01:46 user nova-compute[74190]: DEBUG nova.network.neutron [req-091a007b-d42e-451b-b6d0-550d49f46e51 req-a3da926a-dc12-4d12-86b9-5193e29204f7 service nova] [instance: 14ba5fe8-567e-40c8-9d69-b54af521b2bc] Refreshing network info cache for port cb5a7e63-9321-4ca6-b619-61c96cf114dc {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 12:01:46 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-0e13ad73-986b-40d4-82eb-6b8a798d0002 tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] [instance: 14ba5fe8-567e-40c8-9d69-b54af521b2bc] Start _get_guest_xml network_info=[{"id": "cb5a7e63-9321-4ca6-b619-61c96cf114dc", "address": "fa:16:3e:b1:a3:69", "network": {"id": "5376a65d-deb9-42e1-abe5-29deda5fd3ad", "bridge": "br-int", "label": "tempest-VolumesActionsTest-589402019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0bf9fda5ac74ffc8bbdb02d9073bb3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb5a7e63-93", "ovs_interfaceid": "cb5a7e63-9321-4ca6-b619-61c96cf114dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'image_id': '6e88bbf0-6e78-49a8-b3c5-9453d22a89df'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 12:01:46 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-0e13ad73-986b-40d4-82eb-6b8a798d0002 tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:01:46 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-0e13ad73-986b-40d4-82eb-6b8a798d0002 tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:01:46 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-0e13ad73-986b-40d4-82eb-6b8a798d0002 tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 12:01:46 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-0e13ad73-986b-40d4-82eb-6b8a798d0002 tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] CPU controller missing on host. {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 12:01:46 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-0e13ad73-986b-40d4-82eb-6b8a798d0002 tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 12:01:46 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-0e13ad73-986b-40d4-82eb-6b8a798d0002 tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] CPU controller found on host. {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 12:01:46 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-0e13ad73-986b-40d4-82eb-6b8a798d0002 tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74190) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 12:01:46 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-0e13ad73-986b-40d4-82eb-6b8a798d0002 tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T11:37:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 12:01:46 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-0e13ad73-986b-40d4-82eb-6b8a798d0002 tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] Flavor limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 12:01:46 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-0e13ad73-986b-40d4-82eb-6b8a798d0002 tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] Image limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 12:01:46 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-0e13ad73-986b-40d4-82eb-6b8a798d0002 tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] Flavor pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 12:01:46 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-0e13ad73-986b-40d4-82eb-6b8a798d0002 tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] Image pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 12:01:46 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-0e13ad73-986b-40d4-82eb-6b8a798d0002 tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 12:01:46 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-0e13ad73-986b-40d4-82eb-6b8a798d0002 tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 12:01:46 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-0e13ad73-986b-40d4-82eb-6b8a798d0002 tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 12:01:46 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-0e13ad73-986b-40d4-82eb-6b8a798d0002 tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] Got 1 possible topologies {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 12:01:46 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-0e13ad73-986b-40d4-82eb-6b8a798d0002 tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 12:01:46 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-0e13ad73-986b-40d4-82eb-6b8a798d0002 tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 12:01:46 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-0e13ad73-986b-40d4-82eb-6b8a798d0002 tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T12:01:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1176474461',display_name='tempest-VolumesActionsTest-instance-1176474461',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1176474461',id=34,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e0bf9fda5ac74ffc8bbdb02d9073bb3b',ramdisk_id='',reservation_id='r-3cliy041',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1589100911',owner_user_name='tempest-VolumesActionsTest-1589100911-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T12:01:45Z,user_data=None,user_id='72efa980b59f48c0943f3de85181ff4f',uuid=14ba5fe8-567e-40c8-9d69-b54af521b2bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb5a7e63-9321-4ca6-b619-61c96cf114dc", "address": "fa:16:3e:b1:a3:69", "network": {"id": "5376a65d-deb9-42e1-abe5-29deda5fd3ad", "bridge": "br-int", "label": "tempest-VolumesActionsTest-589402019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0bf9fda5ac74ffc8bbdb02d9073bb3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb5a7e63-93", "ovs_interfaceid": "cb5a7e63-9321-4ca6-b619-61c96cf114dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74190) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 12:01:46 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-0e13ad73-986b-40d4-82eb-6b8a798d0002 tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] Converting VIF {"id": "cb5a7e63-9321-4ca6-b619-61c96cf114dc", "address": "fa:16:3e:b1:a3:69", "network": {"id": "5376a65d-deb9-42e1-abe5-29deda5fd3ad", "bridge": "br-int", "label": "tempest-VolumesActionsTest-589402019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0bf9fda5ac74ffc8bbdb02d9073bb3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb5a7e63-93", "ovs_interfaceid": "cb5a7e63-9321-4ca6-b619-61c96cf114dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 12:01:46 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-0e13ad73-986b-40d4-82eb-6b8a798d0002 tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:a3:69,bridge_name='br-int',has_traffic_filtering=True,id=cb5a7e63-9321-4ca6-b619-61c96cf114dc,network=Network(5376a65d-deb9-42e1-abe5-29deda5fd3ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb5a7e63-93') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 12:01:46 user nova-compute[74190]: DEBUG nova.objects.instance [None req-0e13ad73-986b-40d4-82eb-6b8a798d0002 tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] Lazy-loading 'pci_devices' on Instance uuid 14ba5fe8-567e-40c8-9d69-b54af521b2bc {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:01:46 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-0e13ad73-986b-40d4-82eb-6b8a798d0002 tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] [instance: 14ba5fe8-567e-40c8-9d69-b54af521b2bc] End _get_guest_xml xml=<domain type="kvm">
Oct 18 12:01:46 user nova-compute[74190]:   <uuid>14ba5fe8-567e-40c8-9d69-b54af521b2bc</uuid>
Oct 18 12:01:46 user nova-compute[74190]:   <name>instance-00000022</name>
Oct 18 12:01:46 user nova-compute[74190]:   <memory>524288</memory>
Oct 18 12:01:46 user nova-compute[74190]:   <vcpu>1</vcpu>
Oct 18 12:01:46 user nova-compute[74190]:   <metadata>
Oct 18 12:01:46 user nova-compute[74190]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 12:01:46 user nova-compute[74190]:       <nova:package version="0.0.0"/>
Oct 18 12:01:46 user nova-compute[74190]:       <nova:name>tempest-VolumesActionsTest-instance-1176474461</nova:name>
Oct 18 12:01:46 user nova-compute[74190]:       <nova:creationTime>2023-10-18 12:01:46</nova:creationTime>
Oct 18 12:01:46 user nova-compute[74190]:       <nova:flavor name="m1.tiny">
Oct 18 12:01:46 user nova-compute[74190]:         <nova:memory>512</nova:memory>
Oct 18 12:01:46 user nova-compute[74190]:         <nova:disk>1</nova:disk>
Oct 18 12:01:46 user nova-compute[74190]:         <nova:swap>0</nova:swap>
Oct 18 12:01:46 user nova-compute[74190]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 12:01:46 user nova-compute[74190]:         <nova:vcpus>1</nova:vcpus>
Oct 18 12:01:46 user nova-compute[74190]:       </nova:flavor>
Oct 18 12:01:46 user nova-compute[74190]:       <nova:owner>
Oct 18 12:01:46 user nova-compute[74190]:         <nova:user uuid="72efa980b59f48c0943f3de85181ff4f">tempest-VolumesActionsTest-1589100911-project-member</nova:user>
Oct 18 12:01:46 user nova-compute[74190]:         <nova:project uuid="e0bf9fda5ac74ffc8bbdb02d9073bb3b">tempest-VolumesActionsTest-1589100911</nova:project>
Oct 18 12:01:46 user nova-compute[74190]:       </nova:owner>
Oct 18 12:01:46 user nova-compute[74190]:       <nova:root type="image" uuid="6e88bbf0-6e78-49a8-b3c5-9453d22a89df"/>
Oct 18 12:01:46 user nova-compute[74190]:       <nova:ports>
Oct 18 12:01:46 user nova-compute[74190]:         <nova:port uuid="cb5a7e63-9321-4ca6-b619-61c96cf114dc">
Oct 18 12:01:46 user nova-compute[74190]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 18 12:01:46 user nova-compute[74190]:         </nova:port>
Oct 18 12:01:46 user nova-compute[74190]:       </nova:ports>
Oct 18 12:01:46 user nova-compute[74190]:     </nova:instance>
Oct 18 12:01:46 user nova-compute[74190]:   </metadata>
Oct 18 12:01:46 user nova-compute[74190]:   <sysinfo type="smbios">
Oct 18 12:01:46 user nova-compute[74190]:     <system>
Oct 18 12:01:46 user nova-compute[74190]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 12:01:46 user nova-compute[74190]:       <entry name="product">OpenStack Nova</entry>
Oct 18 12:01:46 user nova-compute[74190]:       <entry name="version">0.0.0</entry>
Oct 18 12:01:46 user nova-compute[74190]:       <entry name="serial">14ba5fe8-567e-40c8-9d69-b54af521b2bc</entry>
Oct 18 12:01:46 user nova-compute[74190]:       <entry name="uuid">14ba5fe8-567e-40c8-9d69-b54af521b2bc</entry>
Oct 18 12:01:46 user nova-compute[74190]:       <entry name="family">Virtual Machine</entry>
Oct 18 12:01:46 user nova-compute[74190]:     </system>
Oct 18 12:01:46 user nova-compute[74190]:   </sysinfo>
Oct 18 12:01:46 user nova-compute[74190]:   <os>
Oct 18 12:01:46 user nova-compute[74190]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 12:01:46 user nova-compute[74190]:     <boot dev="hd"/>
Oct 18 12:01:46 user nova-compute[74190]:     <smbios mode="sysinfo"/>
Oct 18 12:01:46 user nova-compute[74190]:   </os>
Oct 18 12:01:46 user nova-compute[74190]:   <features>
Oct 18 12:01:46 user nova-compute[74190]:     <acpi/>
Oct 18 12:01:46 user nova-compute[74190]:     <apic/>
Oct 18 12:01:46 user nova-compute[74190]:     <vmcoreinfo/>
Oct 18 12:01:46 user nova-compute[74190]:   </features>
Oct 18 12:01:46 user nova-compute[74190]:   <clock offset="utc">
Oct 18 12:01:46 user nova-compute[74190]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 12:01:46 user nova-compute[74190]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 12:01:46 user nova-compute[74190]:     <timer name="hpet" present="no"/>
Oct 18 12:01:46 user nova-compute[74190]:   </clock>
Oct 18 12:01:46 user nova-compute[74190]:   <cpu mode="custom" match="exact">
Oct 18 12:01:46 user nova-compute[74190]:     <model>Nehalem</model>
Oct 18 12:01:46 user nova-compute[74190]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 12:01:46 user nova-compute[74190]:   </cpu>
Oct 18 12:01:46 user nova-compute[74190]:   <devices>
Oct 18 12:01:46 user nova-compute[74190]:     <disk type="file" device="disk">
Oct 18 12:01:46 user nova-compute[74190]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 12:01:46 user nova-compute[74190]:       <source file="/opt/stack/data/nova/instances/14ba5fe8-567e-40c8-9d69-b54af521b2bc/disk"/>
Oct 18 12:01:46 user nova-compute[74190]:       <target dev="vda" bus="virtio"/>
Oct 18 12:01:46 user nova-compute[74190]:     </disk>
Oct 18 12:01:46 user nova-compute[74190]:     <interface type="ethernet">
Oct 18 12:01:46 user nova-compute[74190]:       <mac address="fa:16:3e:b1:a3:69"/>
Oct 18 12:01:46 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 12:01:46 user nova-compute[74190]:       <mtu size="1442"/>
Oct 18 12:01:46 user nova-compute[74190]:       <target dev="tapcb5a7e63-93"/>
Oct 18 12:01:46 user nova-compute[74190]:     </interface>
Oct 18 12:01:46 user nova-compute[74190]:     <serial type="pty">
Oct 18 12:01:46 user nova-compute[74190]:       <log file="/opt/stack/data/nova/instances/14ba5fe8-567e-40c8-9d69-b54af521b2bc/console.log" append="off"/>
Oct 18 12:01:46 user nova-compute[74190]:     </serial>
Oct 18 12:01:46 user nova-compute[74190]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 12:01:46 user nova-compute[74190]:     <video>
Oct 18 12:01:46 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 12:01:46 user nova-compute[74190]:     </video>
Oct 18 12:01:46 user nova-compute[74190]:     <rng model="virtio">
Oct 18 12:01:46 user nova-compute[74190]:       <backend model="random">/dev/urandom</backend>
Oct 18 12:01:46 user nova-compute[74190]:     </rng>
Oct 18 12:01:46 user nova-compute[74190]:     <controller type="usb" index="0" model="none"/>
Oct 18 12:01:46 user nova-compute[74190]:     <memballoon model="virtio">
Oct 18 12:01:46 user nova-compute[74190]:       <stats period="10"/>
Oct 18 12:01:46 user nova-compute[74190]:     </memballoon>
Oct 18 12:01:46 user nova-compute[74190]:   </devices>
Oct 18 12:01:46 user nova-compute[74190]: </domain>
Oct 18 12:01:46 user nova-compute[74190]:  {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 12:01:46 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-0e13ad73-986b-40d4-82eb-6b8a798d0002 tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T12:01:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1176474461',display_name='tempest-VolumesActionsTest-instance-1176474461',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1176474461',id=34,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e0bf9fda5ac74ffc8bbdb02d9073bb3b',ramdisk_id='',reservation_id='r-3cliy041',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1589100911',owner_user_name='tempest-VolumesActionsTest-1589100911-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T12:01:45Z,user_data=None,user_id='72efa980b59f48c0943f3de85181ff4f',uuid=14ba5fe8-567e-40c8-9d69-b54af521b2bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb5a7e63-9321-4ca6-b619-61c96cf114dc", "address": "fa:16:3e:b1:a3:69", "network": {"id": "5376a65d-deb9-42e1-abe5-29deda5fd3ad", "bridge": "br-int", "label": "tempest-VolumesActionsTest-589402019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0bf9fda5ac74ffc8bbdb02d9073bb3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb5a7e63-93", "ovs_interfaceid": "cb5a7e63-9321-4ca6-b619-61c96cf114dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 12:01:46 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-0e13ad73-986b-40d4-82eb-6b8a798d0002 tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] Converting VIF {"id": "cb5a7e63-9321-4ca6-b619-61c96cf114dc", "address": "fa:16:3e:b1:a3:69", "network": {"id": "5376a65d-deb9-42e1-abe5-29deda5fd3ad", "bridge": "br-int", "label": "tempest-VolumesActionsTest-589402019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0bf9fda5ac74ffc8bbdb02d9073bb3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb5a7e63-93", "ovs_interfaceid": "cb5a7e63-9321-4ca6-b619-61c96cf114dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 12:01:46 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-0e13ad73-986b-40d4-82eb-6b8a798d0002 tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:a3:69,bridge_name='br-int',has_traffic_filtering=True,id=cb5a7e63-9321-4ca6-b619-61c96cf114dc,network=Network(5376a65d-deb9-42e1-abe5-29deda5fd3ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb5a7e63-93') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 12:01:46 user nova-compute[74190]: DEBUG os_vif [None req-0e13ad73-986b-40d4-82eb-6b8a798d0002 tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:a3:69,bridge_name='br-int',has_traffic_filtering=True,id=cb5a7e63-9321-4ca6-b619-61c96cf114dc,network=Network(5376a65d-deb9-42e1-abe5-29deda5fd3ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb5a7e63-93') {{(pid=74190) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 12:01:46 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:01:46 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:01:46 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 12:01:46 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:01:46 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3231ef54-a999-5352-ab9d-289b80523bdf', '_type': 'linux-noop'}}, row=False) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:01:46 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:01:46 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:01:46 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:01:46 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcb5a7e63-93, may_exist=True, interface_attrs={}) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:01:46 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcb5a7e63-93, col_values=(('qos', UUID('ebde6956-df66-490a-aa54-4a796f217b31')),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:01:46 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcb5a7e63-93, col_values=(('external_ids', {'iface-id': 'cb5a7e63-9321-4ca6-b619-61c96cf114dc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b1:a3:69', 'vm-uuid': '14ba5fe8-567e-40c8-9d69-b54af521b2bc'}),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:01:46 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:01:46 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:01:46 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:01:46 user nova-compute[74190]: INFO os_vif [None req-0e13ad73-986b-40d4-82eb-6b8a798d0002 tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:a3:69,bridge_name='br-int',has_traffic_filtering=True,id=cb5a7e63-9321-4ca6-b619-61c96cf114dc,network=Network(5376a65d-deb9-42e1-abe5-29deda5fd3ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb5a7e63-93')
Oct 18 12:01:46 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-0e13ad73-986b-40d4-82eb-6b8a798d0002 tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] No BDM found with device name vda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 12:01:46 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-0e13ad73-986b-40d4-82eb-6b8a798d0002 tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] No VIF found with MAC fa:16:3e:b1:a3:69, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 12:01:46 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-cec24f9c-5e7d-49f1-a5e0-26735b1b8fbc tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7128c4e8-0118-4138-b421-9b1d610d7454 {{(pid=74190) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 18 12:01:47 user nova-compute[74190]: DEBUG nova.network.neutron [req-091a007b-d42e-451b-b6d0-550d49f46e51 req-a3da926a-dc12-4d12-86b9-5193e29204f7 service nova] [instance: 14ba5fe8-567e-40c8-9d69-b54af521b2bc] Updated VIF entry in instance network info cache for port cb5a7e63-9321-4ca6-b619-61c96cf114dc. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 12:01:47 user nova-compute[74190]: DEBUG nova.network.neutron [req-091a007b-d42e-451b-b6d0-550d49f46e51 req-a3da926a-dc12-4d12-86b9-5193e29204f7 service nova] [instance: 14ba5fe8-567e-40c8-9d69-b54af521b2bc] Updating instance_info_cache with network_info: [{"id": "cb5a7e63-9321-4ca6-b619-61c96cf114dc", "address": "fa:16:3e:b1:a3:69", "network": {"id": "5376a65d-deb9-42e1-abe5-29deda5fd3ad", "bridge": "br-int", "label": "tempest-VolumesActionsTest-589402019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0bf9fda5ac74ffc8bbdb02d9073bb3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb5a7e63-93", "ovs_interfaceid": "cb5a7e63-9321-4ca6-b619-61c96cf114dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:01:47 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-091a007b-d42e-451b-b6d0-550d49f46e51 req-a3da926a-dc12-4d12-86b9-5193e29204f7 service nova] Releasing lock "refresh_cache-14ba5fe8-567e-40c8-9d69-b54af521b2bc" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:01:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:01:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:01:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:01:48 user nova-compute[74190]: DEBUG nova.compute.manager [req-a29fcda0-49a7-4677-a8e1-55758b348582 req-624382e8-6e45-425a-afa3-9b3b1ad96802 service nova] [instance: 14ba5fe8-567e-40c8-9d69-b54af521b2bc] Received event network-vif-plugged-cb5a7e63-9321-4ca6-b619-61c96cf114dc {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:01:48 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-a29fcda0-49a7-4677-a8e1-55758b348582 req-624382e8-6e45-425a-afa3-9b3b1ad96802 service nova] Acquiring lock "14ba5fe8-567e-40c8-9d69-b54af521b2bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:01:48 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-a29fcda0-49a7-4677-a8e1-55758b348582 req-624382e8-6e45-425a-afa3-9b3b1ad96802 service nova] Lock "14ba5fe8-567e-40c8-9d69-b54af521b2bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:01:48 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-a29fcda0-49a7-4677-a8e1-55758b348582 req-624382e8-6e45-425a-afa3-9b3b1ad96802 service nova] Lock "14ba5fe8-567e-40c8-9d69-b54af521b2bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:01:48 user nova-compute[74190]: DEBUG nova.compute.manager [req-a29fcda0-49a7-4677-a8e1-55758b348582 req-624382e8-6e45-425a-afa3-9b3b1ad96802 service nova] [instance: 14ba5fe8-567e-40c8-9d69-b54af521b2bc] No waiting events found dispatching network-vif-plugged-cb5a7e63-9321-4ca6-b619-61c96cf114dc {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:01:48 user nova-compute[74190]: WARNING nova.compute.manager [req-a29fcda0-49a7-4677-a8e1-55758b348582 req-624382e8-6e45-425a-afa3-9b3b1ad96802 service nova] [instance: 14ba5fe8-567e-40c8-9d69-b54af521b2bc] Received unexpected event network-vif-plugged-cb5a7e63-9321-4ca6-b619-61c96cf114dc for instance with vm_state building and task_state spawning.
Oct 18 12:01:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:01:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:01:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:01:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:01:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:01:49 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-749627d1-3d0c-46e2-8349-7f307a8643e2 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Acquiring lock "a79ff814-dec6-4022-a7b6-5420861a2164" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:01:49 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-749627d1-3d0c-46e2-8349-7f307a8643e2 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Lock "a79ff814-dec6-4022-a7b6-5420861a2164" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:01:49 user nova-compute[74190]: DEBUG nova.compute.manager [None req-749627d1-3d0c-46e2-8349-7f307a8643e2 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] [instance: a79ff814-dec6-4022-a7b6-5420861a2164] Starting instance... {{(pid=74190) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 12:01:49 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-749627d1-3d0c-46e2-8349-7f307a8643e2 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:01:49 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-749627d1-3d0c-46e2-8349-7f307a8643e2 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:01:49 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-749627d1-3d0c-46e2-8349-7f307a8643e2 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74190) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 12:01:49 user nova-compute[74190]: INFO nova.compute.claims [None req-749627d1-3d0c-46e2-8349-7f307a8643e2 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] [instance: a79ff814-dec6-4022-a7b6-5420861a2164] Claim successful on node user
Oct 18 12:01:49 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-749627d1-3d0c-46e2-8349-7f307a8643e2 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 12:01:49 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-749627d1-3d0c-46e2-8349-7f307a8643e2 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 12:01:49 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-749627d1-3d0c-46e2-8349-7f307a8643e2 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.384s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:01:49 user nova-compute[74190]: DEBUG nova.compute.manager [None req-749627d1-3d0c-46e2-8349-7f307a8643e2 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] [instance: a79ff814-dec6-4022-a7b6-5420861a2164] Start building networks asynchronously for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 12:01:49 user nova-compute[74190]: DEBUG nova.compute.manager [None req-749627d1-3d0c-46e2-8349-7f307a8643e2 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] [instance: a79ff814-dec6-4022-a7b6-5420861a2164] Allocating IP information in the background. {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 12:01:49 user nova-compute[74190]: DEBUG nova.network.neutron [None req-749627d1-3d0c-46e2-8349-7f307a8643e2 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] [instance: a79ff814-dec6-4022-a7b6-5420861a2164] allocate_for_instance() {{(pid=74190) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 12:01:49 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-749627d1-3d0c-46e2-8349-7f307a8643e2 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] [instance: a79ff814-dec6-4022-a7b6-5420861a2164] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 12:01:49 user nova-compute[74190]: DEBUG nova.compute.manager [None req-749627d1-3d0c-46e2-8349-7f307a8643e2 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] [instance: a79ff814-dec6-4022-a7b6-5420861a2164] Start building block device mappings for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 12:01:49 user nova-compute[74190]: DEBUG nova.policy [None req-749627d1-3d0c-46e2-8349-7f307a8643e2 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b0ef25ad27f64ac8a423b867e0f7b836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ed99f026894d569a13d0854fab0a17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74190) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 12:01:50 user nova-compute[74190]: DEBUG nova.compute.manager [None req-749627d1-3d0c-46e2-8349-7f307a8643e2 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] [instance: a79ff814-dec6-4022-a7b6-5420861a2164] Start spawning the instance on the hypervisor. {{(pid=74190) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 12:01:50 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-749627d1-3d0c-46e2-8349-7f307a8643e2 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] [instance: a79ff814-dec6-4022-a7b6-5420861a2164] Creating instance directory {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 12:01:50 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-749627d1-3d0c-46e2-8349-7f307a8643e2 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] [instance: a79ff814-dec6-4022-a7b6-5420861a2164] Creating image(s)
Oct 18 12:01:50 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-749627d1-3d0c-46e2-8349-7f307a8643e2 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Acquiring lock "/opt/stack/data/nova/instances/a79ff814-dec6-4022-a7b6-5420861a2164/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:01:50 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-749627d1-3d0c-46e2-8349-7f307a8643e2 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Lock "/opt/stack/data/nova/instances/a79ff814-dec6-4022-a7b6-5420861a2164/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:01:50 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-749627d1-3d0c-46e2-8349-7f307a8643e2 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Lock "/opt/stack/data/nova/instances/a79ff814-dec6-4022-a7b6-5420861a2164/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:01:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-749627d1-3d0c-46e2-8349-7f307a8643e2 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:01:50 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:01:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-749627d1-3d0c-46e2-8349-7f307a8643e2 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.189s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:01:50 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-749627d1-3d0c-46e2-8349-7f307a8643e2 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Acquiring lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:01:50 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-749627d1-3d0c-46e2-8349-7f307a8643e2 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:01:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-749627d1-3d0c-46e2-8349-7f307a8643e2 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:01:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-749627d1-3d0c-46e2-8349-7f307a8643e2 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.172s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:01:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-749627d1-3d0c-46e2-8349-7f307a8643e2 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f,backing_fmt=raw /opt/stack/data/nova/instances/a79ff814-dec6-4022-a7b6-5420861a2164/disk 1073741824 {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:01:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-749627d1-3d0c-46e2-8349-7f307a8643e2 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f,backing_fmt=raw /opt/stack/data/nova/instances/a79ff814-dec6-4022-a7b6-5420861a2164/disk 1073741824" returned: 0 in 0.058s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:01:50 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-749627d1-3d0c-46e2-8349-7f307a8643e2 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:01:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-749627d1-3d0c-46e2-8349-7f307a8643e2 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:01:50 user nova-compute[74190]: DEBUG nova.compute.manager [req-24c1a36f-826a-438f-a08f-509ab79f3f2b req-a44967a2-3555-4818-935e-a1fee7f69fbd service nova] [instance: 14ba5fe8-567e-40c8-9d69-b54af521b2bc] Received event network-vif-plugged-cb5a7e63-9321-4ca6-b619-61c96cf114dc {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:01:50 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-24c1a36f-826a-438f-a08f-509ab79f3f2b req-a44967a2-3555-4818-935e-a1fee7f69fbd service nova] Acquiring lock "14ba5fe8-567e-40c8-9d69-b54af521b2bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:01:50 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-24c1a36f-826a-438f-a08f-509ab79f3f2b req-a44967a2-3555-4818-935e-a1fee7f69fbd service nova] Lock "14ba5fe8-567e-40c8-9d69-b54af521b2bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:01:50 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-24c1a36f-826a-438f-a08f-509ab79f3f2b req-a44967a2-3555-4818-935e-a1fee7f69fbd service nova] Lock "14ba5fe8-567e-40c8-9d69-b54af521b2bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:01:50 user nova-compute[74190]: DEBUG nova.compute.manager [req-24c1a36f-826a-438f-a08f-509ab79f3f2b req-a44967a2-3555-4818-935e-a1fee7f69fbd service nova] [instance: 14ba5fe8-567e-40c8-9d69-b54af521b2bc] No waiting events found dispatching network-vif-plugged-cb5a7e63-9321-4ca6-b619-61c96cf114dc {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:01:50 user nova-compute[74190]: WARNING nova.compute.manager [req-24c1a36f-826a-438f-a08f-509ab79f3f2b req-a44967a2-3555-4818-935e-a1fee7f69fbd service nova] [instance: 14ba5fe8-567e-40c8-9d69-b54af521b2bc] Received unexpected event network-vif-plugged-cb5a7e63-9321-4ca6-b619-61c96cf114dc for instance with vm_state building and task_state spawning.
Oct 18 12:01:50 user nova-compute[74190]: DEBUG nova.network.neutron [None req-749627d1-3d0c-46e2-8349-7f307a8643e2 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] [instance: a79ff814-dec6-4022-a7b6-5420861a2164] Successfully created port: 53f42091-aa79-4aaf-8156-ecab4252e286 {{(pid=74190) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 12:01:50 user nova-compute[74190]: DEBUG nova.compute.manager [None req-0e13ad73-986b-40d4-82eb-6b8a798d0002 tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] [instance: 14ba5fe8-567e-40c8-9d69-b54af521b2bc] Instance event wait completed in 0 seconds for  {{(pid=74190) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 12:01:50 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-0e13ad73-986b-40d4-82eb-6b8a798d0002 tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] [instance: 14ba5fe8-567e-40c8-9d69-b54af521b2bc] Guest created on hypervisor {{(pid=74190) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 12:01:50 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 14ba5fe8-567e-40c8-9d69-b54af521b2bc] Instance spawned successfully.
Oct 18 12:01:50 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-0e13ad73-986b-40d4-82eb-6b8a798d0002 tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] [instance: 14ba5fe8-567e-40c8-9d69-b54af521b2bc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 12:01:50 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-0e13ad73-986b-40d4-82eb-6b8a798d0002 tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] [instance: 14ba5fe8-567e-40c8-9d69-b54af521b2bc] Found default for hw_cdrom_bus of ide {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:01:50 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-0e13ad73-986b-40d4-82eb-6b8a798d0002 tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] [instance: 14ba5fe8-567e-40c8-9d69-b54af521b2bc] Found default for hw_disk_bus of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:01:50 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-0e13ad73-986b-40d4-82eb-6b8a798d0002 tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] [instance: 14ba5fe8-567e-40c8-9d69-b54af521b2bc] Found default for hw_input_bus of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:01:50 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-0e13ad73-986b-40d4-82eb-6b8a798d0002 tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] [instance: 14ba5fe8-567e-40c8-9d69-b54af521b2bc] Found default for hw_pointer_model of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:01:50 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-0e13ad73-986b-40d4-82eb-6b8a798d0002 tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] [instance: 14ba5fe8-567e-40c8-9d69-b54af521b2bc] Found default for hw_video_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:01:50 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-0e13ad73-986b-40d4-82eb-6b8a798d0002 tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] [instance: 14ba5fe8-567e-40c8-9d69-b54af521b2bc] Found default for hw_vif_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:01:50 user nova-compute[74190]: INFO nova.compute.manager [None req-0e13ad73-986b-40d4-82eb-6b8a798d0002 tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] [instance: 14ba5fe8-567e-40c8-9d69-b54af521b2bc] Took 5.68 seconds to spawn the instance on the hypervisor.
Oct 18 12:01:50 user nova-compute[74190]: DEBUG nova.compute.manager [None req-0e13ad73-986b-40d4-82eb-6b8a798d0002 tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] [instance: 14ba5fe8-567e-40c8-9d69-b54af521b2bc] Checking state {{(pid=74190) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 12:01:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-749627d1-3d0c-46e2-8349-7f307a8643e2 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.206s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:01:50 user nova-compute[74190]: DEBUG nova.virt.disk.api [None req-749627d1-3d0c-46e2-8349-7f307a8643e2 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a79ff814-dec6-4022-a7b6-5420861a2164/disk. size=1073741824 {{(pid=74190) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 18 12:01:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-749627d1-3d0c-46e2-8349-7f307a8643e2 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a79ff814-dec6-4022-a7b6-5420861a2164/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:01:50 user nova-compute[74190]: INFO nova.compute.manager [None req-0e13ad73-986b-40d4-82eb-6b8a798d0002 tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] [instance: 14ba5fe8-567e-40c8-9d69-b54af521b2bc] Took 6.37 seconds to build instance.
Oct 18 12:01:50 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-0e13ad73-986b-40d4-82eb-6b8a798d0002 tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] Lock "14ba5fe8-567e-40c8-9d69-b54af521b2bc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.460s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:01:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-749627d1-3d0c-46e2-8349-7f307a8643e2 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a79ff814-dec6-4022-a7b6-5420861a2164/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:01:50 user nova-compute[74190]: DEBUG nova.virt.disk.api [None req-749627d1-3d0c-46e2-8349-7f307a8643e2 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Cannot resize image /opt/stack/data/nova/instances/a79ff814-dec6-4022-a7b6-5420861a2164/disk to a smaller size. {{(pid=74190) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 18 12:01:50 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-749627d1-3d0c-46e2-8349-7f307a8643e2 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] [instance: a79ff814-dec6-4022-a7b6-5420861a2164] Created local disks {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 12:01:50 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-749627d1-3d0c-46e2-8349-7f307a8643e2 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] [instance: a79ff814-dec6-4022-a7b6-5420861a2164] Ensure instance console log exists: /opt/stack/data/nova/instances/a79ff814-dec6-4022-a7b6-5420861a2164/console.log {{(pid=74190) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 12:01:50 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-749627d1-3d0c-46e2-8349-7f307a8643e2 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:01:50 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-749627d1-3d0c-46e2-8349-7f307a8643e2 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:01:50 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-749627d1-3d0c-46e2-8349-7f307a8643e2 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:01:51 user nova-compute[74190]: DEBUG nova.network.neutron [None req-749627d1-3d0c-46e2-8349-7f307a8643e2 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] [instance: a79ff814-dec6-4022-a7b6-5420861a2164] Successfully updated port: 53f42091-aa79-4aaf-8156-ecab4252e286 {{(pid=74190) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 12:01:51 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-749627d1-3d0c-46e2-8349-7f307a8643e2 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Acquiring lock "refresh_cache-a79ff814-dec6-4022-a7b6-5420861a2164" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:01:51 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-749627d1-3d0c-46e2-8349-7f307a8643e2 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Acquired lock "refresh_cache-a79ff814-dec6-4022-a7b6-5420861a2164" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:01:51 user nova-compute[74190]: DEBUG nova.network.neutron [None req-749627d1-3d0c-46e2-8349-7f307a8643e2 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] [instance: a79ff814-dec6-4022-a7b6-5420861a2164] Building network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 12:01:51 user nova-compute[74190]: DEBUG nova.network.neutron [None req-749627d1-3d0c-46e2-8349-7f307a8643e2 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] [instance: a79ff814-dec6-4022-a7b6-5420861a2164] Instance cache missing network info. {{(pid=74190) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 12:01:51 user nova-compute[74190]: DEBUG nova.network.neutron [None req-749627d1-3d0c-46e2-8349-7f307a8643e2 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] [instance: a79ff814-dec6-4022-a7b6-5420861a2164] Updating instance_info_cache with network_info: [{"id": "53f42091-aa79-4aaf-8156-ecab4252e286", "address": "fa:16:3e:13:78:c3", "network": {"id": "d143b91a-fbcd-40d0-b199-381c523b8a0c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-175467972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62ed99f026894d569a13d0854fab0a17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53f42091-aa", "ovs_interfaceid": "53f42091-aa79-4aaf-8156-ecab4252e286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:01:51 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-749627d1-3d0c-46e2-8349-7f307a8643e2 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Releasing lock "refresh_cache-a79ff814-dec6-4022-a7b6-5420861a2164" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:01:51 user nova-compute[74190]: DEBUG nova.compute.manager [None req-749627d1-3d0c-46e2-8349-7f307a8643e2 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] [instance: a79ff814-dec6-4022-a7b6-5420861a2164] Instance network_info: |[{"id": "53f42091-aa79-4aaf-8156-ecab4252e286", "address": "fa:16:3e:13:78:c3", "network": {"id": "d143b91a-fbcd-40d0-b199-381c523b8a0c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-175467972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62ed99f026894d569a13d0854fab0a17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53f42091-aa", "ovs_interfaceid": "53f42091-aa79-4aaf-8156-ecab4252e286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 12:01:51 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-749627d1-3d0c-46e2-8349-7f307a8643e2 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] [instance: a79ff814-dec6-4022-a7b6-5420861a2164] Start _get_guest_xml network_info=[{"id": "53f42091-aa79-4aaf-8156-ecab4252e286", "address": "fa:16:3e:13:78:c3", "network": {"id": "d143b91a-fbcd-40d0-b199-381c523b8a0c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-175467972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62ed99f026894d569a13d0854fab0a17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53f42091-aa", "ovs_interfaceid": "53f42091-aa79-4aaf-8156-ecab4252e286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'image_id': '6e88bbf0-6e78-49a8-b3c5-9453d22a89df'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 12:01:51 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-749627d1-3d0c-46e2-8349-7f307a8643e2 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:01:51 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-749627d1-3d0c-46e2-8349-7f307a8643e2 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:01:51 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-749627d1-3d0c-46e2-8349-7f307a8643e2 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 12:01:51 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-749627d1-3d0c-46e2-8349-7f307a8643e2 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] CPU controller missing on host. {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 12:01:51 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-749627d1-3d0c-46e2-8349-7f307a8643e2 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 12:01:51 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-749627d1-3d0c-46e2-8349-7f307a8643e2 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] CPU controller found on host. {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 12:01:51 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-749627d1-3d0c-46e2-8349-7f307a8643e2 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74190) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 12:01:51 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-749627d1-3d0c-46e2-8349-7f307a8643e2 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T11:37:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 12:01:51 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-749627d1-3d0c-46e2-8349-7f307a8643e2 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Flavor limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 12:01:51 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-749627d1-3d0c-46e2-8349-7f307a8643e2 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Image limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 12:01:51 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-749627d1-3d0c-46e2-8349-7f307a8643e2 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Flavor pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 12:01:51 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-749627d1-3d0c-46e2-8349-7f307a8643e2 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Image pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 12:01:51 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-749627d1-3d0c-46e2-8349-7f307a8643e2 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 12:01:51 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-749627d1-3d0c-46e2-8349-7f307a8643e2 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 12:01:51 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-749627d1-3d0c-46e2-8349-7f307a8643e2 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 12:01:51 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-749627d1-3d0c-46e2-8349-7f307a8643e2 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Got 1 possible topologies {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 12:01:51 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-749627d1-3d0c-46e2-8349-7f307a8643e2 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 12:01:51 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-749627d1-3d0c-46e2-8349-7f307a8643e2 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 12:01:51 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-749627d1-3d0c-46e2-8349-7f307a8643e2 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T12:01:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-307323474',display_name='tempest-VolumesActionsTest-instance-307323474',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-307323474',id=35,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62ed99f026894d569a13d0854fab0a17',ramdisk_id='',reservation_id='r-26bb83et',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-563901414',owner_user_name='tempest-VolumesActionsTest-563901414-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T12:01:50Z,user_data=None,user_id='b0ef25ad27f64ac8a423b867e0f7b836',uuid=a79ff814-dec6-4022-a7b6-5420861a2164,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "53f42091-aa79-4aaf-8156-ecab4252e286", "address": "fa:16:3e:13:78:c3", "network": {"id": "d143b91a-fbcd-40d0-b199-381c523b8a0c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-175467972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62ed99f026894d569a13d0854fab0a17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53f42091-aa", "ovs_interfaceid": "53f42091-aa79-4aaf-8156-ecab4252e286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74190) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 12:01:51 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-749627d1-3d0c-46e2-8349-7f307a8643e2 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Converting VIF {"id": "53f42091-aa79-4aaf-8156-ecab4252e286", "address": "fa:16:3e:13:78:c3", "network": {"id": "d143b91a-fbcd-40d0-b199-381c523b8a0c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-175467972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62ed99f026894d569a13d0854fab0a17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53f42091-aa", "ovs_interfaceid": "53f42091-aa79-4aaf-8156-ecab4252e286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 12:01:51 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-749627d1-3d0c-46e2-8349-7f307a8643e2 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:78:c3,bridge_name='br-int',has_traffic_filtering=True,id=53f42091-aa79-4aaf-8156-ecab4252e286,network=Network(d143b91a-fbcd-40d0-b199-381c523b8a0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53f42091-aa') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 12:01:51 user nova-compute[74190]: DEBUG nova.objects.instance [None req-749627d1-3d0c-46e2-8349-7f307a8643e2 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Lazy-loading 'pci_devices' on Instance uuid a79ff814-dec6-4022-a7b6-5420861a2164 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:01:51 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-749627d1-3d0c-46e2-8349-7f307a8643e2 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] [instance: a79ff814-dec6-4022-a7b6-5420861a2164] End _get_guest_xml xml=<domain type="kvm">
Oct 18 12:01:51 user nova-compute[74190]:   <uuid>a79ff814-dec6-4022-a7b6-5420861a2164</uuid>
Oct 18 12:01:51 user nova-compute[74190]:   <name>instance-00000023</name>
Oct 18 12:01:51 user nova-compute[74190]:   <memory>524288</memory>
Oct 18 12:01:51 user nova-compute[74190]:   <vcpu>1</vcpu>
Oct 18 12:01:51 user nova-compute[74190]:   <metadata>
Oct 18 12:01:51 user nova-compute[74190]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 12:01:51 user nova-compute[74190]:       <nova:package version="0.0.0"/>
Oct 18 12:01:51 user nova-compute[74190]:       <nova:name>tempest-VolumesActionsTest-instance-307323474</nova:name>
Oct 18 12:01:51 user nova-compute[74190]:       <nova:creationTime>2023-10-18 12:01:51</nova:creationTime>
Oct 18 12:01:51 user nova-compute[74190]:       <nova:flavor name="m1.tiny">
Oct 18 12:01:51 user nova-compute[74190]:         <nova:memory>512</nova:memory>
Oct 18 12:01:51 user nova-compute[74190]:         <nova:disk>1</nova:disk>
Oct 18 12:01:51 user nova-compute[74190]:         <nova:swap>0</nova:swap>
Oct 18 12:01:51 user nova-compute[74190]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 12:01:51 user nova-compute[74190]:         <nova:vcpus>1</nova:vcpus>
Oct 18 12:01:51 user nova-compute[74190]:       </nova:flavor>
Oct 18 12:01:51 user nova-compute[74190]:       <nova:owner>
Oct 18 12:01:51 user nova-compute[74190]:         <nova:user uuid="b0ef25ad27f64ac8a423b867e0f7b836">tempest-VolumesActionsTest-563901414-project-member</nova:user>
Oct 18 12:01:51 user nova-compute[74190]:         <nova:project uuid="62ed99f026894d569a13d0854fab0a17">tempest-VolumesActionsTest-563901414</nova:project>
Oct 18 12:01:51 user nova-compute[74190]:       </nova:owner>
Oct 18 12:01:51 user nova-compute[74190]:       <nova:root type="image" uuid="6e88bbf0-6e78-49a8-b3c5-9453d22a89df"/>
Oct 18 12:01:51 user nova-compute[74190]:       <nova:ports>
Oct 18 12:01:51 user nova-compute[74190]:         <nova:port uuid="53f42091-aa79-4aaf-8156-ecab4252e286">
Oct 18 12:01:51 user nova-compute[74190]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 18 12:01:51 user nova-compute[74190]:         </nova:port>
Oct 18 12:01:51 user nova-compute[74190]:       </nova:ports>
Oct 18 12:01:51 user nova-compute[74190]:     </nova:instance>
Oct 18 12:01:51 user nova-compute[74190]:   </metadata>
Oct 18 12:01:51 user nova-compute[74190]:   <sysinfo type="smbios">
Oct 18 12:01:51 user nova-compute[74190]:     <system>
Oct 18 12:01:51 user nova-compute[74190]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 12:01:51 user nova-compute[74190]:       <entry name="product">OpenStack Nova</entry>
Oct 18 12:01:51 user nova-compute[74190]:       <entry name="version">0.0.0</entry>
Oct 18 12:01:51 user nova-compute[74190]:       <entry name="serial">a79ff814-dec6-4022-a7b6-5420861a2164</entry>
Oct 18 12:01:51 user nova-compute[74190]:       <entry name="uuid">a79ff814-dec6-4022-a7b6-5420861a2164</entry>
Oct 18 12:01:51 user nova-compute[74190]:       <entry name="family">Virtual Machine</entry>
Oct 18 12:01:51 user nova-compute[74190]:     </system>
Oct 18 12:01:51 user nova-compute[74190]:   </sysinfo>
Oct 18 12:01:51 user nova-compute[74190]:   <os>
Oct 18 12:01:51 user nova-compute[74190]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 12:01:51 user nova-compute[74190]:     <boot dev="hd"/>
Oct 18 12:01:51 user nova-compute[74190]:     <smbios mode="sysinfo"/>
Oct 18 12:01:51 user nova-compute[74190]:   </os>
Oct 18 12:01:51 user nova-compute[74190]:   <features>
Oct 18 12:01:51 user nova-compute[74190]:     <acpi/>
Oct 18 12:01:51 user nova-compute[74190]:     <apic/>
Oct 18 12:01:51 user nova-compute[74190]:     <vmcoreinfo/>
Oct 18 12:01:51 user nova-compute[74190]:   </features>
Oct 18 12:01:51 user nova-compute[74190]:   <clock offset="utc">
Oct 18 12:01:51 user nova-compute[74190]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 12:01:51 user nova-compute[74190]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 12:01:51 user nova-compute[74190]:     <timer name="hpet" present="no"/>
Oct 18 12:01:51 user nova-compute[74190]:   </clock>
Oct 18 12:01:51 user nova-compute[74190]:   <cpu mode="custom" match="exact">
Oct 18 12:01:51 user nova-compute[74190]:     <model>Nehalem</model>
Oct 18 12:01:51 user nova-compute[74190]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 12:01:51 user nova-compute[74190]:   </cpu>
Oct 18 12:01:51 user nova-compute[74190]:   <devices>
Oct 18 12:01:51 user nova-compute[74190]:     <disk type="file" device="disk">
Oct 18 12:01:51 user nova-compute[74190]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 12:01:51 user nova-compute[74190]:       <source file="/opt/stack/data/nova/instances/a79ff814-dec6-4022-a7b6-5420861a2164/disk"/>
Oct 18 12:01:51 user nova-compute[74190]:       <target dev="vda" bus="virtio"/>
Oct 18 12:01:51 user nova-compute[74190]:     </disk>
Oct 18 12:01:51 user nova-compute[74190]:     <interface type="ethernet">
Oct 18 12:01:51 user nova-compute[74190]:       <mac address="fa:16:3e:13:78:c3"/>
Oct 18 12:01:51 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 12:01:51 user nova-compute[74190]:       <mtu size="1442"/>
Oct 18 12:01:51 user nova-compute[74190]:       <target dev="tap53f42091-aa"/>
Oct 18 12:01:51 user nova-compute[74190]:     </interface>
Oct 18 12:01:51 user nova-compute[74190]:     <serial type="pty">
Oct 18 12:01:51 user nova-compute[74190]:       <log file="/opt/stack/data/nova/instances/a79ff814-dec6-4022-a7b6-5420861a2164/console.log" append="off"/>
Oct 18 12:01:51 user nova-compute[74190]:     </serial>
Oct 18 12:01:51 user nova-compute[74190]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 12:01:51 user nova-compute[74190]:     <video>
Oct 18 12:01:51 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 12:01:51 user nova-compute[74190]:     </video>
Oct 18 12:01:51 user nova-compute[74190]:     <rng model="virtio">
Oct 18 12:01:51 user nova-compute[74190]:       <backend model="random">/dev/urandom</backend>
Oct 18 12:01:51 user nova-compute[74190]:     </rng>
Oct 18 12:01:51 user nova-compute[74190]:     <controller type="usb" index="0" model="none"/>
Oct 18 12:01:51 user nova-compute[74190]:     <memballoon model="virtio">
Oct 18 12:01:51 user nova-compute[74190]:       <stats period="10"/>
Oct 18 12:01:51 user nova-compute[74190]:     </memballoon>
Oct 18 12:01:51 user nova-compute[74190]:   </devices>
Oct 18 12:01:51 user nova-compute[74190]: </domain>
Oct 18 12:01:51 user nova-compute[74190]:  {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 12:01:51 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-749627d1-3d0c-46e2-8349-7f307a8643e2 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T12:01:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-307323474',display_name='tempest-VolumesActionsTest-instance-307323474',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-307323474',id=35,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62ed99f026894d569a13d0854fab0a17',ramdisk_id='',reservation_id='r-26bb83et',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-563901414',owner_user_name='tempest-VolumesActionsTest-563901414-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T12:01:50Z,user_data=None,user_id='b0ef25ad27f64ac8a423b867e0f7b836',uuid=a79ff814-dec6-4022-a7b6-5420861a2164,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "53f42091-aa79-4aaf-8156-ecab4252e286", "address": "fa:16:3e:13:78:c3", "network": {"id": "d143b91a-fbcd-40d0-b199-381c523b8a0c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-175467972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62ed99f026894d569a13d0854fab0a17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53f42091-aa", "ovs_interfaceid": "53f42091-aa79-4aaf-8156-ecab4252e286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 12:01:51 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-749627d1-3d0c-46e2-8349-7f307a8643e2 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Converting VIF {"id": "53f42091-aa79-4aaf-8156-ecab4252e286", "address": "fa:16:3e:13:78:c3", "network": {"id": "d143b91a-fbcd-40d0-b199-381c523b8a0c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-175467972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62ed99f026894d569a13d0854fab0a17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53f42091-aa", "ovs_interfaceid": "53f42091-aa79-4aaf-8156-ecab4252e286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 12:01:51 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-749627d1-3d0c-46e2-8349-7f307a8643e2 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:78:c3,bridge_name='br-int',has_traffic_filtering=True,id=53f42091-aa79-4aaf-8156-ecab4252e286,network=Network(d143b91a-fbcd-40d0-b199-381c523b8a0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53f42091-aa') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 12:01:51 user nova-compute[74190]: DEBUG os_vif [None req-749627d1-3d0c-46e2-8349-7f307a8643e2 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:78:c3,bridge_name='br-int',has_traffic_filtering=True,id=53f42091-aa79-4aaf-8156-ecab4252e286,network=Network(d143b91a-fbcd-40d0-b199-381c523b8a0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53f42091-aa') {{(pid=74190) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 12:01:51 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:01:51 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:01:51 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 12:01:51 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:01:51 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0478e2df-9680-5d79-aa4b-6ba6e352520d', '_type': 'linux-noop'}}, row=False) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:01:51 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:01:51 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:01:51 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:01:51 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap53f42091-aa, may_exist=True, interface_attrs={}) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:01:51 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap53f42091-aa, col_values=(('qos', UUID('e22bc24d-bec4-4c3c-a55c-ffbb52e49c61')),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:01:51 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap53f42091-aa, col_values=(('external_ids', {'iface-id': '53f42091-aa79-4aaf-8156-ecab4252e286', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:78:c3', 'vm-uuid': 'a79ff814-dec6-4022-a7b6-5420861a2164'}),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:01:51 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:01:51 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:01:51 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:01:51 user nova-compute[74190]: INFO os_vif [None req-749627d1-3d0c-46e2-8349-7f307a8643e2 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:78:c3,bridge_name='br-int',has_traffic_filtering=True,id=53f42091-aa79-4aaf-8156-ecab4252e286,network=Network(d143b91a-fbcd-40d0-b199-381c523b8a0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53f42091-aa')
Oct 18 12:01:51 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-749627d1-3d0c-46e2-8349-7f307a8643e2 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] No BDM found with device name vda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 12:01:51 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-749627d1-3d0c-46e2-8349-7f307a8643e2 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] No VIF found with MAC fa:16:3e:13:78:c3, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 12:01:52 user nova-compute[74190]: DEBUG nova.compute.manager [req-2e5d95f9-fb52-40fe-905a-1ca830108c68 req-d4589c41-14cf-4c6c-941a-1f6a128cd8a6 service nova] [instance: a79ff814-dec6-4022-a7b6-5420861a2164] Received event network-changed-53f42091-aa79-4aaf-8156-ecab4252e286 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:01:52 user nova-compute[74190]: DEBUG nova.compute.manager [req-2e5d95f9-fb52-40fe-905a-1ca830108c68 req-d4589c41-14cf-4c6c-941a-1f6a128cd8a6 service nova] [instance: a79ff814-dec6-4022-a7b6-5420861a2164] Refreshing instance network info cache due to event network-changed-53f42091-aa79-4aaf-8156-ecab4252e286. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 12:01:52 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-2e5d95f9-fb52-40fe-905a-1ca830108c68 req-d4589c41-14cf-4c6c-941a-1f6a128cd8a6 service nova] Acquiring lock "refresh_cache-a79ff814-dec6-4022-a7b6-5420861a2164" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:01:52 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-2e5d95f9-fb52-40fe-905a-1ca830108c68 req-d4589c41-14cf-4c6c-941a-1f6a128cd8a6 service nova] Acquired lock "refresh_cache-a79ff814-dec6-4022-a7b6-5420861a2164" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:01:52 user nova-compute[74190]: DEBUG nova.network.neutron [req-2e5d95f9-fb52-40fe-905a-1ca830108c68 req-d4589c41-14cf-4c6c-941a-1f6a128cd8a6 service nova] [instance: a79ff814-dec6-4022-a7b6-5420861a2164] Refreshing network info cache for port 53f42091-aa79-4aaf-8156-ecab4252e286 {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 12:01:52 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:01:53 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:01:53 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:01:53 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:01:53 user nova-compute[74190]: DEBUG nova.network.neutron [req-2e5d95f9-fb52-40fe-905a-1ca830108c68 req-d4589c41-14cf-4c6c-941a-1f6a128cd8a6 service nova] [instance: a79ff814-dec6-4022-a7b6-5420861a2164] Updated VIF entry in instance network info cache for port 53f42091-aa79-4aaf-8156-ecab4252e286. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 12:01:53 user nova-compute[74190]: DEBUG nova.network.neutron [req-2e5d95f9-fb52-40fe-905a-1ca830108c68 req-d4589c41-14cf-4c6c-941a-1f6a128cd8a6 service nova] [instance: a79ff814-dec6-4022-a7b6-5420861a2164] Updating instance_info_cache with network_info: [{"id": "53f42091-aa79-4aaf-8156-ecab4252e286", "address": "fa:16:3e:13:78:c3", "network": {"id": "d143b91a-fbcd-40d0-b199-381c523b8a0c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-175467972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62ed99f026894d569a13d0854fab0a17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53f42091-aa", "ovs_interfaceid": "53f42091-aa79-4aaf-8156-ecab4252e286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:01:53 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-2e5d95f9-fb52-40fe-905a-1ca830108c68 req-d4589c41-14cf-4c6c-941a-1f6a128cd8a6 service nova] Releasing lock "refresh_cache-a79ff814-dec6-4022-a7b6-5420861a2164" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:01:53 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:01:53 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:01:53 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:01:53 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:01:54 user nova-compute[74190]: DEBUG nova.compute.manager [req-756e55e6-765e-4c85-ab58-f524cc49ffa7 req-3b7e7b6f-82dd-4e97-9bd2-a2bb3088901e service nova] [instance: a79ff814-dec6-4022-a7b6-5420861a2164] Received event network-vif-plugged-53f42091-aa79-4aaf-8156-ecab4252e286 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:01:54 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-756e55e6-765e-4c85-ab58-f524cc49ffa7 req-3b7e7b6f-82dd-4e97-9bd2-a2bb3088901e service nova] Acquiring lock "a79ff814-dec6-4022-a7b6-5420861a2164-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:01:54 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-756e55e6-765e-4c85-ab58-f524cc49ffa7 req-3b7e7b6f-82dd-4e97-9bd2-a2bb3088901e service nova] Lock "a79ff814-dec6-4022-a7b6-5420861a2164-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:01:54 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-756e55e6-765e-4c85-ab58-f524cc49ffa7 req-3b7e7b6f-82dd-4e97-9bd2-a2bb3088901e service nova] Lock "a79ff814-dec6-4022-a7b6-5420861a2164-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:01:54 user nova-compute[74190]: DEBUG nova.compute.manager [req-756e55e6-765e-4c85-ab58-f524cc49ffa7 req-3b7e7b6f-82dd-4e97-9bd2-a2bb3088901e service nova] [instance: a79ff814-dec6-4022-a7b6-5420861a2164] No waiting events found dispatching network-vif-plugged-53f42091-aa79-4aaf-8156-ecab4252e286 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:01:54 user nova-compute[74190]: WARNING nova.compute.manager [req-756e55e6-765e-4c85-ab58-f524cc49ffa7 req-3b7e7b6f-82dd-4e97-9bd2-a2bb3088901e service nova] [instance: a79ff814-dec6-4022-a7b6-5420861a2164] Received unexpected event network-vif-plugged-53f42091-aa79-4aaf-8156-ecab4252e286 for instance with vm_state building and task_state spawning.
Oct 18 12:01:54 user nova-compute[74190]: DEBUG nova.compute.manager [req-756e55e6-765e-4c85-ab58-f524cc49ffa7 req-3b7e7b6f-82dd-4e97-9bd2-a2bb3088901e service nova] [instance: a79ff814-dec6-4022-a7b6-5420861a2164] Received event network-vif-plugged-53f42091-aa79-4aaf-8156-ecab4252e286 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:01:54 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-756e55e6-765e-4c85-ab58-f524cc49ffa7 req-3b7e7b6f-82dd-4e97-9bd2-a2bb3088901e service nova] Acquiring lock "a79ff814-dec6-4022-a7b6-5420861a2164-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:01:54 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-756e55e6-765e-4c85-ab58-f524cc49ffa7 req-3b7e7b6f-82dd-4e97-9bd2-a2bb3088901e service nova] Lock "a79ff814-dec6-4022-a7b6-5420861a2164-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:01:54 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-756e55e6-765e-4c85-ab58-f524cc49ffa7 req-3b7e7b6f-82dd-4e97-9bd2-a2bb3088901e service nova] Lock "a79ff814-dec6-4022-a7b6-5420861a2164-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:01:54 user nova-compute[74190]: DEBUG nova.compute.manager [req-756e55e6-765e-4c85-ab58-f524cc49ffa7 req-3b7e7b6f-82dd-4e97-9bd2-a2bb3088901e service nova] [instance: a79ff814-dec6-4022-a7b6-5420861a2164] No waiting events found dispatching network-vif-plugged-53f42091-aa79-4aaf-8156-ecab4252e286 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:01:54 user nova-compute[74190]: WARNING nova.compute.manager [req-756e55e6-765e-4c85-ab58-f524cc49ffa7 req-3b7e7b6f-82dd-4e97-9bd2-a2bb3088901e service nova] [instance: a79ff814-dec6-4022-a7b6-5420861a2164] Received unexpected event network-vif-plugged-53f42091-aa79-4aaf-8156-ecab4252e286 for instance with vm_state building and task_state spawning.
Oct 18 12:01:55 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:01:55 user nova-compute[74190]: DEBUG nova.compute.manager [None req-749627d1-3d0c-46e2-8349-7f307a8643e2 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] [instance: a79ff814-dec6-4022-a7b6-5420861a2164] Instance event wait completed in 0 seconds for  {{(pid=74190) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 12:01:55 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-749627d1-3d0c-46e2-8349-7f307a8643e2 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] [instance: a79ff814-dec6-4022-a7b6-5420861a2164] Guest created on hypervisor {{(pid=74190) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 12:01:55 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: a79ff814-dec6-4022-a7b6-5420861a2164] Instance spawned successfully.
Oct 18 12:01:55 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-749627d1-3d0c-46e2-8349-7f307a8643e2 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] [instance: a79ff814-dec6-4022-a7b6-5420861a2164] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 12:01:55 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-749627d1-3d0c-46e2-8349-7f307a8643e2 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] [instance: a79ff814-dec6-4022-a7b6-5420861a2164] Found default for hw_cdrom_bus of ide {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:01:55 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-749627d1-3d0c-46e2-8349-7f307a8643e2 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] [instance: a79ff814-dec6-4022-a7b6-5420861a2164] Found default for hw_disk_bus of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:01:55 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-749627d1-3d0c-46e2-8349-7f307a8643e2 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] [instance: a79ff814-dec6-4022-a7b6-5420861a2164] Found default for hw_input_bus of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:01:55 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-749627d1-3d0c-46e2-8349-7f307a8643e2 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] [instance: a79ff814-dec6-4022-a7b6-5420861a2164] Found default for hw_pointer_model of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:01:55 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-749627d1-3d0c-46e2-8349-7f307a8643e2 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] [instance: a79ff814-dec6-4022-a7b6-5420861a2164] Found default for hw_video_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:01:55 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-749627d1-3d0c-46e2-8349-7f307a8643e2 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] [instance: a79ff814-dec6-4022-a7b6-5420861a2164] Found default for hw_vif_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:01:55 user nova-compute[74190]: INFO nova.compute.manager [None req-749627d1-3d0c-46e2-8349-7f307a8643e2 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] [instance: a79ff814-dec6-4022-a7b6-5420861a2164] Took 5.37 seconds to spawn the instance on the hypervisor.
Oct 18 12:01:55 user nova-compute[74190]: DEBUG nova.compute.manager [None req-749627d1-3d0c-46e2-8349-7f307a8643e2 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] [instance: a79ff814-dec6-4022-a7b6-5420861a2164] Checking state {{(pid=74190) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 12:01:55 user nova-compute[74190]: INFO nova.compute.manager [None req-749627d1-3d0c-46e2-8349-7f307a8643e2 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] [instance: a79ff814-dec6-4022-a7b6-5420861a2164] Took 6.11 seconds to build instance.
Oct 18 12:01:55 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-749627d1-3d0c-46e2-8349-7f307a8643e2 tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Lock "a79ff814-dec6-4022-a7b6-5420861a2164" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.221s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:01:56 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:02:00 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:02:01 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:02:01 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Cleaning up deleted instances {{(pid=74190) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 18 12:02:01 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] There are 0 instances to clean {{(pid=74190) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 18 12:02:01 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:02:02 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:02:03 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:02:05 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:02:06 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:02:06 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-cec24f9c-5e7d-49f1-a5e0-26735b1b8fbc tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7128c4e8-0118-4138-b421-9b1d610d7454 is timed out.
Oct 18 12:02:06 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-cec24f9c-5e7d-49f1-a5e0-26735b1b8fbc tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Successfully detached device vdb from instance 7128c4e8-0118-4138-b421-9b1d610d7454 from the live domain config.
Oct 18 12:02:06 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cec24f9c-5e7d-49f1-a5e0-26735b1b8fbc tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: 7128c4e8-0118-4138-b421-9b1d610d7454] calling os-brick to detach iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 12:02:06 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-cec24f9c-5e7d-49f1-a5e0-26735b1b8fbc tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, {'target_iqn': 'iqn.2010-10.org.openstack:2cec69f2-df91-41a3-83fe-235889dd0667', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZESUpiyX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 12:02:06 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-cec24f9c-5e7d-49f1-a5e0-26735b1b8fbc tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 12:02:06 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-cec24f9c-5e7d-49f1-a5e0-26735b1b8fbc tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 12:02:06 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-cec24f9c-5e7d-49f1-a5e0-26735b1b8fbc tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 12:02:06 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:02:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:02:07 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a520ac-b3e0-43d0-aa86-c282ccbcdf69]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2cec69f2-df91-41a3-83fe-235889dd0667\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:02:07 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-cec24f9c-5e7d-49f1-a5e0-26735b1b8fbc tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 12:02:07 user nova-compute[74190]: No targets found.
Oct 18 12:02:07 user nova-compute[74190]: iSNS:
Oct 18 12:02:07 user nova-compute[74190]: No targets found.
Oct 18 12:02:07 user nova-compute[74190]: STATIC:
Oct 18 12:02:07 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa
Oct 18 12:02:07 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 12:02:07 user nova-compute[74190]:                 Iface Name: default
Oct 18 12:02:07 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:2cec69f2-df91-41a3-83fe-235889dd0667
Oct 18 12:02:07 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 12:02:07 user nova-compute[74190]:                 Iface Name: default
Oct 18 12:02:07 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f
Oct 18 12:02:07 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 12:02:07 user nova-compute[74190]:                 Iface Name: default
Oct 18 12:02:07 user nova-compute[74190]: FIRMWARE:
Oct 18 12:02:07 user nova-compute[74190]: No targets found.
Oct 18 12:02:07 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 12:02:07 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-cec24f9c-5e7d-49f1-a5e0-26735b1b8fbc tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 12:02:07 user nova-compute[74190]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 12:02:07 user nova-compute[74190]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74190) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 12:02:07 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-cec24f9c-5e7d-49f1-a5e0-26735b1b8fbc tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2cec69f2-df91-41a3-83fe-235889dd0667', 0)] {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 12:02:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:02:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:02:07 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bdde753-00c5-4dd2-a5de-d26d8c062e36]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2cec69f2-df91-41a3-83fe-235889dd0667\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:02:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:02:07 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:02:07 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:02:07 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74190) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 12:02:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:02:07 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb316442-df56-48a4-93d7-aa5b2a9a4f2e]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cec69f2-df91-41a3-83fe-235889dd0667 (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:02:07 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-cec24f9c-5e7d-49f1-a5e0-26735b1b8fbc tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 12:02:07 user nova-compute[74190]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)
Oct 18 12:02:07 user nova-compute[74190]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cec69f2-df91-41a3-83fe-235889dd0667 (non-flash)
Oct 18 12:02:07 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 12:02:07 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-cec24f9c-5e7d-49f1-a5e0-26735b1b8fbc tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 12:02:07 user nova-compute[74190]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)
Oct 18 12:02:07 user nova-compute[74190]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cec69f2-df91-41a3-83fe-235889dd0667 (non-flash)
Oct 18 12:02:07 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 12:02:07 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-cec24f9c-5e7d-49f1-a5e0-26735b1b8fbc tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1f44693760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2cec69f2-df91-41a3-83fe-235889dd0667'): ({'sdd'}, set())}) {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 12:02:07 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-cec24f9c-5e7d-49f1-a5e0-26735b1b8fbc tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Removing single pathed devices sdd {{(pid=74190) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 12:02:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:02:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:02:07 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[3869a0c4-269a-4b3c-b5fe-49789384c945]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:02:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:02:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:02:07 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f526b8-6573-4f04-aedb-b19972bd5133]: (4, ('ok\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:02:07 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-cec24f9c-5e7d-49f1-a5e0-26735b1b8fbc tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Flushing IO for device /dev/sdd {{(pid=74190) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 12:02:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:02:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:02:07 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1c88f8d-d2f1-41a6-b4e0-fd78b6260f6c]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:02:07 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-cec24f9c-5e7d-49f1-a5e0-26735b1b8fbc tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74190) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 12:02:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:02:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.054s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:02:07 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e64754e-61ce-49fa-940f-8d88a6fb030a]: (4, ('1', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:02:07 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-cec24f9c-5e7d-49f1-a5e0-26735b1b8fbc tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 12:02:07 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-cec24f9c-5e7d-49f1-a5e0-26735b1b8fbc tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] SCSI volumes sdd have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 12:02:07 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-cec24f9c-5e7d-49f1-a5e0-26735b1b8fbc tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2cec69f2-df91-41a3-83fe-235889dd0667')] {{(pid=74190) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 12:02:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cec69f2-df91-41a3-83fe-235889dd0667 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:02:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cec69f2-df91-41a3-83fe-235889dd0667 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:02:07 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ac278b-fb4f-499b-a534-f8b96d2ca2b3]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:02:07 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-cec24f9c-5e7d-49f1-a5e0-26735b1b8fbc tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:02:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cec69f2-df91-41a3-83fe-235889dd0667 -p 172.16.0.220:3260 --logout {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:02:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cec69f2-df91-41a3-83fe-235889dd0667 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:02:07 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fee476e-e255-4fa9-b747-34a36e942c8a]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:2cec69f2-df91-41a3-83fe-235889dd0667, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:2cec69f2-df91-41a3-83fe-235889dd0667, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:02:07 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-cec24f9c-5e7d-49f1-a5e0-26735b1b8fbc tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:2cec69f2-df91-41a3-83fe-235889dd0667, portal: 172.16.0.220,3260]
Oct 18 12:02:07 user nova-compute[74190]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:2cec69f2-df91-41a3-83fe-235889dd0667, portal: 172.16.0.220,3260] successful.
Oct 18 12:02:07 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:02:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cec69f2-df91-41a3-83fe-235889dd0667 -p 172.16.0.220:3260 --op delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:02:07 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cec69f2-df91-41a3-83fe-235889dd0667 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:02:07 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[10705842-dddd-4940-a2cb-1e1994ebcdcf]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:02:07 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-cec24f9c-5e7d-49f1-a5e0-26735b1b8fbc tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:02:07 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-cec24f9c-5e7d-49f1-a5e0-26735b1b8fbc tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 12:02:07 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-cec24f9c-5e7d-49f1-a5e0-26735b1b8fbc tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] <== disconnect_volume: return (306ms) None {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 12:02:07 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cec24f9c-5e7d-49f1-a5e0-26735b1b8fbc tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: 7128c4e8-0118-4138-b421-9b1d610d7454] Disconnected iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 12:02:08 user nova-compute[74190]: DEBUG nova.objects.instance [None req-cec24f9c-5e7d-49f1-a5e0-26735b1b8fbc tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lazy-loading 'flavor' on Instance uuid 7128c4e8-0118-4138-b421-9b1d610d7454 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:02:08 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-cec24f9c-5e7d-49f1-a5e0-26735b1b8fbc tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "7128c4e8-0118-4138-b421-9b1d610d7454" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.993s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:02:10 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:02:10 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:02:10 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Starting heal instance info cache {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 12:02:10 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Didn't find any instances for network info cache update. {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 18 12:02:10 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:02:10 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:02:10 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:02:10 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:02:10 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Auditing locally available compute resources for user (node: user) {{(pid=74190) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 12:02:10 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:02:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f59adf3-9728-4d5b-87d5-2ad32c99d06e/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:02:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f59adf3-9728-4d5b-87d5-2ad32c99d06e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:02:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f59adf3-9728-4d5b-87d5-2ad32c99d06e/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:02:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f59adf3-9728-4d5b-87d5-2ad32c99d06e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:02:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:02:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:02:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:02:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:02:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a79ff814-dec6-4022-a7b6-5420861a2164/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:02:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a79ff814-dec6-4022-a7b6-5420861a2164/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:02:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a79ff814-dec6-4022-a7b6-5420861a2164/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:02:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a79ff814-dec6-4022-a7b6-5420861a2164/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:02:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:02:11 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:02:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:02:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:02:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:02:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14ba5fe8-567e-40c8-9d69-b54af521b2bc/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:02:12 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14ba5fe8-567e-40c8-9d69-b54af521b2bc/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:02:12 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14ba5fe8-567e-40c8-9d69-b54af521b2bc/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:02:12 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14ba5fe8-567e-40c8-9d69-b54af521b2bc/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:02:12 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7128c4e8-0118-4138-b421-9b1d610d7454/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:02:12 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7128c4e8-0118-4138-b421-9b1d610d7454/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:02:12 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7128c4e8-0118-4138-b421-9b1d610d7454/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:02:12 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7128c4e8-0118-4138-b421-9b1d610d7454/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:02:12 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:02:12 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:02:12 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:02:12 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:02:12 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 12:02:13 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk.rescue --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:02:13 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:02:13 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk.rescue --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:02:13 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:02:13 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:02:13 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:02:13 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:02:13 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:02:13 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 12:02:13 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0382820d-a678-4593-85df-168f42fc4ce4/disk.rescue --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:02:13 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0382820d-a678-4593-85df-168f42fc4ce4/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:02:13 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0382820d-a678-4593-85df-168f42fc4ce4/disk.rescue --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:02:14 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0382820d-a678-4593-85df-168f42fc4ce4/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:02:14 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:02:14 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:02:14 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Hypervisor/Node resource view: name=user free_ram=7677MB free_disk=25.01781463623047GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74190) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 12:02:14 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:02:14 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:02:14 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 4e916d24-9f9d-4289-87ce-f65d2499fcd9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:02:14 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 95ca0697-22b5-4109-868f-ca5556015a1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:02:14 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 42413a94-9973-4e8d-83b6-207a4e7847c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:02:14 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 772b126c-2148-4ca8-90f2-69d6eb4b7db7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:02:14 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 0382820d-a678-4593-85df-168f42fc4ce4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:02:14 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 7128c4e8-0118-4138-b421-9b1d610d7454 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:02:14 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 2f59adf3-9728-4d5b-87d5-2ad32c99d06e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:02:14 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 14ba5fe8-567e-40c8-9d69-b54af521b2bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:02:14 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance a79ff814-dec6-4022-a7b6-5420861a2164 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:02:14 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 12:02:14 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 12:02:14 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 12:02:15 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 12:02:15 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Compute_service record updated for user:user {{(pid=74190) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 12:02:15 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.520s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:02:15 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:02:15 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74190) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 18 12:02:15 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:02:16 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:02:18 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:02:18 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:02:18 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:02:20 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:02:21 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:02:25 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:02:26 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:02:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:02:31 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:02:33 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:02:35 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-fc4edd62-ecff-4960-b0e3-8a8f3f86a3eb tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Acquiring lock "7f79a267-5bc8-4fa0-9e3a-4706fa1da142" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:02:35 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-fc4edd62-ecff-4960-b0e3-8a8f3f86a3eb tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lock "7f79a267-5bc8-4fa0-9e3a-4706fa1da142" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:02:35 user nova-compute[74190]: DEBUG nova.compute.manager [None req-fc4edd62-ecff-4960-b0e3-8a8f3f86a3eb tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Starting instance... {{(pid=74190) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 12:02:35 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-fc4edd62-ecff-4960-b0e3-8a8f3f86a3eb tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:02:35 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-fc4edd62-ecff-4960-b0e3-8a8f3f86a3eb tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:02:35 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-fc4edd62-ecff-4960-b0e3-8a8f3f86a3eb tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74190) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 12:02:35 user nova-compute[74190]: INFO nova.compute.claims [None req-fc4edd62-ecff-4960-b0e3-8a8f3f86a3eb tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Claim successful on node user
Oct 18 12:02:35 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-fc4edd62-ecff-4960-b0e3-8a8f3f86a3eb tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 12:02:35 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-fc4edd62-ecff-4960-b0e3-8a8f3f86a3eb tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 12:02:35 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-fc4edd62-ecff-4960-b0e3-8a8f3f86a3eb tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.349s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:02:35 user nova-compute[74190]: DEBUG nova.compute.manager [None req-fc4edd62-ecff-4960-b0e3-8a8f3f86a3eb tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Start building networks asynchronously for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 12:02:35 user nova-compute[74190]: DEBUG nova.compute.manager [None req-fc4edd62-ecff-4960-b0e3-8a8f3f86a3eb tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Allocating IP information in the background. {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 12:02:35 user nova-compute[74190]: DEBUG nova.network.neutron [None req-fc4edd62-ecff-4960-b0e3-8a8f3f86a3eb tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] allocate_for_instance() {{(pid=74190) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 12:02:35 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-fc4edd62-ecff-4960-b0e3-8a8f3f86a3eb tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 12:02:35 user nova-compute[74190]: DEBUG nova.compute.manager [None req-fc4edd62-ecff-4960-b0e3-8a8f3f86a3eb tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Start building block device mappings for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 12:02:35 user nova-compute[74190]: DEBUG nova.policy [None req-fc4edd62-ecff-4960-b0e3-8a8f3f86a3eb tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9db2d65206e24d0aa1428b9bcaa0a86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa18c02b8a4117ab1ccc52aca64f06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74190) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 12:02:35 user nova-compute[74190]: DEBUG nova.compute.manager [None req-fc4edd62-ecff-4960-b0e3-8a8f3f86a3eb tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Start spawning the instance on the hypervisor. {{(pid=74190) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 12:02:35 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-fc4edd62-ecff-4960-b0e3-8a8f3f86a3eb tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Creating instance directory {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 12:02:35 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-fc4edd62-ecff-4960-b0e3-8a8f3f86a3eb tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Creating image(s)
Oct 18 12:02:35 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-fc4edd62-ecff-4960-b0e3-8a8f3f86a3eb tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Acquiring lock "/opt/stack/data/nova/instances/7f79a267-5bc8-4fa0-9e3a-4706fa1da142/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:02:35 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-fc4edd62-ecff-4960-b0e3-8a8f3f86a3eb tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lock "/opt/stack/data/nova/instances/7f79a267-5bc8-4fa0-9e3a-4706fa1da142/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:02:35 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-fc4edd62-ecff-4960-b0e3-8a8f3f86a3eb tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lock "/opt/stack/data/nova/instances/7f79a267-5bc8-4fa0-9e3a-4706fa1da142/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:02:35 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-fc4edd62-ecff-4960-b0e3-8a8f3f86a3eb tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:02:36 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-fc4edd62-ecff-4960-b0e3-8a8f3f86a3eb tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.191s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:02:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-fc4edd62-ecff-4960-b0e3-8a8f3f86a3eb tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Acquiring lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:02:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-fc4edd62-ecff-4960-b0e3-8a8f3f86a3eb tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:02:36 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-fc4edd62-ecff-4960-b0e3-8a8f3f86a3eb tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:02:36 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-fc4edd62-ecff-4960-b0e3-8a8f3f86a3eb tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.175s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:02:36 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-fc4edd62-ecff-4960-b0e3-8a8f3f86a3eb tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f,backing_fmt=raw /opt/stack/data/nova/instances/7f79a267-5bc8-4fa0-9e3a-4706fa1da142/disk 1073741824 {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:02:36 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-fc4edd62-ecff-4960-b0e3-8a8f3f86a3eb tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f,backing_fmt=raw /opt/stack/data/nova/instances/7f79a267-5bc8-4fa0-9e3a-4706fa1da142/disk 1073741824" returned: 0 in 0.061s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:02:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-fc4edd62-ecff-4960-b0e3-8a8f3f86a3eb tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:02:36 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-fc4edd62-ecff-4960-b0e3-8a8f3f86a3eb tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:02:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-a6c919cb-89ac-4da7-9eb8-1da2a518542c tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Acquiring lock "7128c4e8-0118-4138-b421-9b1d610d7454" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:02:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-a6c919cb-89ac-4da7-9eb8-1da2a518542c tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "7128c4e8-0118-4138-b421-9b1d610d7454" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:02:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-a6c919cb-89ac-4da7-9eb8-1da2a518542c tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Acquiring lock "7128c4e8-0118-4138-b421-9b1d610d7454-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:02:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-a6c919cb-89ac-4da7-9eb8-1da2a518542c tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "7128c4e8-0118-4138-b421-9b1d610d7454-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:02:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-a6c919cb-89ac-4da7-9eb8-1da2a518542c tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "7128c4e8-0118-4138-b421-9b1d610d7454-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:02:36 user nova-compute[74190]: INFO nova.compute.manager [None req-a6c919cb-89ac-4da7-9eb8-1da2a518542c tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: 7128c4e8-0118-4138-b421-9b1d610d7454] Terminating instance
Oct 18 12:02:36 user nova-compute[74190]: DEBUG nova.compute.manager [None req-a6c919cb-89ac-4da7-9eb8-1da2a518542c tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: 7128c4e8-0118-4138-b421-9b1d610d7454] Start destroying the instance on the hypervisor. {{(pid=74190) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 12:02:36 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-fc4edd62-ecff-4960-b0e3-8a8f3f86a3eb tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.201s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:02:36 user nova-compute[74190]: DEBUG nova.virt.disk.api [None req-fc4edd62-ecff-4960-b0e3-8a8f3f86a3eb tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7f79a267-5bc8-4fa0-9e3a-4706fa1da142/disk. size=1073741824 {{(pid=74190) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 18 12:02:36 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-fc4edd62-ecff-4960-b0e3-8a8f3f86a3eb tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f79a267-5bc8-4fa0-9e3a-4706fa1da142/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:02:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:02:36 user nova-compute[74190]: DEBUG nova.network.neutron [None req-fc4edd62-ecff-4960-b0e3-8a8f3f86a3eb tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Successfully created port: 85b87aa7-52a9-4487-a954-7e07dcf20500 {{(pid=74190) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 12:02:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:02:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:02:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:02:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:02:36 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-fc4edd62-ecff-4960-b0e3-8a8f3f86a3eb tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f79a267-5bc8-4fa0-9e3a-4706fa1da142/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:02:36 user nova-compute[74190]: DEBUG nova.virt.disk.api [None req-fc4edd62-ecff-4960-b0e3-8a8f3f86a3eb tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Cannot resize image /opt/stack/data/nova/instances/7f79a267-5bc8-4fa0-9e3a-4706fa1da142/disk to a smaller size. {{(pid=74190) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 18 12:02:36 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-fc4edd62-ecff-4960-b0e3-8a8f3f86a3eb tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Created local disks {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 12:02:36 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-fc4edd62-ecff-4960-b0e3-8a8f3f86a3eb tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Ensure instance console log exists: /opt/stack/data/nova/instances/7f79a267-5bc8-4fa0-9e3a-4706fa1da142/console.log {{(pid=74190) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 12:02:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-fc4edd62-ecff-4960-b0e3-8a8f3f86a3eb tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:02:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-fc4edd62-ecff-4960-b0e3-8a8f3f86a3eb tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:02:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-fc4edd62-ecff-4960-b0e3-8a8f3f86a3eb tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:02:36 user nova-compute[74190]: DEBUG nova.compute.manager [req-b93eecda-f6c4-4abb-9d1c-b958455f27f9 req-e69cc1b0-a593-411c-bfa7-20106bd72c46 service nova] [instance: 7128c4e8-0118-4138-b421-9b1d610d7454] Received event network-vif-unplugged-bc81c313-cdfc-4ef9-9c98-6efba1603301 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:02:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-b93eecda-f6c4-4abb-9d1c-b958455f27f9 req-e69cc1b0-a593-411c-bfa7-20106bd72c46 service nova] Acquiring lock "7128c4e8-0118-4138-b421-9b1d610d7454-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:02:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-b93eecda-f6c4-4abb-9d1c-b958455f27f9 req-e69cc1b0-a593-411c-bfa7-20106bd72c46 service nova] Lock "7128c4e8-0118-4138-b421-9b1d610d7454-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:02:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-b93eecda-f6c4-4abb-9d1c-b958455f27f9 req-e69cc1b0-a593-411c-bfa7-20106bd72c46 service nova] Lock "7128c4e8-0118-4138-b421-9b1d610d7454-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:02:36 user nova-compute[74190]: DEBUG nova.compute.manager [req-b93eecda-f6c4-4abb-9d1c-b958455f27f9 req-e69cc1b0-a593-411c-bfa7-20106bd72c46 service nova] [instance: 7128c4e8-0118-4138-b421-9b1d610d7454] No waiting events found dispatching network-vif-unplugged-bc81c313-cdfc-4ef9-9c98-6efba1603301 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:02:36 user nova-compute[74190]: DEBUG nova.compute.manager [req-b93eecda-f6c4-4abb-9d1c-b958455f27f9 req-e69cc1b0-a593-411c-bfa7-20106bd72c46 service nova] [instance: 7128c4e8-0118-4138-b421-9b1d610d7454] Received event network-vif-unplugged-bc81c313-cdfc-4ef9-9c98-6efba1603301 for instance with task_state deleting. {{(pid=74190) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 12:02:37 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 7128c4e8-0118-4138-b421-9b1d610d7454] Instance destroyed successfully.
Oct 18 12:02:37 user nova-compute[74190]: DEBUG nova.objects.instance [None req-a6c919cb-89ac-4da7-9eb8-1da2a518542c tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lazy-loading 'resources' on Instance uuid 7128c4e8-0118-4138-b421-9b1d610d7454 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:02:37 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-a6c919cb-89ac-4da7-9eb8-1da2a518542c tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:59:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-78526681',display_name='tempest-AttachVolumeNegativeTest-server-78526681',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-78526681',id=32,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGHpX6pNGSXj2Dh6qmvnk8TzDprfMG0ku/74hC8gzYaiTscVO9KdQI7iLHX9m1z4rzTeJzELXcMd21TokrPU7bfbNpyzpbRJ0Jg33ifD66h8tRM7k270FRSlTn3m7/8iHQ==',key_name='tempest-keypair-1203749121',keypairs=<?>,launch_index=0,launched_at=2023-10-18T11:59:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='df06c4b010434e3da9ba4ea41f26befa',ramdisk_id='',reservation_id='r-qy1zsitm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1730208605',owner_user_name='tempest-AttachVolumeNegativeTest-1730208605-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T11:59:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d6bb993153245daabfc59215abbf7a1',uuid=7128c4e8-0118-4138-b421-9b1d610d7454,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bc81c313-cdfc-4ef9-9c98-6efba1603301", "address": "fa:16:3e:d1:de:c2", "network": {"id": "25e0d6f5-497d-4898-8181-5b4848950f16", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-245925644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df06c4b010434e3da9ba4ea41f26befa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc81c313-cd", "ovs_interfaceid": "bc81c313-cdfc-4ef9-9c98-6efba1603301", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 12:02:37 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-a6c919cb-89ac-4da7-9eb8-1da2a518542c tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Converting VIF {"id": "bc81c313-cdfc-4ef9-9c98-6efba1603301", "address": "fa:16:3e:d1:de:c2", "network": {"id": "25e0d6f5-497d-4898-8181-5b4848950f16", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-245925644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df06c4b010434e3da9ba4ea41f26befa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc81c313-cd", "ovs_interfaceid": "bc81c313-cdfc-4ef9-9c98-6efba1603301", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 12:02:37 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-a6c919cb-89ac-4da7-9eb8-1da2a518542c tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d1:de:c2,bridge_name='br-int',has_traffic_filtering=True,id=bc81c313-cdfc-4ef9-9c98-6efba1603301,network=Network(25e0d6f5-497d-4898-8181-5b4848950f16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc81c313-cd') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 12:02:37 user nova-compute[74190]: DEBUG os_vif [None req-a6c919cb-89ac-4da7-9eb8-1da2a518542c tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:de:c2,bridge_name='br-int',has_traffic_filtering=True,id=bc81c313-cdfc-4ef9-9c98-6efba1603301,network=Network(25e0d6f5-497d-4898-8181-5b4848950f16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc81c313-cd') {{(pid=74190) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 12:02:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:02:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbc81c313-cd, bridge=br-int, if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:02:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:02:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:02:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:02:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8e4028f0-ecc5-4dc8-9168-f7b257350856) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:02:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:02:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:02:37 user nova-compute[74190]: INFO os_vif [None req-a6c919cb-89ac-4da7-9eb8-1da2a518542c tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:de:c2,bridge_name='br-int',has_traffic_filtering=True,id=bc81c313-cdfc-4ef9-9c98-6efba1603301,network=Network(25e0d6f5-497d-4898-8181-5b4848950f16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc81c313-cd')
Oct 18 12:02:37 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-a6c919cb-89ac-4da7-9eb8-1da2a518542c tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: 7128c4e8-0118-4138-b421-9b1d610d7454] Deleting instance files /opt/stack/data/nova/instances/7128c4e8-0118-4138-b421-9b1d610d7454_del
Oct 18 12:02:37 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-a6c919cb-89ac-4da7-9eb8-1da2a518542c tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: 7128c4e8-0118-4138-b421-9b1d610d7454] Deletion of /opt/stack/data/nova/instances/7128c4e8-0118-4138-b421-9b1d610d7454_del complete
Oct 18 12:02:37 user nova-compute[74190]: DEBUG nova.network.neutron [None req-fc4edd62-ecff-4960-b0e3-8a8f3f86a3eb tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Successfully updated port: 85b87aa7-52a9-4487-a954-7e07dcf20500 {{(pid=74190) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 12:02:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-fc4edd62-ecff-4960-b0e3-8a8f3f86a3eb tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Acquiring lock "refresh_cache-7f79a267-5bc8-4fa0-9e3a-4706fa1da142" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:02:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-fc4edd62-ecff-4960-b0e3-8a8f3f86a3eb tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Acquired lock "refresh_cache-7f79a267-5bc8-4fa0-9e3a-4706fa1da142" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:02:37 user nova-compute[74190]: DEBUG nova.network.neutron [None req-fc4edd62-ecff-4960-b0e3-8a8f3f86a3eb tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Building network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 12:02:37 user nova-compute[74190]: INFO nova.compute.manager [None req-a6c919cb-89ac-4da7-9eb8-1da2a518542c tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: 7128c4e8-0118-4138-b421-9b1d610d7454] Took 0.88 seconds to destroy the instance on the hypervisor.
Oct 18 12:02:37 user nova-compute[74190]: DEBUG oslo.service.loopingcall [None req-a6c919cb-89ac-4da7-9eb8-1da2a518542c tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74190) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 12:02:37 user nova-compute[74190]: DEBUG nova.compute.manager [-] [instance: 7128c4e8-0118-4138-b421-9b1d610d7454] Deallocating network for instance {{(pid=74190) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 12:02:37 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: 7128c4e8-0118-4138-b421-9b1d610d7454] deallocate_for_instance() {{(pid=74190) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 12:02:37 user nova-compute[74190]: DEBUG nova.compute.manager [req-110e8dcc-881a-4f08-b607-0451e08c06fa req-164b5ef2-51d5-4a5a-9fb7-6aabfc6d3af3 service nova] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Received event network-changed-85b87aa7-52a9-4487-a954-7e07dcf20500 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:02:37 user nova-compute[74190]: DEBUG nova.compute.manager [req-110e8dcc-881a-4f08-b607-0451e08c06fa req-164b5ef2-51d5-4a5a-9fb7-6aabfc6d3af3 service nova] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Refreshing instance network info cache due to event network-changed-85b87aa7-52a9-4487-a954-7e07dcf20500. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 12:02:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-110e8dcc-881a-4f08-b607-0451e08c06fa req-164b5ef2-51d5-4a5a-9fb7-6aabfc6d3af3 service nova] Acquiring lock "refresh_cache-7f79a267-5bc8-4fa0-9e3a-4706fa1da142" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:02:37 user nova-compute[74190]: DEBUG nova.network.neutron [None req-fc4edd62-ecff-4960-b0e3-8a8f3f86a3eb tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Instance cache missing network info. {{(pid=74190) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 12:02:37 user nova-compute[74190]: DEBUG nova.network.neutron [None req-fc4edd62-ecff-4960-b0e3-8a8f3f86a3eb tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Updating instance_info_cache with network_info: [{"id": "85b87aa7-52a9-4487-a954-7e07dcf20500", "address": "fa:16:3e:68:65:7b", "network": {"id": "130f7948-11e4-49b4-9d4a-dffb2b48bdcd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595419292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ffa18c02b8a4117ab1ccc52aca64f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85b87aa7-52", "ovs_interfaceid": "85b87aa7-52a9-4487-a954-7e07dcf20500", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:02:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-fc4edd62-ecff-4960-b0e3-8a8f3f86a3eb tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Releasing lock "refresh_cache-7f79a267-5bc8-4fa0-9e3a-4706fa1da142" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:02:37 user nova-compute[74190]: DEBUG nova.compute.manager [None req-fc4edd62-ecff-4960-b0e3-8a8f3f86a3eb tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Instance network_info: |[{"id": "85b87aa7-52a9-4487-a954-7e07dcf20500", "address": "fa:16:3e:68:65:7b", "network": {"id": "130f7948-11e4-49b4-9d4a-dffb2b48bdcd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595419292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ffa18c02b8a4117ab1ccc52aca64f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85b87aa7-52", "ovs_interfaceid": "85b87aa7-52a9-4487-a954-7e07dcf20500", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 12:02:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-110e8dcc-881a-4f08-b607-0451e08c06fa req-164b5ef2-51d5-4a5a-9fb7-6aabfc6d3af3 service nova] Acquired lock "refresh_cache-7f79a267-5bc8-4fa0-9e3a-4706fa1da142" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:02:37 user nova-compute[74190]: DEBUG nova.network.neutron [req-110e8dcc-881a-4f08-b607-0451e08c06fa req-164b5ef2-51d5-4a5a-9fb7-6aabfc6d3af3 service nova] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Refreshing network info cache for port 85b87aa7-52a9-4487-a954-7e07dcf20500 {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 12:02:37 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-fc4edd62-ecff-4960-b0e3-8a8f3f86a3eb tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Start _get_guest_xml network_info=[{"id": "85b87aa7-52a9-4487-a954-7e07dcf20500", "address": "fa:16:3e:68:65:7b", "network": {"id": "130f7948-11e4-49b4-9d4a-dffb2b48bdcd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595419292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ffa18c02b8a4117ab1ccc52aca64f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85b87aa7-52", "ovs_interfaceid": "85b87aa7-52a9-4487-a954-7e07dcf20500", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'image_id': '6e88bbf0-6e78-49a8-b3c5-9453d22a89df'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 12:02:37 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-fc4edd62-ecff-4960-b0e3-8a8f3f86a3eb tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:02:37 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-fc4edd62-ecff-4960-b0e3-8a8f3f86a3eb tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:02:37 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-fc4edd62-ecff-4960-b0e3-8a8f3f86a3eb tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 12:02:37 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-fc4edd62-ecff-4960-b0e3-8a8f3f86a3eb tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] CPU controller missing on host. {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 12:02:37 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-fc4edd62-ecff-4960-b0e3-8a8f3f86a3eb tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 12:02:37 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-fc4edd62-ecff-4960-b0e3-8a8f3f86a3eb tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] CPU controller found on host. {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 12:02:37 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-fc4edd62-ecff-4960-b0e3-8a8f3f86a3eb tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74190) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 12:02:37 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-fc4edd62-ecff-4960-b0e3-8a8f3f86a3eb tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T11:37:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 12:02:37 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-fc4edd62-ecff-4960-b0e3-8a8f3f86a3eb tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Flavor limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 12:02:37 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-fc4edd62-ecff-4960-b0e3-8a8f3f86a3eb tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Image limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 12:02:37 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-fc4edd62-ecff-4960-b0e3-8a8f3f86a3eb tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Flavor pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 12:02:37 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-fc4edd62-ecff-4960-b0e3-8a8f3f86a3eb tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Image pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 12:02:37 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-fc4edd62-ecff-4960-b0e3-8a8f3f86a3eb tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 12:02:37 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-fc4edd62-ecff-4960-b0e3-8a8f3f86a3eb tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 12:02:37 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-fc4edd62-ecff-4960-b0e3-8a8f3f86a3eb tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 12:02:37 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-fc4edd62-ecff-4960-b0e3-8a8f3f86a3eb tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Got 1 possible topologies {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 12:02:37 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-fc4edd62-ecff-4960-b0e3-8a8f3f86a3eb tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 12:02:37 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-fc4edd62-ecff-4960-b0e3-8a8f3f86a3eb tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 12:02:37 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-fc4edd62-ecff-4960-b0e3-8a8f3f86a3eb tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T12:02:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1792483886',display_name='tempest-ServerRescueNegativeTestJSON-server-1792483886',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1792483886',id=36,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkIQ8d3leZjsvwziIWZ+8LvZaK+fQGEHmIEFhtuiFYjCN5LSlir32U0rEoPzQvvKfWbmmXf87lyxNJGp1oDmc+aRdOnCgCKp/U0aihiZb7ZCRL045Ck061Eajb0ZA9iDQ==',key_name='tempest-keypair-132610173',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ffa18c02b8a4117ab1ccc52aca64f06',ramdisk_id='',reservation_id='r-mifp9rvd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1266902394',owner_user_name='tempest-ServerRescueNegativeTestJSON-1266902394-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T12:02:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9db2d65206e24d0aa1428b9bcaa0a86e',uuid=7f79a267-5bc8-4fa0-9e3a-4706fa1da142,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85b87aa7-52a9-4487-a954-7e07dcf20500", "address": "fa:16:3e:68:65:7b", "network": {"id": "130f7948-11e4-49b4-9d4a-dffb2b48bdcd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595419292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ffa18c02b8a4117ab1ccc52aca64f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85b87aa7-52", "ovs_interfaceid": "85b87aa7-52a9-4487-a954-7e07dcf20500", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74190) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 12:02:37 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-fc4edd62-ecff-4960-b0e3-8a8f3f86a3eb tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Converting VIF {"id": "85b87aa7-52a9-4487-a954-7e07dcf20500", "address": "fa:16:3e:68:65:7b", "network": {"id": "130f7948-11e4-49b4-9d4a-dffb2b48bdcd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595419292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ffa18c02b8a4117ab1ccc52aca64f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85b87aa7-52", "ovs_interfaceid": "85b87aa7-52a9-4487-a954-7e07dcf20500", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 12:02:37 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-fc4edd62-ecff-4960-b0e3-8a8f3f86a3eb tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:65:7b,bridge_name='br-int',has_traffic_filtering=True,id=85b87aa7-52a9-4487-a954-7e07dcf20500,network=Network(130f7948-11e4-49b4-9d4a-dffb2b48bdcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85b87aa7-52') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 12:02:37 user nova-compute[74190]: DEBUG nova.objects.instance [None req-fc4edd62-ecff-4960-b0e3-8a8f3f86a3eb tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lazy-loading 'pci_devices' on Instance uuid 7f79a267-5bc8-4fa0-9e3a-4706fa1da142 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:02:37 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-fc4edd62-ecff-4960-b0e3-8a8f3f86a3eb tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] End _get_guest_xml xml=<domain type="kvm">
Oct 18 12:02:37 user nova-compute[74190]:   <uuid>7f79a267-5bc8-4fa0-9e3a-4706fa1da142</uuid>
Oct 18 12:02:37 user nova-compute[74190]:   <name>instance-00000024</name>
Oct 18 12:02:37 user nova-compute[74190]:   <memory>524288</memory>
Oct 18 12:02:37 user nova-compute[74190]:   <vcpu>1</vcpu>
Oct 18 12:02:37 user nova-compute[74190]:   <metadata>
Oct 18 12:02:37 user nova-compute[74190]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 12:02:37 user nova-compute[74190]:       <nova:package version="0.0.0"/>
Oct 18 12:02:37 user nova-compute[74190]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1792483886</nova:name>
Oct 18 12:02:37 user nova-compute[74190]:       <nova:creationTime>2023-10-18 12:02:37</nova:creationTime>
Oct 18 12:02:37 user nova-compute[74190]:       <nova:flavor name="m1.tiny">
Oct 18 12:02:37 user nova-compute[74190]:         <nova:memory>512</nova:memory>
Oct 18 12:02:37 user nova-compute[74190]:         <nova:disk>1</nova:disk>
Oct 18 12:02:37 user nova-compute[74190]:         <nova:swap>0</nova:swap>
Oct 18 12:02:37 user nova-compute[74190]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 12:02:37 user nova-compute[74190]:         <nova:vcpus>1</nova:vcpus>
Oct 18 12:02:37 user nova-compute[74190]:       </nova:flavor>
Oct 18 12:02:37 user nova-compute[74190]:       <nova:owner>
Oct 18 12:02:37 user nova-compute[74190]:         <nova:user uuid="9db2d65206e24d0aa1428b9bcaa0a86e">tempest-ServerRescueNegativeTestJSON-1266902394-project-member</nova:user>
Oct 18 12:02:37 user nova-compute[74190]:         <nova:project uuid="1ffa18c02b8a4117ab1ccc52aca64f06">tempest-ServerRescueNegativeTestJSON-1266902394</nova:project>
Oct 18 12:02:37 user nova-compute[74190]:       </nova:owner>
Oct 18 12:02:37 user nova-compute[74190]:       <nova:root type="image" uuid="6e88bbf0-6e78-49a8-b3c5-9453d22a89df"/>
Oct 18 12:02:37 user nova-compute[74190]:       <nova:ports>
Oct 18 12:02:37 user nova-compute[74190]:         <nova:port uuid="85b87aa7-52a9-4487-a954-7e07dcf20500">
Oct 18 12:02:37 user nova-compute[74190]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 18 12:02:37 user nova-compute[74190]:         </nova:port>
Oct 18 12:02:37 user nova-compute[74190]:       </nova:ports>
Oct 18 12:02:37 user nova-compute[74190]:     </nova:instance>
Oct 18 12:02:37 user nova-compute[74190]:   </metadata>
Oct 18 12:02:37 user nova-compute[74190]:   <sysinfo type="smbios">
Oct 18 12:02:37 user nova-compute[74190]:     <system>
Oct 18 12:02:37 user nova-compute[74190]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 12:02:37 user nova-compute[74190]:       <entry name="product">OpenStack Nova</entry>
Oct 18 12:02:37 user nova-compute[74190]:       <entry name="version">0.0.0</entry>
Oct 18 12:02:37 user nova-compute[74190]:       <entry name="serial">7f79a267-5bc8-4fa0-9e3a-4706fa1da142</entry>
Oct 18 12:02:37 user nova-compute[74190]:       <entry name="uuid">7f79a267-5bc8-4fa0-9e3a-4706fa1da142</entry>
Oct 18 12:02:37 user nova-compute[74190]:       <entry name="family">Virtual Machine</entry>
Oct 18 12:02:37 user nova-compute[74190]:     </system>
Oct 18 12:02:37 user nova-compute[74190]:   </sysinfo>
Oct 18 12:02:37 user nova-compute[74190]:   <os>
Oct 18 12:02:37 user nova-compute[74190]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 12:02:37 user nova-compute[74190]:     <boot dev="hd"/>
Oct 18 12:02:37 user nova-compute[74190]:     <smbios mode="sysinfo"/>
Oct 18 12:02:37 user nova-compute[74190]:   </os>
Oct 18 12:02:37 user nova-compute[74190]:   <features>
Oct 18 12:02:37 user nova-compute[74190]:     <acpi/>
Oct 18 12:02:37 user nova-compute[74190]:     <apic/>
Oct 18 12:02:37 user nova-compute[74190]:     <vmcoreinfo/>
Oct 18 12:02:37 user nova-compute[74190]:   </features>
Oct 18 12:02:37 user nova-compute[74190]:   <clock offset="utc">
Oct 18 12:02:37 user nova-compute[74190]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 12:02:37 user nova-compute[74190]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 12:02:37 user nova-compute[74190]:     <timer name="hpet" present="no"/>
Oct 18 12:02:37 user nova-compute[74190]:   </clock>
Oct 18 12:02:37 user nova-compute[74190]:   <cpu mode="custom" match="exact">
Oct 18 12:02:37 user nova-compute[74190]:     <model>Nehalem</model>
Oct 18 12:02:37 user nova-compute[74190]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 12:02:37 user nova-compute[74190]:   </cpu>
Oct 18 12:02:37 user nova-compute[74190]:   <devices>
Oct 18 12:02:37 user nova-compute[74190]:     <disk type="file" device="disk">
Oct 18 12:02:37 user nova-compute[74190]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 12:02:37 user nova-compute[74190]:       <source file="/opt/stack/data/nova/instances/7f79a267-5bc8-4fa0-9e3a-4706fa1da142/disk"/>
Oct 18 12:02:37 user nova-compute[74190]:       <target dev="vda" bus="virtio"/>
Oct 18 12:02:37 user nova-compute[74190]:     </disk>
Oct 18 12:02:37 user nova-compute[74190]:     <interface type="ethernet">
Oct 18 12:02:37 user nova-compute[74190]:       <mac address="fa:16:3e:68:65:7b"/>
Oct 18 12:02:37 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 12:02:37 user nova-compute[74190]:       <mtu size="1442"/>
Oct 18 12:02:37 user nova-compute[74190]:       <target dev="tap85b87aa7-52"/>
Oct 18 12:02:37 user nova-compute[74190]:     </interface>
Oct 18 12:02:37 user nova-compute[74190]:     <serial type="pty">
Oct 18 12:02:37 user nova-compute[74190]:       <log file="/opt/stack/data/nova/instances/7f79a267-5bc8-4fa0-9e3a-4706fa1da142/console.log" append="off"/>
Oct 18 12:02:37 user nova-compute[74190]:     </serial>
Oct 18 12:02:37 user nova-compute[74190]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 12:02:37 user nova-compute[74190]:     <video>
Oct 18 12:02:37 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 12:02:37 user nova-compute[74190]:     </video>
Oct 18 12:02:37 user nova-compute[74190]:     <rng model="virtio">
Oct 18 12:02:37 user nova-compute[74190]:       <backend model="random">/dev/urandom</backend>
Oct 18 12:02:37 user nova-compute[74190]:     </rng>
Oct 18 12:02:37 user nova-compute[74190]:     <controller type="usb" index="0" model="none"/>
Oct 18 12:02:37 user nova-compute[74190]:     <memballoon model="virtio">
Oct 18 12:02:37 user nova-compute[74190]:       <stats period="10"/>
Oct 18 12:02:37 user nova-compute[74190]:     </memballoon>
Oct 18 12:02:37 user nova-compute[74190]:   </devices>
Oct 18 12:02:37 user nova-compute[74190]: </domain>
Oct 18 12:02:37 user nova-compute[74190]:  {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 12:02:37 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-fc4edd62-ecff-4960-b0e3-8a8f3f86a3eb tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T12:02:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1792483886',display_name='tempest-ServerRescueNegativeTestJSON-server-1792483886',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1792483886',id=36,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkIQ8d3leZjsvwziIWZ+8LvZaK+fQGEHmIEFhtuiFYjCN5LSlir32U0rEoPzQvvKfWbmmXf87lyxNJGp1oDmc+aRdOnCgCKp/U0aihiZb7ZCRL045Ck061Eajb0ZA9iDQ==',key_name='tempest-keypair-132610173',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ffa18c02b8a4117ab1ccc52aca64f06',ramdisk_id='',reservation_id='r-mifp9rvd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1266902394',owner_user_name='tempest-ServerRescueNegativeTestJSON-1266902394-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T12:02:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9db2d65206e24d0aa1428b9bcaa0a86e',uuid=7f79a267-5bc8-4fa0-9e3a-4706fa1da142,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85b87aa7-52a9-4487-a954-7e07dcf20500", "address": "fa:16:3e:68:65:7b", "network": {"id": "130f7948-11e4-49b4-9d4a-dffb2b48bdcd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595419292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ffa18c02b8a4117ab1ccc52aca64f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85b87aa7-52", "ovs_interfaceid": "85b87aa7-52a9-4487-a954-7e07dcf20500", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 12:02:37 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-fc4edd62-ecff-4960-b0e3-8a8f3f86a3eb tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Converting VIF {"id": "85b87aa7-52a9-4487-a954-7e07dcf20500", "address": "fa:16:3e:68:65:7b", "network": {"id": "130f7948-11e4-49b4-9d4a-dffb2b48bdcd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595419292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ffa18c02b8a4117ab1ccc52aca64f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85b87aa7-52", "ovs_interfaceid": "85b87aa7-52a9-4487-a954-7e07dcf20500", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 12:02:37 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-fc4edd62-ecff-4960-b0e3-8a8f3f86a3eb tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:65:7b,bridge_name='br-int',has_traffic_filtering=True,id=85b87aa7-52a9-4487-a954-7e07dcf20500,network=Network(130f7948-11e4-49b4-9d4a-dffb2b48bdcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85b87aa7-52') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 12:02:37 user nova-compute[74190]: DEBUG os_vif [None req-fc4edd62-ecff-4960-b0e3-8a8f3f86a3eb tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:65:7b,bridge_name='br-int',has_traffic_filtering=True,id=85b87aa7-52a9-4487-a954-7e07dcf20500,network=Network(130f7948-11e4-49b4-9d4a-dffb2b48bdcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85b87aa7-52') {{(pid=74190) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 12:02:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:02:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:02:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 12:02:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:02:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '089a85c7-a5e4-5a97-b605-3f2181499b0d', '_type': 'linux-noop'}}, row=False) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:02:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:02:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:02:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:02:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap85b87aa7-52, may_exist=True, interface_attrs={}) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:02:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap85b87aa7-52, col_values=(('qos', UUID('fbe1e938-edd9-40c2-9a6a-27fc615d4582')),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:02:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap85b87aa7-52, col_values=(('external_ids', {'iface-id': '85b87aa7-52a9-4487-a954-7e07dcf20500', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:68:65:7b', 'vm-uuid': '7f79a267-5bc8-4fa0-9e3a-4706fa1da142'}),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:02:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:02:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:02:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:02:37 user nova-compute[74190]: INFO os_vif [None req-fc4edd62-ecff-4960-b0e3-8a8f3f86a3eb tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:65:7b,bridge_name='br-int',has_traffic_filtering=True,id=85b87aa7-52a9-4487-a954-7e07dcf20500,network=Network(130f7948-11e4-49b4-9d4a-dffb2b48bdcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85b87aa7-52')
Oct 18 12:02:37 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-fc4edd62-ecff-4960-b0e3-8a8f3f86a3eb tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] No BDM found with device name vda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 12:02:37 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-fc4edd62-ecff-4960-b0e3-8a8f3f86a3eb tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] No VIF found with MAC fa:16:3e:68:65:7b, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 12:02:38 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: 7128c4e8-0118-4138-b421-9b1d610d7454] Updating instance_info_cache with network_info: [] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:02:38 user nova-compute[74190]: INFO nova.compute.manager [-] [instance: 7128c4e8-0118-4138-b421-9b1d610d7454] Took 0.76 seconds to deallocate network for instance.
Oct 18 12:02:38 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-a6c919cb-89ac-4da7-9eb8-1da2a518542c tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:02:38 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-a6c919cb-89ac-4da7-9eb8-1da2a518542c tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:02:38 user nova-compute[74190]: DEBUG nova.network.neutron [req-110e8dcc-881a-4f08-b607-0451e08c06fa req-164b5ef2-51d5-4a5a-9fb7-6aabfc6d3af3 service nova] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Updated VIF entry in instance network info cache for port 85b87aa7-52a9-4487-a954-7e07dcf20500. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 12:02:38 user nova-compute[74190]: DEBUG nova.network.neutron [req-110e8dcc-881a-4f08-b607-0451e08c06fa req-164b5ef2-51d5-4a5a-9fb7-6aabfc6d3af3 service nova] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Updating instance_info_cache with network_info: [{"id": "85b87aa7-52a9-4487-a954-7e07dcf20500", "address": "fa:16:3e:68:65:7b", "network": {"id": "130f7948-11e4-49b4-9d4a-dffb2b48bdcd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595419292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ffa18c02b8a4117ab1ccc52aca64f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85b87aa7-52", "ovs_interfaceid": "85b87aa7-52a9-4487-a954-7e07dcf20500", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:02:38 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-110e8dcc-881a-4f08-b607-0451e08c06fa req-164b5ef2-51d5-4a5a-9fb7-6aabfc6d3af3 service nova] Releasing lock "refresh_cache-7f79a267-5bc8-4fa0-9e3a-4706fa1da142" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:02:38 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-a6c919cb-89ac-4da7-9eb8-1da2a518542c tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 12:02:38 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-a6c919cb-89ac-4da7-9eb8-1da2a518542c tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 12:02:38 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-a6c919cb-89ac-4da7-9eb8-1da2a518542c tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.362s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:02:38 user nova-compute[74190]: INFO nova.scheduler.client.report [None req-a6c919cb-89ac-4da7-9eb8-1da2a518542c tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Deleted allocations for instance 7128c4e8-0118-4138-b421-9b1d610d7454
Oct 18 12:02:38 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-a6c919cb-89ac-4da7-9eb8-1da2a518542c tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "7128c4e8-0118-4138-b421-9b1d610d7454" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.199s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:02:38 user nova-compute[74190]: DEBUG nova.compute.manager [req-761ee08a-5abc-4f7c-9f4b-229483bcb398 req-f3825732-fd19-4cca-9330-6108e1b1fa17 service nova] [instance: 7128c4e8-0118-4138-b421-9b1d610d7454] Received event network-vif-plugged-bc81c313-cdfc-4ef9-9c98-6efba1603301 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:02:38 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-761ee08a-5abc-4f7c-9f4b-229483bcb398 req-f3825732-fd19-4cca-9330-6108e1b1fa17 service nova] Acquiring lock "7128c4e8-0118-4138-b421-9b1d610d7454-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:02:38 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-761ee08a-5abc-4f7c-9f4b-229483bcb398 req-f3825732-fd19-4cca-9330-6108e1b1fa17 service nova] Lock "7128c4e8-0118-4138-b421-9b1d610d7454-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:02:38 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-761ee08a-5abc-4f7c-9f4b-229483bcb398 req-f3825732-fd19-4cca-9330-6108e1b1fa17 service nova] Lock "7128c4e8-0118-4138-b421-9b1d610d7454-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:02:38 user nova-compute[74190]: DEBUG nova.compute.manager [req-761ee08a-5abc-4f7c-9f4b-229483bcb398 req-f3825732-fd19-4cca-9330-6108e1b1fa17 service nova] [instance: 7128c4e8-0118-4138-b421-9b1d610d7454] No waiting events found dispatching network-vif-plugged-bc81c313-cdfc-4ef9-9c98-6efba1603301 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:02:38 user nova-compute[74190]: WARNING nova.compute.manager [req-761ee08a-5abc-4f7c-9f4b-229483bcb398 req-f3825732-fd19-4cca-9330-6108e1b1fa17 service nova] [instance: 7128c4e8-0118-4138-b421-9b1d610d7454] Received unexpected event network-vif-plugged-bc81c313-cdfc-4ef9-9c98-6efba1603301 for instance with vm_state deleted and task_state None.
Oct 18 12:02:38 user nova-compute[74190]: DEBUG nova.compute.manager [req-761ee08a-5abc-4f7c-9f4b-229483bcb398 req-f3825732-fd19-4cca-9330-6108e1b1fa17 service nova] [instance: 7128c4e8-0118-4138-b421-9b1d610d7454] Received event network-vif-deleted-bc81c313-cdfc-4ef9-9c98-6efba1603301 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:02:39 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:02:39 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:02:39 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:02:39 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:02:39 user nova-compute[74190]: DEBUG nova.compute.manager [req-468a51e2-a154-4fac-b96b-1d4eb286e21e req-bd46370f-19fa-4a87-bbe1-4c7657b1794d service nova] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Received event network-vif-plugged-85b87aa7-52a9-4487-a954-7e07dcf20500 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:02:39 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-468a51e2-a154-4fac-b96b-1d4eb286e21e req-bd46370f-19fa-4a87-bbe1-4c7657b1794d service nova] Acquiring lock "7f79a267-5bc8-4fa0-9e3a-4706fa1da142-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:02:39 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-468a51e2-a154-4fac-b96b-1d4eb286e21e req-bd46370f-19fa-4a87-bbe1-4c7657b1794d service nova] Lock "7f79a267-5bc8-4fa0-9e3a-4706fa1da142-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:02:39 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-468a51e2-a154-4fac-b96b-1d4eb286e21e req-bd46370f-19fa-4a87-bbe1-4c7657b1794d service nova] Lock "7f79a267-5bc8-4fa0-9e3a-4706fa1da142-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:02:39 user nova-compute[74190]: DEBUG nova.compute.manager [req-468a51e2-a154-4fac-b96b-1d4eb286e21e req-bd46370f-19fa-4a87-bbe1-4c7657b1794d service nova] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] No waiting events found dispatching network-vif-plugged-85b87aa7-52a9-4487-a954-7e07dcf20500 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:02:39 user nova-compute[74190]: WARNING nova.compute.manager [req-468a51e2-a154-4fac-b96b-1d4eb286e21e req-bd46370f-19fa-4a87-bbe1-4c7657b1794d service nova] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Received unexpected event network-vif-plugged-85b87aa7-52a9-4487-a954-7e07dcf20500 for instance with vm_state building and task_state spawning.
Oct 18 12:02:39 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:02:39 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:02:40 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:02:41 user nova-compute[74190]: DEBUG nova.compute.manager [None req-fc4edd62-ecff-4960-b0e3-8a8f3f86a3eb tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Instance event wait completed in 0 seconds for  {{(pid=74190) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 12:02:41 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-fc4edd62-ecff-4960-b0e3-8a8f3f86a3eb tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Guest created on hypervisor {{(pid=74190) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 12:02:41 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Instance spawned successfully.
Oct 18 12:02:41 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-fc4edd62-ecff-4960-b0e3-8a8f3f86a3eb tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 12:02:41 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-fc4edd62-ecff-4960-b0e3-8a8f3f86a3eb tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Found default for hw_cdrom_bus of ide {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:02:41 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-fc4edd62-ecff-4960-b0e3-8a8f3f86a3eb tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Found default for hw_disk_bus of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:02:41 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-fc4edd62-ecff-4960-b0e3-8a8f3f86a3eb tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Found default for hw_input_bus of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:02:41 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-fc4edd62-ecff-4960-b0e3-8a8f3f86a3eb tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Found default for hw_pointer_model of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:02:41 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-fc4edd62-ecff-4960-b0e3-8a8f3f86a3eb tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Found default for hw_video_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:02:41 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-fc4edd62-ecff-4960-b0e3-8a8f3f86a3eb tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Found default for hw_vif_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:02:41 user nova-compute[74190]: INFO nova.compute.manager [None req-fc4edd62-ecff-4960-b0e3-8a8f3f86a3eb tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Took 5.61 seconds to spawn the instance on the hypervisor.
Oct 18 12:02:41 user nova-compute[74190]: DEBUG nova.compute.manager [None req-fc4edd62-ecff-4960-b0e3-8a8f3f86a3eb tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Checking state {{(pid=74190) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 12:02:41 user nova-compute[74190]: DEBUG nova.compute.manager [req-d4b598c6-6fae-483f-ba27-d7199186ca3e req-66e1a90b-cab7-46b8-af71-c4c0d099eb07 service nova] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Received event network-vif-plugged-85b87aa7-52a9-4487-a954-7e07dcf20500 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:02:41 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d4b598c6-6fae-483f-ba27-d7199186ca3e req-66e1a90b-cab7-46b8-af71-c4c0d099eb07 service nova] Acquiring lock "7f79a267-5bc8-4fa0-9e3a-4706fa1da142-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:02:41 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d4b598c6-6fae-483f-ba27-d7199186ca3e req-66e1a90b-cab7-46b8-af71-c4c0d099eb07 service nova] Lock "7f79a267-5bc8-4fa0-9e3a-4706fa1da142-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:02:41 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d4b598c6-6fae-483f-ba27-d7199186ca3e req-66e1a90b-cab7-46b8-af71-c4c0d099eb07 service nova] Lock "7f79a267-5bc8-4fa0-9e3a-4706fa1da142-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:02:41 user nova-compute[74190]: DEBUG nova.compute.manager [req-d4b598c6-6fae-483f-ba27-d7199186ca3e req-66e1a90b-cab7-46b8-af71-c4c0d099eb07 service nova] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] No waiting events found dispatching network-vif-plugged-85b87aa7-52a9-4487-a954-7e07dcf20500 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:02:41 user nova-compute[74190]: WARNING nova.compute.manager [req-d4b598c6-6fae-483f-ba27-d7199186ca3e req-66e1a90b-cab7-46b8-af71-c4c0d099eb07 service nova] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Received unexpected event network-vif-plugged-85b87aa7-52a9-4487-a954-7e07dcf20500 for instance with vm_state building and task_state spawning.
Oct 18 12:02:41 user nova-compute[74190]: INFO nova.compute.manager [None req-fc4edd62-ecff-4960-b0e3-8a8f3f86a3eb tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Took 6.30 seconds to build instance.
Oct 18 12:02:41 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-fc4edd62-ecff-4960-b0e3-8a8f3f86a3eb tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lock "7f79a267-5bc8-4fa0-9e3a-4706fa1da142" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.401s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:02:42 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:02:47 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:02:47 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:02:47 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74190) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 12:02:47 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:02:47 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:02:47 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:02:50 user nova-compute[74190]: INFO nova.compute.manager [None req-869e7b7c-642d-4f43-8fd8-4238709be3e1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Unrescuing
Oct 18 12:02:50 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-869e7b7c-642d-4f43-8fd8-4238709be3e1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Acquiring lock "refresh_cache-0382820d-a678-4593-85df-168f42fc4ce4" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:02:50 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-869e7b7c-642d-4f43-8fd8-4238709be3e1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Acquired lock "refresh_cache-0382820d-a678-4593-85df-168f42fc4ce4" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:02:50 user nova-compute[74190]: DEBUG nova.network.neutron [None req-869e7b7c-642d-4f43-8fd8-4238709be3e1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Building network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 12:02:51 user nova-compute[74190]: DEBUG nova.network.neutron [None req-869e7b7c-642d-4f43-8fd8-4238709be3e1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Updating instance_info_cache with network_info: [{"id": "a32b81a2-7b02-48ed-9550-d392be5e221e", "address": "fa:16:3e:e7:d8:e5", "network": {"id": "c2dbbd24-f1d2-47a2-835f-0f9b24b585f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-920140900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d994366010142519ff367fa7ca77e61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa32b81a2-7b", "ovs_interfaceid": "a32b81a2-7b02-48ed-9550-d392be5e221e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:02:51 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-869e7b7c-642d-4f43-8fd8-4238709be3e1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Releasing lock "refresh_cache-0382820d-a678-4593-85df-168f42fc4ce4" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:02:51 user nova-compute[74190]: DEBUG nova.objects.instance [None req-869e7b7c-642d-4f43-8fd8-4238709be3e1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lazy-loading 'flavor' on Instance uuid 0382820d-a678-4593-85df-168f42fc4ce4 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:02:51 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:02:51 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:02:51 user nova-compute[74190]: DEBUG nova.compute.manager [req-81427592-0cb0-494b-9489-516ec7e89303 req-9a9e291f-48f7-4d2d-bb10-ceed3f7dcdc3 service nova] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Received event network-vif-unplugged-a32b81a2-7b02-48ed-9550-d392be5e221e {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:02:51 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-81427592-0cb0-494b-9489-516ec7e89303 req-9a9e291f-48f7-4d2d-bb10-ceed3f7dcdc3 service nova] Acquiring lock "0382820d-a678-4593-85df-168f42fc4ce4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:02:51 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-81427592-0cb0-494b-9489-516ec7e89303 req-9a9e291f-48f7-4d2d-bb10-ceed3f7dcdc3 service nova] Lock "0382820d-a678-4593-85df-168f42fc4ce4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:02:51 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-81427592-0cb0-494b-9489-516ec7e89303 req-9a9e291f-48f7-4d2d-bb10-ceed3f7dcdc3 service nova] Lock "0382820d-a678-4593-85df-168f42fc4ce4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:02:51 user nova-compute[74190]: DEBUG nova.compute.manager [req-81427592-0cb0-494b-9489-516ec7e89303 req-9a9e291f-48f7-4d2d-bb10-ceed3f7dcdc3 service nova] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] No waiting events found dispatching network-vif-unplugged-a32b81a2-7b02-48ed-9550-d392be5e221e {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:02:51 user nova-compute[74190]: WARNING nova.compute.manager [req-81427592-0cb0-494b-9489-516ec7e89303 req-9a9e291f-48f7-4d2d-bb10-ceed3f7dcdc3 service nova] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Received unexpected event network-vif-unplugged-a32b81a2-7b02-48ed-9550-d392be5e221e for instance with vm_state rescued and task_state unrescuing.
Oct 18 12:02:51 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:02:51 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:02:51 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Instance destroyed successfully.
Oct 18 12:02:52 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:02:53 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:02:53 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:02:53 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:02:53 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:02:53 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:02:53 user nova-compute[74190]: DEBUG nova.compute.manager [req-bd6f509a-5c56-45f2-8645-f7a5dab36270 req-60890168-557e-4690-86fb-e3bd6cfafa81 service nova] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Received event network-vif-plugged-a32b81a2-7b02-48ed-9550-d392be5e221e {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:02:53 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-bd6f509a-5c56-45f2-8645-f7a5dab36270 req-60890168-557e-4690-86fb-e3bd6cfafa81 service nova] Acquiring lock "0382820d-a678-4593-85df-168f42fc4ce4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:02:53 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-bd6f509a-5c56-45f2-8645-f7a5dab36270 req-60890168-557e-4690-86fb-e3bd6cfafa81 service nova] Lock "0382820d-a678-4593-85df-168f42fc4ce4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:02:53 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-bd6f509a-5c56-45f2-8645-f7a5dab36270 req-60890168-557e-4690-86fb-e3bd6cfafa81 service nova] Lock "0382820d-a678-4593-85df-168f42fc4ce4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:02:53 user nova-compute[74190]: DEBUG nova.compute.manager [req-bd6f509a-5c56-45f2-8645-f7a5dab36270 req-60890168-557e-4690-86fb-e3bd6cfafa81 service nova] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] No waiting events found dispatching network-vif-plugged-a32b81a2-7b02-48ed-9550-d392be5e221e {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:02:53 user nova-compute[74190]: WARNING nova.compute.manager [req-bd6f509a-5c56-45f2-8645-f7a5dab36270 req-60890168-557e-4690-86fb-e3bd6cfafa81 service nova] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Received unexpected event network-vif-plugged-a32b81a2-7b02-48ed-9550-d392be5e221e for instance with vm_state rescued and task_state unrescuing.
Oct 18 12:02:53 user nova-compute[74190]: DEBUG nova.compute.manager [req-bd6f509a-5c56-45f2-8645-f7a5dab36270 req-60890168-557e-4690-86fb-e3bd6cfafa81 service nova] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Received event network-vif-plugged-a32b81a2-7b02-48ed-9550-d392be5e221e {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:02:53 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-bd6f509a-5c56-45f2-8645-f7a5dab36270 req-60890168-557e-4690-86fb-e3bd6cfafa81 service nova] Acquiring lock "0382820d-a678-4593-85df-168f42fc4ce4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:02:53 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-bd6f509a-5c56-45f2-8645-f7a5dab36270 req-60890168-557e-4690-86fb-e3bd6cfafa81 service nova] Lock "0382820d-a678-4593-85df-168f42fc4ce4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:02:53 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-bd6f509a-5c56-45f2-8645-f7a5dab36270 req-60890168-557e-4690-86fb-e3bd6cfafa81 service nova] Lock "0382820d-a678-4593-85df-168f42fc4ce4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:02:53 user nova-compute[74190]: DEBUG nova.compute.manager [req-bd6f509a-5c56-45f2-8645-f7a5dab36270 req-60890168-557e-4690-86fb-e3bd6cfafa81 service nova] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] No waiting events found dispatching network-vif-plugged-a32b81a2-7b02-48ed-9550-d392be5e221e {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:02:53 user nova-compute[74190]: WARNING nova.compute.manager [req-bd6f509a-5c56-45f2-8645-f7a5dab36270 req-60890168-557e-4690-86fb-e3bd6cfafa81 service nova] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Received unexpected event network-vif-plugged-a32b81a2-7b02-48ed-9550-d392be5e221e for instance with vm_state rescued and task_state unrescuing.
Oct 18 12:02:55 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:02:55 user nova-compute[74190]: DEBUG nova.compute.manager [None req-869e7b7c-642d-4f43-8fd8-4238709be3e1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Checking state {{(pid=74190) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 12:02:55 user nova-compute[74190]: DEBUG nova.compute.manager [req-0dba4480-b0bc-44f8-8b89-20cfa3e32dc9 req-562cd2f9-8672-400f-a4ac-4b4473985b8e service nova] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Received event network-vif-plugged-a32b81a2-7b02-48ed-9550-d392be5e221e {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:02:55 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-0dba4480-b0bc-44f8-8b89-20cfa3e32dc9 req-562cd2f9-8672-400f-a4ac-4b4473985b8e service nova] Acquiring lock "0382820d-a678-4593-85df-168f42fc4ce4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:02:55 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-0dba4480-b0bc-44f8-8b89-20cfa3e32dc9 req-562cd2f9-8672-400f-a4ac-4b4473985b8e service nova] Lock "0382820d-a678-4593-85df-168f42fc4ce4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:02:55 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-0dba4480-b0bc-44f8-8b89-20cfa3e32dc9 req-562cd2f9-8672-400f-a4ac-4b4473985b8e service nova] Lock "0382820d-a678-4593-85df-168f42fc4ce4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:02:55 user nova-compute[74190]: DEBUG nova.compute.manager [req-0dba4480-b0bc-44f8-8b89-20cfa3e32dc9 req-562cd2f9-8672-400f-a4ac-4b4473985b8e service nova] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] No waiting events found dispatching network-vif-plugged-a32b81a2-7b02-48ed-9550-d392be5e221e {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:02:55 user nova-compute[74190]: WARNING nova.compute.manager [req-0dba4480-b0bc-44f8-8b89-20cfa3e32dc9 req-562cd2f9-8672-400f-a4ac-4b4473985b8e service nova] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Received unexpected event network-vif-plugged-a32b81a2-7b02-48ed-9550-d392be5e221e for instance with vm_state active and task_state None.
Oct 18 12:02:57 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:03:00 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:03:02 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:03:03 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:03:05 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:03:05 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:03:07 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:03:07 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:03:08 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:03:08 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74190) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 12:03:10 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:03:10 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:03:12 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:03:12 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Starting heal instance info cache {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 12:03:12 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Rebuilding the list of instances to heal {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 18 12:03:12 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "refresh_cache-4e916d24-9f9d-4289-87ce-f65d2499fcd9" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:03:12 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquired lock "refresh_cache-4e916d24-9f9d-4289-87ce-f65d2499fcd9" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:03:12 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Forcefully refreshing network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 18 12:03:12 user nova-compute[74190]: DEBUG nova.objects.instance [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lazy-loading 'info_cache' on Instance uuid 4e916d24-9f9d-4289-87ce-f65d2499fcd9 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:03:12 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Updating instance_info_cache with network_info: [{"id": "7cee893b-5ac8-45f8-a1f8-5374b49cc3b5", "address": "fa:16:3e:15:15:1d", "network": {"id": "4609cfba-1e8b-4740-bdf6-642b196097a3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1019354168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a4f041e58144d54a458a01074eb35a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cee893b-5a", "ovs_interfaceid": "7cee893b-5ac8-45f8-a1f8-5374b49cc3b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:03:12 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Releasing lock "refresh_cache-4e916d24-9f9d-4289-87ce-f65d2499fcd9" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:03:12 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Updated the network info_cache for instance {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 18 12:03:12 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:03:12 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:03:12 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:03:12 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:03:12 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Auditing locally available compute resources for user (node: user) {{(pid=74190) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 12:03:12 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:03:12 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f59adf3-9728-4d5b-87d5-2ad32c99d06e/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:03:13 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f59adf3-9728-4d5b-87d5-2ad32c99d06e/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:03:13 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f59adf3-9728-4d5b-87d5-2ad32c99d06e/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:03:13 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f59adf3-9728-4d5b-87d5-2ad32c99d06e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:03:13 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f79a267-5bc8-4fa0-9e3a-4706fa1da142/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:03:13 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f79a267-5bc8-4fa0-9e3a-4706fa1da142/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:03:13 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f79a267-5bc8-4fa0-9e3a-4706fa1da142/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:03:13 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f79a267-5bc8-4fa0-9e3a-4706fa1da142/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:03:13 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:03:13 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:03:13 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:03:14 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:03:14 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a79ff814-dec6-4022-a7b6-5420861a2164/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:03:14 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a79ff814-dec6-4022-a7b6-5420861a2164/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:03:14 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a79ff814-dec6-4022-a7b6-5420861a2164/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:03:14 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a79ff814-dec6-4022-a7b6-5420861a2164/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:03:14 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:03:14 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:03:14 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:03:14 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:03:14 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14ba5fe8-567e-40c8-9d69-b54af521b2bc/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:03:15 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14ba5fe8-567e-40c8-9d69-b54af521b2bc/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:03:15 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14ba5fe8-567e-40c8-9d69-b54af521b2bc/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:03:15 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14ba5fe8-567e-40c8-9d69-b54af521b2bc/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:03:15 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:03:15 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:03:15 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:03:15 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:03:15 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 12:03:15 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk.rescue --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:03:15 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:03:15 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk.rescue --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:03:15 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:03:15 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:03:16 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:03:16 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:03:16 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:03:16 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 12:03:16 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:03:16 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:03:16 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Hypervisor/Node resource view: name=user free_ram=7788MB free_disk=25.005664825439453GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74190) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 12:03:16 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:03:16 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:03:16 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 4e916d24-9f9d-4289-87ce-f65d2499fcd9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:03:16 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 95ca0697-22b5-4109-868f-ca5556015a1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:03:16 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 42413a94-9973-4e8d-83b6-207a4e7847c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:03:16 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 772b126c-2148-4ca8-90f2-69d6eb4b7db7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:03:16 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 0382820d-a678-4593-85df-168f42fc4ce4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:03:16 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 2f59adf3-9728-4d5b-87d5-2ad32c99d06e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:03:16 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 14ba5fe8-567e-40c8-9d69-b54af521b2bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:03:16 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance a79ff814-dec6-4022-a7b6-5420861a2164 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:03:16 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 7f79a267-5bc8-4fa0-9e3a-4706fa1da142 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:03:16 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 12:03:16 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 12:03:16 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Refreshing inventories for resource provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 18 12:03:16 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Updating ProviderTree inventory for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 18 12:03:16 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Updating inventory in ProviderTree for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 18 12:03:16 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Refreshing aggregate associations for resource provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66, aggregates: None {{(pid=74190) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 18 12:03:16 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Refreshing trait associations for resource provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66, traits: COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE42,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_ACCELERATORS,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=74190) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 18 12:03:17 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 12:03:17 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 12:03:17 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Compute_service record updated for user:user {{(pid=74190) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 12:03:17 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.535s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:03:17 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:03:17 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:03:17 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74190) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 12:03:17 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:03:17 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:03:17 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:03:18 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:03:18 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:03:18 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:03:19 user nova-compute[74190]: DEBUG nova.compute.manager [req-b3bc12a7-4aed-4648-b4b0-505c8651e54a req-70d2e1e2-be7f-42a2-8c27-6e4e231c6b36 service nova] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] Received event network-changed-9817302c-2890-4026-86e9-061ca2d1497a {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:03:19 user nova-compute[74190]: DEBUG nova.compute.manager [req-b3bc12a7-4aed-4648-b4b0-505c8651e54a req-70d2e1e2-be7f-42a2-8c27-6e4e231c6b36 service nova] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] Refreshing instance network info cache due to event network-changed-9817302c-2890-4026-86e9-061ca2d1497a. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 12:03:19 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-b3bc12a7-4aed-4648-b4b0-505c8651e54a req-70d2e1e2-be7f-42a2-8c27-6e4e231c6b36 service nova] Acquiring lock "refresh_cache-2f59adf3-9728-4d5b-87d5-2ad32c99d06e" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:03:19 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-b3bc12a7-4aed-4648-b4b0-505c8651e54a req-70d2e1e2-be7f-42a2-8c27-6e4e231c6b36 service nova] Acquired lock "refresh_cache-2f59adf3-9728-4d5b-87d5-2ad32c99d06e" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:03:19 user nova-compute[74190]: DEBUG nova.network.neutron [req-b3bc12a7-4aed-4648-b4b0-505c8651e54a req-70d2e1e2-be7f-42a2-8c27-6e4e231c6b36 service nova] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] Refreshing network info cache for port 9817302c-2890-4026-86e9-061ca2d1497a {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 12:03:19 user nova-compute[74190]: DEBUG nova.network.neutron [req-b3bc12a7-4aed-4648-b4b0-505c8651e54a req-70d2e1e2-be7f-42a2-8c27-6e4e231c6b36 service nova] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] Updated VIF entry in instance network info cache for port 9817302c-2890-4026-86e9-061ca2d1497a. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 12:03:19 user nova-compute[74190]: DEBUG nova.network.neutron [req-b3bc12a7-4aed-4648-b4b0-505c8651e54a req-70d2e1e2-be7f-42a2-8c27-6e4e231c6b36 service nova] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] Updating instance_info_cache with network_info: [{"id": "9817302c-2890-4026-86e9-061ca2d1497a", "address": "fa:16:3e:5c:73:bc", "network": {"id": "60c208d8-33b0-4c65-8ac5-5632b2e428df", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-39693250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "423525b841c84a6f8fe6a72da9cccef2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9817302c-28", "ovs_interfaceid": "9817302c-2890-4026-86e9-061ca2d1497a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:03:19 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-b3bc12a7-4aed-4648-b4b0-505c8651e54a req-70d2e1e2-be7f-42a2-8c27-6e4e231c6b36 service nova] Releasing lock "refresh_cache-2f59adf3-9728-4d5b-87d5-2ad32c99d06e" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:03:20 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:03:22 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:03:25 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:03:26 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-ffe5ab78-f32b-4c76-9331-ddfc319c84e9 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Acquiring lock "2f59adf3-9728-4d5b-87d5-2ad32c99d06e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:03:26 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-ffe5ab78-f32b-4c76-9331-ddfc319c84e9 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Lock "2f59adf3-9728-4d5b-87d5-2ad32c99d06e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:03:26 user nova-compute[74190]: DEBUG nova.objects.instance [None req-ffe5ab78-f32b-4c76-9331-ddfc319c84e9 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Lazy-loading 'flavor' on Instance uuid 2f59adf3-9728-4d5b-87d5-2ad32c99d06e {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:03:26 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-ffe5ab78-f32b-4c76-9331-ddfc319c84e9 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Lock "2f59adf3-9728-4d5b-87d5-2ad32c99d06e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:03:26 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-ffe5ab78-f32b-4c76-9331-ddfc319c84e9 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Acquiring lock "2f59adf3-9728-4d5b-87d5-2ad32c99d06e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:03:26 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-ffe5ab78-f32b-4c76-9331-ddfc319c84e9 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Lock "2f59adf3-9728-4d5b-87d5-2ad32c99d06e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:03:26 user nova-compute[74190]: INFO nova.compute.manager [None req-ffe5ab78-f32b-4c76-9331-ddfc319c84e9 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] Attaching volume 6a5cafb3-2051-4f2b-bfc7-eb4c184d9fd6 to /dev/vdb
Oct 18 12:03:26 user nova-compute[74190]: DEBUG os_brick.utils [None req-ffe5ab78-f32b-4c76-9331-ddfc319c84e9 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 12:03:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:03:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:03:26 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d93258-c4a3-4600-91bc-dca6e384180d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cff158e257e1\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:03:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:03:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:03:26 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ef28cf-60a2-4deb-85f7-2f23a0fc88c1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:03:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:03:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:03:26 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[31d3c28a-d36a-480e-9f54-2f3f6f472625]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:03:26 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e48ae8-90a7-40b2-9c5e-2303fb8f39bb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:03:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-ffe5ab78-f32b-4c76-9331-ddfc319c84e9 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Running cmd (subprocess): nvme version {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:03:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-ffe5ab78-f32b-4c76-9331-ddfc319c84e9 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] 'nvme version' failed. Not Retrying. {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 12:03:26 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ffe5ab78-f32b-4c76-9331-ddfc319c84e9 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] nvme not present on system {{(pid=74190) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 12:03:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:03:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 12:03:26 user nova-compute[74190]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 12:03:26 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd2be35-db13-4f78-b35e-1f934f550339]: (4, '') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:03:26 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-ffe5ab78-f32b-4c76-9331-ddfc319c84e9 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74190) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 12:03:26 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-ffe5ab78-f32b-4c76-9331-ddfc319c84e9 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 12:03:26 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-ffe5ab78-f32b-4c76-9331-ddfc319c84e9 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] LIGHTOS: no hostnqn found. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 12:03:26 user nova-compute[74190]: DEBUG os_brick.utils [None req-ffe5ab78-f32b-4c76-9331-ddfc319c84e9 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cff158e257e1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 12:03:26 user nova-compute[74190]: DEBUG nova.virt.block_device [None req-ffe5ab78-f32b-4c76-9331-ddfc319c84e9 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] Updating existing volume attachment record: 6ff42350-0164-4a40-9e1c-c1a7aeaf7f97 {{(pid=74190) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 12:03:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:03:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:03:30 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-608304b0-97e0-4323-a4ab-aaaa4049ba6f tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Acquiring lock "c0f8682a-6de5-459b-9843-bbe945fb329e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:03:30 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-608304b0-97e0-4323-a4ab-aaaa4049ba6f tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "c0f8682a-6de5-459b-9843-bbe945fb329e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:03:30 user nova-compute[74190]: DEBUG nova.compute.manager [None req-608304b0-97e0-4323-a4ab-aaaa4049ba6f tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: c0f8682a-6de5-459b-9843-bbe945fb329e] Starting instance... {{(pid=74190) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 12:03:30 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-608304b0-97e0-4323-a4ab-aaaa4049ba6f tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:03:30 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-608304b0-97e0-4323-a4ab-aaaa4049ba6f tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:03:30 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-608304b0-97e0-4323-a4ab-aaaa4049ba6f tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74190) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 12:03:30 user nova-compute[74190]: INFO nova.compute.claims [None req-608304b0-97e0-4323-a4ab-aaaa4049ba6f tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: c0f8682a-6de5-459b-9843-bbe945fb329e] Claim successful on node user
Oct 18 12:03:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:03:30 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-608304b0-97e0-4323-a4ab-aaaa4049ba6f tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 12:03:30 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-608304b0-97e0-4323-a4ab-aaaa4049ba6f tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 12:03:30 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-608304b0-97e0-4323-a4ab-aaaa4049ba6f tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.390s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:03:30 user nova-compute[74190]: DEBUG nova.compute.manager [None req-608304b0-97e0-4323-a4ab-aaaa4049ba6f tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: c0f8682a-6de5-459b-9843-bbe945fb329e] Start building networks asynchronously for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 12:03:30 user nova-compute[74190]: DEBUG nova.compute.manager [None req-608304b0-97e0-4323-a4ab-aaaa4049ba6f tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: c0f8682a-6de5-459b-9843-bbe945fb329e] Allocating IP information in the background. {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 12:03:30 user nova-compute[74190]: DEBUG nova.network.neutron [None req-608304b0-97e0-4323-a4ab-aaaa4049ba6f tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: c0f8682a-6de5-459b-9843-bbe945fb329e] allocate_for_instance() {{(pid=74190) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 12:03:30 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-608304b0-97e0-4323-a4ab-aaaa4049ba6f tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: c0f8682a-6de5-459b-9843-bbe945fb329e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 12:03:30 user nova-compute[74190]: DEBUG nova.compute.manager [None req-608304b0-97e0-4323-a4ab-aaaa4049ba6f tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: c0f8682a-6de5-459b-9843-bbe945fb329e] Start building block device mappings for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 12:03:30 user nova-compute[74190]: DEBUG nova.policy [None req-608304b0-97e0-4323-a4ab-aaaa4049ba6f tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7d6bb993153245daabfc59215abbf7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df06c4b010434e3da9ba4ea41f26befa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74190) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 12:03:30 user nova-compute[74190]: DEBUG nova.compute.manager [None req-608304b0-97e0-4323-a4ab-aaaa4049ba6f tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: c0f8682a-6de5-459b-9843-bbe945fb329e] Start spawning the instance on the hypervisor. {{(pid=74190) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 12:03:30 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-608304b0-97e0-4323-a4ab-aaaa4049ba6f tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: c0f8682a-6de5-459b-9843-bbe945fb329e] Creating instance directory {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 12:03:30 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-608304b0-97e0-4323-a4ab-aaaa4049ba6f tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: c0f8682a-6de5-459b-9843-bbe945fb329e] Creating image(s)
Oct 18 12:03:30 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-608304b0-97e0-4323-a4ab-aaaa4049ba6f tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Acquiring lock "/opt/stack/data/nova/instances/c0f8682a-6de5-459b-9843-bbe945fb329e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:03:30 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-608304b0-97e0-4323-a4ab-aaaa4049ba6f tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "/opt/stack/data/nova/instances/c0f8682a-6de5-459b-9843-bbe945fb329e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:03:30 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-608304b0-97e0-4323-a4ab-aaaa4049ba6f tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "/opt/stack/data/nova/instances/c0f8682a-6de5-459b-9843-bbe945fb329e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.013s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:03:30 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-608304b0-97e0-4323-a4ab-aaaa4049ba6f tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:03:31 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-608304b0-97e0-4323-a4ab-aaaa4049ba6f tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.181s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:03:31 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-608304b0-97e0-4323-a4ab-aaaa4049ba6f tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Acquiring lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:03:31 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-608304b0-97e0-4323-a4ab-aaaa4049ba6f tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:03:31 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-608304b0-97e0-4323-a4ab-aaaa4049ba6f tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:03:31 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-608304b0-97e0-4323-a4ab-aaaa4049ba6f tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.166s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:03:31 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-608304b0-97e0-4323-a4ab-aaaa4049ba6f tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f,backing_fmt=raw /opt/stack/data/nova/instances/c0f8682a-6de5-459b-9843-bbe945fb329e/disk 1073741824 {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:03:31 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-608304b0-97e0-4323-a4ab-aaaa4049ba6f tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f,backing_fmt=raw /opt/stack/data/nova/instances/c0f8682a-6de5-459b-9843-bbe945fb329e/disk 1073741824" returned: 0 in 0.051s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:03:31 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-608304b0-97e0-4323-a4ab-aaaa4049ba6f tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:03:31 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-608304b0-97e0-4323-a4ab-aaaa4049ba6f tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:03:31 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-608304b0-97e0-4323-a4ab-aaaa4049ba6f tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.175s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:03:31 user nova-compute[74190]: DEBUG nova.virt.disk.api [None req-608304b0-97e0-4323-a4ab-aaaa4049ba6f tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c0f8682a-6de5-459b-9843-bbe945fb329e/disk. size=1073741824 {{(pid=74190) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 18 12:03:31 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-608304b0-97e0-4323-a4ab-aaaa4049ba6f tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f8682a-6de5-459b-9843-bbe945fb329e/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:03:31 user nova-compute[74190]: DEBUG nova.network.neutron [None req-608304b0-97e0-4323-a4ab-aaaa4049ba6f tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: c0f8682a-6de5-459b-9843-bbe945fb329e] Successfully created port: bf475d1e-c90f-4ec2-aafc-5f9fdaab831f {{(pid=74190) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 12:03:31 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-608304b0-97e0-4323-a4ab-aaaa4049ba6f tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f8682a-6de5-459b-9843-bbe945fb329e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:03:31 user nova-compute[74190]: DEBUG nova.virt.disk.api [None req-608304b0-97e0-4323-a4ab-aaaa4049ba6f tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Cannot resize image /opt/stack/data/nova/instances/c0f8682a-6de5-459b-9843-bbe945fb329e/disk to a smaller size. {{(pid=74190) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 18 12:03:31 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-608304b0-97e0-4323-a4ab-aaaa4049ba6f tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: c0f8682a-6de5-459b-9843-bbe945fb329e] Created local disks {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 12:03:31 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-608304b0-97e0-4323-a4ab-aaaa4049ba6f tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: c0f8682a-6de5-459b-9843-bbe945fb329e] Ensure instance console log exists: /opt/stack/data/nova/instances/c0f8682a-6de5-459b-9843-bbe945fb329e/console.log {{(pid=74190) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 12:03:31 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-608304b0-97e0-4323-a4ab-aaaa4049ba6f tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:03:31 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-608304b0-97e0-4323-a4ab-aaaa4049ba6f tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:03:31 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-608304b0-97e0-4323-a4ab-aaaa4049ba6f tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:03:32 user nova-compute[74190]: DEBUG nova.network.neutron [None req-608304b0-97e0-4323-a4ab-aaaa4049ba6f tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: c0f8682a-6de5-459b-9843-bbe945fb329e] Successfully updated port: bf475d1e-c90f-4ec2-aafc-5f9fdaab831f {{(pid=74190) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 12:03:32 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-608304b0-97e0-4323-a4ab-aaaa4049ba6f tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Acquiring lock "refresh_cache-c0f8682a-6de5-459b-9843-bbe945fb329e" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:03:32 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-608304b0-97e0-4323-a4ab-aaaa4049ba6f tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Acquired lock "refresh_cache-c0f8682a-6de5-459b-9843-bbe945fb329e" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:03:32 user nova-compute[74190]: DEBUG nova.network.neutron [None req-608304b0-97e0-4323-a4ab-aaaa4049ba6f tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: c0f8682a-6de5-459b-9843-bbe945fb329e] Building network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 12:03:32 user nova-compute[74190]: DEBUG nova.compute.manager [req-67dcf719-ac91-4c38-bafe-9b9417341af3 req-d648f7f6-fcb0-4bc9-bfaf-e7bb7ce86efc service nova] [instance: c0f8682a-6de5-459b-9843-bbe945fb329e] Received event network-changed-bf475d1e-c90f-4ec2-aafc-5f9fdaab831f {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:03:32 user nova-compute[74190]: DEBUG nova.compute.manager [req-67dcf719-ac91-4c38-bafe-9b9417341af3 req-d648f7f6-fcb0-4bc9-bfaf-e7bb7ce86efc service nova] [instance: c0f8682a-6de5-459b-9843-bbe945fb329e] Refreshing instance network info cache due to event network-changed-bf475d1e-c90f-4ec2-aafc-5f9fdaab831f. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 12:03:32 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-67dcf719-ac91-4c38-bafe-9b9417341af3 req-d648f7f6-fcb0-4bc9-bfaf-e7bb7ce86efc service nova] Acquiring lock "refresh_cache-c0f8682a-6de5-459b-9843-bbe945fb329e" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:03:32 user nova-compute[74190]: DEBUG nova.network.neutron [None req-608304b0-97e0-4323-a4ab-aaaa4049ba6f tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: c0f8682a-6de5-459b-9843-bbe945fb329e] Instance cache missing network info. {{(pid=74190) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 12:03:32 user nova-compute[74190]: DEBUG nova.network.neutron [None req-608304b0-97e0-4323-a4ab-aaaa4049ba6f tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: c0f8682a-6de5-459b-9843-bbe945fb329e] Updating instance_info_cache with network_info: [{"id": "bf475d1e-c90f-4ec2-aafc-5f9fdaab831f", "address": "fa:16:3e:a7:7b:dd", "network": {"id": "25e0d6f5-497d-4898-8181-5b4848950f16", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-245925644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df06c4b010434e3da9ba4ea41f26befa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf475d1e-c9", "ovs_interfaceid": "bf475d1e-c90f-4ec2-aafc-5f9fdaab831f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:03:32 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-608304b0-97e0-4323-a4ab-aaaa4049ba6f tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Releasing lock "refresh_cache-c0f8682a-6de5-459b-9843-bbe945fb329e" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:03:32 user nova-compute[74190]: DEBUG nova.compute.manager [None req-608304b0-97e0-4323-a4ab-aaaa4049ba6f tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: c0f8682a-6de5-459b-9843-bbe945fb329e] Instance network_info: |[{"id": "bf475d1e-c90f-4ec2-aafc-5f9fdaab831f", "address": "fa:16:3e:a7:7b:dd", "network": {"id": "25e0d6f5-497d-4898-8181-5b4848950f16", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-245925644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df06c4b010434e3da9ba4ea41f26befa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf475d1e-c9", "ovs_interfaceid": "bf475d1e-c90f-4ec2-aafc-5f9fdaab831f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 12:03:32 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-67dcf719-ac91-4c38-bafe-9b9417341af3 req-d648f7f6-fcb0-4bc9-bfaf-e7bb7ce86efc service nova] Acquired lock "refresh_cache-c0f8682a-6de5-459b-9843-bbe945fb329e" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:03:32 user nova-compute[74190]: DEBUG nova.network.neutron [req-67dcf719-ac91-4c38-bafe-9b9417341af3 req-d648f7f6-fcb0-4bc9-bfaf-e7bb7ce86efc service nova] [instance: c0f8682a-6de5-459b-9843-bbe945fb329e] Refreshing network info cache for port bf475d1e-c90f-4ec2-aafc-5f9fdaab831f {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 12:03:32 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-608304b0-97e0-4323-a4ab-aaaa4049ba6f tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: c0f8682a-6de5-459b-9843-bbe945fb329e] Start _get_guest_xml network_info=[{"id": "bf475d1e-c90f-4ec2-aafc-5f9fdaab831f", "address": "fa:16:3e:a7:7b:dd", "network": {"id": "25e0d6f5-497d-4898-8181-5b4848950f16", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-245925644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df06c4b010434e3da9ba4ea41f26befa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf475d1e-c9", "ovs_interfaceid": "bf475d1e-c90f-4ec2-aafc-5f9fdaab831f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'image_id': '6e88bbf0-6e78-49a8-b3c5-9453d22a89df'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 12:03:32 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-608304b0-97e0-4323-a4ab-aaaa4049ba6f tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:03:32 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-608304b0-97e0-4323-a4ab-aaaa4049ba6f tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:03:32 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-608304b0-97e0-4323-a4ab-aaaa4049ba6f tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 12:03:32 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-608304b0-97e0-4323-a4ab-aaaa4049ba6f tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] CPU controller missing on host. {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 12:03:32 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-608304b0-97e0-4323-a4ab-aaaa4049ba6f tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 12:03:32 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-608304b0-97e0-4323-a4ab-aaaa4049ba6f tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] CPU controller found on host. {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 12:03:32 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-608304b0-97e0-4323-a4ab-aaaa4049ba6f tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74190) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 12:03:32 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-608304b0-97e0-4323-a4ab-aaaa4049ba6f tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T11:37:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 12:03:32 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-608304b0-97e0-4323-a4ab-aaaa4049ba6f tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Flavor limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 12:03:32 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-608304b0-97e0-4323-a4ab-aaaa4049ba6f tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Image limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 12:03:32 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-608304b0-97e0-4323-a4ab-aaaa4049ba6f tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Flavor pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 12:03:32 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-608304b0-97e0-4323-a4ab-aaaa4049ba6f tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Image pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 12:03:32 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-608304b0-97e0-4323-a4ab-aaaa4049ba6f tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 12:03:32 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-608304b0-97e0-4323-a4ab-aaaa4049ba6f tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 12:03:32 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-608304b0-97e0-4323-a4ab-aaaa4049ba6f tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 12:03:32 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-608304b0-97e0-4323-a4ab-aaaa4049ba6f tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Got 1 possible topologies {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 12:03:32 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-608304b0-97e0-4323-a4ab-aaaa4049ba6f tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 12:03:32 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-608304b0-97e0-4323-a4ab-aaaa4049ba6f tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 12:03:32 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-608304b0-97e0-4323-a4ab-aaaa4049ba6f tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T12:03:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-405495458',display_name='tempest-AttachVolumeNegativeTest-server-405495458',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-405495458',id=37,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIsvrKNE/qiqg7gBe8ZK6b8uQPD2zFT9/fQGpsXjGoFyAQaFEJ1Th/mPCmO+nHgUyNfEBYsVyOmANawPUtiGXkCQ0CusA+ARK1MqeUDgxKkYYfteWRRcJf0Amv/wcC3jmw==',key_name='tempest-keypair-73457791',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df06c4b010434e3da9ba4ea41f26befa',ramdisk_id='',reservation_id='r-vr4t5ffg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1730208605',owner_user_name='tempest-AttachVolumeNegativeTest-1730208605-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T12:03:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d6bb993153245daabfc59215abbf7a1',uuid=c0f8682a-6de5-459b-9843-bbe945fb329e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf475d1e-c90f-4ec2-aafc-5f9fdaab831f", "address": "fa:16:3e:a7:7b:dd", "network": {"id": "25e0d6f5-497d-4898-8181-5b4848950f16", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-245925644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df06c4b010434e3da9ba4ea41f26befa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf475d1e-c9", "ovs_interfaceid": "bf475d1e-c90f-4ec2-aafc-5f9fdaab831f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74190) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 12:03:32 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-608304b0-97e0-4323-a4ab-aaaa4049ba6f tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Converting VIF {"id": "bf475d1e-c90f-4ec2-aafc-5f9fdaab831f", "address": "fa:16:3e:a7:7b:dd", "network": {"id": "25e0d6f5-497d-4898-8181-5b4848950f16", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-245925644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df06c4b010434e3da9ba4ea41f26befa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf475d1e-c9", "ovs_interfaceid": "bf475d1e-c90f-4ec2-aafc-5f9fdaab831f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 12:03:32 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-608304b0-97e0-4323-a4ab-aaaa4049ba6f tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:7b:dd,bridge_name='br-int',has_traffic_filtering=True,id=bf475d1e-c90f-4ec2-aafc-5f9fdaab831f,network=Network(25e0d6f5-497d-4898-8181-5b4848950f16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf475d1e-c9') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 12:03:32 user nova-compute[74190]: DEBUG nova.objects.instance [None req-608304b0-97e0-4323-a4ab-aaaa4049ba6f tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lazy-loading 'pci_devices' on Instance uuid c0f8682a-6de5-459b-9843-bbe945fb329e {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:03:32 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-608304b0-97e0-4323-a4ab-aaaa4049ba6f tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: c0f8682a-6de5-459b-9843-bbe945fb329e] End _get_guest_xml xml=<domain type="kvm">
Oct 18 12:03:32 user nova-compute[74190]:   <uuid>c0f8682a-6de5-459b-9843-bbe945fb329e</uuid>
Oct 18 12:03:32 user nova-compute[74190]:   <name>instance-00000025</name>
Oct 18 12:03:32 user nova-compute[74190]:   <memory>524288</memory>
Oct 18 12:03:32 user nova-compute[74190]:   <vcpu>1</vcpu>
Oct 18 12:03:32 user nova-compute[74190]:   <metadata>
Oct 18 12:03:32 user nova-compute[74190]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 12:03:32 user nova-compute[74190]:       <nova:package version="0.0.0"/>
Oct 18 12:03:32 user nova-compute[74190]:       <nova:name>tempest-AttachVolumeNegativeTest-server-405495458</nova:name>
Oct 18 12:03:32 user nova-compute[74190]:       <nova:creationTime>2023-10-18 12:03:32</nova:creationTime>
Oct 18 12:03:32 user nova-compute[74190]:       <nova:flavor name="m1.tiny">
Oct 18 12:03:32 user nova-compute[74190]:         <nova:memory>512</nova:memory>
Oct 18 12:03:32 user nova-compute[74190]:         <nova:disk>1</nova:disk>
Oct 18 12:03:32 user nova-compute[74190]:         <nova:swap>0</nova:swap>
Oct 18 12:03:32 user nova-compute[74190]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 12:03:32 user nova-compute[74190]:         <nova:vcpus>1</nova:vcpus>
Oct 18 12:03:32 user nova-compute[74190]:       </nova:flavor>
Oct 18 12:03:32 user nova-compute[74190]:       <nova:owner>
Oct 18 12:03:32 user nova-compute[74190]:         <nova:user uuid="7d6bb993153245daabfc59215abbf7a1">tempest-AttachVolumeNegativeTest-1730208605-project-member</nova:user>
Oct 18 12:03:32 user nova-compute[74190]:         <nova:project uuid="df06c4b010434e3da9ba4ea41f26befa">tempest-AttachVolumeNegativeTest-1730208605</nova:project>
Oct 18 12:03:32 user nova-compute[74190]:       </nova:owner>
Oct 18 12:03:32 user nova-compute[74190]:       <nova:root type="image" uuid="6e88bbf0-6e78-49a8-b3c5-9453d22a89df"/>
Oct 18 12:03:32 user nova-compute[74190]:       <nova:ports>
Oct 18 12:03:32 user nova-compute[74190]:         <nova:port uuid="bf475d1e-c90f-4ec2-aafc-5f9fdaab831f">
Oct 18 12:03:32 user nova-compute[74190]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 18 12:03:32 user nova-compute[74190]:         </nova:port>
Oct 18 12:03:32 user nova-compute[74190]:       </nova:ports>
Oct 18 12:03:32 user nova-compute[74190]:     </nova:instance>
Oct 18 12:03:32 user nova-compute[74190]:   </metadata>
Oct 18 12:03:32 user nova-compute[74190]:   <sysinfo type="smbios">
Oct 18 12:03:32 user nova-compute[74190]:     <system>
Oct 18 12:03:32 user nova-compute[74190]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 12:03:32 user nova-compute[74190]:       <entry name="product">OpenStack Nova</entry>
Oct 18 12:03:32 user nova-compute[74190]:       <entry name="version">0.0.0</entry>
Oct 18 12:03:32 user nova-compute[74190]:       <entry name="serial">c0f8682a-6de5-459b-9843-bbe945fb329e</entry>
Oct 18 12:03:32 user nova-compute[74190]:       <entry name="uuid">c0f8682a-6de5-459b-9843-bbe945fb329e</entry>
Oct 18 12:03:32 user nova-compute[74190]:       <entry name="family">Virtual Machine</entry>
Oct 18 12:03:32 user nova-compute[74190]:     </system>
Oct 18 12:03:32 user nova-compute[74190]:   </sysinfo>
Oct 18 12:03:32 user nova-compute[74190]:   <os>
Oct 18 12:03:32 user nova-compute[74190]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 12:03:32 user nova-compute[74190]:     <boot dev="hd"/>
Oct 18 12:03:32 user nova-compute[74190]:     <smbios mode="sysinfo"/>
Oct 18 12:03:32 user nova-compute[74190]:   </os>
Oct 18 12:03:32 user nova-compute[74190]:   <features>
Oct 18 12:03:32 user nova-compute[74190]:     <acpi/>
Oct 18 12:03:32 user nova-compute[74190]:     <apic/>
Oct 18 12:03:32 user nova-compute[74190]:     <vmcoreinfo/>
Oct 18 12:03:32 user nova-compute[74190]:   </features>
Oct 18 12:03:32 user nova-compute[74190]:   <clock offset="utc">
Oct 18 12:03:32 user nova-compute[74190]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 12:03:32 user nova-compute[74190]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 12:03:32 user nova-compute[74190]:     <timer name="hpet" present="no"/>
Oct 18 12:03:32 user nova-compute[74190]:   </clock>
Oct 18 12:03:32 user nova-compute[74190]:   <cpu mode="custom" match="exact">
Oct 18 12:03:32 user nova-compute[74190]:     <model>Nehalem</model>
Oct 18 12:03:32 user nova-compute[74190]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 12:03:32 user nova-compute[74190]:   </cpu>
Oct 18 12:03:32 user nova-compute[74190]:   <devices>
Oct 18 12:03:32 user nova-compute[74190]:     <disk type="file" device="disk">
Oct 18 12:03:32 user nova-compute[74190]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 12:03:32 user nova-compute[74190]:       <source file="/opt/stack/data/nova/instances/c0f8682a-6de5-459b-9843-bbe945fb329e/disk"/>
Oct 18 12:03:32 user nova-compute[74190]:       <target dev="vda" bus="virtio"/>
Oct 18 12:03:32 user nova-compute[74190]:     </disk>
Oct 18 12:03:32 user nova-compute[74190]:     <interface type="ethernet">
Oct 18 12:03:32 user nova-compute[74190]:       <mac address="fa:16:3e:a7:7b:dd"/>
Oct 18 12:03:32 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 12:03:32 user nova-compute[74190]:       <mtu size="1442"/>
Oct 18 12:03:32 user nova-compute[74190]:       <target dev="tapbf475d1e-c9"/>
Oct 18 12:03:32 user nova-compute[74190]:     </interface>
Oct 18 12:03:32 user nova-compute[74190]:     <serial type="pty">
Oct 18 12:03:32 user nova-compute[74190]:       <log file="/opt/stack/data/nova/instances/c0f8682a-6de5-459b-9843-bbe945fb329e/console.log" append="off"/>
Oct 18 12:03:32 user nova-compute[74190]:     </serial>
Oct 18 12:03:32 user nova-compute[74190]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 12:03:32 user nova-compute[74190]:     <video>
Oct 18 12:03:32 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 12:03:32 user nova-compute[74190]:     </video>
Oct 18 12:03:32 user nova-compute[74190]:     <rng model="virtio">
Oct 18 12:03:32 user nova-compute[74190]:       <backend model="random">/dev/urandom</backend>
Oct 18 12:03:32 user nova-compute[74190]:     </rng>
Oct 18 12:03:32 user nova-compute[74190]:     <controller type="usb" index="0" model="none"/>
Oct 18 12:03:32 user nova-compute[74190]:     <memballoon model="virtio">
Oct 18 12:03:32 user nova-compute[74190]:       <stats period="10"/>
Oct 18 12:03:32 user nova-compute[74190]:     </memballoon>
Oct 18 12:03:32 user nova-compute[74190]:   </devices>
Oct 18 12:03:32 user nova-compute[74190]: </domain>
Oct 18 12:03:32 user nova-compute[74190]:  {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 12:03:32 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-608304b0-97e0-4323-a4ab-aaaa4049ba6f tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T12:03:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-405495458',display_name='tempest-AttachVolumeNegativeTest-server-405495458',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-405495458',id=37,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIsvrKNE/qiqg7gBe8ZK6b8uQPD2zFT9/fQGpsXjGoFyAQaFEJ1Th/mPCmO+nHgUyNfEBYsVyOmANawPUtiGXkCQ0CusA+ARK1MqeUDgxKkYYfteWRRcJf0Amv/wcC3jmw==',key_name='tempest-keypair-73457791',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df06c4b010434e3da9ba4ea41f26befa',ramdisk_id='',reservation_id='r-vr4t5ffg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1730208605',owner_user_name='tempest-AttachVolumeNegativeTest-1730208605-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T12:03:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d6bb993153245daabfc59215abbf7a1',uuid=c0f8682a-6de5-459b-9843-bbe945fb329e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf475d1e-c90f-4ec2-aafc-5f9fdaab831f", "address": "fa:16:3e:a7:7b:dd", "network": {"id": "25e0d6f5-497d-4898-8181-5b4848950f16", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-245925644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df06c4b010434e3da9ba4ea41f26befa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf475d1e-c9", "ovs_interfaceid": "bf475d1e-c90f-4ec2-aafc-5f9fdaab831f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 12:03:32 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-608304b0-97e0-4323-a4ab-aaaa4049ba6f tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Converting VIF {"id": "bf475d1e-c90f-4ec2-aafc-5f9fdaab831f", "address": "fa:16:3e:a7:7b:dd", "network": {"id": "25e0d6f5-497d-4898-8181-5b4848950f16", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-245925644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df06c4b010434e3da9ba4ea41f26befa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf475d1e-c9", "ovs_interfaceid": "bf475d1e-c90f-4ec2-aafc-5f9fdaab831f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 12:03:32 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-608304b0-97e0-4323-a4ab-aaaa4049ba6f tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:7b:dd,bridge_name='br-int',has_traffic_filtering=True,id=bf475d1e-c90f-4ec2-aafc-5f9fdaab831f,network=Network(25e0d6f5-497d-4898-8181-5b4848950f16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf475d1e-c9') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 12:03:32 user nova-compute[74190]: DEBUG os_vif [None req-608304b0-97e0-4323-a4ab-aaaa4049ba6f tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:7b:dd,bridge_name='br-int',has_traffic_filtering=True,id=bf475d1e-c90f-4ec2-aafc-5f9fdaab831f,network=Network(25e0d6f5-497d-4898-8181-5b4848950f16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf475d1e-c9') {{(pid=74190) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 12:03:32 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:03:32 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:03:32 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 12:03:32 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:03:32 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '83a4f5a7-6b33-589f-96e9-e6c5a87a7fee', '_type': 'linux-noop'}}, row=False) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:03:32 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:03:32 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:03:32 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:03:32 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbf475d1e-c9, may_exist=True, interface_attrs={}) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:03:32 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbf475d1e-c9, col_values=(('qos', UUID('0e88c4a1-c720-41f4-bf9c-983f29e8a9fb')),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:03:32 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbf475d1e-c9, col_values=(('external_ids', {'iface-id': 'bf475d1e-c90f-4ec2-aafc-5f9fdaab831f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:7b:dd', 'vm-uuid': 'c0f8682a-6de5-459b-9843-bbe945fb329e'}),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:03:32 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:03:32 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:03:32 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:03:32 user nova-compute[74190]: INFO os_vif [None req-608304b0-97e0-4323-a4ab-aaaa4049ba6f tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:7b:dd,bridge_name='br-int',has_traffic_filtering=True,id=bf475d1e-c90f-4ec2-aafc-5f9fdaab831f,network=Network(25e0d6f5-497d-4898-8181-5b4848950f16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf475d1e-c9')
Oct 18 12:03:32 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-608304b0-97e0-4323-a4ab-aaaa4049ba6f tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] No BDM found with device name vda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 12:03:32 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-608304b0-97e0-4323-a4ab-aaaa4049ba6f tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] No VIF found with MAC fa:16:3e:a7:7b:dd, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 12:03:33 user nova-compute[74190]: DEBUG nova.network.neutron [req-67dcf719-ac91-4c38-bafe-9b9417341af3 req-d648f7f6-fcb0-4bc9-bfaf-e7bb7ce86efc service nova] [instance: c0f8682a-6de5-459b-9843-bbe945fb329e] Updated VIF entry in instance network info cache for port bf475d1e-c90f-4ec2-aafc-5f9fdaab831f. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 12:03:33 user nova-compute[74190]: DEBUG nova.network.neutron [req-67dcf719-ac91-4c38-bafe-9b9417341af3 req-d648f7f6-fcb0-4bc9-bfaf-e7bb7ce86efc service nova] [instance: c0f8682a-6de5-459b-9843-bbe945fb329e] Updating instance_info_cache with network_info: [{"id": "bf475d1e-c90f-4ec2-aafc-5f9fdaab831f", "address": "fa:16:3e:a7:7b:dd", "network": {"id": "25e0d6f5-497d-4898-8181-5b4848950f16", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-245925644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df06c4b010434e3da9ba4ea41f26befa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf475d1e-c9", "ovs_interfaceid": "bf475d1e-c90f-4ec2-aafc-5f9fdaab831f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:03:33 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-67dcf719-ac91-4c38-bafe-9b9417341af3 req-d648f7f6-fcb0-4bc9-bfaf-e7bb7ce86efc service nova] Releasing lock "refresh_cache-c0f8682a-6de5-459b-9843-bbe945fb329e" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:03:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:03:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:03:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:03:34 user nova-compute[74190]: DEBUG nova.compute.manager [req-1017b1fb-c172-4b54-912f-38b4077f63ce req-605ef8dc-ff7f-425b-845c-40c1fbdb2336 service nova] [instance: c0f8682a-6de5-459b-9843-bbe945fb329e] Received event network-vif-plugged-bf475d1e-c90f-4ec2-aafc-5f9fdaab831f {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:03:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-1017b1fb-c172-4b54-912f-38b4077f63ce req-605ef8dc-ff7f-425b-845c-40c1fbdb2336 service nova] Acquiring lock "c0f8682a-6de5-459b-9843-bbe945fb329e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:03:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-1017b1fb-c172-4b54-912f-38b4077f63ce req-605ef8dc-ff7f-425b-845c-40c1fbdb2336 service nova] Lock "c0f8682a-6de5-459b-9843-bbe945fb329e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:03:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-1017b1fb-c172-4b54-912f-38b4077f63ce req-605ef8dc-ff7f-425b-845c-40c1fbdb2336 service nova] Lock "c0f8682a-6de5-459b-9843-bbe945fb329e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:03:34 user nova-compute[74190]: DEBUG nova.compute.manager [req-1017b1fb-c172-4b54-912f-38b4077f63ce req-605ef8dc-ff7f-425b-845c-40c1fbdb2336 service nova] [instance: c0f8682a-6de5-459b-9843-bbe945fb329e] No waiting events found dispatching network-vif-plugged-bf475d1e-c90f-4ec2-aafc-5f9fdaab831f {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:03:34 user nova-compute[74190]: WARNING nova.compute.manager [req-1017b1fb-c172-4b54-912f-38b4077f63ce req-605ef8dc-ff7f-425b-845c-40c1fbdb2336 service nova] [instance: c0f8682a-6de5-459b-9843-bbe945fb329e] Received unexpected event network-vif-plugged-bf475d1e-c90f-4ec2-aafc-5f9fdaab831f for instance with vm_state building and task_state spawning.
Oct 18 12:03:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:03:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:03:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:03:35 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:03:36 user nova-compute[74190]: DEBUG nova.compute.manager [None req-608304b0-97e0-4323-a4ab-aaaa4049ba6f tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: c0f8682a-6de5-459b-9843-bbe945fb329e] Instance event wait completed in 0 seconds for  {{(pid=74190) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 12:03:36 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-608304b0-97e0-4323-a4ab-aaaa4049ba6f tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: c0f8682a-6de5-459b-9843-bbe945fb329e] Guest created on hypervisor {{(pid=74190) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 12:03:36 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: c0f8682a-6de5-459b-9843-bbe945fb329e] Instance spawned successfully.
Oct 18 12:03:36 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-608304b0-97e0-4323-a4ab-aaaa4049ba6f tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: c0f8682a-6de5-459b-9843-bbe945fb329e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 12:03:36 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-608304b0-97e0-4323-a4ab-aaaa4049ba6f tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: c0f8682a-6de5-459b-9843-bbe945fb329e] Found default for hw_cdrom_bus of ide {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:03:36 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-608304b0-97e0-4323-a4ab-aaaa4049ba6f tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: c0f8682a-6de5-459b-9843-bbe945fb329e] Found default for hw_disk_bus of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:03:36 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-608304b0-97e0-4323-a4ab-aaaa4049ba6f tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: c0f8682a-6de5-459b-9843-bbe945fb329e] Found default for hw_input_bus of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:03:36 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-608304b0-97e0-4323-a4ab-aaaa4049ba6f tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: c0f8682a-6de5-459b-9843-bbe945fb329e] Found default for hw_pointer_model of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:03:36 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-608304b0-97e0-4323-a4ab-aaaa4049ba6f tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: c0f8682a-6de5-459b-9843-bbe945fb329e] Found default for hw_video_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:03:36 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-608304b0-97e0-4323-a4ab-aaaa4049ba6f tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: c0f8682a-6de5-459b-9843-bbe945fb329e] Found default for hw_vif_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:03:36 user nova-compute[74190]: INFO nova.compute.manager [None req-608304b0-97e0-4323-a4ab-aaaa4049ba6f tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: c0f8682a-6de5-459b-9843-bbe945fb329e] Took 5.66 seconds to spawn the instance on the hypervisor.
Oct 18 12:03:36 user nova-compute[74190]: DEBUG nova.compute.manager [None req-608304b0-97e0-4323-a4ab-aaaa4049ba6f tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: c0f8682a-6de5-459b-9843-bbe945fb329e] Checking state {{(pid=74190) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 12:03:36 user nova-compute[74190]: DEBUG nova.compute.manager [req-d64acd0e-1f8b-4914-b41c-15fdd4d8f73e req-ab0da1eb-6c67-403e-8ffc-1f3a7d597de6 service nova] [instance: c0f8682a-6de5-459b-9843-bbe945fb329e] Received event network-vif-plugged-bf475d1e-c90f-4ec2-aafc-5f9fdaab831f {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:03:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d64acd0e-1f8b-4914-b41c-15fdd4d8f73e req-ab0da1eb-6c67-403e-8ffc-1f3a7d597de6 service nova] Acquiring lock "c0f8682a-6de5-459b-9843-bbe945fb329e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:03:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d64acd0e-1f8b-4914-b41c-15fdd4d8f73e req-ab0da1eb-6c67-403e-8ffc-1f3a7d597de6 service nova] Lock "c0f8682a-6de5-459b-9843-bbe945fb329e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:03:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d64acd0e-1f8b-4914-b41c-15fdd4d8f73e req-ab0da1eb-6c67-403e-8ffc-1f3a7d597de6 service nova] Lock "c0f8682a-6de5-459b-9843-bbe945fb329e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:03:36 user nova-compute[74190]: DEBUG nova.compute.manager [req-d64acd0e-1f8b-4914-b41c-15fdd4d8f73e req-ab0da1eb-6c67-403e-8ffc-1f3a7d597de6 service nova] [instance: c0f8682a-6de5-459b-9843-bbe945fb329e] No waiting events found dispatching network-vif-plugged-bf475d1e-c90f-4ec2-aafc-5f9fdaab831f {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:03:36 user nova-compute[74190]: WARNING nova.compute.manager [req-d64acd0e-1f8b-4914-b41c-15fdd4d8f73e req-ab0da1eb-6c67-403e-8ffc-1f3a7d597de6 service nova] [instance: c0f8682a-6de5-459b-9843-bbe945fb329e] Received unexpected event network-vif-plugged-bf475d1e-c90f-4ec2-aafc-5f9fdaab831f for instance with vm_state building and task_state spawning.
Oct 18 12:03:36 user nova-compute[74190]: INFO nova.compute.manager [None req-608304b0-97e0-4323-a4ab-aaaa4049ba6f tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: c0f8682a-6de5-459b-9843-bbe945fb329e] Took 6.40 seconds to build instance.
Oct 18 12:03:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-608304b0-97e0-4323-a4ab-aaaa4049ba6f tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "c0f8682a-6de5-459b-9843-bbe945fb329e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.519s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:03:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:03:40 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-345db42e-170b-4bd9-bcba-1dc0dc0e798c tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Acquiring lock "a79ff814-dec6-4022-a7b6-5420861a2164" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:03:40 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-345db42e-170b-4bd9-bcba-1dc0dc0e798c tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Lock "a79ff814-dec6-4022-a7b6-5420861a2164" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:03:40 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-345db42e-170b-4bd9-bcba-1dc0dc0e798c tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Acquiring lock "a79ff814-dec6-4022-a7b6-5420861a2164-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:03:40 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-345db42e-170b-4bd9-bcba-1dc0dc0e798c tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Lock "a79ff814-dec6-4022-a7b6-5420861a2164-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:03:40 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-345db42e-170b-4bd9-bcba-1dc0dc0e798c tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Lock "a79ff814-dec6-4022-a7b6-5420861a2164-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:03:40 user nova-compute[74190]: INFO nova.compute.manager [None req-345db42e-170b-4bd9-bcba-1dc0dc0e798c tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] [instance: a79ff814-dec6-4022-a7b6-5420861a2164] Terminating instance
Oct 18 12:03:40 user nova-compute[74190]: DEBUG nova.compute.manager [None req-345db42e-170b-4bd9-bcba-1dc0dc0e798c tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] [instance: a79ff814-dec6-4022-a7b6-5420861a2164] Start destroying the instance on the hypervisor. {{(pid=74190) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 12:03:40 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:03:40 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:03:40 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:03:40 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:03:40 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:03:40 user nova-compute[74190]: DEBUG nova.compute.manager [req-42b1228d-003d-4631-95de-0e1c3bb8c2ec req-7efc6aa2-44b9-43a0-a7b0-67d24b25f81c service nova] [instance: a79ff814-dec6-4022-a7b6-5420861a2164] Received event network-vif-unplugged-53f42091-aa79-4aaf-8156-ecab4252e286 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:03:40 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-42b1228d-003d-4631-95de-0e1c3bb8c2ec req-7efc6aa2-44b9-43a0-a7b0-67d24b25f81c service nova] Acquiring lock "a79ff814-dec6-4022-a7b6-5420861a2164-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:03:40 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-42b1228d-003d-4631-95de-0e1c3bb8c2ec req-7efc6aa2-44b9-43a0-a7b0-67d24b25f81c service nova] Lock "a79ff814-dec6-4022-a7b6-5420861a2164-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:03:40 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-42b1228d-003d-4631-95de-0e1c3bb8c2ec req-7efc6aa2-44b9-43a0-a7b0-67d24b25f81c service nova] Lock "a79ff814-dec6-4022-a7b6-5420861a2164-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:03:40 user nova-compute[74190]: DEBUG nova.compute.manager [req-42b1228d-003d-4631-95de-0e1c3bb8c2ec req-7efc6aa2-44b9-43a0-a7b0-67d24b25f81c service nova] [instance: a79ff814-dec6-4022-a7b6-5420861a2164] No waiting events found dispatching network-vif-unplugged-53f42091-aa79-4aaf-8156-ecab4252e286 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:03:40 user nova-compute[74190]: DEBUG nova.compute.manager [req-42b1228d-003d-4631-95de-0e1c3bb8c2ec req-7efc6aa2-44b9-43a0-a7b0-67d24b25f81c service nova] [instance: a79ff814-dec6-4022-a7b6-5420861a2164] Received event network-vif-unplugged-53f42091-aa79-4aaf-8156-ecab4252e286 for instance with task_state deleting. {{(pid=74190) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 12:03:40 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: a79ff814-dec6-4022-a7b6-5420861a2164] Instance destroyed successfully.
Oct 18 12:03:40 user nova-compute[74190]: DEBUG nova.objects.instance [None req-345db42e-170b-4bd9-bcba-1dc0dc0e798c tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Lazy-loading 'resources' on Instance uuid a79ff814-dec6-4022-a7b6-5420861a2164 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:03:40 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-345db42e-170b-4bd9-bcba-1dc0dc0e798c tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T12:01:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-307323474',display_name='tempest-VolumesActionsTest-instance-307323474',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-307323474',id=35,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-18T12:01:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='62ed99f026894d569a13d0854fab0a17',ramdisk_id='',reservation_id='r-26bb83et',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-563901414',owner_user_name='tempest-VolumesActionsTest-563901414-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T12:01:55Z,user_data=None,user_id='b0ef25ad27f64ac8a423b867e0f7b836',uuid=a79ff814-dec6-4022-a7b6-5420861a2164,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "53f42091-aa79-4aaf-8156-ecab4252e286", "address": "fa:16:3e:13:78:c3", "network": {"id": "d143b91a-fbcd-40d0-b199-381c523b8a0c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-175467972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62ed99f026894d569a13d0854fab0a17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53f42091-aa", "ovs_interfaceid": "53f42091-aa79-4aaf-8156-ecab4252e286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 12:03:40 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-345db42e-170b-4bd9-bcba-1dc0dc0e798c tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Converting VIF {"id": "53f42091-aa79-4aaf-8156-ecab4252e286", "address": "fa:16:3e:13:78:c3", "network": {"id": "d143b91a-fbcd-40d0-b199-381c523b8a0c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-175467972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62ed99f026894d569a13d0854fab0a17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53f42091-aa", "ovs_interfaceid": "53f42091-aa79-4aaf-8156-ecab4252e286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 12:03:40 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-345db42e-170b-4bd9-bcba-1dc0dc0e798c tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:78:c3,bridge_name='br-int',has_traffic_filtering=True,id=53f42091-aa79-4aaf-8156-ecab4252e286,network=Network(d143b91a-fbcd-40d0-b199-381c523b8a0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53f42091-aa') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 12:03:40 user nova-compute[74190]: DEBUG os_vif [None req-345db42e-170b-4bd9-bcba-1dc0dc0e798c tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:78:c3,bridge_name='br-int',has_traffic_filtering=True,id=53f42091-aa79-4aaf-8156-ecab4252e286,network=Network(d143b91a-fbcd-40d0-b199-381c523b8a0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53f42091-aa') {{(pid=74190) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 12:03:40 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:03:40 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap53f42091-aa, bridge=br-int, if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:03:40 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:03:40 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:03:40 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e22bc24d-bec4-4c3c-a55c-ffbb52e49c61) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:03:40 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:03:40 user nova-compute[74190]: INFO os_vif [None req-345db42e-170b-4bd9-bcba-1dc0dc0e798c tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:78:c3,bridge_name='br-int',has_traffic_filtering=True,id=53f42091-aa79-4aaf-8156-ecab4252e286,network=Network(d143b91a-fbcd-40d0-b199-381c523b8a0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53f42091-aa')
Oct 18 12:03:40 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-345db42e-170b-4bd9-bcba-1dc0dc0e798c tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] [instance: a79ff814-dec6-4022-a7b6-5420861a2164] Deleting instance files /opt/stack/data/nova/instances/a79ff814-dec6-4022-a7b6-5420861a2164_del
Oct 18 12:03:40 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-345db42e-170b-4bd9-bcba-1dc0dc0e798c tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] [instance: a79ff814-dec6-4022-a7b6-5420861a2164] Deletion of /opt/stack/data/nova/instances/a79ff814-dec6-4022-a7b6-5420861a2164_del complete
Oct 18 12:03:40 user nova-compute[74190]: INFO nova.compute.manager [None req-345db42e-170b-4bd9-bcba-1dc0dc0e798c tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] [instance: a79ff814-dec6-4022-a7b6-5420861a2164] Took 0.91 seconds to destroy the instance on the hypervisor.
Oct 18 12:03:40 user nova-compute[74190]: DEBUG oslo.service.loopingcall [None req-345db42e-170b-4bd9-bcba-1dc0dc0e798c tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74190) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 12:03:40 user nova-compute[74190]: DEBUG nova.compute.manager [-] [instance: a79ff814-dec6-4022-a7b6-5420861a2164] Deallocating network for instance {{(pid=74190) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 12:03:40 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: a79ff814-dec6-4022-a7b6-5420861a2164] deallocate_for_instance() {{(pid=74190) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 12:03:41 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: a79ff814-dec6-4022-a7b6-5420861a2164] Updating instance_info_cache with network_info: [] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:03:41 user nova-compute[74190]: INFO nova.compute.manager [-] [instance: a79ff814-dec6-4022-a7b6-5420861a2164] Took 0.53 seconds to deallocate network for instance.
Oct 18 12:03:41 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-345db42e-170b-4bd9-bcba-1dc0dc0e798c tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:03:41 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-345db42e-170b-4bd9-bcba-1dc0dc0e798c tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:03:41 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-345db42e-170b-4bd9-bcba-1dc0dc0e798c tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 12:03:41 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-345db42e-170b-4bd9-bcba-1dc0dc0e798c tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 12:03:41 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-345db42e-170b-4bd9-bcba-1dc0dc0e798c tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.385s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:03:41 user nova-compute[74190]: INFO nova.scheduler.client.report [None req-345db42e-170b-4bd9-bcba-1dc0dc0e798c tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Deleted allocations for instance a79ff814-dec6-4022-a7b6-5420861a2164
Oct 18 12:03:42 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-345db42e-170b-4bd9-bcba-1dc0dc0e798c tempest-VolumesActionsTest-563901414 tempest-VolumesActionsTest-563901414-project-member] Lock "a79ff814-dec6-4022-a7b6-5420861a2164" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.020s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:03:42 user nova-compute[74190]: DEBUG nova.compute.manager [req-6b29a744-ecc9-4db3-9cdb-652eb6e38da6 req-c58fc2d6-54fa-4ebc-9a45-db5441ebd9a5 service nova] [instance: a79ff814-dec6-4022-a7b6-5420861a2164] Received event network-vif-plugged-53f42091-aa79-4aaf-8156-ecab4252e286 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:03:42 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-6b29a744-ecc9-4db3-9cdb-652eb6e38da6 req-c58fc2d6-54fa-4ebc-9a45-db5441ebd9a5 service nova] Acquiring lock "a79ff814-dec6-4022-a7b6-5420861a2164-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:03:42 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-6b29a744-ecc9-4db3-9cdb-652eb6e38da6 req-c58fc2d6-54fa-4ebc-9a45-db5441ebd9a5 service nova] Lock "a79ff814-dec6-4022-a7b6-5420861a2164-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:03:42 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-6b29a744-ecc9-4db3-9cdb-652eb6e38da6 req-c58fc2d6-54fa-4ebc-9a45-db5441ebd9a5 service nova] Lock "a79ff814-dec6-4022-a7b6-5420861a2164-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:03:42 user nova-compute[74190]: DEBUG nova.compute.manager [req-6b29a744-ecc9-4db3-9cdb-652eb6e38da6 req-c58fc2d6-54fa-4ebc-9a45-db5441ebd9a5 service nova] [instance: a79ff814-dec6-4022-a7b6-5420861a2164] No waiting events found dispatching network-vif-plugged-53f42091-aa79-4aaf-8156-ecab4252e286 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:03:42 user nova-compute[74190]: WARNING nova.compute.manager [req-6b29a744-ecc9-4db3-9cdb-652eb6e38da6 req-c58fc2d6-54fa-4ebc-9a45-db5441ebd9a5 service nova] [instance: a79ff814-dec6-4022-a7b6-5420861a2164] Received unexpected event network-vif-plugged-53f42091-aa79-4aaf-8156-ecab4252e286 for instance with vm_state deleted and task_state None.
Oct 18 12:03:42 user nova-compute[74190]: DEBUG nova.compute.manager [req-6b29a744-ecc9-4db3-9cdb-652eb6e38da6 req-c58fc2d6-54fa-4ebc-9a45-db5441ebd9a5 service nova] [instance: a79ff814-dec6-4022-a7b6-5420861a2164] Received event network-vif-deleted-53f42091-aa79-4aaf-8156-ecab4252e286 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:03:43 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ffe5ab78-f32b-4c76-9331-ddfc319c84e9 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] Calling os-brick to attach iSCSI Volume {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 12:03:43 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffe5ab78-f32b-4c76-9331-ddfc319c84e9 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6a5cafb3-2051-4f2b-bfc7-eb4c184d9fd6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GNBSbcgk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 12:03:43 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-ffe5ab78-f32b-4c76-9331-ddfc319c84e9 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 12:03:43 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-ffe5ab78-f32b-4c76-9331-ddfc319c84e9 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 12:03:43 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-ffe5ab78-f32b-4c76-9331-ddfc319c84e9 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.009s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 12:03:43 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-ffe5ab78-f32b-4c76-9331-ddfc319c84e9 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 12:03:43 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-ffe5ab78-f32b-4c76-9331-ddfc319c84e9 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a5cafb3-2051-4f2b-bfc7-eb4c184d9fd6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 12:03:43 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-ffe5ab78-f32b-4c76-9331-ddfc319c84e9 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a5cafb3-2051-4f2b-bfc7-eb4c184d9fd6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 12:03:43 user nova-compute[74190]: INFO os_brick.initiator.connectors.iscsi [None req-ffe5ab78-f32b-4c76-9331-ddfc319c84e9 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 12:03:43 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a5cafb3-2051-4f2b-bfc7-eb4c184d9fd6 -p 172.16.0.220:3260 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:03:43 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a5cafb3-2051-4f2b-bfc7-eb4c184d9fd6 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:03:43 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[c184c8f7-aefb-4f60-a2f8-35e131f19eb4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:03:43 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffe5ab78-f32b-4c76-9331-ddfc319c84e9 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 12:03:43 user nova-compute[74190]:  {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:03:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a5cafb3-2051-4f2b-bfc7-eb4c184d9fd6 -p 172.16.0.220:3260 --interface default --op new {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:03:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a5cafb3-2051-4f2b-bfc7-eb4c184d9fd6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:03:44 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[f61ae3d2-e080-4567-b46e-d2addff5a905]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6a5cafb3-2051-4f2b-bfc7-eb4c184d9fd6] added\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:03:44 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffe5ab78-f32b-4c76-9331-ddfc319c84e9 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6a5cafb3-2051-4f2b-bfc7-eb4c184d9fd6] added
Oct 18 12:03:44 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:03:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a5cafb3-2051-4f2b-bfc7-eb4c184d9fd6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:03:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a5cafb3-2051-4f2b-bfc7-eb4c184d9fd6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:03:44 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9bd5655-5fee-4b8e-b1f2-f3013b10e77b]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:03:44 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffe5ab78-f32b-4c76-9331-ddfc319c84e9 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:03:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a5cafb3-2051-4f2b-bfc7-eb4c184d9fd6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:03:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a5cafb3-2051-4f2b-bfc7-eb4c184d9fd6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:03:44 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[29bc2f0f-ec14-49a4-b0a4-2128b3b165e2]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:03:44 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffe5ab78-f32b-4c76-9331-ddfc319c84e9 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:03:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a5cafb3-2051-4f2b-bfc7-eb4c184d9fd6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GNBSbcgk {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:03:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a5cafb3-2051-4f2b-bfc7-eb4c184d9fd6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GNBSbcgk" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:03:44 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a9d7289-7244-422a-a594-5bcd6db9a4b3]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:03:44 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffe5ab78-f32b-4c76-9331-ddfc319c84e9 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GNBSbcgk'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:03:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a5cafb3-2051-4f2b-bfc7-eb4c184d9fd6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:03:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a5cafb3-2051-4f2b-bfc7-eb4c184d9fd6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:03:44 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad0e81d3-fadd-4543-87bc-0d1075c94dc3]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:03:44 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffe5ab78-f32b-4c76-9331-ddfc319c84e9 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:03:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:03:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:03:44 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0decda6-c6fb-4cd2-9b8a-bba190e18bde]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:03:44 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffe5ab78-f32b-4c76-9331-ddfc319c84e9 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 12:03:44 user nova-compute[74190]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)
Oct 18 12:03:44 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 12:03:44 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffe5ab78-f32b-4c76-9331-ddfc319c84e9 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 12:03:44 user nova-compute[74190]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)
Oct 18 12:03:44 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 12:03:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a5cafb3-2051-4f2b-bfc7-eb4c184d9fd6 -p 172.16.0.220:3260 --login {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:03:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a5cafb3-2051-4f2b-bfc7-eb4c184d9fd6 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:03:44 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d714ed3-6c79-41e1-9327-72299fed6acf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6a5cafb3-2051-4f2b-bfc7-eb4c184d9fd6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6a5cafb3-2051-4f2b-bfc7-eb4c184d9fd6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:03:44 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffe5ab78-f32b-4c76-9331-ddfc319c84e9 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6a5cafb3-2051-4f2b-bfc7-eb4c184d9fd6, portal: 172.16.0.220,3260]
Oct 18 12:03:44 user nova-compute[74190]: Login to [iface: default, target: iqn.2010-10.org.openstack:6a5cafb3-2051-4f2b-bfc7-eb4c184d9fd6, portal: 172.16.0.220,3260] successful.
Oct 18 12:03:44 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:03:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a5cafb3-2051-4f2b-bfc7-eb4c184d9fd6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:03:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a5cafb3-2051-4f2b-bfc7-eb4c184d9fd6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:03:44 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f90933-b988-43e5-b1c5-f377eae210ee]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:03:44 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffe5ab78-f32b-4c76-9331-ddfc319c84e9 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:03:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:03:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:03:44 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7be7009-0fe2-4f0f-9fb2-b4538b132b83]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a5cafb3-2051-4f2b-bfc7-eb4c184d9fd6 (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:03:44 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffe5ab78-f32b-4c76-9331-ddfc319c84e9 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 12:03:44 user nova-compute[74190]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)
Oct 18 12:03:44 user nova-compute[74190]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a5cafb3-2051-4f2b-bfc7-eb4c184d9fd6 (non-flash)
Oct 18 12:03:44 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 12:03:44 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffe5ab78-f32b-4c76-9331-ddfc319c84e9 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 12:03:44 user nova-compute[74190]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)
Oct 18 12:03:44 user nova-compute[74190]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a5cafb3-2051-4f2b-bfc7-eb4c184d9fd6 (non-flash)
Oct 18 12:03:44 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 12:03:44 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-ffe5ab78-f32b-4c76-9331-ddfc319c84e9 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a5cafb3-2051-4f2b-bfc7-eb4c184d9fd6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 12:03:44 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffe5ab78-f32b-4c76-9331-ddfc319c84e9 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Connected to 172.16.0.220:3260 {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 12:03:44 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-ffe5ab78-f32b-4c76-9331-ddfc319c84e9 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] HCTL ('35', '-', '-', 0) found on session 39 with lun 0 {{(pid=74190) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 12:03:44 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-ffe5ab78-f32b-4c76-9331-ddfc319c84e9 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74190) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 12:03:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:03:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:03:44 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a23d1a-1548-4d03-8c0e-24e0302cd10d]: (4, ('- - 0', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:03:44 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-ffe5ab78-f32b-4c76-9331-ddfc319c84e9 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Searching for a device in session 39 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74190) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 12:03:44 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffe5ab78-f32b-4c76-9331-ddfc319c84e9 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:6a5cafb3-2051-4f2b-bfc7-eb4c184d9fd6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GNBSbcgk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 12:03:45 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-ffe5ab78-f32b-4c76-9331-ddfc319c84e9 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 12:03:45 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffe5ab78-f32b-4c76-9331-ddfc319c84e9 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '23266383739313164', 'path': '/dev/sdd'} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 12:03:45 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ffe5ab78-f32b-4c76-9331-ddfc319c84e9 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23266383739313164', 'path': '/dev/sdd'} {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 12:03:45 user nova-compute[74190]: DEBUG nova.objects.instance [None req-ffe5ab78-f32b-4c76-9331-ddfc319c84e9 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Lazy-loading 'flavor' on Instance uuid 2f59adf3-9728-4d5b-87d5-2ad32c99d06e {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:03:45 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-ffe5ab78-f32b-4c76-9331-ddfc319c84e9 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] attach device xml: <disk type="block" device="disk">
Oct 18 12:03:45 user nova-compute[74190]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 12:03:45 user nova-compute[74190]:   <source dev="/dev/sdd"/>
Oct 18 12:03:45 user nova-compute[74190]:   <target dev="vdb" bus="virtio"/>
Oct 18 12:03:45 user nova-compute[74190]:   <serial>6a5cafb3-2051-4f2b-bfc7-eb4c184d9fd6</serial>
Oct 18 12:03:45 user nova-compute[74190]: </disk>
Oct 18 12:03:45 user nova-compute[74190]:  {{(pid=74190) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 18 12:03:45 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-ffe5ab78-f32b-4c76-9331-ddfc319c84e9 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] No BDM found with device name vda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 12:03:45 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-ffe5ab78-f32b-4c76-9331-ddfc319c84e9 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 12:03:45 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-ffe5ab78-f32b-4c76-9331-ddfc319c84e9 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] No VIF found with MAC fa:16:3e:5c:73:bc, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 12:03:45 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:03:45 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-ffe5ab78-f32b-4c76-9331-ddfc319c84e9 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Lock "2f59adf3-9728-4d5b-87d5-2ad32c99d06e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.321s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:03:50 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-bb477c34-ceb6-4cbc-9e6c-1e575faedcea tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] Acquiring lock "14ba5fe8-567e-40c8-9d69-b54af521b2bc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:03:50 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-bb477c34-ceb6-4cbc-9e6c-1e575faedcea tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] Lock "14ba5fe8-567e-40c8-9d69-b54af521b2bc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:03:50 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-bb477c34-ceb6-4cbc-9e6c-1e575faedcea tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] Acquiring lock "14ba5fe8-567e-40c8-9d69-b54af521b2bc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:03:50 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-bb477c34-ceb6-4cbc-9e6c-1e575faedcea tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] Lock "14ba5fe8-567e-40c8-9d69-b54af521b2bc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:03:50 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-bb477c34-ceb6-4cbc-9e6c-1e575faedcea tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] Lock "14ba5fe8-567e-40c8-9d69-b54af521b2bc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:03:50 user nova-compute[74190]: INFO nova.compute.manager [None req-bb477c34-ceb6-4cbc-9e6c-1e575faedcea tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] [instance: 14ba5fe8-567e-40c8-9d69-b54af521b2bc] Terminating instance
Oct 18 12:03:50 user nova-compute[74190]: DEBUG nova.compute.manager [None req-bb477c34-ceb6-4cbc-9e6c-1e575faedcea tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] [instance: 14ba5fe8-567e-40c8-9d69-b54af521b2bc] Start destroying the instance on the hypervisor. {{(pid=74190) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 12:03:50 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:03:50 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:03:50 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:03:50 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:03:50 user nova-compute[74190]: DEBUG nova.compute.manager [req-31ef83ba-ee9a-4015-8a21-3f0ef5909ff3 req-caaa937e-ced0-4c47-99e6-a07378705ea8 service nova] [instance: 14ba5fe8-567e-40c8-9d69-b54af521b2bc] Received event network-vif-unplugged-cb5a7e63-9321-4ca6-b619-61c96cf114dc {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:03:50 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-31ef83ba-ee9a-4015-8a21-3f0ef5909ff3 req-caaa937e-ced0-4c47-99e6-a07378705ea8 service nova] Acquiring lock "14ba5fe8-567e-40c8-9d69-b54af521b2bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:03:50 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-31ef83ba-ee9a-4015-8a21-3f0ef5909ff3 req-caaa937e-ced0-4c47-99e6-a07378705ea8 service nova] Lock "14ba5fe8-567e-40c8-9d69-b54af521b2bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:03:50 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-31ef83ba-ee9a-4015-8a21-3f0ef5909ff3 req-caaa937e-ced0-4c47-99e6-a07378705ea8 service nova] Lock "14ba5fe8-567e-40c8-9d69-b54af521b2bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:03:50 user nova-compute[74190]: DEBUG nova.compute.manager [req-31ef83ba-ee9a-4015-8a21-3f0ef5909ff3 req-caaa937e-ced0-4c47-99e6-a07378705ea8 service nova] [instance: 14ba5fe8-567e-40c8-9d69-b54af521b2bc] No waiting events found dispatching network-vif-unplugged-cb5a7e63-9321-4ca6-b619-61c96cf114dc {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:03:50 user nova-compute[74190]: DEBUG nova.compute.manager [req-31ef83ba-ee9a-4015-8a21-3f0ef5909ff3 req-caaa937e-ced0-4c47-99e6-a07378705ea8 service nova] [instance: 14ba5fe8-567e-40c8-9d69-b54af521b2bc] Received event network-vif-unplugged-cb5a7e63-9321-4ca6-b619-61c96cf114dc for instance with task_state deleting. {{(pid=74190) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 12:03:50 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 14ba5fe8-567e-40c8-9d69-b54af521b2bc] Instance destroyed successfully.
Oct 18 12:03:50 user nova-compute[74190]: DEBUG nova.objects.instance [None req-bb477c34-ceb6-4cbc-9e6c-1e575faedcea tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] Lazy-loading 'resources' on Instance uuid 14ba5fe8-567e-40c8-9d69-b54af521b2bc {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:03:50 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-bb477c34-ceb6-4cbc-9e6c-1e575faedcea tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T12:01:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1176474461',display_name='tempest-VolumesActionsTest-instance-1176474461',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1176474461',id=34,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-18T12:01:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e0bf9fda5ac74ffc8bbdb02d9073bb3b',ramdisk_id='',reservation_id='r-3cliy041',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1589100911',owner_user_name='tempest-VolumesActionsTest-1589100911-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T12:01:51Z,user_data=None,user_id='72efa980b59f48c0943f3de85181ff4f',uuid=14ba5fe8-567e-40c8-9d69-b54af521b2bc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cb5a7e63-9321-4ca6-b619-61c96cf114dc", "address": "fa:16:3e:b1:a3:69", "network": {"id": "5376a65d-deb9-42e1-abe5-29deda5fd3ad", "bridge": "br-int", "label": "tempest-VolumesActionsTest-589402019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0bf9fda5ac74ffc8bbdb02d9073bb3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb5a7e63-93", "ovs_interfaceid": "cb5a7e63-9321-4ca6-b619-61c96cf114dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 12:03:50 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-bb477c34-ceb6-4cbc-9e6c-1e575faedcea tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] Converting VIF {"id": "cb5a7e63-9321-4ca6-b619-61c96cf114dc", "address": "fa:16:3e:b1:a3:69", "network": {"id": "5376a65d-deb9-42e1-abe5-29deda5fd3ad", "bridge": "br-int", "label": "tempest-VolumesActionsTest-589402019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0bf9fda5ac74ffc8bbdb02d9073bb3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb5a7e63-93", "ovs_interfaceid": "cb5a7e63-9321-4ca6-b619-61c96cf114dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 12:03:50 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-bb477c34-ceb6-4cbc-9e6c-1e575faedcea tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:a3:69,bridge_name='br-int',has_traffic_filtering=True,id=cb5a7e63-9321-4ca6-b619-61c96cf114dc,network=Network(5376a65d-deb9-42e1-abe5-29deda5fd3ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb5a7e63-93') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 12:03:50 user nova-compute[74190]: DEBUG os_vif [None req-bb477c34-ceb6-4cbc-9e6c-1e575faedcea tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:a3:69,bridge_name='br-int',has_traffic_filtering=True,id=cb5a7e63-9321-4ca6-b619-61c96cf114dc,network=Network(5376a65d-deb9-42e1-abe5-29deda5fd3ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb5a7e63-93') {{(pid=74190) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 12:03:50 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:03:50 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcb5a7e63-93, bridge=br-int, if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:03:50 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:03:50 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:03:50 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:03:50 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ebde6956-df66-490a-aa54-4a796f217b31) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:03:50 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:03:50 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:03:50 user nova-compute[74190]: INFO os_vif [None req-bb477c34-ceb6-4cbc-9e6c-1e575faedcea tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:a3:69,bridge_name='br-int',has_traffic_filtering=True,id=cb5a7e63-9321-4ca6-b619-61c96cf114dc,network=Network(5376a65d-deb9-42e1-abe5-29deda5fd3ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb5a7e63-93')
Oct 18 12:03:50 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-bb477c34-ceb6-4cbc-9e6c-1e575faedcea tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] [instance: 14ba5fe8-567e-40c8-9d69-b54af521b2bc] Deleting instance files /opt/stack/data/nova/instances/14ba5fe8-567e-40c8-9d69-b54af521b2bc_del
Oct 18 12:03:50 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-bb477c34-ceb6-4cbc-9e6c-1e575faedcea tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] [instance: 14ba5fe8-567e-40c8-9d69-b54af521b2bc] Deletion of /opt/stack/data/nova/instances/14ba5fe8-567e-40c8-9d69-b54af521b2bc_del complete
Oct 18 12:03:50 user nova-compute[74190]: INFO nova.compute.manager [None req-bb477c34-ceb6-4cbc-9e6c-1e575faedcea tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] [instance: 14ba5fe8-567e-40c8-9d69-b54af521b2bc] Took 0.69 seconds to destroy the instance on the hypervisor.
Oct 18 12:03:50 user nova-compute[74190]: DEBUG oslo.service.loopingcall [None req-bb477c34-ceb6-4cbc-9e6c-1e575faedcea tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74190) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 12:03:50 user nova-compute[74190]: DEBUG nova.compute.manager [-] [instance: 14ba5fe8-567e-40c8-9d69-b54af521b2bc] Deallocating network for instance {{(pid=74190) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 12:03:50 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: 14ba5fe8-567e-40c8-9d69-b54af521b2bc] deallocate_for_instance() {{(pid=74190) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 12:03:51 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: 14ba5fe8-567e-40c8-9d69-b54af521b2bc] Updating instance_info_cache with network_info: [] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:03:51 user nova-compute[74190]: INFO nova.compute.manager [-] [instance: 14ba5fe8-567e-40c8-9d69-b54af521b2bc] Took 0.45 seconds to deallocate network for instance.
Oct 18 12:03:51 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-bb477c34-ceb6-4cbc-9e6c-1e575faedcea tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:03:51 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-bb477c34-ceb6-4cbc-9e6c-1e575faedcea tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:03:51 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-bb477c34-ceb6-4cbc-9e6c-1e575faedcea tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 12:03:51 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-bb477c34-ceb6-4cbc-9e6c-1e575faedcea tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 12:03:51 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-bb477c34-ceb6-4cbc-9e6c-1e575faedcea tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.293s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:03:51 user nova-compute[74190]: INFO nova.scheduler.client.report [None req-bb477c34-ceb6-4cbc-9e6c-1e575faedcea tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] Deleted allocations for instance 14ba5fe8-567e-40c8-9d69-b54af521b2bc
Oct 18 12:03:51 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-bb477c34-ceb6-4cbc-9e6c-1e575faedcea tempest-VolumesActionsTest-1589100911 tempest-VolumesActionsTest-1589100911-project-member] Lock "14ba5fe8-567e-40c8-9d69-b54af521b2bc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.622s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:03:52 user nova-compute[74190]: DEBUG nova.compute.manager [req-ab043a1f-e19e-4bff-9195-374eef3a71e2 req-0d1bb59e-f268-4d15-9fb4-f581bfe05ca3 service nova] [instance: 14ba5fe8-567e-40c8-9d69-b54af521b2bc] Received event network-vif-plugged-cb5a7e63-9321-4ca6-b619-61c96cf114dc {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:03:52 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-ab043a1f-e19e-4bff-9195-374eef3a71e2 req-0d1bb59e-f268-4d15-9fb4-f581bfe05ca3 service nova] Acquiring lock "14ba5fe8-567e-40c8-9d69-b54af521b2bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:03:52 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-ab043a1f-e19e-4bff-9195-374eef3a71e2 req-0d1bb59e-f268-4d15-9fb4-f581bfe05ca3 service nova] Lock "14ba5fe8-567e-40c8-9d69-b54af521b2bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:03:52 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-ab043a1f-e19e-4bff-9195-374eef3a71e2 req-0d1bb59e-f268-4d15-9fb4-f581bfe05ca3 service nova] Lock "14ba5fe8-567e-40c8-9d69-b54af521b2bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:03:52 user nova-compute[74190]: DEBUG nova.compute.manager [req-ab043a1f-e19e-4bff-9195-374eef3a71e2 req-0d1bb59e-f268-4d15-9fb4-f581bfe05ca3 service nova] [instance: 14ba5fe8-567e-40c8-9d69-b54af521b2bc] No waiting events found dispatching network-vif-plugged-cb5a7e63-9321-4ca6-b619-61c96cf114dc {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:03:52 user nova-compute[74190]: WARNING nova.compute.manager [req-ab043a1f-e19e-4bff-9195-374eef3a71e2 req-0d1bb59e-f268-4d15-9fb4-f581bfe05ca3 service nova] [instance: 14ba5fe8-567e-40c8-9d69-b54af521b2bc] Received unexpected event network-vif-plugged-cb5a7e63-9321-4ca6-b619-61c96cf114dc for instance with vm_state deleted and task_state None.
Oct 18 12:03:52 user nova-compute[74190]: DEBUG nova.compute.manager [req-ab043a1f-e19e-4bff-9195-374eef3a71e2 req-0d1bb59e-f268-4d15-9fb4-f581bfe05ca3 service nova] [instance: 14ba5fe8-567e-40c8-9d69-b54af521b2bc] Received event network-vif-deleted-cb5a7e63-9321-4ca6-b619-61c96cf114dc {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:03:55 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:03:55 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:04:00 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:04:00 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:04:04 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:04:05 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:04:05 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:04:06 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:04:07 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:04:09 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:04:09 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74190) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 12:04:10 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:04:10 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:04:12 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:04:12 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:04:12 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Starting heal instance info cache {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 12:04:12 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "refresh_cache-95ca0697-22b5-4109-868f-ca5556015a1f" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:04:12 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquired lock "refresh_cache-95ca0697-22b5-4109-868f-ca5556015a1f" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:04:12 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] Forcefully refreshing network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 18 12:04:12 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] Updating instance_info_cache with network_info: [{"id": "58c81983-46ab-4026-b712-775ae319a09f", "address": "fa:16:3e:dd:c9:17", "network": {"id": "130f7948-11e4-49b4-9d4a-dffb2b48bdcd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595419292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ffa18c02b8a4117ab1ccc52aca64f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58c81983-46", "ovs_interfaceid": "58c81983-46ab-4026-b712-775ae319a09f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:04:12 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Releasing lock "refresh_cache-95ca0697-22b5-4109-868f-ca5556015a1f" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:04:12 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] Updated the network info_cache for instance {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 18 12:04:13 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:04:13 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:04:13 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:04:13 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:04:13 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Auditing locally available compute resources for user (node: user) {{(pid=74190) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 12:04:13 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f59adf3-9728-4d5b-87d5-2ad32c99d06e/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:04:13 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f59adf3-9728-4d5b-87d5-2ad32c99d06e/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:04:13 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f59adf3-9728-4d5b-87d5-2ad32c99d06e/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:04:13 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f59adf3-9728-4d5b-87d5-2ad32c99d06e/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:04:13 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 12:04:13 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f79a267-5bc8-4fa0-9e3a-4706fa1da142/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:04:13 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f79a267-5bc8-4fa0-9e3a-4706fa1da142/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:04:13 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f79a267-5bc8-4fa0-9e3a-4706fa1da142/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:04:13 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f79a267-5bc8-4fa0-9e3a-4706fa1da142/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:04:14 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:04:14 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:04:14 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:04:14 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:04:14 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:04:14 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:04:14 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:04:14 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:04:14 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f8682a-6de5-459b-9843-bbe945fb329e/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:04:14 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f8682a-6de5-459b-9843-bbe945fb329e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:04:14 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f8682a-6de5-459b-9843-bbe945fb329e/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:04:15 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f8682a-6de5-459b-9843-bbe945fb329e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:04:15 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:04:15 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:04:15 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:04:15 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:04:15 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 12:04:15 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk.rescue --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:04:15 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:04:15 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk.rescue --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:04:15 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:04:15 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:04:15 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:04:16 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:04:16 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:04:16 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:04:16 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 12:04:16 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:04:16 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:04:16 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Hypervisor/Node resource view: name=user free_ram=8021MB free_disk=25.030139923095703GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74190) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 12:04:16 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:04:16 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:04:16 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 4e916d24-9f9d-4289-87ce-f65d2499fcd9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:04:16 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 95ca0697-22b5-4109-868f-ca5556015a1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:04:16 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 42413a94-9973-4e8d-83b6-207a4e7847c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:04:16 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 772b126c-2148-4ca8-90f2-69d6eb4b7db7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:04:16 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 0382820d-a678-4593-85df-168f42fc4ce4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:04:16 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 2f59adf3-9728-4d5b-87d5-2ad32c99d06e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:04:16 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 7f79a267-5bc8-4fa0-9e3a-4706fa1da142 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:04:16 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance c0f8682a-6de5-459b-9843-bbe945fb329e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:04:16 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 12:04:16 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 12:04:17 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 12:04:17 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 12:04:17 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Compute_service record updated for user:user {{(pid=74190) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 12:04:17 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.442s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:04:17 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-979a6bb1-d894-42e6-a76c-b26a2e5a93ad tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Acquiring lock "2f59adf3-9728-4d5b-87d5-2ad32c99d06e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:04:17 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-979a6bb1-d894-42e6-a76c-b26a2e5a93ad tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Lock "2f59adf3-9728-4d5b-87d5-2ad32c99d06e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:04:17 user nova-compute[74190]: INFO nova.compute.manager [None req-979a6bb1-d894-42e6-a76c-b26a2e5a93ad tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] Detaching volume 6a5cafb3-2051-4f2b-bfc7-eb4c184d9fd6
Oct 18 12:04:17 user nova-compute[74190]: INFO nova.virt.block_device [None req-979a6bb1-d894-42e6-a76c-b26a2e5a93ad tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] Attempting to driver detach volume 6a5cafb3-2051-4f2b-bfc7-eb4c184d9fd6 from mountpoint /dev/vdb
Oct 18 12:04:17 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-979a6bb1-d894-42e6-a76c-b26a2e5a93ad tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Attempting to detach device vdb from instance 2f59adf3-9728-4d5b-87d5-2ad32c99d06e from the persistent domain config. {{(pid=74190) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 18 12:04:17 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-979a6bb1-d894-42e6-a76c-b26a2e5a93ad tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 12:04:17 user nova-compute[74190]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 12:04:17 user nova-compute[74190]:   <source dev="/dev/sdd"/>
Oct 18 12:04:17 user nova-compute[74190]:   <target dev="vdb" bus="virtio"/>
Oct 18 12:04:17 user nova-compute[74190]:   <serial>6a5cafb3-2051-4f2b-bfc7-eb4c184d9fd6</serial>
Oct 18 12:04:17 user nova-compute[74190]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 18 12:04:17 user nova-compute[74190]: </disk>
Oct 18 12:04:17 user nova-compute[74190]:  {{(pid=74190) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 12:04:17 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-979a6bb1-d894-42e6-a76c-b26a2e5a93ad tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Successfully detached device vdb from instance 2f59adf3-9728-4d5b-87d5-2ad32c99d06e from the persistent domain config.
Oct 18 12:04:17 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-979a6bb1-d894-42e6-a76c-b26a2e5a93ad tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2f59adf3-9728-4d5b-87d5-2ad32c99d06e from the live domain config. {{(pid=74190) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 18 12:04:17 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-979a6bb1-d894-42e6-a76c-b26a2e5a93ad tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 12:04:17 user nova-compute[74190]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 12:04:17 user nova-compute[74190]:   <source dev="/dev/sdd"/>
Oct 18 12:04:17 user nova-compute[74190]:   <target dev="vdb" bus="virtio"/>
Oct 18 12:04:17 user nova-compute[74190]:   <serial>6a5cafb3-2051-4f2b-bfc7-eb4c184d9fd6</serial>
Oct 18 12:04:17 user nova-compute[74190]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 18 12:04:17 user nova-compute[74190]: </disk>
Oct 18 12:04:17 user nova-compute[74190]:  {{(pid=74190) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 12:04:18 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:04:18 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:04:18 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-979a6bb1-d894-42e6-a76c-b26a2e5a93ad tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2f59adf3-9728-4d5b-87d5-2ad32c99d06e {{(pid=74190) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 18 12:04:20 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:04:25 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:04:26 user nova-compute[74190]: DEBUG nova.compute.manager [req-ab9171d8-fbe5-4d80-8fa5-e4ced3d01388 req-897e5bfc-8a9f-4afe-bf04-9c351182a47c service nova] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Received event network-changed-85b87aa7-52a9-4487-a954-7e07dcf20500 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:04:26 user nova-compute[74190]: DEBUG nova.compute.manager [req-ab9171d8-fbe5-4d80-8fa5-e4ced3d01388 req-897e5bfc-8a9f-4afe-bf04-9c351182a47c service nova] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Refreshing instance network info cache due to event network-changed-85b87aa7-52a9-4487-a954-7e07dcf20500. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 12:04:26 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-ab9171d8-fbe5-4d80-8fa5-e4ced3d01388 req-897e5bfc-8a9f-4afe-bf04-9c351182a47c service nova] Acquiring lock "refresh_cache-7f79a267-5bc8-4fa0-9e3a-4706fa1da142" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:04:26 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-ab9171d8-fbe5-4d80-8fa5-e4ced3d01388 req-897e5bfc-8a9f-4afe-bf04-9c351182a47c service nova] Acquired lock "refresh_cache-7f79a267-5bc8-4fa0-9e3a-4706fa1da142" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:04:26 user nova-compute[74190]: DEBUG nova.network.neutron [req-ab9171d8-fbe5-4d80-8fa5-e4ced3d01388 req-897e5bfc-8a9f-4afe-bf04-9c351182a47c service nova] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Refreshing network info cache for port 85b87aa7-52a9-4487-a954-7e07dcf20500 {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 12:04:26 user nova-compute[74190]: DEBUG nova.network.neutron [req-ab9171d8-fbe5-4d80-8fa5-e4ced3d01388 req-897e5bfc-8a9f-4afe-bf04-9c351182a47c service nova] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Updated VIF entry in instance network info cache for port 85b87aa7-52a9-4487-a954-7e07dcf20500. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 12:04:26 user nova-compute[74190]: DEBUG nova.network.neutron [req-ab9171d8-fbe5-4d80-8fa5-e4ced3d01388 req-897e5bfc-8a9f-4afe-bf04-9c351182a47c service nova] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Updating instance_info_cache with network_info: [{"id": "85b87aa7-52a9-4487-a954-7e07dcf20500", "address": "fa:16:3e:68:65:7b", "network": {"id": "130f7948-11e4-49b4-9d4a-dffb2b48bdcd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595419292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ffa18c02b8a4117ab1ccc52aca64f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85b87aa7-52", "ovs_interfaceid": "85b87aa7-52a9-4487-a954-7e07dcf20500", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:04:26 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-ab9171d8-fbe5-4d80-8fa5-e4ced3d01388 req-897e5bfc-8a9f-4afe-bf04-9c351182a47c service nova] Releasing lock "refresh_cache-7f79a267-5bc8-4fa0-9e3a-4706fa1da142" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:04:27 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-36b38e95-5fb5-4974-9d66-36f3e1eab685 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Acquiring lock "7f79a267-5bc8-4fa0-9e3a-4706fa1da142" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:04:27 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-36b38e95-5fb5-4974-9d66-36f3e1eab685 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lock "7f79a267-5bc8-4fa0-9e3a-4706fa1da142" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:04:27 user nova-compute[74190]: DEBUG nova.objects.instance [None req-36b38e95-5fb5-4974-9d66-36f3e1eab685 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lazy-loading 'flavor' on Instance uuid 7f79a267-5bc8-4fa0-9e3a-4706fa1da142 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:04:27 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-36b38e95-5fb5-4974-9d66-36f3e1eab685 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lock "7f79a267-5bc8-4fa0-9e3a-4706fa1da142" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:04:27 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-36b38e95-5fb5-4974-9d66-36f3e1eab685 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Acquiring lock "7f79a267-5bc8-4fa0-9e3a-4706fa1da142" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:04:27 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-36b38e95-5fb5-4974-9d66-36f3e1eab685 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lock "7f79a267-5bc8-4fa0-9e3a-4706fa1da142" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:04:27 user nova-compute[74190]: INFO nova.compute.manager [None req-36b38e95-5fb5-4974-9d66-36f3e1eab685 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Attaching volume 26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f to /dev/vdb
Oct 18 12:04:27 user nova-compute[74190]: DEBUG os_brick.utils [None req-36b38e95-5fb5-4974-9d66-36f3e1eab685 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 12:04:27 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:04:27 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:04:27 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e3aa19c-d8d7-430a-a40a-be260afc9d9b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cff158e257e1\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:04:27 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:04:27 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:04:27 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2e54792-8259-4a8f-a118-b754f3dc571a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:04:27 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:04:27 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:04:27 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc5cf70f-9f71-483f-8710-c07492a935dd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:04:27 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[490a2e48-3516-4b14-9395-0d86745f1ec1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:04:27 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-36b38e95-5fb5-4974-9d66-36f3e1eab685 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Running cmd (subprocess): nvme version {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:04:27 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-36b38e95-5fb5-4974-9d66-36f3e1eab685 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] 'nvme version' failed. Not Retrying. {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 12:04:27 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.nvmeof [None req-36b38e95-5fb5-4974-9d66-36f3e1eab685 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] nvme not present on system {{(pid=74190) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 12:04:27 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:04:28 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 12:04:28 user nova-compute[74190]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 12:04:28 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[630eb14b-96b8-493c-9339-140fd0373c42]: (4, '') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:04:28 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-36b38e95-5fb5-4974-9d66-36f3e1eab685 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74190) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 12:04:28 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-36b38e95-5fb5-4974-9d66-36f3e1eab685 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 12:04:28 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-36b38e95-5fb5-4974-9d66-36f3e1eab685 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] LIGHTOS: no hostnqn found. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 12:04:28 user nova-compute[74190]: DEBUG os_brick.utils [None req-36b38e95-5fb5-4974-9d66-36f3e1eab685 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cff158e257e1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 12:04:28 user nova-compute[74190]: DEBUG nova.virt.block_device [None req-36b38e95-5fb5-4974-9d66-36f3e1eab685 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Updating existing volume attachment record: 0a633034-85e1-4a6e-98ba-9ac6142c2bc4 {{(pid=74190) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 12:04:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:04:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:04:35 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:04:35 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:04:38 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-979a6bb1-d894-42e6-a76c-b26a2e5a93ad tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2f59adf3-9728-4d5b-87d5-2ad32c99d06e is timed out.
Oct 18 12:04:38 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-979a6bb1-d894-42e6-a76c-b26a2e5a93ad tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Successfully detached device vdb from instance 2f59adf3-9728-4d5b-87d5-2ad32c99d06e from the live domain config.
Oct 18 12:04:38 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-979a6bb1-d894-42e6-a76c-b26a2e5a93ad tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] calling os-brick to detach iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 12:04:38 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-979a6bb1-d894-42e6-a76c-b26a2e5a93ad tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, {'target_iqn': 'iqn.2010-10.org.openstack:6a5cafb3-2051-4f2b-bfc7-eb4c184d9fd6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GNBSbcgk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 12:04:38 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-979a6bb1-d894-42e6-a76c-b26a2e5a93ad tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 12:04:38 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-979a6bb1-d894-42e6-a76c-b26a2e5a93ad tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 12:04:38 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-979a6bb1-d894-42e6-a76c-b26a2e5a93ad tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 12:04:38 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:04:38 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:04:38 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b15c7f1-aefa-4e14-ab3c-b8a81435119d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a5cafb3-2051-4f2b-bfc7-eb4c184d9fd6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:04:38 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-979a6bb1-d894-42e6-a76c-b26a2e5a93ad tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 12:04:38 user nova-compute[74190]: No targets found.
Oct 18 12:04:38 user nova-compute[74190]: iSNS:
Oct 18 12:04:38 user nova-compute[74190]: No targets found.
Oct 18 12:04:38 user nova-compute[74190]: STATIC:
Oct 18 12:04:38 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa
Oct 18 12:04:38 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 12:04:38 user nova-compute[74190]:                 Iface Name: default
Oct 18 12:04:38 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f
Oct 18 12:04:38 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 12:04:38 user nova-compute[74190]:                 Iface Name: default
Oct 18 12:04:38 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:6a5cafb3-2051-4f2b-bfc7-eb4c184d9fd6
Oct 18 12:04:38 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 12:04:38 user nova-compute[74190]:                 Iface Name: default
Oct 18 12:04:38 user nova-compute[74190]: FIRMWARE:
Oct 18 12:04:38 user nova-compute[74190]: No targets found.
Oct 18 12:04:38 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 12:04:38 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-979a6bb1-d894-42e6-a76c-b26a2e5a93ad tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 12:04:38 user nova-compute[74190]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 12:04:38 user nova-compute[74190]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74190) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 12:04:38 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-979a6bb1-d894-42e6-a76c-b26a2e5a93ad tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a5cafb3-2051-4f2b-bfc7-eb4c184d9fd6', 0)] {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 12:04:38 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:04:38 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:04:38 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[693dfe81-656c-4b3c-9134-189a39be7421]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a5cafb3-2051-4f2b-bfc7-eb4c184d9fd6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:04:38 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:04:38 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:04:38 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[be364220-0ac2-430d-8ec7-637d70c6d8c4]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a5cafb3-2051-4f2b-bfc7-eb4c184d9fd6 (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:04:38 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-979a6bb1-d894-42e6-a76c-b26a2e5a93ad tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 12:04:38 user nova-compute[74190]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)
Oct 18 12:04:38 user nova-compute[74190]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a5cafb3-2051-4f2b-bfc7-eb4c184d9fd6 (non-flash)
Oct 18 12:04:38 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 12:04:38 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-979a6bb1-d894-42e6-a76c-b26a2e5a93ad tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 12:04:38 user nova-compute[74190]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)
Oct 18 12:04:38 user nova-compute[74190]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a5cafb3-2051-4f2b-bfc7-eb4c184d9fd6 (non-flash)
Oct 18 12:04:38 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 12:04:38 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-979a6bb1-d894-42e6-a76c-b26a2e5a93ad tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1f5408db40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a5cafb3-2051-4f2b-bfc7-eb4c184d9fd6'): ({'sdd'}, set())}) {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 12:04:38 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-979a6bb1-d894-42e6-a76c-b26a2e5a93ad tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Removing single pathed devices sdd {{(pid=74190) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 12:04:38 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:04:38 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:04:38 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[15623301-1ae8-4523-ae87-333f19310140]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:04:38 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:04:38 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:04:38 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddaa7e8e-7564-4bfe-ae85-62f074a68e25]: (4, ('ok\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:04:38 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-979a6bb1-d894-42e6-a76c-b26a2e5a93ad tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Flushing IO for device /dev/sdd {{(pid=74190) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 12:04:38 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:04:38 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:04:38 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d3e59b4-630e-435c-8957-ccb08e2090d8]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:04:38 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-979a6bb1-d894-42e6-a76c-b26a2e5a93ad tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74190) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 12:04:38 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:04:38 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.050s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:04:38 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[82cbfec8-b893-4413-973d-d07af29ac5cb]: (4, ('1', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:04:38 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-979a6bb1-d894-42e6-a76c-b26a2e5a93ad tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 12:04:38 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-979a6bb1-d894-42e6-a76c-b26a2e5a93ad tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] SCSI volumes sdd have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 12:04:38 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-979a6bb1-d894-42e6-a76c-b26a2e5a93ad tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a5cafb3-2051-4f2b-bfc7-eb4c184d9fd6')] {{(pid=74190) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 12:04:38 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a5cafb3-2051-4f2b-bfc7-eb4c184d9fd6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:04:38 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a5cafb3-2051-4f2b-bfc7-eb4c184d9fd6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:04:38 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[a576552d-b2ca-40f5-8346-8951a8e9734e]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:04:38 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-979a6bb1-d894-42e6-a76c-b26a2e5a93ad tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:04:38 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a5cafb3-2051-4f2b-bfc7-eb4c184d9fd6 -p 172.16.0.220:3260 --logout {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:04:38 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a5cafb3-2051-4f2b-bfc7-eb4c184d9fd6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:04:38 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[558fb3f5-5a69-4663-a52e-4ffd2b91e07b]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:6a5cafb3-2051-4f2b-bfc7-eb4c184d9fd6, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:6a5cafb3-2051-4f2b-bfc7-eb4c184d9fd6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:04:38 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-979a6bb1-d894-42e6-a76c-b26a2e5a93ad tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:6a5cafb3-2051-4f2b-bfc7-eb4c184d9fd6, portal: 172.16.0.220,3260]
Oct 18 12:04:38 user nova-compute[74190]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:6a5cafb3-2051-4f2b-bfc7-eb4c184d9fd6, portal: 172.16.0.220,3260] successful.
Oct 18 12:04:38 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:04:38 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a5cafb3-2051-4f2b-bfc7-eb4c184d9fd6 -p 172.16.0.220:3260 --op delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:04:38 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a5cafb3-2051-4f2b-bfc7-eb4c184d9fd6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:04:38 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c97a7c9-6021-4264-8a96-18dde4f4fde1]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:04:38 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-979a6bb1-d894-42e6-a76c-b26a2e5a93ad tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:04:38 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-979a6bb1-d894-42e6-a76c-b26a2e5a93ad tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 12:04:38 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-979a6bb1-d894-42e6-a76c-b26a2e5a93ad tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] <== disconnect_volume: return (306ms) None {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 12:04:38 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-979a6bb1-d894-42e6-a76c-b26a2e5a93ad tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] Disconnected iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 12:04:39 user nova-compute[74190]: DEBUG nova.objects.instance [None req-979a6bb1-d894-42e6-a76c-b26a2e5a93ad tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Lazy-loading 'flavor' on Instance uuid 2f59adf3-9728-4d5b-87d5-2ad32c99d06e {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:04:39 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-979a6bb1-d894-42e6-a76c-b26a2e5a93ad tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Lock "2f59adf3-9728-4d5b-87d5-2ad32c99d06e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.801s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:04:40 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:04:42 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-46cfd3aa-347a-43bd-8de9-dfa74d75982a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Acquiring lock "b1e27a16-43e4-4e80-9c0a-5c2dce06daae" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:04:42 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-46cfd3aa-347a-43bd-8de9-dfa74d75982a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lock "b1e27a16-43e4-4e80-9c0a-5c2dce06daae" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:04:42 user nova-compute[74190]: DEBUG nova.compute.manager [None req-46cfd3aa-347a-43bd-8de9-dfa74d75982a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: b1e27a16-43e4-4e80-9c0a-5c2dce06daae] Starting instance... {{(pid=74190) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 12:04:42 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-46cfd3aa-347a-43bd-8de9-dfa74d75982a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:04:42 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-46cfd3aa-347a-43bd-8de9-dfa74d75982a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:04:42 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-46cfd3aa-347a-43bd-8de9-dfa74d75982a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74190) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 12:04:42 user nova-compute[74190]: INFO nova.compute.claims [None req-46cfd3aa-347a-43bd-8de9-dfa74d75982a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: b1e27a16-43e4-4e80-9c0a-5c2dce06daae] Claim successful on node user
Oct 18 12:04:43 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-46cfd3aa-347a-43bd-8de9-dfa74d75982a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 12:04:43 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-46cfd3aa-347a-43bd-8de9-dfa74d75982a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 12:04:43 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-46cfd3aa-347a-43bd-8de9-dfa74d75982a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.467s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:04:43 user nova-compute[74190]: DEBUG nova.compute.manager [None req-46cfd3aa-347a-43bd-8de9-dfa74d75982a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: b1e27a16-43e4-4e80-9c0a-5c2dce06daae] Start building networks asynchronously for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 12:04:43 user nova-compute[74190]: DEBUG nova.compute.manager [None req-46cfd3aa-347a-43bd-8de9-dfa74d75982a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: b1e27a16-43e4-4e80-9c0a-5c2dce06daae] Allocating IP information in the background. {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 12:04:43 user nova-compute[74190]: DEBUG nova.network.neutron [None req-46cfd3aa-347a-43bd-8de9-dfa74d75982a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: b1e27a16-43e4-4e80-9c0a-5c2dce06daae] allocate_for_instance() {{(pid=74190) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 12:04:43 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-46cfd3aa-347a-43bd-8de9-dfa74d75982a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: b1e27a16-43e4-4e80-9c0a-5c2dce06daae] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 12:04:43 user nova-compute[74190]: DEBUG nova.compute.manager [None req-46cfd3aa-347a-43bd-8de9-dfa74d75982a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: b1e27a16-43e4-4e80-9c0a-5c2dce06daae] Start building block device mappings for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 12:04:43 user nova-compute[74190]: DEBUG nova.policy [None req-46cfd3aa-347a-43bd-8de9-dfa74d75982a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7fa675b6803f4e21b090295b51fb9ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d994366010142519ff367fa7ca77e61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74190) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 12:04:43 user nova-compute[74190]: DEBUG nova.compute.manager [None req-46cfd3aa-347a-43bd-8de9-dfa74d75982a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: b1e27a16-43e4-4e80-9c0a-5c2dce06daae] Start spawning the instance on the hypervisor. {{(pid=74190) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 12:04:43 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-46cfd3aa-347a-43bd-8de9-dfa74d75982a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: b1e27a16-43e4-4e80-9c0a-5c2dce06daae] Creating instance directory {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 12:04:43 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-46cfd3aa-347a-43bd-8de9-dfa74d75982a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: b1e27a16-43e4-4e80-9c0a-5c2dce06daae] Creating image(s)
Oct 18 12:04:43 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-46cfd3aa-347a-43bd-8de9-dfa74d75982a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Acquiring lock "/opt/stack/data/nova/instances/b1e27a16-43e4-4e80-9c0a-5c2dce06daae/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:04:43 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-46cfd3aa-347a-43bd-8de9-dfa74d75982a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lock "/opt/stack/data/nova/instances/b1e27a16-43e4-4e80-9c0a-5c2dce06daae/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:04:43 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-46cfd3aa-347a-43bd-8de9-dfa74d75982a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lock "/opt/stack/data/nova/instances/b1e27a16-43e4-4e80-9c0a-5c2dce06daae/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:04:43 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-46cfd3aa-347a-43bd-8de9-dfa74d75982a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:04:43 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-46cfd3aa-347a-43bd-8de9-dfa74d75982a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.184s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:04:43 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-46cfd3aa-347a-43bd-8de9-dfa74d75982a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Acquiring lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:04:43 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-46cfd3aa-347a-43bd-8de9-dfa74d75982a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:04:43 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-46cfd3aa-347a-43bd-8de9-dfa74d75982a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:04:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-46cfd3aa-347a-43bd-8de9-dfa74d75982a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.187s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:04:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-46cfd3aa-347a-43bd-8de9-dfa74d75982a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f,backing_fmt=raw /opt/stack/data/nova/instances/b1e27a16-43e4-4e80-9c0a-5c2dce06daae/disk 1073741824 {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:04:44 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:04:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-46cfd3aa-347a-43bd-8de9-dfa74d75982a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f,backing_fmt=raw /opt/stack/data/nova/instances/b1e27a16-43e4-4e80-9c0a-5c2dce06daae/disk 1073741824" returned: 0 in 0.065s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:04:44 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-46cfd3aa-347a-43bd-8de9-dfa74d75982a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:04:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-46cfd3aa-347a-43bd-8de9-dfa74d75982a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:04:44 user nova-compute[74190]: DEBUG nova.network.neutron [None req-46cfd3aa-347a-43bd-8de9-dfa74d75982a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: b1e27a16-43e4-4e80-9c0a-5c2dce06daae] Successfully created port: 3d3e9708-ec6a-4fd9-853a-2f492a488a32 {{(pid=74190) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 12:04:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-46cfd3aa-347a-43bd-8de9-dfa74d75982a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.221s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:04:44 user nova-compute[74190]: DEBUG nova.virt.disk.api [None req-46cfd3aa-347a-43bd-8de9-dfa74d75982a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b1e27a16-43e4-4e80-9c0a-5c2dce06daae/disk. size=1073741824 {{(pid=74190) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 18 12:04:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-46cfd3aa-347a-43bd-8de9-dfa74d75982a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1e27a16-43e4-4e80-9c0a-5c2dce06daae/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:04:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-46cfd3aa-347a-43bd-8de9-dfa74d75982a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1e27a16-43e4-4e80-9c0a-5c2dce06daae/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:04:44 user nova-compute[74190]: DEBUG nova.virt.disk.api [None req-46cfd3aa-347a-43bd-8de9-dfa74d75982a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Cannot resize image /opt/stack/data/nova/instances/b1e27a16-43e4-4e80-9c0a-5c2dce06daae/disk to a smaller size. {{(pid=74190) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 18 12:04:44 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-46cfd3aa-347a-43bd-8de9-dfa74d75982a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: b1e27a16-43e4-4e80-9c0a-5c2dce06daae] Created local disks {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 12:04:44 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-46cfd3aa-347a-43bd-8de9-dfa74d75982a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: b1e27a16-43e4-4e80-9c0a-5c2dce06daae] Ensure instance console log exists: /opt/stack/data/nova/instances/b1e27a16-43e4-4e80-9c0a-5c2dce06daae/console.log {{(pid=74190) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 12:04:44 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-46cfd3aa-347a-43bd-8de9-dfa74d75982a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:04:44 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-46cfd3aa-347a-43bd-8de9-dfa74d75982a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:04:44 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-46cfd3aa-347a-43bd-8de9-dfa74d75982a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:04:44 user nova-compute[74190]: DEBUG nova.network.neutron [None req-46cfd3aa-347a-43bd-8de9-dfa74d75982a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: b1e27a16-43e4-4e80-9c0a-5c2dce06daae] Successfully updated port: 3d3e9708-ec6a-4fd9-853a-2f492a488a32 {{(pid=74190) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 12:04:44 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-46cfd3aa-347a-43bd-8de9-dfa74d75982a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Acquiring lock "refresh_cache-b1e27a16-43e4-4e80-9c0a-5c2dce06daae" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:04:44 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-46cfd3aa-347a-43bd-8de9-dfa74d75982a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Acquired lock "refresh_cache-b1e27a16-43e4-4e80-9c0a-5c2dce06daae" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:04:44 user nova-compute[74190]: DEBUG nova.network.neutron [None req-46cfd3aa-347a-43bd-8de9-dfa74d75982a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: b1e27a16-43e4-4e80-9c0a-5c2dce06daae] Building network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 12:04:44 user nova-compute[74190]: DEBUG nova.compute.manager [req-1f2fd8c3-15ad-431d-bace-d0b934bb6ac1 req-de105bbf-cac0-4bcd-98e7-742b35928d64 service nova] [instance: b1e27a16-43e4-4e80-9c0a-5c2dce06daae] Received event network-changed-3d3e9708-ec6a-4fd9-853a-2f492a488a32 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:04:44 user nova-compute[74190]: DEBUG nova.compute.manager [req-1f2fd8c3-15ad-431d-bace-d0b934bb6ac1 req-de105bbf-cac0-4bcd-98e7-742b35928d64 service nova] [instance: b1e27a16-43e4-4e80-9c0a-5c2dce06daae] Refreshing instance network info cache due to event network-changed-3d3e9708-ec6a-4fd9-853a-2f492a488a32. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 12:04:44 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-1f2fd8c3-15ad-431d-bace-d0b934bb6ac1 req-de105bbf-cac0-4bcd-98e7-742b35928d64 service nova] Acquiring lock "refresh_cache-b1e27a16-43e4-4e80-9c0a-5c2dce06daae" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:04:44 user nova-compute[74190]: DEBUG nova.network.neutron [None req-46cfd3aa-347a-43bd-8de9-dfa74d75982a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: b1e27a16-43e4-4e80-9c0a-5c2dce06daae] Instance cache missing network info. {{(pid=74190) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG nova.network.neutron [None req-46cfd3aa-347a-43bd-8de9-dfa74d75982a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: b1e27a16-43e4-4e80-9c0a-5c2dce06daae] Updating instance_info_cache with network_info: [{"id": "3d3e9708-ec6a-4fd9-853a-2f492a488a32", "address": "fa:16:3e:3d:c4:83", "network": {"id": "c2dbbd24-f1d2-47a2-835f-0f9b24b585f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-920140900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d994366010142519ff367fa7ca77e61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d3e9708-ec", "ovs_interfaceid": "3d3e9708-ec6a-4fd9-853a-2f492a488a32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-46cfd3aa-347a-43bd-8de9-dfa74d75982a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Releasing lock "refresh_cache-b1e27a16-43e4-4e80-9c0a-5c2dce06daae" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG nova.compute.manager [None req-46cfd3aa-347a-43bd-8de9-dfa74d75982a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: b1e27a16-43e4-4e80-9c0a-5c2dce06daae] Instance network_info: |[{"id": "3d3e9708-ec6a-4fd9-853a-2f492a488a32", "address": "fa:16:3e:3d:c4:83", "network": {"id": "c2dbbd24-f1d2-47a2-835f-0f9b24b585f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-920140900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d994366010142519ff367fa7ca77e61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d3e9708-ec", "ovs_interfaceid": "3d3e9708-ec6a-4fd9-853a-2f492a488a32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-1f2fd8c3-15ad-431d-bace-d0b934bb6ac1 req-de105bbf-cac0-4bcd-98e7-742b35928d64 service nova] Acquired lock "refresh_cache-b1e27a16-43e4-4e80-9c0a-5c2dce06daae" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG nova.network.neutron [req-1f2fd8c3-15ad-431d-bace-d0b934bb6ac1 req-de105bbf-cac0-4bcd-98e7-742b35928d64 service nova] [instance: b1e27a16-43e4-4e80-9c0a-5c2dce06daae] Refreshing network info cache for port 3d3e9708-ec6a-4fd9-853a-2f492a488a32 {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-46cfd3aa-347a-43bd-8de9-dfa74d75982a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: b1e27a16-43e4-4e80-9c0a-5c2dce06daae] Start _get_guest_xml network_info=[{"id": "3d3e9708-ec6a-4fd9-853a-2f492a488a32", "address": "fa:16:3e:3d:c4:83", "network": {"id": "c2dbbd24-f1d2-47a2-835f-0f9b24b585f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-920140900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d994366010142519ff367fa7ca77e61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d3e9708-ec", "ovs_interfaceid": "3d3e9708-ec6a-4fd9-853a-2f492a488a32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'image_id': '6e88bbf0-6e78-49a8-b3c5-9453d22a89df'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 12:04:45 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-46cfd3aa-347a-43bd-8de9-dfa74d75982a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:04:45 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-46cfd3aa-347a-43bd-8de9-dfa74d75982a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:04:45 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-46cfd3aa-347a-43bd-8de9-dfa74d75982a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-46cfd3aa-347a-43bd-8de9-dfa74d75982a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] CPU controller missing on host. {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-46cfd3aa-347a-43bd-8de9-dfa74d75982a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-46cfd3aa-347a-43bd-8de9-dfa74d75982a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] CPU controller found on host. {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-46cfd3aa-347a-43bd-8de9-dfa74d75982a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74190) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-46cfd3aa-347a-43bd-8de9-dfa74d75982a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T11:37:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-46cfd3aa-347a-43bd-8de9-dfa74d75982a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Flavor limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-46cfd3aa-347a-43bd-8de9-dfa74d75982a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Image limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-46cfd3aa-347a-43bd-8de9-dfa74d75982a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Flavor pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-46cfd3aa-347a-43bd-8de9-dfa74d75982a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Image pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-46cfd3aa-347a-43bd-8de9-dfa74d75982a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-46cfd3aa-347a-43bd-8de9-dfa74d75982a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-46cfd3aa-347a-43bd-8de9-dfa74d75982a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-46cfd3aa-347a-43bd-8de9-dfa74d75982a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Got 1 possible topologies {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-46cfd3aa-347a-43bd-8de9-dfa74d75982a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-46cfd3aa-347a-43bd-8de9-dfa74d75982a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-46cfd3aa-347a-43bd-8de9-dfa74d75982a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T12:04:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1068206669',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1068206669',id=38,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d994366010142519ff367fa7ca77e61',ramdisk_id='',reservation_id='r-s7lfky0d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1815510380',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T12:04:44Z,user_data=None,user_id='7fa675b6803f4e21b090295b51fb9ceb',uuid=b1e27a16-43e4-4e80-9c0a-5c2dce06daae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d3e9708-ec6a-4fd9-853a-2f492a488a32", "address": "fa:16:3e:3d:c4:83", "network": {"id": "c2dbbd24-f1d2-47a2-835f-0f9b24b585f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-920140900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d994366010142519ff367fa7ca77e61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d3e9708-ec", "ovs_interfaceid": "3d3e9708-ec6a-4fd9-853a-2f492a488a32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74190) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-46cfd3aa-347a-43bd-8de9-dfa74d75982a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Converting VIF {"id": "3d3e9708-ec6a-4fd9-853a-2f492a488a32", "address": "fa:16:3e:3d:c4:83", "network": {"id": "c2dbbd24-f1d2-47a2-835f-0f9b24b585f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-920140900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d994366010142519ff367fa7ca77e61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d3e9708-ec", "ovs_interfaceid": "3d3e9708-ec6a-4fd9-853a-2f492a488a32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-46cfd3aa-347a-43bd-8de9-dfa74d75982a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:c4:83,bridge_name='br-int',has_traffic_filtering=True,id=3d3e9708-ec6a-4fd9-853a-2f492a488a32,network=Network(c2dbbd24-f1d2-47a2-835f-0f9b24b585f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d3e9708-ec') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG nova.objects.instance [None req-46cfd3aa-347a-43bd-8de9-dfa74d75982a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lazy-loading 'pci_devices' on Instance uuid b1e27a16-43e4-4e80-9c0a-5c2dce06daae {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-46cfd3aa-347a-43bd-8de9-dfa74d75982a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: b1e27a16-43e4-4e80-9c0a-5c2dce06daae] End _get_guest_xml xml=<domain type="kvm">
Oct 18 12:04:45 user nova-compute[74190]:   <uuid>b1e27a16-43e4-4e80-9c0a-5c2dce06daae</uuid>
Oct 18 12:04:45 user nova-compute[74190]:   <name>instance-00000026</name>
Oct 18 12:04:45 user nova-compute[74190]:   <memory>524288</memory>
Oct 18 12:04:45 user nova-compute[74190]:   <vcpu>1</vcpu>
Oct 18 12:04:45 user nova-compute[74190]:   <metadata>
Oct 18 12:04:45 user nova-compute[74190]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 12:04:45 user nova-compute[74190]:       <nova:package version="0.0.0"/>
Oct 18 12:04:45 user nova-compute[74190]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1068206669</nova:name>
Oct 18 12:04:45 user nova-compute[74190]:       <nova:creationTime>2023-10-18 12:04:45</nova:creationTime>
Oct 18 12:04:45 user nova-compute[74190]:       <nova:flavor name="m1.tiny">
Oct 18 12:04:45 user nova-compute[74190]:         <nova:memory>512</nova:memory>
Oct 18 12:04:45 user nova-compute[74190]:         <nova:disk>1</nova:disk>
Oct 18 12:04:45 user nova-compute[74190]:         <nova:swap>0</nova:swap>
Oct 18 12:04:45 user nova-compute[74190]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 12:04:45 user nova-compute[74190]:         <nova:vcpus>1</nova:vcpus>
Oct 18 12:04:45 user nova-compute[74190]:       </nova:flavor>
Oct 18 12:04:45 user nova-compute[74190]:       <nova:owner>
Oct 18 12:04:45 user nova-compute[74190]:         <nova:user uuid="7fa675b6803f4e21b090295b51fb9ceb">tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member</nova:user>
Oct 18 12:04:45 user nova-compute[74190]:         <nova:project uuid="6d994366010142519ff367fa7ca77e61">tempest-ServerBootFromVolumeStableRescueTest-1815510380</nova:project>
Oct 18 12:04:45 user nova-compute[74190]:       </nova:owner>
Oct 18 12:04:45 user nova-compute[74190]:       <nova:root type="image" uuid="6e88bbf0-6e78-49a8-b3c5-9453d22a89df"/>
Oct 18 12:04:45 user nova-compute[74190]:       <nova:ports>
Oct 18 12:04:45 user nova-compute[74190]:         <nova:port uuid="3d3e9708-ec6a-4fd9-853a-2f492a488a32">
Oct 18 12:04:45 user nova-compute[74190]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 18 12:04:45 user nova-compute[74190]:         </nova:port>
Oct 18 12:04:45 user nova-compute[74190]:       </nova:ports>
Oct 18 12:04:45 user nova-compute[74190]:     </nova:instance>
Oct 18 12:04:45 user nova-compute[74190]:   </metadata>
Oct 18 12:04:45 user nova-compute[74190]:   <sysinfo type="smbios">
Oct 18 12:04:45 user nova-compute[74190]:     <system>
Oct 18 12:04:45 user nova-compute[74190]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 12:04:45 user nova-compute[74190]:       <entry name="product">OpenStack Nova</entry>
Oct 18 12:04:45 user nova-compute[74190]:       <entry name="version">0.0.0</entry>
Oct 18 12:04:45 user nova-compute[74190]:       <entry name="serial">b1e27a16-43e4-4e80-9c0a-5c2dce06daae</entry>
Oct 18 12:04:45 user nova-compute[74190]:       <entry name="uuid">b1e27a16-43e4-4e80-9c0a-5c2dce06daae</entry>
Oct 18 12:04:45 user nova-compute[74190]:       <entry name="family">Virtual Machine</entry>
Oct 18 12:04:45 user nova-compute[74190]:     </system>
Oct 18 12:04:45 user nova-compute[74190]:   </sysinfo>
Oct 18 12:04:45 user nova-compute[74190]:   <os>
Oct 18 12:04:45 user nova-compute[74190]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 12:04:45 user nova-compute[74190]:     <boot dev="hd"/>
Oct 18 12:04:45 user nova-compute[74190]:     <smbios mode="sysinfo"/>
Oct 18 12:04:45 user nova-compute[74190]:   </os>
Oct 18 12:04:45 user nova-compute[74190]:   <features>
Oct 18 12:04:45 user nova-compute[74190]:     <acpi/>
Oct 18 12:04:45 user nova-compute[74190]:     <apic/>
Oct 18 12:04:45 user nova-compute[74190]:     <vmcoreinfo/>
Oct 18 12:04:45 user nova-compute[74190]:   </features>
Oct 18 12:04:45 user nova-compute[74190]:   <clock offset="utc">
Oct 18 12:04:45 user nova-compute[74190]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 12:04:45 user nova-compute[74190]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 12:04:45 user nova-compute[74190]:     <timer name="hpet" present="no"/>
Oct 18 12:04:45 user nova-compute[74190]:   </clock>
Oct 18 12:04:45 user nova-compute[74190]:   <cpu mode="custom" match="exact">
Oct 18 12:04:45 user nova-compute[74190]:     <model>Nehalem</model>
Oct 18 12:04:45 user nova-compute[74190]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 12:04:45 user nova-compute[74190]:   </cpu>
Oct 18 12:04:45 user nova-compute[74190]:   <devices>
Oct 18 12:04:45 user nova-compute[74190]:     <disk type="file" device="disk">
Oct 18 12:04:45 user nova-compute[74190]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 12:04:45 user nova-compute[74190]:       <source file="/opt/stack/data/nova/instances/b1e27a16-43e4-4e80-9c0a-5c2dce06daae/disk"/>
Oct 18 12:04:45 user nova-compute[74190]:       <target dev="vda" bus="virtio"/>
Oct 18 12:04:45 user nova-compute[74190]:     </disk>
Oct 18 12:04:45 user nova-compute[74190]:     <interface type="ethernet">
Oct 18 12:04:45 user nova-compute[74190]:       <mac address="fa:16:3e:3d:c4:83"/>
Oct 18 12:04:45 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 12:04:45 user nova-compute[74190]:       <mtu size="1442"/>
Oct 18 12:04:45 user nova-compute[74190]:       <target dev="tap3d3e9708-ec"/>
Oct 18 12:04:45 user nova-compute[74190]:     </interface>
Oct 18 12:04:45 user nova-compute[74190]:     <serial type="pty">
Oct 18 12:04:45 user nova-compute[74190]:       <log file="/opt/stack/data/nova/instances/b1e27a16-43e4-4e80-9c0a-5c2dce06daae/console.log" append="off"/>
Oct 18 12:04:45 user nova-compute[74190]:     </serial>
Oct 18 12:04:45 user nova-compute[74190]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 12:04:45 user nova-compute[74190]:     <video>
Oct 18 12:04:45 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 12:04:45 user nova-compute[74190]:     </video>
Oct 18 12:04:45 user nova-compute[74190]:     <rng model="virtio">
Oct 18 12:04:45 user nova-compute[74190]:       <backend model="random">/dev/urandom</backend>
Oct 18 12:04:45 user nova-compute[74190]:     </rng>
Oct 18 12:04:45 user nova-compute[74190]:     <controller type="usb" index="0" model="none"/>
Oct 18 12:04:45 user nova-compute[74190]:     <memballoon model="virtio">
Oct 18 12:04:45 user nova-compute[74190]:       <stats period="10"/>
Oct 18 12:04:45 user nova-compute[74190]:     </memballoon>
Oct 18 12:04:45 user nova-compute[74190]:   </devices>
Oct 18 12:04:45 user nova-compute[74190]: </domain>
Oct 18 12:04:45 user nova-compute[74190]:  {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-46cfd3aa-347a-43bd-8de9-dfa74d75982a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T12:04:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1068206669',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1068206669',id=38,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d994366010142519ff367fa7ca77e61',ramdisk_id='',reservation_id='r-s7lfky0d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1815510380',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T12:04:44Z,user_data=None,user_id='7fa675b6803f4e21b090295b51fb9ceb',uuid=b1e27a16-43e4-4e80-9c0a-5c2dce06daae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d3e9708-ec6a-4fd9-853a-2f492a488a32", "address": "fa:16:3e:3d:c4:83", "network": {"id": "c2dbbd24-f1d2-47a2-835f-0f9b24b585f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-920140900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d994366010142519ff367fa7ca77e61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d3e9708-ec", "ovs_interfaceid": "3d3e9708-ec6a-4fd9-853a-2f492a488a32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-46cfd3aa-347a-43bd-8de9-dfa74d75982a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Converting VIF {"id": "3d3e9708-ec6a-4fd9-853a-2f492a488a32", "address": "fa:16:3e:3d:c4:83", "network": {"id": "c2dbbd24-f1d2-47a2-835f-0f9b24b585f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-920140900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d994366010142519ff367fa7ca77e61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d3e9708-ec", "ovs_interfaceid": "3d3e9708-ec6a-4fd9-853a-2f492a488a32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-46cfd3aa-347a-43bd-8de9-dfa74d75982a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:c4:83,bridge_name='br-int',has_traffic_filtering=True,id=3d3e9708-ec6a-4fd9-853a-2f492a488a32,network=Network(c2dbbd24-f1d2-47a2-835f-0f9b24b585f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d3e9708-ec') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG os_vif [None req-46cfd3aa-347a-43bd-8de9-dfa74d75982a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:c4:83,bridge_name='br-int',has_traffic_filtering=True,id=3d3e9708-ec6a-4fd9-853a-2f492a488a32,network=Network(c2dbbd24-f1d2-47a2-835f-0f9b24b585f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d3e9708-ec') {{(pid=74190) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b55ac60f-7164-5cba-9da0-f6e1c4e05275', '_type': 'linux-noop'}}, row=False) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3d3e9708-ec, may_exist=True, interface_attrs={}) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3d3e9708-ec, col_values=(('qos', UUID('3a12c730-541a-456e-9090-0cd611985f78')),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3d3e9708-ec, col_values=(('external_ids', {'iface-id': '3d3e9708-ec6a-4fd9-853a-2f492a488a32', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3d:c4:83', 'vm-uuid': 'b1e27a16-43e4-4e80-9c0a-5c2dce06daae'}),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:04:45 user nova-compute[74190]: INFO os_vif [None req-46cfd3aa-347a-43bd-8de9-dfa74d75982a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:c4:83,bridge_name='br-int',has_traffic_filtering=True,id=3d3e9708-ec6a-4fd9-853a-2f492a488a32,network=Network(c2dbbd24-f1d2-47a2-835f-0f9b24b585f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d3e9708-ec')
Oct 18 12:04:45 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36b38e95-5fb5-4974-9d66-36f3e1eab685 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Calling os-brick to attach iSCSI Volume {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-36b38e95-5fb5-4974-9d66-36f3e1eab685 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uxMoXGFf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 12:04:45 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-36b38e95-5fb5-4974-9d66-36f3e1eab685 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 12:04:45 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-36b38e95-5fb5-4974-9d66-36f3e1eab685 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-36b38e95-5fb5-4974-9d66-36f3e1eab685 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 12:04:45 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-36b38e95-5fb5-4974-9d66-36f3e1eab685 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 12:04:45 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-36b38e95-5fb5-4974-9d66-36f3e1eab685 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-36b38e95-5fb5-4974-9d66-36f3e1eab685 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 12:04:45 user nova-compute[74190]: INFO os_brick.initiator.connectors.iscsi [None req-36b38e95-5fb5-4974-9d66-36f3e1eab685 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 12:04:45 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f -p 172.16.0.220:3260 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[afbb3535-4e12-4d6d-92f2-0fa0589d9cd0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-36b38e95-5fb5-4974-9d66-36f3e1eab685 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 12:04:45 user nova-compute[74190]:  {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f -p 172.16.0.220:3260 --interface default --op new {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-46cfd3aa-347a-43bd-8de9-dfa74d75982a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] No BDM found with device name vda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-46cfd3aa-347a-43bd-8de9-dfa74d75982a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] No VIF found with MAC fa:16:3e:3d:c4:83, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b86f1f5-c281-467c-905e-15420a4e2345]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f] added\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-36b38e95-5fb5-4974-9d66-36f3e1eab685 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f] added
Oct 18 12:04:45 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[caaf74f0-9f5e-4703-a8b8-2d55ee08f20b]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-36b38e95-5fb5-4974-9d66-36f3e1eab685 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa52acca-36fb-4254-afa8-96c31b1fcfb1]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-36b38e95-5fb5-4974-9d66-36f3e1eab685 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uxMoXGFf {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uxMoXGFf" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[a562a137-4430-4106-afb4-e647ef80995b]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-36b38e95-5fb5-4974-9d66-36f3e1eab685 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uxMoXGFf'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[44548611-7b04-48d4-8afe-1bc82fc38753]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-36b38e95-5fb5-4974-9d66-36f3e1eab685 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[445f24a4-6032-4efc-8e06-c5ee32b6549f]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-36b38e95-5fb5-4974-9d66-36f3e1eab685 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 12:04:45 user nova-compute[74190]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)
Oct 18 12:04:45 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-36b38e95-5fb5-4974-9d66-36f3e1eab685 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 12:04:45 user nova-compute[74190]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)
Oct 18 12:04:45 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f -p 172.16.0.220:3260 --login {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[09fcb0a1-3243-4d80-8349-d5243e62a67c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-36b38e95-5fb5-4974-9d66-36f3e1eab685 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f, portal: 172.16.0.220,3260]
Oct 18 12:04:45 user nova-compute[74190]: Login to [iface: default, target: iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f, portal: 172.16.0.220,3260] successful.
Oct 18 12:04:45 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[778d5a84-0c51-4e3c-b888-6a6818b6492d]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-36b38e95-5fb5-4974-9d66-36f3e1eab685 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[27dc8e75-5dd4-4808-aa47-3750ac792c50]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-36b38e95-5fb5-4974-9d66-36f3e1eab685 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 12:04:45 user nova-compute[74190]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)
Oct 18 12:04:45 user nova-compute[74190]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f (non-flash)
Oct 18 12:04:45 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-36b38e95-5fb5-4974-9d66-36f3e1eab685 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 12:04:45 user nova-compute[74190]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)
Oct 18 12:04:45 user nova-compute[74190]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f (non-flash)
Oct 18 12:04:45 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-36b38e95-5fb5-4974-9d66-36f3e1eab685 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-36b38e95-5fb5-4974-9d66-36f3e1eab685 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Connected to 172.16.0.220:3260 {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-36b38e95-5fb5-4974-9d66-36f3e1eab685 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] HCTL ('35', '-', '-', 0) found on session 40 with lun 0 {{(pid=74190) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-36b38e95-5fb5-4974-9d66-36f3e1eab685 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74190) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG nova.network.neutron [req-1f2fd8c3-15ad-431d-bace-d0b934bb6ac1 req-de105bbf-cac0-4bcd-98e7-742b35928d64 service nova] [instance: b1e27a16-43e4-4e80-9c0a-5c2dce06daae] Updated VIF entry in instance network info cache for port 3d3e9708-ec6a-4fd9-853a-2f492a488a32. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG nova.network.neutron [req-1f2fd8c3-15ad-431d-bace-d0b934bb6ac1 req-de105bbf-cac0-4bcd-98e7-742b35928d64 service nova] [instance: b1e27a16-43e4-4e80-9c0a-5c2dce06daae] Updating instance_info_cache with network_info: [{"id": "3d3e9708-ec6a-4fd9-853a-2f492a488a32", "address": "fa:16:3e:3d:c4:83", "network": {"id": "c2dbbd24-f1d2-47a2-835f-0f9b24b585f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-920140900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d994366010142519ff367fa7ca77e61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d3e9708-ec", "ovs_interfaceid": "3d3e9708-ec6a-4fd9-853a-2f492a488a32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b4e8c9d-bd2c-44f4-88e0-0d6f5a885116]: (4, ('- - 0', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-36b38e95-5fb5-4974-9d66-36f3e1eab685 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Searching for a device in session 40 and hctl ['35', '*', '*', 0] yield: None {{(pid=74190) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 12:04:45 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-1f2fd8c3-15ad-431d-bace-d0b934bb6ac1 req-de105bbf-cac0-4bcd-98e7-742b35928d64 service nova] Releasing lock "refresh_cache-b1e27a16-43e4-4e80-9c0a-5c2dce06daae" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:04:46 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:04:46 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-36b38e95-5fb5-4974-9d66-36f3e1eab685 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Searching for a device in session 40 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74190) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 12:04:46 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-36b38e95-5fb5-4974-9d66-36f3e1eab685 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uxMoXGFf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 12:04:46 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-36b38e95-5fb5-4974-9d66-36f3e1eab685 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 12:04:46 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-36b38e95-5fb5-4974-9d66-36f3e1eab685 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '23636323038656563', 'path': '/dev/sdd'} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 12:04:46 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36b38e95-5fb5-4974-9d66-36f3e1eab685 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23636323038656563', 'path': '/dev/sdd'} {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 12:04:46 user nova-compute[74190]: DEBUG nova.objects.instance [None req-36b38e95-5fb5-4974-9d66-36f3e1eab685 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lazy-loading 'flavor' on Instance uuid 7f79a267-5bc8-4fa0-9e3a-4706fa1da142 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:04:46 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:04:46 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:04:46 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-36b38e95-5fb5-4974-9d66-36f3e1eab685 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] attach device xml: <disk type="block" device="disk">
Oct 18 12:04:46 user nova-compute[74190]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 12:04:46 user nova-compute[74190]:   <source dev="/dev/sdd"/>
Oct 18 12:04:46 user nova-compute[74190]:   <target dev="vdb" bus="virtio"/>
Oct 18 12:04:46 user nova-compute[74190]:   <serial>26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f</serial>
Oct 18 12:04:46 user nova-compute[74190]: </disk>
Oct 18 12:04:46 user nova-compute[74190]:  {{(pid=74190) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 18 12:04:46 user nova-compute[74190]: DEBUG nova.compute.manager [req-7457d7a6-069c-459e-9c02-cdb1f11f4eba req-f23079a6-fb8b-4818-9280-571146b7db98 service nova] [instance: b1e27a16-43e4-4e80-9c0a-5c2dce06daae] Received event network-vif-plugged-3d3e9708-ec6a-4fd9-853a-2f492a488a32 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:04:46 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-7457d7a6-069c-459e-9c02-cdb1f11f4eba req-f23079a6-fb8b-4818-9280-571146b7db98 service nova] Acquiring lock "b1e27a16-43e4-4e80-9c0a-5c2dce06daae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:04:46 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-7457d7a6-069c-459e-9c02-cdb1f11f4eba req-f23079a6-fb8b-4818-9280-571146b7db98 service nova] Lock "b1e27a16-43e4-4e80-9c0a-5c2dce06daae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:04:46 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-7457d7a6-069c-459e-9c02-cdb1f11f4eba req-f23079a6-fb8b-4818-9280-571146b7db98 service nova] Lock "b1e27a16-43e4-4e80-9c0a-5c2dce06daae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:04:46 user nova-compute[74190]: DEBUG nova.compute.manager [req-7457d7a6-069c-459e-9c02-cdb1f11f4eba req-f23079a6-fb8b-4818-9280-571146b7db98 service nova] [instance: b1e27a16-43e4-4e80-9c0a-5c2dce06daae] No waiting events found dispatching network-vif-plugged-3d3e9708-ec6a-4fd9-853a-2f492a488a32 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:04:46 user nova-compute[74190]: WARNING nova.compute.manager [req-7457d7a6-069c-459e-9c02-cdb1f11f4eba req-f23079a6-fb8b-4818-9280-571146b7db98 service nova] [instance: b1e27a16-43e4-4e80-9c0a-5c2dce06daae] Received unexpected event network-vif-plugged-3d3e9708-ec6a-4fd9-853a-2f492a488a32 for instance with vm_state building and task_state spawning.
Oct 18 12:04:47 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:04:47 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:04:47 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-36b38e95-5fb5-4974-9d66-36f3e1eab685 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] No BDM found with device name vda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 12:04:47 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-36b38e95-5fb5-4974-9d66-36f3e1eab685 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 12:04:47 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-36b38e95-5fb5-4974-9d66-36f3e1eab685 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] No VIF found with MAC fa:16:3e:68:65:7b, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 12:04:47 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-36b38e95-5fb5-4974-9d66-36f3e1eab685 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lock "7f79a267-5bc8-4fa0-9e3a-4706fa1da142" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.770s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:04:48 user nova-compute[74190]: INFO nova.compute.manager [None req-bfdb5a3d-8efd-4ce9-932f-fa2d3f1ab4c3 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Rescuing
Oct 18 12:04:48 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-bfdb5a3d-8efd-4ce9-932f-fa2d3f1ab4c3 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Acquiring lock "refresh_cache-7f79a267-5bc8-4fa0-9e3a-4706fa1da142" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:04:48 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-bfdb5a3d-8efd-4ce9-932f-fa2d3f1ab4c3 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Acquired lock "refresh_cache-7f79a267-5bc8-4fa0-9e3a-4706fa1da142" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:04:48 user nova-compute[74190]: DEBUG nova.network.neutron [None req-bfdb5a3d-8efd-4ce9-932f-fa2d3f1ab4c3 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Building network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 12:04:49 user nova-compute[74190]: DEBUG nova.compute.manager [req-493bd50e-069d-49f7-b132-456407354eb8 req-ab70dc2f-4b0e-46a3-95ad-815cececcadb service nova] [instance: b1e27a16-43e4-4e80-9c0a-5c2dce06daae] Received event network-vif-plugged-3d3e9708-ec6a-4fd9-853a-2f492a488a32 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:04:49 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-493bd50e-069d-49f7-b132-456407354eb8 req-ab70dc2f-4b0e-46a3-95ad-815cececcadb service nova] Acquiring lock "b1e27a16-43e4-4e80-9c0a-5c2dce06daae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:04:49 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-493bd50e-069d-49f7-b132-456407354eb8 req-ab70dc2f-4b0e-46a3-95ad-815cececcadb service nova] Lock "b1e27a16-43e4-4e80-9c0a-5c2dce06daae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:04:49 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-493bd50e-069d-49f7-b132-456407354eb8 req-ab70dc2f-4b0e-46a3-95ad-815cececcadb service nova] Lock "b1e27a16-43e4-4e80-9c0a-5c2dce06daae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:04:49 user nova-compute[74190]: DEBUG nova.compute.manager [req-493bd50e-069d-49f7-b132-456407354eb8 req-ab70dc2f-4b0e-46a3-95ad-815cececcadb service nova] [instance: b1e27a16-43e4-4e80-9c0a-5c2dce06daae] No waiting events found dispatching network-vif-plugged-3d3e9708-ec6a-4fd9-853a-2f492a488a32 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:04:49 user nova-compute[74190]: WARNING nova.compute.manager [req-493bd50e-069d-49f7-b132-456407354eb8 req-ab70dc2f-4b0e-46a3-95ad-815cececcadb service nova] [instance: b1e27a16-43e4-4e80-9c0a-5c2dce06daae] Received unexpected event network-vif-plugged-3d3e9708-ec6a-4fd9-853a-2f492a488a32 for instance with vm_state building and task_state spawning.
Oct 18 12:04:49 user nova-compute[74190]: DEBUG nova.network.neutron [None req-bfdb5a3d-8efd-4ce9-932f-fa2d3f1ab4c3 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Updating instance_info_cache with network_info: [{"id": "85b87aa7-52a9-4487-a954-7e07dcf20500", "address": "fa:16:3e:68:65:7b", "network": {"id": "130f7948-11e4-49b4-9d4a-dffb2b48bdcd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595419292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ffa18c02b8a4117ab1ccc52aca64f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85b87aa7-52", "ovs_interfaceid": "85b87aa7-52a9-4487-a954-7e07dcf20500", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:04:49 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-bfdb5a3d-8efd-4ce9-932f-fa2d3f1ab4c3 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Releasing lock "refresh_cache-7f79a267-5bc8-4fa0-9e3a-4706fa1da142" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:04:49 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:04:49 user nova-compute[74190]: DEBUG nova.compute.manager [None req-46cfd3aa-347a-43bd-8de9-dfa74d75982a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: b1e27a16-43e4-4e80-9c0a-5c2dce06daae] Instance event wait completed in 0 seconds for  {{(pid=74190) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 12:04:49 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-46cfd3aa-347a-43bd-8de9-dfa74d75982a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: b1e27a16-43e4-4e80-9c0a-5c2dce06daae] Guest created on hypervisor {{(pid=74190) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 12:04:49 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:04:49 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: b1e27a16-43e4-4e80-9c0a-5c2dce06daae] Instance spawned successfully.
Oct 18 12:04:49 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-46cfd3aa-347a-43bd-8de9-dfa74d75982a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: b1e27a16-43e4-4e80-9c0a-5c2dce06daae] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 12:04:49 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-46cfd3aa-347a-43bd-8de9-dfa74d75982a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: b1e27a16-43e4-4e80-9c0a-5c2dce06daae] Found default for hw_cdrom_bus of ide {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:04:49 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-46cfd3aa-347a-43bd-8de9-dfa74d75982a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: b1e27a16-43e4-4e80-9c0a-5c2dce06daae] Found default for hw_disk_bus of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:04:49 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-46cfd3aa-347a-43bd-8de9-dfa74d75982a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: b1e27a16-43e4-4e80-9c0a-5c2dce06daae] Found default for hw_input_bus of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:04:49 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-46cfd3aa-347a-43bd-8de9-dfa74d75982a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: b1e27a16-43e4-4e80-9c0a-5c2dce06daae] Found default for hw_pointer_model of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:04:49 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-46cfd3aa-347a-43bd-8de9-dfa74d75982a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: b1e27a16-43e4-4e80-9c0a-5c2dce06daae] Found default for hw_video_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:04:49 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-46cfd3aa-347a-43bd-8de9-dfa74d75982a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: b1e27a16-43e4-4e80-9c0a-5c2dce06daae] Found default for hw_vif_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:04:49 user nova-compute[74190]: INFO nova.compute.manager [None req-46cfd3aa-347a-43bd-8de9-dfa74d75982a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: b1e27a16-43e4-4e80-9c0a-5c2dce06daae] Took 5.74 seconds to spawn the instance on the hypervisor.
Oct 18 12:04:49 user nova-compute[74190]: DEBUG nova.compute.manager [None req-46cfd3aa-347a-43bd-8de9-dfa74d75982a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: b1e27a16-43e4-4e80-9c0a-5c2dce06daae] Checking state {{(pid=74190) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 12:04:49 user nova-compute[74190]: DEBUG nova.compute.manager [req-1b9d2ad5-1c2e-429d-9f54-d56c6ee3f2e6 req-0fba0115-77ad-491a-8402-de51bb88ef01 service nova] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Received event network-vif-unplugged-85b87aa7-52a9-4487-a954-7e07dcf20500 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:04:49 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-1b9d2ad5-1c2e-429d-9f54-d56c6ee3f2e6 req-0fba0115-77ad-491a-8402-de51bb88ef01 service nova] Acquiring lock "7f79a267-5bc8-4fa0-9e3a-4706fa1da142-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:04:49 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-1b9d2ad5-1c2e-429d-9f54-d56c6ee3f2e6 req-0fba0115-77ad-491a-8402-de51bb88ef01 service nova] Lock "7f79a267-5bc8-4fa0-9e3a-4706fa1da142-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:04:49 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-1b9d2ad5-1c2e-429d-9f54-d56c6ee3f2e6 req-0fba0115-77ad-491a-8402-de51bb88ef01 service nova] Lock "7f79a267-5bc8-4fa0-9e3a-4706fa1da142-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:04:49 user nova-compute[74190]: DEBUG nova.compute.manager [req-1b9d2ad5-1c2e-429d-9f54-d56c6ee3f2e6 req-0fba0115-77ad-491a-8402-de51bb88ef01 service nova] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] No waiting events found dispatching network-vif-unplugged-85b87aa7-52a9-4487-a954-7e07dcf20500 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:04:49 user nova-compute[74190]: WARNING nova.compute.manager [req-1b9d2ad5-1c2e-429d-9f54-d56c6ee3f2e6 req-0fba0115-77ad-491a-8402-de51bb88ef01 service nova] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Received unexpected event network-vif-unplugged-85b87aa7-52a9-4487-a954-7e07dcf20500 for instance with vm_state active and task_state rescuing.
Oct 18 12:04:49 user nova-compute[74190]: INFO nova.compute.manager [None req-46cfd3aa-347a-43bd-8de9-dfa74d75982a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: b1e27a16-43e4-4e80-9c0a-5c2dce06daae] Took 6.69 seconds to build instance.
Oct 18 12:04:49 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-46cfd3aa-347a-43bd-8de9-dfa74d75982a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lock "b1e27a16-43e4-4e80-9c0a-5c2dce06daae" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.788s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:04:49 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:04:49 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:04:49 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Instance destroyed successfully.
Oct 18 12:04:49 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-bfdb5a3d-8efd-4ce9-932f-fa2d3f1ab4c3 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Attempting rescue
Oct 18 12:04:49 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-bfdb5a3d-8efd-4ce9-932f-fa2d3f1ab4c3 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74190) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 18 12:04:49 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-bfdb5a3d-8efd-4ce9-932f-fa2d3f1ab4c3 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Instance directory exists: not creating {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 18 12:04:49 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-bfdb5a3d-8efd-4ce9-932f-fa2d3f1ab4c3 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Creating image(s)
Oct 18 12:04:49 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-bfdb5a3d-8efd-4ce9-932f-fa2d3f1ab4c3 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Acquiring lock "/opt/stack/data/nova/instances/7f79a267-5bc8-4fa0-9e3a-4706fa1da142/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:04:49 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-bfdb5a3d-8efd-4ce9-932f-fa2d3f1ab4c3 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lock "/opt/stack/data/nova/instances/7f79a267-5bc8-4fa0-9e3a-4706fa1da142/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:04:49 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-bfdb5a3d-8efd-4ce9-932f-fa2d3f1ab4c3 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lock "/opt/stack/data/nova/instances/7f79a267-5bc8-4fa0-9e3a-4706fa1da142/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:04:49 user nova-compute[74190]: DEBUG nova.objects.instance [None req-bfdb5a3d-8efd-4ce9-932f-fa2d3f1ab4c3 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7f79a267-5bc8-4fa0-9e3a-4706fa1da142 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:04:50 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-bfdb5a3d-8efd-4ce9-932f-fa2d3f1ab4c3 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Acquiring lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:04:50 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-bfdb5a3d-8efd-4ce9-932f-fa2d3f1ab4c3 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:04:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-bfdb5a3d-8efd-4ce9-932f-fa2d3f1ab4c3 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:04:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-bfdb5a3d-8efd-4ce9-932f-fa2d3f1ab4c3 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.192s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:04:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-bfdb5a3d-8efd-4ce9-932f-fa2d3f1ab4c3 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f,backing_fmt=raw /opt/stack/data/nova/instances/7f79a267-5bc8-4fa0-9e3a-4706fa1da142/disk.rescue {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:04:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-bfdb5a3d-8efd-4ce9-932f-fa2d3f1ab4c3 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f,backing_fmt=raw /opt/stack/data/nova/instances/7f79a267-5bc8-4fa0-9e3a-4706fa1da142/disk.rescue" returned: 0 in 0.049s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:04:50 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-bfdb5a3d-8efd-4ce9-932f-fa2d3f1ab4c3 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:04:50 user nova-compute[74190]: DEBUG nova.objects.instance [None req-bfdb5a3d-8efd-4ce9-932f-fa2d3f1ab4c3 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lazy-loading 'migration_context' on Instance uuid 7f79a267-5bc8-4fa0-9e3a-4706fa1da142 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:04:50 user nova-compute[74190]: DEBUG nova.objects.base [None req-bfdb5a3d-8efd-4ce9-932f-fa2d3f1ab4c3 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Object Instance<7f79a267-5bc8-4fa0-9e3a-4706fa1da142> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74190) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 12:04:50 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-bfdb5a3d-8efd-4ce9-932f-fa2d3f1ab4c3 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Created local disks {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 12:04:50 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-bfdb5a3d-8efd-4ce9-932f-fa2d3f1ab4c3 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Start _get_guest_xml network_info=[{"id": "85b87aa7-52a9-4487-a954-7e07dcf20500", "address": "fa:16:3e:68:65:7b", "network": {"id": "130f7948-11e4-49b4-9d4a-dffb2b48bdcd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595419292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-595419292-network", "vif_mac": "fa:16:3e:68:65:7b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ffa18c02b8a4117ab1ccc52aca64f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85b87aa7-52", "ovs_interfaceid": "85b87aa7-52a9-4487-a954-7e07dcf20500", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '6e88bbf0-6e78-49a8-b3c5-9453d22a89df', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 12:04:50 user nova-compute[74190]: DEBUG nova.objects.instance [None req-bfdb5a3d-8efd-4ce9-932f-fa2d3f1ab4c3 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lazy-loading 'resources' on Instance uuid 7f79a267-5bc8-4fa0-9e3a-4706fa1da142 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:04:50 user nova-compute[74190]: DEBUG nova.objects.base [None req-bfdb5a3d-8efd-4ce9-932f-fa2d3f1ab4c3 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Object Instance<7f79a267-5bc8-4fa0-9e3a-4706fa1da142> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74190) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 12:04:50 user nova-compute[74190]: DEBUG nova.objects.instance [None req-bfdb5a3d-8efd-4ce9-932f-fa2d3f1ab4c3 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lazy-loading 'numa_topology' on Instance uuid 7f79a267-5bc8-4fa0-9e3a-4706fa1da142 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:04:50 user nova-compute[74190]: DEBUG nova.objects.base [None req-bfdb5a3d-8efd-4ce9-932f-fa2d3f1ab4c3 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Object Instance<7f79a267-5bc8-4fa0-9e3a-4706fa1da142> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74190) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 12:04:50 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-bfdb5a3d-8efd-4ce9-932f-fa2d3f1ab4c3 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:04:50 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-bfdb5a3d-8efd-4ce9-932f-fa2d3f1ab4c3 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:04:50 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-bfdb5a3d-8efd-4ce9-932f-fa2d3f1ab4c3 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 12:04:50 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-bfdb5a3d-8efd-4ce9-932f-fa2d3f1ab4c3 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] CPU controller missing on host. {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 12:04:50 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-bfdb5a3d-8efd-4ce9-932f-fa2d3f1ab4c3 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 12:04:50 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-bfdb5a3d-8efd-4ce9-932f-fa2d3f1ab4c3 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] CPU controller found on host. {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 12:04:50 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-bfdb5a3d-8efd-4ce9-932f-fa2d3f1ab4c3 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74190) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 12:04:50 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-bfdb5a3d-8efd-4ce9-932f-fa2d3f1ab4c3 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T11:37:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 12:04:50 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-bfdb5a3d-8efd-4ce9-932f-fa2d3f1ab4c3 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Flavor limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 12:04:50 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-bfdb5a3d-8efd-4ce9-932f-fa2d3f1ab4c3 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Image limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 12:04:50 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-bfdb5a3d-8efd-4ce9-932f-fa2d3f1ab4c3 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Flavor pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 12:04:50 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-bfdb5a3d-8efd-4ce9-932f-fa2d3f1ab4c3 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Image pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 12:04:50 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-bfdb5a3d-8efd-4ce9-932f-fa2d3f1ab4c3 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 12:04:50 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-bfdb5a3d-8efd-4ce9-932f-fa2d3f1ab4c3 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 12:04:50 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-bfdb5a3d-8efd-4ce9-932f-fa2d3f1ab4c3 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 12:04:50 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-bfdb5a3d-8efd-4ce9-932f-fa2d3f1ab4c3 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Got 1 possible topologies {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 12:04:50 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-bfdb5a3d-8efd-4ce9-932f-fa2d3f1ab4c3 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 12:04:50 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-bfdb5a3d-8efd-4ce9-932f-fa2d3f1ab4c3 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 12:04:50 user nova-compute[74190]: DEBUG nova.objects.instance [None req-bfdb5a3d-8efd-4ce9-932f-fa2d3f1ab4c3 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7f79a267-5bc8-4fa0-9e3a-4706fa1da142 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:04:50 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:04:50 user nova-compute[74190]: DEBUG nova.objects.base [None req-bfdb5a3d-8efd-4ce9-932f-fa2d3f1ab4c3 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Object Instance<7f79a267-5bc8-4fa0-9e3a-4706fa1da142> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74190) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 12:04:50 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-bfdb5a3d-8efd-4ce9-932f-fa2d3f1ab4c3 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T12:02:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1792483886',display_name='tempest-ServerRescueNegativeTestJSON-server-1792483886',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1792483886',id=36,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkIQ8d3leZjsvwziIWZ+8LvZaK+fQGEHmIEFhtuiFYjCN5LSlir32U0rEoPzQvvKfWbmmXf87lyxNJGp1oDmc+aRdOnCgCKp/U0aihiZb7ZCRL045Ck061Eajb0ZA9iDQ==',key_name='tempest-keypair-132610173',keypairs=<?>,launch_index=0,launched_at=2023-10-18T12:02:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1ffa18c02b8a4117ab1ccc52aca64f06',ramdisk_id='',reservation_id='r-mifp9rvd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1266902394',owner_user_name='tempest-ServerRescueNegativeTestJSON-1266902394-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T12:02:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9db2d65206e24d0aa1428b9bcaa0a86e',uuid=7f79a267-5bc8-4fa0-9e3a-4706fa1da142,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "85b87aa7-52a9-4487-a954-7e07dcf20500", "address": "fa:16:3e:68:65:7b", "network": {"id": "130f7948-11e4-49b4-9d4a-dffb2b48bdcd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595419292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-595419292-network", "vif_mac": "fa:16:3e:68:65:7b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ffa18c02b8a4117ab1ccc52aca64f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85b87aa7-52", "ovs_interfaceid": "85b87aa7-52a9-4487-a954-7e07dcf20500", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74190) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 12:04:50 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-bfdb5a3d-8efd-4ce9-932f-fa2d3f1ab4c3 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Converting VIF {"id": "85b87aa7-52a9-4487-a954-7e07dcf20500", "address": "fa:16:3e:68:65:7b", "network": {"id": "130f7948-11e4-49b4-9d4a-dffb2b48bdcd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595419292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-595419292-network", "vif_mac": "fa:16:3e:68:65:7b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ffa18c02b8a4117ab1ccc52aca64f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85b87aa7-52", "ovs_interfaceid": "85b87aa7-52a9-4487-a954-7e07dcf20500", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 12:04:50 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-bfdb5a3d-8efd-4ce9-932f-fa2d3f1ab4c3 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:68:65:7b,bridge_name='br-int',has_traffic_filtering=True,id=85b87aa7-52a9-4487-a954-7e07dcf20500,network=Network(130f7948-11e4-49b4-9d4a-dffb2b48bdcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85b87aa7-52') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 12:04:50 user nova-compute[74190]: DEBUG nova.objects.instance [None req-bfdb5a3d-8efd-4ce9-932f-fa2d3f1ab4c3 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lazy-loading 'pci_devices' on Instance uuid 7f79a267-5bc8-4fa0-9e3a-4706fa1da142 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:04:50 user nova-compute[74190]: DEBUG nova.objects.base [None req-bfdb5a3d-8efd-4ce9-932f-fa2d3f1ab4c3 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Object Instance<7f79a267-5bc8-4fa0-9e3a-4706fa1da142> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74190) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 12:04:50 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-bfdb5a3d-8efd-4ce9-932f-fa2d3f1ab4c3 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] End _get_guest_xml xml=<domain type="kvm">
Oct 18 12:04:50 user nova-compute[74190]:   <uuid>7f79a267-5bc8-4fa0-9e3a-4706fa1da142</uuid>
Oct 18 12:04:50 user nova-compute[74190]:   <name>instance-00000024</name>
Oct 18 12:04:50 user nova-compute[74190]:   <memory>524288</memory>
Oct 18 12:04:50 user nova-compute[74190]:   <vcpu>1</vcpu>
Oct 18 12:04:50 user nova-compute[74190]:   <metadata>
Oct 18 12:04:50 user nova-compute[74190]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 12:04:50 user nova-compute[74190]:       <nova:package version="0.0.0"/>
Oct 18 12:04:50 user nova-compute[74190]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1792483886</nova:name>
Oct 18 12:04:50 user nova-compute[74190]:       <nova:creationTime>2023-10-18 12:04:50</nova:creationTime>
Oct 18 12:04:50 user nova-compute[74190]:       <nova:flavor name="m1.tiny">
Oct 18 12:04:50 user nova-compute[74190]:         <nova:memory>512</nova:memory>
Oct 18 12:04:50 user nova-compute[74190]:         <nova:disk>1</nova:disk>
Oct 18 12:04:50 user nova-compute[74190]:         <nova:swap>0</nova:swap>
Oct 18 12:04:50 user nova-compute[74190]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 12:04:50 user nova-compute[74190]:         <nova:vcpus>1</nova:vcpus>
Oct 18 12:04:50 user nova-compute[74190]:       </nova:flavor>
Oct 18 12:04:50 user nova-compute[74190]:       <nova:owner>
Oct 18 12:04:50 user nova-compute[74190]:         <nova:user uuid="9db2d65206e24d0aa1428b9bcaa0a86e">tempest-ServerRescueNegativeTestJSON-1266902394-project-member</nova:user>
Oct 18 12:04:50 user nova-compute[74190]:         <nova:project uuid="1ffa18c02b8a4117ab1ccc52aca64f06">tempest-ServerRescueNegativeTestJSON-1266902394</nova:project>
Oct 18 12:04:50 user nova-compute[74190]:       </nova:owner>
Oct 18 12:04:50 user nova-compute[74190]:       <nova:root type="image" uuid="6e88bbf0-6e78-49a8-b3c5-9453d22a89df"/>
Oct 18 12:04:50 user nova-compute[74190]:       <nova:ports>
Oct 18 12:04:50 user nova-compute[74190]:         <nova:port uuid="85b87aa7-52a9-4487-a954-7e07dcf20500">
Oct 18 12:04:50 user nova-compute[74190]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 18 12:04:50 user nova-compute[74190]:         </nova:port>
Oct 18 12:04:50 user nova-compute[74190]:       </nova:ports>
Oct 18 12:04:50 user nova-compute[74190]:     </nova:instance>
Oct 18 12:04:50 user nova-compute[74190]:   </metadata>
Oct 18 12:04:50 user nova-compute[74190]:   <sysinfo type="smbios">
Oct 18 12:04:50 user nova-compute[74190]:     <system>
Oct 18 12:04:50 user nova-compute[74190]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 12:04:50 user nova-compute[74190]:       <entry name="product">OpenStack Nova</entry>
Oct 18 12:04:50 user nova-compute[74190]:       <entry name="version">0.0.0</entry>
Oct 18 12:04:50 user nova-compute[74190]:       <entry name="serial">7f79a267-5bc8-4fa0-9e3a-4706fa1da142</entry>
Oct 18 12:04:50 user nova-compute[74190]:       <entry name="uuid">7f79a267-5bc8-4fa0-9e3a-4706fa1da142</entry>
Oct 18 12:04:50 user nova-compute[74190]:       <entry name="family">Virtual Machine</entry>
Oct 18 12:04:50 user nova-compute[74190]:     </system>
Oct 18 12:04:50 user nova-compute[74190]:   </sysinfo>
Oct 18 12:04:50 user nova-compute[74190]:   <os>
Oct 18 12:04:50 user nova-compute[74190]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 12:04:50 user nova-compute[74190]:     <smbios mode="sysinfo"/>
Oct 18 12:04:50 user nova-compute[74190]:   </os>
Oct 18 12:04:50 user nova-compute[74190]:   <features>
Oct 18 12:04:50 user nova-compute[74190]:     <acpi/>
Oct 18 12:04:50 user nova-compute[74190]:     <apic/>
Oct 18 12:04:50 user nova-compute[74190]:     <vmcoreinfo/>
Oct 18 12:04:50 user nova-compute[74190]:   </features>
Oct 18 12:04:50 user nova-compute[74190]:   <clock offset="utc">
Oct 18 12:04:50 user nova-compute[74190]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 12:04:50 user nova-compute[74190]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 12:04:50 user nova-compute[74190]:     <timer name="hpet" present="no"/>
Oct 18 12:04:50 user nova-compute[74190]:   </clock>
Oct 18 12:04:50 user nova-compute[74190]:   <cpu mode="custom" match="exact">
Oct 18 12:04:50 user nova-compute[74190]:     <model>Nehalem</model>
Oct 18 12:04:50 user nova-compute[74190]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 12:04:50 user nova-compute[74190]:   </cpu>
Oct 18 12:04:50 user nova-compute[74190]:   <devices>
Oct 18 12:04:50 user nova-compute[74190]:     <disk type="file" device="disk">
Oct 18 12:04:50 user nova-compute[74190]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 12:04:50 user nova-compute[74190]:       <source file="/opt/stack/data/nova/instances/7f79a267-5bc8-4fa0-9e3a-4706fa1da142/disk.rescue"/>
Oct 18 12:04:50 user nova-compute[74190]:       <target dev="vda" bus="virtio"/>
Oct 18 12:04:50 user nova-compute[74190]:     </disk>
Oct 18 12:04:50 user nova-compute[74190]:     <disk type="file" device="disk">
Oct 18 12:04:50 user nova-compute[74190]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 12:04:50 user nova-compute[74190]:       <source file="/opt/stack/data/nova/instances/7f79a267-5bc8-4fa0-9e3a-4706fa1da142/disk"/>
Oct 18 12:04:50 user nova-compute[74190]:       <target dev="vdb" bus="virtio"/>
Oct 18 12:04:50 user nova-compute[74190]:     </disk>
Oct 18 12:04:50 user nova-compute[74190]:     <interface type="ethernet">
Oct 18 12:04:50 user nova-compute[74190]:       <mac address="fa:16:3e:68:65:7b"/>
Oct 18 12:04:50 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 12:04:50 user nova-compute[74190]:       <mtu size="1442"/>
Oct 18 12:04:50 user nova-compute[74190]:       <target dev="tap85b87aa7-52"/>
Oct 18 12:04:50 user nova-compute[74190]:     </interface>
Oct 18 12:04:50 user nova-compute[74190]:     <serial type="pty">
Oct 18 12:04:50 user nova-compute[74190]:       <log file="/opt/stack/data/nova/instances/7f79a267-5bc8-4fa0-9e3a-4706fa1da142/console.log" append="off"/>
Oct 18 12:04:50 user nova-compute[74190]:     </serial>
Oct 18 12:04:50 user nova-compute[74190]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 12:04:50 user nova-compute[74190]:     <video>
Oct 18 12:04:50 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 12:04:50 user nova-compute[74190]:     </video>
Oct 18 12:04:50 user nova-compute[74190]:     <rng model="virtio">
Oct 18 12:04:50 user nova-compute[74190]:       <backend model="random">/dev/urandom</backend>
Oct 18 12:04:50 user nova-compute[74190]:     </rng>
Oct 18 12:04:50 user nova-compute[74190]:     <controller type="usb" index="0" model="none"/>
Oct 18 12:04:50 user nova-compute[74190]:     <memballoon model="virtio">
Oct 18 12:04:50 user nova-compute[74190]:       <stats period="10"/>
Oct 18 12:04:50 user nova-compute[74190]:     </memballoon>
Oct 18 12:04:50 user nova-compute[74190]:   </devices>
Oct 18 12:04:50 user nova-compute[74190]: </domain>
Oct 18 12:04:50 user nova-compute[74190]:  {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 12:04:50 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:04:50 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Instance destroyed successfully.
Oct 18 12:04:50 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-bfdb5a3d-8efd-4ce9-932f-fa2d3f1ab4c3 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] No BDM found with device name vda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 12:04:50 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-bfdb5a3d-8efd-4ce9-932f-fa2d3f1ab4c3 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 12:04:50 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-bfdb5a3d-8efd-4ce9-932f-fa2d3f1ab4c3 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] No VIF found with MAC fa:16:3e:68:65:7b, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 12:04:51 user nova-compute[74190]: DEBUG nova.compute.manager [req-56b69c00-7789-4360-bd25-c21beea6c1cc req-74c8abbf-db66-4d15-8122-21f720a708a4 service nova] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Received event network-vif-plugged-85b87aa7-52a9-4487-a954-7e07dcf20500 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:04:51 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-56b69c00-7789-4360-bd25-c21beea6c1cc req-74c8abbf-db66-4d15-8122-21f720a708a4 service nova] Acquiring lock "7f79a267-5bc8-4fa0-9e3a-4706fa1da142-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:04:51 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-56b69c00-7789-4360-bd25-c21beea6c1cc req-74c8abbf-db66-4d15-8122-21f720a708a4 service nova] Lock "7f79a267-5bc8-4fa0-9e3a-4706fa1da142-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:04:51 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-56b69c00-7789-4360-bd25-c21beea6c1cc req-74c8abbf-db66-4d15-8122-21f720a708a4 service nova] Lock "7f79a267-5bc8-4fa0-9e3a-4706fa1da142-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:04:51 user nova-compute[74190]: DEBUG nova.compute.manager [req-56b69c00-7789-4360-bd25-c21beea6c1cc req-74c8abbf-db66-4d15-8122-21f720a708a4 service nova] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] No waiting events found dispatching network-vif-plugged-85b87aa7-52a9-4487-a954-7e07dcf20500 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:04:51 user nova-compute[74190]: WARNING nova.compute.manager [req-56b69c00-7789-4360-bd25-c21beea6c1cc req-74c8abbf-db66-4d15-8122-21f720a708a4 service nova] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Received unexpected event network-vif-plugged-85b87aa7-52a9-4487-a954-7e07dcf20500 for instance with vm_state active and task_state rescuing.
Oct 18 12:04:51 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:04:51 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:04:51 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:04:51 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:04:52 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:04:52 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:04:53 user nova-compute[74190]: DEBUG nova.compute.manager [req-112cb26b-dedf-4d93-82a8-3d597d4f3605 req-d8c7748c-2e29-447b-b18c-b7fa0ba6590e service nova] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Received event network-vif-plugged-85b87aa7-52a9-4487-a954-7e07dcf20500 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:04:53 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-112cb26b-dedf-4d93-82a8-3d597d4f3605 req-d8c7748c-2e29-447b-b18c-b7fa0ba6590e service nova] Acquiring lock "7f79a267-5bc8-4fa0-9e3a-4706fa1da142-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:04:53 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-112cb26b-dedf-4d93-82a8-3d597d4f3605 req-d8c7748c-2e29-447b-b18c-b7fa0ba6590e service nova] Lock "7f79a267-5bc8-4fa0-9e3a-4706fa1da142-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:04:53 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-112cb26b-dedf-4d93-82a8-3d597d4f3605 req-d8c7748c-2e29-447b-b18c-b7fa0ba6590e service nova] Lock "7f79a267-5bc8-4fa0-9e3a-4706fa1da142-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:04:53 user nova-compute[74190]: DEBUG nova.compute.manager [req-112cb26b-dedf-4d93-82a8-3d597d4f3605 req-d8c7748c-2e29-447b-b18c-b7fa0ba6590e service nova] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] No waiting events found dispatching network-vif-plugged-85b87aa7-52a9-4487-a954-7e07dcf20500 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:04:53 user nova-compute[74190]: WARNING nova.compute.manager [req-112cb26b-dedf-4d93-82a8-3d597d4f3605 req-d8c7748c-2e29-447b-b18c-b7fa0ba6590e service nova] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Received unexpected event network-vif-plugged-85b87aa7-52a9-4487-a954-7e07dcf20500 for instance with vm_state active and task_state rescuing.
Oct 18 12:04:53 user nova-compute[74190]: DEBUG nova.compute.manager [req-112cb26b-dedf-4d93-82a8-3d597d4f3605 req-d8c7748c-2e29-447b-b18c-b7fa0ba6590e service nova] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Received event network-vif-plugged-85b87aa7-52a9-4487-a954-7e07dcf20500 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:04:53 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-112cb26b-dedf-4d93-82a8-3d597d4f3605 req-d8c7748c-2e29-447b-b18c-b7fa0ba6590e service nova] Acquiring lock "7f79a267-5bc8-4fa0-9e3a-4706fa1da142-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:04:53 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-112cb26b-dedf-4d93-82a8-3d597d4f3605 req-d8c7748c-2e29-447b-b18c-b7fa0ba6590e service nova] Lock "7f79a267-5bc8-4fa0-9e3a-4706fa1da142-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:04:53 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-112cb26b-dedf-4d93-82a8-3d597d4f3605 req-d8c7748c-2e29-447b-b18c-b7fa0ba6590e service nova] Lock "7f79a267-5bc8-4fa0-9e3a-4706fa1da142-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:04:53 user nova-compute[74190]: DEBUG nova.compute.manager [req-112cb26b-dedf-4d93-82a8-3d597d4f3605 req-d8c7748c-2e29-447b-b18c-b7fa0ba6590e service nova] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] No waiting events found dispatching network-vif-plugged-85b87aa7-52a9-4487-a954-7e07dcf20500 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:04:53 user nova-compute[74190]: WARNING nova.compute.manager [req-112cb26b-dedf-4d93-82a8-3d597d4f3605 req-d8c7748c-2e29-447b-b18c-b7fa0ba6590e service nova] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Received unexpected event network-vif-plugged-85b87aa7-52a9-4487-a954-7e07dcf20500 for instance with vm_state active and task_state rescuing.
Oct 18 12:04:54 user nova-compute[74190]: DEBUG nova.compute.manager [None req-bfdb5a3d-8efd-4ce9-932f-fa2d3f1ab4c3 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Checking state {{(pid=74190) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 12:04:55 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:04:55 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:05:00 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:05:00 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:05:05 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:05:05 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:05:06 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:05:06 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:05:07 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:05:10 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:05:10 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:05:11 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:05:11 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74190) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 12:05:12 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:05:12 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:05:12 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Starting heal instance info cache {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 12:05:12 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "refresh_cache-42413a94-9973-4e8d-83b6-207a4e7847c1" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:05:12 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquired lock "refresh_cache-42413a94-9973-4e8d-83b6-207a4e7847c1" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:05:12 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 42413a94-9973-4e8d-83b6-207a4e7847c1] Forcefully refreshing network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 18 12:05:12 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 42413a94-9973-4e8d-83b6-207a4e7847c1] Updating instance_info_cache with network_info: [{"id": "1bad07b8-897d-4280-9eac-ea800fd1cf5a", "address": "fa:16:3e:0f:dd:a5", "network": {"id": "130f7948-11e4-49b4-9d4a-dffb2b48bdcd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595419292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ffa18c02b8a4117ab1ccc52aca64f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bad07b8-89", "ovs_interfaceid": "1bad07b8-897d-4280-9eac-ea800fd1cf5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:05:12 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Releasing lock "refresh_cache-42413a94-9973-4e8d-83b6-207a4e7847c1" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:05:12 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 42413a94-9973-4e8d-83b6-207a4e7847c1] Updated the network info_cache for instance {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 18 12:05:14 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-a1482e5c-f341-4600-80de-76c05ccef07e tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Acquiring lock "2f59adf3-9728-4d5b-87d5-2ad32c99d06e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:05:14 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-a1482e5c-f341-4600-80de-76c05ccef07e tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Lock "2f59adf3-9728-4d5b-87d5-2ad32c99d06e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:05:14 user nova-compute[74190]: DEBUG nova.objects.instance [None req-a1482e5c-f341-4600-80de-76c05ccef07e tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Lazy-loading 'flavor' on Instance uuid 2f59adf3-9728-4d5b-87d5-2ad32c99d06e {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:05:14 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-a1482e5c-f341-4600-80de-76c05ccef07e tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Lock "2f59adf3-9728-4d5b-87d5-2ad32c99d06e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:05:14 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-a1482e5c-f341-4600-80de-76c05ccef07e tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Acquiring lock "2f59adf3-9728-4d5b-87d5-2ad32c99d06e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:05:14 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-a1482e5c-f341-4600-80de-76c05ccef07e tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Lock "2f59adf3-9728-4d5b-87d5-2ad32c99d06e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:05:14 user nova-compute[74190]: INFO nova.compute.manager [None req-a1482e5c-f341-4600-80de-76c05ccef07e tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] Attaching volume a4675405-969d-40a8-8680-8497751fe6ac to /dev/vdb
Oct 18 12:05:14 user nova-compute[74190]: DEBUG os_brick.utils [None req-a1482e5c-f341-4600-80de-76c05ccef07e tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 12:05:14 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:05:14 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:05:14 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[7954f98b-c232-4466-8909-f5441f1f35dc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cff158e257e1\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:05:14 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:05:14 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:05:14 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ef75da-20b2-4863-90f6-c25fdb8ae3fc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:05:14 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:05:14 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.130s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:05:14 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[71c72cc8-070f-4a8e-9fe0-afbadd6a8d44]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:05:14 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[832a077c-08fc-4578-8f40-d3403c393538]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:05:14 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-a1482e5c-f341-4600-80de-76c05ccef07e tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Running cmd (subprocess): nvme version {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:05:14 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-a1482e5c-f341-4600-80de-76c05ccef07e tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] 'nvme version' failed. Not Retrying. {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 12:05:14 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a1482e5c-f341-4600-80de-76c05ccef07e tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] nvme not present on system {{(pid=74190) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 12:05:14 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:05:14 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 12:05:14 user nova-compute[74190]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 12:05:14 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[131c9607-7892-4abf-a811-7588c36ad5e3]: (4, '') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:05:14 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-a1482e5c-f341-4600-80de-76c05ccef07e tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74190) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 12:05:14 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-a1482e5c-f341-4600-80de-76c05ccef07e tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 12:05:14 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-a1482e5c-f341-4600-80de-76c05ccef07e tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] LIGHTOS: no hostnqn found. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 12:05:14 user nova-compute[74190]: DEBUG os_brick.utils [None req-a1482e5c-f341-4600-80de-76c05ccef07e tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] <== get_connector_properties: return (251ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cff158e257e1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 12:05:14 user nova-compute[74190]: DEBUG nova.virt.block_device [None req-a1482e5c-f341-4600-80de-76c05ccef07e tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] Updating existing volume attachment record: e92c8b65-3616-459e-813d-13e3de53d63a {{(pid=74190) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 12:05:15 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:05:15 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:05:15 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:05:15 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:05:15 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Auditing locally available compute resources for user (node: user) {{(pid=74190) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 12:05:15 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f59adf3-9728-4d5b-87d5-2ad32c99d06e/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:05:15 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:05:15 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:05:15 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f59adf3-9728-4d5b-87d5-2ad32c99d06e/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:05:15 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f59adf3-9728-4d5b-87d5-2ad32c99d06e/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:05:15 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f59adf3-9728-4d5b-87d5-2ad32c99d06e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:05:15 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f79a267-5bc8-4fa0-9e3a-4706fa1da142/disk.rescue --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:05:15 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f79a267-5bc8-4fa0-9e3a-4706fa1da142/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:05:15 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f79a267-5bc8-4fa0-9e3a-4706fa1da142/disk.rescue --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:05:16 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f79a267-5bc8-4fa0-9e3a-4706fa1da142/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:05:16 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /opt/stack/data/nova/instances/7f79a267-5bc8-4fa0-9e3a-4706fa1da142/disk (vdb) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 12:05:16 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:05:16 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:05:16 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:05:16 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:05:16 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1e27a16-43e4-4e80-9c0a-5c2dce06daae/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:05:16 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1e27a16-43e4-4e80-9c0a-5c2dce06daae/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:05:16 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1e27a16-43e4-4e80-9c0a-5c2dce06daae/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:05:16 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1e27a16-43e4-4e80-9c0a-5c2dce06daae/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:05:16 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:05:17 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:05:17 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:05:17 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:05:17 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f8682a-6de5-459b-9843-bbe945fb329e/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:05:17 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f8682a-6de5-459b-9843-bbe945fb329e/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:05:17 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f8682a-6de5-459b-9843-bbe945fb329e/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:05:17 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f8682a-6de5-459b-9843-bbe945fb329e/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:05:17 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:05:17 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:05:17 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:05:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:05:18 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 12:05:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk.rescue --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:05:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:05:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk.rescue --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:05:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:05:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:05:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:05:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:05:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:05:18 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 12:05:19 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:05:19 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:05:19 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Hypervisor/Node resource view: name=user free_ram=7823MB free_disk=24.990234375GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74190) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 12:05:19 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:05:19 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:05:19 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 4e916d24-9f9d-4289-87ce-f65d2499fcd9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:05:19 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 95ca0697-22b5-4109-868f-ca5556015a1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:05:19 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 42413a94-9973-4e8d-83b6-207a4e7847c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:05:19 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 772b126c-2148-4ca8-90f2-69d6eb4b7db7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:05:19 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 0382820d-a678-4593-85df-168f42fc4ce4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:05:19 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 2f59adf3-9728-4d5b-87d5-2ad32c99d06e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:05:19 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 7f79a267-5bc8-4fa0-9e3a-4706fa1da142 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:05:19 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance c0f8682a-6de5-459b-9843-bbe945fb329e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:05:19 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance b1e27a16-43e4-4e80-9c0a-5c2dce06daae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:05:19 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 12:05:19 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 12:05:19 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 12:05:19 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 12:05:19 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Compute_service record updated for user:user {{(pid=74190) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 12:05:19 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.447s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:05:20 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:05:20 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:05:20 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:05:20 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:05:20 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:05:20 user nova-compute[74190]: DEBUG nova.compute.manager [req-d4552863-da7e-41a8-bc9c-2fe492e1afe4 req-bd936298-b147-4011-b36f-090f546d5560 service nova] [instance: c0f8682a-6de5-459b-9843-bbe945fb329e] Received event network-changed-bf475d1e-c90f-4ec2-aafc-5f9fdaab831f {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:05:20 user nova-compute[74190]: DEBUG nova.compute.manager [req-d4552863-da7e-41a8-bc9c-2fe492e1afe4 req-bd936298-b147-4011-b36f-090f546d5560 service nova] [instance: c0f8682a-6de5-459b-9843-bbe945fb329e] Refreshing instance network info cache due to event network-changed-bf475d1e-c90f-4ec2-aafc-5f9fdaab831f. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 12:05:20 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d4552863-da7e-41a8-bc9c-2fe492e1afe4 req-bd936298-b147-4011-b36f-090f546d5560 service nova] Acquiring lock "refresh_cache-c0f8682a-6de5-459b-9843-bbe945fb329e" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:05:20 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d4552863-da7e-41a8-bc9c-2fe492e1afe4 req-bd936298-b147-4011-b36f-090f546d5560 service nova] Acquired lock "refresh_cache-c0f8682a-6de5-459b-9843-bbe945fb329e" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:05:20 user nova-compute[74190]: DEBUG nova.network.neutron [req-d4552863-da7e-41a8-bc9c-2fe492e1afe4 req-bd936298-b147-4011-b36f-090f546d5560 service nova] [instance: c0f8682a-6de5-459b-9843-bbe945fb329e] Refreshing network info cache for port bf475d1e-c90f-4ec2-aafc-5f9fdaab831f {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 12:05:21 user nova-compute[74190]: DEBUG nova.network.neutron [req-d4552863-da7e-41a8-bc9c-2fe492e1afe4 req-bd936298-b147-4011-b36f-090f546d5560 service nova] [instance: c0f8682a-6de5-459b-9843-bbe945fb329e] Updated VIF entry in instance network info cache for port bf475d1e-c90f-4ec2-aafc-5f9fdaab831f. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 12:05:21 user nova-compute[74190]: DEBUG nova.network.neutron [req-d4552863-da7e-41a8-bc9c-2fe492e1afe4 req-bd936298-b147-4011-b36f-090f546d5560 service nova] [instance: c0f8682a-6de5-459b-9843-bbe945fb329e] Updating instance_info_cache with network_info: [{"id": "bf475d1e-c90f-4ec2-aafc-5f9fdaab831f", "address": "fa:16:3e:a7:7b:dd", "network": {"id": "25e0d6f5-497d-4898-8181-5b4848950f16", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-245925644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df06c4b010434e3da9ba4ea41f26befa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf475d1e-c9", "ovs_interfaceid": "bf475d1e-c90f-4ec2-aafc-5f9fdaab831f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:05:21 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d4552863-da7e-41a8-bc9c-2fe492e1afe4 req-bd936298-b147-4011-b36f-090f546d5560 service nova] Releasing lock "refresh_cache-c0f8682a-6de5-459b-9843-bbe945fb329e" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:05:25 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:05:25 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:05:26 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-4a9f6a9e-ddce-42ad-b46f-820846076f0a tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Acquiring lock "c0f8682a-6de5-459b-9843-bbe945fb329e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:05:26 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-4a9f6a9e-ddce-42ad-b46f-820846076f0a tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "c0f8682a-6de5-459b-9843-bbe945fb329e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:05:26 user nova-compute[74190]: DEBUG nova.objects.instance [None req-4a9f6a9e-ddce-42ad-b46f-820846076f0a tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lazy-loading 'flavor' on Instance uuid c0f8682a-6de5-459b-9843-bbe945fb329e {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:05:26 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-4a9f6a9e-ddce-42ad-b46f-820846076f0a tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "c0f8682a-6de5-459b-9843-bbe945fb329e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:05:27 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-4a9f6a9e-ddce-42ad-b46f-820846076f0a tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Acquiring lock "c0f8682a-6de5-459b-9843-bbe945fb329e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:05:27 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-4a9f6a9e-ddce-42ad-b46f-820846076f0a tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "c0f8682a-6de5-459b-9843-bbe945fb329e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:05:27 user nova-compute[74190]: INFO nova.compute.manager [None req-4a9f6a9e-ddce-42ad-b46f-820846076f0a tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: c0f8682a-6de5-459b-9843-bbe945fb329e] Attaching volume a074b500-cda4-4ee2-be35-26ab58d09a54 to /dev/vdb
Oct 18 12:05:27 user nova-compute[74190]: DEBUG os_brick.utils [None req-4a9f6a9e-ddce-42ad-b46f-820846076f0a tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 12:05:27 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:05:27 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:05:27 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7ede1c1-7105-4db7-986b-18e83cd86857]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cff158e257e1\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:05:27 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:05:27 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:05:27 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[359017cd-4804-4a3a-a895-d6535317d14e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:05:27 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:05:27 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:05:27 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[f04ce281-6a28-4369-aabf-fe29d03681b1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:05:27 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc9f62c-588a-4d0b-a6da-5bff90de5bd1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:05:27 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-4a9f6a9e-ddce-42ad-b46f-820846076f0a tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Running cmd (subprocess): nvme version {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:05:27 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-4a9f6a9e-ddce-42ad-b46f-820846076f0a tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] 'nvme version' failed. Not Retrying. {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 12:05:27 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4a9f6a9e-ddce-42ad-b46f-820846076f0a tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] nvme not present on system {{(pid=74190) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 12:05:27 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:05:27 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 12:05:27 user nova-compute[74190]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 12:05:27 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e93eb3-7217-42a1-b0fb-663083fdc0a3]: (4, '') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:05:27 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-4a9f6a9e-ddce-42ad-b46f-820846076f0a tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74190) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 12:05:27 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-4a9f6a9e-ddce-42ad-b46f-820846076f0a tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 12:05:27 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-4a9f6a9e-ddce-42ad-b46f-820846076f0a tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] LIGHTOS: no hostnqn found. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 12:05:27 user nova-compute[74190]: DEBUG os_brick.utils [None req-4a9f6a9e-ddce-42ad-b46f-820846076f0a tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cff158e257e1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 12:05:27 user nova-compute[74190]: DEBUG nova.virt.block_device [None req-4a9f6a9e-ddce-42ad-b46f-820846076f0a tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: c0f8682a-6de5-459b-9843-bbe945fb329e] Updating existing volume attachment record: ceec8a25-3eb6-4107-9af9-7af5d278f64f {{(pid=74190) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 12:05:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:05:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:05:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:05:32 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1482e5c-f341-4600-80de-76c05ccef07e tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] Calling os-brick to attach iSCSI Volume {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 12:05:32 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1482e5c-f341-4600-80de-76c05ccef07e tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a4675405-969d-40a8-8680-8497751fe6ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uecdKliL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 12:05:32 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-a1482e5c-f341-4600-80de-76c05ccef07e tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 12:05:32 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-a1482e5c-f341-4600-80de-76c05ccef07e tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 12:05:32 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-a1482e5c-f341-4600-80de-76c05ccef07e tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 12:05:32 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-a1482e5c-f341-4600-80de-76c05ccef07e tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 12:05:32 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-a1482e5c-f341-4600-80de-76c05ccef07e tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4675405-969d-40a8-8680-8497751fe6ac" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 12:05:32 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-a1482e5c-f341-4600-80de-76c05ccef07e tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4675405-969d-40a8-8680-8497751fe6ac" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 12:05:32 user nova-compute[74190]: INFO os_brick.initiator.connectors.iscsi [None req-a1482e5c-f341-4600-80de-76c05ccef07e tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 12:05:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4675405-969d-40a8-8680-8497751fe6ac -p 172.16.0.220:3260 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:05:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4675405-969d-40a8-8680-8497751fe6ac -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:05:32 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ad8ccd-dde0-4145-b7e2-8b73a48cf45d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:05:32 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1482e5c-f341-4600-80de-76c05ccef07e tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 12:05:32 user nova-compute[74190]:  {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:05:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4675405-969d-40a8-8680-8497751fe6ac -p 172.16.0.220:3260 --interface default --op new {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:05:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4675405-969d-40a8-8680-8497751fe6ac -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:05:32 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba03bcf0-6d2a-4702-8c76-6e277185e912]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a4675405-969d-40a8-8680-8497751fe6ac] added\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:05:32 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1482e5c-f341-4600-80de-76c05ccef07e tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a4675405-969d-40a8-8680-8497751fe6ac] added
Oct 18 12:05:32 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:05:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4675405-969d-40a8-8680-8497751fe6ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:05:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4675405-969d-40a8-8680-8497751fe6ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:05:32 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ea0011-f922-46e8-bebd-412ef6c81954]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:05:32 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1482e5c-f341-4600-80de-76c05ccef07e tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:05:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4675405-969d-40a8-8680-8497751fe6ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:05:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4675405-969d-40a8-8680-8497751fe6ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:05:32 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[b53805d3-7924-4ce3-b508-5a8e92ac4772]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:05:32 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1482e5c-f341-4600-80de-76c05ccef07e tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:05:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4675405-969d-40a8-8680-8497751fe6ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uecdKliL {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:05:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4675405-969d-40a8-8680-8497751fe6ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uecdKliL" returned: 0 in 0.023s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:05:32 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[807b90ec-5df3-460a-b4c6-48db6bad9fe0]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:05:32 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1482e5c-f341-4600-80de-76c05ccef07e tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uecdKliL'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:05:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4675405-969d-40a8-8680-8497751fe6ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:05:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4675405-969d-40a8-8680-8497751fe6ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:05:32 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c95a7fd-14fa-4e87-a631-bdcf8aca13f6]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:05:32 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1482e5c-f341-4600-80de-76c05ccef07e tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:05:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:05:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:05:32 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac9e1f2-ac07-4f01-8767-27ef7ea7345c]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:05:32 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1482e5c-f341-4600-80de-76c05ccef07e tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 12:05:32 user nova-compute[74190]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)
Oct 18 12:05:32 user nova-compute[74190]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f (non-flash)
Oct 18 12:05:32 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 12:05:32 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1482e5c-f341-4600-80de-76c05ccef07e tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 12:05:32 user nova-compute[74190]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)
Oct 18 12:05:32 user nova-compute[74190]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f (non-flash)
Oct 18 12:05:32 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 12:05:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4675405-969d-40a8-8680-8497751fe6ac -p 172.16.0.220:3260 --login {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:05:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4675405-969d-40a8-8680-8497751fe6ac -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:05:32 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4258dc1-efad-4030-8083-6a928e921219]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a4675405-969d-40a8-8680-8497751fe6ac, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a4675405-969d-40a8-8680-8497751fe6ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:05:32 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1482e5c-f341-4600-80de-76c05ccef07e tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a4675405-969d-40a8-8680-8497751fe6ac, portal: 172.16.0.220,3260]
Oct 18 12:05:32 user nova-compute[74190]: Login to [iface: default, target: iqn.2010-10.org.openstack:a4675405-969d-40a8-8680-8497751fe6ac, portal: 172.16.0.220,3260] successful.
Oct 18 12:05:32 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:05:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4675405-969d-40a8-8680-8497751fe6ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:05:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4675405-969d-40a8-8680-8497751fe6ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:05:32 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2f373d6-ea0f-48f4-926d-341f15a53524]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:05:32 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1482e5c-f341-4600-80de-76c05ccef07e tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:05:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:05:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:05:32 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c52bb2-0556-433e-a3a1-8561ed7f9eff]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4675405-969d-40a8-8680-8497751fe6ac (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:05:32 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1482e5c-f341-4600-80de-76c05ccef07e tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 12:05:32 user nova-compute[74190]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)
Oct 18 12:05:32 user nova-compute[74190]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f (non-flash)
Oct 18 12:05:32 user nova-compute[74190]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4675405-969d-40a8-8680-8497751fe6ac (non-flash)
Oct 18 12:05:32 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 12:05:32 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1482e5c-f341-4600-80de-76c05ccef07e tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 12:05:32 user nova-compute[74190]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)
Oct 18 12:05:32 user nova-compute[74190]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f (non-flash)
Oct 18 12:05:32 user nova-compute[74190]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4675405-969d-40a8-8680-8497751fe6ac (non-flash)
Oct 18 12:05:32 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 12:05:32 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-a1482e5c-f341-4600-80de-76c05ccef07e tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4675405-969d-40a8-8680-8497751fe6ac" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 12:05:32 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1482e5c-f341-4600-80de-76c05ccef07e tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Connected to 172.16.0.220:3260 {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 12:05:32 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-a1482e5c-f341-4600-80de-76c05ccef07e tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] HCTL ('36', '-', '-', 0) found on session 42 with lun 0 {{(pid=74190) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 12:05:32 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-a1482e5c-f341-4600-80de-76c05ccef07e tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74190) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 12:05:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:05:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:05:32 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7232827-726b-4380-aea0-9be6fd5146d0]: (4, ('- - 0', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:05:32 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-a1482e5c-f341-4600-80de-76c05ccef07e tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Searching for a device in session 42 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74190) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 12:05:32 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1482e5c-f341-4600-80de-76c05ccef07e tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:a4675405-969d-40a8-8680-8497751fe6ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uecdKliL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 12:05:33 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-a1482e5c-f341-4600-80de-76c05ccef07e tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 12:05:33 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1482e5c-f341-4600-80de-76c05ccef07e tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '23930396364323233', 'path': '/dev/sde'} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 12:05:33 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1482e5c-f341-4600-80de-76c05ccef07e tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23930396364323233', 'path': '/dev/sde'} {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 12:05:33 user nova-compute[74190]: DEBUG nova.objects.instance [None req-a1482e5c-f341-4600-80de-76c05ccef07e tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Lazy-loading 'flavor' on Instance uuid 2f59adf3-9728-4d5b-87d5-2ad32c99d06e {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:05:33 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-a1482e5c-f341-4600-80de-76c05ccef07e tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] attach device xml: <disk type="block" device="disk">
Oct 18 12:05:33 user nova-compute[74190]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 12:05:33 user nova-compute[74190]:   <source dev="/dev/sde"/>
Oct 18 12:05:33 user nova-compute[74190]:   <target dev="vdb" bus="virtio"/>
Oct 18 12:05:33 user nova-compute[74190]:   <serial>a4675405-969d-40a8-8680-8497751fe6ac</serial>
Oct 18 12:05:33 user nova-compute[74190]: </disk>
Oct 18 12:05:33 user nova-compute[74190]:  {{(pid=74190) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 18 12:05:34 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-a1482e5c-f341-4600-80de-76c05ccef07e tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] No BDM found with device name vda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 12:05:34 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-a1482e5c-f341-4600-80de-76c05ccef07e tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 12:05:34 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-a1482e5c-f341-4600-80de-76c05ccef07e tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] No VIF found with MAC fa:16:3e:5c:73:bc, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 12:05:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-a1482e5c-f341-4600-80de-76c05ccef07e tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Lock "2f59adf3-9728-4d5b-87d5-2ad32c99d06e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.184s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:05:35 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:05:35 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:05:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-017852b2-56f8-4115-81c9-ae800f1a3ddb tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Acquiring lock "2f59adf3-9728-4d5b-87d5-2ad32c99d06e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:05:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-017852b2-56f8-4115-81c9-ae800f1a3ddb tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Lock "2f59adf3-9728-4d5b-87d5-2ad32c99d06e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:05:36 user nova-compute[74190]: INFO nova.compute.manager [None req-017852b2-56f8-4115-81c9-ae800f1a3ddb tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] Detaching volume a4675405-969d-40a8-8680-8497751fe6ac
Oct 18 12:05:36 user nova-compute[74190]: INFO nova.virt.block_device [None req-017852b2-56f8-4115-81c9-ae800f1a3ddb tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] Attempting to driver detach volume a4675405-969d-40a8-8680-8497751fe6ac from mountpoint /dev/vdb
Oct 18 12:05:36 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-017852b2-56f8-4115-81c9-ae800f1a3ddb tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Attempting to detach device vdb from instance 2f59adf3-9728-4d5b-87d5-2ad32c99d06e from the persistent domain config. {{(pid=74190) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 18 12:05:36 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-017852b2-56f8-4115-81c9-ae800f1a3ddb tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 12:05:36 user nova-compute[74190]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 12:05:36 user nova-compute[74190]:   <source dev="/dev/sde"/>
Oct 18 12:05:36 user nova-compute[74190]:   <target dev="vdb" bus="virtio"/>
Oct 18 12:05:36 user nova-compute[74190]:   <serial>a4675405-969d-40a8-8680-8497751fe6ac</serial>
Oct 18 12:05:36 user nova-compute[74190]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 18 12:05:36 user nova-compute[74190]: </disk>
Oct 18 12:05:36 user nova-compute[74190]:  {{(pid=74190) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 12:05:36 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-017852b2-56f8-4115-81c9-ae800f1a3ddb tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Successfully detached device vdb from instance 2f59adf3-9728-4d5b-87d5-2ad32c99d06e from the persistent domain config.
Oct 18 12:05:36 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-017852b2-56f8-4115-81c9-ae800f1a3ddb tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2f59adf3-9728-4d5b-87d5-2ad32c99d06e from the live domain config. {{(pid=74190) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 18 12:05:36 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-017852b2-56f8-4115-81c9-ae800f1a3ddb tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 12:05:36 user nova-compute[74190]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 12:05:36 user nova-compute[74190]:   <source dev="/dev/sde"/>
Oct 18 12:05:36 user nova-compute[74190]:   <target dev="vdb" bus="virtio"/>
Oct 18 12:05:36 user nova-compute[74190]:   <serial>a4675405-969d-40a8-8680-8497751fe6ac</serial>
Oct 18 12:05:36 user nova-compute[74190]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 18 12:05:36 user nova-compute[74190]: </disk>
Oct 18 12:05:36 user nova-compute[74190]:  {{(pid=74190) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 12:05:37 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-017852b2-56f8-4115-81c9-ae800f1a3ddb tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2f59adf3-9728-4d5b-87d5-2ad32c99d06e {{(pid=74190) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 18 12:05:38 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:05:40 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:05:40 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:05:40 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:05:44 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:05:45 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:05:45 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:05:46 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:05:50 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:05:50 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:05:55 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:05:55 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:05:57 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-017852b2-56f8-4115-81c9-ae800f1a3ddb tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2f59adf3-9728-4d5b-87d5-2ad32c99d06e is timed out.
Oct 18 12:05:57 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-017852b2-56f8-4115-81c9-ae800f1a3ddb tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Successfully detached device vdb from instance 2f59adf3-9728-4d5b-87d5-2ad32c99d06e from the live domain config.
Oct 18 12:05:57 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-017852b2-56f8-4115-81c9-ae800f1a3ddb tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] calling os-brick to detach iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 12:05:57 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-017852b2-56f8-4115-81c9-ae800f1a3ddb tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, {'target_iqn': 'iqn.2010-10.org.openstack:a4675405-969d-40a8-8680-8497751fe6ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uecdKliL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 12:05:57 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-017852b2-56f8-4115-81c9-ae800f1a3ddb tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 12:05:57 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-017852b2-56f8-4115-81c9-ae800f1a3ddb tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 12:05:57 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-017852b2-56f8-4115-81c9-ae800f1a3ddb tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 12:05:57 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:05:57 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:05:57 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf2f5c7-e0b1-4160-9835-966f3baebeee]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a4675405-969d-40a8-8680-8497751fe6ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:05:57 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-017852b2-56f8-4115-81c9-ae800f1a3ddb tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 12:05:57 user nova-compute[74190]: No targets found.
Oct 18 12:05:57 user nova-compute[74190]: iSNS:
Oct 18 12:05:57 user nova-compute[74190]: No targets found.
Oct 18 12:05:57 user nova-compute[74190]: STATIC:
Oct 18 12:05:57 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f
Oct 18 12:05:57 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 12:05:57 user nova-compute[74190]:                 Iface Name: default
Oct 18 12:05:57 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa
Oct 18 12:05:57 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 12:05:57 user nova-compute[74190]:                 Iface Name: default
Oct 18 12:05:57 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:a4675405-969d-40a8-8680-8497751fe6ac
Oct 18 12:05:57 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 12:05:57 user nova-compute[74190]:                 Iface Name: default
Oct 18 12:05:57 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f
Oct 18 12:05:57 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 12:05:57 user nova-compute[74190]:                 Iface Name: default
Oct 18 12:05:57 user nova-compute[74190]: FIRMWARE:
Oct 18 12:05:57 user nova-compute[74190]: No targets found.
Oct 18 12:05:57 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 12:05:57 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-017852b2-56f8-4115-81c9-ae800f1a3ddb tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 12:05:57 user nova-compute[74190]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 12:05:57 user nova-compute[74190]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74190) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 12:05:57 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-017852b2-56f8-4115-81c9-ae800f1a3ddb tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4675405-969d-40a8-8680-8497751fe6ac', 0)] {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 12:05:57 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:05:57 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:05:57 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6722e8f-b416-48ac-9d71-18cf22b9061c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4675405-969d-40a8-8680-8497751fe6ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:05:57 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:05:57 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:05:57 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[154a96a2-4c15-4cac-b657-f14eb6bd9c8c]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4675405-969d-40a8-8680-8497751fe6ac (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:05:57 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-017852b2-56f8-4115-81c9-ae800f1a3ddb tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 12:05:57 user nova-compute[74190]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)
Oct 18 12:05:57 user nova-compute[74190]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f (non-flash)
Oct 18 12:05:57 user nova-compute[74190]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4675405-969d-40a8-8680-8497751fe6ac (non-flash)
Oct 18 12:05:57 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 12:05:57 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-017852b2-56f8-4115-81c9-ae800f1a3ddb tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 12:05:57 user nova-compute[74190]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)
Oct 18 12:05:57 user nova-compute[74190]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f (non-flash)
Oct 18 12:05:57 user nova-compute[74190]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4675405-969d-40a8-8680-8497751fe6ac (non-flash)
Oct 18 12:05:57 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 12:05:57 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-017852b2-56f8-4115-81c9-ae800f1a3ddb tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1f44538dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4675405-969d-40a8-8680-8497751fe6ac'): ({'sde'}, set())}) {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 12:05:57 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-017852b2-56f8-4115-81c9-ae800f1a3ddb tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Removing single pathed devices sde {{(pid=74190) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 12:05:57 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:05:57 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:05:57 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[9017c50a-fc4e-4f3c-a7ac-885294904d14]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:05:57 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:05:57 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:05:57 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[252abadf-8cff-42b9-8aac-e4bda091df7d]: (4, ('ok\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:05:57 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-017852b2-56f8-4115-81c9-ae800f1a3ddb tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Flushing IO for device /dev/sde {{(pid=74190) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 12:05:57 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:05:57 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:05:57 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab65993-93f6-4556-8966-4a0877c3a96d]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:05:57 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-017852b2-56f8-4115-81c9-ae800f1a3ddb tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74190) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 12:05:57 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:05:57 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.052s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:05:57 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dcc4bcb-dd59-4f62-aa41-891b0b9003b6]: (4, ('1', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:05:57 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-017852b2-56f8-4115-81c9-ae800f1a3ddb tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 12:05:57 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-017852b2-56f8-4115-81c9-ae800f1a3ddb tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] SCSI volumes sde have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 12:05:57 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-017852b2-56f8-4115-81c9-ae800f1a3ddb tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4675405-969d-40a8-8680-8497751fe6ac')] {{(pid=74190) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 12:05:57 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4675405-969d-40a8-8680-8497751fe6ac -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:05:57 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4675405-969d-40a8-8680-8497751fe6ac -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:05:57 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[b426ac72-40a1-4963-9c66-c1991821a9e4]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:05:57 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-017852b2-56f8-4115-81c9-ae800f1a3ddb tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:05:57 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4675405-969d-40a8-8680-8497751fe6ac -p 172.16.0.220:3260 --logout {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:05:57 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4675405-969d-40a8-8680-8497751fe6ac -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:05:57 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a683187-b9bc-492c-8608-fc307cf8db4e]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:a4675405-969d-40a8-8680-8497751fe6ac, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:a4675405-969d-40a8-8680-8497751fe6ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:05:57 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-017852b2-56f8-4115-81c9-ae800f1a3ddb tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:a4675405-969d-40a8-8680-8497751fe6ac, portal: 172.16.0.220,3260]
Oct 18 12:05:57 user nova-compute[74190]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:a4675405-969d-40a8-8680-8497751fe6ac, portal: 172.16.0.220,3260] successful.
Oct 18 12:05:57 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:05:57 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4675405-969d-40a8-8680-8497751fe6ac -p 172.16.0.220:3260 --op delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:05:57 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4675405-969d-40a8-8680-8497751fe6ac -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:05:57 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f7817e3-0d51-480f-b8a8-93ff8be45470]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:05:57 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-017852b2-56f8-4115-81c9-ae800f1a3ddb tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:05:57 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-017852b2-56f8-4115-81c9-ae800f1a3ddb tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 12:05:57 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-017852b2-56f8-4115-81c9-ae800f1a3ddb tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] <== disconnect_volume: return (330ms) None {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 12:05:57 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-017852b2-56f8-4115-81c9-ae800f1a3ddb tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] Disconnected iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 12:05:58 user nova-compute[74190]: DEBUG nova.objects.instance [None req-017852b2-56f8-4115-81c9-ae800f1a3ddb tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Lazy-loading 'flavor' on Instance uuid 2f59adf3-9728-4d5b-87d5-2ad32c99d06e {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:05:58 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-017852b2-56f8-4115-81c9-ae800f1a3ddb tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Lock "2f59adf3-9728-4d5b-87d5-2ad32c99d06e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.873s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:06:00 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:06:00 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:06:05 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:06:05 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:06:05 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74190) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 12:06:05 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:06:05 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:06:05 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:06:06 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a9f6a9e-ddce-42ad-b46f-820846076f0a tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: c0f8682a-6de5-459b-9843-bbe945fb329e] Calling os-brick to attach iSCSI Volume {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 12:06:06 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9f6a9e-ddce-42ad-b46f-820846076f0a tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a074b500-cda4-4ee2-be35-26ab58d09a54', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jWYThlFu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 12:06:06 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-4a9f6a9e-ddce-42ad-b46f-820846076f0a tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 12:06:06 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-4a9f6a9e-ddce-42ad-b46f-820846076f0a tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 12:06:06 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-4a9f6a9e-ddce-42ad-b46f-820846076f0a tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 12:06:06 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-4a9f6a9e-ddce-42ad-b46f-820846076f0a tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 12:06:06 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-4a9f6a9e-ddce-42ad-b46f-820846076f0a tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a074b500-cda4-4ee2-be35-26ab58d09a54" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 12:06:06 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-4a9f6a9e-ddce-42ad-b46f-820846076f0a tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a074b500-cda4-4ee2-be35-26ab58d09a54" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 12:06:06 user nova-compute[74190]: INFO os_brick.initiator.connectors.iscsi [None req-4a9f6a9e-ddce-42ad-b46f-820846076f0a tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 12:06:06 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a074b500-cda4-4ee2-be35-26ab58d09a54 -p 172.16.0.220:3260 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:06:06 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a074b500-cda4-4ee2-be35-26ab58d09a54 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:06:06 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[6261e1cd-5c7f-4c80-8357-c96c3be3ecbb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:06:06 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9f6a9e-ddce-42ad-b46f-820846076f0a tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 12:06:06 user nova-compute[74190]:  {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:06:06 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a074b500-cda4-4ee2-be35-26ab58d09a54 -p 172.16.0.220:3260 --interface default --op new {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:06:06 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a074b500-cda4-4ee2-be35-26ab58d09a54 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:06:06 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5df93a8-bf72-4fc6-ac59-327652774c2b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a074b500-cda4-4ee2-be35-26ab58d09a54] added\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:06:06 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9f6a9e-ddce-42ad-b46f-820846076f0a tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a074b500-cda4-4ee2-be35-26ab58d09a54] added
Oct 18 12:06:06 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:06:06 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a074b500-cda4-4ee2-be35-26ab58d09a54 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:06:06 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a074b500-cda4-4ee2-be35-26ab58d09a54 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:06:06 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8debf7a-16f0-489e-bcc2-dd2a4b1738a0]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:06:06 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9f6a9e-ddce-42ad-b46f-820846076f0a tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:06:06 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a074b500-cda4-4ee2-be35-26ab58d09a54 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:06:06 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a074b500-cda4-4ee2-be35-26ab58d09a54 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:06:06 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5fa82d-c191-4c2c-8a15-65c56666e7a5]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:06:06 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9f6a9e-ddce-42ad-b46f-820846076f0a tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:06:06 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a074b500-cda4-4ee2-be35-26ab58d09a54 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jWYThlFu {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:06:06 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a074b500-cda4-4ee2-be35-26ab58d09a54 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jWYThlFu" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:06:06 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[f18b642c-f7e0-459d-8a6f-6fc2f8f87d78]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:06:06 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9f6a9e-ddce-42ad-b46f-820846076f0a tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jWYThlFu'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:06:06 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a074b500-cda4-4ee2-be35-26ab58d09a54 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:06:06 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a074b500-cda4-4ee2-be35-26ab58d09a54 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:06:06 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ced848e-3315-4dad-8cb6-8ac407faea1d]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:06:06 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9f6a9e-ddce-42ad-b46f-820846076f0a tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:06:06 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:06:06 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:06:06 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee81bcc1-800c-46fc-a9ec-73b7f55c9ead]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:06:06 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9f6a9e-ddce-42ad-b46f-820846076f0a tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 12:06:06 user nova-compute[74190]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)
Oct 18 12:06:06 user nova-compute[74190]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f (non-flash)
Oct 18 12:06:06 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 12:06:06 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9f6a9e-ddce-42ad-b46f-820846076f0a tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 12:06:06 user nova-compute[74190]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)
Oct 18 12:06:06 user nova-compute[74190]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f (non-flash)
Oct 18 12:06:06 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 12:06:06 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a074b500-cda4-4ee2-be35-26ab58d09a54 -p 172.16.0.220:3260 --login {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:06:06 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a074b500-cda4-4ee2-be35-26ab58d09a54 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:06:06 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[5588a307-b1d1-475a-9bbc-8a732b6d4dee]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a074b500-cda4-4ee2-be35-26ab58d09a54, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a074b500-cda4-4ee2-be35-26ab58d09a54, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:06:06 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9f6a9e-ddce-42ad-b46f-820846076f0a tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a074b500-cda4-4ee2-be35-26ab58d09a54, portal: 172.16.0.220,3260]
Oct 18 12:06:06 user nova-compute[74190]: Login to [iface: default, target: iqn.2010-10.org.openstack:a074b500-cda4-4ee2-be35-26ab58d09a54, portal: 172.16.0.220,3260] successful.
Oct 18 12:06:06 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:06:06 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a074b500-cda4-4ee2-be35-26ab58d09a54 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:06:06 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a074b500-cda4-4ee2-be35-26ab58d09a54 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:06:06 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[a88acac8-5b92-4b66-a438-668c1d6359cd]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:06:06 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9f6a9e-ddce-42ad-b46f-820846076f0a tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:06:06 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:06:06 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:06:06 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce615e0-753a-4f6e-b12d-06f06308dd69]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a074b500-cda4-4ee2-be35-26ab58d09a54 (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:06:06 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9f6a9e-ddce-42ad-b46f-820846076f0a tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 12:06:06 user nova-compute[74190]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)
Oct 18 12:06:06 user nova-compute[74190]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f (non-flash)
Oct 18 12:06:06 user nova-compute[74190]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a074b500-cda4-4ee2-be35-26ab58d09a54 (non-flash)
Oct 18 12:06:06 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 12:06:06 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9f6a9e-ddce-42ad-b46f-820846076f0a tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 12:06:06 user nova-compute[74190]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)
Oct 18 12:06:06 user nova-compute[74190]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f (non-flash)
Oct 18 12:06:06 user nova-compute[74190]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a074b500-cda4-4ee2-be35-26ab58d09a54 (non-flash)
Oct 18 12:06:06 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 12:06:06 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-4a9f6a9e-ddce-42ad-b46f-820846076f0a tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a074b500-cda4-4ee2-be35-26ab58d09a54" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 12:06:06 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9f6a9e-ddce-42ad-b46f-820846076f0a tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Connected to 172.16.0.220:3260 {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 12:06:06 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-4a9f6a9e-ddce-42ad-b46f-820846076f0a tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] HCTL ('36', '-', '-', 0) found on session 43 with lun 0 {{(pid=74190) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 12:06:06 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-4a9f6a9e-ddce-42ad-b46f-820846076f0a tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74190) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 12:06:06 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:06:06 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:06:06 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab2c5e7-ff65-4794-b611-96b54cee842b]: (4, ('- - 0', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:06:06 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-4a9f6a9e-ddce-42ad-b46f-820846076f0a tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Searching for a device in session 43 and hctl ['36', '*', '*', 0] yield: None {{(pid=74190) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 12:06:07 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:06:07 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:06:07 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:06:07 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-4a9f6a9e-ddce-42ad-b46f-820846076f0a tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Searching for a device in session 43 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74190) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 12:06:07 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9f6a9e-ddce-42ad-b46f-820846076f0a tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:a074b500-cda4-4ee2-be35-26ab58d09a54', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jWYThlFu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 12:06:07 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-4a9f6a9e-ddce-42ad-b46f-820846076f0a tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 12:06:07 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9f6a9e-ddce-42ad-b46f-820846076f0a tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '23265656131643238', 'path': '/dev/sde'} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 12:06:07 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a9f6a9e-ddce-42ad-b46f-820846076f0a tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: c0f8682a-6de5-459b-9843-bbe945fb329e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23265656131643238', 'path': '/dev/sde'} {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 12:06:07 user nova-compute[74190]: DEBUG nova.objects.instance [None req-4a9f6a9e-ddce-42ad-b46f-820846076f0a tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lazy-loading 'flavor' on Instance uuid c0f8682a-6de5-459b-9843-bbe945fb329e {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:06:07 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-4a9f6a9e-ddce-42ad-b46f-820846076f0a tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] attach device xml: <disk type="block" device="disk">
Oct 18 12:06:07 user nova-compute[74190]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 12:06:07 user nova-compute[74190]:   <source dev="/dev/sde"/>
Oct 18 12:06:07 user nova-compute[74190]:   <target dev="vdb" bus="virtio"/>
Oct 18 12:06:07 user nova-compute[74190]:   <serial>a074b500-cda4-4ee2-be35-26ab58d09a54</serial>
Oct 18 12:06:07 user nova-compute[74190]: </disk>
Oct 18 12:06:07 user nova-compute[74190]:  {{(pid=74190) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 18 12:06:08 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-4a9f6a9e-ddce-42ad-b46f-820846076f0a tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] No BDM found with device name vda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 12:06:08 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-4a9f6a9e-ddce-42ad-b46f-820846076f0a tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 12:06:08 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-4a9f6a9e-ddce-42ad-b46f-820846076f0a tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] No VIF found with MAC fa:16:3e:a7:7b:dd, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 12:06:08 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-4a9f6a9e-ddce-42ad-b46f-820846076f0a tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "c0f8682a-6de5-459b-9843-bbe945fb329e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 41.170s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:06:09 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-be829aeb-6c48-4893-af99-f23f6cbd515b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Acquiring lock "c0f8682a-6de5-459b-9843-bbe945fb329e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:06:09 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-be829aeb-6c48-4893-af99-f23f6cbd515b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "c0f8682a-6de5-459b-9843-bbe945fb329e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:06:09 user nova-compute[74190]: INFO nova.compute.manager [None req-be829aeb-6c48-4893-af99-f23f6cbd515b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: c0f8682a-6de5-459b-9843-bbe945fb329e] Detaching volume a074b500-cda4-4ee2-be35-26ab58d09a54
Oct 18 12:06:09 user nova-compute[74190]: INFO nova.virt.block_device [None req-be829aeb-6c48-4893-af99-f23f6cbd515b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: c0f8682a-6de5-459b-9843-bbe945fb329e] Attempting to driver detach volume a074b500-cda4-4ee2-be35-26ab58d09a54 from mountpoint /dev/vdb
Oct 18 12:06:09 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-be829aeb-6c48-4893-af99-f23f6cbd515b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Attempting to detach device vdb from instance c0f8682a-6de5-459b-9843-bbe945fb329e from the persistent domain config. {{(pid=74190) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 18 12:06:09 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-be829aeb-6c48-4893-af99-f23f6cbd515b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 12:06:09 user nova-compute[74190]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 12:06:09 user nova-compute[74190]:   <source dev="/dev/sde"/>
Oct 18 12:06:09 user nova-compute[74190]:   <target dev="vdb" bus="virtio"/>
Oct 18 12:06:09 user nova-compute[74190]:   <serial>a074b500-cda4-4ee2-be35-26ab58d09a54</serial>
Oct 18 12:06:09 user nova-compute[74190]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 18 12:06:09 user nova-compute[74190]: </disk>
Oct 18 12:06:09 user nova-compute[74190]:  {{(pid=74190) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 12:06:09 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-be829aeb-6c48-4893-af99-f23f6cbd515b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Successfully detached device vdb from instance c0f8682a-6de5-459b-9843-bbe945fb329e from the persistent domain config.
Oct 18 12:06:09 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-be829aeb-6c48-4893-af99-f23f6cbd515b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c0f8682a-6de5-459b-9843-bbe945fb329e from the live domain config. {{(pid=74190) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 18 12:06:09 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-be829aeb-6c48-4893-af99-f23f6cbd515b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 12:06:09 user nova-compute[74190]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 12:06:09 user nova-compute[74190]:   <source dev="/dev/sde"/>
Oct 18 12:06:09 user nova-compute[74190]:   <target dev="vdb" bus="virtio"/>
Oct 18 12:06:09 user nova-compute[74190]:   <serial>a074b500-cda4-4ee2-be35-26ab58d09a54</serial>
Oct 18 12:06:09 user nova-compute[74190]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 18 12:06:09 user nova-compute[74190]: </disk>
Oct 18 12:06:09 user nova-compute[74190]:  {{(pid=74190) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 12:06:09 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-be829aeb-6c48-4893-af99-f23f6cbd515b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c0f8682a-6de5-459b-9843-bbe945fb329e {{(pid=74190) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 18 12:06:10 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:06:10 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:06:11 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Acquiring lock "1b169141-68f3-4a5a-ad03-d29c37d39f69" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:06:11 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "1b169141-68f3-4a5a-ad03-d29c37d39f69" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:06:11 user nova-compute[74190]: DEBUG nova.compute.manager [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 1b169141-68f3-4a5a-ad03-d29c37d39f69] Starting instance... {{(pid=74190) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 12:06:11 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:06:11 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:06:11 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74190) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 12:06:11 user nova-compute[74190]: INFO nova.compute.claims [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 1b169141-68f3-4a5a-ad03-d29c37d39f69] Claim successful on node user
Oct 18 12:06:12 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 12:06:12 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 12:06:12 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.526s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:06:12 user nova-compute[74190]: DEBUG nova.compute.manager [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 1b169141-68f3-4a5a-ad03-d29c37d39f69] Start building networks asynchronously for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 12:06:12 user nova-compute[74190]: DEBUG nova.compute.manager [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 1b169141-68f3-4a5a-ad03-d29c37d39f69] Allocating IP information in the background. {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 12:06:12 user nova-compute[74190]: DEBUG nova.network.neutron [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 1b169141-68f3-4a5a-ad03-d29c37d39f69] allocate_for_instance() {{(pid=74190) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 12:06:12 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 1b169141-68f3-4a5a-ad03-d29c37d39f69] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 12:06:12 user nova-compute[74190]: DEBUG nova.compute.manager [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 1b169141-68f3-4a5a-ad03-d29c37d39f69] Start building block device mappings for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 12:06:12 user nova-compute[74190]: DEBUG nova.policy [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '27d9fc244d0f4e10a43b7df4dc8e30ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e375153f6f24827811c5825fc2a2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74190) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 12:06:12 user nova-compute[74190]: INFO nova.virt.block_device [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 1b169141-68f3-4a5a-ad03-d29c37d39f69] Booting with volume snapshot 9f8562d6-447f-4e6c-a977-4604ae3d74c8 at /dev/vda
Oct 18 12:06:13 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:06:13 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Starting heal instance info cache {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 12:06:13 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "refresh_cache-772b126c-2148-4ca8-90f2-69d6eb4b7db7" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:06:13 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquired lock "refresh_cache-772b126c-2148-4ca8-90f2-69d6eb4b7db7" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:06:13 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 772b126c-2148-4ca8-90f2-69d6eb4b7db7] Forcefully refreshing network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 18 12:06:13 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:06:13 user nova-compute[74190]: DEBUG nova.network.neutron [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 1b169141-68f3-4a5a-ad03-d29c37d39f69] Successfully created port: bfe79254-95f6-4c3b-914e-85874a28731e {{(pid=74190) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 12:06:13 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 772b126c-2148-4ca8-90f2-69d6eb4b7db7] Updating instance_info_cache with network_info: [{"id": "5470a91d-fa0f-4018-afa9-8e0a604cfca3", "address": "fa:16:3e:aa:5e:3e", "network": {"id": "c2dbbd24-f1d2-47a2-835f-0f9b24b585f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-920140900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d994366010142519ff367fa7ca77e61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5470a91d-fa", "ovs_interfaceid": "5470a91d-fa0f-4018-afa9-8e0a604cfca3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:06:13 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Releasing lock "refresh_cache-772b126c-2148-4ca8-90f2-69d6eb4b7db7" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:06:13 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 772b126c-2148-4ca8-90f2-69d6eb4b7db7] Updated the network info_cache for instance {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 18 12:06:13 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:06:13 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74190) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 12:06:14 user nova-compute[74190]: DEBUG nova.network.neutron [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 1b169141-68f3-4a5a-ad03-d29c37d39f69] Successfully updated port: bfe79254-95f6-4c3b-914e-85874a28731e {{(pid=74190) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 12:06:14 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Acquiring lock "refresh_cache-1b169141-68f3-4a5a-ad03-d29c37d39f69" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:06:14 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Acquired lock "refresh_cache-1b169141-68f3-4a5a-ad03-d29c37d39f69" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:06:14 user nova-compute[74190]: DEBUG nova.network.neutron [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 1b169141-68f3-4a5a-ad03-d29c37d39f69] Building network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 12:06:14 user nova-compute[74190]: DEBUG nova.compute.manager [req-bb2ad41a-4912-40d2-955a-53794f6845ef req-845a9530-6b12-49b3-9edc-3e09ddf16bec service nova] [instance: 1b169141-68f3-4a5a-ad03-d29c37d39f69] Received event network-changed-bfe79254-95f6-4c3b-914e-85874a28731e {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:06:14 user nova-compute[74190]: DEBUG nova.compute.manager [req-bb2ad41a-4912-40d2-955a-53794f6845ef req-845a9530-6b12-49b3-9edc-3e09ddf16bec service nova] [instance: 1b169141-68f3-4a5a-ad03-d29c37d39f69] Refreshing instance network info cache due to event network-changed-bfe79254-95f6-4c3b-914e-85874a28731e. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 12:06:14 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-bb2ad41a-4912-40d2-955a-53794f6845ef req-845a9530-6b12-49b3-9edc-3e09ddf16bec service nova] Acquiring lock "refresh_cache-1b169141-68f3-4a5a-ad03-d29c37d39f69" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:06:14 user nova-compute[74190]: DEBUG nova.network.neutron [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 1b169141-68f3-4a5a-ad03-d29c37d39f69] Instance cache missing network info. {{(pid=74190) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 12:06:14 user nova-compute[74190]: DEBUG nova.network.neutron [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 1b169141-68f3-4a5a-ad03-d29c37d39f69] Updating instance_info_cache with network_info: [{"id": "bfe79254-95f6-4c3b-914e-85874a28731e", "address": "fa:16:3e:6b:cb:19", "network": {"id": "aa827f81-b165-444f-89cc-f21c42a9f772", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1659902586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e375153f6f24827811c5825fc2a2c6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfe79254-95", "ovs_interfaceid": "bfe79254-95f6-4c3b-914e-85874a28731e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:06:14 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Releasing lock "refresh_cache-1b169141-68f3-4a5a-ad03-d29c37d39f69" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:06:14 user nova-compute[74190]: DEBUG nova.compute.manager [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 1b169141-68f3-4a5a-ad03-d29c37d39f69] Instance network_info: |[{"id": "bfe79254-95f6-4c3b-914e-85874a28731e", "address": "fa:16:3e:6b:cb:19", "network": {"id": "aa827f81-b165-444f-89cc-f21c42a9f772", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1659902586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e375153f6f24827811c5825fc2a2c6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfe79254-95", "ovs_interfaceid": "bfe79254-95f6-4c3b-914e-85874a28731e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 12:06:14 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-bb2ad41a-4912-40d2-955a-53794f6845ef req-845a9530-6b12-49b3-9edc-3e09ddf16bec service nova] Acquired lock "refresh_cache-1b169141-68f3-4a5a-ad03-d29c37d39f69" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:06:14 user nova-compute[74190]: DEBUG nova.network.neutron [req-bb2ad41a-4912-40d2-955a-53794f6845ef req-845a9530-6b12-49b3-9edc-3e09ddf16bec service nova] [instance: 1b169141-68f3-4a5a-ad03-d29c37d39f69] Refreshing network info cache for port bfe79254-95f6-4c3b-914e-85874a28731e {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 12:06:14 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:06:14 user nova-compute[74190]: DEBUG nova.network.neutron [req-bb2ad41a-4912-40d2-955a-53794f6845ef req-845a9530-6b12-49b3-9edc-3e09ddf16bec service nova] [instance: 1b169141-68f3-4a5a-ad03-d29c37d39f69] Updated VIF entry in instance network info cache for port bfe79254-95f6-4c3b-914e-85874a28731e. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 12:06:14 user nova-compute[74190]: DEBUG nova.network.neutron [req-bb2ad41a-4912-40d2-955a-53794f6845ef req-845a9530-6b12-49b3-9edc-3e09ddf16bec service nova] [instance: 1b169141-68f3-4a5a-ad03-d29c37d39f69] Updating instance_info_cache with network_info: [{"id": "bfe79254-95f6-4c3b-914e-85874a28731e", "address": "fa:16:3e:6b:cb:19", "network": {"id": "aa827f81-b165-444f-89cc-f21c42a9f772", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1659902586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e375153f6f24827811c5825fc2a2c6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfe79254-95", "ovs_interfaceid": "bfe79254-95f6-4c3b-914e-85874a28731e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:06:14 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-bb2ad41a-4912-40d2-955a-53794f6845ef req-845a9530-6b12-49b3-9edc-3e09ddf16bec service nova] Releasing lock "refresh_cache-1b169141-68f3-4a5a-ad03-d29c37d39f69" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:06:15 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:06:15 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:06:16 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:06:17 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:06:17 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:06:17 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:06:17 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:06:17 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:06:17 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Auditing locally available compute resources for user (node: user) {{(pid=74190) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 12:06:17 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f59adf3-9728-4d5b-87d5-2ad32c99d06e/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:06:17 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f59adf3-9728-4d5b-87d5-2ad32c99d06e/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:06:17 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f59adf3-9728-4d5b-87d5-2ad32c99d06e/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:06:17 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f59adf3-9728-4d5b-87d5-2ad32c99d06e/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:06:17 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f79a267-5bc8-4fa0-9e3a-4706fa1da142/disk.rescue --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:06:17 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f79a267-5bc8-4fa0-9e3a-4706fa1da142/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:06:17 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f79a267-5bc8-4fa0-9e3a-4706fa1da142/disk.rescue --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:06:17 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f79a267-5bc8-4fa0-9e3a-4706fa1da142/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:06:17 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /opt/stack/data/nova/instances/7f79a267-5bc8-4fa0-9e3a-4706fa1da142/disk (vdb) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 12:06:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:06:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:06:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:06:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:06:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1e27a16-43e4-4e80-9c0a-5c2dce06daae/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:06:18 user nova-compute[74190]: DEBUG os_brick.utils [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 12:06:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:06:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:06:18 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa2f5660-b1ff-45d1-872d-4b3b73b4d908]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cff158e257e1\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:06:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:06:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:06:18 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[af881343-bb03-4083-83ee-b1fc9b966e34]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:06:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:06:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:06:18 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced54f18-e26e-40b9-84ed-22b09512165c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:06:18 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[12668c0b-4df3-431a-bee7-812b0518e55c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:06:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Running cmd (subprocess): nvme version {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:06:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] 'nvme version' failed. Not Retrying. {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 12:06:18 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.nvmeof [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] nvme not present on system {{(pid=74190) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 12:06:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:06:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 12:06:18 user nova-compute[74190]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 12:06:18 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a08a1a7-5ddf-4cfc-9780-78648c04c69d]: (4, '') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:06:18 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74190) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 12:06:18 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 12:06:18 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] LIGHTOS: no hostnqn found. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 12:06:18 user nova-compute[74190]: DEBUG os_brick.utils [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cff158e257e1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 12:06:18 user nova-compute[74190]: DEBUG nova.virt.block_device [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 1b169141-68f3-4a5a-ad03-d29c37d39f69] Updating existing volume attachment record: ad3f1014-2464-4daa-a201-725b32ee3a9b {{(pid=74190) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 12:06:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1e27a16-43e4-4e80-9c0a-5c2dce06daae/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:06:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1e27a16-43e4-4e80-9c0a-5c2dce06daae/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:06:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1e27a16-43e4-4e80-9c0a-5c2dce06daae/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:06:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:06:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:06:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:06:19 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:06:19 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f8682a-6de5-459b-9843-bbe945fb329e/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:06:19 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f8682a-6de5-459b-9843-bbe945fb329e/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:06:19 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f8682a-6de5-459b-9843-bbe945fb329e/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:06:19 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f8682a-6de5-459b-9843-bbe945fb329e/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:06:19 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:06:19 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:06:19 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:06:19 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:06:19 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 12:06:19 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk.rescue --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:06:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:06:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk.rescue --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:06:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk.rescue --force-share --output=json" returned: 0 in 0.209s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:06:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:06:20 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:06:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:06:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:06:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:06:20 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 12:06:21 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:06:21 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:06:21 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Hypervisor/Node resource view: name=user free_ram=8005MB free_disk=24.985565185546875GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74190) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 12:06:21 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:06:21 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:06:21 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 4e916d24-9f9d-4289-87ce-f65d2499fcd9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:06:21 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 95ca0697-22b5-4109-868f-ca5556015a1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:06:21 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 42413a94-9973-4e8d-83b6-207a4e7847c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:06:21 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 772b126c-2148-4ca8-90f2-69d6eb4b7db7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:06:21 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 0382820d-a678-4593-85df-168f42fc4ce4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:06:21 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 2f59adf3-9728-4d5b-87d5-2ad32c99d06e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:06:21 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 7f79a267-5bc8-4fa0-9e3a-4706fa1da142 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:06:21 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance c0f8682a-6de5-459b-9843-bbe945fb329e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:06:21 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance b1e27a16-43e4-4e80-9c0a-5c2dce06daae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:06:21 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 1b169141-68f3-4a5a-ad03-d29c37d39f69 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:06:21 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 12:06:21 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 12:06:21 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 12:06:21 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 12:06:21 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Compute_service record updated for user:user {{(pid=74190) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 12:06:21 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.533s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:06:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:06:25 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:06:26 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:06:29 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-be829aeb-6c48-4893-af99-f23f6cbd515b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c0f8682a-6de5-459b-9843-bbe945fb329e is timed out.
Oct 18 12:06:29 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-be829aeb-6c48-4893-af99-f23f6cbd515b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Successfully detached device vdb from instance c0f8682a-6de5-459b-9843-bbe945fb329e from the live domain config.
Oct 18 12:06:29 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be829aeb-6c48-4893-af99-f23f6cbd515b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: c0f8682a-6de5-459b-9843-bbe945fb329e] calling os-brick to detach iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 12:06:29 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-be829aeb-6c48-4893-af99-f23f6cbd515b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, {'target_iqn': 'iqn.2010-10.org.openstack:a074b500-cda4-4ee2-be35-26ab58d09a54', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jWYThlFu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 12:06:29 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-be829aeb-6c48-4893-af99-f23f6cbd515b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 12:06:29 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-be829aeb-6c48-4893-af99-f23f6cbd515b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 12:06:29 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-be829aeb-6c48-4893-af99-f23f6cbd515b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 12:06:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:06:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:06:29 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e85106-86ce-4596-b008-2b812ee49417]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a074b500-cda4-4ee2-be35-26ab58d09a54\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:06:29 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-be829aeb-6c48-4893-af99-f23f6cbd515b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 12:06:29 user nova-compute[74190]: No targets found.
Oct 18 12:06:29 user nova-compute[74190]: iSNS:
Oct 18 12:06:29 user nova-compute[74190]: No targets found.
Oct 18 12:06:29 user nova-compute[74190]: STATIC:
Oct 18 12:06:29 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f
Oct 18 12:06:29 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 12:06:29 user nova-compute[74190]:                 Iface Name: default
Oct 18 12:06:29 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa
Oct 18 12:06:29 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 12:06:29 user nova-compute[74190]:                 Iface Name: default
Oct 18 12:06:29 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:a074b500-cda4-4ee2-be35-26ab58d09a54
Oct 18 12:06:29 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 12:06:29 user nova-compute[74190]:                 Iface Name: default
Oct 18 12:06:29 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f
Oct 18 12:06:29 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 12:06:29 user nova-compute[74190]:                 Iface Name: default
Oct 18 12:06:29 user nova-compute[74190]: FIRMWARE:
Oct 18 12:06:29 user nova-compute[74190]: No targets found.
Oct 18 12:06:29 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 12:06:29 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-be829aeb-6c48-4893-af99-f23f6cbd515b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 12:06:29 user nova-compute[74190]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 12:06:29 user nova-compute[74190]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74190) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 12:06:29 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-be829aeb-6c48-4893-af99-f23f6cbd515b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a074b500-cda4-4ee2-be35-26ab58d09a54', 0)] {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 12:06:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:06:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:06:29 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[c75241a6-302f-4166-a36f-00704a9bc8b2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a074b500-cda4-4ee2-be35-26ab58d09a54\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:06:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:06:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:06:29 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[5be4fa72-0083-41df-a953-73a5697c4410]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a074b500-cda4-4ee2-be35-26ab58d09a54 (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:06:29 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-be829aeb-6c48-4893-af99-f23f6cbd515b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 12:06:29 user nova-compute[74190]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)
Oct 18 12:06:29 user nova-compute[74190]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f (non-flash)
Oct 18 12:06:29 user nova-compute[74190]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a074b500-cda4-4ee2-be35-26ab58d09a54 (non-flash)
Oct 18 12:06:29 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 12:06:29 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-be829aeb-6c48-4893-af99-f23f6cbd515b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 12:06:29 user nova-compute[74190]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)
Oct 18 12:06:29 user nova-compute[74190]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f (non-flash)
Oct 18 12:06:29 user nova-compute[74190]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a074b500-cda4-4ee2-be35-26ab58d09a54 (non-flash)
Oct 18 12:06:29 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 12:06:29 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-be829aeb-6c48-4893-af99-f23f6cbd515b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1f5e7c2320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a074b500-cda4-4ee2-be35-26ab58d09a54'): ({'sde'}, set())}) {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 12:06:29 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-be829aeb-6c48-4893-af99-f23f6cbd515b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Removing single pathed devices sde {{(pid=74190) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 12:06:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:06:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:06:29 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[68c1280c-b04e-440b-bea2-d1ec7eb07a91]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:06:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:06:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:06:29 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[078dde0e-d62e-45b2-b91b-cdc9cca13ed9]: (4, ('ok\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:06:29 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-be829aeb-6c48-4893-af99-f23f6cbd515b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Flushing IO for device /dev/sde {{(pid=74190) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 12:06:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:06:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:06:29 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[964f1f48-26ee-44a6-93cb-ddfa7ba73b9c]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:06:29 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-be829aeb-6c48-4893-af99-f23f6cbd515b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74190) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 12:06:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:06:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.047s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:06:29 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf8e2f59-05d5-418e-8948-9d7bddce13db]: (4, ('1', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:06:29 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-be829aeb-6c48-4893-af99-f23f6cbd515b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 12:06:29 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-be829aeb-6c48-4893-af99-f23f6cbd515b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] SCSI volumes sde have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 12:06:29 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-be829aeb-6c48-4893-af99-f23f6cbd515b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a074b500-cda4-4ee2-be35-26ab58d09a54')] {{(pid=74190) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 12:06:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a074b500-cda4-4ee2-be35-26ab58d09a54 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:06:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a074b500-cda4-4ee2-be35-26ab58d09a54 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:06:29 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c2e8ec-782a-4015-b4f0-fedfa0137627]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:06:29 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-be829aeb-6c48-4893-af99-f23f6cbd515b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:06:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a074b500-cda4-4ee2-be35-26ab58d09a54 -p 172.16.0.220:3260 --logout {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:06:30 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a074b500-cda4-4ee2-be35-26ab58d09a54 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:06:30 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae6bfc7-a290-4b35-9ed8-68aabc0b2e53]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:a074b500-cda4-4ee2-be35-26ab58d09a54, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:a074b500-cda4-4ee2-be35-26ab58d09a54, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:06:30 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-be829aeb-6c48-4893-af99-f23f6cbd515b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:a074b500-cda4-4ee2-be35-26ab58d09a54, portal: 172.16.0.220,3260]
Oct 18 12:06:30 user nova-compute[74190]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:a074b500-cda4-4ee2-be35-26ab58d09a54, portal: 172.16.0.220,3260] successful.
Oct 18 12:06:30 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:06:30 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a074b500-cda4-4ee2-be35-26ab58d09a54 -p 172.16.0.220:3260 --op delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:06:30 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a074b500-cda4-4ee2-be35-26ab58d09a54 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:06:30 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[b87c9901-ebd0-4d27-9659-670b08816199]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:06:30 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-be829aeb-6c48-4893-af99-f23f6cbd515b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:06:30 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-be829aeb-6c48-4893-af99-f23f6cbd515b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.362s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 12:06:30 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-be829aeb-6c48-4893-af99-f23f6cbd515b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] <== disconnect_volume: return (363ms) None {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 12:06:30 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be829aeb-6c48-4893-af99-f23f6cbd515b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: c0f8682a-6de5-459b-9843-bbe945fb329e] Disconnected iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 12:06:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:06:31 user nova-compute[74190]: DEBUG nova.objects.instance [None req-be829aeb-6c48-4893-af99-f23f6cbd515b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lazy-loading 'flavor' on Instance uuid c0f8682a-6de5-459b-9843-bbe945fb329e {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:06:31 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-be829aeb-6c48-4893-af99-f23f6cbd515b tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "c0f8682a-6de5-459b-9843-bbe945fb329e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.928s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:06:32 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-926dbb9b-1de9-4555-a716-08fc8f39e907 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Acquiring lock "2f59adf3-9728-4d5b-87d5-2ad32c99d06e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:06:32 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-926dbb9b-1de9-4555-a716-08fc8f39e907 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Lock "2f59adf3-9728-4d5b-87d5-2ad32c99d06e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:06:32 user nova-compute[74190]: DEBUG nova.objects.instance [None req-926dbb9b-1de9-4555-a716-08fc8f39e907 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Lazy-loading 'flavor' on Instance uuid 2f59adf3-9728-4d5b-87d5-2ad32c99d06e {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:06:32 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-926dbb9b-1de9-4555-a716-08fc8f39e907 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Lock "2f59adf3-9728-4d5b-87d5-2ad32c99d06e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:06:32 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-926dbb9b-1de9-4555-a716-08fc8f39e907 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Acquiring lock "2f59adf3-9728-4d5b-87d5-2ad32c99d06e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:06:32 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-926dbb9b-1de9-4555-a716-08fc8f39e907 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Lock "2f59adf3-9728-4d5b-87d5-2ad32c99d06e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:06:32 user nova-compute[74190]: INFO nova.compute.manager [None req-926dbb9b-1de9-4555-a716-08fc8f39e907 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] Attaching volume 36ae588d-1fe5-490e-99ab-226c6e9dcf25 to /dev/vdb
Oct 18 12:06:32 user nova-compute[74190]: DEBUG os_brick.utils [None req-926dbb9b-1de9-4555-a716-08fc8f39e907 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 12:06:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:06:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:06:32 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c321638-1267-4adb-88f6-3d1228b1396f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cff158e257e1\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:06:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:06:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:06:32 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d4a8902-72a5-4990-8592-cf0f75a799a0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:06:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:06:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:06:32 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[7249ff4a-ac91-4608-8f0b-00befd429b11]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:06:32 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[80be7196-7abf-4c01-82f5-8b9ec9e2aa5f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:06:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-926dbb9b-1de9-4555-a716-08fc8f39e907 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Running cmd (subprocess): nvme version {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:06:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-926dbb9b-1de9-4555-a716-08fc8f39e907 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] 'nvme version' failed. Not Retrying. {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 12:06:32 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.nvmeof [None req-926dbb9b-1de9-4555-a716-08fc8f39e907 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] nvme not present on system {{(pid=74190) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 12:06:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:06:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 12:06:32 user nova-compute[74190]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 12:06:32 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[0edb0d0f-3350-4858-b378-603d04a81933]: (4, '') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:06:32 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-926dbb9b-1de9-4555-a716-08fc8f39e907 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74190) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 12:06:32 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-926dbb9b-1de9-4555-a716-08fc8f39e907 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 12:06:32 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-926dbb9b-1de9-4555-a716-08fc8f39e907 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] LIGHTOS: no hostnqn found. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 12:06:32 user nova-compute[74190]: DEBUG os_brick.utils [None req-926dbb9b-1de9-4555-a716-08fc8f39e907 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cff158e257e1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 12:06:32 user nova-compute[74190]: DEBUG nova.virt.block_device [None req-926dbb9b-1de9-4555-a716-08fc8f39e907 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] Updating existing volume attachment record: ce2747dd-58cb-4d50-9130-3c586bcea03d {{(pid=74190) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 12:06:33 user nova-compute[74190]: DEBUG nova.compute.manager [None req-0067cec9-51a6-4dc9-aef0-c26dccddd919 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: b1e27a16-43e4-4e80-9c0a-5c2dce06daae] Checking state {{(pid=74190) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 12:06:33 user nova-compute[74190]: INFO nova.compute.manager [None req-0067cec9-51a6-4dc9-aef0-c26dccddd919 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: b1e27a16-43e4-4e80-9c0a-5c2dce06daae] instance snapshotting
Oct 18 12:06:33 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-0067cec9-51a6-4dc9-aef0-c26dccddd919 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: b1e27a16-43e4-4e80-9c0a-5c2dce06daae] Beginning live snapshot process
Oct 18 12:06:33 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-0067cec9-51a6-4dc9-aef0-c26dccddd919 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1e27a16-43e4-4e80-9c0a-5c2dce06daae/disk --force-share --output=json -f qcow2 {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:06:34 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-0067cec9-51a6-4dc9-aef0-c26dccddd919 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1e27a16-43e4-4e80-9c0a-5c2dce06daae/disk --force-share --output=json -f qcow2" returned: 0 in 0.177s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:06:34 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-0067cec9-51a6-4dc9-aef0-c26dccddd919 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1e27a16-43e4-4e80-9c0a-5c2dce06daae/disk --force-share --output=json -f qcow2 {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:06:34 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-0067cec9-51a6-4dc9-aef0-c26dccddd919 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1e27a16-43e4-4e80-9c0a-5c2dce06daae/disk --force-share --output=json -f qcow2" returned: 0 in 0.238s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:06:34 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-0067cec9-51a6-4dc9-aef0-c26dccddd919 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:06:34 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-0067cec9-51a6-4dc9-aef0-c26dccddd919 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.175s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:06:34 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-0067cec9-51a6-4dc9-aef0-c26dccddd919 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpg11ffk97/4e187d5d567f4c9c8a7b77d04068abbb.delta 1073741824 {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:06:34 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-0067cec9-51a6-4dc9-aef0-c26dccddd919 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpg11ffk97/4e187d5d567f4c9c8a7b77d04068abbb.delta 1073741824" returned: 0 in 0.058s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:06:34 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-0067cec9-51a6-4dc9-aef0-c26dccddd919 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: b1e27a16-43e4-4e80-9c0a-5c2dce06daae] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 18 12:06:35 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-0067cec9-51a6-4dc9-aef0-c26dccddd919 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74190) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 18 12:06:35 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:06:35 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:06:35 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-0067cec9-51a6-4dc9-aef0-c26dccddd919 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74190) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 18 12:06:35 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-0067cec9-51a6-4dc9-aef0-c26dccddd919 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: b1e27a16-43e4-4e80-9c0a-5c2dce06daae] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 18 12:06:35 user nova-compute[74190]: DEBUG nova.privsep.utils [None req-0067cec9-51a6-4dc9-aef0-c26dccddd919 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74190) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 18 12:06:35 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-0067cec9-51a6-4dc9-aef0-c26dccddd919 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpg11ffk97/4e187d5d567f4c9c8a7b77d04068abbb.delta /opt/stack/data/nova/instances/snapshots/tmpg11ffk97/4e187d5d567f4c9c8a7b77d04068abbb {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:06:36 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-0067cec9-51a6-4dc9-aef0-c26dccddd919 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpg11ffk97/4e187d5d567f4c9c8a7b77d04068abbb.delta /opt/stack/data/nova/instances/snapshots/tmpg11ffk97/4e187d5d567f4c9c8a7b77d04068abbb" returned: 0 in 0.550s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:06:36 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-0067cec9-51a6-4dc9-aef0-c26dccddd919 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: b1e27a16-43e4-4e80-9c0a-5c2dce06daae] Snapshot extracted, beginning image upload
Oct 18 12:06:36 user nova-compute[74190]: DEBUG nova.compute.manager [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 1b169141-68f3-4a5a-ad03-d29c37d39f69] Start spawning the instance on the hypervisor. {{(pid=74190) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 12:06:36 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 1b169141-68f3-4a5a-ad03-d29c37d39f69] Creating instance directory {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 12:06:36 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 1b169141-68f3-4a5a-ad03-d29c37d39f69] Creating image(s)
Oct 18 12:06:36 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 1b169141-68f3-4a5a-ad03-d29c37d39f69] Did not create local disks {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 18 12:06:36 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 1b169141-68f3-4a5a-ad03-d29c37d39f69] Ensure instance console log exists: /opt/stack/data/nova/instances/1b169141-68f3-4a5a-ad03-d29c37d39f69/console.log {{(pid=74190) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 12:06:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:06:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:06:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:06:36 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 1b169141-68f3-4a5a-ad03-d29c37d39f69] Start _get_guest_xml network_info=[{"id": "bfe79254-95f6-4c3b-914e-85874a28731e", "address": "fa:16:3e:6b:cb:19", "network": {"id": "aa827f81-b165-444f-89cc-f21c42a9f772", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1659902586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e375153f6f24827811c5825fc2a2c6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfe79254-95", "ovs_interfaceid": "bfe79254-95f6-4c3b-914e-85874a28731e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2e780d69-215f-42df-9312-69b207f13eb7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ELFzChrT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1b169141-68f3-4a5a-ad03-d29c37d39f69', 'attached_at': '', 'detached_at': '', 'volume_id': '2e780d69-215f-42df-9312-69b207f13eb7', 'serial': '2e780d69-215f-42df-9312-69b207f13eb7'}, 'delete_on_termination': True, 'guest_format': None, 'attachment_id': 'ad3f1014-2464-4daa-a201-725b32ee3a9b', 'volume_type': None} {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 12:06:36 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:06:36 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:06:36 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 12:06:36 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] CPU controller missing on host. {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 12:06:36 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 12:06:36 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] CPU controller found on host. {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 12:06:36 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74190) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 12:06:36 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T11:37:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 12:06:36 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Flavor limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 12:06:36 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Image limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 12:06:36 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Flavor pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 12:06:36 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Image pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 12:06:36 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 12:06:36 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 12:06:36 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 12:06:36 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Got 1 possible topologies {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 12:06:36 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 12:06:36 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 12:06:37 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 1b169141-68f3-4a5a-ad03-d29c37d39f69] Calling os-brick to attach iSCSI Volume {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 12:06:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2e780d69-215f-42df-9312-69b207f13eb7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ELFzChrT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 12:06:37 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 12:06:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 12:06:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 12:06:37 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 12:06:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e780d69-215f-42df-9312-69b207f13eb7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 12:06:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e780d69-215f-42df-9312-69b207f13eb7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 12:06:37 user nova-compute[74190]: INFO os_brick.initiator.connectors.iscsi [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 12:06:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e780d69-215f-42df-9312-69b207f13eb7 -p 172.16.0.220:3260 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:06:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e780d69-215f-42df-9312-69b207f13eb7 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:06:37 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7d4f5ca-1d25-414b-a682-c687d3b35602]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:06:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 12:06:37 user nova-compute[74190]:  {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:06:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e780d69-215f-42df-9312-69b207f13eb7 -p 172.16.0.220:3260 --interface default --op new {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:06:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e780d69-215f-42df-9312-69b207f13eb7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:06:37 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb340b1-368f-49b5-917f-383fa4dce077]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2e780d69-215f-42df-9312-69b207f13eb7] added\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:06:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2e780d69-215f-42df-9312-69b207f13eb7] added
Oct 18 12:06:37 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:06:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e780d69-215f-42df-9312-69b207f13eb7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:06:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e780d69-215f-42df-9312-69b207f13eb7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:06:37 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d110a1-6192-4c47-93b8-5a52cc3ebe4f]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:06:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:06:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e780d69-215f-42df-9312-69b207f13eb7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:06:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e780d69-215f-42df-9312-69b207f13eb7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:06:37 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fedbe56-b594-4470-8e6a-a38f4b7b599c]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:06:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:06:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e780d69-215f-42df-9312-69b207f13eb7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ELFzChrT {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:06:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e780d69-215f-42df-9312-69b207f13eb7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ELFzChrT" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:06:37 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[8346d23a-f0b0-4276-8e02-b2421df27f5e]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:06:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ELFzChrT'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:06:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e780d69-215f-42df-9312-69b207f13eb7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:06:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e780d69-215f-42df-9312-69b207f13eb7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:06:37 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f48bf73-0282-4c5e-9de8-2dc1a6f5672e]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:06:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:06:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:06:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:06:37 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[1593c377-988f-47db-b094-b8b9be6726b4]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:06:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 12:06:37 user nova-compute[74190]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)
Oct 18 12:06:37 user nova-compute[74190]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f (non-flash)
Oct 18 12:06:37 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 12:06:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 12:06:37 user nova-compute[74190]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)
Oct 18 12:06:37 user nova-compute[74190]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f (non-flash)
Oct 18 12:06:37 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 12:06:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e780d69-215f-42df-9312-69b207f13eb7 -p 172.16.0.220:3260 --login {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:06:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e780d69-215f-42df-9312-69b207f13eb7 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:06:37 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[285012be-af57-43be-97f5-689f4bdfd141]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2e780d69-215f-42df-9312-69b207f13eb7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2e780d69-215f-42df-9312-69b207f13eb7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:06:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2e780d69-215f-42df-9312-69b207f13eb7, portal: 172.16.0.220,3260]
Oct 18 12:06:37 user nova-compute[74190]: Login to [iface: default, target: iqn.2010-10.org.openstack:2e780d69-215f-42df-9312-69b207f13eb7, portal: 172.16.0.220,3260] successful.
Oct 18 12:06:37 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:06:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e780d69-215f-42df-9312-69b207f13eb7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:06:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e780d69-215f-42df-9312-69b207f13eb7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:06:37 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[c814c418-a2db-43d4-ab7c-732e082b81e7]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:06:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:06:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:06:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:06:37 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e1d6b8-1900-472f-9a2c-72f31ab74f60]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e780d69-215f-42df-9312-69b207f13eb7 (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:06:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 12:06:37 user nova-compute[74190]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)
Oct 18 12:06:37 user nova-compute[74190]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f (non-flash)
Oct 18 12:06:37 user nova-compute[74190]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e780d69-215f-42df-9312-69b207f13eb7 (non-flash)
Oct 18 12:06:37 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 12:06:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 12:06:37 user nova-compute[74190]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)
Oct 18 12:06:37 user nova-compute[74190]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f (non-flash)
Oct 18 12:06:37 user nova-compute[74190]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e780d69-215f-42df-9312-69b207f13eb7 (non-flash)
Oct 18 12:06:37 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 12:06:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e780d69-215f-42df-9312-69b207f13eb7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 12:06:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Connected to 172.16.0.220:3260 {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 12:06:37 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] HCTL ('36', '-', '-', 0) found on session 44 with lun 0 {{(pid=74190) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 12:06:37 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74190) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 12:06:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:06:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:06:37 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f76a79c-c662-4d75-85d7-66e13065720f]: (4, ('- - 0', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:06:37 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Searching for a device in session 44 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74190) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 12:06:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:2e780d69-215f-42df-9312-69b207f13eb7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ELFzChrT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 12:06:38 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 12:06:38 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '23463383837396136', 'path': '/dev/sde'} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 12:06:38 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 1b169141-68f3-4a5a-ad03-d29c37d39f69] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23463383837396136', 'path': '/dev/sde'} {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 12:06:38 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T12:06:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1120029390',display_name='tempest-TestVolumeBootPattern-server-1120029390',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1120029390',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e375153f6f24827811c5825fc2a2c6a',ramdisk_id='',reservation_id='r-0irby1jy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1157442382',owner_user_name='tempest-TestVolumeBootPattern-1157442382-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T12:06:13Z,user_data=None,user_id='27d9fc244d0f4e10a43b7df4dc8e30ad',uuid=1b169141-68f3-4a5a-ad03-d29c37d39f69,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bfe79254-95f6-4c3b-914e-85874a28731e", "address": "fa:16:3e:6b:cb:19", "network": {"id": "aa827f81-b165-444f-89cc-f21c42a9f772", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1659902586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e375153f6f24827811c5825fc2a2c6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfe79254-95", "ovs_interfaceid": "bfe79254-95f6-4c3b-914e-85874a28731e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74190) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 12:06:38 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Converting VIF {"id": "bfe79254-95f6-4c3b-914e-85874a28731e", "address": "fa:16:3e:6b:cb:19", "network": {"id": "aa827f81-b165-444f-89cc-f21c42a9f772", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1659902586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e375153f6f24827811c5825fc2a2c6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfe79254-95", "ovs_interfaceid": "bfe79254-95f6-4c3b-914e-85874a28731e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 12:06:38 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:cb:19,bridge_name='br-int',has_traffic_filtering=True,id=bfe79254-95f6-4c3b-914e-85874a28731e,network=Network(aa827f81-b165-444f-89cc-f21c42a9f772),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfe79254-95') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 12:06:38 user nova-compute[74190]: DEBUG nova.objects.instance [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lazy-loading 'pci_devices' on Instance uuid 1b169141-68f3-4a5a-ad03-d29c37d39f69 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:06:38 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 1b169141-68f3-4a5a-ad03-d29c37d39f69] End _get_guest_xml xml=<domain type="kvm">
Oct 18 12:06:38 user nova-compute[74190]:   <uuid>1b169141-68f3-4a5a-ad03-d29c37d39f69</uuid>
Oct 18 12:06:38 user nova-compute[74190]:   <name>instance-00000027</name>
Oct 18 12:06:38 user nova-compute[74190]:   <memory>524288</memory>
Oct 18 12:06:38 user nova-compute[74190]:   <vcpu>1</vcpu>
Oct 18 12:06:38 user nova-compute[74190]:   <metadata>
Oct 18 12:06:38 user nova-compute[74190]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 12:06:38 user nova-compute[74190]:       <nova:package version="0.0.0"/>
Oct 18 12:06:38 user nova-compute[74190]:       <nova:name>tempest-TestVolumeBootPattern-server-1120029390</nova:name>
Oct 18 12:06:38 user nova-compute[74190]:       <nova:creationTime>2023-10-18 12:06:36</nova:creationTime>
Oct 18 12:06:38 user nova-compute[74190]:       <nova:flavor name="m1.tiny">
Oct 18 12:06:38 user nova-compute[74190]:         <nova:memory>512</nova:memory>
Oct 18 12:06:38 user nova-compute[74190]:         <nova:disk>1</nova:disk>
Oct 18 12:06:38 user nova-compute[74190]:         <nova:swap>0</nova:swap>
Oct 18 12:06:38 user nova-compute[74190]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 12:06:38 user nova-compute[74190]:         <nova:vcpus>1</nova:vcpus>
Oct 18 12:06:38 user nova-compute[74190]:       </nova:flavor>
Oct 18 12:06:38 user nova-compute[74190]:       <nova:owner>
Oct 18 12:06:38 user nova-compute[74190]:         <nova:user uuid="27d9fc244d0f4e10a43b7df4dc8e30ad">tempest-TestVolumeBootPattern-1157442382-project-member</nova:user>
Oct 18 12:06:38 user nova-compute[74190]:         <nova:project uuid="1e375153f6f24827811c5825fc2a2c6a">tempest-TestVolumeBootPattern-1157442382</nova:project>
Oct 18 12:06:38 user nova-compute[74190]:       </nova:owner>
Oct 18 12:06:38 user nova-compute[74190]:       <nova:ports>
Oct 18 12:06:38 user nova-compute[74190]:         <nova:port uuid="bfe79254-95f6-4c3b-914e-85874a28731e">
Oct 18 12:06:38 user nova-compute[74190]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 18 12:06:38 user nova-compute[74190]:         </nova:port>
Oct 18 12:06:38 user nova-compute[74190]:       </nova:ports>
Oct 18 12:06:38 user nova-compute[74190]:     </nova:instance>
Oct 18 12:06:38 user nova-compute[74190]:   </metadata>
Oct 18 12:06:38 user nova-compute[74190]:   <sysinfo type="smbios">
Oct 18 12:06:38 user nova-compute[74190]:     <system>
Oct 18 12:06:38 user nova-compute[74190]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 12:06:38 user nova-compute[74190]:       <entry name="product">OpenStack Nova</entry>
Oct 18 12:06:38 user nova-compute[74190]:       <entry name="version">0.0.0</entry>
Oct 18 12:06:38 user nova-compute[74190]:       <entry name="serial">1b169141-68f3-4a5a-ad03-d29c37d39f69</entry>
Oct 18 12:06:38 user nova-compute[74190]:       <entry name="uuid">1b169141-68f3-4a5a-ad03-d29c37d39f69</entry>
Oct 18 12:06:38 user nova-compute[74190]:       <entry name="family">Virtual Machine</entry>
Oct 18 12:06:38 user nova-compute[74190]:     </system>
Oct 18 12:06:38 user nova-compute[74190]:   </sysinfo>
Oct 18 12:06:38 user nova-compute[74190]:   <os>
Oct 18 12:06:38 user nova-compute[74190]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 12:06:38 user nova-compute[74190]:     <boot dev="hd"/>
Oct 18 12:06:38 user nova-compute[74190]:     <smbios mode="sysinfo"/>
Oct 18 12:06:38 user nova-compute[74190]:   </os>
Oct 18 12:06:38 user nova-compute[74190]:   <features>
Oct 18 12:06:38 user nova-compute[74190]:     <acpi/>
Oct 18 12:06:38 user nova-compute[74190]:     <apic/>
Oct 18 12:06:38 user nova-compute[74190]:     <vmcoreinfo/>
Oct 18 12:06:38 user nova-compute[74190]:   </features>
Oct 18 12:06:38 user nova-compute[74190]:   <clock offset="utc">
Oct 18 12:06:38 user nova-compute[74190]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 12:06:38 user nova-compute[74190]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 12:06:38 user nova-compute[74190]:     <timer name="hpet" present="no"/>
Oct 18 12:06:38 user nova-compute[74190]:   </clock>
Oct 18 12:06:38 user nova-compute[74190]:   <cpu mode="custom" match="exact">
Oct 18 12:06:38 user nova-compute[74190]:     <model>Nehalem</model>
Oct 18 12:06:38 user nova-compute[74190]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 12:06:38 user nova-compute[74190]:   </cpu>
Oct 18 12:06:38 user nova-compute[74190]:   <devices>
Oct 18 12:06:38 user nova-compute[74190]:     <disk type="block" device="disk">
Oct 18 12:06:38 user nova-compute[74190]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 12:06:38 user nova-compute[74190]:       <source dev="/dev/sde"/>
Oct 18 12:06:38 user nova-compute[74190]:       <target dev="vda" bus="virtio"/>
Oct 18 12:06:38 user nova-compute[74190]:       <serial>2e780d69-215f-42df-9312-69b207f13eb7</serial>
Oct 18 12:06:38 user nova-compute[74190]:     </disk>
Oct 18 12:06:38 user nova-compute[74190]:     <interface type="ethernet">
Oct 18 12:06:38 user nova-compute[74190]:       <mac address="fa:16:3e:6b:cb:19"/>
Oct 18 12:06:38 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 12:06:38 user nova-compute[74190]:       <mtu size="1442"/>
Oct 18 12:06:38 user nova-compute[74190]:       <target dev="tapbfe79254-95"/>
Oct 18 12:06:38 user nova-compute[74190]:     </interface>
Oct 18 12:06:38 user nova-compute[74190]:     <serial type="pty">
Oct 18 12:06:38 user nova-compute[74190]:       <log file="/opt/stack/data/nova/instances/1b169141-68f3-4a5a-ad03-d29c37d39f69/console.log" append="off"/>
Oct 18 12:06:38 user nova-compute[74190]:     </serial>
Oct 18 12:06:38 user nova-compute[74190]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 12:06:38 user nova-compute[74190]:     <video>
Oct 18 12:06:38 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 12:06:38 user nova-compute[74190]:     </video>
Oct 18 12:06:38 user nova-compute[74190]:     <rng model="virtio">
Oct 18 12:06:38 user nova-compute[74190]:       <backend model="random">/dev/urandom</backend>
Oct 18 12:06:38 user nova-compute[74190]:     </rng>
Oct 18 12:06:38 user nova-compute[74190]:     <controller type="usb" index="0" model="none"/>
Oct 18 12:06:38 user nova-compute[74190]:     <memballoon model="virtio">
Oct 18 12:06:38 user nova-compute[74190]:       <stats period="10"/>
Oct 18 12:06:38 user nova-compute[74190]:     </memballoon>
Oct 18 12:06:38 user nova-compute[74190]:   </devices>
Oct 18 12:06:38 user nova-compute[74190]: </domain>
Oct 18 12:06:38 user nova-compute[74190]:  {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 12:06:38 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T12:06:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1120029390',display_name='tempest-TestVolumeBootPattern-server-1120029390',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1120029390',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e375153f6f24827811c5825fc2a2c6a',ramdisk_id='',reservation_id='r-0irby1jy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1157442382',owner_user_name='tempest-TestVolumeBootPattern-1157442382-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T12:06:13Z,user_data=None,user_id='27d9fc244d0f4e10a43b7df4dc8e30ad',uuid=1b169141-68f3-4a5a-ad03-d29c37d39f69,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bfe79254-95f6-4c3b-914e-85874a28731e", "address": "fa:16:3e:6b:cb:19", "network": {"id": "aa827f81-b165-444f-89cc-f21c42a9f772", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1659902586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e375153f6f24827811c5825fc2a2c6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfe79254-95", "ovs_interfaceid": "bfe79254-95f6-4c3b-914e-85874a28731e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 12:06:38 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Converting VIF {"id": "bfe79254-95f6-4c3b-914e-85874a28731e", "address": "fa:16:3e:6b:cb:19", "network": {"id": "aa827f81-b165-444f-89cc-f21c42a9f772", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1659902586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e375153f6f24827811c5825fc2a2c6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfe79254-95", "ovs_interfaceid": "bfe79254-95f6-4c3b-914e-85874a28731e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 12:06:38 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:cb:19,bridge_name='br-int',has_traffic_filtering=True,id=bfe79254-95f6-4c3b-914e-85874a28731e,network=Network(aa827f81-b165-444f-89cc-f21c42a9f772),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfe79254-95') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 12:06:38 user nova-compute[74190]: DEBUG os_vif [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:cb:19,bridge_name='br-int',has_traffic_filtering=True,id=bfe79254-95f6-4c3b-914e-85874a28731e,network=Network(aa827f81-b165-444f-89cc-f21c42a9f772),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfe79254-95') {{(pid=74190) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 12:06:38 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:06:38 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:06:38 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 12:06:38 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:06:38 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2190a9cf-4398-5bcd-af8f-bbe7af0a4d0d', '_type': 'linux-noop'}}, row=False) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:06:38 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:06:38 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:06:38 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:06:38 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbfe79254-95, may_exist=True, interface_attrs={}) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:06:38 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbfe79254-95, col_values=(('qos', UUID('ff1a5b31-5f70-4156-92e1-b1afb67c3d89')),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:06:38 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbfe79254-95, col_values=(('external_ids', {'iface-id': 'bfe79254-95f6-4c3b-914e-85874a28731e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6b:cb:19', 'vm-uuid': '1b169141-68f3-4a5a-ad03-d29c37d39f69'}),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:06:38 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:06:38 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:06:38 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:06:38 user nova-compute[74190]: INFO os_vif [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:cb:19,bridge_name='br-int',has_traffic_filtering=True,id=bfe79254-95f6-4c3b-914e-85874a28731e,network=Network(aa827f81-b165-444f-89cc-f21c42a9f772),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfe79254-95')
Oct 18 12:06:38 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] No BDM found with device name vda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 12:06:38 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] No VIF found with MAC fa:16:3e:6b:cb:19, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 12:06:39 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-0067cec9-51a6-4dc9-aef0-c26dccddd919 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: b1e27a16-43e4-4e80-9c0a-5c2dce06daae] Snapshot image upload complete
Oct 18 12:06:39 user nova-compute[74190]: INFO nova.compute.manager [None req-0067cec9-51a6-4dc9-aef0-c26dccddd919 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: b1e27a16-43e4-4e80-9c0a-5c2dce06daae] Took 5.54 seconds to snapshot the instance on the hypervisor.
Oct 18 12:06:39 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:06:39 user nova-compute[74190]: INFO nova.compute.manager [None req-d9642678-c59f-4752-825d-83756c2366ad tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Unrescuing
Oct 18 12:06:39 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-d9642678-c59f-4752-825d-83756c2366ad tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Acquiring lock "refresh_cache-7f79a267-5bc8-4fa0-9e3a-4706fa1da142" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:06:39 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-d9642678-c59f-4752-825d-83756c2366ad tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Acquired lock "refresh_cache-7f79a267-5bc8-4fa0-9e3a-4706fa1da142" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:06:39 user nova-compute[74190]: DEBUG nova.network.neutron [None req-d9642678-c59f-4752-825d-83756c2366ad tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Building network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 12:06:39 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:06:39 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:06:40 user nova-compute[74190]: DEBUG nova.compute.manager [req-3e3aae6f-9bc4-4b8d-a0a2-cf2fd27a55ef req-e4844934-26f7-43fe-aec5-70ac30b93176 service nova] [instance: 1b169141-68f3-4a5a-ad03-d29c37d39f69] Received event network-vif-plugged-bfe79254-95f6-4c3b-914e-85874a28731e {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:06:40 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-3e3aae6f-9bc4-4b8d-a0a2-cf2fd27a55ef req-e4844934-26f7-43fe-aec5-70ac30b93176 service nova] Acquiring lock "1b169141-68f3-4a5a-ad03-d29c37d39f69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:06:40 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-3e3aae6f-9bc4-4b8d-a0a2-cf2fd27a55ef req-e4844934-26f7-43fe-aec5-70ac30b93176 service nova] Lock "1b169141-68f3-4a5a-ad03-d29c37d39f69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:06:40 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-3e3aae6f-9bc4-4b8d-a0a2-cf2fd27a55ef req-e4844934-26f7-43fe-aec5-70ac30b93176 service nova] Lock "1b169141-68f3-4a5a-ad03-d29c37d39f69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:06:40 user nova-compute[74190]: DEBUG nova.compute.manager [req-3e3aae6f-9bc4-4b8d-a0a2-cf2fd27a55ef req-e4844934-26f7-43fe-aec5-70ac30b93176 service nova] [instance: 1b169141-68f3-4a5a-ad03-d29c37d39f69] No waiting events found dispatching network-vif-plugged-bfe79254-95f6-4c3b-914e-85874a28731e {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:06:40 user nova-compute[74190]: WARNING nova.compute.manager [req-3e3aae6f-9bc4-4b8d-a0a2-cf2fd27a55ef req-e4844934-26f7-43fe-aec5-70ac30b93176 service nova] [instance: 1b169141-68f3-4a5a-ad03-d29c37d39f69] Received unexpected event network-vif-plugged-bfe79254-95f6-4c3b-914e-85874a28731e for instance with vm_state building and task_state spawning.
Oct 18 12:06:40 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:06:40 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:06:40 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:06:40 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:06:40 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:06:40 user nova-compute[74190]: DEBUG nova.network.neutron [None req-d9642678-c59f-4752-825d-83756c2366ad tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Updating instance_info_cache with network_info: [{"id": "85b87aa7-52a9-4487-a954-7e07dcf20500", "address": "fa:16:3e:68:65:7b", "network": {"id": "130f7948-11e4-49b4-9d4a-dffb2b48bdcd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595419292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ffa18c02b8a4117ab1ccc52aca64f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85b87aa7-52", "ovs_interfaceid": "85b87aa7-52a9-4487-a954-7e07dcf20500", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:06:40 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:06:40 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-d9642678-c59f-4752-825d-83756c2366ad tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Releasing lock "refresh_cache-7f79a267-5bc8-4fa0-9e3a-4706fa1da142" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:06:40 user nova-compute[74190]: DEBUG nova.objects.instance [None req-d9642678-c59f-4752-825d-83756c2366ad tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lazy-loading 'flavor' on Instance uuid 7f79a267-5bc8-4fa0-9e3a-4706fa1da142 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:06:40 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:06:40 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:06:40 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:06:40 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:06:41 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Instance destroyed successfully.
Oct 18 12:06:42 user nova-compute[74190]: DEBUG nova.compute.manager [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 1b169141-68f3-4a5a-ad03-d29c37d39f69] Instance event wait completed in 0 seconds for  {{(pid=74190) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 12:06:42 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 1b169141-68f3-4a5a-ad03-d29c37d39f69] Guest created on hypervisor {{(pid=74190) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 12:06:42 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 1b169141-68f3-4a5a-ad03-d29c37d39f69] Instance spawned successfully.
Oct 18 12:06:42 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 1b169141-68f3-4a5a-ad03-d29c37d39f69] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 12:06:42 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 1b169141-68f3-4a5a-ad03-d29c37d39f69] Found default for hw_cdrom_bus of ide {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:06:42 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 1b169141-68f3-4a5a-ad03-d29c37d39f69] Found default for hw_disk_bus of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:06:42 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 1b169141-68f3-4a5a-ad03-d29c37d39f69] Found default for hw_input_bus of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:06:42 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 1b169141-68f3-4a5a-ad03-d29c37d39f69] Found default for hw_pointer_model of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:06:42 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 1b169141-68f3-4a5a-ad03-d29c37d39f69] Found default for hw_video_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:06:42 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 1b169141-68f3-4a5a-ad03-d29c37d39f69] Found default for hw_vif_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:06:42 user nova-compute[74190]: INFO nova.compute.manager [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 1b169141-68f3-4a5a-ad03-d29c37d39f69] Took 5.19 seconds to spawn the instance on the hypervisor.
Oct 18 12:06:42 user nova-compute[74190]: DEBUG nova.compute.manager [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 1b169141-68f3-4a5a-ad03-d29c37d39f69] Checking state {{(pid=74190) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 12:06:42 user nova-compute[74190]: INFO nova.compute.manager [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 1b169141-68f3-4a5a-ad03-d29c37d39f69] Took 30.40 seconds to build instance.
Oct 18 12:06:42 user nova-compute[74190]: DEBUG nova.compute.manager [req-d7f99ed9-99ca-4f6e-8759-4abd3a7d428f req-fe285f0a-07c6-4e26-b1af-69591c720eb2 service nova] [instance: 1b169141-68f3-4a5a-ad03-d29c37d39f69] Received event network-vif-plugged-bfe79254-95f6-4c3b-914e-85874a28731e {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:06:42 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d7f99ed9-99ca-4f6e-8759-4abd3a7d428f req-fe285f0a-07c6-4e26-b1af-69591c720eb2 service nova] Acquiring lock "1b169141-68f3-4a5a-ad03-d29c37d39f69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:06:42 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d7f99ed9-99ca-4f6e-8759-4abd3a7d428f req-fe285f0a-07c6-4e26-b1af-69591c720eb2 service nova] Lock "1b169141-68f3-4a5a-ad03-d29c37d39f69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:06:42 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d7f99ed9-99ca-4f6e-8759-4abd3a7d428f req-fe285f0a-07c6-4e26-b1af-69591c720eb2 service nova] Lock "1b169141-68f3-4a5a-ad03-d29c37d39f69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:06:42 user nova-compute[74190]: DEBUG nova.compute.manager [req-d7f99ed9-99ca-4f6e-8759-4abd3a7d428f req-fe285f0a-07c6-4e26-b1af-69591c720eb2 service nova] [instance: 1b169141-68f3-4a5a-ad03-d29c37d39f69] No waiting events found dispatching network-vif-plugged-bfe79254-95f6-4c3b-914e-85874a28731e {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:06:42 user nova-compute[74190]: WARNING nova.compute.manager [req-d7f99ed9-99ca-4f6e-8759-4abd3a7d428f req-fe285f0a-07c6-4e26-b1af-69591c720eb2 service nova] [instance: 1b169141-68f3-4a5a-ad03-d29c37d39f69] Received unexpected event network-vif-plugged-bfe79254-95f6-4c3b-914e-85874a28731e for instance with vm_state active and task_state None.
Oct 18 12:06:42 user nova-compute[74190]: DEBUG nova.compute.manager [req-d7f99ed9-99ca-4f6e-8759-4abd3a7d428f req-fe285f0a-07c6-4e26-b1af-69591c720eb2 service nova] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Received event network-vif-unplugged-85b87aa7-52a9-4487-a954-7e07dcf20500 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:06:42 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d7f99ed9-99ca-4f6e-8759-4abd3a7d428f req-fe285f0a-07c6-4e26-b1af-69591c720eb2 service nova] Acquiring lock "7f79a267-5bc8-4fa0-9e3a-4706fa1da142-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:06:42 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d7f99ed9-99ca-4f6e-8759-4abd3a7d428f req-fe285f0a-07c6-4e26-b1af-69591c720eb2 service nova] Lock "7f79a267-5bc8-4fa0-9e3a-4706fa1da142-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:06:42 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d7f99ed9-99ca-4f6e-8759-4abd3a7d428f req-fe285f0a-07c6-4e26-b1af-69591c720eb2 service nova] Lock "7f79a267-5bc8-4fa0-9e3a-4706fa1da142-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:06:42 user nova-compute[74190]: DEBUG nova.compute.manager [req-d7f99ed9-99ca-4f6e-8759-4abd3a7d428f req-fe285f0a-07c6-4e26-b1af-69591c720eb2 service nova] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] No waiting events found dispatching network-vif-unplugged-85b87aa7-52a9-4487-a954-7e07dcf20500 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:06:42 user nova-compute[74190]: WARNING nova.compute.manager [req-d7f99ed9-99ca-4f6e-8759-4abd3a7d428f req-fe285f0a-07c6-4e26-b1af-69591c720eb2 service nova] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Received unexpected event network-vif-unplugged-85b87aa7-52a9-4487-a954-7e07dcf20500 for instance with vm_state rescued and task_state unrescuing.
Oct 18 12:06:42 user nova-compute[74190]: DEBUG nova.compute.manager [req-d7f99ed9-99ca-4f6e-8759-4abd3a7d428f req-fe285f0a-07c6-4e26-b1af-69591c720eb2 service nova] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Received event network-vif-plugged-85b87aa7-52a9-4487-a954-7e07dcf20500 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:06:42 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d7f99ed9-99ca-4f6e-8759-4abd3a7d428f req-fe285f0a-07c6-4e26-b1af-69591c720eb2 service nova] Acquiring lock "7f79a267-5bc8-4fa0-9e3a-4706fa1da142-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:06:42 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d7f99ed9-99ca-4f6e-8759-4abd3a7d428f req-fe285f0a-07c6-4e26-b1af-69591c720eb2 service nova] Lock "7f79a267-5bc8-4fa0-9e3a-4706fa1da142-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:06:42 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d7f99ed9-99ca-4f6e-8759-4abd3a7d428f req-fe285f0a-07c6-4e26-b1af-69591c720eb2 service nova] Lock "7f79a267-5bc8-4fa0-9e3a-4706fa1da142-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:06:42 user nova-compute[74190]: DEBUG nova.compute.manager [req-d7f99ed9-99ca-4f6e-8759-4abd3a7d428f req-fe285f0a-07c6-4e26-b1af-69591c720eb2 service nova] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] No waiting events found dispatching network-vif-plugged-85b87aa7-52a9-4487-a954-7e07dcf20500 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:06:42 user nova-compute[74190]: WARNING nova.compute.manager [req-d7f99ed9-99ca-4f6e-8759-4abd3a7d428f req-fe285f0a-07c6-4e26-b1af-69591c720eb2 service nova] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Received unexpected event network-vif-plugged-85b87aa7-52a9-4487-a954-7e07dcf20500 for instance with vm_state rescued and task_state unrescuing.
Oct 18 12:06:42 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-79e26ef4-ef3d-4c7b-a93b-c37292f21fbb tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "1b169141-68f3-4a5a-ad03-d29c37d39f69" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 30.514s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:06:42 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:06:42 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:06:42 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:06:43 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:06:43 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:06:44 user nova-compute[74190]: DEBUG nova.compute.manager [req-c671742c-3c7f-4869-85a8-6fc5b13acb0c req-6d5af116-cd29-48cb-8e10-688f88b7768a service nova] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Received event network-vif-plugged-85b87aa7-52a9-4487-a954-7e07dcf20500 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:06:44 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-c671742c-3c7f-4869-85a8-6fc5b13acb0c req-6d5af116-cd29-48cb-8e10-688f88b7768a service nova] Acquiring lock "7f79a267-5bc8-4fa0-9e3a-4706fa1da142-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:06:44 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-c671742c-3c7f-4869-85a8-6fc5b13acb0c req-6d5af116-cd29-48cb-8e10-688f88b7768a service nova] Lock "7f79a267-5bc8-4fa0-9e3a-4706fa1da142-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:06:44 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-c671742c-3c7f-4869-85a8-6fc5b13acb0c req-6d5af116-cd29-48cb-8e10-688f88b7768a service nova] Lock "7f79a267-5bc8-4fa0-9e3a-4706fa1da142-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:06:44 user nova-compute[74190]: DEBUG nova.compute.manager [req-c671742c-3c7f-4869-85a8-6fc5b13acb0c req-6d5af116-cd29-48cb-8e10-688f88b7768a service nova] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] No waiting events found dispatching network-vif-plugged-85b87aa7-52a9-4487-a954-7e07dcf20500 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:06:44 user nova-compute[74190]: WARNING nova.compute.manager [req-c671742c-3c7f-4869-85a8-6fc5b13acb0c req-6d5af116-cd29-48cb-8e10-688f88b7768a service nova] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Received unexpected event network-vif-plugged-85b87aa7-52a9-4487-a954-7e07dcf20500 for instance with vm_state rescued and task_state unrescuing.
Oct 18 12:06:44 user nova-compute[74190]: DEBUG nova.compute.manager [req-c671742c-3c7f-4869-85a8-6fc5b13acb0c req-6d5af116-cd29-48cb-8e10-688f88b7768a service nova] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Received event network-vif-plugged-85b87aa7-52a9-4487-a954-7e07dcf20500 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:06:44 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-c671742c-3c7f-4869-85a8-6fc5b13acb0c req-6d5af116-cd29-48cb-8e10-688f88b7768a service nova] Acquiring lock "7f79a267-5bc8-4fa0-9e3a-4706fa1da142-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:06:44 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-c671742c-3c7f-4869-85a8-6fc5b13acb0c req-6d5af116-cd29-48cb-8e10-688f88b7768a service nova] Lock "7f79a267-5bc8-4fa0-9e3a-4706fa1da142-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:06:44 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-c671742c-3c7f-4869-85a8-6fc5b13acb0c req-6d5af116-cd29-48cb-8e10-688f88b7768a service nova] Lock "7f79a267-5bc8-4fa0-9e3a-4706fa1da142-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:06:44 user nova-compute[74190]: DEBUG nova.compute.manager [req-c671742c-3c7f-4869-85a8-6fc5b13acb0c req-6d5af116-cd29-48cb-8e10-688f88b7768a service nova] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] No waiting events found dispatching network-vif-plugged-85b87aa7-52a9-4487-a954-7e07dcf20500 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:06:44 user nova-compute[74190]: WARNING nova.compute.manager [req-c671742c-3c7f-4869-85a8-6fc5b13acb0c req-6d5af116-cd29-48cb-8e10-688f88b7768a service nova] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Received unexpected event network-vif-plugged-85b87aa7-52a9-4487-a954-7e07dcf20500 for instance with vm_state rescued and task_state unrescuing.
Oct 18 12:06:45 user nova-compute[74190]: DEBUG nova.compute.manager [None req-d9642678-c59f-4752-825d-83756c2366ad tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Checking state {{(pid=74190) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 12:06:45 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:06:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:06:50 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-926dbb9b-1de9-4555-a716-08fc8f39e907 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] Calling os-brick to attach iSCSI Volume {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 12:06:50 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-926dbb9b-1de9-4555-a716-08fc8f39e907 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:36ae588d-1fe5-490e-99ab-226c6e9dcf25', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xKQpwunR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 12:06:50 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-926dbb9b-1de9-4555-a716-08fc8f39e907 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 12:06:50 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-926dbb9b-1de9-4555-a716-08fc8f39e907 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 12:06:50 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-926dbb9b-1de9-4555-a716-08fc8f39e907 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 12:06:50 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-926dbb9b-1de9-4555-a716-08fc8f39e907 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 12:06:50 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-926dbb9b-1de9-4555-a716-08fc8f39e907 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36ae588d-1fe5-490e-99ab-226c6e9dcf25" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 12:06:50 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-926dbb9b-1de9-4555-a716-08fc8f39e907 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36ae588d-1fe5-490e-99ab-226c6e9dcf25" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 12:06:50 user nova-compute[74190]: INFO os_brick.initiator.connectors.iscsi [None req-926dbb9b-1de9-4555-a716-08fc8f39e907 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 12:06:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36ae588d-1fe5-490e-99ab-226c6e9dcf25 -p 172.16.0.220:3260 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:06:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36ae588d-1fe5-490e-99ab-226c6e9dcf25 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:06:50 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd48cf6a-bc08-41b4-b5fc-a0f6077efabc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:06:50 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-926dbb9b-1de9-4555-a716-08fc8f39e907 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 12:06:50 user nova-compute[74190]:  {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:06:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36ae588d-1fe5-490e-99ab-226c6e9dcf25 -p 172.16.0.220:3260 --interface default --op new {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:06:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36ae588d-1fe5-490e-99ab-226c6e9dcf25 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:06:50 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4355d0e-8b2c-491c-b87d-099894ff348b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:36ae588d-1fe5-490e-99ab-226c6e9dcf25] added\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:06:50 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-926dbb9b-1de9-4555-a716-08fc8f39e907 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:36ae588d-1fe5-490e-99ab-226c6e9dcf25] added
Oct 18 12:06:50 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:06:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36ae588d-1fe5-490e-99ab-226c6e9dcf25 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:06:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36ae588d-1fe5-490e-99ab-226c6e9dcf25 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:06:50 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34451e5-b22c-4d8c-9d66-b44fdbb7fa6c]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:06:50 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-926dbb9b-1de9-4555-a716-08fc8f39e907 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:06:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36ae588d-1fe5-490e-99ab-226c6e9dcf25 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:06:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36ae588d-1fe5-490e-99ab-226c6e9dcf25 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:06:50 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5fbc066-5383-4d56-9d37-fa208ae26fd1]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:06:50 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-926dbb9b-1de9-4555-a716-08fc8f39e907 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:06:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36ae588d-1fe5-490e-99ab-226c6e9dcf25 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xKQpwunR {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:06:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36ae588d-1fe5-490e-99ab-226c6e9dcf25 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xKQpwunR" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:06:50 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec0269ab-8db4-474a-93bc-61ce6375a55d]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:06:50 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-926dbb9b-1de9-4555-a716-08fc8f39e907 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xKQpwunR'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:06:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36ae588d-1fe5-490e-99ab-226c6e9dcf25 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:06:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36ae588d-1fe5-490e-99ab-226c6e9dcf25 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:06:50 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b713ba5-b5e8-4d66-b4a6-a0578a5e8c9b]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:06:50 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-926dbb9b-1de9-4555-a716-08fc8f39e907 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:06:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:06:51 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:06:51 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c9d848-fb73-48f3-8382-ce8dcb97dfe8]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e780d69-215f-42df-9312-69b207f13eb7 (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:06:51 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-926dbb9b-1de9-4555-a716-08fc8f39e907 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 12:06:51 user nova-compute[74190]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)
Oct 18 12:06:51 user nova-compute[74190]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f (non-flash)
Oct 18 12:06:51 user nova-compute[74190]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e780d69-215f-42df-9312-69b207f13eb7 (non-flash)
Oct 18 12:06:51 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 12:06:51 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-926dbb9b-1de9-4555-a716-08fc8f39e907 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 12:06:51 user nova-compute[74190]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)
Oct 18 12:06:51 user nova-compute[74190]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f (non-flash)
Oct 18 12:06:51 user nova-compute[74190]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e780d69-215f-42df-9312-69b207f13eb7 (non-flash)
Oct 18 12:06:51 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 12:06:51 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36ae588d-1fe5-490e-99ab-226c6e9dcf25 -p 172.16.0.220:3260 --login {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:06:51 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36ae588d-1fe5-490e-99ab-226c6e9dcf25 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:06:51 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb3e4bce-a3da-4166-bae7-d81323c4de63]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:36ae588d-1fe5-490e-99ab-226c6e9dcf25, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:36ae588d-1fe5-490e-99ab-226c6e9dcf25, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:06:51 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-926dbb9b-1de9-4555-a716-08fc8f39e907 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:36ae588d-1fe5-490e-99ab-226c6e9dcf25, portal: 172.16.0.220,3260]
Oct 18 12:06:51 user nova-compute[74190]: Login to [iface: default, target: iqn.2010-10.org.openstack:36ae588d-1fe5-490e-99ab-226c6e9dcf25, portal: 172.16.0.220,3260] successful.
Oct 18 12:06:51 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:06:51 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36ae588d-1fe5-490e-99ab-226c6e9dcf25 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:06:51 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36ae588d-1fe5-490e-99ab-226c6e9dcf25 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:06:51 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[885032b8-b5f0-4095-934b-ec2983f12055]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:06:51 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-926dbb9b-1de9-4555-a716-08fc8f39e907 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:06:51 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:06:51 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:06:51 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9c76ce6-b615-465f-beec-42a81fd05de2]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e780d69-215f-42df-9312-69b207f13eb7 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36ae588d-1fe5-490e-99ab-226c6e9dcf25 (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:06:51 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-926dbb9b-1de9-4555-a716-08fc8f39e907 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 12:06:51 user nova-compute[74190]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)
Oct 18 12:06:51 user nova-compute[74190]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f (non-flash)
Oct 18 12:06:51 user nova-compute[74190]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e780d69-215f-42df-9312-69b207f13eb7 (non-flash)
Oct 18 12:06:51 user nova-compute[74190]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36ae588d-1fe5-490e-99ab-226c6e9dcf25 (non-flash)
Oct 18 12:06:51 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 12:06:51 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-926dbb9b-1de9-4555-a716-08fc8f39e907 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 12:06:51 user nova-compute[74190]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)
Oct 18 12:06:51 user nova-compute[74190]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f (non-flash)
Oct 18 12:06:51 user nova-compute[74190]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e780d69-215f-42df-9312-69b207f13eb7 (non-flash)
Oct 18 12:06:51 user nova-compute[74190]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36ae588d-1fe5-490e-99ab-226c6e9dcf25 (non-flash)
Oct 18 12:06:51 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 12:06:51 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-926dbb9b-1de9-4555-a716-08fc8f39e907 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36ae588d-1fe5-490e-99ab-226c6e9dcf25" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.330s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 12:06:51 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-926dbb9b-1de9-4555-a716-08fc8f39e907 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Connected to 172.16.0.220:3260 {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 12:06:51 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-926dbb9b-1de9-4555-a716-08fc8f39e907 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] HCTL ('37', '-', '-', 0) found on session 45 with lun 0 {{(pid=74190) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 12:06:51 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-926dbb9b-1de9-4555-a716-08fc8f39e907 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74190) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 12:06:51 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:06:51 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:06:51 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9f365d7-ef16-4133-a423-44644a3193f5]: (4, ('- - 0', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:06:51 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-926dbb9b-1de9-4555-a716-08fc8f39e907 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Searching for a device in session 45 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74190) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 12:06:51 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-926dbb9b-1de9-4555-a716-08fc8f39e907 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:36ae588d-1fe5-490e-99ab-226c6e9dcf25', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xKQpwunR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 12:06:52 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-926dbb9b-1de9-4555-a716-08fc8f39e907 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.367s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 12:06:52 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-926dbb9b-1de9-4555-a716-08fc8f39e907 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] <== connect_volume: return (1370ms) {'type': 'block', 'scsi_wwn': '23733393636323635', 'path': '/dev/sdf'} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 12:06:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-926dbb9b-1de9-4555-a716-08fc8f39e907 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23733393636323635', 'path': '/dev/sdf'} {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 12:06:52 user nova-compute[74190]: DEBUG nova.objects.instance [None req-926dbb9b-1de9-4555-a716-08fc8f39e907 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Lazy-loading 'flavor' on Instance uuid 2f59adf3-9728-4d5b-87d5-2ad32c99d06e {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:06:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-926dbb9b-1de9-4555-a716-08fc8f39e907 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] attach device xml: <disk type="block" device="disk">
Oct 18 12:06:52 user nova-compute[74190]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 12:06:52 user nova-compute[74190]:   <source dev="/dev/sdf"/>
Oct 18 12:06:52 user nova-compute[74190]:   <target dev="vdb" bus="virtio"/>
Oct 18 12:06:52 user nova-compute[74190]:   <serial>36ae588d-1fe5-490e-99ab-226c6e9dcf25</serial>
Oct 18 12:06:52 user nova-compute[74190]: </disk>
Oct 18 12:06:52 user nova-compute[74190]:  {{(pid=74190) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 18 12:06:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-926dbb9b-1de9-4555-a716-08fc8f39e907 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] No BDM found with device name vda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 12:06:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-926dbb9b-1de9-4555-a716-08fc8f39e907 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 12:06:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-926dbb9b-1de9-4555-a716-08fc8f39e907 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] No VIF found with MAC fa:16:3e:5c:73:bc, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 12:06:52 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-926dbb9b-1de9-4555-a716-08fc8f39e907 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Lock "2f59adf3-9728-4d5b-87d5-2ad32c99d06e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.486s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:06:53 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:06:53 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:06:54 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:06:55 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:06:55 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-6c5e9d20-08b1-49cc-b333-bd39846a7775 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Acquiring lock "2f59adf3-9728-4d5b-87d5-2ad32c99d06e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:06:55 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-6c5e9d20-08b1-49cc-b333-bd39846a7775 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Lock "2f59adf3-9728-4d5b-87d5-2ad32c99d06e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:06:55 user nova-compute[74190]: INFO nova.compute.manager [None req-6c5e9d20-08b1-49cc-b333-bd39846a7775 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] Detaching volume 36ae588d-1fe5-490e-99ab-226c6e9dcf25
Oct 18 12:06:55 user nova-compute[74190]: INFO nova.virt.block_device [None req-6c5e9d20-08b1-49cc-b333-bd39846a7775 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] Attempting to driver detach volume 36ae588d-1fe5-490e-99ab-226c6e9dcf25 from mountpoint /dev/vdb
Oct 18 12:06:55 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-6c5e9d20-08b1-49cc-b333-bd39846a7775 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Attempting to detach device vdb from instance 2f59adf3-9728-4d5b-87d5-2ad32c99d06e from the persistent domain config. {{(pid=74190) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 18 12:06:55 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-6c5e9d20-08b1-49cc-b333-bd39846a7775 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 12:06:55 user nova-compute[74190]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 12:06:55 user nova-compute[74190]:   <source dev="/dev/sdf"/>
Oct 18 12:06:55 user nova-compute[74190]:   <target dev="vdb" bus="virtio"/>
Oct 18 12:06:55 user nova-compute[74190]:   <serial>36ae588d-1fe5-490e-99ab-226c6e9dcf25</serial>
Oct 18 12:06:55 user nova-compute[74190]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 18 12:06:55 user nova-compute[74190]: </disk>
Oct 18 12:06:55 user nova-compute[74190]:  {{(pid=74190) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 12:06:55 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-6c5e9d20-08b1-49cc-b333-bd39846a7775 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Successfully detached device vdb from instance 2f59adf3-9728-4d5b-87d5-2ad32c99d06e from the persistent domain config.
Oct 18 12:06:55 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-6c5e9d20-08b1-49cc-b333-bd39846a7775 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2f59adf3-9728-4d5b-87d5-2ad32c99d06e from the live domain config. {{(pid=74190) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 18 12:06:55 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-6c5e9d20-08b1-49cc-b333-bd39846a7775 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 12:06:55 user nova-compute[74190]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 12:06:55 user nova-compute[74190]:   <source dev="/dev/sdf"/>
Oct 18 12:06:55 user nova-compute[74190]:   <target dev="vdb" bus="virtio"/>
Oct 18 12:06:55 user nova-compute[74190]:   <serial>36ae588d-1fe5-490e-99ab-226c6e9dcf25</serial>
Oct 18 12:06:55 user nova-compute[74190]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 18 12:06:55 user nova-compute[74190]: </disk>
Oct 18 12:06:55 user nova-compute[74190]:  {{(pid=74190) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 12:06:56 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-6c5e9d20-08b1-49cc-b333-bd39846a7775 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2f59adf3-9728-4d5b-87d5-2ad32c99d06e {{(pid=74190) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 18 12:06:58 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:06:59 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-2bc3ec05-4d0f-4043-88e6-c6bb952e0b75 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Acquiring lock "c0f8682a-6de5-459b-9843-bbe945fb329e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:06:59 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-2bc3ec05-4d0f-4043-88e6-c6bb952e0b75 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "c0f8682a-6de5-459b-9843-bbe945fb329e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:06:59 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-2bc3ec05-4d0f-4043-88e6-c6bb952e0b75 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Acquiring lock "c0f8682a-6de5-459b-9843-bbe945fb329e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:06:59 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-2bc3ec05-4d0f-4043-88e6-c6bb952e0b75 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "c0f8682a-6de5-459b-9843-bbe945fb329e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:06:59 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-2bc3ec05-4d0f-4043-88e6-c6bb952e0b75 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "c0f8682a-6de5-459b-9843-bbe945fb329e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:06:59 user nova-compute[74190]: INFO nova.compute.manager [None req-2bc3ec05-4d0f-4043-88e6-c6bb952e0b75 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: c0f8682a-6de5-459b-9843-bbe945fb329e] Terminating instance
Oct 18 12:06:59 user nova-compute[74190]: DEBUG nova.compute.manager [None req-2bc3ec05-4d0f-4043-88e6-c6bb952e0b75 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: c0f8682a-6de5-459b-9843-bbe945fb329e] Start destroying the instance on the hypervisor. {{(pid=74190) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 12:06:59 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:06:59 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:06:59 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:06:59 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:06:59 user nova-compute[74190]: DEBUG nova.compute.manager [req-fa2be416-6af4-4b6d-b3cf-f7bae6a73878 req-95f1dbeb-ad0f-43fa-8733-c0a302696463 service nova] [instance: c0f8682a-6de5-459b-9843-bbe945fb329e] Received event network-vif-unplugged-bf475d1e-c90f-4ec2-aafc-5f9fdaab831f {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:06:59 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-fa2be416-6af4-4b6d-b3cf-f7bae6a73878 req-95f1dbeb-ad0f-43fa-8733-c0a302696463 service nova] Acquiring lock "c0f8682a-6de5-459b-9843-bbe945fb329e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:06:59 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-fa2be416-6af4-4b6d-b3cf-f7bae6a73878 req-95f1dbeb-ad0f-43fa-8733-c0a302696463 service nova] Lock "c0f8682a-6de5-459b-9843-bbe945fb329e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:06:59 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-fa2be416-6af4-4b6d-b3cf-f7bae6a73878 req-95f1dbeb-ad0f-43fa-8733-c0a302696463 service nova] Lock "c0f8682a-6de5-459b-9843-bbe945fb329e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:06:59 user nova-compute[74190]: DEBUG nova.compute.manager [req-fa2be416-6af4-4b6d-b3cf-f7bae6a73878 req-95f1dbeb-ad0f-43fa-8733-c0a302696463 service nova] [instance: c0f8682a-6de5-459b-9843-bbe945fb329e] No waiting events found dispatching network-vif-unplugged-bf475d1e-c90f-4ec2-aafc-5f9fdaab831f {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:06:59 user nova-compute[74190]: DEBUG nova.compute.manager [req-fa2be416-6af4-4b6d-b3cf-f7bae6a73878 req-95f1dbeb-ad0f-43fa-8733-c0a302696463 service nova] [instance: c0f8682a-6de5-459b-9843-bbe945fb329e] Received event network-vif-unplugged-bf475d1e-c90f-4ec2-aafc-5f9fdaab831f for instance with task_state deleting. {{(pid=74190) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 12:07:00 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: c0f8682a-6de5-459b-9843-bbe945fb329e] Instance destroyed successfully.
Oct 18 12:07:00 user nova-compute[74190]: DEBUG nova.objects.instance [None req-2bc3ec05-4d0f-4043-88e6-c6bb952e0b75 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lazy-loading 'resources' on Instance uuid c0f8682a-6de5-459b-9843-bbe945fb329e {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:07:00 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-2bc3ec05-4d0f-4043-88e6-c6bb952e0b75 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T12:03:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-405495458',display_name='tempest-AttachVolumeNegativeTest-server-405495458',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-405495458',id=37,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIsvrKNE/qiqg7gBe8ZK6b8uQPD2zFT9/fQGpsXjGoFyAQaFEJ1Th/mPCmO+nHgUyNfEBYsVyOmANawPUtiGXkCQ0CusA+ARK1MqeUDgxKkYYfteWRRcJf0Amv/wcC3jmw==',key_name='tempest-keypair-73457791',keypairs=<?>,launch_index=0,launched_at=2023-10-18T12:03:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='df06c4b010434e3da9ba4ea41f26befa',ramdisk_id='',reservation_id='r-vr4t5ffg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1730208605',owner_user_name='tempest-AttachVolumeNegativeTest-1730208605-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T12:03:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d6bb993153245daabfc59215abbf7a1',uuid=c0f8682a-6de5-459b-9843-bbe945fb329e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bf475d1e-c90f-4ec2-aafc-5f9fdaab831f", "address": "fa:16:3e:a7:7b:dd", "network": {"id": "25e0d6f5-497d-4898-8181-5b4848950f16", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-245925644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df06c4b010434e3da9ba4ea41f26befa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf475d1e-c9", "ovs_interfaceid": "bf475d1e-c90f-4ec2-aafc-5f9fdaab831f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 12:07:00 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-2bc3ec05-4d0f-4043-88e6-c6bb952e0b75 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Converting VIF {"id": "bf475d1e-c90f-4ec2-aafc-5f9fdaab831f", "address": "fa:16:3e:a7:7b:dd", "network": {"id": "25e0d6f5-497d-4898-8181-5b4848950f16", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-245925644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df06c4b010434e3da9ba4ea41f26befa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf475d1e-c9", "ovs_interfaceid": "bf475d1e-c90f-4ec2-aafc-5f9fdaab831f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 12:07:00 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-2bc3ec05-4d0f-4043-88e6-c6bb952e0b75 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a7:7b:dd,bridge_name='br-int',has_traffic_filtering=True,id=bf475d1e-c90f-4ec2-aafc-5f9fdaab831f,network=Network(25e0d6f5-497d-4898-8181-5b4848950f16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf475d1e-c9') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 12:07:00 user nova-compute[74190]: DEBUG os_vif [None req-2bc3ec05-4d0f-4043-88e6-c6bb952e0b75 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:7b:dd,bridge_name='br-int',has_traffic_filtering=True,id=bf475d1e-c90f-4ec2-aafc-5f9fdaab831f,network=Network(25e0d6f5-497d-4898-8181-5b4848950f16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf475d1e-c9') {{(pid=74190) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 12:07:00 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:07:00 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbf475d1e-c9, bridge=br-int, if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:07:00 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:07:00 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:07:00 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0e88c4a1-c720-41f4-bf9c-983f29e8a9fb) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:07:00 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:07:00 user nova-compute[74190]: INFO os_vif [None req-2bc3ec05-4d0f-4043-88e6-c6bb952e0b75 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:7b:dd,bridge_name='br-int',has_traffic_filtering=True,id=bf475d1e-c90f-4ec2-aafc-5f9fdaab831f,network=Network(25e0d6f5-497d-4898-8181-5b4848950f16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf475d1e-c9')
Oct 18 12:07:00 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-2bc3ec05-4d0f-4043-88e6-c6bb952e0b75 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: c0f8682a-6de5-459b-9843-bbe945fb329e] Deleting instance files /opt/stack/data/nova/instances/c0f8682a-6de5-459b-9843-bbe945fb329e_del
Oct 18 12:07:00 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-2bc3ec05-4d0f-4043-88e6-c6bb952e0b75 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: c0f8682a-6de5-459b-9843-bbe945fb329e] Deletion of /opt/stack/data/nova/instances/c0f8682a-6de5-459b-9843-bbe945fb329e_del complete
Oct 18 12:07:00 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:07:00 user nova-compute[74190]: INFO nova.compute.manager [None req-2bc3ec05-4d0f-4043-88e6-c6bb952e0b75 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] [instance: c0f8682a-6de5-459b-9843-bbe945fb329e] Took 0.96 seconds to destroy the instance on the hypervisor.
Oct 18 12:07:00 user nova-compute[74190]: DEBUG oslo.service.loopingcall [None req-2bc3ec05-4d0f-4043-88e6-c6bb952e0b75 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74190) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 12:07:00 user nova-compute[74190]: DEBUG nova.compute.manager [-] [instance: c0f8682a-6de5-459b-9843-bbe945fb329e] Deallocating network for instance {{(pid=74190) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 12:07:00 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: c0f8682a-6de5-459b-9843-bbe945fb329e] deallocate_for_instance() {{(pid=74190) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 12:07:01 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: c0f8682a-6de5-459b-9843-bbe945fb329e] Updating instance_info_cache with network_info: [] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:07:01 user nova-compute[74190]: INFO nova.compute.manager [-] [instance: c0f8682a-6de5-459b-9843-bbe945fb329e] Took 0.78 seconds to deallocate network for instance.
Oct 18 12:07:01 user nova-compute[74190]: DEBUG nova.compute.manager [req-ee9c5206-c2cf-4d19-b91f-f1077ed9f8eb req-7c4a07f9-7586-4ddc-92eb-ef32a225f67e service nova] [instance: c0f8682a-6de5-459b-9843-bbe945fb329e] Received event network-vif-deleted-bf475d1e-c90f-4ec2-aafc-5f9fdaab831f {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:07:01 user nova-compute[74190]: INFO nova.compute.manager [req-ee9c5206-c2cf-4d19-b91f-f1077ed9f8eb req-7c4a07f9-7586-4ddc-92eb-ef32a225f67e service nova] [instance: c0f8682a-6de5-459b-9843-bbe945fb329e] Neutron deleted interface bf475d1e-c90f-4ec2-aafc-5f9fdaab831f; detaching it from the instance and deleting it from the info cache
Oct 18 12:07:01 user nova-compute[74190]: DEBUG nova.network.neutron [req-ee9c5206-c2cf-4d19-b91f-f1077ed9f8eb req-7c4a07f9-7586-4ddc-92eb-ef32a225f67e service nova] [instance: c0f8682a-6de5-459b-9843-bbe945fb329e] Updating instance_info_cache with network_info: [] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:07:01 user nova-compute[74190]: DEBUG nova.compute.manager [req-ee9c5206-c2cf-4d19-b91f-f1077ed9f8eb req-7c4a07f9-7586-4ddc-92eb-ef32a225f67e service nova] [instance: c0f8682a-6de5-459b-9843-bbe945fb329e] Detach interface failed, port_id=bf475d1e-c90f-4ec2-aafc-5f9fdaab831f, reason: Instance c0f8682a-6de5-459b-9843-bbe945fb329e could not be found. {{(pid=74190) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 18 12:07:01 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-2bc3ec05-4d0f-4043-88e6-c6bb952e0b75 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:07:01 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-2bc3ec05-4d0f-4043-88e6-c6bb952e0b75 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:07:01 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-2bc3ec05-4d0f-4043-88e6-c6bb952e0b75 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 12:07:01 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-2bc3ec05-4d0f-4043-88e6-c6bb952e0b75 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 12:07:01 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-2bc3ec05-4d0f-4043-88e6-c6bb952e0b75 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.323s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:07:01 user nova-compute[74190]: INFO nova.scheduler.client.report [None req-2bc3ec05-4d0f-4043-88e6-c6bb952e0b75 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Deleted allocations for instance c0f8682a-6de5-459b-9843-bbe945fb329e
Oct 18 12:07:01 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-2bc3ec05-4d0f-4043-88e6-c6bb952e0b75 tempest-AttachVolumeNegativeTest-1730208605 tempest-AttachVolumeNegativeTest-1730208605-project-member] Lock "c0f8682a-6de5-459b-9843-bbe945fb329e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.292s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:07:01 user nova-compute[74190]: DEBUG nova.compute.manager [req-1293ae19-8eb3-4aba-acd6-4cc089e46dc6 req-80e9f44e-6f3d-43cc-8e6d-2355c51d0748 service nova] [instance: c0f8682a-6de5-459b-9843-bbe945fb329e] Received event network-vif-plugged-bf475d1e-c90f-4ec2-aafc-5f9fdaab831f {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:07:01 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-1293ae19-8eb3-4aba-acd6-4cc089e46dc6 req-80e9f44e-6f3d-43cc-8e6d-2355c51d0748 service nova] Acquiring lock "c0f8682a-6de5-459b-9843-bbe945fb329e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:07:01 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-1293ae19-8eb3-4aba-acd6-4cc089e46dc6 req-80e9f44e-6f3d-43cc-8e6d-2355c51d0748 service nova] Lock "c0f8682a-6de5-459b-9843-bbe945fb329e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:07:01 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-1293ae19-8eb3-4aba-acd6-4cc089e46dc6 req-80e9f44e-6f3d-43cc-8e6d-2355c51d0748 service nova] Lock "c0f8682a-6de5-459b-9843-bbe945fb329e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:07:01 user nova-compute[74190]: DEBUG nova.compute.manager [req-1293ae19-8eb3-4aba-acd6-4cc089e46dc6 req-80e9f44e-6f3d-43cc-8e6d-2355c51d0748 service nova] [instance: c0f8682a-6de5-459b-9843-bbe945fb329e] No waiting events found dispatching network-vif-plugged-bf475d1e-c90f-4ec2-aafc-5f9fdaab831f {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:07:01 user nova-compute[74190]: WARNING nova.compute.manager [req-1293ae19-8eb3-4aba-acd6-4cc089e46dc6 req-80e9f44e-6f3d-43cc-8e6d-2355c51d0748 service nova] [instance: c0f8682a-6de5-459b-9843-bbe945fb329e] Received unexpected event network-vif-plugged-bf475d1e-c90f-4ec2-aafc-5f9fdaab831f for instance with vm_state deleted and task_state None.
Oct 18 12:07:05 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:07:05 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:07:07 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:07:08 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:07:09 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:07:09 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:07:09 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Cleaning up deleted instances {{(pid=74190) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 18 12:07:09 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] There are 0 instances to clean {{(pid=74190) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 18 12:07:10 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:07:10 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:07:14 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:07:14 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:07:14 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Starting heal instance info cache {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 12:07:14 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "refresh_cache-0382820d-a678-4593-85df-168f42fc4ce4" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:07:14 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquired lock "refresh_cache-0382820d-a678-4593-85df-168f42fc4ce4" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:07:14 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Forcefully refreshing network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 18 12:07:14 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Updating instance_info_cache with network_info: [{"id": "a32b81a2-7b02-48ed-9550-d392be5e221e", "address": "fa:16:3e:e7:d8:e5", "network": {"id": "c2dbbd24-f1d2-47a2-835f-0f9b24b585f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-920140900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d994366010142519ff367fa7ca77e61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa32b81a2-7b", "ovs_interfaceid": "a32b81a2-7b02-48ed-9550-d392be5e221e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:07:14 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Releasing lock "refresh_cache-0382820d-a678-4593-85df-168f42fc4ce4" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:07:14 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Updated the network info_cache for instance {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 18 12:07:15 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:07:15 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74190) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 12:07:15 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:07:15 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:07:16 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-6c5e9d20-08b1-49cc-b333-bd39846a7775 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2f59adf3-9728-4d5b-87d5-2ad32c99d06e is timed out.
Oct 18 12:07:16 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-6c5e9d20-08b1-49cc-b333-bd39846a7775 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Successfully detached device vdb from instance 2f59adf3-9728-4d5b-87d5-2ad32c99d06e from the live domain config.
Oct 18 12:07:16 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c5e9d20-08b1-49cc-b333-bd39846a7775 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] calling os-brick to detach iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 12:07:16 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c5e9d20-08b1-49cc-b333-bd39846a7775 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, {'target_iqn': 'iqn.2010-10.org.openstack:36ae588d-1fe5-490e-99ab-226c6e9dcf25', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xKQpwunR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 12:07:16 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-6c5e9d20-08b1-49cc-b333-bd39846a7775 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 12:07:16 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-6c5e9d20-08b1-49cc-b333-bd39846a7775 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 12:07:16 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-6c5e9d20-08b1-49cc-b333-bd39846a7775 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 12:07:16 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:07:16 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:07:16 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[070d2f19-0efb-4844-b845-540c096a7e77]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e780d69-215f-42df-9312-69b207f13eb7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36ae588d-1fe5-490e-99ab-226c6e9dcf25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:07:16 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c5e9d20-08b1-49cc-b333-bd39846a7775 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 12:07:16 user nova-compute[74190]: No targets found.
Oct 18 12:07:16 user nova-compute[74190]: iSNS:
Oct 18 12:07:16 user nova-compute[74190]: No targets found.
Oct 18 12:07:16 user nova-compute[74190]: STATIC:
Oct 18 12:07:16 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f
Oct 18 12:07:16 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 12:07:16 user nova-compute[74190]:                 Iface Name: default
Oct 18 12:07:16 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa
Oct 18 12:07:16 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 12:07:16 user nova-compute[74190]:                 Iface Name: default
Oct 18 12:07:16 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:2e780d69-215f-42df-9312-69b207f13eb7
Oct 18 12:07:16 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 12:07:16 user nova-compute[74190]:                 Iface Name: default
Oct 18 12:07:16 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f
Oct 18 12:07:16 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 12:07:16 user nova-compute[74190]:                 Iface Name: default
Oct 18 12:07:16 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:36ae588d-1fe5-490e-99ab-226c6e9dcf25
Oct 18 12:07:16 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 12:07:16 user nova-compute[74190]:                 Iface Name: default
Oct 18 12:07:16 user nova-compute[74190]: FIRMWARE:
Oct 18 12:07:16 user nova-compute[74190]: No targets found.
Oct 18 12:07:16 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 12:07:16 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c5e9d20-08b1-49cc-b333-bd39846a7775 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 12:07:16 user nova-compute[74190]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 12:07:16 user nova-compute[74190]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74190) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 12:07:16 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c5e9d20-08b1-49cc-b333-bd39846a7775 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:36ae588d-1fe5-490e-99ab-226c6e9dcf25', 0)] {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 12:07:16 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:07:16 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:07:16 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[a32cba96-fea9-4466-8305-e44b6db64a12]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e780d69-215f-42df-9312-69b207f13eb7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36ae588d-1fe5-490e-99ab-226c6e9dcf25\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:07:16 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:07:16 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:07:16 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[a55aac34-588b-4b90-8d9c-eadb5cb68180]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e780d69-215f-42df-9312-69b207f13eb7 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36ae588d-1fe5-490e-99ab-226c6e9dcf25 (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:07:16 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c5e9d20-08b1-49cc-b333-bd39846a7775 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 12:07:16 user nova-compute[74190]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)
Oct 18 12:07:16 user nova-compute[74190]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f (non-flash)
Oct 18 12:07:16 user nova-compute[74190]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e780d69-215f-42df-9312-69b207f13eb7 (non-flash)
Oct 18 12:07:16 user nova-compute[74190]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36ae588d-1fe5-490e-99ab-226c6e9dcf25 (non-flash)
Oct 18 12:07:16 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 12:07:16 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c5e9d20-08b1-49cc-b333-bd39846a7775 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 12:07:16 user nova-compute[74190]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)
Oct 18 12:07:16 user nova-compute[74190]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f (non-flash)
Oct 18 12:07:16 user nova-compute[74190]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e780d69-215f-42df-9312-69b207f13eb7 (non-flash)
Oct 18 12:07:16 user nova-compute[74190]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36ae588d-1fe5-490e-99ab-226c6e9dcf25 (non-flash)
Oct 18 12:07:16 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 12:07:16 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c5e9d20-08b1-49cc-b333-bd39846a7775 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1f247cd750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:36ae588d-1fe5-490e-99ab-226c6e9dcf25'): ({'sdf'}, set())}) {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 12:07:16 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-6c5e9d20-08b1-49cc-b333-bd39846a7775 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Removing single pathed devices sdf {{(pid=74190) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 12:07:16 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:07:16 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:07:16 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d0c4e3-11f3-4fde-9b47-1bfd9048b25f]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:07:16 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:07:16 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:07:16 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a4a90df-167d-45eb-9676-bab08d73b52b]: (4, ('ok\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:07:16 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-6c5e9d20-08b1-49cc-b333-bd39846a7775 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Flushing IO for device /dev/sdf {{(pid=74190) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 12:07:16 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:07:16 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:07:16 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0cdbcad-71c1-4400-b84d-0e591e71cbe3]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:07:16 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-6c5e9d20-08b1-49cc-b333-bd39846a7775 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74190) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 12:07:16 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:07:16 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.039s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:07:16 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[9910b303-96d0-454c-98b4-674f00d9eb85]: (4, ('1', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:07:16 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-6c5e9d20-08b1-49cc-b333-bd39846a7775 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 12:07:16 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-6c5e9d20-08b1-49cc-b333-bd39846a7775 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] SCSI volumes sdf have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 12:07:16 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c5e9d20-08b1-49cc-b333-bd39846a7775 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:36ae588d-1fe5-490e-99ab-226c6e9dcf25')] {{(pid=74190) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 12:07:16 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36ae588d-1fe5-490e-99ab-226c6e9dcf25 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:07:16 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36ae588d-1fe5-490e-99ab-226c6e9dcf25 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:07:16 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[64288290-8640-4eff-a07b-625981fb2b3c]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:07:16 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c5e9d20-08b1-49cc-b333-bd39846a7775 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:07:16 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36ae588d-1fe5-490e-99ab-226c6e9dcf25 -p 172.16.0.220:3260 --logout {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:07:16 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36ae588d-1fe5-490e-99ab-226c6e9dcf25 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:07:16 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f80109-0a7e-4867-955a-a82155f3b1cf]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:36ae588d-1fe5-490e-99ab-226c6e9dcf25, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:36ae588d-1fe5-490e-99ab-226c6e9dcf25, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:07:16 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c5e9d20-08b1-49cc-b333-bd39846a7775 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:36ae588d-1fe5-490e-99ab-226c6e9dcf25, portal: 172.16.0.220,3260]
Oct 18 12:07:16 user nova-compute[74190]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:36ae588d-1fe5-490e-99ab-226c6e9dcf25, portal: 172.16.0.220,3260] successful.
Oct 18 12:07:16 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:07:16 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36ae588d-1fe5-490e-99ab-226c6e9dcf25 -p 172.16.0.220:3260 --op delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:07:16 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36ae588d-1fe5-490e-99ab-226c6e9dcf25 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:07:16 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[382310e2-0d97-4ad9-93d8-d28ab62e29d6]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:07:16 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c5e9d20-08b1-49cc-b333-bd39846a7775 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:07:16 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-6c5e9d20-08b1-49cc-b333-bd39846a7775 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 12:07:16 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c5e9d20-08b1-49cc-b333-bd39846a7775 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] <== disconnect_volume: return (339ms) None {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 12:07:16 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c5e9d20-08b1-49cc-b333-bd39846a7775 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] Disconnected iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 12:07:17 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:07:17 user nova-compute[74190]: DEBUG nova.objects.instance [None req-6c5e9d20-08b1-49cc-b333-bd39846a7775 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Lazy-loading 'flavor' on Instance uuid 2f59adf3-9728-4d5b-87d5-2ad32c99d06e {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:07:17 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-6c5e9d20-08b1-49cc-b333-bd39846a7775 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Lock "2f59adf3-9728-4d5b-87d5-2ad32c99d06e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.795s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:07:18 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:07:18 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:07:18 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:07:18 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:07:18 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:07:18 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:07:18 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Auditing locally available compute resources for user (node: user) {{(pid=74190) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 12:07:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f59adf3-9728-4d5b-87d5-2ad32c99d06e/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:07:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f59adf3-9728-4d5b-87d5-2ad32c99d06e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:07:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f59adf3-9728-4d5b-87d5-2ad32c99d06e/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:07:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f59adf3-9728-4d5b-87d5-2ad32c99d06e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:07:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f79a267-5bc8-4fa0-9e3a-4706fa1da142/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:07:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f79a267-5bc8-4fa0-9e3a-4706fa1da142/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:07:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f79a267-5bc8-4fa0-9e3a-4706fa1da142/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:07:19 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f79a267-5bc8-4fa0-9e3a-4706fa1da142/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:07:19 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 12:07:19 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:07:19 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:07:19 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:07:19 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:07:19 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1e27a16-43e4-4e80-9c0a-5c2dce06daae/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:07:19 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1e27a16-43e4-4e80-9c0a-5c2dce06daae/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:07:19 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1e27a16-43e4-4e80-9c0a-5c2dce06daae/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:07:19 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1e27a16-43e4-4e80-9c0a-5c2dce06daae/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:07:19 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 12:07:19 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:07:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:07:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:07:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:07:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:07:20 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:07:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:07:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:07:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:07:20 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 12:07:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk.rescue --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:07:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:07:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk.rescue --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:07:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:07:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:07:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:07:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:07:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:07:21 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 12:07:21 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:07:21 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:07:21 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Hypervisor/Node resource view: name=user free_ram=7836MB free_disk=24.952800750732422GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74190) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 12:07:21 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:07:21 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:07:22 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 4e916d24-9f9d-4289-87ce-f65d2499fcd9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:07:22 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 95ca0697-22b5-4109-868f-ca5556015a1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:07:22 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 42413a94-9973-4e8d-83b6-207a4e7847c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:07:22 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 772b126c-2148-4ca8-90f2-69d6eb4b7db7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:07:22 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 0382820d-a678-4593-85df-168f42fc4ce4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:07:22 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 2f59adf3-9728-4d5b-87d5-2ad32c99d06e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:07:22 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 7f79a267-5bc8-4fa0-9e3a-4706fa1da142 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:07:22 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance b1e27a16-43e4-4e80-9c0a-5c2dce06daae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:07:22 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 1b169141-68f3-4a5a-ad03-d29c37d39f69 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:07:22 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 12:07:22 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 12:07:22 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 12:07:22 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 12:07:22 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Compute_service record updated for user:user {{(pid=74190) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 12:07:22 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.554s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:07:22 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:07:22 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74190) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 18 12:07:22 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:07:25 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:07:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:07:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:07:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74190) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 12:07:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:07:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:07:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:07:35 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:07:36 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:07:36 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Triggering sync for uuid 4e916d24-9f9d-4289-87ce-f65d2499fcd9 {{(pid=74190) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 18 12:07:36 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Triggering sync for uuid 95ca0697-22b5-4109-868f-ca5556015a1f {{(pid=74190) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 18 12:07:36 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Triggering sync for uuid 42413a94-9973-4e8d-83b6-207a4e7847c1 {{(pid=74190) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 18 12:07:36 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Triggering sync for uuid 772b126c-2148-4ca8-90f2-69d6eb4b7db7 {{(pid=74190) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 18 12:07:36 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Triggering sync for uuid 0382820d-a678-4593-85df-168f42fc4ce4 {{(pid=74190) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 18 12:07:36 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Triggering sync for uuid 2f59adf3-9728-4d5b-87d5-2ad32c99d06e {{(pid=74190) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 18 12:07:36 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Triggering sync for uuid 7f79a267-5bc8-4fa0-9e3a-4706fa1da142 {{(pid=74190) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 18 12:07:36 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Triggering sync for uuid b1e27a16-43e4-4e80-9c0a-5c2dce06daae {{(pid=74190) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 18 12:07:36 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Triggering sync for uuid 1b169141-68f3-4a5a-ad03-d29c37d39f69 {{(pid=74190) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 18 12:07:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "4e916d24-9f9d-4289-87ce-f65d2499fcd9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:07:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "4e916d24-9f9d-4289-87ce-f65d2499fcd9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:07:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "95ca0697-22b5-4109-868f-ca5556015a1f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:07:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "95ca0697-22b5-4109-868f-ca5556015a1f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:07:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "42413a94-9973-4e8d-83b6-207a4e7847c1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:07:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "42413a94-9973-4e8d-83b6-207a4e7847c1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:07:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "772b126c-2148-4ca8-90f2-69d6eb4b7db7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:07:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "772b126c-2148-4ca8-90f2-69d6eb4b7db7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:07:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "0382820d-a678-4593-85df-168f42fc4ce4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:07:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "0382820d-a678-4593-85df-168f42fc4ce4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:07:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "2f59adf3-9728-4d5b-87d5-2ad32c99d06e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:07:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "2f59adf3-9728-4d5b-87d5-2ad32c99d06e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:07:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "7f79a267-5bc8-4fa0-9e3a-4706fa1da142" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:07:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "7f79a267-5bc8-4fa0-9e3a-4706fa1da142" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:07:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "b1e27a16-43e4-4e80-9c0a-5c2dce06daae" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:07:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "b1e27a16-43e4-4e80-9c0a-5c2dce06daae" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:07:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "1b169141-68f3-4a5a-ad03-d29c37d39f69" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:07:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "1b169141-68f3-4a5a-ad03-d29c37d39f69" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:07:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "4e916d24-9f9d-4289-87ce-f65d2499fcd9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.039s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:07:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "42413a94-9973-4e8d-83b6-207a4e7847c1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.044s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:07:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "772b126c-2148-4ca8-90f2-69d6eb4b7db7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.048s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:07:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "95ca0697-22b5-4109-868f-ca5556015a1f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.051s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:07:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "7f79a267-5bc8-4fa0-9e3a-4706fa1da142" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.051s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:07:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "2f59adf3-9728-4d5b-87d5-2ad32c99d06e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.055s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:07:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "1b169141-68f3-4a5a-ad03-d29c37d39f69" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.061s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:07:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "b1e27a16-43e4-4e80-9c0a-5c2dce06daae" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.063s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:07:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "0382820d-a678-4593-85df-168f42fc4ce4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.081s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:07:40 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:07:41 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Acquiring lock "5861a219-456a-43dd-898c-a99ed3051d83" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:07:41 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lock "5861a219-456a-43dd-898c-a99ed3051d83" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:07:41 user nova-compute[74190]: DEBUG nova.compute.manager [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] Starting instance... {{(pid=74190) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 12:07:41 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:07:41 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:07:41 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74190) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 12:07:41 user nova-compute[74190]: INFO nova.compute.claims [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] Claim successful on node user
Oct 18 12:07:42 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 12:07:42 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 12:07:42 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.454s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:07:42 user nova-compute[74190]: DEBUG nova.compute.manager [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] Start building networks asynchronously for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 12:07:42 user nova-compute[74190]: DEBUG nova.compute.manager [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] Allocating IP information in the background. {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 12:07:42 user nova-compute[74190]: DEBUG nova.network.neutron [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] allocate_for_instance() {{(pid=74190) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 12:07:42 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 12:07:42 user nova-compute[74190]: DEBUG nova.compute.manager [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] Start building block device mappings for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 12:07:42 user nova-compute[74190]: INFO nova.virt.block_device [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] Booting with volume-backed-image 6e88bbf0-6e78-49a8-b3c5-9453d22a89df at /dev/vda
Oct 18 12:07:42 user nova-compute[74190]: DEBUG nova.policy [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7fa675b6803f4e21b090295b51fb9ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d994366010142519ff367fa7ca77e61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74190) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 12:07:42 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:07:42 user nova-compute[74190]: DEBUG nova.network.neutron [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] Successfully created port: f1268427-9b33-481f-b7dc-2e397d6d2da9 {{(pid=74190) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 12:07:43 user nova-compute[74190]: DEBUG nova.network.neutron [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] Successfully updated port: f1268427-9b33-481f-b7dc-2e397d6d2da9 {{(pid=74190) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 12:07:43 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Acquiring lock "refresh_cache-5861a219-456a-43dd-898c-a99ed3051d83" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:07:43 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Acquired lock "refresh_cache-5861a219-456a-43dd-898c-a99ed3051d83" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:07:43 user nova-compute[74190]: DEBUG nova.network.neutron [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] Building network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 12:07:43 user nova-compute[74190]: DEBUG nova.compute.manager [req-c69175f7-bb2d-4316-8a6b-b7f27c03fd9b req-afaa72e8-1584-43ea-86cf-446889cced46 service nova] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] Received event network-changed-f1268427-9b33-481f-b7dc-2e397d6d2da9 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:07:43 user nova-compute[74190]: DEBUG nova.compute.manager [req-c69175f7-bb2d-4316-8a6b-b7f27c03fd9b req-afaa72e8-1584-43ea-86cf-446889cced46 service nova] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] Refreshing instance network info cache due to event network-changed-f1268427-9b33-481f-b7dc-2e397d6d2da9. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 12:07:43 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-c69175f7-bb2d-4316-8a6b-b7f27c03fd9b req-afaa72e8-1584-43ea-86cf-446889cced46 service nova] Acquiring lock "refresh_cache-5861a219-456a-43dd-898c-a99ed3051d83" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:07:43 user nova-compute[74190]: DEBUG nova.network.neutron [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] Instance cache missing network info. {{(pid=74190) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 12:07:43 user nova-compute[74190]: DEBUG nova.network.neutron [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] Updating instance_info_cache with network_info: [{"id": "f1268427-9b33-481f-b7dc-2e397d6d2da9", "address": "fa:16:3e:ed:cb:95", "network": {"id": "c2dbbd24-f1d2-47a2-835f-0f9b24b585f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-920140900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d994366010142519ff367fa7ca77e61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1268427-9b", "ovs_interfaceid": "f1268427-9b33-481f-b7dc-2e397d6d2da9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:07:43 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Releasing lock "refresh_cache-5861a219-456a-43dd-898c-a99ed3051d83" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:07:43 user nova-compute[74190]: DEBUG nova.compute.manager [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] Instance network_info: |[{"id": "f1268427-9b33-481f-b7dc-2e397d6d2da9", "address": "fa:16:3e:ed:cb:95", "network": {"id": "c2dbbd24-f1d2-47a2-835f-0f9b24b585f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-920140900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d994366010142519ff367fa7ca77e61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1268427-9b", "ovs_interfaceid": "f1268427-9b33-481f-b7dc-2e397d6d2da9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 12:07:43 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-c69175f7-bb2d-4316-8a6b-b7f27c03fd9b req-afaa72e8-1584-43ea-86cf-446889cced46 service nova] Acquired lock "refresh_cache-5861a219-456a-43dd-898c-a99ed3051d83" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:07:43 user nova-compute[74190]: DEBUG nova.network.neutron [req-c69175f7-bb2d-4316-8a6b-b7f27c03fd9b req-afaa72e8-1584-43ea-86cf-446889cced46 service nova] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] Refreshing network info cache for port f1268427-9b33-481f-b7dc-2e397d6d2da9 {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 12:07:44 user nova-compute[74190]: DEBUG nova.network.neutron [req-c69175f7-bb2d-4316-8a6b-b7f27c03fd9b req-afaa72e8-1584-43ea-86cf-446889cced46 service nova] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] Updated VIF entry in instance network info cache for port f1268427-9b33-481f-b7dc-2e397d6d2da9. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 12:07:44 user nova-compute[74190]: DEBUG nova.network.neutron [req-c69175f7-bb2d-4316-8a6b-b7f27c03fd9b req-afaa72e8-1584-43ea-86cf-446889cced46 service nova] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] Updating instance_info_cache with network_info: [{"id": "f1268427-9b33-481f-b7dc-2e397d6d2da9", "address": "fa:16:3e:ed:cb:95", "network": {"id": "c2dbbd24-f1d2-47a2-835f-0f9b24b585f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-920140900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d994366010142519ff367fa7ca77e61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1268427-9b", "ovs_interfaceid": "f1268427-9b33-481f-b7dc-2e397d6d2da9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:07:44 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-c69175f7-bb2d-4316-8a6b-b7f27c03fd9b req-afaa72e8-1584-43ea-86cf-446889cced46 service nova] Releasing lock "refresh_cache-5861a219-456a-43dd-898c-a99ed3051d83" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:07:45 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:07:50 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:07:51 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-894f26f2-5b7d-4ca3-ae96-50bb83a88750 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Acquiring lock "2f59adf3-9728-4d5b-87d5-2ad32c99d06e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:07:51 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-894f26f2-5b7d-4ca3-ae96-50bb83a88750 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Lock "2f59adf3-9728-4d5b-87d5-2ad32c99d06e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:07:51 user nova-compute[74190]: DEBUG nova.objects.instance [None req-894f26f2-5b7d-4ca3-ae96-50bb83a88750 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Lazy-loading 'flavor' on Instance uuid 2f59adf3-9728-4d5b-87d5-2ad32c99d06e {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:07:51 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-894f26f2-5b7d-4ca3-ae96-50bb83a88750 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Lock "2f59adf3-9728-4d5b-87d5-2ad32c99d06e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.081s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:07:52 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-894f26f2-5b7d-4ca3-ae96-50bb83a88750 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Acquiring lock "2f59adf3-9728-4d5b-87d5-2ad32c99d06e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:07:52 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-894f26f2-5b7d-4ca3-ae96-50bb83a88750 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Lock "2f59adf3-9728-4d5b-87d5-2ad32c99d06e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:07:52 user nova-compute[74190]: INFO nova.compute.manager [None req-894f26f2-5b7d-4ca3-ae96-50bb83a88750 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] Attaching volume e3078e3b-8ce3-402e-9d09-bbb4f2862d2c to /dev/vdb
Oct 18 12:07:52 user nova-compute[74190]: DEBUG os_brick.utils [None req-894f26f2-5b7d-4ca3-ae96-50bb83a88750 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 12:07:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:07:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:07:52 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da925fb-ee79-4d40-ac86-e7392951c4a5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cff158e257e1\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:07:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:07:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:07:52 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b9ece1-1c0a-47d3-adf6-81b415d5de70]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:07:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:07:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:07:52 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[65897d80-d854-4a3e-b68f-8e6dc4daeaff]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:07:52 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef58b93-e432-47dc-951b-65fb7f5b9193]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:07:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-894f26f2-5b7d-4ca3-ae96-50bb83a88750 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Running cmd (subprocess): nvme version {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:07:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-894f26f2-5b7d-4ca3-ae96-50bb83a88750 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] 'nvme version' failed. Not Retrying. {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 12:07:52 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.nvmeof [None req-894f26f2-5b7d-4ca3-ae96-50bb83a88750 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] nvme not present on system {{(pid=74190) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 12:07:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:07:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 12:07:52 user nova-compute[74190]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 12:07:52 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[c73a016f-653d-4cc8-a463-1d2e41f1f673]: (4, '') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:07:52 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-894f26f2-5b7d-4ca3-ae96-50bb83a88750 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74190) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 12:07:52 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-894f26f2-5b7d-4ca3-ae96-50bb83a88750 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 12:07:52 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-894f26f2-5b7d-4ca3-ae96-50bb83a88750 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] LIGHTOS: no hostnqn found. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 12:07:52 user nova-compute[74190]: DEBUG os_brick.utils [None req-894f26f2-5b7d-4ca3-ae96-50bb83a88750 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cff158e257e1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 12:07:52 user nova-compute[74190]: DEBUG nova.virt.block_device [None req-894f26f2-5b7d-4ca3-ae96-50bb83a88750 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] Updating existing volume attachment record: 3cf7e596-cf5f-4c1d-a010-900fe50ce61b {{(pid=74190) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 12:07:55 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:07:55 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:07:57 user nova-compute[74190]: DEBUG os_brick.utils [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 12:07:57 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:07:58 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:07:58 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[13dbbd96-2366-4e33-a10b-85eb782099b2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cff158e257e1\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:07:58 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:07:58 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:07:58 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e76aa1-07e6-4c17-affc-98a7c04af279]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:07:58 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:07:58 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:07:58 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a476667-bcad-448d-a555-69669e8608fe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:07:58 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8829157-541d-4e9c-9cad-cac0d913063f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:07:58 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Running cmd (subprocess): nvme version {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:07:58 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] 'nvme version' failed. Not Retrying. {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 12:07:58 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] nvme not present on system {{(pid=74190) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 12:07:58 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:07:58 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 12:07:58 user nova-compute[74190]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 12:07:58 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[26be6164-e686-4712-8adf-1afb78c3859f]: (4, '') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:07:58 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74190) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 12:07:58 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 12:07:58 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] LIGHTOS: no hostnqn found. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 12:07:58 user nova-compute[74190]: DEBUG os_brick.utils [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cff158e257e1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 12:07:58 user nova-compute[74190]: DEBUG nova.virt.block_device [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] Updating existing volume attachment record: 60005d72-802a-40db-b255-a7d3d822166b {{(pid=74190) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 12:08:00 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:08:00 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:08:02 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-feb2d68b-1860-4351-bc67-5157394f0c04 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Acquiring lock "1b169141-68f3-4a5a-ad03-d29c37d39f69" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:08:02 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-feb2d68b-1860-4351-bc67-5157394f0c04 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "1b169141-68f3-4a5a-ad03-d29c37d39f69" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:08:02 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-feb2d68b-1860-4351-bc67-5157394f0c04 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Acquiring lock "1b169141-68f3-4a5a-ad03-d29c37d39f69-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:08:02 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-feb2d68b-1860-4351-bc67-5157394f0c04 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "1b169141-68f3-4a5a-ad03-d29c37d39f69-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:08:02 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-feb2d68b-1860-4351-bc67-5157394f0c04 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "1b169141-68f3-4a5a-ad03-d29c37d39f69-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:08:02 user nova-compute[74190]: INFO nova.compute.manager [None req-feb2d68b-1860-4351-bc67-5157394f0c04 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 1b169141-68f3-4a5a-ad03-d29c37d39f69] Terminating instance
Oct 18 12:08:02 user nova-compute[74190]: DEBUG nova.compute.manager [None req-feb2d68b-1860-4351-bc67-5157394f0c04 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 1b169141-68f3-4a5a-ad03-d29c37d39f69] Start destroying the instance on the hypervisor. {{(pid=74190) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 12:08:02 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:08:02 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:08:02 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:08:02 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:08:02 user nova-compute[74190]: DEBUG nova.compute.manager [req-99d8d9b7-2ba5-4972-a616-af712a69f3a7 req-e6561c31-067b-4f7a-a45d-ab94967280b4 service nova] [instance: 1b169141-68f3-4a5a-ad03-d29c37d39f69] Received event network-vif-unplugged-bfe79254-95f6-4c3b-914e-85874a28731e {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:08:02 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-99d8d9b7-2ba5-4972-a616-af712a69f3a7 req-e6561c31-067b-4f7a-a45d-ab94967280b4 service nova] Acquiring lock "1b169141-68f3-4a5a-ad03-d29c37d39f69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:08:02 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-99d8d9b7-2ba5-4972-a616-af712a69f3a7 req-e6561c31-067b-4f7a-a45d-ab94967280b4 service nova] Lock "1b169141-68f3-4a5a-ad03-d29c37d39f69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:08:02 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-99d8d9b7-2ba5-4972-a616-af712a69f3a7 req-e6561c31-067b-4f7a-a45d-ab94967280b4 service nova] Lock "1b169141-68f3-4a5a-ad03-d29c37d39f69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:08:02 user nova-compute[74190]: DEBUG nova.compute.manager [req-99d8d9b7-2ba5-4972-a616-af712a69f3a7 req-e6561c31-067b-4f7a-a45d-ab94967280b4 service nova] [instance: 1b169141-68f3-4a5a-ad03-d29c37d39f69] No waiting events found dispatching network-vif-unplugged-bfe79254-95f6-4c3b-914e-85874a28731e {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:08:02 user nova-compute[74190]: DEBUG nova.compute.manager [req-99d8d9b7-2ba5-4972-a616-af712a69f3a7 req-e6561c31-067b-4f7a-a45d-ab94967280b4 service nova] [instance: 1b169141-68f3-4a5a-ad03-d29c37d39f69] Received event network-vif-unplugged-bfe79254-95f6-4c3b-914e-85874a28731e for instance with task_state deleting. {{(pid=74190) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 12:08:03 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 1b169141-68f3-4a5a-ad03-d29c37d39f69] Instance destroyed successfully.
Oct 18 12:08:03 user nova-compute[74190]: DEBUG nova.objects.instance [None req-feb2d68b-1860-4351-bc67-5157394f0c04 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lazy-loading 'resources' on Instance uuid 1b169141-68f3-4a5a-ad03-d29c37d39f69 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:08:03 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-feb2d68b-1860-4351-bc67-5157394f0c04 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T12:06:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1120029390',display_name='tempest-TestVolumeBootPattern-server-1120029390',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1120029390',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-18T12:06:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1e375153f6f24827811c5825fc2a2c6a',ramdisk_id='',reservation_id='r-0irby1jy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1157442382',owner_user_name='tempest-TestVolumeBootPattern-1157442382-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T12:06:42Z,user_data=None,user_id='27d9fc244d0f4e10a43b7df4dc8e30ad',uuid=1b169141-68f3-4a5a-ad03-d29c37d39f69,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bfe79254-95f6-4c3b-914e-85874a28731e", "address": "fa:16:3e:6b:cb:19", "network": {"id": "aa827f81-b165-444f-89cc-f21c42a9f772", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1659902586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e375153f6f24827811c5825fc2a2c6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfe79254-95", "ovs_interfaceid": "bfe79254-95f6-4c3b-914e-85874a28731e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 12:08:03 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-feb2d68b-1860-4351-bc67-5157394f0c04 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Converting VIF {"id": "bfe79254-95f6-4c3b-914e-85874a28731e", "address": "fa:16:3e:6b:cb:19", "network": {"id": "aa827f81-b165-444f-89cc-f21c42a9f772", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1659902586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e375153f6f24827811c5825fc2a2c6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfe79254-95", "ovs_interfaceid": "bfe79254-95f6-4c3b-914e-85874a28731e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 12:08:03 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-feb2d68b-1860-4351-bc67-5157394f0c04 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:cb:19,bridge_name='br-int',has_traffic_filtering=True,id=bfe79254-95f6-4c3b-914e-85874a28731e,network=Network(aa827f81-b165-444f-89cc-f21c42a9f772),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfe79254-95') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 12:08:03 user nova-compute[74190]: DEBUG os_vif [None req-feb2d68b-1860-4351-bc67-5157394f0c04 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:cb:19,bridge_name='br-int',has_traffic_filtering=True,id=bfe79254-95f6-4c3b-914e-85874a28731e,network=Network(aa827f81-b165-444f-89cc-f21c42a9f772),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfe79254-95') {{(pid=74190) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 12:08:03 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:08:03 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbfe79254-95, bridge=br-int, if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:08:03 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:08:03 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:08:03 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ff1a5b31-5f70-4156-92e1-b1afb67c3d89) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:08:03 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:08:03 user nova-compute[74190]: INFO os_vif [None req-feb2d68b-1860-4351-bc67-5157394f0c04 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:cb:19,bridge_name='br-int',has_traffic_filtering=True,id=bfe79254-95f6-4c3b-914e-85874a28731e,network=Network(aa827f81-b165-444f-89cc-f21c42a9f772),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfe79254-95')
Oct 18 12:08:03 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-feb2d68b-1860-4351-bc67-5157394f0c04 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 1b169141-68f3-4a5a-ad03-d29c37d39f69] calling os-brick to detach iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 12:08:03 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-feb2d68b-1860-4351-bc67-5157394f0c04 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, {'target_iqn': 'iqn.2010-10.org.openstack:2e780d69-215f-42df-9312-69b207f13eb7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ELFzChrT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 12:08:03 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-feb2d68b-1860-4351-bc67-5157394f0c04 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 12:08:03 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-feb2d68b-1860-4351-bc67-5157394f0c04 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 12:08:03 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-feb2d68b-1860-4351-bc67-5157394f0c04 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 12:08:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:08:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:08:03 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[935e9813-6026-4b76-83b5-cac60ef1634b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e780d69-215f-42df-9312-69b207f13eb7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:08:03 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-feb2d68b-1860-4351-bc67-5157394f0c04 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 12:08:03 user nova-compute[74190]: No targets found.
Oct 18 12:08:03 user nova-compute[74190]: iSNS:
Oct 18 12:08:03 user nova-compute[74190]: No targets found.
Oct 18 12:08:03 user nova-compute[74190]: STATIC:
Oct 18 12:08:03 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f
Oct 18 12:08:03 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 12:08:03 user nova-compute[74190]:                 Iface Name: default
Oct 18 12:08:03 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa
Oct 18 12:08:03 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 12:08:03 user nova-compute[74190]:                 Iface Name: default
Oct 18 12:08:03 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:2e780d69-215f-42df-9312-69b207f13eb7
Oct 18 12:08:03 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 12:08:03 user nova-compute[74190]:                 Iface Name: default
Oct 18 12:08:03 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f
Oct 18 12:08:03 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 12:08:03 user nova-compute[74190]:                 Iface Name: default
Oct 18 12:08:03 user nova-compute[74190]: FIRMWARE:
Oct 18 12:08:03 user nova-compute[74190]: No targets found.
Oct 18 12:08:03 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 12:08:03 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-feb2d68b-1860-4351-bc67-5157394f0c04 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 12:08:03 user nova-compute[74190]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 12:08:03 user nova-compute[74190]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74190) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 12:08:03 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-feb2d68b-1860-4351-bc67-5157394f0c04 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e780d69-215f-42df-9312-69b207f13eb7', 0)] {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 12:08:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:08:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:08:03 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[a33afd96-cef0-41dc-aec9-3e7fa863f07c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e780d69-215f-42df-9312-69b207f13eb7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:08:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:08:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:08:03 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[8812cee8-f1a9-48f2-a25d-27a8283ede45]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e780d69-215f-42df-9312-69b207f13eb7 (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:08:03 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-feb2d68b-1860-4351-bc67-5157394f0c04 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 12:08:03 user nova-compute[74190]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)
Oct 18 12:08:03 user nova-compute[74190]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f (non-flash)
Oct 18 12:08:03 user nova-compute[74190]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e780d69-215f-42df-9312-69b207f13eb7 (non-flash)
Oct 18 12:08:03 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 12:08:03 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-feb2d68b-1860-4351-bc67-5157394f0c04 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 12:08:03 user nova-compute[74190]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)
Oct 18 12:08:03 user nova-compute[74190]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f (non-flash)
Oct 18 12:08:03 user nova-compute[74190]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e780d69-215f-42df-9312-69b207f13eb7 (non-flash)
Oct 18 12:08:03 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 12:08:03 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-feb2d68b-1860-4351-bc67-5157394f0c04 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1f24796b00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e780d69-215f-42df-9312-69b207f13eb7'): ({'sde'}, set())}) {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 12:08:03 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-feb2d68b-1860-4351-bc67-5157394f0c04 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Removing single pathed devices sde {{(pid=74190) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 12:08:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:08:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:08:03 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd283fb-793c-4fa2-b595-ae9f7bc0ba58]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:08:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:08:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:08:03 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb2976d8-89fa-4172-ad9e-b473af06cc39]: (4, ('ok\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:08:03 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-feb2d68b-1860-4351-bc67-5157394f0c04 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Flushing IO for device /dev/sde {{(pid=74190) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 12:08:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:08:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:08:03 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c82d29-e74a-4027-abd2-1fc14f797e2a]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:08:03 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-feb2d68b-1860-4351-bc67-5157394f0c04 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74190) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 12:08:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:08:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.059s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:08:03 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[b069ef4e-e755-4208-8e6b-e73ce0a900cb]: (4, ('1', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:08:03 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-feb2d68b-1860-4351-bc67-5157394f0c04 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 12:08:03 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-feb2d68b-1860-4351-bc67-5157394f0c04 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] SCSI volumes sde have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 12:08:03 user nova-compute[74190]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOc1146a6d-4c8879a68f398224', '/dev/disk/by-id/scsi-23463383837396136', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_c1146a6d') {{(pid=85217) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 18 12:08:03 user nova-compute[74190]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOc1146a6d-4c8879a68f398224
Oct 18 12:08:03 user nova-compute[74190]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23463383837396136
Oct 18 12:08:03 user nova-compute[74190]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_c1146a6d
Oct 18 12:08:03 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[808133f4-3a81-43de-9df1-26d46f6e6c5e]: (4, None) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:08:03 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-feb2d68b-1860-4351-bc67-5157394f0c04 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e780d69-215f-42df-9312-69b207f13eb7')] {{(pid=74190) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 12:08:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e780d69-215f-42df-9312-69b207f13eb7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:08:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e780d69-215f-42df-9312-69b207f13eb7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:08:03 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[b71e10c8-c5d5-41e3-bef9-7c38e2e7b113]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:08:03 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-feb2d68b-1860-4351-bc67-5157394f0c04 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:08:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e780d69-215f-42df-9312-69b207f13eb7 -p 172.16.0.220:3260 --logout {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:08:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e780d69-215f-42df-9312-69b207f13eb7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:08:03 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7601193-19c6-44bf-8b6c-72796c6d636c]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:2e780d69-215f-42df-9312-69b207f13eb7, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:2e780d69-215f-42df-9312-69b207f13eb7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:08:03 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-feb2d68b-1860-4351-bc67-5157394f0c04 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:2e780d69-215f-42df-9312-69b207f13eb7, portal: 172.16.0.220,3260]
Oct 18 12:08:03 user nova-compute[74190]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:2e780d69-215f-42df-9312-69b207f13eb7, portal: 172.16.0.220,3260] successful.
Oct 18 12:08:03 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:08:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e780d69-215f-42df-9312-69b207f13eb7 -p 172.16.0.220:3260 --op delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:08:03 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e780d69-215f-42df-9312-69b207f13eb7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:08:03 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cfd4337-682d-4b1d-9acb-0991abe830b2]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:08:03 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-feb2d68b-1860-4351-bc67-5157394f0c04 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:08:03 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-feb2d68b-1860-4351-bc67-5157394f0c04 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.383s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 12:08:03 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-feb2d68b-1860-4351-bc67-5157394f0c04 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] <== disconnect_volume: return (385ms) None {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 12:08:03 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-feb2d68b-1860-4351-bc67-5157394f0c04 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 1b169141-68f3-4a5a-ad03-d29c37d39f69] Disconnected iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 12:08:03 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-feb2d68b-1860-4351-bc67-5157394f0c04 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 1b169141-68f3-4a5a-ad03-d29c37d39f69] Deleting instance files /opt/stack/data/nova/instances/1b169141-68f3-4a5a-ad03-d29c37d39f69_del
Oct 18 12:08:03 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-feb2d68b-1860-4351-bc67-5157394f0c04 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 1b169141-68f3-4a5a-ad03-d29c37d39f69] Deletion of /opt/stack/data/nova/instances/1b169141-68f3-4a5a-ad03-d29c37d39f69_del complete
Oct 18 12:08:03 user nova-compute[74190]: INFO nova.compute.manager [None req-feb2d68b-1860-4351-bc67-5157394f0c04 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 1b169141-68f3-4a5a-ad03-d29c37d39f69] Took 1.30 seconds to destroy the instance on the hypervisor.
Oct 18 12:08:03 user nova-compute[74190]: DEBUG oslo.service.loopingcall [None req-feb2d68b-1860-4351-bc67-5157394f0c04 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74190) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 12:08:03 user nova-compute[74190]: DEBUG nova.compute.manager [-] [instance: 1b169141-68f3-4a5a-ad03-d29c37d39f69] Deallocating network for instance {{(pid=74190) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 12:08:03 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: 1b169141-68f3-4a5a-ad03-d29c37d39f69] deallocate_for_instance() {{(pid=74190) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 12:08:04 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: 1b169141-68f3-4a5a-ad03-d29c37d39f69] Updating instance_info_cache with network_info: [] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:08:04 user nova-compute[74190]: INFO nova.compute.manager [-] [instance: 1b169141-68f3-4a5a-ad03-d29c37d39f69] Took 0.49 seconds to deallocate network for instance.
Oct 18 12:08:05 user nova-compute[74190]: DEBUG nova.compute.manager [req-f35fe2df-bec0-4849-bfc7-ec0233ed59e1 req-aaa00c00-47a7-458d-83c3-d200d93acb52 service nova] [instance: 1b169141-68f3-4a5a-ad03-d29c37d39f69] Received event network-vif-plugged-bfe79254-95f6-4c3b-914e-85874a28731e {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:08:05 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-f35fe2df-bec0-4849-bfc7-ec0233ed59e1 req-aaa00c00-47a7-458d-83c3-d200d93acb52 service nova] Acquiring lock "1b169141-68f3-4a5a-ad03-d29c37d39f69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:08:05 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-f35fe2df-bec0-4849-bfc7-ec0233ed59e1 req-aaa00c00-47a7-458d-83c3-d200d93acb52 service nova] Lock "1b169141-68f3-4a5a-ad03-d29c37d39f69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:08:05 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-f35fe2df-bec0-4849-bfc7-ec0233ed59e1 req-aaa00c00-47a7-458d-83c3-d200d93acb52 service nova] Lock "1b169141-68f3-4a5a-ad03-d29c37d39f69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:08:05 user nova-compute[74190]: DEBUG nova.compute.manager [req-f35fe2df-bec0-4849-bfc7-ec0233ed59e1 req-aaa00c00-47a7-458d-83c3-d200d93acb52 service nova] [instance: 1b169141-68f3-4a5a-ad03-d29c37d39f69] No waiting events found dispatching network-vif-plugged-bfe79254-95f6-4c3b-914e-85874a28731e {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:08:05 user nova-compute[74190]: WARNING nova.compute.manager [req-f35fe2df-bec0-4849-bfc7-ec0233ed59e1 req-aaa00c00-47a7-458d-83c3-d200d93acb52 service nova] [instance: 1b169141-68f3-4a5a-ad03-d29c37d39f69] Received unexpected event network-vif-plugged-bfe79254-95f6-4c3b-914e-85874a28731e for instance with vm_state active and task_state deleting.
Oct 18 12:08:05 user nova-compute[74190]: DEBUG nova.compute.manager [req-f35fe2df-bec0-4849-bfc7-ec0233ed59e1 req-aaa00c00-47a7-458d-83c3-d200d93acb52 service nova] [instance: 1b169141-68f3-4a5a-ad03-d29c37d39f69] Received event network-vif-deleted-bfe79254-95f6-4c3b-914e-85874a28731e {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:08:08 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:08:08 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:08:09 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:08:09 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-894f26f2-5b7d-4ca3-ae96-50bb83a88750 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] Calling os-brick to attach iSCSI Volume {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 12:08:09 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-894f26f2-5b7d-4ca3-ae96-50bb83a88750 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e3078e3b-8ce3-402e-9d09-bbb4f2862d2c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OPZGaSso', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 12:08:09 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-894f26f2-5b7d-4ca3-ae96-50bb83a88750 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 12:08:09 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-894f26f2-5b7d-4ca3-ae96-50bb83a88750 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 12:08:09 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-894f26f2-5b7d-4ca3-ae96-50bb83a88750 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 12:08:09 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-894f26f2-5b7d-4ca3-ae96-50bb83a88750 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 12:08:09 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-894f26f2-5b7d-4ca3-ae96-50bb83a88750 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3078e3b-8ce3-402e-9d09-bbb4f2862d2c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 12:08:09 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-894f26f2-5b7d-4ca3-ae96-50bb83a88750 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3078e3b-8ce3-402e-9d09-bbb4f2862d2c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 12:08:09 user nova-compute[74190]: INFO os_brick.initiator.connectors.iscsi [None req-894f26f2-5b7d-4ca3-ae96-50bb83a88750 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 12:08:09 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3078e3b-8ce3-402e-9d09-bbb4f2862d2c -p 172.16.0.220:3260 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:08:09 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3078e3b-8ce3-402e-9d09-bbb4f2862d2c -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:08:09 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[59165d66-4b0e-4f0b-97c6-b7b74bdd085a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:08:09 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-894f26f2-5b7d-4ca3-ae96-50bb83a88750 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 12:08:09 user nova-compute[74190]:  {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:08:09 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3078e3b-8ce3-402e-9d09-bbb4f2862d2c -p 172.16.0.220:3260 --interface default --op new {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:08:09 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3078e3b-8ce3-402e-9d09-bbb4f2862d2c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:08:09 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[f492179e-48c5-4fe7-813c-f7a0542a81da]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e3078e3b-8ce3-402e-9d09-bbb4f2862d2c] added\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:08:09 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-894f26f2-5b7d-4ca3-ae96-50bb83a88750 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e3078e3b-8ce3-402e-9d09-bbb4f2862d2c] added
Oct 18 12:08:09 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:08:09 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3078e3b-8ce3-402e-9d09-bbb4f2862d2c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:08:09 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3078e3b-8ce3-402e-9d09-bbb4f2862d2c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:08:09 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c0921c-50a5-4043-b97f-1b25f40e3214]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:08:09 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-894f26f2-5b7d-4ca3-ae96-50bb83a88750 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:08:09 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3078e3b-8ce3-402e-9d09-bbb4f2862d2c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:08:09 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3078e3b-8ce3-402e-9d09-bbb4f2862d2c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:08:09 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[19a517c4-cab1-41f7-8042-55bcc03027b6]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:08:09 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-894f26f2-5b7d-4ca3-ae96-50bb83a88750 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:08:09 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3078e3b-8ce3-402e-9d09-bbb4f2862d2c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OPZGaSso {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:08:09 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3078e3b-8ce3-402e-9d09-bbb4f2862d2c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OPZGaSso" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:08:09 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b738d8-6fe8-4c93-ab3a-45c92c825d01]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:08:09 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-894f26f2-5b7d-4ca3-ae96-50bb83a88750 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OPZGaSso'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:08:09 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3078e3b-8ce3-402e-9d09-bbb4f2862d2c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:08:09 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3078e3b-8ce3-402e-9d09-bbb4f2862d2c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:08:09 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e121ed-0bed-4e5d-8858-0b3e09613d48]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:08:09 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-894f26f2-5b7d-4ca3-ae96-50bb83a88750 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:08:09 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:08:09 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:08:09 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[607c1bda-a5a5-49ee-9fe5-75819af69d63]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:08:09 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-894f26f2-5b7d-4ca3-ae96-50bb83a88750 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 12:08:09 user nova-compute[74190]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)
Oct 18 12:08:09 user nova-compute[74190]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f (non-flash)
Oct 18 12:08:09 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 12:08:09 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-894f26f2-5b7d-4ca3-ae96-50bb83a88750 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 12:08:09 user nova-compute[74190]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)
Oct 18 12:08:09 user nova-compute[74190]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f (non-flash)
Oct 18 12:08:09 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 12:08:09 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3078e3b-8ce3-402e-9d09-bbb4f2862d2c -p 172.16.0.220:3260 --login {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:08:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3078e3b-8ce3-402e-9d09-bbb4f2862d2c -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:08:10 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[6205c414-59f6-4d03-b641-7289abc1fdc6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e3078e3b-8ce3-402e-9d09-bbb4f2862d2c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e3078e3b-8ce3-402e-9d09-bbb4f2862d2c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:08:10 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-894f26f2-5b7d-4ca3-ae96-50bb83a88750 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e3078e3b-8ce3-402e-9d09-bbb4f2862d2c, portal: 172.16.0.220,3260]
Oct 18 12:08:10 user nova-compute[74190]: Login to [iface: default, target: iqn.2010-10.org.openstack:e3078e3b-8ce3-402e-9d09-bbb4f2862d2c, portal: 172.16.0.220,3260] successful.
Oct 18 12:08:10 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:08:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3078e3b-8ce3-402e-9d09-bbb4f2862d2c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:08:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3078e3b-8ce3-402e-9d09-bbb4f2862d2c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:08:10 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[6801fa45-98d7-4c35-94e8-2b6d11d5da61]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:08:10 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-894f26f2-5b7d-4ca3-ae96-50bb83a88750 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:08:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:08:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:08:10 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[640758d3-9d3c-4028-8e99-ccf60a9fdeb3]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3078e3b-8ce3-402e-9d09-bbb4f2862d2c (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:08:10 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-894f26f2-5b7d-4ca3-ae96-50bb83a88750 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 12:08:10 user nova-compute[74190]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)
Oct 18 12:08:10 user nova-compute[74190]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f (non-flash)
Oct 18 12:08:10 user nova-compute[74190]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3078e3b-8ce3-402e-9d09-bbb4f2862d2c (non-flash)
Oct 18 12:08:10 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 12:08:10 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-894f26f2-5b7d-4ca3-ae96-50bb83a88750 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 12:08:10 user nova-compute[74190]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)
Oct 18 12:08:10 user nova-compute[74190]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f (non-flash)
Oct 18 12:08:10 user nova-compute[74190]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3078e3b-8ce3-402e-9d09-bbb4f2862d2c (non-flash)
Oct 18 12:08:10 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 12:08:10 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-894f26f2-5b7d-4ca3-ae96-50bb83a88750 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3078e3b-8ce3-402e-9d09-bbb4f2862d2c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 12:08:10 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-894f26f2-5b7d-4ca3-ae96-50bb83a88750 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Connected to 172.16.0.220:3260 {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 12:08:10 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-894f26f2-5b7d-4ca3-ae96-50bb83a88750 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] HCTL ('36', '-', '-', 0) found on session 46 with lun 0 {{(pid=74190) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 12:08:10 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-894f26f2-5b7d-4ca3-ae96-50bb83a88750 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74190) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 12:08:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:08:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:08:10 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[874d5871-cd77-4227-9381-929ffd88963b]: (4, ('- - 0', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:08:10 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-894f26f2-5b7d-4ca3-ae96-50bb83a88750 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Searching for a device in session 46 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74190) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 12:08:10 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-894f26f2-5b7d-4ca3-ae96-50bb83a88750 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:e3078e3b-8ce3-402e-9d09-bbb4f2862d2c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OPZGaSso', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 12:08:11 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:08:11 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-894f26f2-5b7d-4ca3-ae96-50bb83a88750 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 12:08:11 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-894f26f2-5b7d-4ca3-ae96-50bb83a88750 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '26335336463323433', 'path': '/dev/sde'} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 12:08:11 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-894f26f2-5b7d-4ca3-ae96-50bb83a88750 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26335336463323433', 'path': '/dev/sde'} {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 12:08:11 user nova-compute[74190]: DEBUG nova.objects.instance [None req-894f26f2-5b7d-4ca3-ae96-50bb83a88750 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Lazy-loading 'flavor' on Instance uuid 2f59adf3-9728-4d5b-87d5-2ad32c99d06e {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:08:11 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-894f26f2-5b7d-4ca3-ae96-50bb83a88750 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] attach device xml: <disk type="block" device="disk">
Oct 18 12:08:11 user nova-compute[74190]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 12:08:11 user nova-compute[74190]:   <source dev="/dev/sde"/>
Oct 18 12:08:11 user nova-compute[74190]:   <target dev="vdb" bus="virtio"/>
Oct 18 12:08:11 user nova-compute[74190]:   <serial>e3078e3b-8ce3-402e-9d09-bbb4f2862d2c</serial>
Oct 18 12:08:11 user nova-compute[74190]: </disk>
Oct 18 12:08:11 user nova-compute[74190]:  {{(pid=74190) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 18 12:08:11 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-894f26f2-5b7d-4ca3-ae96-50bb83a88750 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] No BDM found with device name vda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 12:08:11 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-894f26f2-5b7d-4ca3-ae96-50bb83a88750 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 12:08:11 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-894f26f2-5b7d-4ca3-ae96-50bb83a88750 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] No VIF found with MAC fa:16:3e:5c:73:bc, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 12:08:11 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-894f26f2-5b7d-4ca3-ae96-50bb83a88750 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Lock "2f59adf3-9728-4d5b-87d5-2ad32c99d06e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.609s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:08:13 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:08:14 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-c1d98609-d6b7-4fcf-a497-ec696770918a tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Acquiring lock "2f59adf3-9728-4d5b-87d5-2ad32c99d06e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:08:14 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-c1d98609-d6b7-4fcf-a497-ec696770918a tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Lock "2f59adf3-9728-4d5b-87d5-2ad32c99d06e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:08:14 user nova-compute[74190]: INFO nova.compute.manager [None req-c1d98609-d6b7-4fcf-a497-ec696770918a tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] Detaching volume e3078e3b-8ce3-402e-9d09-bbb4f2862d2c
Oct 18 12:08:14 user nova-compute[74190]: INFO nova.virt.block_device [None req-c1d98609-d6b7-4fcf-a497-ec696770918a tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] Attempting to driver detach volume e3078e3b-8ce3-402e-9d09-bbb4f2862d2c from mountpoint /dev/vdb
Oct 18 12:08:14 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-c1d98609-d6b7-4fcf-a497-ec696770918a tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Attempting to detach device vdb from instance 2f59adf3-9728-4d5b-87d5-2ad32c99d06e from the persistent domain config. {{(pid=74190) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 18 12:08:14 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-c1d98609-d6b7-4fcf-a497-ec696770918a tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 12:08:14 user nova-compute[74190]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 12:08:14 user nova-compute[74190]:   <source dev="/dev/sde"/>
Oct 18 12:08:14 user nova-compute[74190]:   <target dev="vdb" bus="virtio"/>
Oct 18 12:08:14 user nova-compute[74190]:   <serial>e3078e3b-8ce3-402e-9d09-bbb4f2862d2c</serial>
Oct 18 12:08:14 user nova-compute[74190]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 18 12:08:14 user nova-compute[74190]: </disk>
Oct 18 12:08:14 user nova-compute[74190]:  {{(pid=74190) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 12:08:14 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-c1d98609-d6b7-4fcf-a497-ec696770918a tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Successfully detached device vdb from instance 2f59adf3-9728-4d5b-87d5-2ad32c99d06e from the persistent domain config.
Oct 18 12:08:14 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-c1d98609-d6b7-4fcf-a497-ec696770918a tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2f59adf3-9728-4d5b-87d5-2ad32c99d06e from the live domain config. {{(pid=74190) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 18 12:08:14 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-c1d98609-d6b7-4fcf-a497-ec696770918a tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 12:08:14 user nova-compute[74190]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 12:08:14 user nova-compute[74190]:   <source dev="/dev/sde"/>
Oct 18 12:08:14 user nova-compute[74190]:   <target dev="vdb" bus="virtio"/>
Oct 18 12:08:14 user nova-compute[74190]:   <serial>e3078e3b-8ce3-402e-9d09-bbb4f2862d2c</serial>
Oct 18 12:08:14 user nova-compute[74190]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 18 12:08:14 user nova-compute[74190]: </disk>
Oct 18 12:08:14 user nova-compute[74190]:  {{(pid=74190) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 12:08:14 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-c1d98609-d6b7-4fcf-a497-ec696770918a tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2f59adf3-9728-4d5b-87d5-2ad32c99d06e {{(pid=74190) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 18 12:08:15 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:08:15 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Starting heal instance info cache {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 12:08:15 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "refresh_cache-2f59adf3-9728-4d5b-87d5-2ad32c99d06e" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:08:15 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquired lock "refresh_cache-2f59adf3-9728-4d5b-87d5-2ad32c99d06e" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:08:15 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] Forcefully refreshing network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 18 12:08:15 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:08:15 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] Updating instance_info_cache with network_info: [{"id": "9817302c-2890-4026-86e9-061ca2d1497a", "address": "fa:16:3e:5c:73:bc", "network": {"id": "60c208d8-33b0-4c65-8ac5-5632b2e428df", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-39693250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "423525b841c84a6f8fe6a72da9cccef2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9817302c-28", "ovs_interfaceid": "9817302c-2890-4026-86e9-061ca2d1497a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:08:15 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Releasing lock "refresh_cache-2f59adf3-9728-4d5b-87d5-2ad32c99d06e" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:08:15 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] Updated the network info_cache for instance {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 18 12:08:16 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:08:17 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:08:17 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74190) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 12:08:17 user nova-compute[74190]: INFO nova.compute.manager [None req-feb2d68b-1860-4351-bc67-5157394f0c04 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 1b169141-68f3-4a5a-ad03-d29c37d39f69] Took 12.86 seconds to detach 1 volumes for instance.
Oct 18 12:08:17 user nova-compute[74190]: DEBUG nova.compute.manager [None req-feb2d68b-1860-4351-bc67-5157394f0c04 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 1b169141-68f3-4a5a-ad03-d29c37d39f69] Deleting volume: 2e780d69-215f-42df-9312-69b207f13eb7 {{(pid=74190) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 18 12:08:17 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-feb2d68b-1860-4351-bc67-5157394f0c04 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:08:17 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-feb2d68b-1860-4351-bc67-5157394f0c04 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:08:17 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-feb2d68b-1860-4351-bc67-5157394f0c04 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Refreshing inventories for resource provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 18 12:08:17 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-feb2d68b-1860-4351-bc67-5157394f0c04 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Updating ProviderTree inventory for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 18 12:08:17 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-feb2d68b-1860-4351-bc67-5157394f0c04 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Updating inventory in ProviderTree for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 18 12:08:17 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-feb2d68b-1860-4351-bc67-5157394f0c04 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Refreshing aggregate associations for resource provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66, aggregates: None {{(pid=74190) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 18 12:08:17 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-feb2d68b-1860-4351-bc67-5157394f0c04 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Refreshing trait associations for resource provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66, traits: COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE42,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_ACCELERATORS,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=74190) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 18 12:08:17 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-feb2d68b-1860-4351-bc67-5157394f0c04 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 12:08:17 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-feb2d68b-1860-4351-bc67-5157394f0c04 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 12:08:17 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-feb2d68b-1860-4351-bc67-5157394f0c04 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.484s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:08:17 user nova-compute[74190]: INFO nova.scheduler.client.report [None req-feb2d68b-1860-4351-bc67-5157394f0c04 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Deleted allocations for instance 1b169141-68f3-4a5a-ad03-d29c37d39f69
Oct 18 12:08:18 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:08:18 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:08:18 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:08:18 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:08:18 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Auditing locally available compute resources for user (node: user) {{(pid=74190) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 12:08:18 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-feb2d68b-1860-4351-bc67-5157394f0c04 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "1b169141-68f3-4a5a-ad03-d29c37d39f69" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 15.425s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:08:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f59adf3-9728-4d5b-87d5-2ad32c99d06e/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:08:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f59adf3-9728-4d5b-87d5-2ad32c99d06e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:08:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f59adf3-9728-4d5b-87d5-2ad32c99d06e/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:08:18 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:08:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f59adf3-9728-4d5b-87d5-2ad32c99d06e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:08:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f79a267-5bc8-4fa0-9e3a-4706fa1da142/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:08:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f79a267-5bc8-4fa0-9e3a-4706fa1da142/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:08:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f79a267-5bc8-4fa0-9e3a-4706fa1da142/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:08:19 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f79a267-5bc8-4fa0-9e3a-4706fa1da142/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:08:19 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 12:08:19 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:08:19 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:08:19 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:08:19 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:08:19 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1e27a16-43e4-4e80-9c0a-5c2dce06daae/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:08:19 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1e27a16-43e4-4e80-9c0a-5c2dce06daae/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:08:19 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1e27a16-43e4-4e80-9c0a-5c2dce06daae/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:08:19 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1e27a16-43e4-4e80-9c0a-5c2dce06daae/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:08:19 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:08:19 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:08:19 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:08:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:08:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:08:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:08:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:08:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:08:20 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 12:08:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk.rescue --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:08:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:08:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk.rescue --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:08:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk.rescue --force-share --output=json" returned: 0 in 0.244s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:08:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:08:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:08:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:08:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:08:21 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 12:08:21 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:08:21 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:08:21 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:08:21 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Hypervisor/Node resource view: name=user free_ram=8106MB free_disk=24.949874877929688GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74190) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 12:08:21 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:08:21 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:08:22 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 4e916d24-9f9d-4289-87ce-f65d2499fcd9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:08:22 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 95ca0697-22b5-4109-868f-ca5556015a1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:08:22 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 42413a94-9973-4e8d-83b6-207a4e7847c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:08:22 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 772b126c-2148-4ca8-90f2-69d6eb4b7db7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:08:22 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 0382820d-a678-4593-85df-168f42fc4ce4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:08:22 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 2f59adf3-9728-4d5b-87d5-2ad32c99d06e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:08:22 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 7f79a267-5bc8-4fa0-9e3a-4706fa1da142 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:08:22 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance b1e27a16-43e4-4e80-9c0a-5c2dce06daae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:08:22 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 5861a219-456a-43dd-898c-a99ed3051d83 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:08:22 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 12:08:22 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 12:08:22 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 12:08:22 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 12:08:22 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Compute_service record updated for user:user {{(pid=74190) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 12:08:22 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.506s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:08:23 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:08:23 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:08:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:08:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:08:27 user nova-compute[74190]: DEBUG nova.compute.manager [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] Start spawning the instance on the hypervisor. {{(pid=74190) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 12:08:27 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] Creating instance directory {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 12:08:27 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] Creating image(s)
Oct 18 12:08:27 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] Did not create local disks {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 18 12:08:27 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] Ensure instance console log exists: /opt/stack/data/nova/instances/5861a219-456a-43dd-898c-a99ed3051d83/console.log {{(pid=74190) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 12:08:27 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:08:27 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:08:27 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:08:27 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] Start _get_guest_xml network_info=[{"id": "f1268427-9b33-481f-b7dc-2e397d6d2da9", "address": "fa:16:3e:ed:cb:95", "network": {"id": "c2dbbd24-f1d2-47a2-835f-0f9b24b585f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-920140900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d994366010142519ff367fa7ca77e61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1268427-9b", "ovs_interfaceid": "f1268427-9b33-481f-b7dc-2e397d6d2da9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pNLKxRaX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5861a219-456a-43dd-898c-a99ed3051d83', 'attached_at': '', 'detached_at': '', 'volume_id': 'ca7aa93a-9939-442c-8098-c6a297de4f28', 'serial': 'ca7aa93a-9939-442c-8098-c6a297de4f28'}, 'delete_on_termination': False, 'guest_format': None, 'attachment_id': '60005d72-802a-40db-b255-a7d3d822166b', 'volume_type': None} {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 12:08:27 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:08:27 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:08:27 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 12:08:27 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] CPU controller missing on host. {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 12:08:27 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 12:08:27 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] CPU controller found on host. {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 12:08:27 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74190) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 12:08:27 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T11:37:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 12:08:27 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Flavor limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 12:08:27 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Image limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 12:08:27 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Flavor pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 12:08:27 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Image pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 12:08:27 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 12:08:27 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 12:08:27 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 12:08:27 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Got 1 possible topologies {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 12:08:27 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 12:08:27 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 12:08:27 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] Calling os-brick to attach iSCSI Volume {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 12:08:27 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pNLKxRaX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 12:08:27 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 12:08:27 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 12:08:27 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 12:08:27 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 12:08:27 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 12:08:27 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 12:08:27 user nova-compute[74190]: INFO os_brick.initiator.connectors.iscsi [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 12:08:27 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28 -p 172.16.0.220:3260 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:08:27 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:08:27 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[d091162c-f131-422b-ac4d-c029a403c564]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:08:27 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 12:08:27 user nova-compute[74190]:  {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:08:27 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28 -p 172.16.0.220:3260 --interface default --op new {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:08:27 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:08:27 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[122498b9-51ba-45c4-a35b-173ad671089c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28] added\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:08:27 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28] added
Oct 18 12:08:27 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:08:27 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:08:27 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:08:27 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fecf027-cccf-498f-ada7-7153a8a74195]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:08:27 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:08:27 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:08:27 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:08:27 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b055244-76ff-494b-9c7e-750a4d891ca6]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:08:27 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:08:27 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pNLKxRaX {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:08:27 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pNLKxRaX" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:08:27 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf8f44b0-c623-4498-8206-1e7b71c6b87d]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:08:27 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pNLKxRaX'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:08:27 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:08:27 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:08:27 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e978df9-88c1-43b5-a261-f35840acb8e0]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:08:27 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:08:27 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:08:27 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:08:27 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5317279-bc5a-4fa9-9757-de981e8c5c35]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3078e3b-8ce3-402e-9d09-bbb4f2862d2c (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:08:27 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 12:08:27 user nova-compute[74190]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)
Oct 18 12:08:27 user nova-compute[74190]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f (non-flash)
Oct 18 12:08:27 user nova-compute[74190]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3078e3b-8ce3-402e-9d09-bbb4f2862d2c (non-flash)
Oct 18 12:08:27 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 12:08:27 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 12:08:27 user nova-compute[74190]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)
Oct 18 12:08:27 user nova-compute[74190]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f (non-flash)
Oct 18 12:08:27 user nova-compute[74190]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3078e3b-8ce3-402e-9d09-bbb4f2862d2c (non-flash)
Oct 18 12:08:27 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 12:08:27 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28 -p 172.16.0.220:3260 --login {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:08:27 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:08:27 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d468e8a-1a23-4889-b59e-e42562e2167e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:08:27 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28, portal: 172.16.0.220,3260]
Oct 18 12:08:27 user nova-compute[74190]: Login to [iface: default, target: iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28, portal: 172.16.0.220,3260] successful.
Oct 18 12:08:27 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:08:27 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:08:27 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:08:27 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a9119d6-6685-41f2-b55f-8c7adbddaebd]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:08:27 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:08:27 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:08:27 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:08:27 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[574450e3-c1a0-4310-89f3-c39a4164d3d8]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3078e3b-8ce3-402e-9d09-bbb4f2862d2c (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28 (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:08:27 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 12:08:27 user nova-compute[74190]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)
Oct 18 12:08:27 user nova-compute[74190]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f (non-flash)
Oct 18 12:08:27 user nova-compute[74190]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3078e3b-8ce3-402e-9d09-bbb4f2862d2c (non-flash)
Oct 18 12:08:27 user nova-compute[74190]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28 (non-flash)
Oct 18 12:08:27 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 12:08:27 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 12:08:27 user nova-compute[74190]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)
Oct 18 12:08:27 user nova-compute[74190]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f (non-flash)
Oct 18 12:08:27 user nova-compute[74190]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3078e3b-8ce3-402e-9d09-bbb4f2862d2c (non-flash)
Oct 18 12:08:27 user nova-compute[74190]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28 (non-flash)
Oct 18 12:08:27 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 12:08:27 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 12:08:27 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Connected to 172.16.0.220:3260 {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 12:08:27 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] HCTL ('37', '-', '-', 0) found on session 47 with lun 0 {{(pid=74190) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 12:08:27 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74190) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 12:08:27 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:08:27 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:08:27 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[515c8ecc-9c1d-43cc-96f3-7e150878a799]: (4, ('- - 0', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:08:27 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Searching for a device in session 47 and hctl ['37', '*', '*', 0] yield: None {{(pid=74190) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 12:08:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:08:28 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Searching for a device in session 47 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74190) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 12:08:28 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pNLKxRaX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 12:08:28 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 12:08:28 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '26565656431336365', 'path': '/dev/sdf'} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 12:08:28 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26565656431336365', 'path': '/dev/sdf'} {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 12:08:28 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T12:07:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-928619031',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-928619031',id=40,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d994366010142519ff367fa7ca77e61',ramdisk_id='',reservation_id='r-0sqptyar',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1815510380',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T12:07:42Z,user_data=None,user_id='7fa675b6803f4e21b090295b51fb9ceb',uuid=5861a219-456a-43dd-898c-a99ed3051d83,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f1268427-9b33-481f-b7dc-2e397d6d2da9", "address": "fa:16:3e:ed:cb:95", "network": {"id": "c2dbbd24-f1d2-47a2-835f-0f9b24b585f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-920140900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d994366010142519ff367fa7ca77e61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1268427-9b", "ovs_interfaceid": "f1268427-9b33-481f-b7dc-2e397d6d2da9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74190) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 12:08:28 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Converting VIF {"id": "f1268427-9b33-481f-b7dc-2e397d6d2da9", "address": "fa:16:3e:ed:cb:95", "network": {"id": "c2dbbd24-f1d2-47a2-835f-0f9b24b585f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-920140900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d994366010142519ff367fa7ca77e61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1268427-9b", "ovs_interfaceid": "f1268427-9b33-481f-b7dc-2e397d6d2da9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 12:08:28 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:cb:95,bridge_name='br-int',has_traffic_filtering=True,id=f1268427-9b33-481f-b7dc-2e397d6d2da9,network=Network(c2dbbd24-f1d2-47a2-835f-0f9b24b585f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1268427-9b') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 12:08:28 user nova-compute[74190]: DEBUG nova.objects.instance [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lazy-loading 'pci_devices' on Instance uuid 5861a219-456a-43dd-898c-a99ed3051d83 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:08:28 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] End _get_guest_xml xml=<domain type="kvm">
Oct 18 12:08:28 user nova-compute[74190]:   <uuid>5861a219-456a-43dd-898c-a99ed3051d83</uuid>
Oct 18 12:08:28 user nova-compute[74190]:   <name>instance-00000028</name>
Oct 18 12:08:28 user nova-compute[74190]:   <memory>524288</memory>
Oct 18 12:08:28 user nova-compute[74190]:   <vcpu>1</vcpu>
Oct 18 12:08:28 user nova-compute[74190]:   <metadata>
Oct 18 12:08:28 user nova-compute[74190]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 12:08:28 user nova-compute[74190]:       <nova:package version="0.0.0"/>
Oct 18 12:08:28 user nova-compute[74190]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-928619031</nova:name>
Oct 18 12:08:28 user nova-compute[74190]:       <nova:creationTime>2023-10-18 12:08:27</nova:creationTime>
Oct 18 12:08:28 user nova-compute[74190]:       <nova:flavor name="m1.tiny">
Oct 18 12:08:28 user nova-compute[74190]:         <nova:memory>512</nova:memory>
Oct 18 12:08:28 user nova-compute[74190]:         <nova:disk>1</nova:disk>
Oct 18 12:08:28 user nova-compute[74190]:         <nova:swap>0</nova:swap>
Oct 18 12:08:28 user nova-compute[74190]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 12:08:28 user nova-compute[74190]:         <nova:vcpus>1</nova:vcpus>
Oct 18 12:08:28 user nova-compute[74190]:       </nova:flavor>
Oct 18 12:08:28 user nova-compute[74190]:       <nova:owner>
Oct 18 12:08:28 user nova-compute[74190]:         <nova:user uuid="7fa675b6803f4e21b090295b51fb9ceb">tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member</nova:user>
Oct 18 12:08:28 user nova-compute[74190]:         <nova:project uuid="6d994366010142519ff367fa7ca77e61">tempest-ServerBootFromVolumeStableRescueTest-1815510380</nova:project>
Oct 18 12:08:28 user nova-compute[74190]:       </nova:owner>
Oct 18 12:08:28 user nova-compute[74190]:       <nova:root type="image" uuid="6e88bbf0-6e78-49a8-b3c5-9453d22a89df"/>
Oct 18 12:08:28 user nova-compute[74190]:       <nova:ports>
Oct 18 12:08:28 user nova-compute[74190]:         <nova:port uuid="f1268427-9b33-481f-b7dc-2e397d6d2da9">
Oct 18 12:08:28 user nova-compute[74190]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 18 12:08:28 user nova-compute[74190]:         </nova:port>
Oct 18 12:08:28 user nova-compute[74190]:       </nova:ports>
Oct 18 12:08:28 user nova-compute[74190]:     </nova:instance>
Oct 18 12:08:28 user nova-compute[74190]:   </metadata>
Oct 18 12:08:28 user nova-compute[74190]:   <sysinfo type="smbios">
Oct 18 12:08:28 user nova-compute[74190]:     <system>
Oct 18 12:08:28 user nova-compute[74190]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 12:08:28 user nova-compute[74190]:       <entry name="product">OpenStack Nova</entry>
Oct 18 12:08:28 user nova-compute[74190]:       <entry name="version">0.0.0</entry>
Oct 18 12:08:28 user nova-compute[74190]:       <entry name="serial">5861a219-456a-43dd-898c-a99ed3051d83</entry>
Oct 18 12:08:28 user nova-compute[74190]:       <entry name="uuid">5861a219-456a-43dd-898c-a99ed3051d83</entry>
Oct 18 12:08:28 user nova-compute[74190]:       <entry name="family">Virtual Machine</entry>
Oct 18 12:08:28 user nova-compute[74190]:     </system>
Oct 18 12:08:28 user nova-compute[74190]:   </sysinfo>
Oct 18 12:08:28 user nova-compute[74190]:   <os>
Oct 18 12:08:28 user nova-compute[74190]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 12:08:28 user nova-compute[74190]:     <boot dev="hd"/>
Oct 18 12:08:28 user nova-compute[74190]:     <smbios mode="sysinfo"/>
Oct 18 12:08:28 user nova-compute[74190]:   </os>
Oct 18 12:08:28 user nova-compute[74190]:   <features>
Oct 18 12:08:28 user nova-compute[74190]:     <acpi/>
Oct 18 12:08:28 user nova-compute[74190]:     <apic/>
Oct 18 12:08:28 user nova-compute[74190]:     <vmcoreinfo/>
Oct 18 12:08:28 user nova-compute[74190]:   </features>
Oct 18 12:08:28 user nova-compute[74190]:   <clock offset="utc">
Oct 18 12:08:28 user nova-compute[74190]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 12:08:28 user nova-compute[74190]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 12:08:28 user nova-compute[74190]:     <timer name="hpet" present="no"/>
Oct 18 12:08:28 user nova-compute[74190]:   </clock>
Oct 18 12:08:28 user nova-compute[74190]:   <cpu mode="custom" match="exact">
Oct 18 12:08:28 user nova-compute[74190]:     <model>Nehalem</model>
Oct 18 12:08:28 user nova-compute[74190]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 12:08:28 user nova-compute[74190]:   </cpu>
Oct 18 12:08:28 user nova-compute[74190]:   <devices>
Oct 18 12:08:28 user nova-compute[74190]:     <disk type="block" device="disk">
Oct 18 12:08:28 user nova-compute[74190]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 12:08:28 user nova-compute[74190]:       <source dev="/dev/sdf"/>
Oct 18 12:08:28 user nova-compute[74190]:       <target dev="vda" bus="virtio"/>
Oct 18 12:08:28 user nova-compute[74190]:       <serial>ca7aa93a-9939-442c-8098-c6a297de4f28</serial>
Oct 18 12:08:28 user nova-compute[74190]:     </disk>
Oct 18 12:08:28 user nova-compute[74190]:     <interface type="ethernet">
Oct 18 12:08:28 user nova-compute[74190]:       <mac address="fa:16:3e:ed:cb:95"/>
Oct 18 12:08:28 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 12:08:28 user nova-compute[74190]:       <mtu size="1442"/>
Oct 18 12:08:28 user nova-compute[74190]:       <target dev="tapf1268427-9b"/>
Oct 18 12:08:28 user nova-compute[74190]:     </interface>
Oct 18 12:08:28 user nova-compute[74190]:     <serial type="pty">
Oct 18 12:08:28 user nova-compute[74190]:       <log file="/opt/stack/data/nova/instances/5861a219-456a-43dd-898c-a99ed3051d83/console.log" append="off"/>
Oct 18 12:08:28 user nova-compute[74190]:     </serial>
Oct 18 12:08:28 user nova-compute[74190]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 12:08:28 user nova-compute[74190]:     <video>
Oct 18 12:08:28 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 12:08:28 user nova-compute[74190]:     </video>
Oct 18 12:08:28 user nova-compute[74190]:     <rng model="virtio">
Oct 18 12:08:28 user nova-compute[74190]:       <backend model="random">/dev/urandom</backend>
Oct 18 12:08:28 user nova-compute[74190]:     </rng>
Oct 18 12:08:28 user nova-compute[74190]:     <controller type="usb" index="0" model="none"/>
Oct 18 12:08:28 user nova-compute[74190]:     <memballoon model="virtio">
Oct 18 12:08:28 user nova-compute[74190]:       <stats period="10"/>
Oct 18 12:08:28 user nova-compute[74190]:     </memballoon>
Oct 18 12:08:28 user nova-compute[74190]:   </devices>
Oct 18 12:08:28 user nova-compute[74190]: </domain>
Oct 18 12:08:28 user nova-compute[74190]:  {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 12:08:28 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T12:07:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-928619031',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-928619031',id=40,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d994366010142519ff367fa7ca77e61',ramdisk_id='',reservation_id='r-0sqptyar',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1815510380',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T12:07:42Z,user_data=None,user_id='7fa675b6803f4e21b090295b51fb9ceb',uuid=5861a219-456a-43dd-898c-a99ed3051d83,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f1268427-9b33-481f-b7dc-2e397d6d2da9", "address": "fa:16:3e:ed:cb:95", "network": {"id": "c2dbbd24-f1d2-47a2-835f-0f9b24b585f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-920140900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d994366010142519ff367fa7ca77e61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1268427-9b", "ovs_interfaceid": "f1268427-9b33-481f-b7dc-2e397d6d2da9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 12:08:28 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Converting VIF {"id": "f1268427-9b33-481f-b7dc-2e397d6d2da9", "address": "fa:16:3e:ed:cb:95", "network": {"id": "c2dbbd24-f1d2-47a2-835f-0f9b24b585f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-920140900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d994366010142519ff367fa7ca77e61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1268427-9b", "ovs_interfaceid": "f1268427-9b33-481f-b7dc-2e397d6d2da9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 12:08:28 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:cb:95,bridge_name='br-int',has_traffic_filtering=True,id=f1268427-9b33-481f-b7dc-2e397d6d2da9,network=Network(c2dbbd24-f1d2-47a2-835f-0f9b24b585f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1268427-9b') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 12:08:28 user nova-compute[74190]: DEBUG os_vif [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:cb:95,bridge_name='br-int',has_traffic_filtering=True,id=f1268427-9b33-481f-b7dc-2e397d6d2da9,network=Network(c2dbbd24-f1d2-47a2-835f-0f9b24b585f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1268427-9b') {{(pid=74190) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 12:08:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:08:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:08:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 12:08:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:08:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9833059d-2963-508c-96c7-46e188600092', '_type': 'linux-noop'}}, row=False) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:08:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:08:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:08:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf1268427-9b, may_exist=True, interface_attrs={}) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:08:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf1268427-9b, col_values=(('qos', UUID('a95bfead-9e41-44f5-be0c-39450c8a2103')),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:08:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf1268427-9b, col_values=(('external_ids', {'iface-id': 'f1268427-9b33-481f-b7dc-2e397d6d2da9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:cb:95', 'vm-uuid': '5861a219-456a-43dd-898c-a99ed3051d83'}),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:08:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:08:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:08:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:08:28 user nova-compute[74190]: INFO os_vif [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:cb:95,bridge_name='br-int',has_traffic_filtering=True,id=f1268427-9b33-481f-b7dc-2e397d6d2da9,network=Network(c2dbbd24-f1d2-47a2-835f-0f9b24b585f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1268427-9b')
Oct 18 12:08:28 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] No BDM found with device name vda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 12:08:28 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] No VIF found with MAC fa:16:3e:ed:cb:95, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 12:08:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:08:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:08:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:08:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:08:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:08:30 user nova-compute[74190]: DEBUG nova.compute.manager [req-452cadd1-bc28-4c95-bfee-ba7acee15125 req-7f59933f-30c2-4100-b8ee-47f211425abd service nova] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] Received event network-vif-plugged-f1268427-9b33-481f-b7dc-2e397d6d2da9 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:08:30 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-452cadd1-bc28-4c95-bfee-ba7acee15125 req-7f59933f-30c2-4100-b8ee-47f211425abd service nova] Acquiring lock "5861a219-456a-43dd-898c-a99ed3051d83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:08:30 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-452cadd1-bc28-4c95-bfee-ba7acee15125 req-7f59933f-30c2-4100-b8ee-47f211425abd service nova] Lock "5861a219-456a-43dd-898c-a99ed3051d83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:08:30 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-452cadd1-bc28-4c95-bfee-ba7acee15125 req-7f59933f-30c2-4100-b8ee-47f211425abd service nova] Lock "5861a219-456a-43dd-898c-a99ed3051d83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:08:30 user nova-compute[74190]: DEBUG nova.compute.manager [req-452cadd1-bc28-4c95-bfee-ba7acee15125 req-7f59933f-30c2-4100-b8ee-47f211425abd service nova] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] No waiting events found dispatching network-vif-plugged-f1268427-9b33-481f-b7dc-2e397d6d2da9 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:08:30 user nova-compute[74190]: WARNING nova.compute.manager [req-452cadd1-bc28-4c95-bfee-ba7acee15125 req-7f59933f-30c2-4100-b8ee-47f211425abd service nova] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] Received unexpected event network-vif-plugged-f1268427-9b33-481f-b7dc-2e397d6d2da9 for instance with vm_state building and task_state spawning.
Oct 18 12:08:31 user nova-compute[74190]: DEBUG nova.compute.manager [req-34930f0d-915e-47e0-9804-2c4bb88e0b66 req-a19963be-a722-4cb5-a0ce-aac15ca6c19b service nova] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Received event network-changed-85b87aa7-52a9-4487-a954-7e07dcf20500 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:08:31 user nova-compute[74190]: DEBUG nova.compute.manager [req-34930f0d-915e-47e0-9804-2c4bb88e0b66 req-a19963be-a722-4cb5-a0ce-aac15ca6c19b service nova] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Refreshing instance network info cache due to event network-changed-85b87aa7-52a9-4487-a954-7e07dcf20500. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 12:08:31 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-34930f0d-915e-47e0-9804-2c4bb88e0b66 req-a19963be-a722-4cb5-a0ce-aac15ca6c19b service nova] Acquiring lock "refresh_cache-7f79a267-5bc8-4fa0-9e3a-4706fa1da142" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:08:31 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-34930f0d-915e-47e0-9804-2c4bb88e0b66 req-a19963be-a722-4cb5-a0ce-aac15ca6c19b service nova] Acquired lock "refresh_cache-7f79a267-5bc8-4fa0-9e3a-4706fa1da142" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:08:31 user nova-compute[74190]: DEBUG nova.network.neutron [req-34930f0d-915e-47e0-9804-2c4bb88e0b66 req-a19963be-a722-4cb5-a0ce-aac15ca6c19b service nova] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Refreshing network info cache for port 85b87aa7-52a9-4487-a954-7e07dcf20500 {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 12:08:32 user nova-compute[74190]: DEBUG nova.network.neutron [req-34930f0d-915e-47e0-9804-2c4bb88e0b66 req-a19963be-a722-4cb5-a0ce-aac15ca6c19b service nova] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Updated VIF entry in instance network info cache for port 85b87aa7-52a9-4487-a954-7e07dcf20500. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 12:08:32 user nova-compute[74190]: DEBUG nova.network.neutron [req-34930f0d-915e-47e0-9804-2c4bb88e0b66 req-a19963be-a722-4cb5-a0ce-aac15ca6c19b service nova] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Updating instance_info_cache with network_info: [{"id": "85b87aa7-52a9-4487-a954-7e07dcf20500", "address": "fa:16:3e:68:65:7b", "network": {"id": "130f7948-11e4-49b4-9d4a-dffb2b48bdcd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595419292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ffa18c02b8a4117ab1ccc52aca64f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85b87aa7-52", "ovs_interfaceid": "85b87aa7-52a9-4487-a954-7e07dcf20500", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:08:32 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-34930f0d-915e-47e0-9804-2c4bb88e0b66 req-a19963be-a722-4cb5-a0ce-aac15ca6c19b service nova] Releasing lock "refresh_cache-7f79a267-5bc8-4fa0-9e3a-4706fa1da142" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:08:32 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-daa722cf-d295-424c-8426-61d45fdd4636 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Acquiring lock "7f79a267-5bc8-4fa0-9e3a-4706fa1da142" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:08:32 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-daa722cf-d295-424c-8426-61d45fdd4636 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lock "7f79a267-5bc8-4fa0-9e3a-4706fa1da142" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:08:32 user nova-compute[74190]: INFO nova.compute.manager [None req-daa722cf-d295-424c-8426-61d45fdd4636 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Detaching volume 26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f
Oct 18 12:08:32 user nova-compute[74190]: INFO nova.virt.block_device [None req-daa722cf-d295-424c-8426-61d45fdd4636 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Attempting to driver detach volume 26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f from mountpoint /dev/vdb
Oct 18 12:08:32 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-daa722cf-d295-424c-8426-61d45fdd4636 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Attempting to detach device vdb from instance 7f79a267-5bc8-4fa0-9e3a-4706fa1da142 from the persistent domain config. {{(pid=74190) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 18 12:08:32 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-daa722cf-d295-424c-8426-61d45fdd4636 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 12:08:32 user nova-compute[74190]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 12:08:32 user nova-compute[74190]:   <source dev="/dev/sdd"/>
Oct 18 12:08:32 user nova-compute[74190]:   <target dev="vdb" bus="virtio"/>
Oct 18 12:08:32 user nova-compute[74190]:   <serial>26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f</serial>
Oct 18 12:08:32 user nova-compute[74190]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 18 12:08:32 user nova-compute[74190]: </disk>
Oct 18 12:08:32 user nova-compute[74190]:  {{(pid=74190) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 12:08:32 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-daa722cf-d295-424c-8426-61d45fdd4636 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Successfully detached device vdb from instance 7f79a267-5bc8-4fa0-9e3a-4706fa1da142 from the persistent domain config.
Oct 18 12:08:32 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-daa722cf-d295-424c-8426-61d45fdd4636 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7f79a267-5bc8-4fa0-9e3a-4706fa1da142 from the live domain config. {{(pid=74190) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 18 12:08:32 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-daa722cf-d295-424c-8426-61d45fdd4636 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 12:08:32 user nova-compute[74190]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 12:08:32 user nova-compute[74190]:   <source dev="/dev/sdd"/>
Oct 18 12:08:32 user nova-compute[74190]:   <target dev="vdb" bus="virtio"/>
Oct 18 12:08:32 user nova-compute[74190]:   <serial>26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f</serial>
Oct 18 12:08:32 user nova-compute[74190]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 18 12:08:32 user nova-compute[74190]: </disk>
Oct 18 12:08:32 user nova-compute[74190]:  {{(pid=74190) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 12:08:32 user nova-compute[74190]: DEBUG nova.compute.manager [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] Instance event wait completed in 0 seconds for  {{(pid=74190) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 12:08:32 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] Guest created on hypervisor {{(pid=74190) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 12:08:32 user nova-compute[74190]: DEBUG nova.compute.manager [req-c20c91c1-57c5-46c1-8140-11ba0af2fc30 req-7ca0620e-ff69-41a2-8a48-8294d41543ef service nova] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] Received event network-vif-plugged-f1268427-9b33-481f-b7dc-2e397d6d2da9 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:08:32 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-c20c91c1-57c5-46c1-8140-11ba0af2fc30 req-7ca0620e-ff69-41a2-8a48-8294d41543ef service nova] Acquiring lock "5861a219-456a-43dd-898c-a99ed3051d83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:08:32 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-c20c91c1-57c5-46c1-8140-11ba0af2fc30 req-7ca0620e-ff69-41a2-8a48-8294d41543ef service nova] Lock "5861a219-456a-43dd-898c-a99ed3051d83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:08:32 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-c20c91c1-57c5-46c1-8140-11ba0af2fc30 req-7ca0620e-ff69-41a2-8a48-8294d41543ef service nova] Lock "5861a219-456a-43dd-898c-a99ed3051d83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:08:32 user nova-compute[74190]: DEBUG nova.compute.manager [req-c20c91c1-57c5-46c1-8140-11ba0af2fc30 req-7ca0620e-ff69-41a2-8a48-8294d41543ef service nova] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] No waiting events found dispatching network-vif-plugged-f1268427-9b33-481f-b7dc-2e397d6d2da9 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:08:32 user nova-compute[74190]: WARNING nova.compute.manager [req-c20c91c1-57c5-46c1-8140-11ba0af2fc30 req-7ca0620e-ff69-41a2-8a48-8294d41543ef service nova] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] Received unexpected event network-vif-plugged-f1268427-9b33-481f-b7dc-2e397d6d2da9 for instance with vm_state building and task_state spawning.
Oct 18 12:08:32 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] Instance spawned successfully.
Oct 18 12:08:32 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 12:08:32 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] Found default for hw_cdrom_bus of ide {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:08:32 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] Found default for hw_disk_bus of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:08:32 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] Found default for hw_input_bus of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:08:32 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] Found default for hw_pointer_model of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:08:32 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] Found default for hw_video_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:08:32 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] Found default for hw_vif_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:08:32 user nova-compute[74190]: INFO nova.compute.manager [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] Took 5.45 seconds to spawn the instance on the hypervisor.
Oct 18 12:08:32 user nova-compute[74190]: DEBUG nova.compute.manager [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] Checking state {{(pid=74190) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 12:08:33 user nova-compute[74190]: INFO nova.compute.manager [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] Took 51.42 seconds to build instance.
Oct 18 12:08:33 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-6d8c80eb-8124-4997-a916-817eb3726de1 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lock "5861a219-456a-43dd-898c-a99ed3051d83" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 51.517s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:08:33 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-daa722cf-d295-424c-8426-61d45fdd4636 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7f79a267-5bc8-4fa0-9e3a-4706fa1da142 {{(pid=74190) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 18 12:08:33 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:08:33 user nova-compute[74190]: DEBUG nova.compute.manager [req-a924ba30-4e34-4c36-958d-8a8cc6a3cfe4 req-35b84d40-6a42-4dc7-ada4-bedbb4ddf66f service nova] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Received event network-changed-85b87aa7-52a9-4487-a954-7e07dcf20500 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:08:33 user nova-compute[74190]: DEBUG nova.compute.manager [req-a924ba30-4e34-4c36-958d-8a8cc6a3cfe4 req-35b84d40-6a42-4dc7-ada4-bedbb4ddf66f service nova] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Refreshing instance network info cache due to event network-changed-85b87aa7-52a9-4487-a954-7e07dcf20500. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 12:08:33 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-a924ba30-4e34-4c36-958d-8a8cc6a3cfe4 req-35b84d40-6a42-4dc7-ada4-bedbb4ddf66f service nova] Acquiring lock "refresh_cache-7f79a267-5bc8-4fa0-9e3a-4706fa1da142" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:08:33 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-a924ba30-4e34-4c36-958d-8a8cc6a3cfe4 req-35b84d40-6a42-4dc7-ada4-bedbb4ddf66f service nova] Acquired lock "refresh_cache-7f79a267-5bc8-4fa0-9e3a-4706fa1da142" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:08:33 user nova-compute[74190]: DEBUG nova.network.neutron [req-a924ba30-4e34-4c36-958d-8a8cc6a3cfe4 req-35b84d40-6a42-4dc7-ada4-bedbb4ddf66f service nova] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Refreshing network info cache for port 85b87aa7-52a9-4487-a954-7e07dcf20500 {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 12:08:34 user nova-compute[74190]: DEBUG nova.network.neutron [req-a924ba30-4e34-4c36-958d-8a8cc6a3cfe4 req-35b84d40-6a42-4dc7-ada4-bedbb4ddf66f service nova] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Updated VIF entry in instance network info cache for port 85b87aa7-52a9-4487-a954-7e07dcf20500. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 12:08:34 user nova-compute[74190]: DEBUG nova.network.neutron [req-a924ba30-4e34-4c36-958d-8a8cc6a3cfe4 req-35b84d40-6a42-4dc7-ada4-bedbb4ddf66f service nova] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Updating instance_info_cache with network_info: [{"id": "85b87aa7-52a9-4487-a954-7e07dcf20500", "address": "fa:16:3e:68:65:7b", "network": {"id": "130f7948-11e4-49b4-9d4a-dffb2b48bdcd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595419292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ffa18c02b8a4117ab1ccc52aca64f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85b87aa7-52", "ovs_interfaceid": "85b87aa7-52a9-4487-a954-7e07dcf20500", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:08:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-a924ba30-4e34-4c36-958d-8a8cc6a3cfe4 req-35b84d40-6a42-4dc7-ada4-bedbb4ddf66f service nova] Releasing lock "refresh_cache-7f79a267-5bc8-4fa0-9e3a-4706fa1da142" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:08:34 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-c1d98609-d6b7-4fcf-a497-ec696770918a tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2f59adf3-9728-4d5b-87d5-2ad32c99d06e is timed out.
Oct 18 12:08:34 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-c1d98609-d6b7-4fcf-a497-ec696770918a tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Successfully detached device vdb from instance 2f59adf3-9728-4d5b-87d5-2ad32c99d06e from the live domain config.
Oct 18 12:08:34 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1d98609-d6b7-4fcf-a497-ec696770918a tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] calling os-brick to detach iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 12:08:34 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d98609-d6b7-4fcf-a497-ec696770918a tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, {'target_iqn': 'iqn.2010-10.org.openstack:e3078e3b-8ce3-402e-9d09-bbb4f2862d2c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OPZGaSso', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 12:08:34 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-c1d98609-d6b7-4fcf-a497-ec696770918a tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 12:08:34 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-c1d98609-d6b7-4fcf-a497-ec696770918a tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 12:08:34 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-c1d98609-d6b7-4fcf-a497-ec696770918a tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 12:08:34 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:08:34 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:08:34 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b7bd08-ce99-405e-b244-53320cf8804b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e3078e3b-8ce3-402e-9d09-bbb4f2862d2c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:08:34 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d98609-d6b7-4fcf-a497-ec696770918a tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 12:08:34 user nova-compute[74190]: No targets found.
Oct 18 12:08:34 user nova-compute[74190]: iSNS:
Oct 18 12:08:34 user nova-compute[74190]: No targets found.
Oct 18 12:08:34 user nova-compute[74190]: STATIC:
Oct 18 12:08:34 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:e3078e3b-8ce3-402e-9d09-bbb4f2862d2c
Oct 18 12:08:34 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 12:08:34 user nova-compute[74190]:                 Iface Name: default
Oct 18 12:08:34 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f
Oct 18 12:08:34 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 12:08:34 user nova-compute[74190]:                 Iface Name: default
Oct 18 12:08:34 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa
Oct 18 12:08:34 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 12:08:34 user nova-compute[74190]:                 Iface Name: default
Oct 18 12:08:34 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f
Oct 18 12:08:34 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 12:08:34 user nova-compute[74190]:                 Iface Name: default
Oct 18 12:08:34 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28
Oct 18 12:08:34 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 12:08:34 user nova-compute[74190]:                 Iface Name: default
Oct 18 12:08:34 user nova-compute[74190]: FIRMWARE:
Oct 18 12:08:34 user nova-compute[74190]: No targets found.
Oct 18 12:08:34 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 12:08:34 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d98609-d6b7-4fcf-a497-ec696770918a tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 12:08:34 user nova-compute[74190]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 12:08:34 user nova-compute[74190]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74190) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 12:08:34 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d98609-d6b7-4fcf-a497-ec696770918a tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3078e3b-8ce3-402e-9d09-bbb4f2862d2c', 0)] {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 12:08:34 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:08:34 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:08:34 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[866f02e4-8aef-44e1-9646-9ff378f3e7a1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3078e3b-8ce3-402e-9d09-bbb4f2862d2c\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:08:34 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:08:34 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:08:34 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f3e868-b4ab-4215-b791-e06eb7442b30]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3078e3b-8ce3-402e-9d09-bbb4f2862d2c (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28 (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:08:34 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d98609-d6b7-4fcf-a497-ec696770918a tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 12:08:34 user nova-compute[74190]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)
Oct 18 12:08:34 user nova-compute[74190]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f (non-flash)
Oct 18 12:08:34 user nova-compute[74190]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3078e3b-8ce3-402e-9d09-bbb4f2862d2c (non-flash)
Oct 18 12:08:34 user nova-compute[74190]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28 (non-flash)
Oct 18 12:08:34 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 12:08:34 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d98609-d6b7-4fcf-a497-ec696770918a tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 12:08:34 user nova-compute[74190]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)
Oct 18 12:08:34 user nova-compute[74190]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f (non-flash)
Oct 18 12:08:34 user nova-compute[74190]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3078e3b-8ce3-402e-9d09-bbb4f2862d2c (non-flash)
Oct 18 12:08:34 user nova-compute[74190]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28 (non-flash)
Oct 18 12:08:34 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 12:08:34 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d98609-d6b7-4fcf-a497-ec696770918a tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1f54082dd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3078e3b-8ce3-402e-9d09-bbb4f2862d2c'): ({'sde'}, set())}) {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 12:08:34 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-c1d98609-d6b7-4fcf-a497-ec696770918a tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Removing single pathed devices sde {{(pid=74190) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 12:08:34 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:08:34 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:08:34 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db8932c-9949-4977-876d-b5d0eac82dbb]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:08:34 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:08:34 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:08:34 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c86d3e-406c-47b6-9059-dd73101f7236]: (4, ('ok\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:08:34 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-c1d98609-d6b7-4fcf-a497-ec696770918a tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Flushing IO for device /dev/sde {{(pid=74190) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 12:08:34 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:08:34 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:08:34 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[550a353c-4ba2-4466-a564-3b9de4f76226]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:08:34 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-c1d98609-d6b7-4fcf-a497-ec696770918a tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74190) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 12:08:34 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:08:34 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:08:34 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[0006efd3-1368-419e-82a5-8b1ed9487de8]: (4, ('1', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:08:34 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-c1d98609-d6b7-4fcf-a497-ec696770918a tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 12:08:34 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-c1d98609-d6b7-4fcf-a497-ec696770918a tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] SCSI volumes sde have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 12:08:34 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d98609-d6b7-4fcf-a497-ec696770918a tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3078e3b-8ce3-402e-9d09-bbb4f2862d2c')] {{(pid=74190) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 12:08:34 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3078e3b-8ce3-402e-9d09-bbb4f2862d2c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:08:35 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3078e3b-8ce3-402e-9d09-bbb4f2862d2c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:08:35 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d0e61ac-23be-4be4-934b-1b52d18cd247]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:08:35 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d98609-d6b7-4fcf-a497-ec696770918a tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:08:35 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3078e3b-8ce3-402e-9d09-bbb4f2862d2c -p 172.16.0.220:3260 --logout {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:08:35 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3078e3b-8ce3-402e-9d09-bbb4f2862d2c -p 172.16.0.220:3260 --logout" returned: 0 in 0.085s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:08:35 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[7941d319-2fb5-4e5c-b230-efb4d54a3985]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:e3078e3b-8ce3-402e-9d09-bbb4f2862d2c, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:e3078e3b-8ce3-402e-9d09-bbb4f2862d2c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:08:35 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d98609-d6b7-4fcf-a497-ec696770918a tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:e3078e3b-8ce3-402e-9d09-bbb4f2862d2c, portal: 172.16.0.220,3260]
Oct 18 12:08:35 user nova-compute[74190]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:e3078e3b-8ce3-402e-9d09-bbb4f2862d2c, portal: 172.16.0.220,3260] successful.
Oct 18 12:08:35 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:08:35 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3078e3b-8ce3-402e-9d09-bbb4f2862d2c -p 172.16.0.220:3260 --op delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:08:35 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3078e3b-8ce3-402e-9d09-bbb4f2862d2c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:08:35 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[08899393-bf7c-4b38-8bee-2e939385aea5]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:08:35 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d98609-d6b7-4fcf-a497-ec696770918a tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:08:35 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-c1d98609-d6b7-4fcf-a497-ec696770918a tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.393s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 12:08:35 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d98609-d6b7-4fcf-a497-ec696770918a tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] <== disconnect_volume: return (395ms) None {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 12:08:35 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1d98609-d6b7-4fcf-a497-ec696770918a tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] Disconnected iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 12:08:35 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:08:36 user nova-compute[74190]: DEBUG nova.objects.instance [None req-c1d98609-d6b7-4fcf-a497-ec696770918a tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Lazy-loading 'flavor' on Instance uuid 2f59adf3-9728-4d5b-87d5-2ad32c99d06e {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:08:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-c1d98609-d6b7-4fcf-a497-ec696770918a tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Lock "2f59adf3-9728-4d5b-87d5-2ad32c99d06e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.269s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:08:38 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:08:43 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:08:43 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:08:43 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74190) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 12:08:43 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:08:43 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:08:43 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:08:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:08:50 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:08:53 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-daa722cf-d295-424c-8426-61d45fdd4636 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7f79a267-5bc8-4fa0-9e3a-4706fa1da142 is timed out.
Oct 18 12:08:53 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-daa722cf-d295-424c-8426-61d45fdd4636 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Successfully detached device vdb from instance 7f79a267-5bc8-4fa0-9e3a-4706fa1da142 from the live domain config.
Oct 18 12:08:53 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-daa722cf-d295-424c-8426-61d45fdd4636 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] calling os-brick to detach iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 12:08:53 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-daa722cf-d295-424c-8426-61d45fdd4636 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, {'target_iqn': 'iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uxMoXGFf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 12:08:53 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-daa722cf-d295-424c-8426-61d45fdd4636 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 12:08:53 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-daa722cf-d295-424c-8426-61d45fdd4636 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 12:08:53 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-daa722cf-d295-424c-8426-61d45fdd4636 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 12:08:53 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:08:53 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:08:53 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[582750a2-aea8-44cc-8193-7ec5ec7ec2d7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:08:53 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-daa722cf-d295-424c-8426-61d45fdd4636 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 12:08:53 user nova-compute[74190]: No targets found.
Oct 18 12:08:53 user nova-compute[74190]: iSNS:
Oct 18 12:08:53 user nova-compute[74190]: No targets found.
Oct 18 12:08:53 user nova-compute[74190]: STATIC:
Oct 18 12:08:53 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f
Oct 18 12:08:53 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 12:08:53 user nova-compute[74190]:                 Iface Name: default
Oct 18 12:08:53 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa
Oct 18 12:08:53 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 12:08:53 user nova-compute[74190]:                 Iface Name: default
Oct 18 12:08:53 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f
Oct 18 12:08:53 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 12:08:53 user nova-compute[74190]:                 Iface Name: default
Oct 18 12:08:53 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28
Oct 18 12:08:53 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 12:08:53 user nova-compute[74190]:                 Iface Name: default
Oct 18 12:08:53 user nova-compute[74190]: FIRMWARE:
Oct 18 12:08:53 user nova-compute[74190]: No targets found.
Oct 18 12:08:53 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 12:08:53 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-daa722cf-d295-424c-8426-61d45fdd4636 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 12:08:53 user nova-compute[74190]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 12:08:53 user nova-compute[74190]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74190) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 12:08:53 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-daa722cf-d295-424c-8426-61d45fdd4636 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f', 0)] {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 12:08:53 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:08:53 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:08:53 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f1f21dc-2c1b-4dc8-862f-78ac567735a4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:08:53 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:08:53 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:08:53 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[8759a7bf-8218-4e89-a906-fa439d759078]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28 (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:08:53 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-daa722cf-d295-424c-8426-61d45fdd4636 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 12:08:53 user nova-compute[74190]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)
Oct 18 12:08:53 user nova-compute[74190]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f (non-flash)
Oct 18 12:08:53 user nova-compute[74190]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28 (non-flash)
Oct 18 12:08:53 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 12:08:53 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-daa722cf-d295-424c-8426-61d45fdd4636 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 12:08:53 user nova-compute[74190]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)
Oct 18 12:08:53 user nova-compute[74190]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f (non-flash)
Oct 18 12:08:53 user nova-compute[74190]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28 (non-flash)
Oct 18 12:08:53 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 12:08:53 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-daa722cf-d295-424c-8426-61d45fdd4636 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1f55d09750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f'): ({'sdd'}, set())}) {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 12:08:53 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-daa722cf-d295-424c-8426-61d45fdd4636 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Removing single pathed devices sdd {{(pid=74190) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 12:08:53 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:08:53 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:08:53 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf232305-163f-41f1-ab7d-b758f447b6e3]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:08:53 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:08:53 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:08:53 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe2098a7-0f96-459a-8f24-e349d4701456]: (4, ('ok\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:08:53 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-daa722cf-d295-424c-8426-61d45fdd4636 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Flushing IO for device /dev/sdd {{(pid=74190) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 12:08:53 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:08:53 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:08:53 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1c4f2ae-e586-4833-a7f8-c651c89c12d9]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:08:53 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-daa722cf-d295-424c-8426-61d45fdd4636 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74190) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 12:08:53 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:08:53 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:08:53 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[b46b474e-64a2-4b18-8c8e-d692944b5e41]: (4, ('1', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:08:53 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-daa722cf-d295-424c-8426-61d45fdd4636 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 12:08:53 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-daa722cf-d295-424c-8426-61d45fdd4636 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] SCSI volumes sdd have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 12:08:53 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-daa722cf-d295-424c-8426-61d45fdd4636 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f')] {{(pid=74190) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 12:08:53 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:08:53 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:08:53 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f4996c3-aac5-42b5-a117-4b83e42ff739]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:08:53 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-daa722cf-d295-424c-8426-61d45fdd4636 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:08:53 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f -p 172.16.0.220:3260 --logout {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:08:53 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:08:53 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[003b32e2-32db-4a7c-a573-ad857e2493a4]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:08:53 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-daa722cf-d295-424c-8426-61d45fdd4636 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f, portal: 172.16.0.220,3260]
Oct 18 12:08:53 user nova-compute[74190]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f, portal: 172.16.0.220,3260] successful.
Oct 18 12:08:53 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:08:53 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f -p 172.16.0.220:3260 --op delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:08:53 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26ec0b23-e3ee-4b1f-bdc3-4db1a6f5c69f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:08:53 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e73c57-ffed-4a49-9ec9-18b10186fd5c]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:08:53 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-daa722cf-d295-424c-8426-61d45fdd4636 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:08:53 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-daa722cf-d295-424c-8426-61d45fdd4636 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 12:08:53 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-daa722cf-d295-424c-8426-61d45fdd4636 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] <== disconnect_volume: return (328ms) None {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 12:08:53 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-daa722cf-d295-424c-8426-61d45fdd4636 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Disconnected iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 12:08:53 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:08:54 user nova-compute[74190]: DEBUG nova.objects.instance [None req-daa722cf-d295-424c-8426-61d45fdd4636 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lazy-loading 'flavor' on Instance uuid 7f79a267-5bc8-4fa0-9e3a-4706fa1da142 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:08:54 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-daa722cf-d295-424c-8426-61d45fdd4636 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lock "7f79a267-5bc8-4fa0-9e3a-4706fa1da142" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.836s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:08:55 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:08:58 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:09:00 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:09:03 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:09:05 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:09:08 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:09:08 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:09:11 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:09:11 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:09:13 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:09:15 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:09:15 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Starting heal instance info cache {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 12:09:15 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "refresh_cache-7f79a267-5bc8-4fa0-9e3a-4706fa1da142" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:09:15 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquired lock "refresh_cache-7f79a267-5bc8-4fa0-9e3a-4706fa1da142" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:09:15 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Forcefully refreshing network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 18 12:09:15 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Updating instance_info_cache with network_info: [{"id": "85b87aa7-52a9-4487-a954-7e07dcf20500", "address": "fa:16:3e:68:65:7b", "network": {"id": "130f7948-11e4-49b4-9d4a-dffb2b48bdcd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595419292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ffa18c02b8a4117ab1ccc52aca64f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85b87aa7-52", "ovs_interfaceid": "85b87aa7-52a9-4487-a954-7e07dcf20500", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:09:15 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Releasing lock "refresh_cache-7f79a267-5bc8-4fa0-9e3a-4706fa1da142" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:09:15 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Updated the network info_cache for instance {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 18 12:09:16 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:09:18 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:09:18 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:09:18 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:09:18 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:09:18 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:09:18 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Auditing locally available compute resources for user (node: user) {{(pid=74190) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 12:09:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f59adf3-9728-4d5b-87d5-2ad32c99d06e/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:09:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f59adf3-9728-4d5b-87d5-2ad32c99d06e/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:09:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f59adf3-9728-4d5b-87d5-2ad32c99d06e/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:09:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f59adf3-9728-4d5b-87d5-2ad32c99d06e/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:09:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f79a267-5bc8-4fa0-9e3a-4706fa1da142/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:09:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f79a267-5bc8-4fa0-9e3a-4706fa1da142/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:09:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f79a267-5bc8-4fa0-9e3a-4706fa1da142/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:09:18 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:09:19 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f79a267-5bc8-4fa0-9e3a-4706fa1da142/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:09:19 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:09:19 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:09:19 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:09:19 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:09:19 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1e27a16-43e4-4e80-9c0a-5c2dce06daae/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:09:19 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1e27a16-43e4-4e80-9c0a-5c2dce06daae/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:09:19 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1e27a16-43e4-4e80-9c0a-5c2dce06daae/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:09:19 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1e27a16-43e4-4e80-9c0a-5c2dce06daae/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:09:19 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:09:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:09:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:09:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:09:20 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 12:09:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:09:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:09:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:09:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:09:20 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 12:09:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk.rescue --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:09:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:09:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk.rescue --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:09:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:09:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:09:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:09:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:09:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:09:21 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 12:09:21 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:09:21 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:09:21 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Hypervisor/Node resource view: name=user free_ram=7917MB free_disk=24.944869995117188GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74190) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 12:09:21 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:09:21 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:09:22 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 4e916d24-9f9d-4289-87ce-f65d2499fcd9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:09:22 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 95ca0697-22b5-4109-868f-ca5556015a1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:09:22 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 42413a94-9973-4e8d-83b6-207a4e7847c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:09:22 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 772b126c-2148-4ca8-90f2-69d6eb4b7db7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:09:22 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 0382820d-a678-4593-85df-168f42fc4ce4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:09:22 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 2f59adf3-9728-4d5b-87d5-2ad32c99d06e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:09:22 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 7f79a267-5bc8-4fa0-9e3a-4706fa1da142 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:09:22 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance b1e27a16-43e4-4e80-9c0a-5c2dce06daae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:09:22 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 5861a219-456a-43dd-898c-a99ed3051d83 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:09:22 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 12:09:22 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 12:09:22 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 12:09:22 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 12:09:22 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Compute_service record updated for user:user {{(pid=74190) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 12:09:22 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.467s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:09:22 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-13982ed0-da40-45bb-b308-b69f3912f982 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Acquiring lock "7f79a267-5bc8-4fa0-9e3a-4706fa1da142" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:09:22 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-13982ed0-da40-45bb-b308-b69f3912f982 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lock "7f79a267-5bc8-4fa0-9e3a-4706fa1da142" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:09:22 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-13982ed0-da40-45bb-b308-b69f3912f982 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Acquiring lock "7f79a267-5bc8-4fa0-9e3a-4706fa1da142-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:09:22 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-13982ed0-da40-45bb-b308-b69f3912f982 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lock "7f79a267-5bc8-4fa0-9e3a-4706fa1da142-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:09:22 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-13982ed0-da40-45bb-b308-b69f3912f982 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lock "7f79a267-5bc8-4fa0-9e3a-4706fa1da142-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:09:22 user nova-compute[74190]: INFO nova.compute.manager [None req-13982ed0-da40-45bb-b308-b69f3912f982 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Terminating instance
Oct 18 12:09:22 user nova-compute[74190]: DEBUG nova.compute.manager [None req-13982ed0-da40-45bb-b308-b69f3912f982 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Start destroying the instance on the hypervisor. {{(pid=74190) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 12:09:22 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:09:22 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:09:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:09:23 user nova-compute[74190]: DEBUG nova.compute.manager [req-76725797-60d3-45be-ad30-29941e92bba1 req-296bd8a1-243d-4b06-872e-25820d2714a2 service nova] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Received event network-vif-unplugged-85b87aa7-52a9-4487-a954-7e07dcf20500 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:09:23 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-76725797-60d3-45be-ad30-29941e92bba1 req-296bd8a1-243d-4b06-872e-25820d2714a2 service nova] Acquiring lock "7f79a267-5bc8-4fa0-9e3a-4706fa1da142-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:09:23 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-76725797-60d3-45be-ad30-29941e92bba1 req-296bd8a1-243d-4b06-872e-25820d2714a2 service nova] Lock "7f79a267-5bc8-4fa0-9e3a-4706fa1da142-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:09:23 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-76725797-60d3-45be-ad30-29941e92bba1 req-296bd8a1-243d-4b06-872e-25820d2714a2 service nova] Lock "7f79a267-5bc8-4fa0-9e3a-4706fa1da142-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:09:23 user nova-compute[74190]: DEBUG nova.compute.manager [req-76725797-60d3-45be-ad30-29941e92bba1 req-296bd8a1-243d-4b06-872e-25820d2714a2 service nova] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] No waiting events found dispatching network-vif-unplugged-85b87aa7-52a9-4487-a954-7e07dcf20500 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:09:23 user nova-compute[74190]: DEBUG nova.compute.manager [req-76725797-60d3-45be-ad30-29941e92bba1 req-296bd8a1-243d-4b06-872e-25820d2714a2 service nova] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Received event network-vif-unplugged-85b87aa7-52a9-4487-a954-7e07dcf20500 for instance with task_state deleting. {{(pid=74190) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 12:09:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:09:23 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:09:23 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:09:23 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:09:23 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74190) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 12:09:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:09:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:09:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:09:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:09:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:09:23 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Instance destroyed successfully.
Oct 18 12:09:23 user nova-compute[74190]: DEBUG nova.objects.instance [None req-13982ed0-da40-45bb-b308-b69f3912f982 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lazy-loading 'resources' on Instance uuid 7f79a267-5bc8-4fa0-9e3a-4706fa1da142 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:09:23 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-13982ed0-da40-45bb-b308-b69f3912f982 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T12:02:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1792483886',display_name='tempest-ServerRescueNegativeTestJSON-server-1792483886',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1792483886',id=36,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkIQ8d3leZjsvwziIWZ+8LvZaK+fQGEHmIEFhtuiFYjCN5LSlir32U0rEoPzQvvKfWbmmXf87lyxNJGp1oDmc+aRdOnCgCKp/U0aihiZb7ZCRL045Ck061Eajb0ZA9iDQ==',key_name='tempest-keypair-132610173',keypairs=<?>,launch_index=0,launched_at=2023-10-18T12:04:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1ffa18c02b8a4117ab1ccc52aca64f06',ramdisk_id='',reservation_id='r-mifp9rvd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1266902394',owner_user_name='tempest-ServerRescueNegativeTestJSON-1266902394-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T12:06:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9db2d65206e24d0aa1428b9bcaa0a86e',uuid=7f79a267-5bc8-4fa0-9e3a-4706fa1da142,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "85b87aa7-52a9-4487-a954-7e07dcf20500", "address": "fa:16:3e:68:65:7b", "network": {"id": "130f7948-11e4-49b4-9d4a-dffb2b48bdcd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595419292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ffa18c02b8a4117ab1ccc52aca64f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85b87aa7-52", "ovs_interfaceid": "85b87aa7-52a9-4487-a954-7e07dcf20500", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 12:09:23 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-13982ed0-da40-45bb-b308-b69f3912f982 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Converting VIF {"id": "85b87aa7-52a9-4487-a954-7e07dcf20500", "address": "fa:16:3e:68:65:7b", "network": {"id": "130f7948-11e4-49b4-9d4a-dffb2b48bdcd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595419292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ffa18c02b8a4117ab1ccc52aca64f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85b87aa7-52", "ovs_interfaceid": "85b87aa7-52a9-4487-a954-7e07dcf20500", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 12:09:23 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-13982ed0-da40-45bb-b308-b69f3912f982 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:68:65:7b,bridge_name='br-int',has_traffic_filtering=True,id=85b87aa7-52a9-4487-a954-7e07dcf20500,network=Network(130f7948-11e4-49b4-9d4a-dffb2b48bdcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85b87aa7-52') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 12:09:23 user nova-compute[74190]: DEBUG os_vif [None req-13982ed0-da40-45bb-b308-b69f3912f982 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:65:7b,bridge_name='br-int',has_traffic_filtering=True,id=85b87aa7-52a9-4487-a954-7e07dcf20500,network=Network(130f7948-11e4-49b4-9d4a-dffb2b48bdcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85b87aa7-52') {{(pid=74190) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 12:09:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:09:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap85b87aa7-52, bridge=br-int, if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:09:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:09:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:09:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:09:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fbe1e938-edd9-40c2-9a6a-27fc615d4582) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:09:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:09:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:09:23 user nova-compute[74190]: INFO os_vif [None req-13982ed0-da40-45bb-b308-b69f3912f982 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:65:7b,bridge_name='br-int',has_traffic_filtering=True,id=85b87aa7-52a9-4487-a954-7e07dcf20500,network=Network(130f7948-11e4-49b4-9d4a-dffb2b48bdcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85b87aa7-52')
Oct 18 12:09:23 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-13982ed0-da40-45bb-b308-b69f3912f982 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Deleting instance files /opt/stack/data/nova/instances/7f79a267-5bc8-4fa0-9e3a-4706fa1da142_del
Oct 18 12:09:23 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-13982ed0-da40-45bb-b308-b69f3912f982 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Deletion of /opt/stack/data/nova/instances/7f79a267-5bc8-4fa0-9e3a-4706fa1da142_del complete
Oct 18 12:09:23 user nova-compute[74190]: INFO nova.compute.manager [None req-13982ed0-da40-45bb-b308-b69f3912f982 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Took 1.10 seconds to destroy the instance on the hypervisor.
Oct 18 12:09:23 user nova-compute[74190]: DEBUG oslo.service.loopingcall [None req-13982ed0-da40-45bb-b308-b69f3912f982 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74190) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 12:09:23 user nova-compute[74190]: DEBUG nova.compute.manager [-] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Deallocating network for instance {{(pid=74190) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 12:09:23 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] deallocate_for_instance() {{(pid=74190) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 12:09:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:09:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:09:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:09:25 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Updating instance_info_cache with network_info: [] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:09:25 user nova-compute[74190]: INFO nova.compute.manager [-] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Took 1.07 seconds to deallocate network for instance.
Oct 18 12:09:25 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-13982ed0-da40-45bb-b308-b69f3912f982 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:09:25 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-13982ed0-da40-45bb-b308-b69f3912f982 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:09:25 user nova-compute[74190]: DEBUG nova.compute.manager [req-d6d3dc7c-f68a-4406-ace9-c0ab0ba2449e req-8f97e334-fbe4-43dd-980f-fb9175d82cab service nova] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Received event network-vif-plugged-85b87aa7-52a9-4487-a954-7e07dcf20500 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:09:25 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d6d3dc7c-f68a-4406-ace9-c0ab0ba2449e req-8f97e334-fbe4-43dd-980f-fb9175d82cab service nova] Acquiring lock "7f79a267-5bc8-4fa0-9e3a-4706fa1da142-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:09:25 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d6d3dc7c-f68a-4406-ace9-c0ab0ba2449e req-8f97e334-fbe4-43dd-980f-fb9175d82cab service nova] Lock "7f79a267-5bc8-4fa0-9e3a-4706fa1da142-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:09:25 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d6d3dc7c-f68a-4406-ace9-c0ab0ba2449e req-8f97e334-fbe4-43dd-980f-fb9175d82cab service nova] Lock "7f79a267-5bc8-4fa0-9e3a-4706fa1da142-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:09:25 user nova-compute[74190]: DEBUG nova.compute.manager [req-d6d3dc7c-f68a-4406-ace9-c0ab0ba2449e req-8f97e334-fbe4-43dd-980f-fb9175d82cab service nova] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] No waiting events found dispatching network-vif-plugged-85b87aa7-52a9-4487-a954-7e07dcf20500 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:09:25 user nova-compute[74190]: WARNING nova.compute.manager [req-d6d3dc7c-f68a-4406-ace9-c0ab0ba2449e req-8f97e334-fbe4-43dd-980f-fb9175d82cab service nova] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Received unexpected event network-vif-plugged-85b87aa7-52a9-4487-a954-7e07dcf20500 for instance with vm_state deleted and task_state None.
Oct 18 12:09:25 user nova-compute[74190]: DEBUG nova.compute.manager [req-d6d3dc7c-f68a-4406-ace9-c0ab0ba2449e req-8f97e334-fbe4-43dd-980f-fb9175d82cab service nova] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Received event network-vif-plugged-85b87aa7-52a9-4487-a954-7e07dcf20500 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:09:25 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d6d3dc7c-f68a-4406-ace9-c0ab0ba2449e req-8f97e334-fbe4-43dd-980f-fb9175d82cab service nova] Acquiring lock "7f79a267-5bc8-4fa0-9e3a-4706fa1da142-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:09:25 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d6d3dc7c-f68a-4406-ace9-c0ab0ba2449e req-8f97e334-fbe4-43dd-980f-fb9175d82cab service nova] Lock "7f79a267-5bc8-4fa0-9e3a-4706fa1da142-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:09:25 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d6d3dc7c-f68a-4406-ace9-c0ab0ba2449e req-8f97e334-fbe4-43dd-980f-fb9175d82cab service nova] Lock "7f79a267-5bc8-4fa0-9e3a-4706fa1da142-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:09:25 user nova-compute[74190]: DEBUG nova.compute.manager [req-d6d3dc7c-f68a-4406-ace9-c0ab0ba2449e req-8f97e334-fbe4-43dd-980f-fb9175d82cab service nova] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] No waiting events found dispatching network-vif-plugged-85b87aa7-52a9-4487-a954-7e07dcf20500 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:09:25 user nova-compute[74190]: WARNING nova.compute.manager [req-d6d3dc7c-f68a-4406-ace9-c0ab0ba2449e req-8f97e334-fbe4-43dd-980f-fb9175d82cab service nova] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Received unexpected event network-vif-plugged-85b87aa7-52a9-4487-a954-7e07dcf20500 for instance with vm_state deleted and task_state None.
Oct 18 12:09:25 user nova-compute[74190]: DEBUG nova.compute.manager [req-d6d3dc7c-f68a-4406-ace9-c0ab0ba2449e req-8f97e334-fbe4-43dd-980f-fb9175d82cab service nova] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Received event network-vif-plugged-85b87aa7-52a9-4487-a954-7e07dcf20500 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:09:25 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d6d3dc7c-f68a-4406-ace9-c0ab0ba2449e req-8f97e334-fbe4-43dd-980f-fb9175d82cab service nova] Acquiring lock "7f79a267-5bc8-4fa0-9e3a-4706fa1da142-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:09:25 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d6d3dc7c-f68a-4406-ace9-c0ab0ba2449e req-8f97e334-fbe4-43dd-980f-fb9175d82cab service nova] Lock "7f79a267-5bc8-4fa0-9e3a-4706fa1da142-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:09:25 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d6d3dc7c-f68a-4406-ace9-c0ab0ba2449e req-8f97e334-fbe4-43dd-980f-fb9175d82cab service nova] Lock "7f79a267-5bc8-4fa0-9e3a-4706fa1da142-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:09:25 user nova-compute[74190]: DEBUG nova.compute.manager [req-d6d3dc7c-f68a-4406-ace9-c0ab0ba2449e req-8f97e334-fbe4-43dd-980f-fb9175d82cab service nova] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] No waiting events found dispatching network-vif-plugged-85b87aa7-52a9-4487-a954-7e07dcf20500 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:09:25 user nova-compute[74190]: WARNING nova.compute.manager [req-d6d3dc7c-f68a-4406-ace9-c0ab0ba2449e req-8f97e334-fbe4-43dd-980f-fb9175d82cab service nova] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Received unexpected event network-vif-plugged-85b87aa7-52a9-4487-a954-7e07dcf20500 for instance with vm_state deleted and task_state None.
Oct 18 12:09:25 user nova-compute[74190]: DEBUG nova.compute.manager [req-d6d3dc7c-f68a-4406-ace9-c0ab0ba2449e req-8f97e334-fbe4-43dd-980f-fb9175d82cab service nova] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Received event network-vif-unplugged-85b87aa7-52a9-4487-a954-7e07dcf20500 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:09:25 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d6d3dc7c-f68a-4406-ace9-c0ab0ba2449e req-8f97e334-fbe4-43dd-980f-fb9175d82cab service nova] Acquiring lock "7f79a267-5bc8-4fa0-9e3a-4706fa1da142-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:09:25 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d6d3dc7c-f68a-4406-ace9-c0ab0ba2449e req-8f97e334-fbe4-43dd-980f-fb9175d82cab service nova] Lock "7f79a267-5bc8-4fa0-9e3a-4706fa1da142-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:09:25 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d6d3dc7c-f68a-4406-ace9-c0ab0ba2449e req-8f97e334-fbe4-43dd-980f-fb9175d82cab service nova] Lock "7f79a267-5bc8-4fa0-9e3a-4706fa1da142-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:09:25 user nova-compute[74190]: DEBUG nova.compute.manager [req-d6d3dc7c-f68a-4406-ace9-c0ab0ba2449e req-8f97e334-fbe4-43dd-980f-fb9175d82cab service nova] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] No waiting events found dispatching network-vif-unplugged-85b87aa7-52a9-4487-a954-7e07dcf20500 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:09:25 user nova-compute[74190]: WARNING nova.compute.manager [req-d6d3dc7c-f68a-4406-ace9-c0ab0ba2449e req-8f97e334-fbe4-43dd-980f-fb9175d82cab service nova] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Received unexpected event network-vif-unplugged-85b87aa7-52a9-4487-a954-7e07dcf20500 for instance with vm_state deleted and task_state None.
Oct 18 12:09:25 user nova-compute[74190]: DEBUG nova.compute.manager [req-d6d3dc7c-f68a-4406-ace9-c0ab0ba2449e req-8f97e334-fbe4-43dd-980f-fb9175d82cab service nova] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Received event network-vif-plugged-85b87aa7-52a9-4487-a954-7e07dcf20500 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:09:25 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d6d3dc7c-f68a-4406-ace9-c0ab0ba2449e req-8f97e334-fbe4-43dd-980f-fb9175d82cab service nova] Acquiring lock "7f79a267-5bc8-4fa0-9e3a-4706fa1da142-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:09:25 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d6d3dc7c-f68a-4406-ace9-c0ab0ba2449e req-8f97e334-fbe4-43dd-980f-fb9175d82cab service nova] Lock "7f79a267-5bc8-4fa0-9e3a-4706fa1da142-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:09:25 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d6d3dc7c-f68a-4406-ace9-c0ab0ba2449e req-8f97e334-fbe4-43dd-980f-fb9175d82cab service nova] Lock "7f79a267-5bc8-4fa0-9e3a-4706fa1da142-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:09:25 user nova-compute[74190]: DEBUG nova.compute.manager [req-d6d3dc7c-f68a-4406-ace9-c0ab0ba2449e req-8f97e334-fbe4-43dd-980f-fb9175d82cab service nova] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] No waiting events found dispatching network-vif-plugged-85b87aa7-52a9-4487-a954-7e07dcf20500 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:09:25 user nova-compute[74190]: WARNING nova.compute.manager [req-d6d3dc7c-f68a-4406-ace9-c0ab0ba2449e req-8f97e334-fbe4-43dd-980f-fb9175d82cab service nova] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Received unexpected event network-vif-plugged-85b87aa7-52a9-4487-a954-7e07dcf20500 for instance with vm_state deleted and task_state None.
Oct 18 12:09:25 user nova-compute[74190]: DEBUG nova.compute.manager [req-d6d3dc7c-f68a-4406-ace9-c0ab0ba2449e req-8f97e334-fbe4-43dd-980f-fb9175d82cab service nova] [instance: 7f79a267-5bc8-4fa0-9e3a-4706fa1da142] Received event network-vif-deleted-85b87aa7-52a9-4487-a954-7e07dcf20500 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:09:25 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-13982ed0-da40-45bb-b308-b69f3912f982 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 12:09:25 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-13982ed0-da40-45bb-b308-b69f3912f982 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 12:09:25 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-13982ed0-da40-45bb-b308-b69f3912f982 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.328s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:09:25 user nova-compute[74190]: INFO nova.scheduler.client.report [None req-13982ed0-da40-45bb-b308-b69f3912f982 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Deleted allocations for instance 7f79a267-5bc8-4fa0-9e3a-4706fa1da142
Oct 18 12:09:25 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-13982ed0-da40-45bb-b308-b69f3912f982 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lock "7f79a267-5bc8-4fa0-9e3a-4706fa1da142" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.723s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:09:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:09:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:09:32 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Acquiring lock "7c539213-358a-48fd-9abd-1f017ba5b54a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:09:32 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "7c539213-358a-48fd-9abd-1f017ba5b54a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:09:32 user nova-compute[74190]: DEBUG nova.compute.manager [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 7c539213-358a-48fd-9abd-1f017ba5b54a] Starting instance... {{(pid=74190) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 12:09:32 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:09:32 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:09:32 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74190) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 12:09:32 user nova-compute[74190]: INFO nova.compute.claims [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 7c539213-358a-48fd-9abd-1f017ba5b54a] Claim successful on node user
Oct 18 12:09:32 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 12:09:32 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 12:09:32 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.394s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:09:32 user nova-compute[74190]: DEBUG nova.compute.manager [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 7c539213-358a-48fd-9abd-1f017ba5b54a] Start building networks asynchronously for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 12:09:32 user nova-compute[74190]: DEBUG nova.compute.manager [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 7c539213-358a-48fd-9abd-1f017ba5b54a] Allocating IP information in the background. {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 12:09:32 user nova-compute[74190]: DEBUG nova.network.neutron [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 7c539213-358a-48fd-9abd-1f017ba5b54a] allocate_for_instance() {{(pid=74190) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 12:09:32 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 7c539213-358a-48fd-9abd-1f017ba5b54a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 12:09:32 user nova-compute[74190]: DEBUG nova.compute.manager [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 7c539213-358a-48fd-9abd-1f017ba5b54a] Start building block device mappings for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 12:09:32 user nova-compute[74190]: INFO nova.virt.block_device [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 7c539213-358a-48fd-9abd-1f017ba5b54a] Booting with volume 6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf at /dev/vda
Oct 18 12:09:32 user nova-compute[74190]: DEBUG nova.policy [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '27d9fc244d0f4e10a43b7df4dc8e30ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e375153f6f24827811c5825fc2a2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74190) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 12:09:32 user nova-compute[74190]: DEBUG os_brick.utils [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 12:09:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:09:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:09:32 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[72082d26-c31f-4407-9623-2a275bb3611d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cff158e257e1\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:09:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:09:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:09:32 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[a482f0b6-a762-4a06-b677-925dbe836853]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:09:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:09:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:09:32 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[38378d50-6f48-424a-b224-5a2597a76da2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:09:32 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7fac631-34c9-40d8-be4d-ece451e1a664]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:09:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Running cmd (subprocess): nvme version {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:09:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] 'nvme version' failed. Not Retrying. {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 12:09:32 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] nvme not present on system {{(pid=74190) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 12:09:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:09:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 12:09:32 user nova-compute[74190]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 12:09:32 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf99356-9469-4044-9da4-1edf2f1628d4]: (4, '') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:09:32 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74190) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 12:09:32 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 12:09:32 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] LIGHTOS: no hostnqn found. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 12:09:32 user nova-compute[74190]: DEBUG os_brick.utils [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cff158e257e1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 12:09:32 user nova-compute[74190]: DEBUG nova.virt.block_device [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 7c539213-358a-48fd-9abd-1f017ba5b54a] Updating existing volume attachment record: 6e96a071-26f4-440e-a2a3-527531edb183 {{(pid=74190) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 12:09:33 user nova-compute[74190]: DEBUG nova.network.neutron [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 7c539213-358a-48fd-9abd-1f017ba5b54a] Successfully created port: ecc36cc2-dc28-452e-82f2-0d347537cd36 {{(pid=74190) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 12:09:33 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:09:34 user nova-compute[74190]: DEBUG nova.network.neutron [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 7c539213-358a-48fd-9abd-1f017ba5b54a] Successfully updated port: ecc36cc2-dc28-452e-82f2-0d347537cd36 {{(pid=74190) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 12:09:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Acquiring lock "refresh_cache-7c539213-358a-48fd-9abd-1f017ba5b54a" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:09:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Acquired lock "refresh_cache-7c539213-358a-48fd-9abd-1f017ba5b54a" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:09:34 user nova-compute[74190]: DEBUG nova.network.neutron [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 7c539213-358a-48fd-9abd-1f017ba5b54a] Building network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 12:09:34 user nova-compute[74190]: DEBUG nova.compute.manager [req-08446140-6064-4493-9c04-3750b7e19fa4 req-24daced4-4690-49eb-9f1c-6dcfe1759711 service nova] [instance: 7c539213-358a-48fd-9abd-1f017ba5b54a] Received event network-changed-ecc36cc2-dc28-452e-82f2-0d347537cd36 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:09:34 user nova-compute[74190]: DEBUG nova.compute.manager [req-08446140-6064-4493-9c04-3750b7e19fa4 req-24daced4-4690-49eb-9f1c-6dcfe1759711 service nova] [instance: 7c539213-358a-48fd-9abd-1f017ba5b54a] Refreshing instance network info cache due to event network-changed-ecc36cc2-dc28-452e-82f2-0d347537cd36. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 12:09:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-08446140-6064-4493-9c04-3750b7e19fa4 req-24daced4-4690-49eb-9f1c-6dcfe1759711 service nova] Acquiring lock "refresh_cache-7c539213-358a-48fd-9abd-1f017ba5b54a" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:09:34 user nova-compute[74190]: DEBUG nova.network.neutron [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 7c539213-358a-48fd-9abd-1f017ba5b54a] Instance cache missing network info. {{(pid=74190) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 12:09:34 user nova-compute[74190]: DEBUG nova.network.neutron [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 7c539213-358a-48fd-9abd-1f017ba5b54a] Updating instance_info_cache with network_info: [{"id": "ecc36cc2-dc28-452e-82f2-0d347537cd36", "address": "fa:16:3e:0e:31:0c", "network": {"id": "aa827f81-b165-444f-89cc-f21c42a9f772", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1659902586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e375153f6f24827811c5825fc2a2c6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc36cc2-dc", "ovs_interfaceid": "ecc36cc2-dc28-452e-82f2-0d347537cd36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:09:35 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Releasing lock "refresh_cache-7c539213-358a-48fd-9abd-1f017ba5b54a" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:09:35 user nova-compute[74190]: DEBUG nova.compute.manager [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 7c539213-358a-48fd-9abd-1f017ba5b54a] Instance network_info: |[{"id": "ecc36cc2-dc28-452e-82f2-0d347537cd36", "address": "fa:16:3e:0e:31:0c", "network": {"id": "aa827f81-b165-444f-89cc-f21c42a9f772", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1659902586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e375153f6f24827811c5825fc2a2c6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc36cc2-dc", "ovs_interfaceid": "ecc36cc2-dc28-452e-82f2-0d347537cd36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 12:09:35 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-08446140-6064-4493-9c04-3750b7e19fa4 req-24daced4-4690-49eb-9f1c-6dcfe1759711 service nova] Acquired lock "refresh_cache-7c539213-358a-48fd-9abd-1f017ba5b54a" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:09:35 user nova-compute[74190]: DEBUG nova.network.neutron [req-08446140-6064-4493-9c04-3750b7e19fa4 req-24daced4-4690-49eb-9f1c-6dcfe1759711 service nova] [instance: 7c539213-358a-48fd-9abd-1f017ba5b54a] Refreshing network info cache for port ecc36cc2-dc28-452e-82f2-0d347537cd36 {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 12:09:35 user nova-compute[74190]: DEBUG nova.network.neutron [req-08446140-6064-4493-9c04-3750b7e19fa4 req-24daced4-4690-49eb-9f1c-6dcfe1759711 service nova] [instance: 7c539213-358a-48fd-9abd-1f017ba5b54a] Updated VIF entry in instance network info cache for port ecc36cc2-dc28-452e-82f2-0d347537cd36. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 12:09:35 user nova-compute[74190]: DEBUG nova.network.neutron [req-08446140-6064-4493-9c04-3750b7e19fa4 req-24daced4-4690-49eb-9f1c-6dcfe1759711 service nova] [instance: 7c539213-358a-48fd-9abd-1f017ba5b54a] Updating instance_info_cache with network_info: [{"id": "ecc36cc2-dc28-452e-82f2-0d347537cd36", "address": "fa:16:3e:0e:31:0c", "network": {"id": "aa827f81-b165-444f-89cc-f21c42a9f772", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1659902586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e375153f6f24827811c5825fc2a2c6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc36cc2-dc", "ovs_interfaceid": "ecc36cc2-dc28-452e-82f2-0d347537cd36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:09:35 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-08446140-6064-4493-9c04-3750b7e19fa4 req-24daced4-4690-49eb-9f1c-6dcfe1759711 service nova] Releasing lock "refresh_cache-7c539213-358a-48fd-9abd-1f017ba5b54a" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:09:38 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:09:38 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:09:40 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:09:40 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:09:43 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:09:43 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:09:45 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:09:46 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:09:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:09:50 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-29e5adb3-c07a-4ccb-8324-36495bbfbc09 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Acquiring lock "800d5074-2de1-44ce-8f4a-9a7f5ed110c0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:09:50 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-29e5adb3-c07a-4ccb-8324-36495bbfbc09 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Lock "800d5074-2de1-44ce-8f4a-9a7f5ed110c0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:09:50 user nova-compute[74190]: DEBUG nova.compute.manager [None req-29e5adb3-c07a-4ccb-8324-36495bbfbc09 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] [instance: 800d5074-2de1-44ce-8f4a-9a7f5ed110c0] Starting instance... {{(pid=74190) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 12:09:50 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-29e5adb3-c07a-4ccb-8324-36495bbfbc09 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:09:50 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-29e5adb3-c07a-4ccb-8324-36495bbfbc09 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:09:50 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-29e5adb3-c07a-4ccb-8324-36495bbfbc09 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74190) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 12:09:50 user nova-compute[74190]: INFO nova.compute.claims [None req-29e5adb3-c07a-4ccb-8324-36495bbfbc09 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] [instance: 800d5074-2de1-44ce-8f4a-9a7f5ed110c0] Claim successful on node user
Oct 18 12:09:50 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:09:50 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-29e5adb3-c07a-4ccb-8324-36495bbfbc09 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 12:09:50 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-29e5adb3-c07a-4ccb-8324-36495bbfbc09 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 12:09:50 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-29e5adb3-c07a-4ccb-8324-36495bbfbc09 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.533s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:09:50 user nova-compute[74190]: DEBUG nova.compute.manager [None req-29e5adb3-c07a-4ccb-8324-36495bbfbc09 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] [instance: 800d5074-2de1-44ce-8f4a-9a7f5ed110c0] Start building networks asynchronously for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 12:09:50 user nova-compute[74190]: DEBUG nova.compute.manager [None req-29e5adb3-c07a-4ccb-8324-36495bbfbc09 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] [instance: 800d5074-2de1-44ce-8f4a-9a7f5ed110c0] Allocating IP information in the background. {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 12:09:50 user nova-compute[74190]: DEBUG nova.network.neutron [None req-29e5adb3-c07a-4ccb-8324-36495bbfbc09 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] [instance: 800d5074-2de1-44ce-8f4a-9a7f5ed110c0] allocate_for_instance() {{(pid=74190) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 12:09:50 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-29e5adb3-c07a-4ccb-8324-36495bbfbc09 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] [instance: 800d5074-2de1-44ce-8f4a-9a7f5ed110c0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 12:09:51 user nova-compute[74190]: DEBUG nova.compute.manager [None req-29e5adb3-c07a-4ccb-8324-36495bbfbc09 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] [instance: 800d5074-2de1-44ce-8f4a-9a7f5ed110c0] Start building block device mappings for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 12:09:51 user nova-compute[74190]: DEBUG nova.policy [None req-29e5adb3-c07a-4ccb-8324-36495bbfbc09 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '90dc927061594985a654a4a504c59c03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56d8b29004d4bf5b0e67efba6520cbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74190) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 12:09:51 user nova-compute[74190]: DEBUG nova.compute.manager [None req-29e5adb3-c07a-4ccb-8324-36495bbfbc09 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] [instance: 800d5074-2de1-44ce-8f4a-9a7f5ed110c0] Start spawning the instance on the hypervisor. {{(pid=74190) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 12:09:51 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-29e5adb3-c07a-4ccb-8324-36495bbfbc09 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] [instance: 800d5074-2de1-44ce-8f4a-9a7f5ed110c0] Creating instance directory {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 12:09:51 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-29e5adb3-c07a-4ccb-8324-36495bbfbc09 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] [instance: 800d5074-2de1-44ce-8f4a-9a7f5ed110c0] Creating image(s)
Oct 18 12:09:51 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-29e5adb3-c07a-4ccb-8324-36495bbfbc09 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Acquiring lock "/opt/stack/data/nova/instances/800d5074-2de1-44ce-8f4a-9a7f5ed110c0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:09:51 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-29e5adb3-c07a-4ccb-8324-36495bbfbc09 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Lock "/opt/stack/data/nova/instances/800d5074-2de1-44ce-8f4a-9a7f5ed110c0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:09:51 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-29e5adb3-c07a-4ccb-8324-36495bbfbc09 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Lock "/opt/stack/data/nova/instances/800d5074-2de1-44ce-8f4a-9a7f5ed110c0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:09:51 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-29e5adb3-c07a-4ccb-8324-36495bbfbc09 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:09:51 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-29e5adb3-c07a-4ccb-8324-36495bbfbc09 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.212s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:09:51 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-29e5adb3-c07a-4ccb-8324-36495bbfbc09 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Acquiring lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:09:51 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-29e5adb3-c07a-4ccb-8324-36495bbfbc09 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:09:51 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-29e5adb3-c07a-4ccb-8324-36495bbfbc09 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:09:51 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-29e5adb3-c07a-4ccb-8324-36495bbfbc09 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.222s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:09:51 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-29e5adb3-c07a-4ccb-8324-36495bbfbc09 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f,backing_fmt=raw /opt/stack/data/nova/instances/800d5074-2de1-44ce-8f4a-9a7f5ed110c0/disk 1073741824 {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:09:51 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-29e5adb3-c07a-4ccb-8324-36495bbfbc09 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f,backing_fmt=raw /opt/stack/data/nova/instances/800d5074-2de1-44ce-8f4a-9a7f5ed110c0/disk 1073741824" returned: 0 in 0.053s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:09:51 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-29e5adb3-c07a-4ccb-8324-36495bbfbc09 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.284s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:09:51 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-29e5adb3-c07a-4ccb-8324-36495bbfbc09 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:09:51 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-29e5adb3-c07a-4ccb-8324-36495bbfbc09 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.225s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:09:51 user nova-compute[74190]: DEBUG nova.virt.disk.api [None req-29e5adb3-c07a-4ccb-8324-36495bbfbc09 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Checking if we can resize image /opt/stack/data/nova/instances/800d5074-2de1-44ce-8f4a-9a7f5ed110c0/disk. size=1073741824 {{(pid=74190) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 18 12:09:51 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-29e5adb3-c07a-4ccb-8324-36495bbfbc09 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/800d5074-2de1-44ce-8f4a-9a7f5ed110c0/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:09:51 user nova-compute[74190]: DEBUG nova.network.neutron [None req-29e5adb3-c07a-4ccb-8324-36495bbfbc09 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] [instance: 800d5074-2de1-44ce-8f4a-9a7f5ed110c0] Successfully created port: 05810ade-2f7b-4af2-9ed7-f6a70d3842ac {{(pid=74190) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 12:09:52 user nova-compute[74190]: DEBUG nova.compute.manager [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 7c539213-358a-48fd-9abd-1f017ba5b54a] Start spawning the instance on the hypervisor. {{(pid=74190) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 12:09:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 7c539213-358a-48fd-9abd-1f017ba5b54a] Creating instance directory {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 12:09:52 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 7c539213-358a-48fd-9abd-1f017ba5b54a] Creating image(s)
Oct 18 12:09:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 7c539213-358a-48fd-9abd-1f017ba5b54a] Did not create local disks {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 18 12:09:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 7c539213-358a-48fd-9abd-1f017ba5b54a] Ensure instance console log exists: /opt/stack/data/nova/instances/7c539213-358a-48fd-9abd-1f017ba5b54a/console.log {{(pid=74190) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 12:09:52 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:09:52 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:09:52 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:09:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 7c539213-358a-48fd-9abd-1f017ba5b54a] Start _get_guest_xml network_info=[{"id": "ecc36cc2-dc28-452e-82f2-0d347537cd36", "address": "fa:16:3e:0e:31:0c", "network": {"id": "aa827f81-b165-444f-89cc-f21c42a9f772", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1659902586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e375153f6f24827811c5825fc2a2c6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc36cc2-dc", "ovs_interfaceid": "ecc36cc2-dc28-452e-82f2-0d347537cd36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wKMYEdFo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7c539213-358a-48fd-9abd-1f017ba5b54a', 'attached_at': '', 'detached_at': '', 'volume_id': '6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf', 'serial': '6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf'}, 'delete_on_termination': True, 'guest_format': None, 'attachment_id': '6e96a071-26f4-440e-a2a3-527531edb183', 'volume_type': None} {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 12:09:52 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:09:52 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:09:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 12:09:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] CPU controller missing on host. {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 12:09:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 12:09:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] CPU controller found on host. {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 12:09:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74190) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 12:09:52 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T11:37:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 12:09:52 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Flavor limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 12:09:52 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Image limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 12:09:52 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Flavor pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 12:09:52 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Image pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 12:09:52 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 12:09:52 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 12:09:52 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 12:09:52 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Got 1 possible topologies {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 12:09:52 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 12:09:52 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 12:09:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 7c539213-358a-48fd-9abd-1f017ba5b54a] Calling os-brick to attach iSCSI Volume {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 12:09:52 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wKMYEdFo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 12:09:52 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 12:09:52 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 12:09:52 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 12:09:52 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 12:09:52 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 12:09:52 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 12:09:52 user nova-compute[74190]: INFO os_brick.initiator.connectors.iscsi [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 12:09:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf -p 172.16.0.220:3260 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:09:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-29e5adb3-c07a-4ccb-8324-36495bbfbc09 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/800d5074-2de1-44ce-8f4a-9a7f5ed110c0/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:09:52 user nova-compute[74190]: DEBUG nova.virt.disk.api [None req-29e5adb3-c07a-4ccb-8324-36495bbfbc09 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Cannot resize image /opt/stack/data/nova/instances/800d5074-2de1-44ce-8f4a-9a7f5ed110c0/disk to a smaller size. {{(pid=74190) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 18 12:09:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-29e5adb3-c07a-4ccb-8324-36495bbfbc09 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] [instance: 800d5074-2de1-44ce-8f4a-9a7f5ed110c0] Created local disks {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 12:09:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-29e5adb3-c07a-4ccb-8324-36495bbfbc09 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] [instance: 800d5074-2de1-44ce-8f4a-9a7f5ed110c0] Ensure instance console log exists: /opt/stack/data/nova/instances/800d5074-2de1-44ce-8f4a-9a7f5ed110c0/console.log {{(pid=74190) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 12:09:52 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-29e5adb3-c07a-4ccb-8324-36495bbfbc09 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:09:52 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-29e5adb3-c07a-4ccb-8324-36495bbfbc09 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:09:52 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-29e5adb3-c07a-4ccb-8324-36495bbfbc09 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:09:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:09:52 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3c0b907-92d3-4b4d-94dc-f8346bebc59e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:09:52 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 12:09:52 user nova-compute[74190]:  {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:09:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf -p 172.16.0.220:3260 --interface default --op new {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:09:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:09:52 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[42abf33b-d635-4284-957d-4c2c4adb3c8c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf] added\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:09:52 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf] added
Oct 18 12:09:52 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:09:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:09:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:09:52 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[8138761e-f79a-466f-a576-a798e7848d24]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:09:52 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:09:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:09:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:09:52 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6023674-6ba1-4082-a0dd-1f2e2db295ab]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:09:52 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:09:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wKMYEdFo {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:09:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wKMYEdFo" returned: 0 in 0.026s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:09:52 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[e24d32b6-b595-4890-9ee0-b3e3e981a359]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:09:52 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wKMYEdFo'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:09:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:09:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:09:52 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb2d03a-7ea8-47ad-a6f5-3ad544525574]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:09:52 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:09:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:09:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:09:52 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[758a5bc7-e17b-4510-aefb-7e99bd780759]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28 (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:09:52 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 12:09:52 user nova-compute[74190]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)
Oct 18 12:09:52 user nova-compute[74190]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28 (non-flash)
Oct 18 12:09:52 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 12:09:52 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 12:09:52 user nova-compute[74190]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)
Oct 18 12:09:52 user nova-compute[74190]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28 (non-flash)
Oct 18 12:09:52 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 12:09:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf -p 172.16.0.220:3260 --login {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:09:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:09:52 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[369019ae-b9ad-47f5-83c0-6fedf6db55ee]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:09:52 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf, portal: 172.16.0.220,3260]
Oct 18 12:09:52 user nova-compute[74190]: Login to [iface: default, target: iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf, portal: 172.16.0.220,3260] successful.
Oct 18 12:09:52 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:09:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:09:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:09:52 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a98f19-8499-4b8b-bc88-aa4730218047]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:09:52 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:09:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:09:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:09:52 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[69eb43b4-4301-4bc7-9cc8-cb000788b9f5]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:09:52 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 12:09:52 user nova-compute[74190]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)
Oct 18 12:09:52 user nova-compute[74190]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28 (non-flash)
Oct 18 12:09:52 user nova-compute[74190]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf (non-flash)
Oct 18 12:09:52 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 12:09:52 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 12:09:52 user nova-compute[74190]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)
Oct 18 12:09:52 user nova-compute[74190]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28 (non-flash)
Oct 18 12:09:52 user nova-compute[74190]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf (non-flash)
Oct 18 12:09:52 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 12:09:52 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.326s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 12:09:52 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Connected to 172.16.0.220:3260 {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 12:09:52 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] HCTL ('35', '-', '-', 0) found on session 48 with lun 0 {{(pid=74190) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 12:09:52 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74190) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 12:09:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:09:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:09:52 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a669d39-907b-4d48-af8a-fc26b80aeadf]: (4, ('- - 0', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:09:52 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Searching for a device in session 48 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74190) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 12:09:52 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wKMYEdFo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 12:09:52 user nova-compute[74190]: DEBUG nova.network.neutron [None req-29e5adb3-c07a-4ccb-8324-36495bbfbc09 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] [instance: 800d5074-2de1-44ce-8f4a-9a7f5ed110c0] Successfully updated port: 05810ade-2f7b-4af2-9ed7-f6a70d3842ac {{(pid=74190) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 12:09:52 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-29e5adb3-c07a-4ccb-8324-36495bbfbc09 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Acquiring lock "refresh_cache-800d5074-2de1-44ce-8f4a-9a7f5ed110c0" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:09:52 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-29e5adb3-c07a-4ccb-8324-36495bbfbc09 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Acquired lock "refresh_cache-800d5074-2de1-44ce-8f4a-9a7f5ed110c0" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:09:52 user nova-compute[74190]: DEBUG nova.network.neutron [None req-29e5adb3-c07a-4ccb-8324-36495bbfbc09 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] [instance: 800d5074-2de1-44ce-8f4a-9a7f5ed110c0] Building network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 12:09:52 user nova-compute[74190]: DEBUG nova.compute.manager [req-4e4fe826-41ab-43e2-a0b7-e72e82009da4 req-418811d7-13ec-469b-92c7-7fdde33cf791 service nova] [instance: 800d5074-2de1-44ce-8f4a-9a7f5ed110c0] Received event network-changed-05810ade-2f7b-4af2-9ed7-f6a70d3842ac {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:09:52 user nova-compute[74190]: DEBUG nova.compute.manager [req-4e4fe826-41ab-43e2-a0b7-e72e82009da4 req-418811d7-13ec-469b-92c7-7fdde33cf791 service nova] [instance: 800d5074-2de1-44ce-8f4a-9a7f5ed110c0] Refreshing instance network info cache due to event network-changed-05810ade-2f7b-4af2-9ed7-f6a70d3842ac. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 12:09:52 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-4e4fe826-41ab-43e2-a0b7-e72e82009da4 req-418811d7-13ec-469b-92c7-7fdde33cf791 service nova] Acquiring lock "refresh_cache-800d5074-2de1-44ce-8f4a-9a7f5ed110c0" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:09:52 user nova-compute[74190]: DEBUG nova.network.neutron [None req-29e5adb3-c07a-4ccb-8324-36495bbfbc09 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] [instance: 800d5074-2de1-44ce-8f4a-9a7f5ed110c0] Instance cache missing network info. {{(pid=74190) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 12:09:52 user nova-compute[74190]: DEBUG nova.network.neutron [None req-29e5adb3-c07a-4ccb-8324-36495bbfbc09 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] [instance: 800d5074-2de1-44ce-8f4a-9a7f5ed110c0] Updating instance_info_cache with network_info: [{"id": "05810ade-2f7b-4af2-9ed7-f6a70d3842ac", "address": "fa:16:3e:36:22:ee", "network": {"id": "3514ef75-5cb7-47ea-a384-9cae2c8347a9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2048313931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b56d8b29004d4bf5b0e67efba6520cbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05810ade-2f", "ovs_interfaceid": "05810ade-2f7b-4af2-9ed7-f6a70d3842ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:09:53 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-29e5adb3-c07a-4ccb-8324-36495bbfbc09 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Releasing lock "refresh_cache-800d5074-2de1-44ce-8f4a-9a7f5ed110c0" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:09:53 user nova-compute[74190]: DEBUG nova.compute.manager [None req-29e5adb3-c07a-4ccb-8324-36495bbfbc09 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] [instance: 800d5074-2de1-44ce-8f4a-9a7f5ed110c0] Instance network_info: |[{"id": "05810ade-2f7b-4af2-9ed7-f6a70d3842ac", "address": "fa:16:3e:36:22:ee", "network": {"id": "3514ef75-5cb7-47ea-a384-9cae2c8347a9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2048313931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b56d8b29004d4bf5b0e67efba6520cbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05810ade-2f", "ovs_interfaceid": "05810ade-2f7b-4af2-9ed7-f6a70d3842ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 12:09:53 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-4e4fe826-41ab-43e2-a0b7-e72e82009da4 req-418811d7-13ec-469b-92c7-7fdde33cf791 service nova] Acquired lock "refresh_cache-800d5074-2de1-44ce-8f4a-9a7f5ed110c0" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:09:53 user nova-compute[74190]: DEBUG nova.network.neutron [req-4e4fe826-41ab-43e2-a0b7-e72e82009da4 req-418811d7-13ec-469b-92c7-7fdde33cf791 service nova] [instance: 800d5074-2de1-44ce-8f4a-9a7f5ed110c0] Refreshing network info cache for port 05810ade-2f7b-4af2-9ed7-f6a70d3842ac {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 12:09:53 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-29e5adb3-c07a-4ccb-8324-36495bbfbc09 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] [instance: 800d5074-2de1-44ce-8f4a-9a7f5ed110c0] Start _get_guest_xml network_info=[{"id": "05810ade-2f7b-4af2-9ed7-f6a70d3842ac", "address": "fa:16:3e:36:22:ee", "network": {"id": "3514ef75-5cb7-47ea-a384-9cae2c8347a9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2048313931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b56d8b29004d4bf5b0e67efba6520cbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05810ade-2f", "ovs_interfaceid": "05810ade-2f7b-4af2-9ed7-f6a70d3842ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'image_id': '6e88bbf0-6e78-49a8-b3c5-9453d22a89df'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 12:09:53 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-29e5adb3-c07a-4ccb-8324-36495bbfbc09 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:09:53 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-29e5adb3-c07a-4ccb-8324-36495bbfbc09 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:09:53 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-29e5adb3-c07a-4ccb-8324-36495bbfbc09 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 12:09:53 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-29e5adb3-c07a-4ccb-8324-36495bbfbc09 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] CPU controller missing on host. {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 12:09:53 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-29e5adb3-c07a-4ccb-8324-36495bbfbc09 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 12:09:53 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-29e5adb3-c07a-4ccb-8324-36495bbfbc09 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] CPU controller found on host. {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 12:09:53 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-29e5adb3-c07a-4ccb-8324-36495bbfbc09 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74190) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 12:09:53 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-29e5adb3-c07a-4ccb-8324-36495bbfbc09 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T11:37:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 12:09:53 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-29e5adb3-c07a-4ccb-8324-36495bbfbc09 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Flavor limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 12:09:53 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-29e5adb3-c07a-4ccb-8324-36495bbfbc09 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Image limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 12:09:53 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-29e5adb3-c07a-4ccb-8324-36495bbfbc09 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Flavor pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 12:09:53 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-29e5adb3-c07a-4ccb-8324-36495bbfbc09 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Image pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 12:09:53 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-29e5adb3-c07a-4ccb-8324-36495bbfbc09 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 12:09:53 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-29e5adb3-c07a-4ccb-8324-36495bbfbc09 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 12:09:53 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-29e5adb3-c07a-4ccb-8324-36495bbfbc09 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 12:09:53 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-29e5adb3-c07a-4ccb-8324-36495bbfbc09 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Got 1 possible topologies {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 12:09:53 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-29e5adb3-c07a-4ccb-8324-36495bbfbc09 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 12:09:53 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-29e5adb3-c07a-4ccb-8324-36495bbfbc09 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 12:09:53 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-29e5adb3-c07a-4ccb-8324-36495bbfbc09 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T12:09:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-488948398',display_name='tempest-TestServerVolumeAttachmentScenario-server-488948398',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-488948398',id=42,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKS1zaqL935TtTqqky40Ad+6j26+weLWwyOJke+ftMfydYsRRcJGudAJbmUNi28rudKX2ymDr1Ml9XC4lse+Tka60c45+YQpwYUWd0KkKzTYB+jZmTWMlxlNQA8+X6Da4Q==',key_name='tempest-keypair-747651893',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b56d8b29004d4bf5b0e67efba6520cbd',ramdisk_id='',reservation_id='r-k2uqj2ty',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-29120776',owner_user_name='tempest-TestServerVolumeAttachmentScenario-29120776-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T12:09:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90dc927061594985a654a4a504c59c03',uuid=800d5074-2de1-44ce-8f4a-9a7f5ed110c0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "05810ade-2f7b-4af2-9ed7-f6a70d3842ac", "address": "fa:16:3e:36:22:ee", "network": {"id": "3514ef75-5cb7-47ea-a384-9cae2c8347a9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2048313931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b56d8b29004d4bf5b0e67efba6520cbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05810ade-2f", "ovs_interfaceid": "05810ade-2f7b-4af2-9ed7-f6a70d3842ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74190) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 12:09:53 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-29e5adb3-c07a-4ccb-8324-36495bbfbc09 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Converting VIF {"id": "05810ade-2f7b-4af2-9ed7-f6a70d3842ac", "address": "fa:16:3e:36:22:ee", "network": {"id": "3514ef75-5cb7-47ea-a384-9cae2c8347a9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2048313931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b56d8b29004d4bf5b0e67efba6520cbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05810ade-2f", "ovs_interfaceid": "05810ade-2f7b-4af2-9ed7-f6a70d3842ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 12:09:53 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-29e5adb3-c07a-4ccb-8324-36495bbfbc09 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:22:ee,bridge_name='br-int',has_traffic_filtering=True,id=05810ade-2f7b-4af2-9ed7-f6a70d3842ac,network=Network(3514ef75-5cb7-47ea-a384-9cae2c8347a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05810ade-2f') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 12:09:53 user nova-compute[74190]: DEBUG nova.objects.instance [None req-29e5adb3-c07a-4ccb-8324-36495bbfbc09 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Lazy-loading 'pci_devices' on Instance uuid 800d5074-2de1-44ce-8f4a-9a7f5ed110c0 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:09:53 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-29e5adb3-c07a-4ccb-8324-36495bbfbc09 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] [instance: 800d5074-2de1-44ce-8f4a-9a7f5ed110c0] End _get_guest_xml xml=<domain type="kvm">
Oct 18 12:09:53 user nova-compute[74190]:   <uuid>800d5074-2de1-44ce-8f4a-9a7f5ed110c0</uuid>
Oct 18 12:09:53 user nova-compute[74190]:   <name>instance-0000002a</name>
Oct 18 12:09:53 user nova-compute[74190]:   <memory>524288</memory>
Oct 18 12:09:53 user nova-compute[74190]:   <vcpu>1</vcpu>
Oct 18 12:09:53 user nova-compute[74190]:   <metadata>
Oct 18 12:09:53 user nova-compute[74190]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 12:09:53 user nova-compute[74190]:       <nova:package version="0.0.0"/>
Oct 18 12:09:53 user nova-compute[74190]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-488948398</nova:name>
Oct 18 12:09:53 user nova-compute[74190]:       <nova:creationTime>2023-10-18 12:09:53</nova:creationTime>
Oct 18 12:09:53 user nova-compute[74190]:       <nova:flavor name="m1.tiny">
Oct 18 12:09:53 user nova-compute[74190]:         <nova:memory>512</nova:memory>
Oct 18 12:09:53 user nova-compute[74190]:         <nova:disk>1</nova:disk>
Oct 18 12:09:53 user nova-compute[74190]:         <nova:swap>0</nova:swap>
Oct 18 12:09:53 user nova-compute[74190]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 12:09:53 user nova-compute[74190]:         <nova:vcpus>1</nova:vcpus>
Oct 18 12:09:53 user nova-compute[74190]:       </nova:flavor>
Oct 18 12:09:53 user nova-compute[74190]:       <nova:owner>
Oct 18 12:09:53 user nova-compute[74190]:         <nova:user uuid="90dc927061594985a654a4a504c59c03">tempest-TestServerVolumeAttachmentScenario-29120776-project-member</nova:user>
Oct 18 12:09:53 user nova-compute[74190]:         <nova:project uuid="b56d8b29004d4bf5b0e67efba6520cbd">tempest-TestServerVolumeAttachmentScenario-29120776</nova:project>
Oct 18 12:09:53 user nova-compute[74190]:       </nova:owner>
Oct 18 12:09:53 user nova-compute[74190]:       <nova:root type="image" uuid="6e88bbf0-6e78-49a8-b3c5-9453d22a89df"/>
Oct 18 12:09:53 user nova-compute[74190]:       <nova:ports>
Oct 18 12:09:53 user nova-compute[74190]:         <nova:port uuid="05810ade-2f7b-4af2-9ed7-f6a70d3842ac">
Oct 18 12:09:53 user nova-compute[74190]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 18 12:09:53 user nova-compute[74190]:         </nova:port>
Oct 18 12:09:53 user nova-compute[74190]:       </nova:ports>
Oct 18 12:09:53 user nova-compute[74190]:     </nova:instance>
Oct 18 12:09:53 user nova-compute[74190]:   </metadata>
Oct 18 12:09:53 user nova-compute[74190]:   <sysinfo type="smbios">
Oct 18 12:09:53 user nova-compute[74190]:     <system>
Oct 18 12:09:53 user nova-compute[74190]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 12:09:53 user nova-compute[74190]:       <entry name="product">OpenStack Nova</entry>
Oct 18 12:09:53 user nova-compute[74190]:       <entry name="version">0.0.0</entry>
Oct 18 12:09:53 user nova-compute[74190]:       <entry name="serial">800d5074-2de1-44ce-8f4a-9a7f5ed110c0</entry>
Oct 18 12:09:53 user nova-compute[74190]:       <entry name="uuid">800d5074-2de1-44ce-8f4a-9a7f5ed110c0</entry>
Oct 18 12:09:53 user nova-compute[74190]:       <entry name="family">Virtual Machine</entry>
Oct 18 12:09:53 user nova-compute[74190]:     </system>
Oct 18 12:09:53 user nova-compute[74190]:   </sysinfo>
Oct 18 12:09:53 user nova-compute[74190]:   <os>
Oct 18 12:09:53 user nova-compute[74190]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 12:09:53 user nova-compute[74190]:     <boot dev="hd"/>
Oct 18 12:09:53 user nova-compute[74190]:     <smbios mode="sysinfo"/>
Oct 18 12:09:53 user nova-compute[74190]:   </os>
Oct 18 12:09:53 user nova-compute[74190]:   <features>
Oct 18 12:09:53 user nova-compute[74190]:     <acpi/>
Oct 18 12:09:53 user nova-compute[74190]:     <apic/>
Oct 18 12:09:53 user nova-compute[74190]:     <vmcoreinfo/>
Oct 18 12:09:53 user nova-compute[74190]:   </features>
Oct 18 12:09:53 user nova-compute[74190]:   <clock offset="utc">
Oct 18 12:09:53 user nova-compute[74190]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 12:09:53 user nova-compute[74190]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 12:09:53 user nova-compute[74190]:     <timer name="hpet" present="no"/>
Oct 18 12:09:53 user nova-compute[74190]:   </clock>
Oct 18 12:09:53 user nova-compute[74190]:   <cpu mode="custom" match="exact">
Oct 18 12:09:53 user nova-compute[74190]:     <model>Nehalem</model>
Oct 18 12:09:53 user nova-compute[74190]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 12:09:53 user nova-compute[74190]:   </cpu>
Oct 18 12:09:53 user nova-compute[74190]:   <devices>
Oct 18 12:09:53 user nova-compute[74190]:     <disk type="file" device="disk">
Oct 18 12:09:53 user nova-compute[74190]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 12:09:53 user nova-compute[74190]:       <source file="/opt/stack/data/nova/instances/800d5074-2de1-44ce-8f4a-9a7f5ed110c0/disk"/>
Oct 18 12:09:53 user nova-compute[74190]:       <target dev="vda" bus="virtio"/>
Oct 18 12:09:53 user nova-compute[74190]:     </disk>
Oct 18 12:09:53 user nova-compute[74190]:     <interface type="ethernet">
Oct 18 12:09:53 user nova-compute[74190]:       <mac address="fa:16:3e:36:22:ee"/>
Oct 18 12:09:53 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 12:09:53 user nova-compute[74190]:       <mtu size="1442"/>
Oct 18 12:09:53 user nova-compute[74190]:       <target dev="tap05810ade-2f"/>
Oct 18 12:09:53 user nova-compute[74190]:     </interface>
Oct 18 12:09:53 user nova-compute[74190]:     <serial type="pty">
Oct 18 12:09:53 user nova-compute[74190]:       <log file="/opt/stack/data/nova/instances/800d5074-2de1-44ce-8f4a-9a7f5ed110c0/console.log" append="off"/>
Oct 18 12:09:53 user nova-compute[74190]:     </serial>
Oct 18 12:09:53 user nova-compute[74190]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 12:09:53 user nova-compute[74190]:     <video>
Oct 18 12:09:53 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 12:09:53 user nova-compute[74190]:     </video>
Oct 18 12:09:53 user nova-compute[74190]:     <rng model="virtio">
Oct 18 12:09:53 user nova-compute[74190]:       <backend model="random">/dev/urandom</backend>
Oct 18 12:09:53 user nova-compute[74190]:     </rng>
Oct 18 12:09:53 user nova-compute[74190]:     <controller type="usb" index="0" model="none"/>
Oct 18 12:09:53 user nova-compute[74190]:     <memballoon model="virtio">
Oct 18 12:09:53 user nova-compute[74190]:       <stats period="10"/>
Oct 18 12:09:53 user nova-compute[74190]:     </memballoon>
Oct 18 12:09:53 user nova-compute[74190]:   </devices>
Oct 18 12:09:53 user nova-compute[74190]: </domain>
Oct 18 12:09:53 user nova-compute[74190]:  {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 12:09:53 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-29e5adb3-c07a-4ccb-8324-36495bbfbc09 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T12:09:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-488948398',display_name='tempest-TestServerVolumeAttachmentScenario-server-488948398',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-488948398',id=42,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKS1zaqL935TtTqqky40Ad+6j26+weLWwyOJke+ftMfydYsRRcJGudAJbmUNi28rudKX2ymDr1Ml9XC4lse+Tka60c45+YQpwYUWd0KkKzTYB+jZmTWMlxlNQA8+X6Da4Q==',key_name='tempest-keypair-747651893',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b56d8b29004d4bf5b0e67efba6520cbd',ramdisk_id='',reservation_id='r-k2uqj2ty',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-29120776',owner_user_name='tempest-TestServerVolumeAttachmentScenario-29120776-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T12:09:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90dc927061594985a654a4a504c59c03',uuid=800d5074-2de1-44ce-8f4a-9a7f5ed110c0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "05810ade-2f7b-4af2-9ed7-f6a70d3842ac", "address": "fa:16:3e:36:22:ee", "network": {"id": "3514ef75-5cb7-47ea-a384-9cae2c8347a9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2048313931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b56d8b29004d4bf5b0e67efba6520cbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05810ade-2f", "ovs_interfaceid": "05810ade-2f7b-4af2-9ed7-f6a70d3842ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 12:09:53 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-29e5adb3-c07a-4ccb-8324-36495bbfbc09 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Converting VIF {"id": "05810ade-2f7b-4af2-9ed7-f6a70d3842ac", "address": "fa:16:3e:36:22:ee", "network": {"id": "3514ef75-5cb7-47ea-a384-9cae2c8347a9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2048313931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b56d8b29004d4bf5b0e67efba6520cbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05810ade-2f", "ovs_interfaceid": "05810ade-2f7b-4af2-9ed7-f6a70d3842ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 12:09:53 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-29e5adb3-c07a-4ccb-8324-36495bbfbc09 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:22:ee,bridge_name='br-int',has_traffic_filtering=True,id=05810ade-2f7b-4af2-9ed7-f6a70d3842ac,network=Network(3514ef75-5cb7-47ea-a384-9cae2c8347a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05810ade-2f') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 12:09:53 user nova-compute[74190]: DEBUG os_vif [None req-29e5adb3-c07a-4ccb-8324-36495bbfbc09 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:22:ee,bridge_name='br-int',has_traffic_filtering=True,id=05810ade-2f7b-4af2-9ed7-f6a70d3842ac,network=Network(3514ef75-5cb7-47ea-a384-9cae2c8347a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05810ade-2f') {{(pid=74190) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 12:09:53 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:09:53 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:09:53 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 12:09:53 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:09:53 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '96fe4512-aef8-56cb-ba77-a0f457990d01', '_type': 'linux-noop'}}, row=False) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:09:53 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:09:53 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:09:53 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:09:53 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap05810ade-2f, may_exist=True, interface_attrs={}) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:09:53 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap05810ade-2f, col_values=(('qos', UUID('0fa0d312-0179-4a68-9c2c-4578acbac05c')),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:09:53 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap05810ade-2f, col_values=(('external_ids', {'iface-id': '05810ade-2f7b-4af2-9ed7-f6a70d3842ac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:22:ee', 'vm-uuid': '800d5074-2de1-44ce-8f4a-9a7f5ed110c0'}),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:09:53 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:09:53 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:09:53 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:09:53 user nova-compute[74190]: INFO os_vif [None req-29e5adb3-c07a-4ccb-8324-36495bbfbc09 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:22:ee,bridge_name='br-int',has_traffic_filtering=True,id=05810ade-2f7b-4af2-9ed7-f6a70d3842ac,network=Network(3514ef75-5cb7-47ea-a384-9cae2c8347a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05810ade-2f')
Oct 18 12:09:53 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-29e5adb3-c07a-4ccb-8324-36495bbfbc09 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] No BDM found with device name vda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 12:09:53 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-29e5adb3-c07a-4ccb-8324-36495bbfbc09 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] No VIF found with MAC fa:16:3e:36:22:ee, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 12:09:53 user nova-compute[74190]: DEBUG nova.network.neutron [req-4e4fe826-41ab-43e2-a0b7-e72e82009da4 req-418811d7-13ec-469b-92c7-7fdde33cf791 service nova] [instance: 800d5074-2de1-44ce-8f4a-9a7f5ed110c0] Updated VIF entry in instance network info cache for port 05810ade-2f7b-4af2-9ed7-f6a70d3842ac. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 12:09:53 user nova-compute[74190]: DEBUG nova.network.neutron [req-4e4fe826-41ab-43e2-a0b7-e72e82009da4 req-418811d7-13ec-469b-92c7-7fdde33cf791 service nova] [instance: 800d5074-2de1-44ce-8f4a-9a7f5ed110c0] Updating instance_info_cache with network_info: [{"id": "05810ade-2f7b-4af2-9ed7-f6a70d3842ac", "address": "fa:16:3e:36:22:ee", "network": {"id": "3514ef75-5cb7-47ea-a384-9cae2c8347a9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2048313931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b56d8b29004d4bf5b0e67efba6520cbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05810ade-2f", "ovs_interfaceid": "05810ade-2f7b-4af2-9ed7-f6a70d3842ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:09:53 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-4e4fe826-41ab-43e2-a0b7-e72e82009da4 req-418811d7-13ec-469b-92c7-7fdde33cf791 service nova] Releasing lock "refresh_cache-800d5074-2de1-44ce-8f4a-9a7f5ed110c0" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:09:53 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 12:09:53 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '26635393830333766', 'path': '/dev/sdd'} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 12:09:53 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 7c539213-358a-48fd-9abd-1f017ba5b54a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26635393830333766', 'path': '/dev/sdd'} {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 12:09:53 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T12:09:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-627462786',display_name='tempest-TestVolumeBootPattern-volume-backed-server-627462786',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-627462786',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPD7pXmKC8CaPvdQURpfispC+7lrwlqD3/AQ9Y/l0OGwVY4Nz3VBe+js4lCm6r46i3FFzO5vt2JfwVgowtSz1SDn1ikSOBLoccMhZQVaaym3thC2l7DccV5ffWtnfH0wqw==',key_name='tempest-keypair-1486277413',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e375153f6f24827811c5825fc2a2c6a',ramdisk_id='',reservation_id='r-n1o0md0d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1157442382',owner_user_name='tempest-TestVolumeBootPattern-1157442382-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T12:09:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27d9fc244d0f4e10a43b7df4dc8e30ad',uuid=7c539213-358a-48fd-9abd-1f017ba5b54a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ecc36cc2-dc28-452e-82f2-0d347537cd36", "address": "fa:16:3e:0e:31:0c", "network": {"id": "aa827f81-b165-444f-89cc-f21c42a9f772", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1659902586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e375153f6f24827811c5825fc2a2c6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc36cc2-dc", "ovs_interfaceid": "ecc36cc2-dc28-452e-82f2-0d347537cd36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74190) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 12:09:53 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Converting VIF {"id": "ecc36cc2-dc28-452e-82f2-0d347537cd36", "address": "fa:16:3e:0e:31:0c", "network": {"id": "aa827f81-b165-444f-89cc-f21c42a9f772", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1659902586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e375153f6f24827811c5825fc2a2c6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc36cc2-dc", "ovs_interfaceid": "ecc36cc2-dc28-452e-82f2-0d347537cd36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 12:09:53 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:31:0c,bridge_name='br-int',has_traffic_filtering=True,id=ecc36cc2-dc28-452e-82f2-0d347537cd36,network=Network(aa827f81-b165-444f-89cc-f21c42a9f772),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecc36cc2-dc') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 12:09:53 user nova-compute[74190]: DEBUG nova.objects.instance [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lazy-loading 'pci_devices' on Instance uuid 7c539213-358a-48fd-9abd-1f017ba5b54a {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:09:53 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 7c539213-358a-48fd-9abd-1f017ba5b54a] End _get_guest_xml xml=<domain type="kvm">
Oct 18 12:09:53 user nova-compute[74190]:   <uuid>7c539213-358a-48fd-9abd-1f017ba5b54a</uuid>
Oct 18 12:09:53 user nova-compute[74190]:   <name>instance-00000029</name>
Oct 18 12:09:53 user nova-compute[74190]:   <memory>524288</memory>
Oct 18 12:09:53 user nova-compute[74190]:   <vcpu>1</vcpu>
Oct 18 12:09:53 user nova-compute[74190]:   <metadata>
Oct 18 12:09:53 user nova-compute[74190]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 12:09:53 user nova-compute[74190]:       <nova:package version="0.0.0"/>
Oct 18 12:09:53 user nova-compute[74190]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-627462786</nova:name>
Oct 18 12:09:53 user nova-compute[74190]:       <nova:creationTime>2023-10-18 12:09:52</nova:creationTime>
Oct 18 12:09:53 user nova-compute[74190]:       <nova:flavor name="m1.tiny">
Oct 18 12:09:53 user nova-compute[74190]:         <nova:memory>512</nova:memory>
Oct 18 12:09:53 user nova-compute[74190]:         <nova:disk>1</nova:disk>
Oct 18 12:09:53 user nova-compute[74190]:         <nova:swap>0</nova:swap>
Oct 18 12:09:53 user nova-compute[74190]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 12:09:53 user nova-compute[74190]:         <nova:vcpus>1</nova:vcpus>
Oct 18 12:09:53 user nova-compute[74190]:       </nova:flavor>
Oct 18 12:09:53 user nova-compute[74190]:       <nova:owner>
Oct 18 12:09:53 user nova-compute[74190]:         <nova:user uuid="27d9fc244d0f4e10a43b7df4dc8e30ad">tempest-TestVolumeBootPattern-1157442382-project-member</nova:user>
Oct 18 12:09:53 user nova-compute[74190]:         <nova:project uuid="1e375153f6f24827811c5825fc2a2c6a">tempest-TestVolumeBootPattern-1157442382</nova:project>
Oct 18 12:09:53 user nova-compute[74190]:       </nova:owner>
Oct 18 12:09:53 user nova-compute[74190]:       <nova:ports>
Oct 18 12:09:53 user nova-compute[74190]:         <nova:port uuid="ecc36cc2-dc28-452e-82f2-0d347537cd36">
Oct 18 12:09:53 user nova-compute[74190]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 18 12:09:53 user nova-compute[74190]:         </nova:port>
Oct 18 12:09:53 user nova-compute[74190]:       </nova:ports>
Oct 18 12:09:53 user nova-compute[74190]:     </nova:instance>
Oct 18 12:09:53 user nova-compute[74190]:   </metadata>
Oct 18 12:09:53 user nova-compute[74190]:   <sysinfo type="smbios">
Oct 18 12:09:53 user nova-compute[74190]:     <system>
Oct 18 12:09:53 user nova-compute[74190]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 12:09:53 user nova-compute[74190]:       <entry name="product">OpenStack Nova</entry>
Oct 18 12:09:53 user nova-compute[74190]:       <entry name="version">0.0.0</entry>
Oct 18 12:09:53 user nova-compute[74190]:       <entry name="serial">7c539213-358a-48fd-9abd-1f017ba5b54a</entry>
Oct 18 12:09:53 user nova-compute[74190]:       <entry name="uuid">7c539213-358a-48fd-9abd-1f017ba5b54a</entry>
Oct 18 12:09:53 user nova-compute[74190]:       <entry name="family">Virtual Machine</entry>
Oct 18 12:09:53 user nova-compute[74190]:     </system>
Oct 18 12:09:53 user nova-compute[74190]:   </sysinfo>
Oct 18 12:09:53 user nova-compute[74190]:   <os>
Oct 18 12:09:53 user nova-compute[74190]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 12:09:53 user nova-compute[74190]:     <boot dev="hd"/>
Oct 18 12:09:53 user nova-compute[74190]:     <smbios mode="sysinfo"/>
Oct 18 12:09:53 user nova-compute[74190]:   </os>
Oct 18 12:09:53 user nova-compute[74190]:   <features>
Oct 18 12:09:53 user nova-compute[74190]:     <acpi/>
Oct 18 12:09:53 user nova-compute[74190]:     <apic/>
Oct 18 12:09:53 user nova-compute[74190]:     <vmcoreinfo/>
Oct 18 12:09:53 user nova-compute[74190]:   </features>
Oct 18 12:09:53 user nova-compute[74190]:   <clock offset="utc">
Oct 18 12:09:53 user nova-compute[74190]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 12:09:53 user nova-compute[74190]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 12:09:53 user nova-compute[74190]:     <timer name="hpet" present="no"/>
Oct 18 12:09:53 user nova-compute[74190]:   </clock>
Oct 18 12:09:53 user nova-compute[74190]:   <cpu mode="custom" match="exact">
Oct 18 12:09:53 user nova-compute[74190]:     <model>Nehalem</model>
Oct 18 12:09:53 user nova-compute[74190]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 12:09:53 user nova-compute[74190]:   </cpu>
Oct 18 12:09:53 user nova-compute[74190]:   <devices>
Oct 18 12:09:53 user nova-compute[74190]:     <disk type="block" device="disk">
Oct 18 12:09:53 user nova-compute[74190]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 12:09:53 user nova-compute[74190]:       <source dev="/dev/sdd"/>
Oct 18 12:09:53 user nova-compute[74190]:       <target dev="vda" bus="virtio"/>
Oct 18 12:09:53 user nova-compute[74190]:       <serial>6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf</serial>
Oct 18 12:09:53 user nova-compute[74190]:     </disk>
Oct 18 12:09:53 user nova-compute[74190]:     <interface type="ethernet">
Oct 18 12:09:53 user nova-compute[74190]:       <mac address="fa:16:3e:0e:31:0c"/>
Oct 18 12:09:53 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 12:09:53 user nova-compute[74190]:       <mtu size="1442"/>
Oct 18 12:09:53 user nova-compute[74190]:       <target dev="tapecc36cc2-dc"/>
Oct 18 12:09:53 user nova-compute[74190]:     </interface>
Oct 18 12:09:53 user nova-compute[74190]:     <serial type="pty">
Oct 18 12:09:53 user nova-compute[74190]:       <log file="/opt/stack/data/nova/instances/7c539213-358a-48fd-9abd-1f017ba5b54a/console.log" append="off"/>
Oct 18 12:09:53 user nova-compute[74190]:     </serial>
Oct 18 12:09:53 user nova-compute[74190]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 12:09:53 user nova-compute[74190]:     <video>
Oct 18 12:09:53 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 12:09:53 user nova-compute[74190]:     </video>
Oct 18 12:09:53 user nova-compute[74190]:     <rng model="virtio">
Oct 18 12:09:53 user nova-compute[74190]:       <backend model="random">/dev/urandom</backend>
Oct 18 12:09:53 user nova-compute[74190]:     </rng>
Oct 18 12:09:53 user nova-compute[74190]:     <controller type="usb" index="0" model="none"/>
Oct 18 12:09:53 user nova-compute[74190]:     <memballoon model="virtio">
Oct 18 12:09:53 user nova-compute[74190]:       <stats period="10"/>
Oct 18 12:09:53 user nova-compute[74190]:     </memballoon>
Oct 18 12:09:53 user nova-compute[74190]:   </devices>
Oct 18 12:09:53 user nova-compute[74190]: </domain>
Oct 18 12:09:53 user nova-compute[74190]:  {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 12:09:53 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T12:09:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-627462786',display_name='tempest-TestVolumeBootPattern-volume-backed-server-627462786',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-627462786',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPD7pXmKC8CaPvdQURpfispC+7lrwlqD3/AQ9Y/l0OGwVY4Nz3VBe+js4lCm6r46i3FFzO5vt2JfwVgowtSz1SDn1ikSOBLoccMhZQVaaym3thC2l7DccV5ffWtnfH0wqw==',key_name='tempest-keypair-1486277413',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e375153f6f24827811c5825fc2a2c6a',ramdisk_id='',reservation_id='r-n1o0md0d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1157442382',owner_user_name='tempest-TestVolumeBootPattern-1157442382-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T12:09:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27d9fc244d0f4e10a43b7df4dc8e30ad',uuid=7c539213-358a-48fd-9abd-1f017ba5b54a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ecc36cc2-dc28-452e-82f2-0d347537cd36", "address": "fa:16:3e:0e:31:0c", "network": {"id": "aa827f81-b165-444f-89cc-f21c42a9f772", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1659902586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e375153f6f24827811c5825fc2a2c6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc36cc2-dc", "ovs_interfaceid": "ecc36cc2-dc28-452e-82f2-0d347537cd36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 12:09:53 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Converting VIF {"id": "ecc36cc2-dc28-452e-82f2-0d347537cd36", "address": "fa:16:3e:0e:31:0c", "network": {"id": "aa827f81-b165-444f-89cc-f21c42a9f772", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1659902586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e375153f6f24827811c5825fc2a2c6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc36cc2-dc", "ovs_interfaceid": "ecc36cc2-dc28-452e-82f2-0d347537cd36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 12:09:53 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:31:0c,bridge_name='br-int',has_traffic_filtering=True,id=ecc36cc2-dc28-452e-82f2-0d347537cd36,network=Network(aa827f81-b165-444f-89cc-f21c42a9f772),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecc36cc2-dc') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 12:09:53 user nova-compute[74190]: DEBUG os_vif [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:31:0c,bridge_name='br-int',has_traffic_filtering=True,id=ecc36cc2-dc28-452e-82f2-0d347537cd36,network=Network(aa827f81-b165-444f-89cc-f21c42a9f772),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecc36cc2-dc') {{(pid=74190) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 12:09:53 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:09:53 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:09:53 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 12:09:53 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:09:53 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9e4a78af-1632-5f0f-a412-5c8cf22d9400', '_type': 'linux-noop'}}, row=False) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:09:53 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:09:53 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:09:53 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:09:53 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:09:53 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapecc36cc2-dc, may_exist=True, interface_attrs={}) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:09:53 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapecc36cc2-dc, col_values=(('qos', UUID('a1661cb0-91aa-4754-b8d0-541c6b6f7a5e')),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:09:53 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapecc36cc2-dc, col_values=(('external_ids', {'iface-id': 'ecc36cc2-dc28-452e-82f2-0d347537cd36', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0e:31:0c', 'vm-uuid': '7c539213-358a-48fd-9abd-1f017ba5b54a'}),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:09:53 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:09:53 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:09:53 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:09:53 user nova-compute[74190]: INFO os_vif [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:31:0c,bridge_name='br-int',has_traffic_filtering=True,id=ecc36cc2-dc28-452e-82f2-0d347537cd36,network=Network(aa827f81-b165-444f-89cc-f21c42a9f772),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecc36cc2-dc')
Oct 18 12:09:53 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] No BDM found with device name vda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 12:09:53 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] No VIF found with MAC fa:16:3e:0e:31:0c, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 12:09:55 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:09:55 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:09:55 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:09:55 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:09:55 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:09:55 user nova-compute[74190]: DEBUG nova.compute.manager [req-b2dfbee2-7b59-40ed-9f2b-0980dce21480 req-87db06f0-00f2-4133-91b1-d1782cbaa2fc service nova] [instance: 800d5074-2de1-44ce-8f4a-9a7f5ed110c0] Received event network-vif-plugged-05810ade-2f7b-4af2-9ed7-f6a70d3842ac {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:09:55 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-b2dfbee2-7b59-40ed-9f2b-0980dce21480 req-87db06f0-00f2-4133-91b1-d1782cbaa2fc service nova] Acquiring lock "800d5074-2de1-44ce-8f4a-9a7f5ed110c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:09:55 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-b2dfbee2-7b59-40ed-9f2b-0980dce21480 req-87db06f0-00f2-4133-91b1-d1782cbaa2fc service nova] Lock "800d5074-2de1-44ce-8f4a-9a7f5ed110c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:09:55 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-b2dfbee2-7b59-40ed-9f2b-0980dce21480 req-87db06f0-00f2-4133-91b1-d1782cbaa2fc service nova] Lock "800d5074-2de1-44ce-8f4a-9a7f5ed110c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:09:55 user nova-compute[74190]: DEBUG nova.compute.manager [req-b2dfbee2-7b59-40ed-9f2b-0980dce21480 req-87db06f0-00f2-4133-91b1-d1782cbaa2fc service nova] [instance: 800d5074-2de1-44ce-8f4a-9a7f5ed110c0] No waiting events found dispatching network-vif-plugged-05810ade-2f7b-4af2-9ed7-f6a70d3842ac {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:09:55 user nova-compute[74190]: WARNING nova.compute.manager [req-b2dfbee2-7b59-40ed-9f2b-0980dce21480 req-87db06f0-00f2-4133-91b1-d1782cbaa2fc service nova] [instance: 800d5074-2de1-44ce-8f4a-9a7f5ed110c0] Received unexpected event network-vif-plugged-05810ade-2f7b-4af2-9ed7-f6a70d3842ac for instance with vm_state building and task_state spawning.
Oct 18 12:09:55 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:09:55 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:09:55 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:09:55 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:09:55 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:09:56 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:09:56 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:09:56 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:09:56 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:09:56 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:09:57 user nova-compute[74190]: DEBUG nova.compute.manager [req-7e69b317-7a7d-469c-aa96-402f142ccea7 req-c871f31d-c718-48a2-b21d-45a8c46c53cf service nova] [instance: 800d5074-2de1-44ce-8f4a-9a7f5ed110c0] Received event network-vif-plugged-05810ade-2f7b-4af2-9ed7-f6a70d3842ac {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:09:57 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-7e69b317-7a7d-469c-aa96-402f142ccea7 req-c871f31d-c718-48a2-b21d-45a8c46c53cf service nova] Acquiring lock "800d5074-2de1-44ce-8f4a-9a7f5ed110c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:09:57 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-7e69b317-7a7d-469c-aa96-402f142ccea7 req-c871f31d-c718-48a2-b21d-45a8c46c53cf service nova] Lock "800d5074-2de1-44ce-8f4a-9a7f5ed110c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:09:57 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-7e69b317-7a7d-469c-aa96-402f142ccea7 req-c871f31d-c718-48a2-b21d-45a8c46c53cf service nova] Lock "800d5074-2de1-44ce-8f4a-9a7f5ed110c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:09:57 user nova-compute[74190]: DEBUG nova.compute.manager [req-7e69b317-7a7d-469c-aa96-402f142ccea7 req-c871f31d-c718-48a2-b21d-45a8c46c53cf service nova] [instance: 800d5074-2de1-44ce-8f4a-9a7f5ed110c0] No waiting events found dispatching network-vif-plugged-05810ade-2f7b-4af2-9ed7-f6a70d3842ac {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:09:57 user nova-compute[74190]: WARNING nova.compute.manager [req-7e69b317-7a7d-469c-aa96-402f142ccea7 req-c871f31d-c718-48a2-b21d-45a8c46c53cf service nova] [instance: 800d5074-2de1-44ce-8f4a-9a7f5ed110c0] Received unexpected event network-vif-plugged-05810ade-2f7b-4af2-9ed7-f6a70d3842ac for instance with vm_state building and task_state spawning.
Oct 18 12:09:57 user nova-compute[74190]: DEBUG nova.compute.manager [req-7e69b317-7a7d-469c-aa96-402f142ccea7 req-c871f31d-c718-48a2-b21d-45a8c46c53cf service nova] [instance: 7c539213-358a-48fd-9abd-1f017ba5b54a] Received event network-vif-plugged-ecc36cc2-dc28-452e-82f2-0d347537cd36 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:09:57 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-7e69b317-7a7d-469c-aa96-402f142ccea7 req-c871f31d-c718-48a2-b21d-45a8c46c53cf service nova] Acquiring lock "7c539213-358a-48fd-9abd-1f017ba5b54a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:09:57 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-7e69b317-7a7d-469c-aa96-402f142ccea7 req-c871f31d-c718-48a2-b21d-45a8c46c53cf service nova] Lock "7c539213-358a-48fd-9abd-1f017ba5b54a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:09:57 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-7e69b317-7a7d-469c-aa96-402f142ccea7 req-c871f31d-c718-48a2-b21d-45a8c46c53cf service nova] Lock "7c539213-358a-48fd-9abd-1f017ba5b54a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:09:57 user nova-compute[74190]: DEBUG nova.compute.manager [req-7e69b317-7a7d-469c-aa96-402f142ccea7 req-c871f31d-c718-48a2-b21d-45a8c46c53cf service nova] [instance: 7c539213-358a-48fd-9abd-1f017ba5b54a] No waiting events found dispatching network-vif-plugged-ecc36cc2-dc28-452e-82f2-0d347537cd36 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:09:57 user nova-compute[74190]: WARNING nova.compute.manager [req-7e69b317-7a7d-469c-aa96-402f142ccea7 req-c871f31d-c718-48a2-b21d-45a8c46c53cf service nova] [instance: 7c539213-358a-48fd-9abd-1f017ba5b54a] Received unexpected event network-vif-plugged-ecc36cc2-dc28-452e-82f2-0d347537cd36 for instance with vm_state building and task_state spawning.
Oct 18 12:09:57 user nova-compute[74190]: DEBUG nova.compute.manager [req-7e69b317-7a7d-469c-aa96-402f142ccea7 req-c871f31d-c718-48a2-b21d-45a8c46c53cf service nova] [instance: 7c539213-358a-48fd-9abd-1f017ba5b54a] Received event network-vif-plugged-ecc36cc2-dc28-452e-82f2-0d347537cd36 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:09:57 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-7e69b317-7a7d-469c-aa96-402f142ccea7 req-c871f31d-c718-48a2-b21d-45a8c46c53cf service nova] Acquiring lock "7c539213-358a-48fd-9abd-1f017ba5b54a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:09:57 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-7e69b317-7a7d-469c-aa96-402f142ccea7 req-c871f31d-c718-48a2-b21d-45a8c46c53cf service nova] Lock "7c539213-358a-48fd-9abd-1f017ba5b54a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:09:57 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-7e69b317-7a7d-469c-aa96-402f142ccea7 req-c871f31d-c718-48a2-b21d-45a8c46c53cf service nova] Lock "7c539213-358a-48fd-9abd-1f017ba5b54a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:09:57 user nova-compute[74190]: DEBUG nova.compute.manager [req-7e69b317-7a7d-469c-aa96-402f142ccea7 req-c871f31d-c718-48a2-b21d-45a8c46c53cf service nova] [instance: 7c539213-358a-48fd-9abd-1f017ba5b54a] No waiting events found dispatching network-vif-plugged-ecc36cc2-dc28-452e-82f2-0d347537cd36 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:09:57 user nova-compute[74190]: WARNING nova.compute.manager [req-7e69b317-7a7d-469c-aa96-402f142ccea7 req-c871f31d-c718-48a2-b21d-45a8c46c53cf service nova] [instance: 7c539213-358a-48fd-9abd-1f017ba5b54a] Received unexpected event network-vif-plugged-ecc36cc2-dc28-452e-82f2-0d347537cd36 for instance with vm_state building and task_state spawning.
Oct 18 12:09:58 user nova-compute[74190]: DEBUG nova.compute.manager [None req-29e5adb3-c07a-4ccb-8324-36495bbfbc09 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] [instance: 800d5074-2de1-44ce-8f4a-9a7f5ed110c0] Instance event wait completed in 0 seconds for  {{(pid=74190) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 12:09:58 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-29e5adb3-c07a-4ccb-8324-36495bbfbc09 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] [instance: 800d5074-2de1-44ce-8f4a-9a7f5ed110c0] Guest created on hypervisor {{(pid=74190) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 12:09:58 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 800d5074-2de1-44ce-8f4a-9a7f5ed110c0] Instance spawned successfully.
Oct 18 12:09:58 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-29e5adb3-c07a-4ccb-8324-36495bbfbc09 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] [instance: 800d5074-2de1-44ce-8f4a-9a7f5ed110c0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 12:09:58 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-29e5adb3-c07a-4ccb-8324-36495bbfbc09 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] [instance: 800d5074-2de1-44ce-8f4a-9a7f5ed110c0] Found default for hw_cdrom_bus of ide {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:09:58 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-29e5adb3-c07a-4ccb-8324-36495bbfbc09 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] [instance: 800d5074-2de1-44ce-8f4a-9a7f5ed110c0] Found default for hw_disk_bus of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:09:58 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-29e5adb3-c07a-4ccb-8324-36495bbfbc09 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] [instance: 800d5074-2de1-44ce-8f4a-9a7f5ed110c0] Found default for hw_input_bus of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:09:58 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-29e5adb3-c07a-4ccb-8324-36495bbfbc09 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] [instance: 800d5074-2de1-44ce-8f4a-9a7f5ed110c0] Found default for hw_pointer_model of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:09:58 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-29e5adb3-c07a-4ccb-8324-36495bbfbc09 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] [instance: 800d5074-2de1-44ce-8f4a-9a7f5ed110c0] Found default for hw_video_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:09:58 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-29e5adb3-c07a-4ccb-8324-36495bbfbc09 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] [instance: 800d5074-2de1-44ce-8f4a-9a7f5ed110c0] Found default for hw_vif_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:09:58 user nova-compute[74190]: DEBUG nova.compute.manager [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 7c539213-358a-48fd-9abd-1f017ba5b54a] Instance event wait completed in 0 seconds for  {{(pid=74190) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 12:09:58 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 7c539213-358a-48fd-9abd-1f017ba5b54a] Guest created on hypervisor {{(pid=74190) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 12:09:58 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 7c539213-358a-48fd-9abd-1f017ba5b54a] Instance spawned successfully.
Oct 18 12:09:58 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 7c539213-358a-48fd-9abd-1f017ba5b54a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 12:09:58 user nova-compute[74190]: INFO nova.compute.manager [None req-29e5adb3-c07a-4ccb-8324-36495bbfbc09 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] [instance: 800d5074-2de1-44ce-8f4a-9a7f5ed110c0] Took 7.30 seconds to spawn the instance on the hypervisor.
Oct 18 12:09:58 user nova-compute[74190]: DEBUG nova.compute.manager [None req-29e5adb3-c07a-4ccb-8324-36495bbfbc09 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] [instance: 800d5074-2de1-44ce-8f4a-9a7f5ed110c0] Checking state {{(pid=74190) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 12:09:58 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 7c539213-358a-48fd-9abd-1f017ba5b54a] Found default for hw_cdrom_bus of ide {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:09:58 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 7c539213-358a-48fd-9abd-1f017ba5b54a] Found default for hw_disk_bus of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:09:58 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 7c539213-358a-48fd-9abd-1f017ba5b54a] Found default for hw_input_bus of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:09:58 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 7c539213-358a-48fd-9abd-1f017ba5b54a] Found default for hw_pointer_model of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:09:58 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 7c539213-358a-48fd-9abd-1f017ba5b54a] Found default for hw_video_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:09:58 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 7c539213-358a-48fd-9abd-1f017ba5b54a] Found default for hw_vif_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:09:58 user nova-compute[74190]: INFO nova.compute.manager [None req-29e5adb3-c07a-4ccb-8324-36495bbfbc09 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] [instance: 800d5074-2de1-44ce-8f4a-9a7f5ed110c0] Took 8.27 seconds to build instance.
Oct 18 12:09:58 user nova-compute[74190]: INFO nova.compute.manager [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 7c539213-358a-48fd-9abd-1f017ba5b54a] Took 6.51 seconds to spawn the instance on the hypervisor.
Oct 18 12:09:58 user nova-compute[74190]: DEBUG nova.compute.manager [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 7c539213-358a-48fd-9abd-1f017ba5b54a] Checking state {{(pid=74190) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 12:09:58 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-29e5adb3-c07a-4ccb-8324-36495bbfbc09 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Lock "800d5074-2de1-44ce-8f4a-9a7f5ed110c0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.414s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:09:58 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:09:58 user nova-compute[74190]: INFO nova.compute.manager [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 7c539213-358a-48fd-9abd-1f017ba5b54a] Took 26.52 seconds to build instance.
Oct 18 12:09:58 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-2e52d3f5-ce2e-48b1-990a-c5230aa85054 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "7c539213-358a-48fd-9abd-1f017ba5b54a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 26.655s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:10:00 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:10:03 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:10:08 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:10:10 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:10:10 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:10:13 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:10:13 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:10:13 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:10:14 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:10:15 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:10:16 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:10:16 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Starting heal instance info cache {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 12:10:16 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Rebuilding the list of instances to heal {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 18 12:10:16 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "refresh_cache-4e916d24-9f9d-4289-87ce-f65d2499fcd9" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:10:16 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquired lock "refresh_cache-4e916d24-9f9d-4289-87ce-f65d2499fcd9" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:10:16 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Forcefully refreshing network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 18 12:10:16 user nova-compute[74190]: DEBUG nova.objects.instance [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lazy-loading 'info_cache' on Instance uuid 4e916d24-9f9d-4289-87ce-f65d2499fcd9 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:10:16 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Updating instance_info_cache with network_info: [{"id": "7cee893b-5ac8-45f8-a1f8-5374b49cc3b5", "address": "fa:16:3e:15:15:1d", "network": {"id": "4609cfba-1e8b-4740-bdf6-642b196097a3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1019354168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a4f041e58144d54a458a01074eb35a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cee893b-5a", "ovs_interfaceid": "7cee893b-5ac8-45f8-a1f8-5374b49cc3b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:10:16 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Releasing lock "refresh_cache-4e916d24-9f9d-4289-87ce-f65d2499fcd9" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:10:16 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Updated the network info_cache for instance {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 18 12:10:17 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:10:18 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:10:18 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:10:18 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:10:18 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:10:18 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Auditing locally available compute resources for user (node: user) {{(pid=74190) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 12:10:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f59adf3-9728-4d5b-87d5-2ad32c99d06e/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:10:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f59adf3-9728-4d5b-87d5-2ad32c99d06e/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:10:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f59adf3-9728-4d5b-87d5-2ad32c99d06e/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:10:18 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:10:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f59adf3-9728-4d5b-87d5-2ad32c99d06e/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:10:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:10:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:10:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:10:19 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:10:19 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1e27a16-43e4-4e80-9c0a-5c2dce06daae/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:10:19 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1e27a16-43e4-4e80-9c0a-5c2dce06daae/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:10:19 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1e27a16-43e4-4e80-9c0a-5c2dce06daae/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:10:19 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1e27a16-43e4-4e80-9c0a-5c2dce06daae/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:10:19 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/800d5074-2de1-44ce-8f4a-9a7f5ed110c0/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:10:19 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/800d5074-2de1-44ce-8f4a-9a7f5ed110c0/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:10:19 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/800d5074-2de1-44ce-8f4a-9a7f5ed110c0/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:10:19 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/800d5074-2de1-44ce-8f4a-9a7f5ed110c0/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:10:19 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:10:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:10:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:10:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:10:20 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 12:10:20 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 12:10:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:10:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:10:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:10:20 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:10:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:10:20 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 12:10:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk.rescue --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:10:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:10:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk.rescue --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:10:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk.rescue --force-share --output=json" returned: 0 in 0.222s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:10:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:10:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:10:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:10:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:10:21 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 12:10:21 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:10:21 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:10:21 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Hypervisor/Node resource view: name=user free_ram=7768MB free_disk=24.917530059814453GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74190) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 12:10:21 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:10:21 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:10:22 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 4e916d24-9f9d-4289-87ce-f65d2499fcd9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:10:22 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 95ca0697-22b5-4109-868f-ca5556015a1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:10:22 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 42413a94-9973-4e8d-83b6-207a4e7847c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:10:22 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 772b126c-2148-4ca8-90f2-69d6eb4b7db7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:10:22 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 0382820d-a678-4593-85df-168f42fc4ce4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:10:22 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 2f59adf3-9728-4d5b-87d5-2ad32c99d06e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:10:22 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance b1e27a16-43e4-4e80-9c0a-5c2dce06daae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:10:22 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 5861a219-456a-43dd-898c-a99ed3051d83 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:10:22 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 7c539213-358a-48fd-9abd-1f017ba5b54a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:10:22 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 800d5074-2de1-44ce-8f4a-9a7f5ed110c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:10:22 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 12:10:22 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 12:10:22 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 12:10:22 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 12:10:22 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Compute_service record updated for user:user {{(pid=74190) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 12:10:22 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.487s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:10:22 user nova-compute[74190]: INFO nova.compute.manager [None req-c2b9f9b9-bc6b-4983-8aa3-b26b86dd888f tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] Rescuing
Oct 18 12:10:22 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-c2b9f9b9-bc6b-4983-8aa3-b26b86dd888f tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Acquiring lock "refresh_cache-5861a219-456a-43dd-898c-a99ed3051d83" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:10:22 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-c2b9f9b9-bc6b-4983-8aa3-b26b86dd888f tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Acquired lock "refresh_cache-5861a219-456a-43dd-898c-a99ed3051d83" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:10:22 user nova-compute[74190]: DEBUG nova.network.neutron [None req-c2b9f9b9-bc6b-4983-8aa3-b26b86dd888f tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] Building network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 12:10:23 user nova-compute[74190]: DEBUG nova.network.neutron [None req-c2b9f9b9-bc6b-4983-8aa3-b26b86dd888f tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] Updating instance_info_cache with network_info: [{"id": "f1268427-9b33-481f-b7dc-2e397d6d2da9", "address": "fa:16:3e:ed:cb:95", "network": {"id": "c2dbbd24-f1d2-47a2-835f-0f9b24b585f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-920140900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d994366010142519ff367fa7ca77e61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1268427-9b", "ovs_interfaceid": "f1268427-9b33-481f-b7dc-2e397d6d2da9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:10:23 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-c2b9f9b9-bc6b-4983-8aa3-b26b86dd888f tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Releasing lock "refresh_cache-5861a219-456a-43dd-898c-a99ed3051d83" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:10:23 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:10:23 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:10:23 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:10:23 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74190) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 12:10:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:10:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:10:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:10:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:10:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:10:23 user nova-compute[74190]: DEBUG nova.compute.manager [req-70e19687-d27e-4904-9450-78de5eec7ee5 req-40b3d739-796b-4882-8914-3c219397b4e6 service nova] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] Received event network-vif-unplugged-f1268427-9b33-481f-b7dc-2e397d6d2da9 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:10:23 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-70e19687-d27e-4904-9450-78de5eec7ee5 req-40b3d739-796b-4882-8914-3c219397b4e6 service nova] Acquiring lock "5861a219-456a-43dd-898c-a99ed3051d83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:10:23 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-70e19687-d27e-4904-9450-78de5eec7ee5 req-40b3d739-796b-4882-8914-3c219397b4e6 service nova] Lock "5861a219-456a-43dd-898c-a99ed3051d83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:10:23 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-70e19687-d27e-4904-9450-78de5eec7ee5 req-40b3d739-796b-4882-8914-3c219397b4e6 service nova] Lock "5861a219-456a-43dd-898c-a99ed3051d83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:10:23 user nova-compute[74190]: DEBUG nova.compute.manager [req-70e19687-d27e-4904-9450-78de5eec7ee5 req-40b3d739-796b-4882-8914-3c219397b4e6 service nova] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] No waiting events found dispatching network-vif-unplugged-f1268427-9b33-481f-b7dc-2e397d6d2da9 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:10:23 user nova-compute[74190]: WARNING nova.compute.manager [req-70e19687-d27e-4904-9450-78de5eec7ee5 req-40b3d739-796b-4882-8914-3c219397b4e6 service nova] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] Received unexpected event network-vif-unplugged-f1268427-9b33-481f-b7dc-2e397d6d2da9 for instance with vm_state active and task_state rescuing.
Oct 18 12:10:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:10:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:10:24 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] Instance destroyed successfully.
Oct 18 12:10:24 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-c2b9f9b9-bc6b-4983-8aa3-b26b86dd888f tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] Attempting a stable device rescue
Oct 18 12:10:24 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-c2b9f9b9-bc6b-4983-8aa3-b26b86dd888f tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74190) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 18 12:10:24 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-c2b9f9b9-bc6b-4983-8aa3-b26b86dd888f tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] Instance directory exists: not creating {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 18 12:10:24 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-c2b9f9b9-bc6b-4983-8aa3-b26b86dd888f tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] Creating image(s)
Oct 18 12:10:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-c2b9f9b9-bc6b-4983-8aa3-b26b86dd888f tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Acquiring lock "/opt/stack/data/nova/instances/5861a219-456a-43dd-898c-a99ed3051d83/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:10:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-c2b9f9b9-bc6b-4983-8aa3-b26b86dd888f tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lock "/opt/stack/data/nova/instances/5861a219-456a-43dd-898c-a99ed3051d83/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:10:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-c2b9f9b9-bc6b-4983-8aa3-b26b86dd888f tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lock "/opt/stack/data/nova/instances/5861a219-456a-43dd-898c-a99ed3051d83/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:10:24 user nova-compute[74190]: DEBUG nova.objects.instance [None req-c2b9f9b9-bc6b-4983-8aa3-b26b86dd888f tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lazy-loading 'trusted_certs' on Instance uuid 5861a219-456a-43dd-898c-a99ed3051d83 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:10:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-c2b9f9b9-bc6b-4983-8aa3-b26b86dd888f tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Acquiring lock "bd096a95ad7e331db33287cc1ee231bf06e94a62" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:10:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-c2b9f9b9-bc6b-4983-8aa3-b26b86dd888f tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lock "bd096a95ad7e331db33287cc1ee231bf06e94a62" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:10:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-c2b9f9b9-bc6b-4983-8aa3-b26b86dd888f tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd096a95ad7e331db33287cc1ee231bf06e94a62.part --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:10:25 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:10:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-c2b9f9b9-bc6b-4983-8aa3-b26b86dd888f tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd096a95ad7e331db33287cc1ee231bf06e94a62.part --force-share --output=json" returned: 0 in 0.191s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:10:25 user nova-compute[74190]: DEBUG nova.virt.images [None req-c2b9f9b9-bc6b-4983-8aa3-b26b86dd888f tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] fc579e43-732d-4fa9-99cb-7dec26f79d0b was qcow2, converting to raw {{(pid=74190) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 18 12:10:25 user nova-compute[74190]: DEBUG nova.privsep.utils [None req-c2b9f9b9-bc6b-4983-8aa3-b26b86dd888f tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74190) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 18 12:10:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-c2b9f9b9-bc6b-4983-8aa3-b26b86dd888f tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bd096a95ad7e331db33287cc1ee231bf06e94a62.part /opt/stack/data/nova/instances/_base/bd096a95ad7e331db33287cc1ee231bf06e94a62.converted {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:10:25 user nova-compute[74190]: DEBUG nova.compute.manager [req-27a375e4-fa3e-4c7f-a427-c62c4f389e92 req-a7e3bc67-f0d6-4768-a037-09399c11349b service nova] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] Received event network-vif-plugged-f1268427-9b33-481f-b7dc-2e397d6d2da9 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:10:25 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-27a375e4-fa3e-4c7f-a427-c62c4f389e92 req-a7e3bc67-f0d6-4768-a037-09399c11349b service nova] Acquiring lock "5861a219-456a-43dd-898c-a99ed3051d83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:10:25 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-27a375e4-fa3e-4c7f-a427-c62c4f389e92 req-a7e3bc67-f0d6-4768-a037-09399c11349b service nova] Lock "5861a219-456a-43dd-898c-a99ed3051d83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:10:25 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-27a375e4-fa3e-4c7f-a427-c62c4f389e92 req-a7e3bc67-f0d6-4768-a037-09399c11349b service nova] Lock "5861a219-456a-43dd-898c-a99ed3051d83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:10:25 user nova-compute[74190]: DEBUG nova.compute.manager [req-27a375e4-fa3e-4c7f-a427-c62c4f389e92 req-a7e3bc67-f0d6-4768-a037-09399c11349b service nova] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] No waiting events found dispatching network-vif-plugged-f1268427-9b33-481f-b7dc-2e397d6d2da9 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:10:25 user nova-compute[74190]: WARNING nova.compute.manager [req-27a375e4-fa3e-4c7f-a427-c62c4f389e92 req-a7e3bc67-f0d6-4768-a037-09399c11349b service nova] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] Received unexpected event network-vif-plugged-f1268427-9b33-481f-b7dc-2e397d6d2da9 for instance with vm_state active and task_state rescuing.
Oct 18 12:10:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-c2b9f9b9-bc6b-4983-8aa3-b26b86dd888f tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bd096a95ad7e331db33287cc1ee231bf06e94a62.part /opt/stack/data/nova/instances/_base/bd096a95ad7e331db33287cc1ee231bf06e94a62.converted" returned: 0 in 0.525s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:10:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-c2b9f9b9-bc6b-4983-8aa3-b26b86dd888f tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd096a95ad7e331db33287cc1ee231bf06e94a62.converted --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:10:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-c2b9f9b9-bc6b-4983-8aa3-b26b86dd888f tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd096a95ad7e331db33287cc1ee231bf06e94a62.converted --force-share --output=json" returned: 0 in 0.188s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:10:26 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-c2b9f9b9-bc6b-4983-8aa3-b26b86dd888f tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lock "bd096a95ad7e331db33287cc1ee231bf06e94a62" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.027s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:10:26 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-c2b9f9b9-bc6b-4983-8aa3-b26b86dd888f tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Acquiring lock "bd096a95ad7e331db33287cc1ee231bf06e94a62" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:10:26 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-c2b9f9b9-bc6b-4983-8aa3-b26b86dd888f tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lock "bd096a95ad7e331db33287cc1ee231bf06e94a62" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:10:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-c2b9f9b9-bc6b-4983-8aa3-b26b86dd888f tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd096a95ad7e331db33287cc1ee231bf06e94a62 --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:10:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-c2b9f9b9-bc6b-4983-8aa3-b26b86dd888f tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd096a95ad7e331db33287cc1ee231bf06e94a62 --force-share --output=json" returned: 0 in 0.181s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:10:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-c2b9f9b9-bc6b-4983-8aa3-b26b86dd888f tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd096a95ad7e331db33287cc1ee231bf06e94a62,backing_fmt=raw /opt/stack/data/nova/instances/5861a219-456a-43dd-898c-a99ed3051d83/disk.rescue {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:10:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-c2b9f9b9-bc6b-4983-8aa3-b26b86dd888f tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd096a95ad7e331db33287cc1ee231bf06e94a62,backing_fmt=raw /opt/stack/data/nova/instances/5861a219-456a-43dd-898c-a99ed3051d83/disk.rescue" returned: 0 in 0.054s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:10:26 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-c2b9f9b9-bc6b-4983-8aa3-b26b86dd888f tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lock "bd096a95ad7e331db33287cc1ee231bf06e94a62" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:10:26 user nova-compute[74190]: DEBUG nova.objects.instance [None req-c2b9f9b9-bc6b-4983-8aa3-b26b86dd888f tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lazy-loading 'migration_context' on Instance uuid 5861a219-456a-43dd-898c-a99ed3051d83 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:10:26 user nova-compute[74190]: DEBUG nova.objects.base [None req-c2b9f9b9-bc6b-4983-8aa3-b26b86dd888f tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Object Instance<5861a219-456a-43dd-898c-a99ed3051d83> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74190) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 12:10:26 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-c2b9f9b9-bc6b-4983-8aa3-b26b86dd888f tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] Created local disks {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 12:10:26 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-c2b9f9b9-bc6b-4983-8aa3-b26b86dd888f tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] Start _get_guest_xml network_info=[{"id": "f1268427-9b33-481f-b7dc-2e397d6d2da9", "address": "fa:16:3e:ed:cb:95", "network": {"id": "c2dbbd24-f1d2-47a2-835f-0f9b24b585f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-920140900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-920140900-network", "vif_mac": "fa:16:3e:ed:cb:95"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d994366010142519ff367fa7ca77e61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1268427-9b", "ovs_interfaceid": "f1268427-9b33-481f-b7dc-2e397d6d2da9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'fc579e43-732d-4fa9-99cb-7dec26f79d0b', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pNLKxRaX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '5861a219-456a-43dd-898c-a99ed3051d83', 'attached_at': '', 'detached_at': '', 'volume_id': 'ca7aa93a-9939-442c-8098-c6a297de4f28', 'serial': 'ca7aa93a-9939-442c-8098-c6a297de4f28'}, 'delete_on_termination': False, 'guest_format': None, 'attachment_id': '60005d72-802a-40db-b255-a7d3d822166b', 'volume_type': None} {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 12:10:26 user nova-compute[74190]: DEBUG nova.objects.instance [None req-c2b9f9b9-bc6b-4983-8aa3-b26b86dd888f tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lazy-loading 'resources' on Instance uuid 5861a219-456a-43dd-898c-a99ed3051d83 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:10:26 user nova-compute[74190]: DEBUG nova.objects.base [None req-c2b9f9b9-bc6b-4983-8aa3-b26b86dd888f tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Object Instance<5861a219-456a-43dd-898c-a99ed3051d83> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74190) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 12:10:26 user nova-compute[74190]: DEBUG nova.objects.instance [None req-c2b9f9b9-bc6b-4983-8aa3-b26b86dd888f tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lazy-loading 'numa_topology' on Instance uuid 5861a219-456a-43dd-898c-a99ed3051d83 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:10:26 user nova-compute[74190]: DEBUG nova.objects.base [None req-c2b9f9b9-bc6b-4983-8aa3-b26b86dd888f tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Object Instance<5861a219-456a-43dd-898c-a99ed3051d83> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74190) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 12:10:26 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-c2b9f9b9-bc6b-4983-8aa3-b26b86dd888f tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:10:26 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-c2b9f9b9-bc6b-4983-8aa3-b26b86dd888f tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:10:26 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-c2b9f9b9-bc6b-4983-8aa3-b26b86dd888f tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 12:10:26 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-c2b9f9b9-bc6b-4983-8aa3-b26b86dd888f tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] CPU controller missing on host. {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 12:10:26 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-c2b9f9b9-bc6b-4983-8aa3-b26b86dd888f tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 12:10:26 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-c2b9f9b9-bc6b-4983-8aa3-b26b86dd888f tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] CPU controller found on host. {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 12:10:26 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-c2b9f9b9-bc6b-4983-8aa3-b26b86dd888f tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74190) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 12:10:26 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-c2b9f9b9-bc6b-4983-8aa3-b26b86dd888f tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T11:37:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 12:10:26 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-c2b9f9b9-bc6b-4983-8aa3-b26b86dd888f tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Flavor limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 12:10:26 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-c2b9f9b9-bc6b-4983-8aa3-b26b86dd888f tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Image limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 12:10:26 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-c2b9f9b9-bc6b-4983-8aa3-b26b86dd888f tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Flavor pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 12:10:26 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-c2b9f9b9-bc6b-4983-8aa3-b26b86dd888f tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Image pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 12:10:26 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-c2b9f9b9-bc6b-4983-8aa3-b26b86dd888f tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 12:10:26 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-c2b9f9b9-bc6b-4983-8aa3-b26b86dd888f tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 12:10:26 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-c2b9f9b9-bc6b-4983-8aa3-b26b86dd888f tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 12:10:26 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-c2b9f9b9-bc6b-4983-8aa3-b26b86dd888f tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Got 1 possible topologies {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 12:10:26 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-c2b9f9b9-bc6b-4983-8aa3-b26b86dd888f tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 12:10:26 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-c2b9f9b9-bc6b-4983-8aa3-b26b86dd888f tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 12:10:26 user nova-compute[74190]: DEBUG nova.objects.instance [None req-c2b9f9b9-bc6b-4983-8aa3-b26b86dd888f tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5861a219-456a-43dd-898c-a99ed3051d83 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:10:26 user nova-compute[74190]: DEBUG nova.objects.base [None req-c2b9f9b9-bc6b-4983-8aa3-b26b86dd888f tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Object Instance<5861a219-456a-43dd-898c-a99ed3051d83> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74190) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 12:10:26 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2b9f9b9-bc6b-4983-8aa3-b26b86dd888f tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] Calling os-brick to attach iSCSI Volume {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 12:10:26 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b9f9b9-bc6b-4983-8aa3-b26b86dd888f tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pNLKxRaX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 12:10:26 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-c2b9f9b9-bc6b-4983-8aa3-b26b86dd888f tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 12:10:26 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-c2b9f9b9-bc6b-4983-8aa3-b26b86dd888f tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 12:10:26 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-c2b9f9b9-bc6b-4983-8aa3-b26b86dd888f tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 12:10:26 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-c2b9f9b9-bc6b-4983-8aa3-b26b86dd888f tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 12:10:26 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-c2b9f9b9-bc6b-4983-8aa3-b26b86dd888f tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 12:10:26 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-c2b9f9b9-bc6b-4983-8aa3-b26b86dd888f tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 12:10:26 user nova-compute[74190]: INFO os_brick.initiator.connectors.iscsi [None req-c2b9f9b9-bc6b-4983-8aa3-b26b86dd888f tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 12:10:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28 -p 172.16.0.220:3260 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:10:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:10:26 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[db4217f4-7d43-4fdd-8b28-6d145f73ab7b]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = pNLKxRaX\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:10:26 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b9f9b9-bc6b-4983-8aa3-b26b86dd888f tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Oct 18 12:10:26 user nova-compute[74190]: node.name = iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28
Oct 18 12:10:26 user nova-compute[74190]: node.tpgt = -1
Oct 18 12:10:26 user nova-compute[74190]: node.startup = automatic
Oct 18 12:10:26 user nova-compute[74190]: node.leading_login = No
Oct 18 12:10:26 user nova-compute[74190]: iface.iscsi_ifacename = default
Oct 18 12:10:26 user nova-compute[74190]: iface.net_ifacename = <empty>
Oct 18 12:10:26 user nova-compute[74190]: iface.ipaddress = <empty>
Oct 18 12:10:26 user nova-compute[74190]: iface.prefix_len = 0
Oct 18 12:10:26 user nova-compute[74190]: iface.hwaddress = <empty>
Oct 18 12:10:26 user nova-compute[74190]: iface.transport_name = tcp
Oct 18 12:10:26 user nova-compute[74190]: iface.initiatorname = <empty>
Oct 18 12:10:26 user nova-compute[74190]: iface.state = <empty>
Oct 18 12:10:26 user nova-compute[74190]: iface.vlan_id = 0
Oct 18 12:10:26 user nova-compute[74190]: iface.vlan_priority = 0
Oct 18 12:10:26 user nova-compute[74190]: iface.vlan_state = <empty>
Oct 18 12:10:26 user nova-compute[74190]: iface.iface_num = 0
Oct 18 12:10:26 user nova-compute[74190]: iface.mtu = 0
Oct 18 12:10:26 user nova-compute[74190]: iface.port = 0
Oct 18 12:10:26 user nova-compute[74190]: iface.bootproto = <empty>
Oct 18 12:10:26 user nova-compute[74190]: iface.subnet_mask = <empty>
Oct 18 12:10:26 user nova-compute[74190]: iface.gateway = <empty>
Oct 18 12:10:26 user nova-compute[74190]: iface.dhcp_alt_client_id_state = <empty>
Oct 18 12:10:26 user nova-compute[74190]: iface.dhcp_alt_client_id = <empty>
Oct 18 12:10:26 user nova-compute[74190]: iface.dhcp_dns = <empty>
Oct 18 12:10:26 user nova-compute[74190]: iface.dhcp_learn_iqn = <empty>
Oct 18 12:10:26 user nova-compute[74190]: iface.dhcp_req_vendor_id_state = <empty>
Oct 18 12:10:26 user nova-compute[74190]: iface.dhcp_vendor_id_state = <empty>
Oct 18 12:10:26 user nova-compute[74190]: iface.dhcp_vendor_id = <empty>
Oct 18 12:10:26 user nova-compute[74190]: iface.dhcp_slp_da = <empty>
Oct 18 12:10:26 user nova-compute[74190]: iface.fragmentation = <empty>
Oct 18 12:10:26 user nova-compute[74190]: iface.gratuitous_arp = <empty>
Oct 18 12:10:26 user nova-compute[74190]: iface.incoming_forwarding = <empty>
Oct 18 12:10:26 user nova-compute[74190]: iface.tos_state = <empty>
Oct 18 12:10:26 user nova-compute[74190]: iface.tos = 0
Oct 18 12:10:26 user nova-compute[74190]: iface.ttl = 0
Oct 18 12:10:26 user nova-compute[74190]: iface.delayed_ack = <empty>
Oct 18 12:10:26 user nova-compute[74190]: iface.tcp_nagle = <empty>
Oct 18 12:10:26 user nova-compute[74190]: iface.tcp_wsf_state = <empty>
Oct 18 12:10:26 user nova-compute[74190]: iface.tcp_wsf = 0
Oct 18 12:10:26 user nova-compute[74190]: iface.tcp_timer_scale = 0
Oct 18 12:10:26 user nova-compute[74190]: iface.tcp_timestamp = <empty>
Oct 18 12:10:26 user nova-compute[74190]: iface.redirect = <empty>
Oct 18 12:10:26 user nova-compute[74190]: iface.def_task_mgmt_timeout = 0
Oct 18 12:10:26 user nova-compute[74190]: iface.header_digest = <empty>
Oct 18 12:10:26 user nova-compute[74190]: iface.data_digest = <empty>
Oct 18 12:10:26 user nova-compute[74190]: iface.immediate_data = <empty>
Oct 18 12:10:26 user nova-compute[74190]: iface.initial_r2t = <empty>
Oct 18 12:10:26 user nova-compute[74190]: iface.data_seq_inorder = <empty>
Oct 18 12:10:26 user nova-compute[74190]: iface.data_pdu_inorder = <empty>
Oct 18 12:10:26 user nova-compute[74190]: iface.erl = 0
Oct 18 12:10:26 user nova-compute[74190]: iface.max_receive_data_len = 0
Oct 18 12:10:26 user nova-compute[74190]: iface.first_burst_len = 0
Oct 18 12:10:26 user nova-compute[74190]: iface.max_outstanding_r2t = 0
Oct 18 12:10:26 user nova-compute[74190]: iface.max_burst_len = 0
Oct 18 12:10:26 user nova-compute[74190]: iface.chap_auth = <empty>
Oct 18 12:10:26 user nova-compute[74190]: iface.bidi_chap = <empty>
Oct 18 12:10:26 user nova-compute[74190]: iface.strict_login_compliance = <empty>
Oct 18 12:10:26 user nova-compute[74190]: iface.discovery_auth = <empty>
Oct 18 12:10:26 user nova-compute[74190]: iface.discovery_logout = <empty>
Oct 18 12:10:26 user nova-compute[74190]: node.discovery_address = <empty>
Oct 18 12:10:26 user nova-compute[74190]: node.discovery_port = 0
Oct 18 12:10:26 user nova-compute[74190]: node.discovery_type = static
Oct 18 12:10:26 user nova-compute[74190]: node.session.initial_cmdsn = 0
Oct 18 12:10:26 user nova-compute[74190]: node.session.initial_login_retry_max = 8
Oct 18 12:10:26 user nova-compute[74190]: node.session.xmit_thread_priority = -20
Oct 18 12:10:26 user nova-compute[74190]: node.session.cmds_max = 128
Oct 18 12:10:26 user nova-compute[74190]: node.session.queue_depth = 32
Oct 18 12:10:26 user nova-compute[74190]: node.session.nr_sessions = 1
Oct 18 12:10:26 user nova-compute[74190]: node.session.auth.authmethod = CHAP
Oct 18 12:10:26 user nova-compute[74190]: node.session.auth.username = pNLKxRaX
Oct 18 12:10:26 user nova-compute[74190]: node.session.auth.password = ***
Oct 18 12:10:26 user nova-compute[74190]: node.session.auth.username_in = <empty>
Oct 18 12:10:26 user nova-compute[74190]: node.session.auth.password_in = <empty>
Oct 18 12:10:26 user nova-compute[74190]: node.session.auth.chap_algs = MD5
Oct 18 12:10:26 user nova-compute[74190]: node.session.timeo.replacement_timeout = 120
Oct 18 12:10:26 user nova-compute[74190]: node.session.err_timeo.abort_timeout = 15
Oct 18 12:10:26 user nova-compute[74190]: node.session.err_timeo.lu_reset_timeout = 30
Oct 18 12:10:26 user nova-compute[74190]: node.session.err_timeo.tgt_reset_timeout = 30
Oct 18 12:10:26 user nova-compute[74190]: node.session.err_timeo.host_reset_timeout = 60
Oct 18 12:10:26 user nova-compute[74190]: node.session.iscsi.FastAbort = Yes
Oct 18 12:10:26 user nova-compute[74190]: node.session.iscsi.InitialR2T = No
Oct 18 12:10:26 user nova-compute[74190]: node.session.iscsi.ImmediateData = Yes
Oct 18 12:10:26 user nova-compute[74190]: node.session.iscsi.FirstBurstLength = 262144
Oct 18 12:10:26 user nova-compute[74190]: node.session.iscsi.MaxBurstLength = 16776192
Oct 18 12:10:26 user nova-compute[74190]: node.session.iscsi.DefaultTime2Retain = 0
Oct 18 12:10:26 user nova-compute[74190]: node.session.iscsi.DefaultTime2Wait = 2
Oct 18 12:10:26 user nova-compute[74190]: node.session.iscsi.MaxConnections = 1
Oct 18 12:10:26 user nova-compute[74190]: node.session.iscsi.MaxOutstandingR2T = 1
Oct 18 12:10:26 user nova-compute[74190]: node.session.iscsi.ERL = 0
Oct 18 12:10:26 user nova-compute[74190]: node.session.scan = manual
Oct 18 12:10:26 user nova-compute[74190]: node.session.reopen_max = 0
Oct 18 12:10:26 user nova-compute[74190]: node.conn[0].address = 172.16.0.220
Oct 18 12:10:26 user nova-compute[74190]: node.conn[0].port = 3260
Oct 18 12:10:26 user nova-compute[74190]: node.conn[0].startup = manual
Oct 18 12:10:26 user nova-compute[74190]: node.conn[0].tcp.window_size = 524288
Oct 18 12:10:26 user nova-compute[74190]: node.conn[0].tcp.type_of_service = 0
Oct 18 12:10:26 user nova-compute[74190]: node.conn[0].timeo.logout_timeout = 15
Oct 18 12:10:26 user nova-compute[74190]: node.conn[0].timeo.login_timeout = 15
Oct 18 12:10:26 user nova-compute[74190]: node.conn[0].timeo.auth_timeout = 45
Oct 18 12:10:26 user nova-compute[74190]: node.conn[0].timeo.noop_out_interval = 5
Oct 18 12:10:26 user nova-compute[74190]: node.conn[0].timeo.noop_out_timeout = 5
Oct 18 12:10:26 user nova-compute[74190]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Oct 18 12:10:26 user nova-compute[74190]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Oct 18 12:10:26 user nova-compute[74190]: node.conn[0].iscsi.HeaderDigest = None
Oct 18 12:10:26 user nova-compute[74190]: node.conn[0].iscsi.DataDigest = None
Oct 18 12:10:26 user nova-compute[74190]: node.conn[0].iscsi.IFMarker = No
Oct 18 12:10:26 user nova-compute[74190]: node.conn[0].iscsi.OFMarker = No
Oct 18 12:10:26 user nova-compute[74190]: # END RECORD
Oct 18 12:10:26 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:10:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:10:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:10:26 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[a92bb6eb-fb35-4bff-9798-36f5d1ed258e]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:10:26 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b9f9b9-bc6b-4983-8aa3-b26b86dd888f tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:10:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:10:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:10:26 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a8a78d5-04b5-4665-8033-d81b08c2bef5]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:10:26 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b9f9b9-bc6b-4983-8aa3-b26b86dd888f tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:10:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pNLKxRaX {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:10:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pNLKxRaX" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:10:26 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d1d223a-f07e-44f6-bdba-4b5f9562c279]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:10:26 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b9f9b9-bc6b-4983-8aa3-b26b86dd888f tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pNLKxRaX'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:10:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:10:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:10:26 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[c89ea5a0-901f-4d31-b192-0b4358d0d80b]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:10:26 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b9f9b9-bc6b-4983-8aa3-b26b86dd888f tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:10:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:10:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:10:26 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[babbc37e-6582-4491-a31a-d0cd07efb2a4]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:10:26 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b9f9b9-bc6b-4983-8aa3-b26b86dd888f tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 12:10:26 user nova-compute[74190]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)
Oct 18 12:10:26 user nova-compute[74190]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28 (non-flash)
Oct 18 12:10:26 user nova-compute[74190]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf (non-flash)
Oct 18 12:10:26 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 12:10:26 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b9f9b9-bc6b-4983-8aa3-b26b86dd888f tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 12:10:26 user nova-compute[74190]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)
Oct 18 12:10:26 user nova-compute[74190]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28 (non-flash)
Oct 18 12:10:26 user nova-compute[74190]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf (non-flash)
Oct 18 12:10:26 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 12:10:26 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-c2b9f9b9-bc6b-4983-8aa3-b26b86dd888f tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.149s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 12:10:26 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b9f9b9-bc6b-4983-8aa3-b26b86dd888f tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Connected to 172.16.0.220:3260 {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 12:10:26 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-c2b9f9b9-bc6b-4983-8aa3-b26b86dd888f tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] HCTL ('37', '0', '0', 0) found on session 47 with lun 0 {{(pid=74190) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 12:10:26 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-c2b9f9b9-bc6b-4983-8aa3-b26b86dd888f tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Scanning host 37 c: 0, t: 0, l: 0) {{(pid=74190) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 12:10:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:10:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.014s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:10:26 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4240e7a-e4fb-4042-9c55-b9a06334430e]: (4, ('0 0 0', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:10:26 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-c2b9f9b9-bc6b-4983-8aa3-b26b86dd888f tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Searching for a device in session 47 and hctl ('37', '0', '0', 0) yield: sdf {{(pid=74190) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 12:10:26 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b9f9b9-bc6b-4983-8aa3-b26b86dd888f tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pNLKxRaX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 12:10:26 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-c2b9f9b9-bc6b-4983-8aa3-b26b86dd888f tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.173s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 12:10:26 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b9f9b9-bc6b-4983-8aa3-b26b86dd888f tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] <== connect_volume: return (174ms) {'type': 'block', 'scsi_wwn': '26565656431336365', 'path': '/dev/sdf'} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 12:10:26 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2b9f9b9-bc6b-4983-8aa3-b26b86dd888f tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26565656431336365', 'path': '/dev/sdf'} {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 12:10:26 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-c2b9f9b9-bc6b-4983-8aa3-b26b86dd888f tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T12:07:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-928619031',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-928619031',id=40,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-18T12:08:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6d994366010142519ff367fa7ca77e61',ramdisk_id='',reservation_id='r-0sqptyar',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1815510380',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T12:08:33Z,user_data=None,user_id='7fa675b6803f4e21b090295b51fb9ceb',uuid=5861a219-456a-43dd-898c-a99ed3051d83,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f1268427-9b33-481f-b7dc-2e397d6d2da9", "address": "fa:16:3e:ed:cb:95", "network": {"id": "c2dbbd24-f1d2-47a2-835f-0f9b24b585f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-920140900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-920140900-network", "vif_mac": "fa:16:3e:ed:cb:95"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d994366010142519ff367fa7ca77e61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1268427-9b", "ovs_interfaceid": "f1268427-9b33-481f-b7dc-2e397d6d2da9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74190) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 12:10:26 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-c2b9f9b9-bc6b-4983-8aa3-b26b86dd888f tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Converting VIF {"id": "f1268427-9b33-481f-b7dc-2e397d6d2da9", "address": "fa:16:3e:ed:cb:95", "network": {"id": "c2dbbd24-f1d2-47a2-835f-0f9b24b585f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-920140900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-920140900-network", "vif_mac": "fa:16:3e:ed:cb:95"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d994366010142519ff367fa7ca77e61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1268427-9b", "ovs_interfaceid": "f1268427-9b33-481f-b7dc-2e397d6d2da9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 12:10:26 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-c2b9f9b9-bc6b-4983-8aa3-b26b86dd888f tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ed:cb:95,bridge_name='br-int',has_traffic_filtering=True,id=f1268427-9b33-481f-b7dc-2e397d6d2da9,network=Network(c2dbbd24-f1d2-47a2-835f-0f9b24b585f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1268427-9b') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 12:10:26 user nova-compute[74190]: DEBUG nova.objects.instance [None req-c2b9f9b9-bc6b-4983-8aa3-b26b86dd888f tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lazy-loading 'pci_devices' on Instance uuid 5861a219-456a-43dd-898c-a99ed3051d83 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:10:26 user nova-compute[74190]: DEBUG nova.objects.base [None req-c2b9f9b9-bc6b-4983-8aa3-b26b86dd888f tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Object Instance<5861a219-456a-43dd-898c-a99ed3051d83> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74190) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 12:10:26 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-c2b9f9b9-bc6b-4983-8aa3-b26b86dd888f tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] End _get_guest_xml xml=<domain type="kvm">
Oct 18 12:10:26 user nova-compute[74190]:   <uuid>5861a219-456a-43dd-898c-a99ed3051d83</uuid>
Oct 18 12:10:26 user nova-compute[74190]:   <name>instance-00000028</name>
Oct 18 12:10:26 user nova-compute[74190]:   <memory>524288</memory>
Oct 18 12:10:26 user nova-compute[74190]:   <vcpu>1</vcpu>
Oct 18 12:10:26 user nova-compute[74190]:   <metadata>
Oct 18 12:10:26 user nova-compute[74190]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 12:10:26 user nova-compute[74190]:       <nova:package version="0.0.0"/>
Oct 18 12:10:26 user nova-compute[74190]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-928619031</nova:name>
Oct 18 12:10:26 user nova-compute[74190]:       <nova:creationTime>2023-10-18 12:10:26</nova:creationTime>
Oct 18 12:10:26 user nova-compute[74190]:       <nova:flavor name="m1.tiny">
Oct 18 12:10:26 user nova-compute[74190]:         <nova:memory>512</nova:memory>
Oct 18 12:10:26 user nova-compute[74190]:         <nova:disk>1</nova:disk>
Oct 18 12:10:26 user nova-compute[74190]:         <nova:swap>0</nova:swap>
Oct 18 12:10:26 user nova-compute[74190]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 12:10:26 user nova-compute[74190]:         <nova:vcpus>1</nova:vcpus>
Oct 18 12:10:26 user nova-compute[74190]:       </nova:flavor>
Oct 18 12:10:26 user nova-compute[74190]:       <nova:owner>
Oct 18 12:10:26 user nova-compute[74190]:         <nova:user uuid="7fa675b6803f4e21b090295b51fb9ceb">tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member</nova:user>
Oct 18 12:10:26 user nova-compute[74190]:         <nova:project uuid="6d994366010142519ff367fa7ca77e61">tempest-ServerBootFromVolumeStableRescueTest-1815510380</nova:project>
Oct 18 12:10:26 user nova-compute[74190]:       </nova:owner>
Oct 18 12:10:26 user nova-compute[74190]:       <nova:root type="image" uuid="6e88bbf0-6e78-49a8-b3c5-9453d22a89df"/>
Oct 18 12:10:26 user nova-compute[74190]:       <nova:ports>
Oct 18 12:10:26 user nova-compute[74190]:         <nova:port uuid="f1268427-9b33-481f-b7dc-2e397d6d2da9">
Oct 18 12:10:26 user nova-compute[74190]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 18 12:10:26 user nova-compute[74190]:         </nova:port>
Oct 18 12:10:26 user nova-compute[74190]:       </nova:ports>
Oct 18 12:10:26 user nova-compute[74190]:     </nova:instance>
Oct 18 12:10:26 user nova-compute[74190]:   </metadata>
Oct 18 12:10:26 user nova-compute[74190]:   <sysinfo type="smbios">
Oct 18 12:10:26 user nova-compute[74190]:     <system>
Oct 18 12:10:26 user nova-compute[74190]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 12:10:26 user nova-compute[74190]:       <entry name="product">OpenStack Nova</entry>
Oct 18 12:10:26 user nova-compute[74190]:       <entry name="version">0.0.0</entry>
Oct 18 12:10:26 user nova-compute[74190]:       <entry name="serial">5861a219-456a-43dd-898c-a99ed3051d83</entry>
Oct 18 12:10:26 user nova-compute[74190]:       <entry name="uuid">5861a219-456a-43dd-898c-a99ed3051d83</entry>
Oct 18 12:10:26 user nova-compute[74190]:       <entry name="family">Virtual Machine</entry>
Oct 18 12:10:26 user nova-compute[74190]:     </system>
Oct 18 12:10:26 user nova-compute[74190]:   </sysinfo>
Oct 18 12:10:26 user nova-compute[74190]:   <os>
Oct 18 12:10:26 user nova-compute[74190]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 12:10:26 user nova-compute[74190]:     <smbios mode="sysinfo"/>
Oct 18 12:10:26 user nova-compute[74190]:   </os>
Oct 18 12:10:26 user nova-compute[74190]:   <features>
Oct 18 12:10:26 user nova-compute[74190]:     <acpi/>
Oct 18 12:10:26 user nova-compute[74190]:     <apic/>
Oct 18 12:10:26 user nova-compute[74190]:     <vmcoreinfo/>
Oct 18 12:10:26 user nova-compute[74190]:   </features>
Oct 18 12:10:26 user nova-compute[74190]:   <clock offset="utc">
Oct 18 12:10:26 user nova-compute[74190]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 12:10:26 user nova-compute[74190]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 12:10:26 user nova-compute[74190]:     <timer name="hpet" present="no"/>
Oct 18 12:10:26 user nova-compute[74190]:   </clock>
Oct 18 12:10:26 user nova-compute[74190]:   <cpu mode="custom" match="exact">
Oct 18 12:10:26 user nova-compute[74190]:     <model>Nehalem</model>
Oct 18 12:10:26 user nova-compute[74190]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 12:10:26 user nova-compute[74190]:   </cpu>
Oct 18 12:10:26 user nova-compute[74190]:   <devices>
Oct 18 12:10:26 user nova-compute[74190]:     <disk type="block" device="disk">
Oct 18 12:10:26 user nova-compute[74190]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 12:10:26 user nova-compute[74190]:       <source dev="/dev/sdf"/>
Oct 18 12:10:26 user nova-compute[74190]:       <target dev="vda" bus="virtio"/>
Oct 18 12:10:26 user nova-compute[74190]:       <serial>ca7aa93a-9939-442c-8098-c6a297de4f28</serial>
Oct 18 12:10:26 user nova-compute[74190]:     </disk>
Oct 18 12:10:26 user nova-compute[74190]:     <disk type="file" device="disk">
Oct 18 12:10:26 user nova-compute[74190]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 12:10:26 user nova-compute[74190]:       <source file="/opt/stack/data/nova/instances/5861a219-456a-43dd-898c-a99ed3051d83/disk.rescue"/>
Oct 18 12:10:26 user nova-compute[74190]:       <target dev="vdb" bus="virtio"/>
Oct 18 12:10:26 user nova-compute[74190]:       <boot order="1"/>
Oct 18 12:10:26 user nova-compute[74190]:     </disk>
Oct 18 12:10:26 user nova-compute[74190]:     <interface type="ethernet">
Oct 18 12:10:26 user nova-compute[74190]:       <mac address="fa:16:3e:ed:cb:95"/>
Oct 18 12:10:26 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 12:10:26 user nova-compute[74190]:       <mtu size="1442"/>
Oct 18 12:10:26 user nova-compute[74190]:       <target dev="tapf1268427-9b"/>
Oct 18 12:10:26 user nova-compute[74190]:     </interface>
Oct 18 12:10:26 user nova-compute[74190]:     <serial type="pty">
Oct 18 12:10:26 user nova-compute[74190]:       <log file="/opt/stack/data/nova/instances/5861a219-456a-43dd-898c-a99ed3051d83/console.log" append="off"/>
Oct 18 12:10:26 user nova-compute[74190]:     </serial>
Oct 18 12:10:26 user nova-compute[74190]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 12:10:26 user nova-compute[74190]:     <video>
Oct 18 12:10:26 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 12:10:26 user nova-compute[74190]:     </video>
Oct 18 12:10:26 user nova-compute[74190]:     <rng model="virtio">
Oct 18 12:10:26 user nova-compute[74190]:       <backend model="random">/dev/urandom</backend>
Oct 18 12:10:26 user nova-compute[74190]:     </rng>
Oct 18 12:10:26 user nova-compute[74190]:     <controller type="usb" index="0" model="none"/>
Oct 18 12:10:26 user nova-compute[74190]:     <memballoon model="virtio">
Oct 18 12:10:26 user nova-compute[74190]:       <stats period="10"/>
Oct 18 12:10:26 user nova-compute[74190]:     </memballoon>
Oct 18 12:10:26 user nova-compute[74190]:   </devices>
Oct 18 12:10:26 user nova-compute[74190]: </domain>
Oct 18 12:10:26 user nova-compute[74190]:  {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 12:10:26 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] Instance destroyed successfully.
Oct 18 12:10:26 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-c2b9f9b9-bc6b-4983-8aa3-b26b86dd888f tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] No BDM found with device name vda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 12:10:26 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-c2b9f9b9-bc6b-4983-8aa3-b26b86dd888f tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 12:10:26 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-c2b9f9b9-bc6b-4983-8aa3-b26b86dd888f tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] No VIF found with MAC fa:16:3e:ed:cb:95, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 12:10:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:10:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:10:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:10:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:10:28 user nova-compute[74190]: DEBUG nova.compute.manager [req-3c8ad0bb-82a8-4041-aa55-d3dc47560d2a req-d66b57a7-443b-4ac2-8220-663f4f5f9ee7 service nova] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] Received event network-vif-plugged-f1268427-9b33-481f-b7dc-2e397d6d2da9 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:10:28 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-3c8ad0bb-82a8-4041-aa55-d3dc47560d2a req-d66b57a7-443b-4ac2-8220-663f4f5f9ee7 service nova] Acquiring lock "5861a219-456a-43dd-898c-a99ed3051d83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:10:28 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-3c8ad0bb-82a8-4041-aa55-d3dc47560d2a req-d66b57a7-443b-4ac2-8220-663f4f5f9ee7 service nova] Lock "5861a219-456a-43dd-898c-a99ed3051d83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:10:28 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-3c8ad0bb-82a8-4041-aa55-d3dc47560d2a req-d66b57a7-443b-4ac2-8220-663f4f5f9ee7 service nova] Lock "5861a219-456a-43dd-898c-a99ed3051d83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:10:28 user nova-compute[74190]: DEBUG nova.compute.manager [req-3c8ad0bb-82a8-4041-aa55-d3dc47560d2a req-d66b57a7-443b-4ac2-8220-663f4f5f9ee7 service nova] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] No waiting events found dispatching network-vif-plugged-f1268427-9b33-481f-b7dc-2e397d6d2da9 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:10:28 user nova-compute[74190]: WARNING nova.compute.manager [req-3c8ad0bb-82a8-4041-aa55-d3dc47560d2a req-d66b57a7-443b-4ac2-8220-663f4f5f9ee7 service nova] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] Received unexpected event network-vif-plugged-f1268427-9b33-481f-b7dc-2e397d6d2da9 for instance with vm_state active and task_state rescuing.
Oct 18 12:10:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:10:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:10:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:10:30 user nova-compute[74190]: DEBUG nova.compute.manager [None req-c2b9f9b9-bc6b-4983-8aa3-b26b86dd888f tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] Checking state {{(pid=74190) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 12:10:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:10:30 user nova-compute[74190]: DEBUG nova.compute.manager [req-8155a31b-9eff-4cdd-9f85-66f270a63d20 req-72bb3e55-cd6b-426f-bbc5-723bbd859d35 service nova] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] Received event network-vif-plugged-f1268427-9b33-481f-b7dc-2e397d6d2da9 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:10:30 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-8155a31b-9eff-4cdd-9f85-66f270a63d20 req-72bb3e55-cd6b-426f-bbc5-723bbd859d35 service nova] Acquiring lock "5861a219-456a-43dd-898c-a99ed3051d83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:10:30 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-8155a31b-9eff-4cdd-9f85-66f270a63d20 req-72bb3e55-cd6b-426f-bbc5-723bbd859d35 service nova] Lock "5861a219-456a-43dd-898c-a99ed3051d83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:10:30 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-8155a31b-9eff-4cdd-9f85-66f270a63d20 req-72bb3e55-cd6b-426f-bbc5-723bbd859d35 service nova] Lock "5861a219-456a-43dd-898c-a99ed3051d83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:10:30 user nova-compute[74190]: DEBUG nova.compute.manager [req-8155a31b-9eff-4cdd-9f85-66f270a63d20 req-72bb3e55-cd6b-426f-bbc5-723bbd859d35 service nova] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] No waiting events found dispatching network-vif-plugged-f1268427-9b33-481f-b7dc-2e397d6d2da9 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:10:30 user nova-compute[74190]: WARNING nova.compute.manager [req-8155a31b-9eff-4cdd-9f85-66f270a63d20 req-72bb3e55-cd6b-426f-bbc5-723bbd859d35 service nova] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] Received unexpected event network-vif-plugged-f1268427-9b33-481f-b7dc-2e397d6d2da9 for instance with vm_state rescued and task_state None.
Oct 18 12:10:32 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-557fea9e-2d10-4355-8e04-5d183f5cb144 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Acquiring lock "2f59adf3-9728-4d5b-87d5-2ad32c99d06e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:10:32 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-557fea9e-2d10-4355-8e04-5d183f5cb144 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Lock "2f59adf3-9728-4d5b-87d5-2ad32c99d06e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:10:32 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-557fea9e-2d10-4355-8e04-5d183f5cb144 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Acquiring lock "2f59adf3-9728-4d5b-87d5-2ad32c99d06e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:10:32 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-557fea9e-2d10-4355-8e04-5d183f5cb144 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Lock "2f59adf3-9728-4d5b-87d5-2ad32c99d06e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:10:32 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-557fea9e-2d10-4355-8e04-5d183f5cb144 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Lock "2f59adf3-9728-4d5b-87d5-2ad32c99d06e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:10:32 user nova-compute[74190]: INFO nova.compute.manager [None req-557fea9e-2d10-4355-8e04-5d183f5cb144 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] Terminating instance
Oct 18 12:10:32 user nova-compute[74190]: DEBUG nova.compute.manager [None req-557fea9e-2d10-4355-8e04-5d183f5cb144 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] Start destroying the instance on the hypervisor. {{(pid=74190) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 12:10:33 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:10:33 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:10:33 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:10:33 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:10:33 user nova-compute[74190]: DEBUG nova.compute.manager [req-fdae3ebb-c769-43e1-b8c3-c25361392465 req-ef484284-2815-4629-9b7b-0d0bc7fa29b9 service nova] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] Received event network-vif-unplugged-9817302c-2890-4026-86e9-061ca2d1497a {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:10:33 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-fdae3ebb-c769-43e1-b8c3-c25361392465 req-ef484284-2815-4629-9b7b-0d0bc7fa29b9 service nova] Acquiring lock "2f59adf3-9728-4d5b-87d5-2ad32c99d06e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:10:33 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-fdae3ebb-c769-43e1-b8c3-c25361392465 req-ef484284-2815-4629-9b7b-0d0bc7fa29b9 service nova] Lock "2f59adf3-9728-4d5b-87d5-2ad32c99d06e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:10:33 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-fdae3ebb-c769-43e1-b8c3-c25361392465 req-ef484284-2815-4629-9b7b-0d0bc7fa29b9 service nova] Lock "2f59adf3-9728-4d5b-87d5-2ad32c99d06e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:10:33 user nova-compute[74190]: DEBUG nova.compute.manager [req-fdae3ebb-c769-43e1-b8c3-c25361392465 req-ef484284-2815-4629-9b7b-0d0bc7fa29b9 service nova] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] No waiting events found dispatching network-vif-unplugged-9817302c-2890-4026-86e9-061ca2d1497a {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:10:33 user nova-compute[74190]: DEBUG nova.compute.manager [req-fdae3ebb-c769-43e1-b8c3-c25361392465 req-ef484284-2815-4629-9b7b-0d0bc7fa29b9 service nova] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] Received event network-vif-unplugged-9817302c-2890-4026-86e9-061ca2d1497a for instance with task_state deleting. {{(pid=74190) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 12:10:33 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:10:33 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] Instance destroyed successfully.
Oct 18 12:10:33 user nova-compute[74190]: DEBUG nova.objects.instance [None req-557fea9e-2d10-4355-8e04-5d183f5cb144 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Lazy-loading 'resources' on Instance uuid 2f59adf3-9728-4d5b-87d5-2ad32c99d06e {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:10:33 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-557fea9e-2d10-4355-8e04-5d183f5cb144 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T12:01:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-160859695',display_name='tempest-SnapshotDataIntegrityTests-server-160859695',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-160859695',id=33,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAoBrefW7gGTYZ1vGzIfaFns+zpBXIZgIRz/GbVz4A7rM+NPBLmG/5rvNgs+iv8r28DU+lvEZC2lHUNUDKuI1ygUsQQUo2pfGXfIbpHa2UGFmtdiPFc6hzVHt48ahrdrSA==',key_name='tempest-keypair-685467562',keypairs=<?>,launch_index=0,launched_at=2023-10-18T12:01:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='423525b841c84a6f8fe6a72da9cccef2',ramdisk_id='',reservation_id='r-7mudxhg5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-180105789',owner_user_name='tempest-SnapshotDataIntegrityTests-180105789-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T12:01:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80066ffc27d14b658f3e0dc8aa0b9faa',uuid=2f59adf3-9728-4d5b-87d5-2ad32c99d06e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9817302c-2890-4026-86e9-061ca2d1497a", "address": "fa:16:3e:5c:73:bc", "network": {"id": "60c208d8-33b0-4c65-8ac5-5632b2e428df", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-39693250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "423525b841c84a6f8fe6a72da9cccef2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9817302c-28", "ovs_interfaceid": "9817302c-2890-4026-86e9-061ca2d1497a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 12:10:33 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-557fea9e-2d10-4355-8e04-5d183f5cb144 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Converting VIF {"id": "9817302c-2890-4026-86e9-061ca2d1497a", "address": "fa:16:3e:5c:73:bc", "network": {"id": "60c208d8-33b0-4c65-8ac5-5632b2e428df", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-39693250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "423525b841c84a6f8fe6a72da9cccef2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9817302c-28", "ovs_interfaceid": "9817302c-2890-4026-86e9-061ca2d1497a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 12:10:33 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-557fea9e-2d10-4355-8e04-5d183f5cb144 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5c:73:bc,bridge_name='br-int',has_traffic_filtering=True,id=9817302c-2890-4026-86e9-061ca2d1497a,network=Network(60c208d8-33b0-4c65-8ac5-5632b2e428df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9817302c-28') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 12:10:33 user nova-compute[74190]: DEBUG os_vif [None req-557fea9e-2d10-4355-8e04-5d183f5cb144 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:73:bc,bridge_name='br-int',has_traffic_filtering=True,id=9817302c-2890-4026-86e9-061ca2d1497a,network=Network(60c208d8-33b0-4c65-8ac5-5632b2e428df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9817302c-28') {{(pid=74190) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 12:10:33 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:10:33 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9817302c-28, bridge=br-int, if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:10:33 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:10:33 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:10:33 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:10:33 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5b8d6f47-a34e-43a6-baf1-6efd9d2f6ecd) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:10:33 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:10:33 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:10:33 user nova-compute[74190]: INFO os_vif [None req-557fea9e-2d10-4355-8e04-5d183f5cb144 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:73:bc,bridge_name='br-int',has_traffic_filtering=True,id=9817302c-2890-4026-86e9-061ca2d1497a,network=Network(60c208d8-33b0-4c65-8ac5-5632b2e428df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9817302c-28')
Oct 18 12:10:33 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-557fea9e-2d10-4355-8e04-5d183f5cb144 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] Deleting instance files /opt/stack/data/nova/instances/2f59adf3-9728-4d5b-87d5-2ad32c99d06e_del
Oct 18 12:10:33 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-557fea9e-2d10-4355-8e04-5d183f5cb144 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] Deletion of /opt/stack/data/nova/instances/2f59adf3-9728-4d5b-87d5-2ad32c99d06e_del complete
Oct 18 12:10:33 user nova-compute[74190]: INFO nova.compute.manager [None req-557fea9e-2d10-4355-8e04-5d183f5cb144 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] Took 0.87 seconds to destroy the instance on the hypervisor.
Oct 18 12:10:33 user nova-compute[74190]: DEBUG oslo.service.loopingcall [None req-557fea9e-2d10-4355-8e04-5d183f5cb144 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74190) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 12:10:33 user nova-compute[74190]: DEBUG nova.compute.manager [-] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] Deallocating network for instance {{(pid=74190) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 12:10:33 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] deallocate_for_instance() {{(pid=74190) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 12:10:34 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] Updating instance_info_cache with network_info: [] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:10:34 user nova-compute[74190]: INFO nova.compute.manager [-] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] Took 0.87 seconds to deallocate network for instance.
Oct 18 12:10:34 user nova-compute[74190]: DEBUG nova.compute.manager [req-fb34b391-cd03-4fc7-aa33-862154a4e061 req-cec4314d-1414-4147-9941-498bc2117ed1 service nova] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] Received event network-vif-deleted-9817302c-2890-4026-86e9-061ca2d1497a {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:10:34 user nova-compute[74190]: INFO nova.compute.manager [req-fb34b391-cd03-4fc7-aa33-862154a4e061 req-cec4314d-1414-4147-9941-498bc2117ed1 service nova] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] Neutron deleted interface 9817302c-2890-4026-86e9-061ca2d1497a; detaching it from the instance and deleting it from the info cache
Oct 18 12:10:34 user nova-compute[74190]: DEBUG nova.network.neutron [req-fb34b391-cd03-4fc7-aa33-862154a4e061 req-cec4314d-1414-4147-9941-498bc2117ed1 service nova] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] Updating instance_info_cache with network_info: [] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:10:34 user nova-compute[74190]: DEBUG nova.compute.manager [req-fb34b391-cd03-4fc7-aa33-862154a4e061 req-cec4314d-1414-4147-9941-498bc2117ed1 service nova] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] Detach interface failed, port_id=9817302c-2890-4026-86e9-061ca2d1497a, reason: Instance 2f59adf3-9728-4d5b-87d5-2ad32c99d06e could not be found. {{(pid=74190) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 18 12:10:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-557fea9e-2d10-4355-8e04-5d183f5cb144 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:10:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-557fea9e-2d10-4355-8e04-5d183f5cb144 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:10:35 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-557fea9e-2d10-4355-8e04-5d183f5cb144 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 12:10:35 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-557fea9e-2d10-4355-8e04-5d183f5cb144 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 12:10:35 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-557fea9e-2d10-4355-8e04-5d183f5cb144 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.372s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:10:35 user nova-compute[74190]: INFO nova.scheduler.client.report [None req-557fea9e-2d10-4355-8e04-5d183f5cb144 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Deleted allocations for instance 2f59adf3-9728-4d5b-87d5-2ad32c99d06e
Oct 18 12:10:35 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-557fea9e-2d10-4355-8e04-5d183f5cb144 tempest-SnapshotDataIntegrityTests-180105789 tempest-SnapshotDataIntegrityTests-180105789-project-member] Lock "2f59adf3-9728-4d5b-87d5-2ad32c99d06e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.331s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:10:35 user nova-compute[74190]: DEBUG nova.compute.manager [req-cce2973a-9567-4f4b-9fa9-801b1d1f48d4 req-77abd757-3ffe-4b20-93ed-983642a30625 service nova] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] Received event network-vif-plugged-9817302c-2890-4026-86e9-061ca2d1497a {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:10:35 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-cce2973a-9567-4f4b-9fa9-801b1d1f48d4 req-77abd757-3ffe-4b20-93ed-983642a30625 service nova] Acquiring lock "2f59adf3-9728-4d5b-87d5-2ad32c99d06e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:10:35 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-cce2973a-9567-4f4b-9fa9-801b1d1f48d4 req-77abd757-3ffe-4b20-93ed-983642a30625 service nova] Lock "2f59adf3-9728-4d5b-87d5-2ad32c99d06e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:10:35 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-cce2973a-9567-4f4b-9fa9-801b1d1f48d4 req-77abd757-3ffe-4b20-93ed-983642a30625 service nova] Lock "2f59adf3-9728-4d5b-87d5-2ad32c99d06e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:10:35 user nova-compute[74190]: DEBUG nova.compute.manager [req-cce2973a-9567-4f4b-9fa9-801b1d1f48d4 req-77abd757-3ffe-4b20-93ed-983642a30625 service nova] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] No waiting events found dispatching network-vif-plugged-9817302c-2890-4026-86e9-061ca2d1497a {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:10:35 user nova-compute[74190]: WARNING nova.compute.manager [req-cce2973a-9567-4f4b-9fa9-801b1d1f48d4 req-77abd757-3ffe-4b20-93ed-983642a30625 service nova] [instance: 2f59adf3-9728-4d5b-87d5-2ad32c99d06e] Received unexpected event network-vif-plugged-9817302c-2890-4026-86e9-061ca2d1497a for instance with vm_state deleted and task_state None.
Oct 18 12:10:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-3309f802-c625-4754-ac59-cf3247b3e1a0 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Acquiring lock "42413a94-9973-4e8d-83b6-207a4e7847c1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:10:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-3309f802-c625-4754-ac59-cf3247b3e1a0 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lock "42413a94-9973-4e8d-83b6-207a4e7847c1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:10:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-3309f802-c625-4754-ac59-cf3247b3e1a0 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Acquiring lock "42413a94-9973-4e8d-83b6-207a4e7847c1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:10:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-3309f802-c625-4754-ac59-cf3247b3e1a0 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lock "42413a94-9973-4e8d-83b6-207a4e7847c1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:10:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-3309f802-c625-4754-ac59-cf3247b3e1a0 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lock "42413a94-9973-4e8d-83b6-207a4e7847c1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:10:37 user nova-compute[74190]: INFO nova.compute.manager [None req-3309f802-c625-4754-ac59-cf3247b3e1a0 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 42413a94-9973-4e8d-83b6-207a4e7847c1] Terminating instance
Oct 18 12:10:37 user nova-compute[74190]: DEBUG nova.compute.manager [None req-3309f802-c625-4754-ac59-cf3247b3e1a0 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 42413a94-9973-4e8d-83b6-207a4e7847c1] Start destroying the instance on the hypervisor. {{(pid=74190) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 12:10:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:10:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:10:37 user nova-compute[74190]: DEBUG nova.compute.manager [req-5a98c645-2a62-4b2d-b985-00d5806235eb req-66dced6b-de96-4173-8a5e-83db4633068d service nova] [instance: 42413a94-9973-4e8d-83b6-207a4e7847c1] Received event network-vif-unplugged-1bad07b8-897d-4280-9eac-ea800fd1cf5a {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:10:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-5a98c645-2a62-4b2d-b985-00d5806235eb req-66dced6b-de96-4173-8a5e-83db4633068d service nova] Acquiring lock "42413a94-9973-4e8d-83b6-207a4e7847c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:10:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-5a98c645-2a62-4b2d-b985-00d5806235eb req-66dced6b-de96-4173-8a5e-83db4633068d service nova] Lock "42413a94-9973-4e8d-83b6-207a4e7847c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:10:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-5a98c645-2a62-4b2d-b985-00d5806235eb req-66dced6b-de96-4173-8a5e-83db4633068d service nova] Lock "42413a94-9973-4e8d-83b6-207a4e7847c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:10:37 user nova-compute[74190]: DEBUG nova.compute.manager [req-5a98c645-2a62-4b2d-b985-00d5806235eb req-66dced6b-de96-4173-8a5e-83db4633068d service nova] [instance: 42413a94-9973-4e8d-83b6-207a4e7847c1] No waiting events found dispatching network-vif-unplugged-1bad07b8-897d-4280-9eac-ea800fd1cf5a {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:10:37 user nova-compute[74190]: DEBUG nova.compute.manager [req-5a98c645-2a62-4b2d-b985-00d5806235eb req-66dced6b-de96-4173-8a5e-83db4633068d service nova] [instance: 42413a94-9973-4e8d-83b6-207a4e7847c1] Received event network-vif-unplugged-1bad07b8-897d-4280-9eac-ea800fd1cf5a for instance with task_state deleting. {{(pid=74190) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 12:10:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:10:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:10:37 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 42413a94-9973-4e8d-83b6-207a4e7847c1] Instance destroyed successfully.
Oct 18 12:10:37 user nova-compute[74190]: DEBUG nova.objects.instance [None req-3309f802-c625-4754-ac59-cf3247b3e1a0 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lazy-loading 'resources' on Instance uuid 42413a94-9973-4e8d-83b6-207a4e7847c1 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:10:37 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-3309f802-c625-4754-ac59-cf3247b3e1a0 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:53:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1737897040',display_name='tempest-ServerRescueNegativeTestJSON-server-1737897040',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1737897040',id=25,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-18T11:55:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1ffa18c02b8a4117ab1ccc52aca64f06',ramdisk_id='',reservation_id='r-4ho14m2i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1266902394',owner_user_name='tempest-ServerRescueNegativeTestJSON-1266902394-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T11:55:59Z,user_data=None,user_id='9db2d65206e24d0aa1428b9bcaa0a86e',uuid=42413a94-9973-4e8d-83b6-207a4e7847c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "1bad07b8-897d-4280-9eac-ea800fd1cf5a", "address": "fa:16:3e:0f:dd:a5", "network": {"id": "130f7948-11e4-49b4-9d4a-dffb2b48bdcd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595419292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ffa18c02b8a4117ab1ccc52aca64f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bad07b8-89", "ovs_interfaceid": "1bad07b8-897d-4280-9eac-ea800fd1cf5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 12:10:37 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-3309f802-c625-4754-ac59-cf3247b3e1a0 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Converting VIF {"id": "1bad07b8-897d-4280-9eac-ea800fd1cf5a", "address": "fa:16:3e:0f:dd:a5", "network": {"id": "130f7948-11e4-49b4-9d4a-dffb2b48bdcd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595419292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ffa18c02b8a4117ab1ccc52aca64f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bad07b8-89", "ovs_interfaceid": "1bad07b8-897d-4280-9eac-ea800fd1cf5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 12:10:37 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-3309f802-c625-4754-ac59-cf3247b3e1a0 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0f:dd:a5,bridge_name='br-int',has_traffic_filtering=True,id=1bad07b8-897d-4280-9eac-ea800fd1cf5a,network=Network(130f7948-11e4-49b4-9d4a-dffb2b48bdcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bad07b8-89') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 12:10:37 user nova-compute[74190]: DEBUG os_vif [None req-3309f802-c625-4754-ac59-cf3247b3e1a0 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:dd:a5,bridge_name='br-int',has_traffic_filtering=True,id=1bad07b8-897d-4280-9eac-ea800fd1cf5a,network=Network(130f7948-11e4-49b4-9d4a-dffb2b48bdcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bad07b8-89') {{(pid=74190) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 12:10:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:10:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1bad07b8-89, bridge=br-int, if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:10:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:10:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:10:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=58e10205-33aa-4a8f-9542-43fddd9865a8) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:10:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:10:37 user nova-compute[74190]: INFO os_vif [None req-3309f802-c625-4754-ac59-cf3247b3e1a0 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:dd:a5,bridge_name='br-int',has_traffic_filtering=True,id=1bad07b8-897d-4280-9eac-ea800fd1cf5a,network=Network(130f7948-11e4-49b4-9d4a-dffb2b48bdcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bad07b8-89')
Oct 18 12:10:37 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-3309f802-c625-4754-ac59-cf3247b3e1a0 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 42413a94-9973-4e8d-83b6-207a4e7847c1] Deleting instance files /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1_del
Oct 18 12:10:37 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-3309f802-c625-4754-ac59-cf3247b3e1a0 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 42413a94-9973-4e8d-83b6-207a4e7847c1] Deletion of /opt/stack/data/nova/instances/42413a94-9973-4e8d-83b6-207a4e7847c1_del complete
Oct 18 12:10:38 user nova-compute[74190]: INFO nova.compute.manager [None req-3309f802-c625-4754-ac59-cf3247b3e1a0 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 42413a94-9973-4e8d-83b6-207a4e7847c1] Took 0.93 seconds to destroy the instance on the hypervisor.
Oct 18 12:10:38 user nova-compute[74190]: DEBUG oslo.service.loopingcall [None req-3309f802-c625-4754-ac59-cf3247b3e1a0 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74190) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 12:10:38 user nova-compute[74190]: DEBUG nova.compute.manager [-] [instance: 42413a94-9973-4e8d-83b6-207a4e7847c1] Deallocating network for instance {{(pid=74190) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 12:10:38 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: 42413a94-9973-4e8d-83b6-207a4e7847c1] deallocate_for_instance() {{(pid=74190) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 12:10:38 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: 42413a94-9973-4e8d-83b6-207a4e7847c1] Updating instance_info_cache with network_info: [] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:10:38 user nova-compute[74190]: INFO nova.compute.manager [-] [instance: 42413a94-9973-4e8d-83b6-207a4e7847c1] Took 0.87 seconds to deallocate network for instance.
Oct 18 12:10:38 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-3309f802-c625-4754-ac59-cf3247b3e1a0 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:10:38 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-3309f802-c625-4754-ac59-cf3247b3e1a0 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:10:39 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-3309f802-c625-4754-ac59-cf3247b3e1a0 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 12:10:39 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-3309f802-c625-4754-ac59-cf3247b3e1a0 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 12:10:39 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-3309f802-c625-4754-ac59-cf3247b3e1a0 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.304s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:10:39 user nova-compute[74190]: INFO nova.scheduler.client.report [None req-3309f802-c625-4754-ac59-cf3247b3e1a0 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Deleted allocations for instance 42413a94-9973-4e8d-83b6-207a4e7847c1
Oct 18 12:10:39 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-3309f802-c625-4754-ac59-cf3247b3e1a0 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lock "42413a94-9973-4e8d-83b6-207a4e7847c1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.297s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:10:39 user nova-compute[74190]: DEBUG nova.compute.manager [req-f3886f15-0be7-4b89-9db3-d7ddbbeebde3 req-ab5e88b5-e314-4a0f-943d-768b707682f3 service nova] [instance: 42413a94-9973-4e8d-83b6-207a4e7847c1] Received event network-vif-plugged-1bad07b8-897d-4280-9eac-ea800fd1cf5a {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:10:39 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-f3886f15-0be7-4b89-9db3-d7ddbbeebde3 req-ab5e88b5-e314-4a0f-943d-768b707682f3 service nova] Acquiring lock "42413a94-9973-4e8d-83b6-207a4e7847c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:10:39 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-f3886f15-0be7-4b89-9db3-d7ddbbeebde3 req-ab5e88b5-e314-4a0f-943d-768b707682f3 service nova] Lock "42413a94-9973-4e8d-83b6-207a4e7847c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:10:39 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-f3886f15-0be7-4b89-9db3-d7ddbbeebde3 req-ab5e88b5-e314-4a0f-943d-768b707682f3 service nova] Lock "42413a94-9973-4e8d-83b6-207a4e7847c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:10:39 user nova-compute[74190]: DEBUG nova.compute.manager [req-f3886f15-0be7-4b89-9db3-d7ddbbeebde3 req-ab5e88b5-e314-4a0f-943d-768b707682f3 service nova] [instance: 42413a94-9973-4e8d-83b6-207a4e7847c1] No waiting events found dispatching network-vif-plugged-1bad07b8-897d-4280-9eac-ea800fd1cf5a {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:10:39 user nova-compute[74190]: WARNING nova.compute.manager [req-f3886f15-0be7-4b89-9db3-d7ddbbeebde3 req-ab5e88b5-e314-4a0f-943d-768b707682f3 service nova] [instance: 42413a94-9973-4e8d-83b6-207a4e7847c1] Received unexpected event network-vif-plugged-1bad07b8-897d-4280-9eac-ea800fd1cf5a for instance with vm_state deleted and task_state None.
Oct 18 12:10:39 user nova-compute[74190]: DEBUG nova.compute.manager [req-f3886f15-0be7-4b89-9db3-d7ddbbeebde3 req-ab5e88b5-e314-4a0f-943d-768b707682f3 service nova] [instance: 42413a94-9973-4e8d-83b6-207a4e7847c1] Received event network-vif-deleted-1bad07b8-897d-4280-9eac-ea800fd1cf5a {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:10:42 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:10:45 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:10:47 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:10:50 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:10:52 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:10:55 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:10:57 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:11:00 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:11:02 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:11:05 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:11:07 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:11:10 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:11:11 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:11:12 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:11:13 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:11:15 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:11:17 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:11:18 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:11:18 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Starting heal instance info cache {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 12:11:18 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "refresh_cache-95ca0697-22b5-4109-868f-ca5556015a1f" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:11:18 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquired lock "refresh_cache-95ca0697-22b5-4109-868f-ca5556015a1f" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:11:18 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] Forcefully refreshing network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 18 12:11:18 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] Updating instance_info_cache with network_info: [{"id": "58c81983-46ab-4026-b712-775ae319a09f", "address": "fa:16:3e:dd:c9:17", "network": {"id": "130f7948-11e4-49b4-9d4a-dffb2b48bdcd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595419292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ffa18c02b8a4117ab1ccc52aca64f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58c81983-46", "ovs_interfaceid": "58c81983-46ab-4026-b712-775ae319a09f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:11:18 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Releasing lock "refresh_cache-95ca0697-22b5-4109-868f-ca5556015a1f" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:11:18 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] Updated the network info_cache for instance {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 18 12:11:19 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:11:20 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:11:20 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:11:20 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74190) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 12:11:20 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:11:20 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:11:20 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:11:20 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:11:20 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Auditing locally available compute resources for user (node: user) {{(pid=74190) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 12:11:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:11:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:11:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:11:20 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-3ba3f81d-9b69-45d2-bfc0-ceb6def2ea2e tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Acquiring lock "4e916d24-9f9d-4289-87ce-f65d2499fcd9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:11:20 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-3ba3f81d-9b69-45d2-bfc0-ceb6def2ea2e tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Lock "4e916d24-9f9d-4289-87ce-f65d2499fcd9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:11:20 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-3ba3f81d-9b69-45d2-bfc0-ceb6def2ea2e tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Acquiring lock "4e916d24-9f9d-4289-87ce-f65d2499fcd9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:11:20 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-3ba3f81d-9b69-45d2-bfc0-ceb6def2ea2e tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Lock "4e916d24-9f9d-4289-87ce-f65d2499fcd9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:11:20 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-3ba3f81d-9b69-45d2-bfc0-ceb6def2ea2e tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Lock "4e916d24-9f9d-4289-87ce-f65d2499fcd9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:11:20 user nova-compute[74190]: INFO nova.compute.manager [None req-3ba3f81d-9b69-45d2-bfc0-ceb6def2ea2e tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Terminating instance
Oct 18 12:11:20 user nova-compute[74190]: DEBUG nova.compute.manager [None req-3ba3f81d-9b69-45d2-bfc0-ceb6def2ea2e tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Start destroying the instance on the hypervisor. {{(pid=74190) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 12:11:20 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:11:20 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:11:20 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:11:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:11:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1e27a16-43e4-4e80-9c0a-5c2dce06daae/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:11:20 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:11:20 user nova-compute[74190]: DEBUG nova.compute.manager [req-5becba0a-240b-400d-9d9f-252433cac932 req-e023c99e-2851-4309-adf9-b527367b7242 service nova] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Received event network-vif-unplugged-7cee893b-5ac8-45f8-a1f8-5374b49cc3b5 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:11:20 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-5becba0a-240b-400d-9d9f-252433cac932 req-e023c99e-2851-4309-adf9-b527367b7242 service nova] Acquiring lock "4e916d24-9f9d-4289-87ce-f65d2499fcd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:11:20 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-5becba0a-240b-400d-9d9f-252433cac932 req-e023c99e-2851-4309-adf9-b527367b7242 service nova] Lock "4e916d24-9f9d-4289-87ce-f65d2499fcd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:11:20 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-5becba0a-240b-400d-9d9f-252433cac932 req-e023c99e-2851-4309-adf9-b527367b7242 service nova] Lock "4e916d24-9f9d-4289-87ce-f65d2499fcd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:11:20 user nova-compute[74190]: DEBUG nova.compute.manager [req-5becba0a-240b-400d-9d9f-252433cac932 req-e023c99e-2851-4309-adf9-b527367b7242 service nova] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] No waiting events found dispatching network-vif-unplugged-7cee893b-5ac8-45f8-a1f8-5374b49cc3b5 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:11:20 user nova-compute[74190]: DEBUG nova.compute.manager [req-5becba0a-240b-400d-9d9f-252433cac932 req-e023c99e-2851-4309-adf9-b527367b7242 service nova] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Received event network-vif-unplugged-7cee893b-5ac8-45f8-a1f8-5374b49cc3b5 for instance with task_state deleting. {{(pid=74190) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 12:11:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1e27a16-43e4-4e80-9c0a-5c2dce06daae/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:11:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1e27a16-43e4-4e80-9c0a-5c2dce06daae/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:11:21 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:11:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1e27a16-43e4-4e80-9c0a-5c2dce06daae/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:11:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/800d5074-2de1-44ce-8f4a-9a7f5ed110c0/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:11:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/800d5074-2de1-44ce-8f4a-9a7f5ed110c0/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:11:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/800d5074-2de1-44ce-8f4a-9a7f5ed110c0/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:11:21 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Instance destroyed successfully.
Oct 18 12:11:21 user nova-compute[74190]: DEBUG nova.objects.instance [None req-3ba3f81d-9b69-45d2-bfc0-ceb6def2ea2e tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Lazy-loading 'resources' on Instance uuid 4e916d24-9f9d-4289-87ce-f65d2499fcd9 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:11:21 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-3ba3f81d-9b69-45d2-bfc0-ceb6def2ea2e tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:48:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1239510214',display_name='tempest-ServerStableDeviceRescueTest-server-1239510214',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1239510214',id=15,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDzj5UAT4iUqANSvOBkAoJEwMfUM16idg1NibS//oAl0VdU9TP7e54hP2zexPvt5KYwy6IiTFUli5lpncFsKpJEn0+n2xJbrGOus7ZAEqg7XexOxHCi0AyMnjk7r++Fq+A==',key_name='tempest-keypair-1340095913',keypairs=<?>,launch_index=0,launched_at=2023-10-18T11:52:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8a4f041e58144d54a458a01074eb35a4',ramdisk_id='',reservation_id='r-4olb5240',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1127867733',owner_user_name='tempest-ServerStableDeviceRescueTest-1127867733-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T11:54:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0289211c145a424d8b9350aa69bc435d',uuid=4e916d24-9f9d-4289-87ce-f65d2499fcd9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7cee893b-5ac8-45f8-a1f8-5374b49cc3b5", "address": "fa:16:3e:15:15:1d", "network": {"id": "4609cfba-1e8b-4740-bdf6-642b196097a3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1019354168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a4f041e58144d54a458a01074eb35a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cee893b-5a", "ovs_interfaceid": "7cee893b-5ac8-45f8-a1f8-5374b49cc3b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 12:11:21 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-3ba3f81d-9b69-45d2-bfc0-ceb6def2ea2e tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Converting VIF {"id": "7cee893b-5ac8-45f8-a1f8-5374b49cc3b5", "address": "fa:16:3e:15:15:1d", "network": {"id": "4609cfba-1e8b-4740-bdf6-642b196097a3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1019354168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a4f041e58144d54a458a01074eb35a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cee893b-5a", "ovs_interfaceid": "7cee893b-5ac8-45f8-a1f8-5374b49cc3b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 12:11:21 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-3ba3f81d-9b69-45d2-bfc0-ceb6def2ea2e tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:15:15:1d,bridge_name='br-int',has_traffic_filtering=True,id=7cee893b-5ac8-45f8-a1f8-5374b49cc3b5,network=Network(4609cfba-1e8b-4740-bdf6-642b196097a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cee893b-5a') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 12:11:21 user nova-compute[74190]: DEBUG os_vif [None req-3ba3f81d-9b69-45d2-bfc0-ceb6def2ea2e tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:15:1d,bridge_name='br-int',has_traffic_filtering=True,id=7cee893b-5ac8-45f8-a1f8-5374b49cc3b5,network=Network(4609cfba-1e8b-4740-bdf6-642b196097a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cee893b-5a') {{(pid=74190) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 12:11:21 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:11:21 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7cee893b-5a, bridge=br-int, if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:11:21 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:11:21 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:11:21 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:11:21 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a7719be5-c466-4666-916c-56590f784586) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:11:21 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:11:21 user nova-compute[74190]: INFO os_vif [None req-3ba3f81d-9b69-45d2-bfc0-ceb6def2ea2e tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:15:1d,bridge_name='br-int',has_traffic_filtering=True,id=7cee893b-5ac8-45f8-a1f8-5374b49cc3b5,network=Network(4609cfba-1e8b-4740-bdf6-642b196097a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cee893b-5a')
Oct 18 12:11:21 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ba3f81d-9b69-45d2-bfc0-ceb6def2ea2e tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] calling os-brick to detach iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 12:11:21 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba3f81d-9b69-45d2-bfc0-ceb6def2ea2e tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, {'target_iqn': 'iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jMIouEKV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 12:11:21 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-3ba3f81d-9b69-45d2-bfc0-ceb6def2ea2e tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 12:11:21 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-3ba3f81d-9b69-45d2-bfc0-ceb6def2ea2e tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 12:11:21 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-3ba3f81d-9b69-45d2-bfc0-ceb6def2ea2e tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 12:11:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:11:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:11:21 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[510520ac-1e2d-4e1f-a869-eb164bd76f38]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:11:21 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba3f81d-9b69-45d2-bfc0-ceb6def2ea2e tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 12:11:21 user nova-compute[74190]: No targets found.
Oct 18 12:11:21 user nova-compute[74190]: iSNS:
Oct 18 12:11:21 user nova-compute[74190]: No targets found.
Oct 18 12:11:21 user nova-compute[74190]: STATIC:
Oct 18 12:11:21 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa
Oct 18 12:11:21 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 12:11:21 user nova-compute[74190]:                 Iface Name: default
Oct 18 12:11:21 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf
Oct 18 12:11:21 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 12:11:21 user nova-compute[74190]:                 Iface Name: default
Oct 18 12:11:21 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f
Oct 18 12:11:21 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 12:11:21 user nova-compute[74190]:                 Iface Name: default
Oct 18 12:11:21 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28
Oct 18 12:11:21 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 12:11:21 user nova-compute[74190]:                 Iface Name: default
Oct 18 12:11:21 user nova-compute[74190]: FIRMWARE:
Oct 18 12:11:21 user nova-compute[74190]: No targets found.
Oct 18 12:11:21 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 12:11:21 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba3f81d-9b69-45d2-bfc0-ceb6def2ea2e tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 12:11:21 user nova-compute[74190]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 12:11:21 user nova-compute[74190]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74190) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 12:11:21 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba3f81d-9b69-45d2-bfc0-ceb6def2ea2e tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa', 0)] {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 12:11:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:11:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:11:21 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d90b7cc-05d8-4d7f-88d0-11f6c3eb5ec9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:11:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:11:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/800d5074-2de1-44ce-8f4a-9a7f5ed110c0/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:11:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:11:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:11:21 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[31773380-8fe8-46b2-9799-ff3b31973ed4]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:11:21 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba3f81d-9b69-45d2-bfc0-ceb6def2ea2e tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 12:11:21 user nova-compute[74190]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)
Oct 18 12:11:21 user nova-compute[74190]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28 (non-flash)
Oct 18 12:11:21 user nova-compute[74190]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf (non-flash)
Oct 18 12:11:21 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 12:11:21 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba3f81d-9b69-45d2-bfc0-ceb6def2ea2e tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa (non-flash)
Oct 18 12:11:21 user nova-compute[74190]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)
Oct 18 12:11:21 user nova-compute[74190]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28 (non-flash)
Oct 18 12:11:21 user nova-compute[74190]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf (non-flash)
Oct 18 12:11:21 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 12:11:21 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba3f81d-9b69-45d2-bfc0-ceb6def2ea2e tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1f54083520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa'): ({'sdc'}, set())}) {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 12:11:21 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-3ba3f81d-9b69-45d2-bfc0-ceb6def2ea2e tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Removing single pathed devices sdc {{(pid=74190) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 12:11:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:11:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:11:21 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd236d55-70e2-4f24-bb92-979a4d64be0b]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:11:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:11:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:11:21 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b11c676-d54b-48b8-b096-c7053449c8f7]: (4, ('ok\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:11:21 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-3ba3f81d-9b69-45d2-bfc0-ceb6def2ea2e tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Flushing IO for device /dev/sdc {{(pid=74190) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 12:11:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:11:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:11:21 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e743b6-4bc9-42d5-bf88-739756c7db21]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:11:21 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-3ba3f81d-9b69-45d2-bfc0-ceb6def2ea2e tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74190) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 12:11:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:11:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.058s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:11:21 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c011888-5107-443f-b41a-d316fbda029a]: (4, ('1', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:11:21 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-3ba3f81d-9b69-45d2-bfc0-ceb6def2ea2e tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 12:11:21 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-3ba3f81d-9b69-45d2-bfc0-ceb6def2ea2e tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] SCSI volumes sdc have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 12:11:21 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba3f81d-9b69-45d2-bfc0-ceb6def2ea2e tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa')] {{(pid=74190) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 12:11:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:11:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:11:21 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[c05b4a27-a55d-4a23-82d8-42721b4dabe9]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:11:21 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba3f81d-9b69-45d2-bfc0-ceb6def2ea2e tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:11:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:11:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:11:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa -p 172.16.0.220:3260 --logout {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:11:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:11:21 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d166b7-b4ac-4c22-8894-c0ff06b86214]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:11:21 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba3f81d-9b69-45d2-bfc0-ceb6def2ea2e tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa, portal: 172.16.0.220,3260]
Oct 18 12:11:21 user nova-compute[74190]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa, portal: 172.16.0.220,3260] successful.
Oct 18 12:11:21 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:11:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa -p 172.16.0.220:3260 --op delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:11:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:226ee3e2-e6d5-49bd-b68e-3ea63d5fc1fa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:11:21 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[920ae01f-119f-4663-9bdf-68a24d761307]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:11:21 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba3f81d-9b69-45d2-bfc0-ceb6def2ea2e tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:11:21 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-3ba3f81d-9b69-45d2-bfc0-ceb6def2ea2e tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 12:11:21 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba3f81d-9b69-45d2-bfc0-ceb6def2ea2e tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] <== disconnect_volume: return (360ms) None {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 12:11:21 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ba3f81d-9b69-45d2-bfc0-ceb6def2ea2e tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Disconnected iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 12:11:21 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-3ba3f81d-9b69-45d2-bfc0-ceb6def2ea2e tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Deleting instance files /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9_del
Oct 18 12:11:21 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-3ba3f81d-9b69-45d2-bfc0-ceb6def2ea2e tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Deletion of /opt/stack/data/nova/instances/4e916d24-9f9d-4289-87ce-f65d2499fcd9_del complete
Oct 18 12:11:21 user nova-compute[74190]: INFO nova.compute.manager [None req-3ba3f81d-9b69-45d2-bfc0-ceb6def2ea2e tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Took 1.31 seconds to destroy the instance on the hypervisor.
Oct 18 12:11:21 user nova-compute[74190]: DEBUG oslo.service.loopingcall [None req-3ba3f81d-9b69-45d2-bfc0-ceb6def2ea2e tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74190) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 12:11:21 user nova-compute[74190]: DEBUG nova.compute.manager [-] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Deallocating network for instance {{(pid=74190) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 12:11:21 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] deallocate_for_instance() {{(pid=74190) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 12:11:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:11:21 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 12:11:21 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 12:11:21 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5861a219-456a-43dd-898c-a99ed3051d83/disk.rescue --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:11:22 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5861a219-456a-43dd-898c-a99ed3051d83/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:11:22 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5861a219-456a-43dd-898c-a99ed3051d83/disk.rescue --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:11:22 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5861a219-456a-43dd-898c-a99ed3051d83/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:11:22 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Error from libvirt while getting description of instance-0000000f: [Error Code 42] Domain not found: no domain with matching uuid '4e916d24-9f9d-4289-87ce-f65d2499fcd9' (instance-0000000f): libvirt.libvirtError: Domain not found: no domain with matching uuid '4e916d24-9f9d-4289-87ce-f65d2499fcd9' (instance-0000000f)
Oct 18 12:11:22 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 12:11:22 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:11:22 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:11:22 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Hypervisor/Node resource view: name=user free_ram=8014MB free_disk=24.87297821044922GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74190) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 12:11:22 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:11:22 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:11:22 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Updating instance_info_cache with network_info: [] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:11:22 user nova-compute[74190]: INFO nova.compute.manager [-] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Took 0.89 seconds to deallocate network for instance.
Oct 18 12:11:22 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 4e916d24-9f9d-4289-87ce-f65d2499fcd9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:11:22 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 95ca0697-22b5-4109-868f-ca5556015a1f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:11:22 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 772b126c-2148-4ca8-90f2-69d6eb4b7db7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:11:22 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 0382820d-a678-4593-85df-168f42fc4ce4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:11:22 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance b1e27a16-43e4-4e80-9c0a-5c2dce06daae actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:11:22 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 5861a219-456a-43dd-898c-a99ed3051d83 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:11:22 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 7c539213-358a-48fd-9abd-1f017ba5b54a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:11:22 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 800d5074-2de1-44ce-8f4a-9a7f5ed110c0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:11:22 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 12:11:22 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 12:11:22 user nova-compute[74190]: DEBUG nova.compute.manager [req-c334d0f2-8f55-46df-aad6-309142048d83 req-5f4934f5-5d62-48f0-9d4c-fbf3c1b2cedb service nova] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Received event network-vif-plugged-7cee893b-5ac8-45f8-a1f8-5374b49cc3b5 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:11:22 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-c334d0f2-8f55-46df-aad6-309142048d83 req-5f4934f5-5d62-48f0-9d4c-fbf3c1b2cedb service nova] Acquiring lock "4e916d24-9f9d-4289-87ce-f65d2499fcd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:11:22 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-c334d0f2-8f55-46df-aad6-309142048d83 req-5f4934f5-5d62-48f0-9d4c-fbf3c1b2cedb service nova] Lock "4e916d24-9f9d-4289-87ce-f65d2499fcd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:11:22 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-c334d0f2-8f55-46df-aad6-309142048d83 req-5f4934f5-5d62-48f0-9d4c-fbf3c1b2cedb service nova] Lock "4e916d24-9f9d-4289-87ce-f65d2499fcd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:11:22 user nova-compute[74190]: DEBUG nova.compute.manager [req-c334d0f2-8f55-46df-aad6-309142048d83 req-5f4934f5-5d62-48f0-9d4c-fbf3c1b2cedb service nova] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] No waiting events found dispatching network-vif-plugged-7cee893b-5ac8-45f8-a1f8-5374b49cc3b5 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:11:22 user nova-compute[74190]: WARNING nova.compute.manager [req-c334d0f2-8f55-46df-aad6-309142048d83 req-5f4934f5-5d62-48f0-9d4c-fbf3c1b2cedb service nova] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Received unexpected event network-vif-plugged-7cee893b-5ac8-45f8-a1f8-5374b49cc3b5 for instance with vm_state active and task_state deleting.
Oct 18 12:11:22 user nova-compute[74190]: DEBUG nova.compute.manager [req-c334d0f2-8f55-46df-aad6-309142048d83 req-5f4934f5-5d62-48f0-9d4c-fbf3c1b2cedb service nova] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Received event network-vif-deleted-7cee893b-5ac8-45f8-a1f8-5374b49cc3b5 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:11:22 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 12:11:22 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 12:11:23 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Compute_service record updated for user:user {{(pid=74190) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 12:11:23 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.398s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:11:23 user nova-compute[74190]: DEBUG nova.compute.manager [req-c1b82956-3a74-49f5-9acf-2ce5689fe756 req-d6483a18-d70d-4af1-9919-36e7176600ca service nova] [instance: 7c539213-358a-48fd-9abd-1f017ba5b54a] Received event network-changed-ecc36cc2-dc28-452e-82f2-0d347537cd36 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:11:23 user nova-compute[74190]: DEBUG nova.compute.manager [req-c1b82956-3a74-49f5-9acf-2ce5689fe756 req-d6483a18-d70d-4af1-9919-36e7176600ca service nova] [instance: 7c539213-358a-48fd-9abd-1f017ba5b54a] Refreshing instance network info cache due to event network-changed-ecc36cc2-dc28-452e-82f2-0d347537cd36. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 12:11:23 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-c1b82956-3a74-49f5-9acf-2ce5689fe756 req-d6483a18-d70d-4af1-9919-36e7176600ca service nova] Acquiring lock "refresh_cache-7c539213-358a-48fd-9abd-1f017ba5b54a" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:11:23 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-c1b82956-3a74-49f5-9acf-2ce5689fe756 req-d6483a18-d70d-4af1-9919-36e7176600ca service nova] Acquired lock "refresh_cache-7c539213-358a-48fd-9abd-1f017ba5b54a" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:11:23 user nova-compute[74190]: DEBUG nova.network.neutron [req-c1b82956-3a74-49f5-9acf-2ce5689fe756 req-d6483a18-d70d-4af1-9919-36e7176600ca service nova] [instance: 7c539213-358a-48fd-9abd-1f017ba5b54a] Refreshing network info cache for port ecc36cc2-dc28-452e-82f2-0d347537cd36 {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 12:11:23 user nova-compute[74190]: INFO nova.compute.manager [None req-3ba3f81d-9b69-45d2-bfc0-ceb6def2ea2e tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] [instance: 4e916d24-9f9d-4289-87ce-f65d2499fcd9] Took 0.89 seconds to detach 1 volumes for instance.
Oct 18 12:11:23 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-3ba3f81d-9b69-45d2-bfc0-ceb6def2ea2e tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:11:23 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-3ba3f81d-9b69-45d2-bfc0-ceb6def2ea2e tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:11:23 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-3ba3f81d-9b69-45d2-bfc0-ceb6def2ea2e tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 12:11:23 user nova-compute[74190]: DEBUG nova.network.neutron [req-c1b82956-3a74-49f5-9acf-2ce5689fe756 req-d6483a18-d70d-4af1-9919-36e7176600ca service nova] [instance: 7c539213-358a-48fd-9abd-1f017ba5b54a] Updated VIF entry in instance network info cache for port ecc36cc2-dc28-452e-82f2-0d347537cd36. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 12:11:23 user nova-compute[74190]: DEBUG nova.network.neutron [req-c1b82956-3a74-49f5-9acf-2ce5689fe756 req-d6483a18-d70d-4af1-9919-36e7176600ca service nova] [instance: 7c539213-358a-48fd-9abd-1f017ba5b54a] Updating instance_info_cache with network_info: [{"id": "ecc36cc2-dc28-452e-82f2-0d347537cd36", "address": "fa:16:3e:0e:31:0c", "network": {"id": "aa827f81-b165-444f-89cc-f21c42a9f772", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1659902586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e375153f6f24827811c5825fc2a2c6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc36cc2-dc", "ovs_interfaceid": "ecc36cc2-dc28-452e-82f2-0d347537cd36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:11:23 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-3ba3f81d-9b69-45d2-bfc0-ceb6def2ea2e tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 12:11:23 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-c1b82956-3a74-49f5-9acf-2ce5689fe756 req-d6483a18-d70d-4af1-9919-36e7176600ca service nova] Releasing lock "refresh_cache-7c539213-358a-48fd-9abd-1f017ba5b54a" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:11:23 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-3ba3f81d-9b69-45d2-bfc0-ceb6def2ea2e tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.279s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:11:23 user nova-compute[74190]: INFO nova.scheduler.client.report [None req-3ba3f81d-9b69-45d2-bfc0-ceb6def2ea2e tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Deleted allocations for instance 4e916d24-9f9d-4289-87ce-f65d2499fcd9
Oct 18 12:11:24 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:11:24 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:11:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-3ba3f81d-9b69-45d2-bfc0-ceb6def2ea2e tempest-ServerStableDeviceRescueTest-1127867733 tempest-ServerStableDeviceRescueTest-1127867733-project-member] Lock "4e916d24-9f9d-4289-87ce-f65d2499fcd9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.550s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:11:25 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:11:26 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:11:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:11:27 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-e739fcd2-51b7-4ec7-9038-586c5365c091 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Acquiring lock "95ca0697-22b5-4109-868f-ca5556015a1f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:11:27 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-e739fcd2-51b7-4ec7-9038-586c5365c091 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lock "95ca0697-22b5-4109-868f-ca5556015a1f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:11:27 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-e739fcd2-51b7-4ec7-9038-586c5365c091 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Acquiring lock "95ca0697-22b5-4109-868f-ca5556015a1f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:11:27 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-e739fcd2-51b7-4ec7-9038-586c5365c091 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lock "95ca0697-22b5-4109-868f-ca5556015a1f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:11:27 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-e739fcd2-51b7-4ec7-9038-586c5365c091 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lock "95ca0697-22b5-4109-868f-ca5556015a1f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:11:27 user nova-compute[74190]: INFO nova.compute.manager [None req-e739fcd2-51b7-4ec7-9038-586c5365c091 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] Terminating instance
Oct 18 12:11:27 user nova-compute[74190]: DEBUG nova.compute.manager [None req-e739fcd2-51b7-4ec7-9038-586c5365c091 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] Start destroying the instance on the hypervisor. {{(pid=74190) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 12:11:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:11:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:11:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:11:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:11:27 user nova-compute[74190]: DEBUG nova.compute.manager [req-ce69dd25-65ff-44da-95cc-5c3dbd707041 req-00eaf913-482c-4647-b2de-297ea87a8524 service nova] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] Received event network-vif-unplugged-58c81983-46ab-4026-b712-775ae319a09f {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:11:27 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-ce69dd25-65ff-44da-95cc-5c3dbd707041 req-00eaf913-482c-4647-b2de-297ea87a8524 service nova] Acquiring lock "95ca0697-22b5-4109-868f-ca5556015a1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:11:27 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-ce69dd25-65ff-44da-95cc-5c3dbd707041 req-00eaf913-482c-4647-b2de-297ea87a8524 service nova] Lock "95ca0697-22b5-4109-868f-ca5556015a1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:11:27 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-ce69dd25-65ff-44da-95cc-5c3dbd707041 req-00eaf913-482c-4647-b2de-297ea87a8524 service nova] Lock "95ca0697-22b5-4109-868f-ca5556015a1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:11:27 user nova-compute[74190]: DEBUG nova.compute.manager [req-ce69dd25-65ff-44da-95cc-5c3dbd707041 req-00eaf913-482c-4647-b2de-297ea87a8524 service nova] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] No waiting events found dispatching network-vif-unplugged-58c81983-46ab-4026-b712-775ae319a09f {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:11:27 user nova-compute[74190]: DEBUG nova.compute.manager [req-ce69dd25-65ff-44da-95cc-5c3dbd707041 req-00eaf913-482c-4647-b2de-297ea87a8524 service nova] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] Received event network-vif-unplugged-58c81983-46ab-4026-b712-775ae319a09f for instance with task_state deleting. {{(pid=74190) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 12:11:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:11:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:11:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:11:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:11:28 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] Instance destroyed successfully.
Oct 18 12:11:28 user nova-compute[74190]: DEBUG nova.objects.instance [None req-e739fcd2-51b7-4ec7-9038-586c5365c091 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lazy-loading 'resources' on Instance uuid 95ca0697-22b5-4109-868f-ca5556015a1f {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:11:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:11:28 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-e739fcd2-51b7-4ec7-9038-586c5365c091 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:53:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1133778819',display_name='tempest-ServerRescueNegativeTestJSON-server-1133778819',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1133778819',id=24,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-18T11:58:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1ffa18c02b8a4117ab1ccc52aca64f06',ramdisk_id='',reservation_id='r-nbj7z5hd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1266902394',owner_user_name='tempest-ServerRescueNegativeTestJSON-1266902394-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T12:00:42Z,user_data=None,user_id='9db2d65206e24d0aa1428b9bcaa0a86e',uuid=95ca0697-22b5-4109-868f-ca5556015a1f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "58c81983-46ab-4026-b712-775ae319a09f", "address": "fa:16:3e:dd:c9:17", "network": {"id": "130f7948-11e4-49b4-9d4a-dffb2b48bdcd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595419292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ffa18c02b8a4117ab1ccc52aca64f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58c81983-46", "ovs_interfaceid": "58c81983-46ab-4026-b712-775ae319a09f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 12:11:28 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-e739fcd2-51b7-4ec7-9038-586c5365c091 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Converting VIF {"id": "58c81983-46ab-4026-b712-775ae319a09f", "address": "fa:16:3e:dd:c9:17", "network": {"id": "130f7948-11e4-49b4-9d4a-dffb2b48bdcd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595419292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ffa18c02b8a4117ab1ccc52aca64f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58c81983-46", "ovs_interfaceid": "58c81983-46ab-4026-b712-775ae319a09f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 12:11:28 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-e739fcd2-51b7-4ec7-9038-586c5365c091 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dd:c9:17,bridge_name='br-int',has_traffic_filtering=True,id=58c81983-46ab-4026-b712-775ae319a09f,network=Network(130f7948-11e4-49b4-9d4a-dffb2b48bdcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58c81983-46') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 12:11:28 user nova-compute[74190]: DEBUG os_vif [None req-e739fcd2-51b7-4ec7-9038-586c5365c091 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:c9:17,bridge_name='br-int',has_traffic_filtering=True,id=58c81983-46ab-4026-b712-775ae319a09f,network=Network(130f7948-11e4-49b4-9d4a-dffb2b48bdcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58c81983-46') {{(pid=74190) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 12:11:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:11:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap58c81983-46, bridge=br-int, if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:11:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:11:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:11:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:11:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=936e13ff-b6d5-47cb-bd93-d77f5aecc793) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:11:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:11:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:11:28 user nova-compute[74190]: INFO os_vif [None req-e739fcd2-51b7-4ec7-9038-586c5365c091 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:c9:17,bridge_name='br-int',has_traffic_filtering=True,id=58c81983-46ab-4026-b712-775ae319a09f,network=Network(130f7948-11e4-49b4-9d4a-dffb2b48bdcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58c81983-46')
Oct 18 12:11:28 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-e739fcd2-51b7-4ec7-9038-586c5365c091 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] Deleting instance files /opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f_del
Oct 18 12:11:28 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-e739fcd2-51b7-4ec7-9038-586c5365c091 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] Deletion of /opt/stack/data/nova/instances/95ca0697-22b5-4109-868f-ca5556015a1f_del complete
Oct 18 12:11:28 user nova-compute[74190]: INFO nova.compute.manager [None req-e739fcd2-51b7-4ec7-9038-586c5365c091 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] Took 0.75 seconds to destroy the instance on the hypervisor.
Oct 18 12:11:28 user nova-compute[74190]: DEBUG oslo.service.loopingcall [None req-e739fcd2-51b7-4ec7-9038-586c5365c091 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74190) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 12:11:28 user nova-compute[74190]: DEBUG nova.compute.manager [-] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] Deallocating network for instance {{(pid=74190) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 12:11:28 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] deallocate_for_instance() {{(pid=74190) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 12:11:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:11:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:11:28 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] Updating instance_info_cache with network_info: [] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:11:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:11:28 user nova-compute[74190]: INFO nova.compute.manager [-] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] Took 0.48 seconds to deallocate network for instance.
Oct 18 12:11:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:11:28 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-e739fcd2-51b7-4ec7-9038-586c5365c091 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:11:28 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-e739fcd2-51b7-4ec7-9038-586c5365c091 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:11:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:11:29 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-e739fcd2-51b7-4ec7-9038-586c5365c091 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 12:11:29 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-e739fcd2-51b7-4ec7-9038-586c5365c091 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 12:11:29 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-e739fcd2-51b7-4ec7-9038-586c5365c091 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.338s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:11:29 user nova-compute[74190]: INFO nova.scheduler.client.report [None req-e739fcd2-51b7-4ec7-9038-586c5365c091 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Deleted allocations for instance 95ca0697-22b5-4109-868f-ca5556015a1f
Oct 18 12:11:29 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-e739fcd2-51b7-4ec7-9038-586c5365c091 tempest-ServerRescueNegativeTestJSON-1266902394 tempest-ServerRescueNegativeTestJSON-1266902394-project-member] Lock "95ca0697-22b5-4109-868f-ca5556015a1f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.765s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:11:30 user nova-compute[74190]: DEBUG nova.compute.manager [req-c99d738f-ae1e-4b71-983e-8187f3d4f944 req-0011c336-7f78-4549-a21a-18453c1c770d service nova] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] Received event network-vif-plugged-58c81983-46ab-4026-b712-775ae319a09f {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:11:30 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-c99d738f-ae1e-4b71-983e-8187f3d4f944 req-0011c336-7f78-4549-a21a-18453c1c770d service nova] Acquiring lock "95ca0697-22b5-4109-868f-ca5556015a1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:11:30 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-c99d738f-ae1e-4b71-983e-8187f3d4f944 req-0011c336-7f78-4549-a21a-18453c1c770d service nova] Lock "95ca0697-22b5-4109-868f-ca5556015a1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:11:30 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-c99d738f-ae1e-4b71-983e-8187f3d4f944 req-0011c336-7f78-4549-a21a-18453c1c770d service nova] Lock "95ca0697-22b5-4109-868f-ca5556015a1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:11:30 user nova-compute[74190]: DEBUG nova.compute.manager [req-c99d738f-ae1e-4b71-983e-8187f3d4f944 req-0011c336-7f78-4549-a21a-18453c1c770d service nova] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] No waiting events found dispatching network-vif-plugged-58c81983-46ab-4026-b712-775ae319a09f {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:11:30 user nova-compute[74190]: WARNING nova.compute.manager [req-c99d738f-ae1e-4b71-983e-8187f3d4f944 req-0011c336-7f78-4549-a21a-18453c1c770d service nova] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] Received unexpected event network-vif-plugged-58c81983-46ab-4026-b712-775ae319a09f for instance with vm_state deleted and task_state None.
Oct 18 12:11:30 user nova-compute[74190]: DEBUG nova.compute.manager [req-c99d738f-ae1e-4b71-983e-8187f3d4f944 req-0011c336-7f78-4549-a21a-18453c1c770d service nova] [instance: 95ca0697-22b5-4109-868f-ca5556015a1f] Received event network-vif-deleted-58c81983-46ab-4026-b712-775ae319a09f {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:11:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:11:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:11:33 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:11:35 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Acquiring lock "1aa9f158-c064-4e24-9571-6a3d37e07d51" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:11:35 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "1aa9f158-c064-4e24-9571-6a3d37e07d51" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:11:35 user nova-compute[74190]: DEBUG nova.compute.manager [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 1aa9f158-c064-4e24-9571-6a3d37e07d51] Starting instance... {{(pid=74190) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 12:11:35 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:11:35 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:11:35 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74190) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 12:11:35 user nova-compute[74190]: INFO nova.compute.claims [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 1aa9f158-c064-4e24-9571-6a3d37e07d51] Claim successful on node user
Oct 18 12:11:36 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 12:11:36 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 12:11:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.361s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:11:36 user nova-compute[74190]: DEBUG nova.compute.manager [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 1aa9f158-c064-4e24-9571-6a3d37e07d51] Start building networks asynchronously for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 12:11:36 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 1aa9f158-c064-4e24-9571-6a3d37e07d51] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 12:11:36 user nova-compute[74190]: DEBUG nova.compute.manager [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 1aa9f158-c064-4e24-9571-6a3d37e07d51] Allocating IP information in the background. {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 12:11:36 user nova-compute[74190]: DEBUG nova.network.neutron [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 1aa9f158-c064-4e24-9571-6a3d37e07d51] allocate_for_instance() {{(pid=74190) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 12:11:36 user nova-compute[74190]: DEBUG nova.compute.manager [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 1aa9f158-c064-4e24-9571-6a3d37e07d51] Start building block device mappings for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 12:11:36 user nova-compute[74190]: INFO nova.virt.block_device [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 1aa9f158-c064-4e24-9571-6a3d37e07d51] Booting with volume snapshot 35847864-2ea8-4d46-8c8d-347070eb1b1f at /dev/vda
Oct 18 12:11:36 user nova-compute[74190]: DEBUG nova.policy [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '27d9fc244d0f4e10a43b7df4dc8e30ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e375153f6f24827811c5825fc2a2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74190) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 12:11:37 user nova-compute[74190]: DEBUG nova.network.neutron [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 1aa9f158-c064-4e24-9571-6a3d37e07d51] Successfully created port: 440e943e-ccff-4254-981d-7d39a450c6a2 {{(pid=74190) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 12:11:37 user nova-compute[74190]: DEBUG nova.network.neutron [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 1aa9f158-c064-4e24-9571-6a3d37e07d51] Successfully updated port: 440e943e-ccff-4254-981d-7d39a450c6a2 {{(pid=74190) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 12:11:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Acquiring lock "refresh_cache-1aa9f158-c064-4e24-9571-6a3d37e07d51" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:11:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Acquired lock "refresh_cache-1aa9f158-c064-4e24-9571-6a3d37e07d51" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:11:37 user nova-compute[74190]: DEBUG nova.network.neutron [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 1aa9f158-c064-4e24-9571-6a3d37e07d51] Building network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 12:11:37 user nova-compute[74190]: DEBUG nova.compute.manager [req-5e8c1a9f-9134-458f-8dd3-d91759856ffa req-056bc14e-a694-4877-9db2-e1929b1adfa7 service nova] [instance: 1aa9f158-c064-4e24-9571-6a3d37e07d51] Received event network-changed-440e943e-ccff-4254-981d-7d39a450c6a2 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:11:37 user nova-compute[74190]: DEBUG nova.compute.manager [req-5e8c1a9f-9134-458f-8dd3-d91759856ffa req-056bc14e-a694-4877-9db2-e1929b1adfa7 service nova] [instance: 1aa9f158-c064-4e24-9571-6a3d37e07d51] Refreshing instance network info cache due to event network-changed-440e943e-ccff-4254-981d-7d39a450c6a2. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 12:11:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-5e8c1a9f-9134-458f-8dd3-d91759856ffa req-056bc14e-a694-4877-9db2-e1929b1adfa7 service nova] Acquiring lock "refresh_cache-1aa9f158-c064-4e24-9571-6a3d37e07d51" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:11:37 user nova-compute[74190]: DEBUG nova.network.neutron [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 1aa9f158-c064-4e24-9571-6a3d37e07d51] Instance cache missing network info. {{(pid=74190) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 12:11:38 user nova-compute[74190]: DEBUG nova.network.neutron [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 1aa9f158-c064-4e24-9571-6a3d37e07d51] Updating instance_info_cache with network_info: [{"id": "440e943e-ccff-4254-981d-7d39a450c6a2", "address": "fa:16:3e:9b:f5:fc", "network": {"id": "aa827f81-b165-444f-89cc-f21c42a9f772", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1659902586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e375153f6f24827811c5825fc2a2c6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap440e943e-cc", "ovs_interfaceid": "440e943e-ccff-4254-981d-7d39a450c6a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:11:38 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Releasing lock "refresh_cache-1aa9f158-c064-4e24-9571-6a3d37e07d51" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:11:38 user nova-compute[74190]: DEBUG nova.compute.manager [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 1aa9f158-c064-4e24-9571-6a3d37e07d51] Instance network_info: |[{"id": "440e943e-ccff-4254-981d-7d39a450c6a2", "address": "fa:16:3e:9b:f5:fc", "network": {"id": "aa827f81-b165-444f-89cc-f21c42a9f772", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1659902586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e375153f6f24827811c5825fc2a2c6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap440e943e-cc", "ovs_interfaceid": "440e943e-ccff-4254-981d-7d39a450c6a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 12:11:38 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-5e8c1a9f-9134-458f-8dd3-d91759856ffa req-056bc14e-a694-4877-9db2-e1929b1adfa7 service nova] Acquired lock "refresh_cache-1aa9f158-c064-4e24-9571-6a3d37e07d51" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:11:38 user nova-compute[74190]: DEBUG nova.network.neutron [req-5e8c1a9f-9134-458f-8dd3-d91759856ffa req-056bc14e-a694-4877-9db2-e1929b1adfa7 service nova] [instance: 1aa9f158-c064-4e24-9571-6a3d37e07d51] Refreshing network info cache for port 440e943e-ccff-4254-981d-7d39a450c6a2 {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 12:11:38 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:11:38 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:11:38 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74190) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 12:11:38 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:11:38 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:11:38 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:11:38 user nova-compute[74190]: DEBUG nova.network.neutron [req-5e8c1a9f-9134-458f-8dd3-d91759856ffa req-056bc14e-a694-4877-9db2-e1929b1adfa7 service nova] [instance: 1aa9f158-c064-4e24-9571-6a3d37e07d51] Updated VIF entry in instance network info cache for port 440e943e-ccff-4254-981d-7d39a450c6a2. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 12:11:38 user nova-compute[74190]: DEBUG nova.network.neutron [req-5e8c1a9f-9134-458f-8dd3-d91759856ffa req-056bc14e-a694-4877-9db2-e1929b1adfa7 service nova] [instance: 1aa9f158-c064-4e24-9571-6a3d37e07d51] Updating instance_info_cache with network_info: [{"id": "440e943e-ccff-4254-981d-7d39a450c6a2", "address": "fa:16:3e:9b:f5:fc", "network": {"id": "aa827f81-b165-444f-89cc-f21c42a9f772", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1659902586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e375153f6f24827811c5825fc2a2c6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap440e943e-cc", "ovs_interfaceid": "440e943e-ccff-4254-981d-7d39a450c6a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:11:38 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-5e8c1a9f-9134-458f-8dd3-d91759856ffa req-056bc14e-a694-4877-9db2-e1929b1adfa7 service nova] Releasing lock "refresh_cache-1aa9f158-c064-4e24-9571-6a3d37e07d51" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:11:40 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:11:41 user nova-compute[74190]: DEBUG nova.compute.manager [req-75b8181d-3f3f-48d2-af90-a71cd32c7ebb req-442ba4f8-06e3-4de0-b350-7c8643e11200 service nova] [instance: 800d5074-2de1-44ce-8f4a-9a7f5ed110c0] Received event network-changed-05810ade-2f7b-4af2-9ed7-f6a70d3842ac {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:11:41 user nova-compute[74190]: DEBUG nova.compute.manager [req-75b8181d-3f3f-48d2-af90-a71cd32c7ebb req-442ba4f8-06e3-4de0-b350-7c8643e11200 service nova] [instance: 800d5074-2de1-44ce-8f4a-9a7f5ed110c0] Refreshing instance network info cache due to event network-changed-05810ade-2f7b-4af2-9ed7-f6a70d3842ac. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 12:11:41 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-75b8181d-3f3f-48d2-af90-a71cd32c7ebb req-442ba4f8-06e3-4de0-b350-7c8643e11200 service nova] Acquiring lock "refresh_cache-800d5074-2de1-44ce-8f4a-9a7f5ed110c0" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:11:41 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-75b8181d-3f3f-48d2-af90-a71cd32c7ebb req-442ba4f8-06e3-4de0-b350-7c8643e11200 service nova] Acquired lock "refresh_cache-800d5074-2de1-44ce-8f4a-9a7f5ed110c0" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:11:41 user nova-compute[74190]: DEBUG nova.network.neutron [req-75b8181d-3f3f-48d2-af90-a71cd32c7ebb req-442ba4f8-06e3-4de0-b350-7c8643e11200 service nova] [instance: 800d5074-2de1-44ce-8f4a-9a7f5ed110c0] Refreshing network info cache for port 05810ade-2f7b-4af2-9ed7-f6a70d3842ac {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 12:11:41 user nova-compute[74190]: DEBUG nova.network.neutron [req-75b8181d-3f3f-48d2-af90-a71cd32c7ebb req-442ba4f8-06e3-4de0-b350-7c8643e11200 service nova] [instance: 800d5074-2de1-44ce-8f4a-9a7f5ed110c0] Updated VIF entry in instance network info cache for port 05810ade-2f7b-4af2-9ed7-f6a70d3842ac. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 12:11:41 user nova-compute[74190]: DEBUG nova.network.neutron [req-75b8181d-3f3f-48d2-af90-a71cd32c7ebb req-442ba4f8-06e3-4de0-b350-7c8643e11200 service nova] [instance: 800d5074-2de1-44ce-8f4a-9a7f5ed110c0] Updating instance_info_cache with network_info: [{"id": "05810ade-2f7b-4af2-9ed7-f6a70d3842ac", "address": "fa:16:3e:36:22:ee", "network": {"id": "3514ef75-5cb7-47ea-a384-9cae2c8347a9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2048313931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b56d8b29004d4bf5b0e67efba6520cbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05810ade-2f", "ovs_interfaceid": "05810ade-2f7b-4af2-9ed7-f6a70d3842ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:11:41 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-75b8181d-3f3f-48d2-af90-a71cd32c7ebb req-442ba4f8-06e3-4de0-b350-7c8643e11200 service nova] Releasing lock "refresh_cache-800d5074-2de1-44ce-8f4a-9a7f5ed110c0" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:11:41 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-2406b8d0-8b66-468b-aa42-861061df02e5 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Acquiring lock "800d5074-2de1-44ce-8f4a-9a7f5ed110c0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:11:41 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-2406b8d0-8b66-468b-aa42-861061df02e5 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Lock "800d5074-2de1-44ce-8f4a-9a7f5ed110c0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:11:41 user nova-compute[74190]: DEBUG nova.objects.instance [None req-2406b8d0-8b66-468b-aa42-861061df02e5 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Lazy-loading 'flavor' on Instance uuid 800d5074-2de1-44ce-8f4a-9a7f5ed110c0 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:11:41 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-2406b8d0-8b66-468b-aa42-861061df02e5 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Lock "800d5074-2de1-44ce-8f4a-9a7f5ed110c0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:11:42 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-2406b8d0-8b66-468b-aa42-861061df02e5 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Acquiring lock "800d5074-2de1-44ce-8f4a-9a7f5ed110c0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:11:42 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-2406b8d0-8b66-468b-aa42-861061df02e5 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Lock "800d5074-2de1-44ce-8f4a-9a7f5ed110c0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:11:42 user nova-compute[74190]: INFO nova.compute.manager [None req-2406b8d0-8b66-468b-aa42-861061df02e5 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] [instance: 800d5074-2de1-44ce-8f4a-9a7f5ed110c0] Attaching volume eb710c79-3704-4368-9bbb-56cb0879ea00 to /dev/vdb
Oct 18 12:11:42 user nova-compute[74190]: DEBUG os_brick.utils [None req-2406b8d0-8b66-468b-aa42-861061df02e5 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 12:11:42 user nova-compute[74190]: DEBUG os_brick.utils [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 12:11:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:11:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:11:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:11:42 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[619f496e-9528-47b1-be9f-a6606fb16363]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cff158e257e1\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:11:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:11:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:11:42 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd3f2419-9279-4571-9be4-bd066a6babe1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cff158e257e1\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:11:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:11:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:11:42 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[e71f085f-6acd-4505-b50b-476b01bb59bf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:11:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:11:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:11:42 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed8fe00d-7766-43bb-b0c6-35a819128263]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:11:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:11:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:11:42 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d53b9f-91f7-43f4-8136-7f873cbdc4ca]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:11:42 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f842ff0-0940-4acb-ac1f-e3b85809ff1d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:11:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-2406b8d0-8b66-468b-aa42-861061df02e5 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Running cmd (subprocess): nvme version {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:11:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-2406b8d0-8b66-468b-aa42-861061df02e5 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] 'nvme version' failed. Not Retrying. {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 12:11:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:11:42 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1efb5b0-f47b-449f-a41f-e81a041f0065]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:11:42 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2406b8d0-8b66-468b-aa42-861061df02e5 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] nvme not present on system {{(pid=74190) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 12:11:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:11:42 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e9114ae-3a74-4ca0-900d-a34e22f9dd47]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:11:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Running cmd (subprocess): nvme version {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:11:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] 'nvme version' failed. Not Retrying. {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 12:11:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 12:11:42 user nova-compute[74190]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 12:11:42 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[df0a7504-54f2-484f-829e-dd03dd949061]: (4, '') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:11:42 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] nvme not present on system {{(pid=74190) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 12:11:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:11:42 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-2406b8d0-8b66-468b-aa42-861061df02e5 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74190) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 12:11:42 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-2406b8d0-8b66-468b-aa42-861061df02e5 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 12:11:42 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-2406b8d0-8b66-468b-aa42-861061df02e5 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] LIGHTOS: no hostnqn found. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 12:11:42 user nova-compute[74190]: DEBUG os_brick.utils [None req-2406b8d0-8b66-468b-aa42-861061df02e5 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] <== get_connector_properties: return (159ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cff158e257e1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 12:11:42 user nova-compute[74190]: DEBUG nova.virt.block_device [None req-2406b8d0-8b66-468b-aa42-861061df02e5 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] [instance: 800d5074-2de1-44ce-8f4a-9a7f5ed110c0] Updating existing volume attachment record: 78df71b5-4000-4ae2-b567-83f7635ca127 {{(pid=74190) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 12:11:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 12:11:42 user nova-compute[74190]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 12:11:42 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed97d23e-14ce-47b9-8429-a0cc72b5210f]: (4, '') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:11:42 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74190) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 12:11:42 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 12:11:42 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] LIGHTOS: no hostnqn found. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 12:11:42 user nova-compute[74190]: DEBUG os_brick.utils [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] <== get_connector_properties: return (173ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cff158e257e1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 12:11:42 user nova-compute[74190]: DEBUG nova.virt.block_device [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 1aa9f158-c064-4e24-9571-6a3d37e07d51] Updating existing volume attachment record: 1b3d2efe-1722-46f6-a66e-b7fe1d5e6ab2 {{(pid=74190) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 12:11:43 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:11:45 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:11:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:11:50 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:11:53 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:11:55 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:11:58 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:12:00 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:12:03 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:12:08 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:12:08 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:12:08 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74190) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 12:12:08 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:12:08 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:12:08 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:12:08 user nova-compute[74190]: DEBUG nova.compute.manager [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 1aa9f158-c064-4e24-9571-6a3d37e07d51] Start spawning the instance on the hypervisor. {{(pid=74190) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 12:12:08 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 1aa9f158-c064-4e24-9571-6a3d37e07d51] Creating instance directory {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 12:12:08 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 1aa9f158-c064-4e24-9571-6a3d37e07d51] Creating image(s)
Oct 18 12:12:08 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 1aa9f158-c064-4e24-9571-6a3d37e07d51] Did not create local disks {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 18 12:12:08 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 1aa9f158-c064-4e24-9571-6a3d37e07d51] Ensure instance console log exists: /opt/stack/data/nova/instances/1aa9f158-c064-4e24-9571-6a3d37e07d51/console.log {{(pid=74190) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 12:12:08 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:12:08 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:12:08 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:12:08 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 1aa9f158-c064-4e24-9571-6a3d37e07d51] Start _get_guest_xml network_info=[{"id": "440e943e-ccff-4254-981d-7d39a450c6a2", "address": "fa:16:3e:9b:f5:fc", "network": {"id": "aa827f81-b165-444f-89cc-f21c42a9f772", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1659902586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e375153f6f24827811c5825fc2a2c6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap440e943e-cc", "ovs_interfaceid": "440e943e-ccff-4254-981d-7d39a450c6a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-10-18T12:11:25Z,direct_url=<?>,disk_format='qcow2',id=81ad5b32-c1c9-4f98-87a7-eadc05b4a0d8,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-535734609',owner='1e375153f6f24827811c5825fc2a2c6a',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-10-18T12:11:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:165db6bd-3792-416f-89e6-27b25a30b47c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xaqrGLDR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1aa9f158-c064-4e24-9571-6a3d37e07d51', 'attached_at': '', 'detached_at': '', 'volume_id': '165db6bd-3792-416f-89e6-27b25a30b47c', 'serial': '165db6bd-3792-416f-89e6-27b25a30b47c'}, 'delete_on_termination': True, 'guest_format': None, 'attachment_id': '1b3d2efe-1722-46f6-a66e-b7fe1d5e6ab2', 'volume_type': None} {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 12:12:08 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:12:08 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:12:08 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 12:12:08 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] CPU controller missing on host. {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 12:12:08 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 12:12:08 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] CPU controller found on host. {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 12:12:08 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74190) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 12:12:08 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T11:37:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-10-18T12:11:25Z,direct_url=<?>,disk_format='qcow2',id=81ad5b32-c1c9-4f98-87a7-eadc05b4a0d8,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-535734609',owner='1e375153f6f24827811c5825fc2a2c6a',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-10-18T12:11:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 12:12:08 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Flavor limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 12:12:08 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Image limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 12:12:08 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Flavor pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 12:12:08 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Image pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 12:12:08 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 12:12:08 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 12:12:08 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 12:12:08 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Got 1 possible topologies {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 12:12:08 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 12:12:08 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 12:12:08 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 1aa9f158-c064-4e24-9571-6a3d37e07d51] Calling os-brick to attach iSCSI Volume {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 12:12:08 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:165db6bd-3792-416f-89e6-27b25a30b47c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xaqrGLDR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 12:12:08 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 12:12:08 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 12:12:08 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 12:12:08 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 12:12:08 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:165db6bd-3792-416f-89e6-27b25a30b47c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 12:12:08 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:165db6bd-3792-416f-89e6-27b25a30b47c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 12:12:08 user nova-compute[74190]: INFO os_brick.initiator.connectors.iscsi [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 12:12:08 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:165db6bd-3792-416f-89e6-27b25a30b47c -p 172.16.0.220:3260 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:12:08 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:165db6bd-3792-416f-89e6-27b25a30b47c -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:12:08 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd92f0d-a24d-4bfe-acf6-b572e68370ee]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:12:08 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 12:12:08 user nova-compute[74190]:  {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:12:08 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:165db6bd-3792-416f-89e6-27b25a30b47c -p 172.16.0.220:3260 --interface default --op new {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:12:08 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:165db6bd-3792-416f-89e6-27b25a30b47c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:12:08 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb187ae-a824-40cd-a3b8-b4c63bebb399]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:165db6bd-3792-416f-89e6-27b25a30b47c] added\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:12:08 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:165db6bd-3792-416f-89e6-27b25a30b47c] added
Oct 18 12:12:08 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:12:08 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:165db6bd-3792-416f-89e6-27b25a30b47c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:12:08 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:165db6bd-3792-416f-89e6-27b25a30b47c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:12:08 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[30567465-4e5e-4ba5-a564-bd6a9ee4ebb2]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:12:08 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:12:08 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:165db6bd-3792-416f-89e6-27b25a30b47c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:12:08 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2406b8d0-8b66-468b-aa42-861061df02e5 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] [instance: 800d5074-2de1-44ce-8f4a-9a7f5ed110c0] Calling os-brick to attach iSCSI Volume {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 12:12:08 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-2406b8d0-8b66-468b-aa42-861061df02e5 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:eb710c79-3704-4368-9bbb-56cb0879ea00', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vPKLrDhR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 12:12:08 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-2406b8d0-8b66-468b-aa42-861061df02e5 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 12:12:08 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-2406b8d0-8b66-468b-aa42-861061df02e5 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 12:12:08 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:165db6bd-3792-416f-89e6-27b25a30b47c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:12:08 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[7449a2d2-cd0f-493e-a3df-46bc019e36de]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:12:08 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:12:08 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:165db6bd-3792-416f-89e6-27b25a30b47c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xaqrGLDR {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:12:08 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:165db6bd-3792-416f-89e6-27b25a30b47c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xaqrGLDR" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:12:08 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b8edf9-cdec-47a5-99c5-6994b631a6f8]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:12:08 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xaqrGLDR'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:12:08 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:165db6bd-3792-416f-89e6-27b25a30b47c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:12:08 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:165db6bd-3792-416f-89e6-27b25a30b47c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:12:08 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[30eb4ffb-8299-4880-90ca-961c75032dea]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:12:08 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:12:08 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:12:08 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:12:08 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[36349a7c-6542-41c1-a9e0-d570de79c114]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:12:08 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)
Oct 18 12:12:08 user nova-compute[74190]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28 (non-flash)
Oct 18 12:12:08 user nova-compute[74190]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf (non-flash)
Oct 18 12:12:08 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 12:12:08 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)
Oct 18 12:12:08 user nova-compute[74190]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28 (non-flash)
Oct 18 12:12:08 user nova-compute[74190]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf (non-flash)
Oct 18 12:12:08 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 12:12:08 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:165db6bd-3792-416f-89e6-27b25a30b47c -p 172.16.0.220:3260 --login {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:12:08 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:165db6bd-3792-416f-89e6-27b25a30b47c -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:12:08 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[696f6650-faa8-41e1-9223-b69134b08a7d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:165db6bd-3792-416f-89e6-27b25a30b47c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:165db6bd-3792-416f-89e6-27b25a30b47c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:12:08 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:165db6bd-3792-416f-89e6-27b25a30b47c, portal: 172.16.0.220,3260]
Oct 18 12:12:08 user nova-compute[74190]: Login to [iface: default, target: iqn.2010-10.org.openstack:165db6bd-3792-416f-89e6-27b25a30b47c, portal: 172.16.0.220,3260] successful.
Oct 18 12:12:08 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:12:08 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:165db6bd-3792-416f-89e6-27b25a30b47c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:12:08 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:165db6bd-3792-416f-89e6-27b25a30b47c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:12:08 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[8531c1b5-506e-457d-88ab-51a297eff0c0]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:12:08 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:12:08 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:12:08 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:12:08 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[a889ea32-c062-4434-a8f9-0f716f9dd209]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:165db6bd-3792-416f-89e6-27b25a30b47c (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:12:08 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)
Oct 18 12:12:08 user nova-compute[74190]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28 (non-flash)
Oct 18 12:12:08 user nova-compute[74190]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf (non-flash)
Oct 18 12:12:08 user nova-compute[74190]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:165db6bd-3792-416f-89e6-27b25a30b47c (non-flash)
Oct 18 12:12:08 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 12:12:08 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)
Oct 18 12:12:08 user nova-compute[74190]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28 (non-flash)
Oct 18 12:12:08 user nova-compute[74190]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf (non-flash)
Oct 18 12:12:08 user nova-compute[74190]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:165db6bd-3792-416f-89e6-27b25a30b47c (non-flash)
Oct 18 12:12:08 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 12:12:08 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:165db6bd-3792-416f-89e6-27b25a30b47c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 12:12:08 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Connected to 172.16.0.220:3260 {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 12:12:08 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] HCTL ('34', '-', '-', 0) found on session 49 with lun 0 {{(pid=74190) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 12:12:08 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74190) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 12:12:08 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:12:08 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:12:08 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ec28e2-29cc-4d74-9fdb-2154f13eacc0]: (4, ('- - 0', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:12:08 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Searching for a device in session 49 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74190) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 12:12:08 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:165db6bd-3792-416f-89e6-27b25a30b47c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xaqrGLDR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 12:12:09 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 12:12:09 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '23433303266323938', 'path': '/dev/sdc'} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 12:12:09 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 1aa9f158-c064-4e24-9571-6a3d37e07d51] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23433303266323938', 'path': '/dev/sdc'} {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 12:12:09 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-2406b8d0-8b66-468b-aa42-861061df02e5 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.230s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 12:12:09 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-2406b8d0-8b66-468b-aa42-861061df02e5 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 12:12:09 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-2406b8d0-8b66-468b-aa42-861061df02e5 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb710c79-3704-4368-9bbb-56cb0879ea00" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 12:12:09 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-2406b8d0-8b66-468b-aa42-861061df02e5 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb710c79-3704-4368-9bbb-56cb0879ea00" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 12:12:09 user nova-compute[74190]: INFO os_brick.initiator.connectors.iscsi [None req-2406b8d0-8b66-468b-aa42-861061df02e5 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 12:12:09 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb710c79-3704-4368-9bbb-56cb0879ea00 -p 172.16.0.220:3260 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:12:09 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb710c79-3704-4368-9bbb-56cb0879ea00 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:12:09 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[19bc154c-0a2e-480b-b2ed-e06232f33468]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:12:09 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-2406b8d0-8b66-468b-aa42-861061df02e5 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 12:12:09 user nova-compute[74190]:  {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:12:09 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T12:11:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-200121657',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-200121657',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-200121657',id=43,image_ref='81ad5b32-c1c9-4f98-87a7-eadc05b4a0d8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCI1D5nc+L7xscfoMzzzJRKhT+YMLcETOROCO5w9Bvr/TGswmcq5qwFFsi/881Dq+xLdQRrGREI7ckYY7nwdAmGy1NlMhSeu/Frg99qLXce5aHQvK4dns5JUOw1OOAWRkA==',key_name='tempest-keypair-1169132032',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e375153f6f24827811c5825fc2a2c6a',ramdisk_id='',reservation_id='r-fd05a0c9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1157442382',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1157442382-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1157442382',owner_user_name='tempest-TestVolumeBootPattern-1157442382-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T12:11:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27d9fc244d0f4e10a43b7df4dc8e30ad',uuid=1aa9f158-c064-4e24-9571-6a3d37e07d51,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "440e943e-ccff-4254-981d-7d39a450c6a2", "address": "fa:16:3e:9b:f5:fc", "network": {"id": "aa827f81-b165-444f-89cc-f21c42a9f772", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1659902586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e375153f6f24827811c5825fc2a2c6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap440e943e-cc", "ovs_interfaceid": "440e943e-ccff-4254-981d-7d39a450c6a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74190) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 12:12:09 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Converting VIF {"id": "440e943e-ccff-4254-981d-7d39a450c6a2", "address": "fa:16:3e:9b:f5:fc", "network": {"id": "aa827f81-b165-444f-89cc-f21c42a9f772", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1659902586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e375153f6f24827811c5825fc2a2c6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap440e943e-cc", "ovs_interfaceid": "440e943e-ccff-4254-981d-7d39a450c6a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 12:12:09 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:f5:fc,bridge_name='br-int',has_traffic_filtering=True,id=440e943e-ccff-4254-981d-7d39a450c6a2,network=Network(aa827f81-b165-444f-89cc-f21c42a9f772),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap440e943e-cc') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 12:12:09 user nova-compute[74190]: DEBUG nova.objects.instance [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lazy-loading 'pci_devices' on Instance uuid 1aa9f158-c064-4e24-9571-6a3d37e07d51 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:12:09 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb710c79-3704-4368-9bbb-56cb0879ea00 -p 172.16.0.220:3260 --interface default --op new {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:12:09 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 1aa9f158-c064-4e24-9571-6a3d37e07d51] End _get_guest_xml xml=<domain type="kvm">
Oct 18 12:12:09 user nova-compute[74190]:   <uuid>1aa9f158-c064-4e24-9571-6a3d37e07d51</uuid>
Oct 18 12:12:09 user nova-compute[74190]:   <name>instance-0000002b</name>
Oct 18 12:12:09 user nova-compute[74190]:   <memory>524288</memory>
Oct 18 12:12:09 user nova-compute[74190]:   <vcpu>1</vcpu>
Oct 18 12:12:09 user nova-compute[74190]:   <metadata>
Oct 18 12:12:09 user nova-compute[74190]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 12:12:09 user nova-compute[74190]:       <nova:package version="0.0.0"/>
Oct 18 12:12:09 user nova-compute[74190]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-200121657</nova:name>
Oct 18 12:12:09 user nova-compute[74190]:       <nova:creationTime>2023-10-18 12:12:08</nova:creationTime>
Oct 18 12:12:09 user nova-compute[74190]:       <nova:flavor name="m1.tiny">
Oct 18 12:12:09 user nova-compute[74190]:         <nova:memory>512</nova:memory>
Oct 18 12:12:09 user nova-compute[74190]:         <nova:disk>1</nova:disk>
Oct 18 12:12:09 user nova-compute[74190]:         <nova:swap>0</nova:swap>
Oct 18 12:12:09 user nova-compute[74190]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 12:12:09 user nova-compute[74190]:         <nova:vcpus>1</nova:vcpus>
Oct 18 12:12:09 user nova-compute[74190]:       </nova:flavor>
Oct 18 12:12:09 user nova-compute[74190]:       <nova:owner>
Oct 18 12:12:09 user nova-compute[74190]:         <nova:user uuid="27d9fc244d0f4e10a43b7df4dc8e30ad">tempest-TestVolumeBootPattern-1157442382-project-member</nova:user>
Oct 18 12:12:09 user nova-compute[74190]:         <nova:project uuid="1e375153f6f24827811c5825fc2a2c6a">tempest-TestVolumeBootPattern-1157442382</nova:project>
Oct 18 12:12:09 user nova-compute[74190]:       </nova:owner>
Oct 18 12:12:09 user nova-compute[74190]:       <nova:root type="image" uuid="81ad5b32-c1c9-4f98-87a7-eadc05b4a0d8"/>
Oct 18 12:12:09 user nova-compute[74190]:       <nova:ports>
Oct 18 12:12:09 user nova-compute[74190]:         <nova:port uuid="440e943e-ccff-4254-981d-7d39a450c6a2">
Oct 18 12:12:09 user nova-compute[74190]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 18 12:12:09 user nova-compute[74190]:         </nova:port>
Oct 18 12:12:09 user nova-compute[74190]:       </nova:ports>
Oct 18 12:12:09 user nova-compute[74190]:     </nova:instance>
Oct 18 12:12:09 user nova-compute[74190]:   </metadata>
Oct 18 12:12:09 user nova-compute[74190]:   <sysinfo type="smbios">
Oct 18 12:12:09 user nova-compute[74190]:     <system>
Oct 18 12:12:09 user nova-compute[74190]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 12:12:09 user nova-compute[74190]:       <entry name="product">OpenStack Nova</entry>
Oct 18 12:12:09 user nova-compute[74190]:       <entry name="version">0.0.0</entry>
Oct 18 12:12:09 user nova-compute[74190]:       <entry name="serial">1aa9f158-c064-4e24-9571-6a3d37e07d51</entry>
Oct 18 12:12:09 user nova-compute[74190]:       <entry name="uuid">1aa9f158-c064-4e24-9571-6a3d37e07d51</entry>
Oct 18 12:12:09 user nova-compute[74190]:       <entry name="family">Virtual Machine</entry>
Oct 18 12:12:09 user nova-compute[74190]:     </system>
Oct 18 12:12:09 user nova-compute[74190]:   </sysinfo>
Oct 18 12:12:09 user nova-compute[74190]:   <os>
Oct 18 12:12:09 user nova-compute[74190]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 12:12:09 user nova-compute[74190]:     <boot dev="hd"/>
Oct 18 12:12:09 user nova-compute[74190]:     <smbios mode="sysinfo"/>
Oct 18 12:12:09 user nova-compute[74190]:   </os>
Oct 18 12:12:09 user nova-compute[74190]:   <features>
Oct 18 12:12:09 user nova-compute[74190]:     <acpi/>
Oct 18 12:12:09 user nova-compute[74190]:     <apic/>
Oct 18 12:12:09 user nova-compute[74190]:     <vmcoreinfo/>
Oct 18 12:12:09 user nova-compute[74190]:   </features>
Oct 18 12:12:09 user nova-compute[74190]:   <clock offset="utc">
Oct 18 12:12:09 user nova-compute[74190]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 12:12:09 user nova-compute[74190]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 12:12:09 user nova-compute[74190]:     <timer name="hpet" present="no"/>
Oct 18 12:12:09 user nova-compute[74190]:   </clock>
Oct 18 12:12:09 user nova-compute[74190]:   <cpu mode="custom" match="exact">
Oct 18 12:12:09 user nova-compute[74190]:     <model>Nehalem</model>
Oct 18 12:12:09 user nova-compute[74190]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 12:12:09 user nova-compute[74190]:   </cpu>
Oct 18 12:12:09 user nova-compute[74190]:   <devices>
Oct 18 12:12:09 user nova-compute[74190]:     <disk type="block" device="disk">
Oct 18 12:12:09 user nova-compute[74190]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 12:12:09 user nova-compute[74190]:       <source dev="/dev/sdc"/>
Oct 18 12:12:09 user nova-compute[74190]:       <target dev="vda" bus="virtio"/>
Oct 18 12:12:09 user nova-compute[74190]:       <serial>165db6bd-3792-416f-89e6-27b25a30b47c</serial>
Oct 18 12:12:09 user nova-compute[74190]:     </disk>
Oct 18 12:12:09 user nova-compute[74190]:     <interface type="ethernet">
Oct 18 12:12:09 user nova-compute[74190]:       <mac address="fa:16:3e:9b:f5:fc"/>
Oct 18 12:12:09 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 12:12:09 user nova-compute[74190]:       <mtu size="1442"/>
Oct 18 12:12:09 user nova-compute[74190]:       <target dev="tap440e943e-cc"/>
Oct 18 12:12:09 user nova-compute[74190]:     </interface>
Oct 18 12:12:09 user nova-compute[74190]:     <serial type="pty">
Oct 18 12:12:09 user nova-compute[74190]:       <log file="/opt/stack/data/nova/instances/1aa9f158-c064-4e24-9571-6a3d37e07d51/console.log" append="off"/>
Oct 18 12:12:09 user nova-compute[74190]:     </serial>
Oct 18 12:12:09 user nova-compute[74190]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 12:12:09 user nova-compute[74190]:     <video>
Oct 18 12:12:09 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 12:12:09 user nova-compute[74190]:     </video>
Oct 18 12:12:09 user nova-compute[74190]:     <rng model="virtio">
Oct 18 12:12:09 user nova-compute[74190]:       <backend model="random">/dev/urandom</backend>
Oct 18 12:12:09 user nova-compute[74190]:     </rng>
Oct 18 12:12:09 user nova-compute[74190]:     <controller type="usb" index="0" model="none"/>
Oct 18 12:12:09 user nova-compute[74190]:     <memballoon model="virtio">
Oct 18 12:12:09 user nova-compute[74190]:       <stats period="10"/>
Oct 18 12:12:09 user nova-compute[74190]:     </memballoon>
Oct 18 12:12:09 user nova-compute[74190]:   </devices>
Oct 18 12:12:09 user nova-compute[74190]: </domain>
Oct 18 12:12:09 user nova-compute[74190]:  {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 12:12:09 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T12:11:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-200121657',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-200121657',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-200121657',id=43,image_ref='81ad5b32-c1c9-4f98-87a7-eadc05b4a0d8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCI1D5nc+L7xscfoMzzzJRKhT+YMLcETOROCO5w9Bvr/TGswmcq5qwFFsi/881Dq+xLdQRrGREI7ckYY7nwdAmGy1NlMhSeu/Frg99qLXce5aHQvK4dns5JUOw1OOAWRkA==',key_name='tempest-keypair-1169132032',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e375153f6f24827811c5825fc2a2c6a',ramdisk_id='',reservation_id='r-fd05a0c9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1157442382',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1157442382-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1157442382',owner_user_name='tempest-TestVolumeBootPattern-1157442382-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T12:11:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27d9fc244d0f4e10a43b7df4dc8e30ad',uuid=1aa9f158-c064-4e24-9571-6a3d37e07d51,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "440e943e-ccff-4254-981d-7d39a450c6a2", "address": "fa:16:3e:9b:f5:fc", "network": {"id": "aa827f81-b165-444f-89cc-f21c42a9f772", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1659902586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e375153f6f24827811c5825fc2a2c6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap440e943e-cc", "ovs_interfaceid": "440e943e-ccff-4254-981d-7d39a450c6a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 12:12:09 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Converting VIF {"id": "440e943e-ccff-4254-981d-7d39a450c6a2", "address": "fa:16:3e:9b:f5:fc", "network": {"id": "aa827f81-b165-444f-89cc-f21c42a9f772", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1659902586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e375153f6f24827811c5825fc2a2c6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap440e943e-cc", "ovs_interfaceid": "440e943e-ccff-4254-981d-7d39a450c6a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 12:12:09 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:f5:fc,bridge_name='br-int',has_traffic_filtering=True,id=440e943e-ccff-4254-981d-7d39a450c6a2,network=Network(aa827f81-b165-444f-89cc-f21c42a9f772),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap440e943e-cc') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 12:12:09 user nova-compute[74190]: DEBUG os_vif [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:f5:fc,bridge_name='br-int',has_traffic_filtering=True,id=440e943e-ccff-4254-981d-7d39a450c6a2,network=Network(aa827f81-b165-444f-89cc-f21c42a9f772),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap440e943e-cc') {{(pid=74190) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 12:12:09 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:12:09 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:12:09 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 12:12:09 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb710c79-3704-4368-9bbb-56cb0879ea00 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:12:09 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed78b6a6-d83b-4c53-9573-2540cf727f27]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eb710c79-3704-4368-9bbb-56cb0879ea00] added\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:12:09 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-2406b8d0-8b66-468b-aa42-861061df02e5 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eb710c79-3704-4368-9bbb-56cb0879ea00] added
Oct 18 12:12:09 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:12:09 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:12:09 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c16899be-82d4-59ff-9df1-43ab398cc970', '_type': 'linux-noop'}}, row=False) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:12:09 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb710c79-3704-4368-9bbb-56cb0879ea00 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:12:09 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:12:09 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:12:09 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:12:09 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap440e943e-cc, may_exist=True, interface_attrs={}) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:12:09 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap440e943e-cc, col_values=(('qos', UUID('27c96900-6af6-4e14-9492-64b83c16099b')),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:12:09 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap440e943e-cc, col_values=(('external_ids', {'iface-id': '440e943e-ccff-4254-981d-7d39a450c6a2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9b:f5:fc', 'vm-uuid': '1aa9f158-c064-4e24-9571-6a3d37e07d51'}),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:12:09 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:12:09 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:12:09 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb710c79-3704-4368-9bbb-56cb0879ea00 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:12:09 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c307d5-1660-416f-b0d6-12a8a6a054ab]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:12:09 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-2406b8d0-8b66-468b-aa42-861061df02e5 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:12:09 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:12:09 user nova-compute[74190]: INFO os_vif [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:f5:fc,bridge_name='br-int',has_traffic_filtering=True,id=440e943e-ccff-4254-981d-7d39a450c6a2,network=Network(aa827f81-b165-444f-89cc-f21c42a9f772),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap440e943e-cc')
Oct 18 12:12:09 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb710c79-3704-4368-9bbb-56cb0879ea00 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:12:09 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb710c79-3704-4368-9bbb-56cb0879ea00 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:12:09 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff90929a-dd52-4b19-a314-f8aa10195e01]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:12:09 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-2406b8d0-8b66-468b-aa42-861061df02e5 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:12:09 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb710c79-3704-4368-9bbb-56cb0879ea00 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vPKLrDhR {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:12:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb710c79-3704-4368-9bbb-56cb0879ea00 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vPKLrDhR" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:12:10 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[98aadb43-dc22-40f8-bef7-86ba71ced135]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:12:10 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-2406b8d0-8b66-468b-aa42-861061df02e5 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vPKLrDhR'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:12:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb710c79-3704-4368-9bbb-56cb0879ea00 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:12:10 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] No BDM found with device name vda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 12:12:10 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] No VIF found with MAC fa:16:3e:9b:f5:fc, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 12:12:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb710c79-3704-4368-9bbb-56cb0879ea00 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:12:10 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[558bbf31-42b1-433e-8630-2a854b571ae2]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:12:10 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-2406b8d0-8b66-468b-aa42-861061df02e5 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:12:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:12:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:12:10 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bde457f-71a3-43b5-8b24-15701fa3c4b9]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:165db6bd-3792-416f-89e6-27b25a30b47c (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:12:10 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-2406b8d0-8b66-468b-aa42-861061df02e5 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)
Oct 18 12:12:10 user nova-compute[74190]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28 (non-flash)
Oct 18 12:12:10 user nova-compute[74190]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf (non-flash)
Oct 18 12:12:10 user nova-compute[74190]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:165db6bd-3792-416f-89e6-27b25a30b47c (non-flash)
Oct 18 12:12:10 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 12:12:10 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-2406b8d0-8b66-468b-aa42-861061df02e5 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)
Oct 18 12:12:10 user nova-compute[74190]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28 (non-flash)
Oct 18 12:12:10 user nova-compute[74190]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf (non-flash)
Oct 18 12:12:10 user nova-compute[74190]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:165db6bd-3792-416f-89e6-27b25a30b47c (non-flash)
Oct 18 12:12:10 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 12:12:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb710c79-3704-4368-9bbb-56cb0879ea00 -p 172.16.0.220:3260 --login {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:12:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb710c79-3704-4368-9bbb-56cb0879ea00 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:12:10 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d8379e2-1bdf-4b7d-bd8e-15241025ab76]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:eb710c79-3704-4368-9bbb-56cb0879ea00, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:eb710c79-3704-4368-9bbb-56cb0879ea00, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:12:10 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-2406b8d0-8b66-468b-aa42-861061df02e5 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:eb710c79-3704-4368-9bbb-56cb0879ea00, portal: 172.16.0.220,3260]
Oct 18 12:12:10 user nova-compute[74190]: Login to [iface: default, target: iqn.2010-10.org.openstack:eb710c79-3704-4368-9bbb-56cb0879ea00, portal: 172.16.0.220,3260] successful.
Oct 18 12:12:10 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:12:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb710c79-3704-4368-9bbb-56cb0879ea00 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:12:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb710c79-3704-4368-9bbb-56cb0879ea00 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:12:10 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[f99cb7de-f0d0-4ba7-b1a4-42dc9420662e]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:12:10 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-2406b8d0-8b66-468b-aa42-861061df02e5 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:12:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:12:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:12:10 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cbd04a3-8c74-4667-bcf8-6762f013db32]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:165db6bd-3792-416f-89e6-27b25a30b47c (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb710c79-3704-4368-9bbb-56cb0879ea00 (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:12:10 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-2406b8d0-8b66-468b-aa42-861061df02e5 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)
Oct 18 12:12:10 user nova-compute[74190]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28 (non-flash)
Oct 18 12:12:10 user nova-compute[74190]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf (non-flash)
Oct 18 12:12:10 user nova-compute[74190]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:165db6bd-3792-416f-89e6-27b25a30b47c (non-flash)
Oct 18 12:12:10 user nova-compute[74190]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb710c79-3704-4368-9bbb-56cb0879ea00 (non-flash)
Oct 18 12:12:10 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 12:12:10 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-2406b8d0-8b66-468b-aa42-861061df02e5 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)
Oct 18 12:12:10 user nova-compute[74190]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28 (non-flash)
Oct 18 12:12:10 user nova-compute[74190]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf (non-flash)
Oct 18 12:12:10 user nova-compute[74190]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:165db6bd-3792-416f-89e6-27b25a30b47c (non-flash)
Oct 18 12:12:10 user nova-compute[74190]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb710c79-3704-4368-9bbb-56cb0879ea00 (non-flash)
Oct 18 12:12:10 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 12:12:10 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-2406b8d0-8b66-468b-aa42-861061df02e5 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb710c79-3704-4368-9bbb-56cb0879ea00" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 12:12:10 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-2406b8d0-8b66-468b-aa42-861061df02e5 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Connected to 172.16.0.220:3260 {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 12:12:10 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-2406b8d0-8b66-468b-aa42-861061df02e5 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] HCTL ('36', '-', '-', 0) found on session 50 with lun 0 {{(pid=74190) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 12:12:10 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-2406b8d0-8b66-468b-aa42-861061df02e5 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74190) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 12:12:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:12:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:12:10 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a3ff64-c256-4328-b488-daaede45bf94]: (4, ('- - 0', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:12:10 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-2406b8d0-8b66-468b-aa42-861061df02e5 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Searching for a device in session 50 and hctl ['36', '*', '*', 0] yield: None {{(pid=74190) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 12:12:11 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:12:11 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-2406b8d0-8b66-468b-aa42-861061df02e5 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Searching for a device in session 50 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74190) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 12:12:11 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-2406b8d0-8b66-468b-aa42-861061df02e5 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:eb710c79-3704-4368-9bbb-56cb0879ea00', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vPKLrDhR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 12:12:11 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-2406b8d0-8b66-468b-aa42-861061df02e5 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 12:12:11 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-2406b8d0-8b66-468b-aa42-861061df02e5 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] <== connect_volume: return (2552ms) {'type': 'block', 'scsi_wwn': '23665356363373666', 'path': '/dev/sde'} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 12:12:11 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2406b8d0-8b66-468b-aa42-861061df02e5 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] [instance: 800d5074-2de1-44ce-8f4a-9a7f5ed110c0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23665356363373666', 'path': '/dev/sde'} {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 12:12:11 user nova-compute[74190]: DEBUG nova.objects.instance [None req-2406b8d0-8b66-468b-aa42-861061df02e5 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Lazy-loading 'flavor' on Instance uuid 800d5074-2de1-44ce-8f4a-9a7f5ed110c0 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:12:11 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:12:11 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-2406b8d0-8b66-468b-aa42-861061df02e5 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] attach device xml: <disk type="block" device="disk">
Oct 18 12:12:11 user nova-compute[74190]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 12:12:11 user nova-compute[74190]:   <source dev="/dev/sde"/>
Oct 18 12:12:11 user nova-compute[74190]:   <target dev="vdb" bus="virtio"/>
Oct 18 12:12:11 user nova-compute[74190]:   <serial>eb710c79-3704-4368-9bbb-56cb0879ea00</serial>
Oct 18 12:12:11 user nova-compute[74190]: </disk>
Oct 18 12:12:11 user nova-compute[74190]:  {{(pid=74190) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 18 12:12:11 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:12:11 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:12:11 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:12:11 user nova-compute[74190]: DEBUG nova.compute.manager [req-2b82632d-a592-4477-9e68-902e3408cf77 req-bcd5ac38-35c0-4cfe-8b48-82f6502ea252 service nova] [instance: 1aa9f158-c064-4e24-9571-6a3d37e07d51] Received event network-vif-plugged-440e943e-ccff-4254-981d-7d39a450c6a2 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:12:11 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-2b82632d-a592-4477-9e68-902e3408cf77 req-bcd5ac38-35c0-4cfe-8b48-82f6502ea252 service nova] Acquiring lock "1aa9f158-c064-4e24-9571-6a3d37e07d51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:12:11 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-2b82632d-a592-4477-9e68-902e3408cf77 req-bcd5ac38-35c0-4cfe-8b48-82f6502ea252 service nova] Lock "1aa9f158-c064-4e24-9571-6a3d37e07d51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:12:11 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-2b82632d-a592-4477-9e68-902e3408cf77 req-bcd5ac38-35c0-4cfe-8b48-82f6502ea252 service nova] Lock "1aa9f158-c064-4e24-9571-6a3d37e07d51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:12:11 user nova-compute[74190]: DEBUG nova.compute.manager [req-2b82632d-a592-4477-9e68-902e3408cf77 req-bcd5ac38-35c0-4cfe-8b48-82f6502ea252 service nova] [instance: 1aa9f158-c064-4e24-9571-6a3d37e07d51] No waiting events found dispatching network-vif-plugged-440e943e-ccff-4254-981d-7d39a450c6a2 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:12:11 user nova-compute[74190]: WARNING nova.compute.manager [req-2b82632d-a592-4477-9e68-902e3408cf77 req-bcd5ac38-35c0-4cfe-8b48-82f6502ea252 service nova] [instance: 1aa9f158-c064-4e24-9571-6a3d37e07d51] Received unexpected event network-vif-plugged-440e943e-ccff-4254-981d-7d39a450c6a2 for instance with vm_state building and task_state spawning.
Oct 18 12:12:12 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:12:12 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Cleaning up deleted instances {{(pid=74190) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 18 12:12:12 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] There are 0 instances to clean {{(pid=74190) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 18 12:12:12 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-2406b8d0-8b66-468b-aa42-861061df02e5 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] No BDM found with device name vda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 12:12:12 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-2406b8d0-8b66-468b-aa42-861061df02e5 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 12:12:12 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-2406b8d0-8b66-468b-aa42-861061df02e5 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] No VIF found with MAC fa:16:3e:36:22:ee, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 12:12:12 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-2406b8d0-8b66-468b-aa42-861061df02e5 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Lock "800d5074-2de1-44ce-8f4a-9a7f5ed110c0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 30.299s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:12:13 user nova-compute[74190]: INFO nova.compute.manager [None req-192a15b4-5ea0-44e4-baf8-7c7f0c1ed12d tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] Unrescuing
Oct 18 12:12:13 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-192a15b4-5ea0-44e4-baf8-7c7f0c1ed12d tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Acquiring lock "refresh_cache-5861a219-456a-43dd-898c-a99ed3051d83" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:12:13 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-192a15b4-5ea0-44e4-baf8-7c7f0c1ed12d tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Acquired lock "refresh_cache-5861a219-456a-43dd-898c-a99ed3051d83" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:12:13 user nova-compute[74190]: DEBUG nova.network.neutron [None req-192a15b4-5ea0-44e4-baf8-7c7f0c1ed12d tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] Building network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 12:12:13 user nova-compute[74190]: DEBUG nova.compute.manager [req-a06b12bd-8ed1-47f1-89f1-417bec958a95 req-f765392c-56a0-458a-a3d0-1e92fef1a563 service nova] [instance: 1aa9f158-c064-4e24-9571-6a3d37e07d51] Received event network-vif-plugged-440e943e-ccff-4254-981d-7d39a450c6a2 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:12:13 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-a06b12bd-8ed1-47f1-89f1-417bec958a95 req-f765392c-56a0-458a-a3d0-1e92fef1a563 service nova] Acquiring lock "1aa9f158-c064-4e24-9571-6a3d37e07d51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:12:13 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-a06b12bd-8ed1-47f1-89f1-417bec958a95 req-f765392c-56a0-458a-a3d0-1e92fef1a563 service nova] Lock "1aa9f158-c064-4e24-9571-6a3d37e07d51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:12:13 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-a06b12bd-8ed1-47f1-89f1-417bec958a95 req-f765392c-56a0-458a-a3d0-1e92fef1a563 service nova] Lock "1aa9f158-c064-4e24-9571-6a3d37e07d51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:12:13 user nova-compute[74190]: DEBUG nova.compute.manager [req-a06b12bd-8ed1-47f1-89f1-417bec958a95 req-f765392c-56a0-458a-a3d0-1e92fef1a563 service nova] [instance: 1aa9f158-c064-4e24-9571-6a3d37e07d51] No waiting events found dispatching network-vif-plugged-440e943e-ccff-4254-981d-7d39a450c6a2 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:12:13 user nova-compute[74190]: WARNING nova.compute.manager [req-a06b12bd-8ed1-47f1-89f1-417bec958a95 req-f765392c-56a0-458a-a3d0-1e92fef1a563 service nova] [instance: 1aa9f158-c064-4e24-9571-6a3d37e07d51] Received unexpected event network-vif-plugged-440e943e-ccff-4254-981d-7d39a450c6a2 for instance with vm_state building and task_state spawning.
Oct 18 12:12:13 user nova-compute[74190]: DEBUG nova.compute.manager [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 1aa9f158-c064-4e24-9571-6a3d37e07d51] Instance event wait completed in 0 seconds for  {{(pid=74190) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 12:12:13 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 1aa9f158-c064-4e24-9571-6a3d37e07d51] Guest created on hypervisor {{(pid=74190) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 12:12:13 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 1aa9f158-c064-4e24-9571-6a3d37e07d51] Instance spawned successfully.
Oct 18 12:12:13 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 1aa9f158-c064-4e24-9571-6a3d37e07d51] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 12:12:13 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 1aa9f158-c064-4e24-9571-6a3d37e07d51] Found default for hw_input_bus of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:12:13 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 1aa9f158-c064-4e24-9571-6a3d37e07d51] Found default for hw_pointer_model of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:12:14 user nova-compute[74190]: INFO nova.compute.manager [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 1aa9f158-c064-4e24-9571-6a3d37e07d51] Took 5.56 seconds to spawn the instance on the hypervisor.
Oct 18 12:12:14 user nova-compute[74190]: DEBUG nova.compute.manager [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 1aa9f158-c064-4e24-9571-6a3d37e07d51] Checking state {{(pid=74190) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 12:12:14 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:12:14 user nova-compute[74190]: INFO nova.compute.manager [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 1aa9f158-c064-4e24-9571-6a3d37e07d51] Took 38.34 seconds to build instance.
Oct 18 12:12:14 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-5bf7d954-fcc3-4792-8075-69de6e0d2f9d tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "1aa9f158-c064-4e24-9571-6a3d37e07d51" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 38.442s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:12:14 user nova-compute[74190]: DEBUG nova.network.neutron [None req-192a15b4-5ea0-44e4-baf8-7c7f0c1ed12d tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] Updating instance_info_cache with network_info: [{"id": "f1268427-9b33-481f-b7dc-2e397d6d2da9", "address": "fa:16:3e:ed:cb:95", "network": {"id": "c2dbbd24-f1d2-47a2-835f-0f9b24b585f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-920140900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d994366010142519ff367fa7ca77e61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1268427-9b", "ovs_interfaceid": "f1268427-9b33-481f-b7dc-2e397d6d2da9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:12:14 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-192a15b4-5ea0-44e4-baf8-7c7f0c1ed12d tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Releasing lock "refresh_cache-5861a219-456a-43dd-898c-a99ed3051d83" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:12:14 user nova-compute[74190]: DEBUG nova.objects.instance [None req-192a15b4-5ea0-44e4-baf8-7c7f0c1ed12d tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lazy-loading 'flavor' on Instance uuid 5861a219-456a-43dd-898c-a99ed3051d83 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:12:14 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:12:14 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:12:14 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:12:14 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:12:14 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:12:15 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] Instance destroyed successfully.
Oct 18 12:12:15 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:12:15 user nova-compute[74190]: DEBUG nova.compute.manager [req-edad0e6d-9aac-4e2b-9807-5680530420d5 req-ab1cac5a-6d34-420f-8120-147d2566f8de service nova] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] Received event network-vif-unplugged-f1268427-9b33-481f-b7dc-2e397d6d2da9 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:12:15 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-edad0e6d-9aac-4e2b-9807-5680530420d5 req-ab1cac5a-6d34-420f-8120-147d2566f8de service nova] Acquiring lock "5861a219-456a-43dd-898c-a99ed3051d83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:12:15 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-edad0e6d-9aac-4e2b-9807-5680530420d5 req-ab1cac5a-6d34-420f-8120-147d2566f8de service nova] Lock "5861a219-456a-43dd-898c-a99ed3051d83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:12:15 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-edad0e6d-9aac-4e2b-9807-5680530420d5 req-ab1cac5a-6d34-420f-8120-147d2566f8de service nova] Lock "5861a219-456a-43dd-898c-a99ed3051d83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:12:15 user nova-compute[74190]: DEBUG nova.compute.manager [req-edad0e6d-9aac-4e2b-9807-5680530420d5 req-ab1cac5a-6d34-420f-8120-147d2566f8de service nova] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] No waiting events found dispatching network-vif-unplugged-f1268427-9b33-481f-b7dc-2e397d6d2da9 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:12:15 user nova-compute[74190]: WARNING nova.compute.manager [req-edad0e6d-9aac-4e2b-9807-5680530420d5 req-ab1cac5a-6d34-420f-8120-147d2566f8de service nova] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] Received unexpected event network-vif-unplugged-f1268427-9b33-481f-b7dc-2e397d6d2da9 for instance with vm_state rescued and task_state unrescuing.
Oct 18 12:12:15 user nova-compute[74190]: DEBUG nova.compute.manager [req-edad0e6d-9aac-4e2b-9807-5680530420d5 req-ab1cac5a-6d34-420f-8120-147d2566f8de service nova] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] Received event network-vif-plugged-f1268427-9b33-481f-b7dc-2e397d6d2da9 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:12:15 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-edad0e6d-9aac-4e2b-9807-5680530420d5 req-ab1cac5a-6d34-420f-8120-147d2566f8de service nova] Acquiring lock "5861a219-456a-43dd-898c-a99ed3051d83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:12:15 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-edad0e6d-9aac-4e2b-9807-5680530420d5 req-ab1cac5a-6d34-420f-8120-147d2566f8de service nova] Lock "5861a219-456a-43dd-898c-a99ed3051d83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:12:15 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-edad0e6d-9aac-4e2b-9807-5680530420d5 req-ab1cac5a-6d34-420f-8120-147d2566f8de service nova] Lock "5861a219-456a-43dd-898c-a99ed3051d83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:12:15 user nova-compute[74190]: DEBUG nova.compute.manager [req-edad0e6d-9aac-4e2b-9807-5680530420d5 req-ab1cac5a-6d34-420f-8120-147d2566f8de service nova] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] No waiting events found dispatching network-vif-plugged-f1268427-9b33-481f-b7dc-2e397d6d2da9 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:12:15 user nova-compute[74190]: WARNING nova.compute.manager [req-edad0e6d-9aac-4e2b-9807-5680530420d5 req-ab1cac5a-6d34-420f-8120-147d2566f8de service nova] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] Received unexpected event network-vif-plugged-f1268427-9b33-481f-b7dc-2e397d6d2da9 for instance with vm_state rescued and task_state unrescuing.
Oct 18 12:12:15 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-f8e98bbb-99c3-458b-a038-65944d751301 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Acquiring lock "800d5074-2de1-44ce-8f4a-9a7f5ed110c0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:12:15 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-f8e98bbb-99c3-458b-a038-65944d751301 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Lock "800d5074-2de1-44ce-8f4a-9a7f5ed110c0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:12:15 user nova-compute[74190]: DEBUG nova.objects.instance [None req-f8e98bbb-99c3-458b-a038-65944d751301 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Lazy-loading 'flavor' on Instance uuid 800d5074-2de1-44ce-8f4a-9a7f5ed110c0 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:12:16 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-f8e98bbb-99c3-458b-a038-65944d751301 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Lock "800d5074-2de1-44ce-8f4a-9a7f5ed110c0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.103s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:12:16 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-f8e98bbb-99c3-458b-a038-65944d751301 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Acquiring lock "800d5074-2de1-44ce-8f4a-9a7f5ed110c0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:12:16 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-f8e98bbb-99c3-458b-a038-65944d751301 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Lock "800d5074-2de1-44ce-8f4a-9a7f5ed110c0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:12:16 user nova-compute[74190]: INFO nova.compute.manager [None req-f8e98bbb-99c3-458b-a038-65944d751301 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] [instance: 800d5074-2de1-44ce-8f4a-9a7f5ed110c0] Attaching volume d198be11-e2f2-4ef0-a745-a8e139d1ada1 to /dev/vdc
Oct 18 12:12:16 user nova-compute[74190]: DEBUG os_brick.utils [None req-f8e98bbb-99c3-458b-a038-65944d751301 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 12:12:16 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:12:16 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:12:16 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[a31d93fb-824d-4742-9aa0-5e3c51a2ecd6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cff158e257e1\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:12:16 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:12:16 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:12:16 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a2560b5-d65a-43bd-a5d9-96e1d8bb5aea]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:12:16 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:12:16 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:12:16 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e7fe08-8578-4c96-9b94-2299b260198c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:12:16 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[a79dfa60-4e9f-4863-bfb1-eadd34d26e35]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:12:16 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-f8e98bbb-99c3-458b-a038-65944d751301 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Running cmd (subprocess): nvme version {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:12:16 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-f8e98bbb-99c3-458b-a038-65944d751301 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] 'nvme version' failed. Not Retrying. {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 12:12:16 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f8e98bbb-99c3-458b-a038-65944d751301 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] nvme not present on system {{(pid=74190) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 12:12:16 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:12:16 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 12:12:16 user nova-compute[74190]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 12:12:16 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8b57555-82c9-4333-979d-ae623a10ad26]: (4, '') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:12:16 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-f8e98bbb-99c3-458b-a038-65944d751301 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74190) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 12:12:16 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-f8e98bbb-99c3-458b-a038-65944d751301 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 12:12:16 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-f8e98bbb-99c3-458b-a038-65944d751301 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] LIGHTOS: no hostnqn found. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 12:12:16 user nova-compute[74190]: DEBUG os_brick.utils [None req-f8e98bbb-99c3-458b-a038-65944d751301 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cff158e257e1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 12:12:16 user nova-compute[74190]: DEBUG nova.virt.block_device [None req-f8e98bbb-99c3-458b-a038-65944d751301 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] [instance: 800d5074-2de1-44ce-8f4a-9a7f5ed110c0] Updating existing volume attachment record: 368fe933-1c3d-4e31-84a9-76299ac831ac {{(pid=74190) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 12:12:16 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:12:16 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:12:16 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:12:16 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:12:17 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:12:17 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:12:17 user nova-compute[74190]: DEBUG nova.compute.manager [req-4c1bb929-c22f-4dea-ad7f-8a021f01dc14 req-b4730e0e-94d8-4f73-ac7e-2e54d35f3aff service nova] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] Received event network-vif-plugged-f1268427-9b33-481f-b7dc-2e397d6d2da9 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:12:17 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-4c1bb929-c22f-4dea-ad7f-8a021f01dc14 req-b4730e0e-94d8-4f73-ac7e-2e54d35f3aff service nova] Acquiring lock "5861a219-456a-43dd-898c-a99ed3051d83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:12:17 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-4c1bb929-c22f-4dea-ad7f-8a021f01dc14 req-b4730e0e-94d8-4f73-ac7e-2e54d35f3aff service nova] Lock "5861a219-456a-43dd-898c-a99ed3051d83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:12:17 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-4c1bb929-c22f-4dea-ad7f-8a021f01dc14 req-b4730e0e-94d8-4f73-ac7e-2e54d35f3aff service nova] Lock "5861a219-456a-43dd-898c-a99ed3051d83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:12:17 user nova-compute[74190]: DEBUG nova.compute.manager [req-4c1bb929-c22f-4dea-ad7f-8a021f01dc14 req-b4730e0e-94d8-4f73-ac7e-2e54d35f3aff service nova] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] No waiting events found dispatching network-vif-plugged-f1268427-9b33-481f-b7dc-2e397d6d2da9 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:12:17 user nova-compute[74190]: WARNING nova.compute.manager [req-4c1bb929-c22f-4dea-ad7f-8a021f01dc14 req-b4730e0e-94d8-4f73-ac7e-2e54d35f3aff service nova] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] Received unexpected event network-vif-plugged-f1268427-9b33-481f-b7dc-2e397d6d2da9 for instance with vm_state rescued and task_state unrescuing.
Oct 18 12:12:17 user nova-compute[74190]: DEBUG nova.compute.manager [req-4c1bb929-c22f-4dea-ad7f-8a021f01dc14 req-b4730e0e-94d8-4f73-ac7e-2e54d35f3aff service nova] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] Received event network-vif-plugged-f1268427-9b33-481f-b7dc-2e397d6d2da9 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:12:17 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-4c1bb929-c22f-4dea-ad7f-8a021f01dc14 req-b4730e0e-94d8-4f73-ac7e-2e54d35f3aff service nova] Acquiring lock "5861a219-456a-43dd-898c-a99ed3051d83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:12:17 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-4c1bb929-c22f-4dea-ad7f-8a021f01dc14 req-b4730e0e-94d8-4f73-ac7e-2e54d35f3aff service nova] Lock "5861a219-456a-43dd-898c-a99ed3051d83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:12:17 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-4c1bb929-c22f-4dea-ad7f-8a021f01dc14 req-b4730e0e-94d8-4f73-ac7e-2e54d35f3aff service nova] Lock "5861a219-456a-43dd-898c-a99ed3051d83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:12:17 user nova-compute[74190]: DEBUG nova.compute.manager [req-4c1bb929-c22f-4dea-ad7f-8a021f01dc14 req-b4730e0e-94d8-4f73-ac7e-2e54d35f3aff service nova] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] No waiting events found dispatching network-vif-plugged-f1268427-9b33-481f-b7dc-2e397d6d2da9 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:12:17 user nova-compute[74190]: WARNING nova.compute.manager [req-4c1bb929-c22f-4dea-ad7f-8a021f01dc14 req-b4730e0e-94d8-4f73-ac7e-2e54d35f3aff service nova] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] Received unexpected event network-vif-plugged-f1268427-9b33-481f-b7dc-2e397d6d2da9 for instance with vm_state rescued and task_state unrescuing.
Oct 18 12:12:19 user nova-compute[74190]: DEBUG nova.compute.manager [None req-192a15b4-5ea0-44e4-baf8-7c7f0c1ed12d tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] Checking state {{(pid=74190) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 12:12:19 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:12:20 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:12:20 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:12:20 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Starting heal instance info cache {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 12:12:20 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "refresh_cache-772b126c-2148-4ca8-90f2-69d6eb4b7db7" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:12:20 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquired lock "refresh_cache-772b126c-2148-4ca8-90f2-69d6eb4b7db7" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:12:20 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 772b126c-2148-4ca8-90f2-69d6eb4b7db7] Forcefully refreshing network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 18 12:12:20 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:12:21 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:12:21 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 772b126c-2148-4ca8-90f2-69d6eb4b7db7] Updating instance_info_cache with network_info: [{"id": "5470a91d-fa0f-4018-afa9-8e0a604cfca3", "address": "fa:16:3e:aa:5e:3e", "network": {"id": "c2dbbd24-f1d2-47a2-835f-0f9b24b585f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-920140900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d994366010142519ff367fa7ca77e61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5470a91d-fa", "ovs_interfaceid": "5470a91d-fa0f-4018-afa9-8e0a604cfca3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:12:21 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Releasing lock "refresh_cache-772b126c-2148-4ca8-90f2-69d6eb4b7db7" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:12:21 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 772b126c-2148-4ca8-90f2-69d6eb4b7db7] Updated the network info_cache for instance {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 18 12:12:21 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:12:22 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:12:22 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:12:22 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74190) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 12:12:22 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:12:22 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:12:22 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:12:22 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:12:22 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Auditing locally available compute resources for user (node: user) {{(pid=74190) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 12:12:22 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1e27a16-43e4-4e80-9c0a-5c2dce06daae/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:12:22 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1e27a16-43e4-4e80-9c0a-5c2dce06daae/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:12:22 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1e27a16-43e4-4e80-9c0a-5c2dce06daae/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:12:22 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:12:22 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1e27a16-43e4-4e80-9c0a-5c2dce06daae/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:12:22 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/800d5074-2de1-44ce-8f4a-9a7f5ed110c0/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:12:23 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/800d5074-2de1-44ce-8f4a-9a7f5ed110c0/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:12:23 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/800d5074-2de1-44ce-8f4a-9a7f5ed110c0/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:12:23 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/800d5074-2de1-44ce-8f4a-9a7f5ed110c0/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:12:23 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 12:12:23 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:12:23 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:12:23 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:12:23 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:12:23 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 12:12:23 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 12:12:23 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 12:12:23 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 12:12:24 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:12:24 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:12:24 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Hypervisor/Node resource view: name=user free_ram=8313MB free_disk=25.01519012451172GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74190) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 12:12:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:12:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:12:24 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 772b126c-2148-4ca8-90f2-69d6eb4b7db7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:12:24 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 0382820d-a678-4593-85df-168f42fc4ce4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:12:24 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance b1e27a16-43e4-4e80-9c0a-5c2dce06daae actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:12:24 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 5861a219-456a-43dd-898c-a99ed3051d83 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:12:24 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 7c539213-358a-48fd-9abd-1f017ba5b54a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:12:24 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 800d5074-2de1-44ce-8f4a-9a7f5ed110c0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:12:24 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 1aa9f158-c064-4e24-9571-6a3d37e07d51 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:12:24 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 12:12:24 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 12:12:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:12:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:12:25 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 12:12:25 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 12:12:25 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Compute_service record updated for user:user {{(pid=74190) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 12:12:25 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.793s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:12:28 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:12:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:12:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:12:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:12:31 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:12:33 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:12:33 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74190) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 18 12:12:33 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9f657f87-edf9-41d9-88ab-c868e7cddd4c tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Acquiring lock "7983ceaf-8ed3-4321-a242-2e44218f4d0b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:12:33 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9f657f87-edf9-41d9-88ab-c868e7cddd4c tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Lock "7983ceaf-8ed3-4321-a242-2e44218f4d0b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:12:33 user nova-compute[74190]: DEBUG nova.compute.manager [None req-9f657f87-edf9-41d9-88ab-c868e7cddd4c tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] [instance: 7983ceaf-8ed3-4321-a242-2e44218f4d0b] Starting instance... {{(pid=74190) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 12:12:33 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9f657f87-edf9-41d9-88ab-c868e7cddd4c tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:12:33 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9f657f87-edf9-41d9-88ab-c868e7cddd4c tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:12:33 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-9f657f87-edf9-41d9-88ab-c868e7cddd4c tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74190) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 12:12:33 user nova-compute[74190]: INFO nova.compute.claims [None req-9f657f87-edf9-41d9-88ab-c868e7cddd4c tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] [instance: 7983ceaf-8ed3-4321-a242-2e44218f4d0b] Claim successful on node user
Oct 18 12:12:34 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-9f657f87-edf9-41d9-88ab-c868e7cddd4c tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 12:12:34 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-9f657f87-edf9-41d9-88ab-c868e7cddd4c tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 12:12:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9f657f87-edf9-41d9-88ab-c868e7cddd4c tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.361s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:12:34 user nova-compute[74190]: DEBUG nova.compute.manager [None req-9f657f87-edf9-41d9-88ab-c868e7cddd4c tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] [instance: 7983ceaf-8ed3-4321-a242-2e44218f4d0b] Start building networks asynchronously for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 12:12:34 user nova-compute[74190]: DEBUG nova.compute.manager [None req-9f657f87-edf9-41d9-88ab-c868e7cddd4c tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] [instance: 7983ceaf-8ed3-4321-a242-2e44218f4d0b] Allocating IP information in the background. {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 12:12:34 user nova-compute[74190]: DEBUG nova.network.neutron [None req-9f657f87-edf9-41d9-88ab-c868e7cddd4c tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] [instance: 7983ceaf-8ed3-4321-a242-2e44218f4d0b] allocate_for_instance() {{(pid=74190) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 12:12:34 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-9f657f87-edf9-41d9-88ab-c868e7cddd4c tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] [instance: 7983ceaf-8ed3-4321-a242-2e44218f4d0b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 12:12:34 user nova-compute[74190]: DEBUG nova.compute.manager [None req-9f657f87-edf9-41d9-88ab-c868e7cddd4c tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] [instance: 7983ceaf-8ed3-4321-a242-2e44218f4d0b] Start building block device mappings for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 12:12:34 user nova-compute[74190]: DEBUG nova.policy [None req-9f657f87-edf9-41d9-88ab-c868e7cddd4c tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'abbdcac234ac48acbc56abf3fda115e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84b62d410cc448486b792e094464815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74190) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 12:12:34 user nova-compute[74190]: DEBUG nova.compute.manager [None req-9f657f87-edf9-41d9-88ab-c868e7cddd4c tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] [instance: 7983ceaf-8ed3-4321-a242-2e44218f4d0b] Start spawning the instance on the hypervisor. {{(pid=74190) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 12:12:34 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-9f657f87-edf9-41d9-88ab-c868e7cddd4c tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] [instance: 7983ceaf-8ed3-4321-a242-2e44218f4d0b] Creating instance directory {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 12:12:34 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-9f657f87-edf9-41d9-88ab-c868e7cddd4c tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] [instance: 7983ceaf-8ed3-4321-a242-2e44218f4d0b] Creating image(s)
Oct 18 12:12:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9f657f87-edf9-41d9-88ab-c868e7cddd4c tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Acquiring lock "/opt/stack/data/nova/instances/7983ceaf-8ed3-4321-a242-2e44218f4d0b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:12:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9f657f87-edf9-41d9-88ab-c868e7cddd4c tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Lock "/opt/stack/data/nova/instances/7983ceaf-8ed3-4321-a242-2e44218f4d0b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:12:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9f657f87-edf9-41d9-88ab-c868e7cddd4c tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Lock "/opt/stack/data/nova/instances/7983ceaf-8ed3-4321-a242-2e44218f4d0b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:12:34 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-9f657f87-edf9-41d9-88ab-c868e7cddd4c tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:12:34 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-9f657f87-edf9-41d9-88ab-c868e7cddd4c tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.185s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:12:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9f657f87-edf9-41d9-88ab-c868e7cddd4c tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Acquiring lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:12:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9f657f87-edf9-41d9-88ab-c868e7cddd4c tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:12:34 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-9f657f87-edf9-41d9-88ab-c868e7cddd4c tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:12:34 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-9f657f87-edf9-41d9-88ab-c868e7cddd4c tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.183s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:12:34 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-9f657f87-edf9-41d9-88ab-c868e7cddd4c tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f,backing_fmt=raw /opt/stack/data/nova/instances/7983ceaf-8ed3-4321-a242-2e44218f4d0b/disk 1073741824 {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:12:34 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-9f657f87-edf9-41d9-88ab-c868e7cddd4c tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f,backing_fmt=raw /opt/stack/data/nova/instances/7983ceaf-8ed3-4321-a242-2e44218f4d0b/disk 1073741824" returned: 0 in 0.066s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:12:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9f657f87-edf9-41d9-88ab-c868e7cddd4c tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:12:34 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-9f657f87-edf9-41d9-88ab-c868e7cddd4c tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:12:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:12:34 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-9f657f87-edf9-41d9-88ab-c868e7cddd4c tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.181s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:12:34 user nova-compute[74190]: DEBUG nova.virt.disk.api [None req-9f657f87-edf9-41d9-88ab-c868e7cddd4c tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7983ceaf-8ed3-4321-a242-2e44218f4d0b/disk. size=1073741824 {{(pid=74190) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 18 12:12:35 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-9f657f87-edf9-41d9-88ab-c868e7cddd4c tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7983ceaf-8ed3-4321-a242-2e44218f4d0b/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:12:35 user nova-compute[74190]: DEBUG nova.network.neutron [None req-9f657f87-edf9-41d9-88ab-c868e7cddd4c tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] [instance: 7983ceaf-8ed3-4321-a242-2e44218f4d0b] Successfully created port: 28ca935e-3c1c-47dc-8b10-d7a5cb602470 {{(pid=74190) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 12:12:35 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-9f657f87-edf9-41d9-88ab-c868e7cddd4c tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7983ceaf-8ed3-4321-a242-2e44218f4d0b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:12:35 user nova-compute[74190]: DEBUG nova.virt.disk.api [None req-9f657f87-edf9-41d9-88ab-c868e7cddd4c tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Cannot resize image /opt/stack/data/nova/instances/7983ceaf-8ed3-4321-a242-2e44218f4d0b/disk to a smaller size. {{(pid=74190) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 18 12:12:35 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-9f657f87-edf9-41d9-88ab-c868e7cddd4c tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] [instance: 7983ceaf-8ed3-4321-a242-2e44218f4d0b] Created local disks {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 12:12:35 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-9f657f87-edf9-41d9-88ab-c868e7cddd4c tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] [instance: 7983ceaf-8ed3-4321-a242-2e44218f4d0b] Ensure instance console log exists: /opt/stack/data/nova/instances/7983ceaf-8ed3-4321-a242-2e44218f4d0b/console.log {{(pid=74190) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 12:12:35 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9f657f87-edf9-41d9-88ab-c868e7cddd4c tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:12:35 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9f657f87-edf9-41d9-88ab-c868e7cddd4c tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:12:35 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9f657f87-edf9-41d9-88ab-c868e7cddd4c tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:12:35 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:12:35 user nova-compute[74190]: DEBUG nova.network.neutron [None req-9f657f87-edf9-41d9-88ab-c868e7cddd4c tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] [instance: 7983ceaf-8ed3-4321-a242-2e44218f4d0b] Successfully updated port: 28ca935e-3c1c-47dc-8b10-d7a5cb602470 {{(pid=74190) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 12:12:35 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9f657f87-edf9-41d9-88ab-c868e7cddd4c tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Acquiring lock "refresh_cache-7983ceaf-8ed3-4321-a242-2e44218f4d0b" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:12:35 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9f657f87-edf9-41d9-88ab-c868e7cddd4c tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Acquired lock "refresh_cache-7983ceaf-8ed3-4321-a242-2e44218f4d0b" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:12:35 user nova-compute[74190]: DEBUG nova.network.neutron [None req-9f657f87-edf9-41d9-88ab-c868e7cddd4c tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] [instance: 7983ceaf-8ed3-4321-a242-2e44218f4d0b] Building network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 12:12:35 user nova-compute[74190]: DEBUG nova.compute.manager [req-781eb745-3efa-46bf-b55e-a2e502512067 req-707f3b55-317e-4fa5-aa6a-9d5103e05ef8 service nova] [instance: 7983ceaf-8ed3-4321-a242-2e44218f4d0b] Received event network-changed-28ca935e-3c1c-47dc-8b10-d7a5cb602470 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:12:35 user nova-compute[74190]: DEBUG nova.compute.manager [req-781eb745-3efa-46bf-b55e-a2e502512067 req-707f3b55-317e-4fa5-aa6a-9d5103e05ef8 service nova] [instance: 7983ceaf-8ed3-4321-a242-2e44218f4d0b] Refreshing instance network info cache due to event network-changed-28ca935e-3c1c-47dc-8b10-d7a5cb602470. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 12:12:35 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-781eb745-3efa-46bf-b55e-a2e502512067 req-707f3b55-317e-4fa5-aa6a-9d5103e05ef8 service nova] Acquiring lock "refresh_cache-7983ceaf-8ed3-4321-a242-2e44218f4d0b" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:12:35 user nova-compute[74190]: DEBUG nova.network.neutron [None req-9f657f87-edf9-41d9-88ab-c868e7cddd4c tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] [instance: 7983ceaf-8ed3-4321-a242-2e44218f4d0b] Instance cache missing network info. {{(pid=74190) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8e98bbb-99c3-458b-a038-65944d751301 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] [instance: 800d5074-2de1-44ce-8f4a-9a7f5ed110c0] Calling os-brick to attach iSCSI Volume {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e98bbb-99c3-458b-a038-65944d751301 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d198be11-e2f2-4ef0-a745-a8e139d1ada1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AJRFfIGS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 12:12:36 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-f8e98bbb-99c3-458b-a038-65944d751301 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 12:12:36 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-f8e98bbb-99c3-458b-a038-65944d751301 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-f8e98bbb-99c3-458b-a038-65944d751301 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 12:12:36 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-f8e98bbb-99c3-458b-a038-65944d751301 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 12:12:36 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-f8e98bbb-99c3-458b-a038-65944d751301 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d198be11-e2f2-4ef0-a745-a8e139d1ada1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-f8e98bbb-99c3-458b-a038-65944d751301 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d198be11-e2f2-4ef0-a745-a8e139d1ada1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 12:12:36 user nova-compute[74190]: INFO os_brick.initiator.connectors.iscsi [None req-f8e98bbb-99c3-458b-a038-65944d751301 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 12:12:36 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d198be11-e2f2-4ef0-a745-a8e139d1ada1 -p 172.16.0.220:3260 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d198be11-e2f2-4ef0-a745-a8e139d1ada1 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[73dfef75-fc03-43d6-a9e2-40a7d4ed7919]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e98bbb-99c3-458b-a038-65944d751301 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 12:12:36 user nova-compute[74190]:  {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d198be11-e2f2-4ef0-a745-a8e139d1ada1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d198be11-e2f2-4ef0-a745-a8e139d1ada1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1c84f46-a7ae-45ad-bc33-8c1c859e2c1c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d198be11-e2f2-4ef0-a745-a8e139d1ada1] added\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e98bbb-99c3-458b-a038-65944d751301 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d198be11-e2f2-4ef0-a745-a8e139d1ada1] added
Oct 18 12:12:36 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d198be11-e2f2-4ef0-a745-a8e139d1ada1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d198be11-e2f2-4ef0-a745-a8e139d1ada1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff6e7514-64d6-4a67-a71f-9c333d590b94]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e98bbb-99c3-458b-a038-65944d751301 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d198be11-e2f2-4ef0-a745-a8e139d1ada1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d198be11-e2f2-4ef0-a745-a8e139d1ada1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[45cd2208-b20f-457c-8960-8749b4323eec]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e98bbb-99c3-458b-a038-65944d751301 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d198be11-e2f2-4ef0-a745-a8e139d1ada1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AJRFfIGS {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG nova.network.neutron [None req-9f657f87-edf9-41d9-88ab-c868e7cddd4c tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] [instance: 7983ceaf-8ed3-4321-a242-2e44218f4d0b] Updating instance_info_cache with network_info: [{"id": "28ca935e-3c1c-47dc-8b10-d7a5cb602470", "address": "fa:16:3e:b8:5e:82", "network": {"id": "31e59f3e-dc25-4b00-9d87-4b4f695425b8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-220402675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f84b62d410cc448486b792e094464815", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28ca935e-3c", "ovs_interfaceid": "28ca935e-3c1c-47dc-8b10-d7a5cb602470", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9f657f87-edf9-41d9-88ab-c868e7cddd4c tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Releasing lock "refresh_cache-7983ceaf-8ed3-4321-a242-2e44218f4d0b" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG nova.compute.manager [None req-9f657f87-edf9-41d9-88ab-c868e7cddd4c tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] [instance: 7983ceaf-8ed3-4321-a242-2e44218f4d0b] Instance network_info: |[{"id": "28ca935e-3c1c-47dc-8b10-d7a5cb602470", "address": "fa:16:3e:b8:5e:82", "network": {"id": "31e59f3e-dc25-4b00-9d87-4b4f695425b8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-220402675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f84b62d410cc448486b792e094464815", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28ca935e-3c", "ovs_interfaceid": "28ca935e-3c1c-47dc-8b10-d7a5cb602470", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d198be11-e2f2-4ef0-a745-a8e139d1ada1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AJRFfIGS" returned: 0 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff22bca-7637-4a96-a43a-ee03d2b40739]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-781eb745-3efa-46bf-b55e-a2e502512067 req-707f3b55-317e-4fa5-aa6a-9d5103e05ef8 service nova] Acquired lock "refresh_cache-7983ceaf-8ed3-4321-a242-2e44218f4d0b" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG nova.network.neutron [req-781eb745-3efa-46bf-b55e-a2e502512067 req-707f3b55-317e-4fa5-aa6a-9d5103e05ef8 service nova] [instance: 7983ceaf-8ed3-4321-a242-2e44218f4d0b] Refreshing network info cache for port 28ca935e-3c1c-47dc-8b10-d7a5cb602470 {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-9f657f87-edf9-41d9-88ab-c868e7cddd4c tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] [instance: 7983ceaf-8ed3-4321-a242-2e44218f4d0b] Start _get_guest_xml network_info=[{"id": "28ca935e-3c1c-47dc-8b10-d7a5cb602470", "address": "fa:16:3e:b8:5e:82", "network": {"id": "31e59f3e-dc25-4b00-9d87-4b4f695425b8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-220402675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f84b62d410cc448486b792e094464815", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28ca935e-3c", "ovs_interfaceid": "28ca935e-3c1c-47dc-8b10-d7a5cb602470", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'image_id': '6e88bbf0-6e78-49a8-b3c5-9453d22a89df'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e98bbb-99c3-458b-a038-65944d751301 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AJRFfIGS'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d198be11-e2f2-4ef0-a745-a8e139d1ada1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:12:36 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-9f657f87-edf9-41d9-88ab-c868e7cddd4c tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:12:36 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-9f657f87-edf9-41d9-88ab-c868e7cddd4c tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:12:36 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-9f657f87-edf9-41d9-88ab-c868e7cddd4c tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-9f657f87-edf9-41d9-88ab-c868e7cddd4c tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] CPU controller missing on host. {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-9f657f87-edf9-41d9-88ab-c868e7cddd4c tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-9f657f87-edf9-41d9-88ab-c868e7cddd4c tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] CPU controller found on host. {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-9f657f87-edf9-41d9-88ab-c868e7cddd4c tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74190) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-9f657f87-edf9-41d9-88ab-c868e7cddd4c tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T11:37:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-9f657f87-edf9-41d9-88ab-c868e7cddd4c tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Flavor limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-9f657f87-edf9-41d9-88ab-c868e7cddd4c tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Image limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-9f657f87-edf9-41d9-88ab-c868e7cddd4c tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Flavor pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-9f657f87-edf9-41d9-88ab-c868e7cddd4c tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Image pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-9f657f87-edf9-41d9-88ab-c868e7cddd4c tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-9f657f87-edf9-41d9-88ab-c868e7cddd4c tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-9f657f87-edf9-41d9-88ab-c868e7cddd4c tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-9f657f87-edf9-41d9-88ab-c868e7cddd4c tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Got 1 possible topologies {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-9f657f87-edf9-41d9-88ab-c868e7cddd4c tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-9f657f87-edf9-41d9-88ab-c868e7cddd4c tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-9f657f87-edf9-41d9-88ab-c868e7cddd4c tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T12:12:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-567421608',display_name='tempest-ServersNegativeTestJSON-server-567421608',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-567421608',id=44,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f84b62d410cc448486b792e094464815',ramdisk_id='',reservation_id='r-u3e0vfui',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1845899853',owner_user_name='tempest-ServersNegativeTestJSON-1845899853-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T12:12:34Z,user_data=None,user_id='abbdcac234ac48acbc56abf3fda115e5',uuid=7983ceaf-8ed3-4321-a242-2e44218f4d0b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "28ca935e-3c1c-47dc-8b10-d7a5cb602470", "address": "fa:16:3e:b8:5e:82", "network": {"id": "31e59f3e-dc25-4b00-9d87-4b4f695425b8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-220402675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f84b62d410cc448486b792e094464815", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28ca935e-3c", "ovs_interfaceid": "28ca935e-3c1c-47dc-8b10-d7a5cb602470", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74190) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-9f657f87-edf9-41d9-88ab-c868e7cddd4c tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Converting VIF {"id": "28ca935e-3c1c-47dc-8b10-d7a5cb602470", "address": "fa:16:3e:b8:5e:82", "network": {"id": "31e59f3e-dc25-4b00-9d87-4b4f695425b8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-220402675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f84b62d410cc448486b792e094464815", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28ca935e-3c", "ovs_interfaceid": "28ca935e-3c1c-47dc-8b10-d7a5cb602470", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-9f657f87-edf9-41d9-88ab-c868e7cddd4c tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:5e:82,bridge_name='br-int',has_traffic_filtering=True,id=28ca935e-3c1c-47dc-8b10-d7a5cb602470,network=Network(31e59f3e-dc25-4b00-9d87-4b4f695425b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28ca935e-3c') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG nova.objects.instance [None req-9f657f87-edf9-41d9-88ab-c868e7cddd4c tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Lazy-loading 'pci_devices' on Instance uuid 7983ceaf-8ed3-4321-a242-2e44218f4d0b {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d198be11-e2f2-4ef0-a745-a8e139d1ada1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6435e28-2193-4e52-aa48-010e83abf70d]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e98bbb-99c3-458b-a038-65944d751301 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-9f657f87-edf9-41d9-88ab-c868e7cddd4c tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] [instance: 7983ceaf-8ed3-4321-a242-2e44218f4d0b] End _get_guest_xml xml=<domain type="kvm">
Oct 18 12:12:36 user nova-compute[74190]:   <uuid>7983ceaf-8ed3-4321-a242-2e44218f4d0b</uuid>
Oct 18 12:12:36 user nova-compute[74190]:   <name>instance-0000002c</name>
Oct 18 12:12:36 user nova-compute[74190]:   <memory>524288</memory>
Oct 18 12:12:36 user nova-compute[74190]:   <vcpu>1</vcpu>
Oct 18 12:12:36 user nova-compute[74190]:   <metadata>
Oct 18 12:12:36 user nova-compute[74190]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 12:12:36 user nova-compute[74190]:       <nova:package version="0.0.0"/>
Oct 18 12:12:36 user nova-compute[74190]:       <nova:name>tempest-ServersNegativeTestJSON-server-567421608</nova:name>
Oct 18 12:12:36 user nova-compute[74190]:       <nova:creationTime>2023-10-18 12:12:36</nova:creationTime>
Oct 18 12:12:36 user nova-compute[74190]:       <nova:flavor name="m1.tiny">
Oct 18 12:12:36 user nova-compute[74190]:         <nova:memory>512</nova:memory>
Oct 18 12:12:36 user nova-compute[74190]:         <nova:disk>1</nova:disk>
Oct 18 12:12:36 user nova-compute[74190]:         <nova:swap>0</nova:swap>
Oct 18 12:12:36 user nova-compute[74190]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 12:12:36 user nova-compute[74190]:         <nova:vcpus>1</nova:vcpus>
Oct 18 12:12:36 user nova-compute[74190]:       </nova:flavor>
Oct 18 12:12:36 user nova-compute[74190]:       <nova:owner>
Oct 18 12:12:36 user nova-compute[74190]:         <nova:user uuid="abbdcac234ac48acbc56abf3fda115e5">tempest-ServersNegativeTestJSON-1845899853-project-member</nova:user>
Oct 18 12:12:36 user nova-compute[74190]:         <nova:project uuid="f84b62d410cc448486b792e094464815">tempest-ServersNegativeTestJSON-1845899853</nova:project>
Oct 18 12:12:36 user nova-compute[74190]:       </nova:owner>
Oct 18 12:12:36 user nova-compute[74190]:       <nova:root type="image" uuid="6e88bbf0-6e78-49a8-b3c5-9453d22a89df"/>
Oct 18 12:12:36 user nova-compute[74190]:       <nova:ports>
Oct 18 12:12:36 user nova-compute[74190]:         <nova:port uuid="28ca935e-3c1c-47dc-8b10-d7a5cb602470">
Oct 18 12:12:36 user nova-compute[74190]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 18 12:12:36 user nova-compute[74190]:         </nova:port>
Oct 18 12:12:36 user nova-compute[74190]:       </nova:ports>
Oct 18 12:12:36 user nova-compute[74190]:     </nova:instance>
Oct 18 12:12:36 user nova-compute[74190]:   </metadata>
Oct 18 12:12:36 user nova-compute[74190]:   <sysinfo type="smbios">
Oct 18 12:12:36 user nova-compute[74190]:     <system>
Oct 18 12:12:36 user nova-compute[74190]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 12:12:36 user nova-compute[74190]:       <entry name="product">OpenStack Nova</entry>
Oct 18 12:12:36 user nova-compute[74190]:       <entry name="version">0.0.0</entry>
Oct 18 12:12:36 user nova-compute[74190]:       <entry name="serial">7983ceaf-8ed3-4321-a242-2e44218f4d0b</entry>
Oct 18 12:12:36 user nova-compute[74190]:       <entry name="uuid">7983ceaf-8ed3-4321-a242-2e44218f4d0b</entry>
Oct 18 12:12:36 user nova-compute[74190]:       <entry name="family">Virtual Machine</entry>
Oct 18 12:12:36 user nova-compute[74190]:     </system>
Oct 18 12:12:36 user nova-compute[74190]:   </sysinfo>
Oct 18 12:12:36 user nova-compute[74190]:   <os>
Oct 18 12:12:36 user nova-compute[74190]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 12:12:36 user nova-compute[74190]:     <boot dev="hd"/>
Oct 18 12:12:36 user nova-compute[74190]:     <smbios mode="sysinfo"/>
Oct 18 12:12:36 user nova-compute[74190]:   </os>
Oct 18 12:12:36 user nova-compute[74190]:   <features>
Oct 18 12:12:36 user nova-compute[74190]:     <acpi/>
Oct 18 12:12:36 user nova-compute[74190]:     <apic/>
Oct 18 12:12:36 user nova-compute[74190]:     <vmcoreinfo/>
Oct 18 12:12:36 user nova-compute[74190]:   </features>
Oct 18 12:12:36 user nova-compute[74190]:   <clock offset="utc">
Oct 18 12:12:36 user nova-compute[74190]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 12:12:36 user nova-compute[74190]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 12:12:36 user nova-compute[74190]:     <timer name="hpet" present="no"/>
Oct 18 12:12:36 user nova-compute[74190]:   </clock>
Oct 18 12:12:36 user nova-compute[74190]:   <cpu mode="custom" match="exact">
Oct 18 12:12:36 user nova-compute[74190]:     <model>Nehalem</model>
Oct 18 12:12:36 user nova-compute[74190]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 12:12:36 user nova-compute[74190]:   </cpu>
Oct 18 12:12:36 user nova-compute[74190]:   <devices>
Oct 18 12:12:36 user nova-compute[74190]:     <disk type="file" device="disk">
Oct 18 12:12:36 user nova-compute[74190]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 12:12:36 user nova-compute[74190]:       <source file="/opt/stack/data/nova/instances/7983ceaf-8ed3-4321-a242-2e44218f4d0b/disk"/>
Oct 18 12:12:36 user nova-compute[74190]:       <target dev="vda" bus="virtio"/>
Oct 18 12:12:36 user nova-compute[74190]:     </disk>
Oct 18 12:12:36 user nova-compute[74190]:     <interface type="ethernet">
Oct 18 12:12:36 user nova-compute[74190]:       <mac address="fa:16:3e:b8:5e:82"/>
Oct 18 12:12:36 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 12:12:36 user nova-compute[74190]:       <mtu size="1442"/>
Oct 18 12:12:36 user nova-compute[74190]:       <target dev="tap28ca935e-3c"/>
Oct 18 12:12:36 user nova-compute[74190]:     </interface>
Oct 18 12:12:36 user nova-compute[74190]:     <serial type="pty">
Oct 18 12:12:36 user nova-compute[74190]:       <log file="/opt/stack/data/nova/instances/7983ceaf-8ed3-4321-a242-2e44218f4d0b/console.log" append="off"/>
Oct 18 12:12:36 user nova-compute[74190]:     </serial>
Oct 18 12:12:36 user nova-compute[74190]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 12:12:36 user nova-compute[74190]:     <video>
Oct 18 12:12:36 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 12:12:36 user nova-compute[74190]:     </video>
Oct 18 12:12:36 user nova-compute[74190]:     <rng model="virtio">
Oct 18 12:12:36 user nova-compute[74190]:       <backend model="random">/dev/urandom</backend>
Oct 18 12:12:36 user nova-compute[74190]:     </rng>
Oct 18 12:12:36 user nova-compute[74190]:     <controller type="usb" index="0" model="none"/>
Oct 18 12:12:36 user nova-compute[74190]:     <memballoon model="virtio">
Oct 18 12:12:36 user nova-compute[74190]:       <stats period="10"/>
Oct 18 12:12:36 user nova-compute[74190]:     </memballoon>
Oct 18 12:12:36 user nova-compute[74190]:   </devices>
Oct 18 12:12:36 user nova-compute[74190]: </domain>
Oct 18 12:12:36 user nova-compute[74190]:  {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-9f657f87-edf9-41d9-88ab-c868e7cddd4c tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T12:12:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-567421608',display_name='tempest-ServersNegativeTestJSON-server-567421608',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-567421608',id=44,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f84b62d410cc448486b792e094464815',ramdisk_id='',reservation_id='r-u3e0vfui',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1845899853',owner_user_name='tempest-ServersNegativeTestJSON-1845899853-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T12:12:34Z,user_data=None,user_id='abbdcac234ac48acbc56abf3fda115e5',uuid=7983ceaf-8ed3-4321-a242-2e44218f4d0b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "28ca935e-3c1c-47dc-8b10-d7a5cb602470", "address": "fa:16:3e:b8:5e:82", "network": {"id": "31e59f3e-dc25-4b00-9d87-4b4f695425b8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-220402675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f84b62d410cc448486b792e094464815", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28ca935e-3c", "ovs_interfaceid": "28ca935e-3c1c-47dc-8b10-d7a5cb602470", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-9f657f87-edf9-41d9-88ab-c868e7cddd4c tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Converting VIF {"id": "28ca935e-3c1c-47dc-8b10-d7a5cb602470", "address": "fa:16:3e:b8:5e:82", "network": {"id": "31e59f3e-dc25-4b00-9d87-4b4f695425b8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-220402675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f84b62d410cc448486b792e094464815", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28ca935e-3c", "ovs_interfaceid": "28ca935e-3c1c-47dc-8b10-d7a5cb602470", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-9f657f87-edf9-41d9-88ab-c868e7cddd4c tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:5e:82,bridge_name='br-int',has_traffic_filtering=True,id=28ca935e-3c1c-47dc-8b10-d7a5cb602470,network=Network(31e59f3e-dc25-4b00-9d87-4b4f695425b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28ca935e-3c') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG os_vif [None req-9f657f87-edf9-41d9-88ab-c868e7cddd4c tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:5e:82,bridge_name='br-int',has_traffic_filtering=True,id=28ca935e-3c1c-47dc-8b10-d7a5cb602470,network=Network(31e59f3e-dc25-4b00-9d87-4b4f695425b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28ca935e-3c') {{(pid=74190) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e917d1cd-4cd8-5b2a-b5b7-36a84cdfd8ce', '_type': 'linux-noop'}}, row=False) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap28ca935e-3c, may_exist=True, interface_attrs={}) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap28ca935e-3c, col_values=(('qos', UUID('0ee6cbcd-4019-4e0e-970c-8207dc0acc13')),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap28ca935e-3c, col_values=(('external_ids', {'iface-id': '28ca935e-3c1c-47dc-8b10-d7a5cb602470', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b8:5e:82', 'vm-uuid': '7983ceaf-8ed3-4321-a242-2e44218f4d0b'}),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ebf5bb1-ccd8-4e99-8992-5cd301dac23c]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:165db6bd-3792-416f-89e6-27b25a30b47c (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb710c79-3704-4368-9bbb-56cb0879ea00 (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e98bbb-99c3-458b-a038-65944d751301 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)
Oct 18 12:12:36 user nova-compute[74190]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28 (non-flash)
Oct 18 12:12:36 user nova-compute[74190]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf (non-flash)
Oct 18 12:12:36 user nova-compute[74190]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:165db6bd-3792-416f-89e6-27b25a30b47c (non-flash)
Oct 18 12:12:36 user nova-compute[74190]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb710c79-3704-4368-9bbb-56cb0879ea00 (non-flash)
Oct 18 12:12:36 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e98bbb-99c3-458b-a038-65944d751301 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)
Oct 18 12:12:36 user nova-compute[74190]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28 (non-flash)
Oct 18 12:12:36 user nova-compute[74190]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf (non-flash)
Oct 18 12:12:36 user nova-compute[74190]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:165db6bd-3792-416f-89e6-27b25a30b47c (non-flash)
Oct 18 12:12:36 user nova-compute[74190]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb710c79-3704-4368-9bbb-56cb0879ea00 (non-flash)
Oct 18 12:12:36 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d198be11-e2f2-4ef0-a745-a8e139d1ada1 -p 172.16.0.220:3260 --login {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:12:36 user nova-compute[74190]: INFO os_vif [None req-9f657f87-edf9-41d9-88ab-c868e7cddd4c tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:5e:82,bridge_name='br-int',has_traffic_filtering=True,id=28ca935e-3c1c-47dc-8b10-d7a5cb602470,network=Network(31e59f3e-dc25-4b00-9d87-4b4f695425b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28ca935e-3c')
Oct 18 12:12:36 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-9f657f87-edf9-41d9-88ab-c868e7cddd4c tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] No BDM found with device name vda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-9f657f87-edf9-41d9-88ab-c868e7cddd4c tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] No VIF found with MAC fa:16:3e:b8:5e:82, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d198be11-e2f2-4ef0-a745-a8e139d1ada1 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[53fd8595-fe6c-45a1-ac89-d2ce1247db4a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d198be11-e2f2-4ef0-a745-a8e139d1ada1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d198be11-e2f2-4ef0-a745-a8e139d1ada1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e98bbb-99c3-458b-a038-65944d751301 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d198be11-e2f2-4ef0-a745-a8e139d1ada1, portal: 172.16.0.220,3260]
Oct 18 12:12:36 user nova-compute[74190]: Login to [iface: default, target: iqn.2010-10.org.openstack:d198be11-e2f2-4ef0-a745-a8e139d1ada1, portal: 172.16.0.220,3260] successful.
Oct 18 12:12:36 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d198be11-e2f2-4ef0-a745-a8e139d1ada1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d198be11-e2f2-4ef0-a745-a8e139d1ada1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b5b0a70-0fbd-44c6-9001-76c8ca1fc74d]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e98bbb-99c3-458b-a038-65944d751301 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[43fdf895-8aa6-468d-8fdc-9ad9017fb61d]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:165db6bd-3792-416f-89e6-27b25a30b47c (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb710c79-3704-4368-9bbb-56cb0879ea00 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d198be11-e2f2-4ef0-a745-a8e139d1ada1 (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e98bbb-99c3-458b-a038-65944d751301 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)
Oct 18 12:12:36 user nova-compute[74190]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28 (non-flash)
Oct 18 12:12:36 user nova-compute[74190]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf (non-flash)
Oct 18 12:12:36 user nova-compute[74190]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:165db6bd-3792-416f-89e6-27b25a30b47c (non-flash)
Oct 18 12:12:36 user nova-compute[74190]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb710c79-3704-4368-9bbb-56cb0879ea00 (non-flash)
Oct 18 12:12:36 user nova-compute[74190]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d198be11-e2f2-4ef0-a745-a8e139d1ada1 (non-flash)
Oct 18 12:12:36 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e98bbb-99c3-458b-a038-65944d751301 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)
Oct 18 12:12:36 user nova-compute[74190]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28 (non-flash)
Oct 18 12:12:36 user nova-compute[74190]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf (non-flash)
Oct 18 12:12:36 user nova-compute[74190]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:165db6bd-3792-416f-89e6-27b25a30b47c (non-flash)
Oct 18 12:12:36 user nova-compute[74190]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb710c79-3704-4368-9bbb-56cb0879ea00 (non-flash)
Oct 18 12:12:36 user nova-compute[74190]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d198be11-e2f2-4ef0-a745-a8e139d1ada1 (non-flash)
Oct 18 12:12:36 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-f8e98bbb-99c3-458b-a038-65944d751301 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d198be11-e2f2-4ef0-a745-a8e139d1ada1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.416s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e98bbb-99c3-458b-a038-65944d751301 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Connected to 172.16.0.220:3260 {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-f8e98bbb-99c3-458b-a038-65944d751301 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] HCTL ('38', '-', '-', 0) found on session 51 with lun 0 {{(pid=74190) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-f8e98bbb-99c3-458b-a038-65944d751301 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74190) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[948d9d5e-fe99-4e06-9401-5050f65d40ea]: (4, ('- - 0', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-f8e98bbb-99c3-458b-a038-65944d751301 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Searching for a device in session 51 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74190) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e98bbb-99c3-458b-a038-65944d751301 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:d198be11-e2f2-4ef0-a745-a8e139d1ada1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AJRFfIGS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG nova.network.neutron [req-781eb745-3efa-46bf-b55e-a2e502512067 req-707f3b55-317e-4fa5-aa6a-9d5103e05ef8 service nova] [instance: 7983ceaf-8ed3-4321-a242-2e44218f4d0b] Updated VIF entry in instance network info cache for port 28ca935e-3c1c-47dc-8b10-d7a5cb602470. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG nova.network.neutron [req-781eb745-3efa-46bf-b55e-a2e502512067 req-707f3b55-317e-4fa5-aa6a-9d5103e05ef8 service nova] [instance: 7983ceaf-8ed3-4321-a242-2e44218f4d0b] Updating instance_info_cache with network_info: [{"id": "28ca935e-3c1c-47dc-8b10-d7a5cb602470", "address": "fa:16:3e:b8:5e:82", "network": {"id": "31e59f3e-dc25-4b00-9d87-4b4f695425b8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-220402675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f84b62d410cc448486b792e094464815", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28ca935e-3c", "ovs_interfaceid": "28ca935e-3c1c-47dc-8b10-d7a5cb602470", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:12:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-781eb745-3efa-46bf-b55e-a2e502512067 req-707f3b55-317e-4fa5-aa6a-9d5103e05ef8 service nova] Releasing lock "refresh_cache-7983ceaf-8ed3-4321-a242-2e44218f4d0b" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:12:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-f8e98bbb-99c3-458b-a038-65944d751301 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.457s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 12:12:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e98bbb-99c3-458b-a038-65944d751301 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] <== connect_volume: return (1459ms) {'type': 'block', 'scsi_wwn': '23035333238616466', 'path': '/dev/sdg'} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 12:12:37 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8e98bbb-99c3-458b-a038-65944d751301 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] [instance: 800d5074-2de1-44ce-8f4a-9a7f5ed110c0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23035333238616466', 'path': '/dev/sdg'} {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 12:12:37 user nova-compute[74190]: DEBUG nova.objects.instance [None req-f8e98bbb-99c3-458b-a038-65944d751301 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Lazy-loading 'flavor' on Instance uuid 800d5074-2de1-44ce-8f4a-9a7f5ed110c0 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:12:37 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-f8e98bbb-99c3-458b-a038-65944d751301 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] attach device xml: <disk type="block" device="disk">
Oct 18 12:12:37 user nova-compute[74190]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 12:12:37 user nova-compute[74190]:   <source dev="/dev/sdg"/>
Oct 18 12:12:37 user nova-compute[74190]:   <target dev="vdc" bus="virtio"/>
Oct 18 12:12:37 user nova-compute[74190]:   <serial>d198be11-e2f2-4ef0-a745-a8e139d1ada1</serial>
Oct 18 12:12:37 user nova-compute[74190]: </disk>
Oct 18 12:12:37 user nova-compute[74190]:  {{(pid=74190) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 18 12:12:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:12:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:12:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:12:37 user nova-compute[74190]: DEBUG nova.compute.manager [req-0ff490fc-68c8-4aa6-90ea-54c404cbb184 req-1921e885-9551-46e7-bf0f-94415ac0aefc service nova] [instance: 7983ceaf-8ed3-4321-a242-2e44218f4d0b] Received event network-vif-plugged-28ca935e-3c1c-47dc-8b10-d7a5cb602470 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:12:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-0ff490fc-68c8-4aa6-90ea-54c404cbb184 req-1921e885-9551-46e7-bf0f-94415ac0aefc service nova] Acquiring lock "7983ceaf-8ed3-4321-a242-2e44218f4d0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:12:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-0ff490fc-68c8-4aa6-90ea-54c404cbb184 req-1921e885-9551-46e7-bf0f-94415ac0aefc service nova] Lock "7983ceaf-8ed3-4321-a242-2e44218f4d0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:12:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-0ff490fc-68c8-4aa6-90ea-54c404cbb184 req-1921e885-9551-46e7-bf0f-94415ac0aefc service nova] Lock "7983ceaf-8ed3-4321-a242-2e44218f4d0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:12:37 user nova-compute[74190]: DEBUG nova.compute.manager [req-0ff490fc-68c8-4aa6-90ea-54c404cbb184 req-1921e885-9551-46e7-bf0f-94415ac0aefc service nova] [instance: 7983ceaf-8ed3-4321-a242-2e44218f4d0b] No waiting events found dispatching network-vif-plugged-28ca935e-3c1c-47dc-8b10-d7a5cb602470 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:12:37 user nova-compute[74190]: WARNING nova.compute.manager [req-0ff490fc-68c8-4aa6-90ea-54c404cbb184 req-1921e885-9551-46e7-bf0f-94415ac0aefc service nova] [instance: 7983ceaf-8ed3-4321-a242-2e44218f4d0b] Received unexpected event network-vif-plugged-28ca935e-3c1c-47dc-8b10-d7a5cb602470 for instance with vm_state building and task_state spawning.
Oct 18 12:12:38 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-f8e98bbb-99c3-458b-a038-65944d751301 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] No BDM found with device name vda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 12:12:38 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-f8e98bbb-99c3-458b-a038-65944d751301 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 12:12:38 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-f8e98bbb-99c3-458b-a038-65944d751301 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 12:12:38 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-f8e98bbb-99c3-458b-a038-65944d751301 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] No VIF found with MAC fa:16:3e:36:22:ee, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 12:12:38 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-f8e98bbb-99c3-458b-a038-65944d751301 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Lock "800d5074-2de1-44ce-8f4a-9a7f5ed110c0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.041s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:12:38 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:12:38 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:12:38 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:12:38 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:12:39 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-1b51f0a9-ab2d-4673-bf6b-3103000965dc tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Acquiring lock "800d5074-2de1-44ce-8f4a-9a7f5ed110c0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:12:39 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-1b51f0a9-ab2d-4673-bf6b-3103000965dc tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Lock "800d5074-2de1-44ce-8f4a-9a7f5ed110c0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:12:39 user nova-compute[74190]: INFO nova.compute.manager [None req-1b51f0a9-ab2d-4673-bf6b-3103000965dc tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] [instance: 800d5074-2de1-44ce-8f4a-9a7f5ed110c0] Detaching volume d198be11-e2f2-4ef0-a745-a8e139d1ada1
Oct 18 12:12:39 user nova-compute[74190]: INFO nova.virt.block_device [None req-1b51f0a9-ab2d-4673-bf6b-3103000965dc tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] [instance: 800d5074-2de1-44ce-8f4a-9a7f5ed110c0] Attempting to driver detach volume d198be11-e2f2-4ef0-a745-a8e139d1ada1 from mountpoint /dev/vdc
Oct 18 12:12:39 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-1b51f0a9-ab2d-4673-bf6b-3103000965dc tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Attempting to detach device vdc from instance 800d5074-2de1-44ce-8f4a-9a7f5ed110c0 from the persistent domain config. {{(pid=74190) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 18 12:12:39 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-1b51f0a9-ab2d-4673-bf6b-3103000965dc tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 12:12:39 user nova-compute[74190]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 12:12:39 user nova-compute[74190]:   <source dev="/dev/sdg"/>
Oct 18 12:12:39 user nova-compute[74190]:   <target dev="vdc" bus="virtio"/>
Oct 18 12:12:39 user nova-compute[74190]:   <serial>d198be11-e2f2-4ef0-a745-a8e139d1ada1</serial>
Oct 18 12:12:39 user nova-compute[74190]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 18 12:12:39 user nova-compute[74190]: </disk>
Oct 18 12:12:39 user nova-compute[74190]:  {{(pid=74190) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 12:12:39 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-1b51f0a9-ab2d-4673-bf6b-3103000965dc tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Successfully detached device vdc from instance 800d5074-2de1-44ce-8f4a-9a7f5ed110c0 from the persistent domain config.
Oct 18 12:12:39 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-1b51f0a9-ab2d-4673-bf6b-3103000965dc tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 800d5074-2de1-44ce-8f4a-9a7f5ed110c0 from the live domain config. {{(pid=74190) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 18 12:12:39 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-1b51f0a9-ab2d-4673-bf6b-3103000965dc tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 12:12:39 user nova-compute[74190]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 12:12:39 user nova-compute[74190]:   <source dev="/dev/sdg"/>
Oct 18 12:12:39 user nova-compute[74190]:   <target dev="vdc" bus="virtio"/>
Oct 18 12:12:39 user nova-compute[74190]:   <serial>d198be11-e2f2-4ef0-a745-a8e139d1ada1</serial>
Oct 18 12:12:39 user nova-compute[74190]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 18 12:12:39 user nova-compute[74190]: </disk>
Oct 18 12:12:39 user nova-compute[74190]:  {{(pid=74190) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 12:12:39 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-1b51f0a9-ab2d-4673-bf6b-3103000965dc tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 800d5074-2de1-44ce-8f4a-9a7f5ed110c0 {{(pid=74190) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 18 12:12:39 user nova-compute[74190]: DEBUG nova.compute.manager [req-8c5af9e0-b8b9-4ff2-83f5-5d60a23b9b67 req-69e89c89-2f8c-4cd2-8ca9-72338a284003 service nova] [instance: 7983ceaf-8ed3-4321-a242-2e44218f4d0b] Received event network-vif-plugged-28ca935e-3c1c-47dc-8b10-d7a5cb602470 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:12:39 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-8c5af9e0-b8b9-4ff2-83f5-5d60a23b9b67 req-69e89c89-2f8c-4cd2-8ca9-72338a284003 service nova] Acquiring lock "7983ceaf-8ed3-4321-a242-2e44218f4d0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:12:40 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-8c5af9e0-b8b9-4ff2-83f5-5d60a23b9b67 req-69e89c89-2f8c-4cd2-8ca9-72338a284003 service nova] Lock "7983ceaf-8ed3-4321-a242-2e44218f4d0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:12:40 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-8c5af9e0-b8b9-4ff2-83f5-5d60a23b9b67 req-69e89c89-2f8c-4cd2-8ca9-72338a284003 service nova] Lock "7983ceaf-8ed3-4321-a242-2e44218f4d0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:12:40 user nova-compute[74190]: DEBUG nova.compute.manager [req-8c5af9e0-b8b9-4ff2-83f5-5d60a23b9b67 req-69e89c89-2f8c-4cd2-8ca9-72338a284003 service nova] [instance: 7983ceaf-8ed3-4321-a242-2e44218f4d0b] No waiting events found dispatching network-vif-plugged-28ca935e-3c1c-47dc-8b10-d7a5cb602470 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:12:40 user nova-compute[74190]: WARNING nova.compute.manager [req-8c5af9e0-b8b9-4ff2-83f5-5d60a23b9b67 req-69e89c89-2f8c-4cd2-8ca9-72338a284003 service nova] [instance: 7983ceaf-8ed3-4321-a242-2e44218f4d0b] Received unexpected event network-vif-plugged-28ca935e-3c1c-47dc-8b10-d7a5cb602470 for instance with vm_state building and task_state spawning.
Oct 18 12:12:40 user nova-compute[74190]: DEBUG nova.compute.manager [None req-9f657f87-edf9-41d9-88ab-c868e7cddd4c tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] [instance: 7983ceaf-8ed3-4321-a242-2e44218f4d0b] Instance event wait completed in 0 seconds for  {{(pid=74190) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 12:12:40 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-9f657f87-edf9-41d9-88ab-c868e7cddd4c tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] [instance: 7983ceaf-8ed3-4321-a242-2e44218f4d0b] Guest created on hypervisor {{(pid=74190) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 12:12:40 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 7983ceaf-8ed3-4321-a242-2e44218f4d0b] Instance spawned successfully.
Oct 18 12:12:40 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-9f657f87-edf9-41d9-88ab-c868e7cddd4c tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] [instance: 7983ceaf-8ed3-4321-a242-2e44218f4d0b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 12:12:40 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-9f657f87-edf9-41d9-88ab-c868e7cddd4c tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] [instance: 7983ceaf-8ed3-4321-a242-2e44218f4d0b] Found default for hw_cdrom_bus of ide {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:12:40 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-9f657f87-edf9-41d9-88ab-c868e7cddd4c tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] [instance: 7983ceaf-8ed3-4321-a242-2e44218f4d0b] Found default for hw_disk_bus of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:12:40 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-9f657f87-edf9-41d9-88ab-c868e7cddd4c tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] [instance: 7983ceaf-8ed3-4321-a242-2e44218f4d0b] Found default for hw_input_bus of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:12:40 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-9f657f87-edf9-41d9-88ab-c868e7cddd4c tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] [instance: 7983ceaf-8ed3-4321-a242-2e44218f4d0b] Found default for hw_pointer_model of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:12:40 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-9f657f87-edf9-41d9-88ab-c868e7cddd4c tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] [instance: 7983ceaf-8ed3-4321-a242-2e44218f4d0b] Found default for hw_video_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:12:40 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-9f657f87-edf9-41d9-88ab-c868e7cddd4c tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] [instance: 7983ceaf-8ed3-4321-a242-2e44218f4d0b] Found default for hw_vif_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:12:40 user nova-compute[74190]: INFO nova.compute.manager [None req-9f657f87-edf9-41d9-88ab-c868e7cddd4c tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] [instance: 7983ceaf-8ed3-4321-a242-2e44218f4d0b] Took 5.94 seconds to spawn the instance on the hypervisor.
Oct 18 12:12:40 user nova-compute[74190]: DEBUG nova.compute.manager [None req-9f657f87-edf9-41d9-88ab-c868e7cddd4c tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] [instance: 7983ceaf-8ed3-4321-a242-2e44218f4d0b] Checking state {{(pid=74190) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 12:12:40 user nova-compute[74190]: INFO nova.compute.manager [None req-9f657f87-edf9-41d9-88ab-c868e7cddd4c tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] [instance: 7983ceaf-8ed3-4321-a242-2e44218f4d0b] Took 6.73 seconds to build instance.
Oct 18 12:12:40 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9f657f87-edf9-41d9-88ab-c868e7cddd4c tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Lock "7983ceaf-8ed3-4321-a242-2e44218f4d0b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.861s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:12:40 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:12:41 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:12:45 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:12:46 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:12:50 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:12:51 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:12:55 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:12:56 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:12:59 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-1b51f0a9-ab2d-4673-bf6b-3103000965dc tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 800d5074-2de1-44ce-8f4a-9a7f5ed110c0 is timed out.
Oct 18 12:12:59 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-1b51f0a9-ab2d-4673-bf6b-3103000965dc tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Successfully detached device vdc from instance 800d5074-2de1-44ce-8f4a-9a7f5ed110c0 from the live domain config.
Oct 18 12:12:59 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b51f0a9-ab2d-4673-bf6b-3103000965dc tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] [instance: 800d5074-2de1-44ce-8f4a-9a7f5ed110c0] calling os-brick to detach iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 12:12:59 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b51f0a9-ab2d-4673-bf6b-3103000965dc tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, {'target_iqn': 'iqn.2010-10.org.openstack:d198be11-e2f2-4ef0-a745-a8e139d1ada1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AJRFfIGS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 12:12:59 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-1b51f0a9-ab2d-4673-bf6b-3103000965dc tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 12:12:59 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-1b51f0a9-ab2d-4673-bf6b-3103000965dc tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 12:12:59 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-1b51f0a9-ab2d-4673-bf6b-3103000965dc tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 12:12:59 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:12:59 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:12:59 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d7e41a4-564c-4b96-9a52-de33de3d7798]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:eb710c79-3704-4368-9bbb-56cb0879ea00\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:165db6bd-3792-416f-89e6-27b25a30b47c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d198be11-e2f2-4ef0-a745-a8e139d1ada1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:12:59 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b51f0a9-ab2d-4673-bf6b-3103000965dc tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 12:12:59 user nova-compute[74190]: No targets found.
Oct 18 12:12:59 user nova-compute[74190]: iSNS:
Oct 18 12:12:59 user nova-compute[74190]: No targets found.
Oct 18 12:12:59 user nova-compute[74190]: STATIC:
Oct 18 12:12:59 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:eb710c79-3704-4368-9bbb-56cb0879ea00
Oct 18 12:12:59 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 12:12:59 user nova-compute[74190]:                 Iface Name: default
Oct 18 12:12:59 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf
Oct 18 12:12:59 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 12:12:59 user nova-compute[74190]:                 Iface Name: default
Oct 18 12:12:59 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f
Oct 18 12:12:59 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 12:12:59 user nova-compute[74190]:                 Iface Name: default
Oct 18 12:12:59 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:165db6bd-3792-416f-89e6-27b25a30b47c
Oct 18 12:12:59 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 12:12:59 user nova-compute[74190]:                 Iface Name: default
Oct 18 12:12:59 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:d198be11-e2f2-4ef0-a745-a8e139d1ada1
Oct 18 12:12:59 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 12:12:59 user nova-compute[74190]:                 Iface Name: default
Oct 18 12:12:59 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28
Oct 18 12:12:59 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 12:12:59 user nova-compute[74190]:                 Iface Name: default
Oct 18 12:12:59 user nova-compute[74190]: FIRMWARE:
Oct 18 12:12:59 user nova-compute[74190]: No targets found.
Oct 18 12:12:59 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 12:12:59 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b51f0a9-ab2d-4673-bf6b-3103000965dc tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 12:12:59 user nova-compute[74190]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 12:12:59 user nova-compute[74190]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74190) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 12:12:59 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b51f0a9-ab2d-4673-bf6b-3103000965dc tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d198be11-e2f2-4ef0-a745-a8e139d1ada1', 0)] {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 12:12:59 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:12:59 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:12:59 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[ade461bd-0637-4265-bebd-aac90de68a1d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:165db6bd-3792-416f-89e6-27b25a30b47c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d198be11-e2f2-4ef0-a745-a8e139d1ada1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb710c79-3704-4368-9bbb-56cb0879ea00\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:12:59 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:12:59 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:12:59 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb89e149-377e-4e3e-bad4-d99b0a2a00ea]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:165db6bd-3792-416f-89e6-27b25a30b47c (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb710c79-3704-4368-9bbb-56cb0879ea00 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d198be11-e2f2-4ef0-a745-a8e139d1ada1 (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:12:59 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b51f0a9-ab2d-4673-bf6b-3103000965dc tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)
Oct 18 12:12:59 user nova-compute[74190]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28 (non-flash)
Oct 18 12:12:59 user nova-compute[74190]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf (non-flash)
Oct 18 12:12:59 user nova-compute[74190]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:165db6bd-3792-416f-89e6-27b25a30b47c (non-flash)
Oct 18 12:12:59 user nova-compute[74190]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb710c79-3704-4368-9bbb-56cb0879ea00 (non-flash)
Oct 18 12:12:59 user nova-compute[74190]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d198be11-e2f2-4ef0-a745-a8e139d1ada1 (non-flash)
Oct 18 12:12:59 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 12:12:59 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b51f0a9-ab2d-4673-bf6b-3103000965dc tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)
Oct 18 12:12:59 user nova-compute[74190]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28 (non-flash)
Oct 18 12:12:59 user nova-compute[74190]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf (non-flash)
Oct 18 12:12:59 user nova-compute[74190]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:165db6bd-3792-416f-89e6-27b25a30b47c (non-flash)
Oct 18 12:12:59 user nova-compute[74190]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb710c79-3704-4368-9bbb-56cb0879ea00 (non-flash)
Oct 18 12:12:59 user nova-compute[74190]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d198be11-e2f2-4ef0-a745-a8e139d1ada1 (non-flash)
Oct 18 12:12:59 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 12:12:59 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b51f0a9-ab2d-4673-bf6b-3103000965dc tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1f44404af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d198be11-e2f2-4ef0-a745-a8e139d1ada1'): ({'sdg'}, set())}) {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 12:12:59 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-1b51f0a9-ab2d-4673-bf6b-3103000965dc tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Removing single pathed devices sdg {{(pid=74190) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 12:12:59 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:12:59 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:12:59 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[89d68ffd-db41-4a85-94ca-2b400a28d3ae]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:12:59 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:12:59 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:12:59 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f7b5b31-1303-4ffc-9445-cc31543cf2b9]: (4, ('ok\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:12:59 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-1b51f0a9-ab2d-4673-bf6b-3103000965dc tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Flushing IO for device /dev/sdg {{(pid=74190) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 12:12:59 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:12:59 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:12:59 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a55933-b31f-4bf4-ac1b-6e48dc583622]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:12:59 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-1b51f0a9-ab2d-4673-bf6b-3103000965dc tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74190) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 12:12:59 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:12:59 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.055s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:12:59 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4ffc4a9-5da6-4962-8289-7c420b701d9f]: (4, ('1', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:12:59 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-1b51f0a9-ab2d-4673-bf6b-3103000965dc tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 12:12:59 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-1b51f0a9-ab2d-4673-bf6b-3103000965dc tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] SCSI volumes sdg have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 12:12:59 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b51f0a9-ab2d-4673-bf6b-3103000965dc tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d198be11-e2f2-4ef0-a745-a8e139d1ada1')] {{(pid=74190) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 12:12:59 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d198be11-e2f2-4ef0-a745-a8e139d1ada1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:12:59 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d198be11-e2f2-4ef0-a745-a8e139d1ada1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:12:59 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e5aed4-467d-4243-bafe-834441f019e3]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:12:59 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b51f0a9-ab2d-4673-bf6b-3103000965dc tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:12:59 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d198be11-e2f2-4ef0-a745-a8e139d1ada1 -p 172.16.0.220:3260 --logout {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:12:59 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d198be11-e2f2-4ef0-a745-a8e139d1ada1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:12:59 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7dcdca2-1411-4102-9dd7-a8e1da296a95]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:d198be11-e2f2-4ef0-a745-a8e139d1ada1, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:d198be11-e2f2-4ef0-a745-a8e139d1ada1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:12:59 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b51f0a9-ab2d-4673-bf6b-3103000965dc tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:d198be11-e2f2-4ef0-a745-a8e139d1ada1, portal: 172.16.0.220,3260]
Oct 18 12:12:59 user nova-compute[74190]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:d198be11-e2f2-4ef0-a745-a8e139d1ada1, portal: 172.16.0.220,3260] successful.
Oct 18 12:12:59 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:12:59 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d198be11-e2f2-4ef0-a745-a8e139d1ada1 -p 172.16.0.220:3260 --op delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:12:59 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d198be11-e2f2-4ef0-a745-a8e139d1ada1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:12:59 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e025f5-1607-434d-b0cf-a56ff7066ace]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:12:59 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b51f0a9-ab2d-4673-bf6b-3103000965dc tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:12:59 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-1b51f0a9-ab2d-4673-bf6b-3103000965dc tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 12:12:59 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b51f0a9-ab2d-4673-bf6b-3103000965dc tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] <== disconnect_volume: return (341ms) None {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 12:12:59 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b51f0a9-ab2d-4673-bf6b-3103000965dc tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] [instance: 800d5074-2de1-44ce-8f4a-9a7f5ed110c0] Disconnected iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 12:13:00 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:13:00 user nova-compute[74190]: DEBUG nova.objects.instance [None req-1b51f0a9-ab2d-4673-bf6b-3103000965dc tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Lazy-loading 'flavor' on Instance uuid 800d5074-2de1-44ce-8f4a-9a7f5ed110c0 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:13:00 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-1b51f0a9-ab2d-4673-bf6b-3103000965dc tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Lock "800d5074-2de1-44ce-8f4a-9a7f5ed110c0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.814s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:13:01 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:13:05 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:13:06 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:13:10 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:13:11 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:13:13 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:13:14 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:13:16 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:13:18 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:13:20 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:13:21 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:13:22 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:13:22 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Starting heal instance info cache {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 12:13:22 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "refresh_cache-0382820d-a678-4593-85df-168f42fc4ce4" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:13:22 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquired lock "refresh_cache-0382820d-a678-4593-85df-168f42fc4ce4" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:13:22 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Forcefully refreshing network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 18 12:13:22 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Updating instance_info_cache with network_info: [{"id": "a32b81a2-7b02-48ed-9550-d392be5e221e", "address": "fa:16:3e:e7:d8:e5", "network": {"id": "c2dbbd24-f1d2-47a2-835f-0f9b24b585f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-920140900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d994366010142519ff367fa7ca77e61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa32b81a2-7b", "ovs_interfaceid": "a32b81a2-7b02-48ed-9550-d392be5e221e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:13:22 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Releasing lock "refresh_cache-0382820d-a678-4593-85df-168f42fc4ce4" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:13:22 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Updated the network info_cache for instance {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 18 12:13:22 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:13:22 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:13:22 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:13:22 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:13:22 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:13:22 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:13:22 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Auditing locally available compute resources for user (node: user) {{(pid=74190) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 12:13:22 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1e27a16-43e4-4e80-9c0a-5c2dce06daae/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:13:22 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1e27a16-43e4-4e80-9c0a-5c2dce06daae/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:13:22 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1e27a16-43e4-4e80-9c0a-5c2dce06daae/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:13:23 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1e27a16-43e4-4e80-9c0a-5c2dce06daae/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:13:23 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/800d5074-2de1-44ce-8f4a-9a7f5ed110c0/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:13:23 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/800d5074-2de1-44ce-8f4a-9a7f5ed110c0/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:13:23 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/800d5074-2de1-44ce-8f4a-9a7f5ed110c0/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:13:23 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/800d5074-2de1-44ce-8f4a-9a7f5ed110c0/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:13:23 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 12:13:23 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:13:23 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:13:23 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:13:23 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:13:23 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 12:13:23 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 12:13:23 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 12:13:23 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7983ceaf-8ed3-4321-a242-2e44218f4d0b/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:13:24 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7983ceaf-8ed3-4321-a242-2e44218f4d0b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:13:24 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7983ceaf-8ed3-4321-a242-2e44218f4d0b/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:13:24 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7983ceaf-8ed3-4321-a242-2e44218f4d0b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:13:24 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 12:13:24 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:13:24 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:13:24 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Hypervisor/Node resource view: name=user free_ram=8034MB free_disk=24.983619689941406GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74190) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 12:13:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:13:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:13:24 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 772b126c-2148-4ca8-90f2-69d6eb4b7db7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:13:24 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 0382820d-a678-4593-85df-168f42fc4ce4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:13:24 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance b1e27a16-43e4-4e80-9c0a-5c2dce06daae actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:13:24 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 5861a219-456a-43dd-898c-a99ed3051d83 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:13:24 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 7c539213-358a-48fd-9abd-1f017ba5b54a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:13:24 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 800d5074-2de1-44ce-8f4a-9a7f5ed110c0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:13:24 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 1aa9f158-c064-4e24-9571-6a3d37e07d51 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:13:24 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 7983ceaf-8ed3-4321-a242-2e44218f4d0b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:13:24 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 12:13:24 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 12:13:24 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Refreshing inventories for resource provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 18 12:13:24 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Updating ProviderTree inventory for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 18 12:13:24 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Updating inventory in ProviderTree for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 18 12:13:24 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Refreshing aggregate associations for resource provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66, aggregates: None {{(pid=74190) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 18 12:13:24 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Refreshing trait associations for resource provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66, traits: COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE42,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_ACCELERATORS,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=74190) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 18 12:13:25 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 12:13:25 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 12:13:25 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Compute_service record updated for user:user {{(pid=74190) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 12:13:25 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.527s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:13:25 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:13:25 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:13:25 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74190) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 12:13:26 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:13:27 user nova-compute[74190]: DEBUG nova.compute.manager [req-2ab1d456-02ed-4469-8df7-abaa3f1367f8 req-aabe19b4-a7c1-4b67-b076-9b5b682fca04 service nova] [instance: 1aa9f158-c064-4e24-9571-6a3d37e07d51] Received event network-changed-440e943e-ccff-4254-981d-7d39a450c6a2 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:13:27 user nova-compute[74190]: DEBUG nova.compute.manager [req-2ab1d456-02ed-4469-8df7-abaa3f1367f8 req-aabe19b4-a7c1-4b67-b076-9b5b682fca04 service nova] [instance: 1aa9f158-c064-4e24-9571-6a3d37e07d51] Refreshing instance network info cache due to event network-changed-440e943e-ccff-4254-981d-7d39a450c6a2. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 12:13:27 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-2ab1d456-02ed-4469-8df7-abaa3f1367f8 req-aabe19b4-a7c1-4b67-b076-9b5b682fca04 service nova] Acquiring lock "refresh_cache-1aa9f158-c064-4e24-9571-6a3d37e07d51" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:13:27 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-2ab1d456-02ed-4469-8df7-abaa3f1367f8 req-aabe19b4-a7c1-4b67-b076-9b5b682fca04 service nova] Acquired lock "refresh_cache-1aa9f158-c064-4e24-9571-6a3d37e07d51" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:13:27 user nova-compute[74190]: DEBUG nova.network.neutron [req-2ab1d456-02ed-4469-8df7-abaa3f1367f8 req-aabe19b4-a7c1-4b67-b076-9b5b682fca04 service nova] [instance: 1aa9f158-c064-4e24-9571-6a3d37e07d51] Refreshing network info cache for port 440e943e-ccff-4254-981d-7d39a450c6a2 {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 12:13:28 user nova-compute[74190]: DEBUG nova.network.neutron [req-2ab1d456-02ed-4469-8df7-abaa3f1367f8 req-aabe19b4-a7c1-4b67-b076-9b5b682fca04 service nova] [instance: 1aa9f158-c064-4e24-9571-6a3d37e07d51] Updated VIF entry in instance network info cache for port 440e943e-ccff-4254-981d-7d39a450c6a2. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 12:13:28 user nova-compute[74190]: DEBUG nova.network.neutron [req-2ab1d456-02ed-4469-8df7-abaa3f1367f8 req-aabe19b4-a7c1-4b67-b076-9b5b682fca04 service nova] [instance: 1aa9f158-c064-4e24-9571-6a3d37e07d51] Updating instance_info_cache with network_info: [{"id": "440e943e-ccff-4254-981d-7d39a450c6a2", "address": "fa:16:3e:9b:f5:fc", "network": {"id": "aa827f81-b165-444f-89cc-f21c42a9f772", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1659902586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e375153f6f24827811c5825fc2a2c6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap440e943e-cc", "ovs_interfaceid": "440e943e-ccff-4254-981d-7d39a450c6a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:13:28 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-2ab1d456-02ed-4469-8df7-abaa3f1367f8 req-aabe19b4-a7c1-4b67-b076-9b5b682fca04 service nova] Releasing lock "refresh_cache-1aa9f158-c064-4e24-9571-6a3d37e07d51" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:13:28 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-e504f94d-0880-455c-9c37-e764a6f85f38 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Acquiring lock "1aa9f158-c064-4e24-9571-6a3d37e07d51" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:13:28 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-e504f94d-0880-455c-9c37-e764a6f85f38 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "1aa9f158-c064-4e24-9571-6a3d37e07d51" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:13:28 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-e504f94d-0880-455c-9c37-e764a6f85f38 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Acquiring lock "1aa9f158-c064-4e24-9571-6a3d37e07d51-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:13:28 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-e504f94d-0880-455c-9c37-e764a6f85f38 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "1aa9f158-c064-4e24-9571-6a3d37e07d51-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:13:28 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-e504f94d-0880-455c-9c37-e764a6f85f38 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "1aa9f158-c064-4e24-9571-6a3d37e07d51-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:13:28 user nova-compute[74190]: INFO nova.compute.manager [None req-e504f94d-0880-455c-9c37-e764a6f85f38 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 1aa9f158-c064-4e24-9571-6a3d37e07d51] Terminating instance
Oct 18 12:13:28 user nova-compute[74190]: DEBUG nova.compute.manager [None req-e504f94d-0880-455c-9c37-e764a6f85f38 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 1aa9f158-c064-4e24-9571-6a3d37e07d51] Start destroying the instance on the hypervisor. {{(pid=74190) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 12:13:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:13:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:13:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:13:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:13:29 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 1aa9f158-c064-4e24-9571-6a3d37e07d51] Instance destroyed successfully.
Oct 18 12:13:29 user nova-compute[74190]: DEBUG nova.objects.instance [None req-e504f94d-0880-455c-9c37-e764a6f85f38 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lazy-loading 'resources' on Instance uuid 1aa9f158-c064-4e24-9571-6a3d37e07d51 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:13:29 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-e504f94d-0880-455c-9c37-e764a6f85f38 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T12:11:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-200121657',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-200121657',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-200121657',id=43,image_ref='81ad5b32-c1c9-4f98-87a7-eadc05b4a0d8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCI1D5nc+L7xscfoMzzzJRKhT+YMLcETOROCO5w9Bvr/TGswmcq5qwFFsi/881Dq+xLdQRrGREI7ckYY7nwdAmGy1NlMhSeu/Frg99qLXce5aHQvK4dns5JUOw1OOAWRkA==',key_name='tempest-keypair-1169132032',keypairs=<?>,launch_index=0,launched_at=2023-10-18T12:12:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1e375153f6f24827811c5825fc2a2c6a',ramdisk_id='',reservation_id='r-fd05a0c9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1157442382',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1157442382-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1157442382',owner_user_name='tempest-TestVolumeBootPattern-1157442382-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T12:12:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27d9fc244d0f4e10a43b7df4dc8e30ad',uuid=1aa9f158-c064-4e24-9571-6a3d37e07d51,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "440e943e-ccff-4254-981d-7d39a450c6a2", "address": "fa:16:3e:9b:f5:fc", "network": {"id": "aa827f81-b165-444f-89cc-f21c42a9f772", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1659902586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e375153f6f24827811c5825fc2a2c6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap440e943e-cc", "ovs_interfaceid": "440e943e-ccff-4254-981d-7d39a450c6a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 12:13:29 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-e504f94d-0880-455c-9c37-e764a6f85f38 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Converting VIF {"id": "440e943e-ccff-4254-981d-7d39a450c6a2", "address": "fa:16:3e:9b:f5:fc", "network": {"id": "aa827f81-b165-444f-89cc-f21c42a9f772", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1659902586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e375153f6f24827811c5825fc2a2c6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap440e943e-cc", "ovs_interfaceid": "440e943e-ccff-4254-981d-7d39a450c6a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 12:13:29 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-e504f94d-0880-455c-9c37-e764a6f85f38 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:f5:fc,bridge_name='br-int',has_traffic_filtering=True,id=440e943e-ccff-4254-981d-7d39a450c6a2,network=Network(aa827f81-b165-444f-89cc-f21c42a9f772),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap440e943e-cc') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 12:13:29 user nova-compute[74190]: DEBUG os_vif [None req-e504f94d-0880-455c-9c37-e764a6f85f38 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:f5:fc,bridge_name='br-int',has_traffic_filtering=True,id=440e943e-ccff-4254-981d-7d39a450c6a2,network=Network(aa827f81-b165-444f-89cc-f21c42a9f772),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap440e943e-cc') {{(pid=74190) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 12:13:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:13:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap440e943e-cc, bridge=br-int, if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:13:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:13:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:13:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:13:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=27c96900-6af6-4e14-9492-64b83c16099b) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:13:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:13:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:13:29 user nova-compute[74190]: INFO os_vif [None req-e504f94d-0880-455c-9c37-e764a6f85f38 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:f5:fc,bridge_name='br-int',has_traffic_filtering=True,id=440e943e-ccff-4254-981d-7d39a450c6a2,network=Network(aa827f81-b165-444f-89cc-f21c42a9f772),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap440e943e-cc')
Oct 18 12:13:29 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e504f94d-0880-455c-9c37-e764a6f85f38 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 1aa9f158-c064-4e24-9571-6a3d37e07d51] calling os-brick to detach iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 12:13:29 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-e504f94d-0880-455c-9c37-e764a6f85f38 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, {'target_iqn': 'iqn.2010-10.org.openstack:165db6bd-3792-416f-89e6-27b25a30b47c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xaqrGLDR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 12:13:29 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-e504f94d-0880-455c-9c37-e764a6f85f38 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 12:13:29 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-e504f94d-0880-455c-9c37-e764a6f85f38 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 12:13:29 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-e504f94d-0880-455c-9c37-e764a6f85f38 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 12:13:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:13:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:13:29 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[671cf00c-3567-4723-aee3-b04462457a9a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:eb710c79-3704-4368-9bbb-56cb0879ea00\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:165db6bd-3792-416f-89e6-27b25a30b47c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:13:29 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-e504f94d-0880-455c-9c37-e764a6f85f38 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 12:13:29 user nova-compute[74190]: No targets found.
Oct 18 12:13:29 user nova-compute[74190]: iSNS:
Oct 18 12:13:29 user nova-compute[74190]: No targets found.
Oct 18 12:13:29 user nova-compute[74190]: STATIC:
Oct 18 12:13:29 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:eb710c79-3704-4368-9bbb-56cb0879ea00
Oct 18 12:13:29 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 12:13:29 user nova-compute[74190]:                 Iface Name: default
Oct 18 12:13:29 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf
Oct 18 12:13:29 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 12:13:29 user nova-compute[74190]:                 Iface Name: default
Oct 18 12:13:29 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f
Oct 18 12:13:29 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 12:13:29 user nova-compute[74190]:                 Iface Name: default
Oct 18 12:13:29 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:165db6bd-3792-416f-89e6-27b25a30b47c
Oct 18 12:13:29 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 12:13:29 user nova-compute[74190]:                 Iface Name: default
Oct 18 12:13:29 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28
Oct 18 12:13:29 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 12:13:29 user nova-compute[74190]:                 Iface Name: default
Oct 18 12:13:29 user nova-compute[74190]: FIRMWARE:
Oct 18 12:13:29 user nova-compute[74190]: No targets found.
Oct 18 12:13:29 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 12:13:29 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-e504f94d-0880-455c-9c37-e764a6f85f38 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 12:13:29 user nova-compute[74190]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 12:13:29 user nova-compute[74190]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74190) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 12:13:29 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-e504f94d-0880-455c-9c37-e764a6f85f38 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:165db6bd-3792-416f-89e6-27b25a30b47c', 0)] {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 12:13:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:13:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:13:29 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[34773931-eacb-4419-a442-8c2accc26905]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:165db6bd-3792-416f-89e6-27b25a30b47c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb710c79-3704-4368-9bbb-56cb0879ea00\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:13:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:13:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:13:29 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe72795b-03c8-4f32-9e96-6145981de45c]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:165db6bd-3792-416f-89e6-27b25a30b47c (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb710c79-3704-4368-9bbb-56cb0879ea00 (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:13:29 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-e504f94d-0880-455c-9c37-e764a6f85f38 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)
Oct 18 12:13:29 user nova-compute[74190]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28 (non-flash)
Oct 18 12:13:29 user nova-compute[74190]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf (non-flash)
Oct 18 12:13:29 user nova-compute[74190]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:165db6bd-3792-416f-89e6-27b25a30b47c (non-flash)
Oct 18 12:13:29 user nova-compute[74190]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb710c79-3704-4368-9bbb-56cb0879ea00 (non-flash)
Oct 18 12:13:29 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 12:13:29 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-e504f94d-0880-455c-9c37-e764a6f85f38 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)
Oct 18 12:13:29 user nova-compute[74190]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28 (non-flash)
Oct 18 12:13:29 user nova-compute[74190]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf (non-flash)
Oct 18 12:13:29 user nova-compute[74190]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:165db6bd-3792-416f-89e6-27b25a30b47c (non-flash)
Oct 18 12:13:29 user nova-compute[74190]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb710c79-3704-4368-9bbb-56cb0879ea00 (non-flash)
Oct 18 12:13:29 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 12:13:29 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-e504f94d-0880-455c-9c37-e764a6f85f38 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1f44404a60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:165db6bd-3792-416f-89e6-27b25a30b47c'): ({'sdc'}, set())}) {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 12:13:29 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-e504f94d-0880-455c-9c37-e764a6f85f38 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Removing single pathed devices sdc {{(pid=74190) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 12:13:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:13:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:13:29 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ffa900b-7a65-4814-bba3-4e51d5ec2782]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:13:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:13:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:13:29 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5998fe0-a7ef-4a0f-b0e0-8d03f8609f13]: (4, ('ok\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:13:29 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-e504f94d-0880-455c-9c37-e764a6f85f38 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Flushing IO for device /dev/sdc {{(pid=74190) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 12:13:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:13:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:13:29 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a11bb43-0f8e-4739-9f06-95ab02b79466]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:13:29 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-e504f94d-0880-455c-9c37-e764a6f85f38 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74190) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 12:13:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:13:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:13:29 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f78f6a-aab0-47b1-bb2c-7145870aa8f9]: (4, ('1', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:13:29 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-e504f94d-0880-455c-9c37-e764a6f85f38 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 12:13:29 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-e504f94d-0880-455c-9c37-e764a6f85f38 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] SCSI volumes sdc have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 12:13:29 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-e504f94d-0880-455c-9c37-e764a6f85f38 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:165db6bd-3792-416f-89e6-27b25a30b47c')] {{(pid=74190) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 12:13:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:165db6bd-3792-416f-89e6-27b25a30b47c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:13:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:165db6bd-3792-416f-89e6-27b25a30b47c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:13:29 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c993cc-c1ff-4301-8782-dd2cbdbef68b]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:13:29 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-e504f94d-0880-455c-9c37-e764a6f85f38 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:13:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:165db6bd-3792-416f-89e6-27b25a30b47c -p 172.16.0.220:3260 --logout {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:13:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:165db6bd-3792-416f-89e6-27b25a30b47c -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:13:29 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c4aa128-650e-4695-8ae8-f08ee39aaa7c]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:165db6bd-3792-416f-89e6-27b25a30b47c, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:165db6bd-3792-416f-89e6-27b25a30b47c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:13:29 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-e504f94d-0880-455c-9c37-e764a6f85f38 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:165db6bd-3792-416f-89e6-27b25a30b47c, portal: 172.16.0.220,3260]
Oct 18 12:13:29 user nova-compute[74190]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:165db6bd-3792-416f-89e6-27b25a30b47c, portal: 172.16.0.220,3260] successful.
Oct 18 12:13:29 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:13:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:165db6bd-3792-416f-89e6-27b25a30b47c -p 172.16.0.220:3260 --op delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:13:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:165db6bd-3792-416f-89e6-27b25a30b47c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:13:29 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a69ef8-97f5-466e-be2f-79d65d50150a]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:13:29 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-e504f94d-0880-455c-9c37-e764a6f85f38 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:13:29 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-e504f94d-0880-455c-9c37-e764a6f85f38 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 12:13:29 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-e504f94d-0880-455c-9c37-e764a6f85f38 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] <== disconnect_volume: return (333ms) None {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 12:13:29 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e504f94d-0880-455c-9c37-e764a6f85f38 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 1aa9f158-c064-4e24-9571-6a3d37e07d51] Disconnected iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 12:13:29 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-e504f94d-0880-455c-9c37-e764a6f85f38 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 1aa9f158-c064-4e24-9571-6a3d37e07d51] Deleting instance files /opt/stack/data/nova/instances/1aa9f158-c064-4e24-9571-6a3d37e07d51_del
Oct 18 12:13:29 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-e504f94d-0880-455c-9c37-e764a6f85f38 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 1aa9f158-c064-4e24-9571-6a3d37e07d51] Deletion of /opt/stack/data/nova/instances/1aa9f158-c064-4e24-9571-6a3d37e07d51_del complete
Oct 18 12:13:29 user nova-compute[74190]: INFO nova.compute.manager [None req-e504f94d-0880-455c-9c37-e764a6f85f38 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 1aa9f158-c064-4e24-9571-6a3d37e07d51] Took 1.34 seconds to destroy the instance on the hypervisor.
Oct 18 12:13:29 user nova-compute[74190]: DEBUG oslo.service.loopingcall [None req-e504f94d-0880-455c-9c37-e764a6f85f38 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74190) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 12:13:29 user nova-compute[74190]: DEBUG nova.compute.manager [-] [instance: 1aa9f158-c064-4e24-9571-6a3d37e07d51] Deallocating network for instance {{(pid=74190) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 12:13:29 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: 1aa9f158-c064-4e24-9571-6a3d37e07d51] deallocate_for_instance() {{(pid=74190) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 12:13:29 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-2e3bf8d3-4128-4b8c-be1d-9d38fea0b2a4 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Acquiring lock "800d5074-2de1-44ce-8f4a-9a7f5ed110c0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:13:29 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-2e3bf8d3-4128-4b8c-be1d-9d38fea0b2a4 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Lock "800d5074-2de1-44ce-8f4a-9a7f5ed110c0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:13:29 user nova-compute[74190]: INFO nova.compute.manager [None req-2e3bf8d3-4128-4b8c-be1d-9d38fea0b2a4 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] [instance: 800d5074-2de1-44ce-8f4a-9a7f5ed110c0] Detaching volume eb710c79-3704-4368-9bbb-56cb0879ea00
Oct 18 12:13:29 user nova-compute[74190]: INFO nova.virt.block_device [None req-2e3bf8d3-4128-4b8c-be1d-9d38fea0b2a4 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] [instance: 800d5074-2de1-44ce-8f4a-9a7f5ed110c0] Attempting to driver detach volume eb710c79-3704-4368-9bbb-56cb0879ea00 from mountpoint /dev/vdb
Oct 18 12:13:29 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-2e3bf8d3-4128-4b8c-be1d-9d38fea0b2a4 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Attempting to detach device vdb from instance 800d5074-2de1-44ce-8f4a-9a7f5ed110c0 from the persistent domain config. {{(pid=74190) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 18 12:13:29 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-2e3bf8d3-4128-4b8c-be1d-9d38fea0b2a4 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 12:13:29 user nova-compute[74190]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 12:13:29 user nova-compute[74190]:   <source dev="/dev/sde"/>
Oct 18 12:13:29 user nova-compute[74190]:   <target dev="vdb" bus="virtio"/>
Oct 18 12:13:29 user nova-compute[74190]:   <serial>eb710c79-3704-4368-9bbb-56cb0879ea00</serial>
Oct 18 12:13:29 user nova-compute[74190]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 18 12:13:29 user nova-compute[74190]: </disk>
Oct 18 12:13:29 user nova-compute[74190]:  {{(pid=74190) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 12:13:29 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-2e3bf8d3-4128-4b8c-be1d-9d38fea0b2a4 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Successfully detached device vdb from instance 800d5074-2de1-44ce-8f4a-9a7f5ed110c0 from the persistent domain config.
Oct 18 12:13:29 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-2e3bf8d3-4128-4b8c-be1d-9d38fea0b2a4 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 800d5074-2de1-44ce-8f4a-9a7f5ed110c0 from the live domain config. {{(pid=74190) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 18 12:13:29 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-2e3bf8d3-4128-4b8c-be1d-9d38fea0b2a4 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 12:13:29 user nova-compute[74190]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 12:13:29 user nova-compute[74190]:   <source dev="/dev/sde"/>
Oct 18 12:13:29 user nova-compute[74190]:   <target dev="vdb" bus="virtio"/>
Oct 18 12:13:29 user nova-compute[74190]:   <serial>eb710c79-3704-4368-9bbb-56cb0879ea00</serial>
Oct 18 12:13:29 user nova-compute[74190]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 18 12:13:29 user nova-compute[74190]: </disk>
Oct 18 12:13:29 user nova-compute[74190]:  {{(pid=74190) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 12:13:29 user nova-compute[74190]: DEBUG nova.compute.manager [req-e2a08991-fc2f-46b9-9bb5-db7274be1b06 req-096dbe6a-5fea-4978-b1b4-0f64c61db543 service nova] [instance: 1aa9f158-c064-4e24-9571-6a3d37e07d51] Received event network-vif-unplugged-440e943e-ccff-4254-981d-7d39a450c6a2 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:13:29 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-e2a08991-fc2f-46b9-9bb5-db7274be1b06 req-096dbe6a-5fea-4978-b1b4-0f64c61db543 service nova] Acquiring lock "1aa9f158-c064-4e24-9571-6a3d37e07d51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:13:29 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-e2a08991-fc2f-46b9-9bb5-db7274be1b06 req-096dbe6a-5fea-4978-b1b4-0f64c61db543 service nova] Lock "1aa9f158-c064-4e24-9571-6a3d37e07d51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:13:29 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-e2a08991-fc2f-46b9-9bb5-db7274be1b06 req-096dbe6a-5fea-4978-b1b4-0f64c61db543 service nova] Lock "1aa9f158-c064-4e24-9571-6a3d37e07d51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:13:29 user nova-compute[74190]: DEBUG nova.compute.manager [req-e2a08991-fc2f-46b9-9bb5-db7274be1b06 req-096dbe6a-5fea-4978-b1b4-0f64c61db543 service nova] [instance: 1aa9f158-c064-4e24-9571-6a3d37e07d51] No waiting events found dispatching network-vif-unplugged-440e943e-ccff-4254-981d-7d39a450c6a2 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:13:29 user nova-compute[74190]: DEBUG nova.compute.manager [req-e2a08991-fc2f-46b9-9bb5-db7274be1b06 req-096dbe6a-5fea-4978-b1b4-0f64c61db543 service nova] [instance: 1aa9f158-c064-4e24-9571-6a3d37e07d51] Received event network-vif-unplugged-440e943e-ccff-4254-981d-7d39a450c6a2 for instance with task_state deleting. {{(pid=74190) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 12:13:29 user nova-compute[74190]: DEBUG nova.compute.manager [req-e2a08991-fc2f-46b9-9bb5-db7274be1b06 req-096dbe6a-5fea-4978-b1b4-0f64c61db543 service nova] [instance: 1aa9f158-c064-4e24-9571-6a3d37e07d51] Received event network-vif-plugged-440e943e-ccff-4254-981d-7d39a450c6a2 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:13:29 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-e2a08991-fc2f-46b9-9bb5-db7274be1b06 req-096dbe6a-5fea-4978-b1b4-0f64c61db543 service nova] Acquiring lock "1aa9f158-c064-4e24-9571-6a3d37e07d51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:13:29 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-e2a08991-fc2f-46b9-9bb5-db7274be1b06 req-096dbe6a-5fea-4978-b1b4-0f64c61db543 service nova] Lock "1aa9f158-c064-4e24-9571-6a3d37e07d51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:13:29 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-e2a08991-fc2f-46b9-9bb5-db7274be1b06 req-096dbe6a-5fea-4978-b1b4-0f64c61db543 service nova] Lock "1aa9f158-c064-4e24-9571-6a3d37e07d51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:13:29 user nova-compute[74190]: DEBUG nova.compute.manager [req-e2a08991-fc2f-46b9-9bb5-db7274be1b06 req-096dbe6a-5fea-4978-b1b4-0f64c61db543 service nova] [instance: 1aa9f158-c064-4e24-9571-6a3d37e07d51] No waiting events found dispatching network-vif-plugged-440e943e-ccff-4254-981d-7d39a450c6a2 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:13:29 user nova-compute[74190]: WARNING nova.compute.manager [req-e2a08991-fc2f-46b9-9bb5-db7274be1b06 req-096dbe6a-5fea-4978-b1b4-0f64c61db543 service nova] [instance: 1aa9f158-c064-4e24-9571-6a3d37e07d51] Received unexpected event network-vif-plugged-440e943e-ccff-4254-981d-7d39a450c6a2 for instance with vm_state active and task_state deleting.
Oct 18 12:13:30 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-2e3bf8d3-4128-4b8c-be1d-9d38fea0b2a4 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 800d5074-2de1-44ce-8f4a-9a7f5ed110c0 {{(pid=74190) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 18 12:13:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:13:30 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: 1aa9f158-c064-4e24-9571-6a3d37e07d51] Updating instance_info_cache with network_info: [] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:13:30 user nova-compute[74190]: INFO nova.compute.manager [-] [instance: 1aa9f158-c064-4e24-9571-6a3d37e07d51] Took 0.97 seconds to deallocate network for instance.
Oct 18 12:13:30 user nova-compute[74190]: DEBUG nova.compute.manager [req-a82b3bad-27b6-4105-b416-53169b08571e req-830bed5e-fea2-4005-8d69-6a11fe1ad923 service nova] [instance: 1aa9f158-c064-4e24-9571-6a3d37e07d51] Received event network-vif-deleted-440e943e-ccff-4254-981d-7d39a450c6a2 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:13:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:13:31 user nova-compute[74190]: INFO nova.compute.manager [None req-e504f94d-0880-455c-9c37-e764a6f85f38 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 1aa9f158-c064-4e24-9571-6a3d37e07d51] Took 0.78 seconds to detach 1 volumes for instance.
Oct 18 12:13:31 user nova-compute[74190]: DEBUG nova.compute.manager [None req-e504f94d-0880-455c-9c37-e764a6f85f38 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 1aa9f158-c064-4e24-9571-6a3d37e07d51] Deleting volume: 165db6bd-3792-416f-89e6-27b25a30b47c {{(pid=74190) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 18 12:13:31 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-e504f94d-0880-455c-9c37-e764a6f85f38 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:13:31 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-e504f94d-0880-455c-9c37-e764a6f85f38 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:13:31 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-e504f94d-0880-455c-9c37-e764a6f85f38 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 12:13:31 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-e504f94d-0880-455c-9c37-e764a6f85f38 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 12:13:31 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-e504f94d-0880-455c-9c37-e764a6f85f38 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.286s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:13:31 user nova-compute[74190]: INFO nova.scheduler.client.report [None req-e504f94d-0880-455c-9c37-e764a6f85f38 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Deleted allocations for instance 1aa9f158-c064-4e24-9571-6a3d37e07d51
Oct 18 12:13:31 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-e504f94d-0880-455c-9c37-e764a6f85f38 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "1aa9f158-c064-4e24-9571-6a3d37e07d51" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.616s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:13:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:13:39 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:13:39 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:13:39 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74190) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 12:13:39 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:13:39 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:13:39 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:13:44 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:13:47 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:13:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:13:49 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:13:50 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-2e3bf8d3-4128-4b8c-be1d-9d38fea0b2a4 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 800d5074-2de1-44ce-8f4a-9a7f5ed110c0 is timed out.
Oct 18 12:13:50 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-2e3bf8d3-4128-4b8c-be1d-9d38fea0b2a4 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Successfully detached device vdb from instance 800d5074-2de1-44ce-8f4a-9a7f5ed110c0 from the live domain config.
Oct 18 12:13:50 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e3bf8d3-4128-4b8c-be1d-9d38fea0b2a4 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] [instance: 800d5074-2de1-44ce-8f4a-9a7f5ed110c0] calling os-brick to detach iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 12:13:50 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3bf8d3-4128-4b8c-be1d-9d38fea0b2a4 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, {'target_iqn': 'iqn.2010-10.org.openstack:eb710c79-3704-4368-9bbb-56cb0879ea00', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vPKLrDhR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 12:13:50 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-2e3bf8d3-4128-4b8c-be1d-9d38fea0b2a4 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 12:13:50 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-2e3bf8d3-4128-4b8c-be1d-9d38fea0b2a4 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 12:13:50 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-2e3bf8d3-4128-4b8c-be1d-9d38fea0b2a4 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 12:13:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:13:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:13:50 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b53a59-c525-48f5-b98f-df181612eff2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:eb710c79-3704-4368-9bbb-56cb0879ea00\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:13:50 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3bf8d3-4128-4b8c-be1d-9d38fea0b2a4 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 12:13:50 user nova-compute[74190]: No targets found.
Oct 18 12:13:50 user nova-compute[74190]: iSNS:
Oct 18 12:13:50 user nova-compute[74190]: No targets found.
Oct 18 12:13:50 user nova-compute[74190]: STATIC:
Oct 18 12:13:50 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:eb710c79-3704-4368-9bbb-56cb0879ea00
Oct 18 12:13:50 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 12:13:50 user nova-compute[74190]:                 Iface Name: default
Oct 18 12:13:50 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf
Oct 18 12:13:50 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 12:13:50 user nova-compute[74190]:                 Iface Name: default
Oct 18 12:13:50 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f
Oct 18 12:13:50 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 12:13:50 user nova-compute[74190]:                 Iface Name: default
Oct 18 12:13:50 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28
Oct 18 12:13:50 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 12:13:50 user nova-compute[74190]:                 Iface Name: default
Oct 18 12:13:50 user nova-compute[74190]: FIRMWARE:
Oct 18 12:13:50 user nova-compute[74190]: No targets found.
Oct 18 12:13:50 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 12:13:50 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3bf8d3-4128-4b8c-be1d-9d38fea0b2a4 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 12:13:50 user nova-compute[74190]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 12:13:50 user nova-compute[74190]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74190) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 12:13:50 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3bf8d3-4128-4b8c-be1d-9d38fea0b2a4 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb710c79-3704-4368-9bbb-56cb0879ea00', 0)] {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 12:13:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:13:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:13:50 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[830102f3-e404-4296-a142-87269eb72eea]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb710c79-3704-4368-9bbb-56cb0879ea00\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:13:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:13:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:13:50 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e79296c-a88f-4ad3-a8fe-9fd928f8bb26]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb710c79-3704-4368-9bbb-56cb0879ea00 (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:13:50 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3bf8d3-4128-4b8c-be1d-9d38fea0b2a4 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)
Oct 18 12:13:50 user nova-compute[74190]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28 (non-flash)
Oct 18 12:13:50 user nova-compute[74190]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf (non-flash)
Oct 18 12:13:50 user nova-compute[74190]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb710c79-3704-4368-9bbb-56cb0879ea00 (non-flash)
Oct 18 12:13:50 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 12:13:50 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3bf8d3-4128-4b8c-be1d-9d38fea0b2a4 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)
Oct 18 12:13:50 user nova-compute[74190]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28 (non-flash)
Oct 18 12:13:50 user nova-compute[74190]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf (non-flash)
Oct 18 12:13:50 user nova-compute[74190]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb710c79-3704-4368-9bbb-56cb0879ea00 (non-flash)
Oct 18 12:13:50 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 12:13:50 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3bf8d3-4128-4b8c-be1d-9d38fea0b2a4 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1f446fe4d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb710c79-3704-4368-9bbb-56cb0879ea00'): ({'sde'}, set())}) {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 12:13:50 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-2e3bf8d3-4128-4b8c-be1d-9d38fea0b2a4 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Removing single pathed devices sde {{(pid=74190) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 12:13:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:13:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:13:50 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f385267-a3a8-48e1-af48-bfac350eebea]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:13:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:13:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:13:50 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[40e093e2-0c12-4a38-b03d-adba686add84]: (4, ('ok\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:13:50 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-2e3bf8d3-4128-4b8c-be1d-9d38fea0b2a4 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Flushing IO for device /dev/sde {{(pid=74190) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 12:13:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:13:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:13:50 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c8ed390-9d4a-4fa9-8896-a8d965048e42]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:13:50 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-2e3bf8d3-4128-4b8c-be1d-9d38fea0b2a4 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74190) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 12:13:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:13:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.045s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:13:50 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c262bf-e693-43d3-a788-6f4af6a8cb2b]: (4, ('1', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:13:50 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-2e3bf8d3-4128-4b8c-be1d-9d38fea0b2a4 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 12:13:50 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-2e3bf8d3-4128-4b8c-be1d-9d38fea0b2a4 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] SCSI volumes sde have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 12:13:50 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3bf8d3-4128-4b8c-be1d-9d38fea0b2a4 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb710c79-3704-4368-9bbb-56cb0879ea00')] {{(pid=74190) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 12:13:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb710c79-3704-4368-9bbb-56cb0879ea00 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:13:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb710c79-3704-4368-9bbb-56cb0879ea00 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:13:50 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[29234a82-3711-4f45-9660-8305778f51bf]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:13:50 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3bf8d3-4128-4b8c-be1d-9d38fea0b2a4 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:13:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb710c79-3704-4368-9bbb-56cb0879ea00 -p 172.16.0.220:3260 --logout {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:13:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb710c79-3704-4368-9bbb-56cb0879ea00 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:13:50 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[a639a571-917a-41b6-bbb9-acdcf1a17afa]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:eb710c79-3704-4368-9bbb-56cb0879ea00, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:eb710c79-3704-4368-9bbb-56cb0879ea00, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:13:50 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3bf8d3-4128-4b8c-be1d-9d38fea0b2a4 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:eb710c79-3704-4368-9bbb-56cb0879ea00, portal: 172.16.0.220,3260]
Oct 18 12:13:50 user nova-compute[74190]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:eb710c79-3704-4368-9bbb-56cb0879ea00, portal: 172.16.0.220,3260] successful.
Oct 18 12:13:50 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:13:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb710c79-3704-4368-9bbb-56cb0879ea00 -p 172.16.0.220:3260 --op delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:13:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb710c79-3704-4368-9bbb-56cb0879ea00 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:13:50 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[63cb8938-5c60-4411-b48c-3ee1db11e89f]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:13:50 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3bf8d3-4128-4b8c-be1d-9d38fea0b2a4 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:13:50 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-2e3bf8d3-4128-4b8c-be1d-9d38fea0b2a4 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 12:13:50 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3bf8d3-4128-4b8c-be1d-9d38fea0b2a4 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] <== disconnect_volume: return (334ms) None {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 12:13:50 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e3bf8d3-4128-4b8c-be1d-9d38fea0b2a4 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] [instance: 800d5074-2de1-44ce-8f4a-9a7f5ed110c0] Disconnected iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 12:13:50 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:13:51 user nova-compute[74190]: DEBUG nova.objects.instance [None req-2e3bf8d3-4128-4b8c-be1d-9d38fea0b2a4 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Lazy-loading 'flavor' on Instance uuid 800d5074-2de1-44ce-8f4a-9a7f5ed110c0 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:13:51 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-2e3bf8d3-4128-4b8c-be1d-9d38fea0b2a4 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Lock "800d5074-2de1-44ce-8f4a-9a7f5ed110c0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.978s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:13:54 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:13:55 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:13:59 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:14:04 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:14:04 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:14:04 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74190) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 12:14:04 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:14:04 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:14:04 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:14:04 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-d7647dee-7455-4801-afb7-738645dc5054 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Acquiring lock "5861a219-456a-43dd-898c-a99ed3051d83" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:14:04 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-d7647dee-7455-4801-afb7-738645dc5054 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lock "5861a219-456a-43dd-898c-a99ed3051d83" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:14:04 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-d7647dee-7455-4801-afb7-738645dc5054 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Acquiring lock "5861a219-456a-43dd-898c-a99ed3051d83-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:14:04 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-d7647dee-7455-4801-afb7-738645dc5054 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lock "5861a219-456a-43dd-898c-a99ed3051d83-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:14:04 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-d7647dee-7455-4801-afb7-738645dc5054 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lock "5861a219-456a-43dd-898c-a99ed3051d83-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:14:04 user nova-compute[74190]: INFO nova.compute.manager [None req-d7647dee-7455-4801-afb7-738645dc5054 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] Terminating instance
Oct 18 12:14:04 user nova-compute[74190]: DEBUG nova.compute.manager [None req-d7647dee-7455-4801-afb7-738645dc5054 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] Start destroying the instance on the hypervisor. {{(pid=74190) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 12:14:04 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:14:04 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:14:04 user nova-compute[74190]: DEBUG nova.compute.manager [req-691b2fd0-a304-46a9-8089-655d4182ba95 req-afa1de75-a9af-4457-b2a1-14ba2df1a24e service nova] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] Received event network-vif-unplugged-f1268427-9b33-481f-b7dc-2e397d6d2da9 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:14:04 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-691b2fd0-a304-46a9-8089-655d4182ba95 req-afa1de75-a9af-4457-b2a1-14ba2df1a24e service nova] Acquiring lock "5861a219-456a-43dd-898c-a99ed3051d83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:14:04 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-691b2fd0-a304-46a9-8089-655d4182ba95 req-afa1de75-a9af-4457-b2a1-14ba2df1a24e service nova] Lock "5861a219-456a-43dd-898c-a99ed3051d83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:14:04 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-691b2fd0-a304-46a9-8089-655d4182ba95 req-afa1de75-a9af-4457-b2a1-14ba2df1a24e service nova] Lock "5861a219-456a-43dd-898c-a99ed3051d83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:14:04 user nova-compute[74190]: DEBUG nova.compute.manager [req-691b2fd0-a304-46a9-8089-655d4182ba95 req-afa1de75-a9af-4457-b2a1-14ba2df1a24e service nova] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] No waiting events found dispatching network-vif-unplugged-f1268427-9b33-481f-b7dc-2e397d6d2da9 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:14:04 user nova-compute[74190]: DEBUG nova.compute.manager [req-691b2fd0-a304-46a9-8089-655d4182ba95 req-afa1de75-a9af-4457-b2a1-14ba2df1a24e service nova] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] Received event network-vif-unplugged-f1268427-9b33-481f-b7dc-2e397d6d2da9 for instance with task_state deleting. {{(pid=74190) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 12:14:05 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:14:05 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:14:05 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] Instance destroyed successfully.
Oct 18 12:14:05 user nova-compute[74190]: DEBUG nova.objects.instance [None req-d7647dee-7455-4801-afb7-738645dc5054 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lazy-loading 'resources' on Instance uuid 5861a219-456a-43dd-898c-a99ed3051d83 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:14:05 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-d7647dee-7455-4801-afb7-738645dc5054 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T12:07:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-928619031',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-928619031',id=40,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-18T12:10:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6d994366010142519ff367fa7ca77e61',ramdisk_id='',reservation_id='r-0sqptyar',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1815510380',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T12:12:19Z,user_data=None,user_id='7fa675b6803f4e21b090295b51fb9ceb',uuid=5861a219-456a-43dd-898c-a99ed3051d83,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f1268427-9b33-481f-b7dc-2e397d6d2da9", "address": "fa:16:3e:ed:cb:95", "network": {"id": "c2dbbd24-f1d2-47a2-835f-0f9b24b585f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-920140900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d994366010142519ff367fa7ca77e61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1268427-9b", "ovs_interfaceid": "f1268427-9b33-481f-b7dc-2e397d6d2da9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 12:14:05 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-d7647dee-7455-4801-afb7-738645dc5054 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Converting VIF {"id": "f1268427-9b33-481f-b7dc-2e397d6d2da9", "address": "fa:16:3e:ed:cb:95", "network": {"id": "c2dbbd24-f1d2-47a2-835f-0f9b24b585f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-920140900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d994366010142519ff367fa7ca77e61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1268427-9b", "ovs_interfaceid": "f1268427-9b33-481f-b7dc-2e397d6d2da9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 12:14:05 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-d7647dee-7455-4801-afb7-738645dc5054 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ed:cb:95,bridge_name='br-int',has_traffic_filtering=True,id=f1268427-9b33-481f-b7dc-2e397d6d2da9,network=Network(c2dbbd24-f1d2-47a2-835f-0f9b24b585f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1268427-9b') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 12:14:05 user nova-compute[74190]: DEBUG os_vif [None req-d7647dee-7455-4801-afb7-738645dc5054 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:cb:95,bridge_name='br-int',has_traffic_filtering=True,id=f1268427-9b33-481f-b7dc-2e397d6d2da9,network=Network(c2dbbd24-f1d2-47a2-835f-0f9b24b585f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1268427-9b') {{(pid=74190) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 12:14:05 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:14:05 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf1268427-9b, bridge=br-int, if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:14:05 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:14:05 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:14:05 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:14:05 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a95bfead-9e41-44f5-be0c-39450c8a2103) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:14:05 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:14:05 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:14:05 user nova-compute[74190]: INFO os_vif [None req-d7647dee-7455-4801-afb7-738645dc5054 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:cb:95,bridge_name='br-int',has_traffic_filtering=True,id=f1268427-9b33-481f-b7dc-2e397d6d2da9,network=Network(c2dbbd24-f1d2-47a2-835f-0f9b24b585f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1268427-9b')
Oct 18 12:14:05 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7647dee-7455-4801-afb7-738645dc5054 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] calling os-brick to detach iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 12:14:05 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7647dee-7455-4801-afb7-738645dc5054 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, {'target_iqn': 'iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pNLKxRaX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 12:14:05 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-d7647dee-7455-4801-afb7-738645dc5054 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 12:14:05 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-d7647dee-7455-4801-afb7-738645dc5054 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 12:14:05 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-d7647dee-7455-4801-afb7-738645dc5054 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 12:14:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:14:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:14:05 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[48842aba-fe9a-40eb-a963-e6207e7204ea]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:14:05 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7647dee-7455-4801-afb7-738645dc5054 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 12:14:05 user nova-compute[74190]: No targets found.
Oct 18 12:14:05 user nova-compute[74190]: iSNS:
Oct 18 12:14:05 user nova-compute[74190]: No targets found.
Oct 18 12:14:05 user nova-compute[74190]: STATIC:
Oct 18 12:14:05 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf
Oct 18 12:14:05 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 12:14:05 user nova-compute[74190]:                 Iface Name: default
Oct 18 12:14:05 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f
Oct 18 12:14:05 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 12:14:05 user nova-compute[74190]:                 Iface Name: default
Oct 18 12:14:05 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28
Oct 18 12:14:05 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 12:14:05 user nova-compute[74190]:                 Iface Name: default
Oct 18 12:14:05 user nova-compute[74190]: FIRMWARE:
Oct 18 12:14:05 user nova-compute[74190]: No targets found.
Oct 18 12:14:05 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 12:14:05 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7647dee-7455-4801-afb7-738645dc5054 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 12:14:05 user nova-compute[74190]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 12:14:05 user nova-compute[74190]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74190) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 12:14:05 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7647dee-7455-4801-afb7-738645dc5054 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28', 0)] {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 12:14:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:14:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:14:05 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae268da-2413-4400-b624-11594ae8c048]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:14:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:14:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:14:05 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[b77267d1-c0a2-4f89-90bc-f7d1e7f8b645]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:14:05 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7647dee-7455-4801-afb7-738645dc5054 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)
Oct 18 12:14:05 user nova-compute[74190]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28 (non-flash)
Oct 18 12:14:05 user nova-compute[74190]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf (non-flash)
Oct 18 12:14:05 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 12:14:05 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7647dee-7455-4801-afb7-738645dc5054 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)
Oct 18 12:14:05 user nova-compute[74190]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28 (non-flash)
Oct 18 12:14:05 user nova-compute[74190]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf (non-flash)
Oct 18 12:14:05 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 12:14:05 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7647dee-7455-4801-afb7-738645dc5054 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1f44279090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28'): ({'sdf'}, set())}) {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 12:14:05 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-d7647dee-7455-4801-afb7-738645dc5054 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Removing single pathed devices sdf {{(pid=74190) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 12:14:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:14:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:14:05 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b0ef2f-b4c9-463f-b9ce-819aa8871ac3]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:14:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:14:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:14:05 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b8b1b06-0195-4814-8192-fb4d25fbcd8e]: (4, ('ok\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:14:05 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-d7647dee-7455-4801-afb7-738645dc5054 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Flushing IO for device /dev/sdf {{(pid=74190) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 12:14:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:14:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:14:05 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab90f094-e960-484e-8d12-ce1db7bd49df]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:14:05 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-d7647dee-7455-4801-afb7-738645dc5054 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74190) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 12:14:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:14:05 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:14:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.046s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:14:05 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[7259ec3d-e0e4-4ece-a588-411a64ea6a79]: (4, ('1', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:14:05 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-d7647dee-7455-4801-afb7-738645dc5054 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 12:14:05 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-d7647dee-7455-4801-afb7-738645dc5054 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] SCSI volumes sdf have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 12:14:05 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7647dee-7455-4801-afb7-738645dc5054 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28')] {{(pid=74190) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 12:14:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:14:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:14:05 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d2578e0-836b-4ef3-a5ef-e1e0f6c8eaff]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:14:05 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7647dee-7455-4801-afb7-738645dc5054 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:14:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28 -p 172.16.0.220:3260 --logout {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:14:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:14:05 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[667411e3-d9ba-4310-9d66-0caacf0fd33d]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:14:05 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7647dee-7455-4801-afb7-738645dc5054 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28, portal: 172.16.0.220,3260]
Oct 18 12:14:05 user nova-compute[74190]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28, portal: 172.16.0.220,3260] successful.
Oct 18 12:14:05 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:14:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28 -p 172.16.0.220:3260 --op delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:14:05 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca7aa93a-9939-442c-8098-c6a297de4f28 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:14:05 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[009170ca-5700-4dfe-8cf7-25fb98efd789]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:14:05 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7647dee-7455-4801-afb7-738645dc5054 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:14:05 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-d7647dee-7455-4801-afb7-738645dc5054 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 12:14:05 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7647dee-7455-4801-afb7-738645dc5054 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] <== disconnect_volume: return (313ms) None {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 12:14:05 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7647dee-7455-4801-afb7-738645dc5054 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] Disconnected iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 12:14:05 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-d7647dee-7455-4801-afb7-738645dc5054 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] Deleting instance files /opt/stack/data/nova/instances/5861a219-456a-43dd-898c-a99ed3051d83_del
Oct 18 12:14:05 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-d7647dee-7455-4801-afb7-738645dc5054 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] Deletion of /opt/stack/data/nova/instances/5861a219-456a-43dd-898c-a99ed3051d83_del complete
Oct 18 12:14:05 user nova-compute[74190]: INFO nova.compute.manager [None req-d7647dee-7455-4801-afb7-738645dc5054 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] Took 1.15 seconds to destroy the instance on the hypervisor.
Oct 18 12:14:05 user nova-compute[74190]: DEBUG oslo.service.loopingcall [None req-d7647dee-7455-4801-afb7-738645dc5054 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74190) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 12:14:05 user nova-compute[74190]: DEBUG nova.compute.manager [-] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] Deallocating network for instance {{(pid=74190) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 12:14:05 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] deallocate_for_instance() {{(pid=74190) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 12:14:06 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] Updating instance_info_cache with network_info: [] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:14:06 user nova-compute[74190]: INFO nova.compute.manager [-] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] Took 0.46 seconds to deallocate network for instance.
Oct 18 12:14:06 user nova-compute[74190]: DEBUG nova.compute.manager [req-9a498743-8f09-4822-8936-901ece5ec973 req-726f782e-58f7-48b4-bd62-c846b33f4f33 service nova] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] Received event network-vif-deleted-f1268427-9b33-481f-b7dc-2e397d6d2da9 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:14:07 user nova-compute[74190]: DEBUG nova.compute.manager [req-f7d2096f-3488-4d1a-a382-e2935682b40c req-512d54a6-4c5d-4550-a0e9-37c1592310b2 service nova] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] Received event network-vif-plugged-f1268427-9b33-481f-b7dc-2e397d6d2da9 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:14:07 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-f7d2096f-3488-4d1a-a382-e2935682b40c req-512d54a6-4c5d-4550-a0e9-37c1592310b2 service nova] Acquiring lock "5861a219-456a-43dd-898c-a99ed3051d83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:14:07 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-f7d2096f-3488-4d1a-a382-e2935682b40c req-512d54a6-4c5d-4550-a0e9-37c1592310b2 service nova] Lock "5861a219-456a-43dd-898c-a99ed3051d83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:14:07 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-f7d2096f-3488-4d1a-a382-e2935682b40c req-512d54a6-4c5d-4550-a0e9-37c1592310b2 service nova] Lock "5861a219-456a-43dd-898c-a99ed3051d83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:14:07 user nova-compute[74190]: DEBUG nova.compute.manager [req-f7d2096f-3488-4d1a-a382-e2935682b40c req-512d54a6-4c5d-4550-a0e9-37c1592310b2 service nova] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] No waiting events found dispatching network-vif-plugged-f1268427-9b33-481f-b7dc-2e397d6d2da9 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:14:07 user nova-compute[74190]: WARNING nova.compute.manager [req-f7d2096f-3488-4d1a-a382-e2935682b40c req-512d54a6-4c5d-4550-a0e9-37c1592310b2 service nova] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] Received unexpected event network-vif-plugged-f1268427-9b33-481f-b7dc-2e397d6d2da9 for instance with vm_state active and task_state deleting.
Oct 18 12:14:07 user nova-compute[74190]: INFO nova.compute.manager [None req-d7647dee-7455-4801-afb7-738645dc5054 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 5861a219-456a-43dd-898c-a99ed3051d83] Took 0.78 seconds to detach 1 volumes for instance.
Oct 18 12:14:07 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-d7647dee-7455-4801-afb7-738645dc5054 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:14:07 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-d7647dee-7455-4801-afb7-738645dc5054 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:14:07 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-d7647dee-7455-4801-afb7-738645dc5054 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 12:14:07 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-d7647dee-7455-4801-afb7-738645dc5054 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 12:14:07 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-d7647dee-7455-4801-afb7-738645dc5054 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.252s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:14:07 user nova-compute[74190]: INFO nova.scheduler.client.report [None req-d7647dee-7455-4801-afb7-738645dc5054 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Deleted allocations for instance 5861a219-456a-43dd-898c-a99ed3051d83
Oct 18 12:14:07 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-d7647dee-7455-4801-afb7-738645dc5054 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lock "5861a219-456a-43dd-898c-a99ed3051d83" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.883s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:14:10 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-58914763-22d5-4849-8d1b-8c6834c538e7 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Acquiring lock "0309a457-dae8-4a13-ac5c-53e2320930ff" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:14:10 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-58914763-22d5-4849-8d1b-8c6834c538e7 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Lock "0309a457-dae8-4a13-ac5c-53e2320930ff" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:14:10 user nova-compute[74190]: DEBUG nova.compute.manager [None req-58914763-22d5-4849-8d1b-8c6834c538e7 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: 0309a457-dae8-4a13-ac5c-53e2320930ff] Starting instance... {{(pid=74190) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 12:14:10 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:14:10 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-58914763-22d5-4849-8d1b-8c6834c538e7 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:14:10 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-58914763-22d5-4849-8d1b-8c6834c538e7 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:14:10 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-58914763-22d5-4849-8d1b-8c6834c538e7 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74190) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 12:14:10 user nova-compute[74190]: INFO nova.compute.claims [None req-58914763-22d5-4849-8d1b-8c6834c538e7 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: 0309a457-dae8-4a13-ac5c-53e2320930ff] Claim successful on node user
Oct 18 12:14:10 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-58914763-22d5-4849-8d1b-8c6834c538e7 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 12:14:10 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-58914763-22d5-4849-8d1b-8c6834c538e7 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 12:14:10 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-58914763-22d5-4849-8d1b-8c6834c538e7 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.304s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:14:10 user nova-compute[74190]: DEBUG nova.compute.manager [None req-58914763-22d5-4849-8d1b-8c6834c538e7 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: 0309a457-dae8-4a13-ac5c-53e2320930ff] Start building networks asynchronously for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 12:14:10 user nova-compute[74190]: DEBUG nova.compute.manager [None req-58914763-22d5-4849-8d1b-8c6834c538e7 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: 0309a457-dae8-4a13-ac5c-53e2320930ff] Allocating IP information in the background. {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 12:14:10 user nova-compute[74190]: DEBUG nova.network.neutron [None req-58914763-22d5-4849-8d1b-8c6834c538e7 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: 0309a457-dae8-4a13-ac5c-53e2320930ff] allocate_for_instance() {{(pid=74190) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 12:14:10 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-58914763-22d5-4849-8d1b-8c6834c538e7 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: 0309a457-dae8-4a13-ac5c-53e2320930ff] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 12:14:10 user nova-compute[74190]: DEBUG nova.compute.manager [None req-58914763-22d5-4849-8d1b-8c6834c538e7 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: 0309a457-dae8-4a13-ac5c-53e2320930ff] Start building block device mappings for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 12:14:10 user nova-compute[74190]: DEBUG nova.policy [None req-58914763-22d5-4849-8d1b-8c6834c538e7 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f2c022bbeb1941fe89964cd372f651f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e49c9e381b0457faa31d0f5bdfa3f18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74190) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 12:14:11 user nova-compute[74190]: DEBUG nova.compute.manager [None req-58914763-22d5-4849-8d1b-8c6834c538e7 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: 0309a457-dae8-4a13-ac5c-53e2320930ff] Start spawning the instance on the hypervisor. {{(pid=74190) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 12:14:11 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-58914763-22d5-4849-8d1b-8c6834c538e7 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: 0309a457-dae8-4a13-ac5c-53e2320930ff] Creating instance directory {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 12:14:11 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-58914763-22d5-4849-8d1b-8c6834c538e7 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: 0309a457-dae8-4a13-ac5c-53e2320930ff] Creating image(s)
Oct 18 12:14:11 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-58914763-22d5-4849-8d1b-8c6834c538e7 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Acquiring lock "/opt/stack/data/nova/instances/0309a457-dae8-4a13-ac5c-53e2320930ff/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:14:11 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-58914763-22d5-4849-8d1b-8c6834c538e7 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Lock "/opt/stack/data/nova/instances/0309a457-dae8-4a13-ac5c-53e2320930ff/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:14:11 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-58914763-22d5-4849-8d1b-8c6834c538e7 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Lock "/opt/stack/data/nova/instances/0309a457-dae8-4a13-ac5c-53e2320930ff/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:14:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-58914763-22d5-4849-8d1b-8c6834c538e7 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:14:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-58914763-22d5-4849-8d1b-8c6834c538e7 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.174s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:14:11 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-58914763-22d5-4849-8d1b-8c6834c538e7 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Acquiring lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:14:11 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-58914763-22d5-4849-8d1b-8c6834c538e7 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:14:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-58914763-22d5-4849-8d1b-8c6834c538e7 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:14:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-58914763-22d5-4849-8d1b-8c6834c538e7 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.168s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:14:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-58914763-22d5-4849-8d1b-8c6834c538e7 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f,backing_fmt=raw /opt/stack/data/nova/instances/0309a457-dae8-4a13-ac5c-53e2320930ff/disk 1073741824 {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:14:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-58914763-22d5-4849-8d1b-8c6834c538e7 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f,backing_fmt=raw /opt/stack/data/nova/instances/0309a457-dae8-4a13-ac5c-53e2320930ff/disk 1073741824" returned: 0 in 0.050s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:14:11 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-58914763-22d5-4849-8d1b-8c6834c538e7 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:14:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-58914763-22d5-4849-8d1b-8c6834c538e7 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:14:11 user nova-compute[74190]: DEBUG nova.network.neutron [None req-58914763-22d5-4849-8d1b-8c6834c538e7 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: 0309a457-dae8-4a13-ac5c-53e2320930ff] Successfully created port: 15fe1d6a-f1b1-4ba7-baa8-7c9c2a0f8643 {{(pid=74190) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 12:14:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-58914763-22d5-4849-8d1b-8c6834c538e7 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.180s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:14:11 user nova-compute[74190]: DEBUG nova.virt.disk.api [None req-58914763-22d5-4849-8d1b-8c6834c538e7 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0309a457-dae8-4a13-ac5c-53e2320930ff/disk. size=1073741824 {{(pid=74190) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 18 12:14:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-58914763-22d5-4849-8d1b-8c6834c538e7 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0309a457-dae8-4a13-ac5c-53e2320930ff/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:14:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-58914763-22d5-4849-8d1b-8c6834c538e7 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0309a457-dae8-4a13-ac5c-53e2320930ff/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:14:11 user nova-compute[74190]: DEBUG nova.virt.disk.api [None req-58914763-22d5-4849-8d1b-8c6834c538e7 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Cannot resize image /opt/stack/data/nova/instances/0309a457-dae8-4a13-ac5c-53e2320930ff/disk to a smaller size. {{(pid=74190) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 18 12:14:11 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-58914763-22d5-4849-8d1b-8c6834c538e7 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: 0309a457-dae8-4a13-ac5c-53e2320930ff] Created local disks {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 12:14:11 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-58914763-22d5-4849-8d1b-8c6834c538e7 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: 0309a457-dae8-4a13-ac5c-53e2320930ff] Ensure instance console log exists: /opt/stack/data/nova/instances/0309a457-dae8-4a13-ac5c-53e2320930ff/console.log {{(pid=74190) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 12:14:11 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-58914763-22d5-4849-8d1b-8c6834c538e7 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:14:11 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-58914763-22d5-4849-8d1b-8c6834c538e7 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:14:11 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-58914763-22d5-4849-8d1b-8c6834c538e7 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:14:12 user nova-compute[74190]: DEBUG nova.network.neutron [None req-58914763-22d5-4849-8d1b-8c6834c538e7 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: 0309a457-dae8-4a13-ac5c-53e2320930ff] Successfully updated port: 15fe1d6a-f1b1-4ba7-baa8-7c9c2a0f8643 {{(pid=74190) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 12:14:12 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-58914763-22d5-4849-8d1b-8c6834c538e7 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Acquiring lock "refresh_cache-0309a457-dae8-4a13-ac5c-53e2320930ff" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:14:12 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-58914763-22d5-4849-8d1b-8c6834c538e7 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Acquired lock "refresh_cache-0309a457-dae8-4a13-ac5c-53e2320930ff" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:14:12 user nova-compute[74190]: DEBUG nova.network.neutron [None req-58914763-22d5-4849-8d1b-8c6834c538e7 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: 0309a457-dae8-4a13-ac5c-53e2320930ff] Building network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 12:14:12 user nova-compute[74190]: DEBUG nova.compute.manager [req-e807ddd1-f1cd-4eb2-a1d5-2f5374ba06e6 req-b46e0094-4a16-4177-8806-ec40f3ef9405 service nova] [instance: 0309a457-dae8-4a13-ac5c-53e2320930ff] Received event network-changed-15fe1d6a-f1b1-4ba7-baa8-7c9c2a0f8643 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:14:12 user nova-compute[74190]: DEBUG nova.compute.manager [req-e807ddd1-f1cd-4eb2-a1d5-2f5374ba06e6 req-b46e0094-4a16-4177-8806-ec40f3ef9405 service nova] [instance: 0309a457-dae8-4a13-ac5c-53e2320930ff] Refreshing instance network info cache due to event network-changed-15fe1d6a-f1b1-4ba7-baa8-7c9c2a0f8643. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 12:14:12 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-e807ddd1-f1cd-4eb2-a1d5-2f5374ba06e6 req-b46e0094-4a16-4177-8806-ec40f3ef9405 service nova] Acquiring lock "refresh_cache-0309a457-dae8-4a13-ac5c-53e2320930ff" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:14:12 user nova-compute[74190]: DEBUG nova.network.neutron [None req-58914763-22d5-4849-8d1b-8c6834c538e7 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: 0309a457-dae8-4a13-ac5c-53e2320930ff] Instance cache missing network info. {{(pid=74190) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 12:14:12 user nova-compute[74190]: DEBUG nova.network.neutron [None req-58914763-22d5-4849-8d1b-8c6834c538e7 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: 0309a457-dae8-4a13-ac5c-53e2320930ff] Updating instance_info_cache with network_info: [{"id": "15fe1d6a-f1b1-4ba7-baa8-7c9c2a0f8643", "address": "fa:16:3e:4e:a5:f5", "network": {"id": "1afc08fa-4518-4ccf-97a1-22f04820b31c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-687660220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e49c9e381b0457faa31d0f5bdfa3f18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15fe1d6a-f1", "ovs_interfaceid": "15fe1d6a-f1b1-4ba7-baa8-7c9c2a0f8643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:14:12 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-58914763-22d5-4849-8d1b-8c6834c538e7 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Releasing lock "refresh_cache-0309a457-dae8-4a13-ac5c-53e2320930ff" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:14:12 user nova-compute[74190]: DEBUG nova.compute.manager [None req-58914763-22d5-4849-8d1b-8c6834c538e7 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: 0309a457-dae8-4a13-ac5c-53e2320930ff] Instance network_info: |[{"id": "15fe1d6a-f1b1-4ba7-baa8-7c9c2a0f8643", "address": "fa:16:3e:4e:a5:f5", "network": {"id": "1afc08fa-4518-4ccf-97a1-22f04820b31c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-687660220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e49c9e381b0457faa31d0f5bdfa3f18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15fe1d6a-f1", "ovs_interfaceid": "15fe1d6a-f1b1-4ba7-baa8-7c9c2a0f8643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 12:14:12 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-e807ddd1-f1cd-4eb2-a1d5-2f5374ba06e6 req-b46e0094-4a16-4177-8806-ec40f3ef9405 service nova] Acquired lock "refresh_cache-0309a457-dae8-4a13-ac5c-53e2320930ff" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:14:12 user nova-compute[74190]: DEBUG nova.network.neutron [req-e807ddd1-f1cd-4eb2-a1d5-2f5374ba06e6 req-b46e0094-4a16-4177-8806-ec40f3ef9405 service nova] [instance: 0309a457-dae8-4a13-ac5c-53e2320930ff] Refreshing network info cache for port 15fe1d6a-f1b1-4ba7-baa8-7c9c2a0f8643 {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 12:14:12 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-58914763-22d5-4849-8d1b-8c6834c538e7 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: 0309a457-dae8-4a13-ac5c-53e2320930ff] Start _get_guest_xml network_info=[{"id": "15fe1d6a-f1b1-4ba7-baa8-7c9c2a0f8643", "address": "fa:16:3e:4e:a5:f5", "network": {"id": "1afc08fa-4518-4ccf-97a1-22f04820b31c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-687660220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e49c9e381b0457faa31d0f5bdfa3f18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15fe1d6a-f1", "ovs_interfaceid": "15fe1d6a-f1b1-4ba7-baa8-7c9c2a0f8643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'image_id': '6e88bbf0-6e78-49a8-b3c5-9453d22a89df'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 12:14:12 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-58914763-22d5-4849-8d1b-8c6834c538e7 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:14:12 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-58914763-22d5-4849-8d1b-8c6834c538e7 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:14:12 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-58914763-22d5-4849-8d1b-8c6834c538e7 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 12:14:12 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-58914763-22d5-4849-8d1b-8c6834c538e7 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] CPU controller missing on host. {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 12:14:12 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-58914763-22d5-4849-8d1b-8c6834c538e7 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 12:14:12 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-58914763-22d5-4849-8d1b-8c6834c538e7 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] CPU controller found on host. {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 12:14:12 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-58914763-22d5-4849-8d1b-8c6834c538e7 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74190) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 12:14:12 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-58914763-22d5-4849-8d1b-8c6834c538e7 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T11:37:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 12:14:12 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-58914763-22d5-4849-8d1b-8c6834c538e7 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Flavor limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 12:14:12 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-58914763-22d5-4849-8d1b-8c6834c538e7 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Image limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 12:14:12 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-58914763-22d5-4849-8d1b-8c6834c538e7 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Flavor pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 12:14:12 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-58914763-22d5-4849-8d1b-8c6834c538e7 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Image pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 12:14:12 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-58914763-22d5-4849-8d1b-8c6834c538e7 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 12:14:12 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-58914763-22d5-4849-8d1b-8c6834c538e7 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 12:14:12 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-58914763-22d5-4849-8d1b-8c6834c538e7 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 12:14:12 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-58914763-22d5-4849-8d1b-8c6834c538e7 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Got 1 possible topologies {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 12:14:12 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-58914763-22d5-4849-8d1b-8c6834c538e7 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 12:14:12 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-58914763-22d5-4849-8d1b-8c6834c538e7 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 12:14:12 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-58914763-22d5-4849-8d1b-8c6834c538e7 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T12:14:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1714449262',display_name='tempest-VolumesSnapshotTestJSON-instance-1714449262',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1714449262',id=45,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBiA49OJsuTWpE/DbESifyn+qStGa0vhIL4qhhpAEiqzuGfmJDChDk6GXu5nVuuAHndGg+J0dA8AgQIAFVMUezVLZIx+SG1F7Cc6T+wgoqacHtEReduCnynVjEVf5WuHtA==',key_name='tempest-keypair-1902603522',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e49c9e381b0457faa31d0f5bdfa3f18',ramdisk_id='',reservation_id='r-gfal3ica',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-252328076',owner_user_name='tempest-VolumesSnapshotTestJSON-252328076-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T12:14:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f2c022bbeb1941fe89964cd372f651f2',uuid=0309a457-dae8-4a13-ac5c-53e2320930ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15fe1d6a-f1b1-4ba7-baa8-7c9c2a0f8643", "address": "fa:16:3e:4e:a5:f5", "network": {"id": "1afc08fa-4518-4ccf-97a1-22f04820b31c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-687660220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e49c9e381b0457faa31d0f5bdfa3f18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15fe1d6a-f1", "ovs_interfaceid": "15fe1d6a-f1b1-4ba7-baa8-7c9c2a0f8643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74190) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 12:14:12 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-58914763-22d5-4849-8d1b-8c6834c538e7 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Converting VIF {"id": "15fe1d6a-f1b1-4ba7-baa8-7c9c2a0f8643", "address": "fa:16:3e:4e:a5:f5", "network": {"id": "1afc08fa-4518-4ccf-97a1-22f04820b31c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-687660220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e49c9e381b0457faa31d0f5bdfa3f18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15fe1d6a-f1", "ovs_interfaceid": "15fe1d6a-f1b1-4ba7-baa8-7c9c2a0f8643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 12:14:12 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-58914763-22d5-4849-8d1b-8c6834c538e7 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:a5:f5,bridge_name='br-int',has_traffic_filtering=True,id=15fe1d6a-f1b1-4ba7-baa8-7c9c2a0f8643,network=Network(1afc08fa-4518-4ccf-97a1-22f04820b31c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15fe1d6a-f1') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 12:14:12 user nova-compute[74190]: DEBUG nova.objects.instance [None req-58914763-22d5-4849-8d1b-8c6834c538e7 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Lazy-loading 'pci_devices' on Instance uuid 0309a457-dae8-4a13-ac5c-53e2320930ff {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:14:12 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-58914763-22d5-4849-8d1b-8c6834c538e7 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: 0309a457-dae8-4a13-ac5c-53e2320930ff] End _get_guest_xml xml=<domain type="kvm">
Oct 18 12:14:12 user nova-compute[74190]:   <uuid>0309a457-dae8-4a13-ac5c-53e2320930ff</uuid>
Oct 18 12:14:12 user nova-compute[74190]:   <name>instance-0000002d</name>
Oct 18 12:14:12 user nova-compute[74190]:   <memory>524288</memory>
Oct 18 12:14:12 user nova-compute[74190]:   <vcpu>1</vcpu>
Oct 18 12:14:12 user nova-compute[74190]:   <metadata>
Oct 18 12:14:12 user nova-compute[74190]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 12:14:12 user nova-compute[74190]:       <nova:package version="0.0.0"/>
Oct 18 12:14:12 user nova-compute[74190]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1714449262</nova:name>
Oct 18 12:14:12 user nova-compute[74190]:       <nova:creationTime>2023-10-18 12:14:12</nova:creationTime>
Oct 18 12:14:12 user nova-compute[74190]:       <nova:flavor name="m1.tiny">
Oct 18 12:14:12 user nova-compute[74190]:         <nova:memory>512</nova:memory>
Oct 18 12:14:12 user nova-compute[74190]:         <nova:disk>1</nova:disk>
Oct 18 12:14:12 user nova-compute[74190]:         <nova:swap>0</nova:swap>
Oct 18 12:14:12 user nova-compute[74190]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 12:14:12 user nova-compute[74190]:         <nova:vcpus>1</nova:vcpus>
Oct 18 12:14:12 user nova-compute[74190]:       </nova:flavor>
Oct 18 12:14:12 user nova-compute[74190]:       <nova:owner>
Oct 18 12:14:12 user nova-compute[74190]:         <nova:user uuid="f2c022bbeb1941fe89964cd372f651f2">tempest-VolumesSnapshotTestJSON-252328076-project-member</nova:user>
Oct 18 12:14:12 user nova-compute[74190]:         <nova:project uuid="1e49c9e381b0457faa31d0f5bdfa3f18">tempest-VolumesSnapshotTestJSON-252328076</nova:project>
Oct 18 12:14:12 user nova-compute[74190]:       </nova:owner>
Oct 18 12:14:12 user nova-compute[74190]:       <nova:root type="image" uuid="6e88bbf0-6e78-49a8-b3c5-9453d22a89df"/>
Oct 18 12:14:12 user nova-compute[74190]:       <nova:ports>
Oct 18 12:14:12 user nova-compute[74190]:         <nova:port uuid="15fe1d6a-f1b1-4ba7-baa8-7c9c2a0f8643">
Oct 18 12:14:12 user nova-compute[74190]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 18 12:14:12 user nova-compute[74190]:         </nova:port>
Oct 18 12:14:12 user nova-compute[74190]:       </nova:ports>
Oct 18 12:14:12 user nova-compute[74190]:     </nova:instance>
Oct 18 12:14:12 user nova-compute[74190]:   </metadata>
Oct 18 12:14:12 user nova-compute[74190]:   <sysinfo type="smbios">
Oct 18 12:14:12 user nova-compute[74190]:     <system>
Oct 18 12:14:12 user nova-compute[74190]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 12:14:12 user nova-compute[74190]:       <entry name="product">OpenStack Nova</entry>
Oct 18 12:14:12 user nova-compute[74190]:       <entry name="version">0.0.0</entry>
Oct 18 12:14:12 user nova-compute[74190]:       <entry name="serial">0309a457-dae8-4a13-ac5c-53e2320930ff</entry>
Oct 18 12:14:12 user nova-compute[74190]:       <entry name="uuid">0309a457-dae8-4a13-ac5c-53e2320930ff</entry>
Oct 18 12:14:12 user nova-compute[74190]:       <entry name="family">Virtual Machine</entry>
Oct 18 12:14:12 user nova-compute[74190]:     </system>
Oct 18 12:14:12 user nova-compute[74190]:   </sysinfo>
Oct 18 12:14:12 user nova-compute[74190]:   <os>
Oct 18 12:14:12 user nova-compute[74190]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 12:14:12 user nova-compute[74190]:     <boot dev="hd"/>
Oct 18 12:14:12 user nova-compute[74190]:     <smbios mode="sysinfo"/>
Oct 18 12:14:12 user nova-compute[74190]:   </os>
Oct 18 12:14:12 user nova-compute[74190]:   <features>
Oct 18 12:14:12 user nova-compute[74190]:     <acpi/>
Oct 18 12:14:12 user nova-compute[74190]:     <apic/>
Oct 18 12:14:12 user nova-compute[74190]:     <vmcoreinfo/>
Oct 18 12:14:12 user nova-compute[74190]:   </features>
Oct 18 12:14:12 user nova-compute[74190]:   <clock offset="utc">
Oct 18 12:14:12 user nova-compute[74190]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 12:14:12 user nova-compute[74190]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 12:14:12 user nova-compute[74190]:     <timer name="hpet" present="no"/>
Oct 18 12:14:12 user nova-compute[74190]:   </clock>
Oct 18 12:14:12 user nova-compute[74190]:   <cpu mode="custom" match="exact">
Oct 18 12:14:12 user nova-compute[74190]:     <model>Nehalem</model>
Oct 18 12:14:12 user nova-compute[74190]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 12:14:12 user nova-compute[74190]:   </cpu>
Oct 18 12:14:12 user nova-compute[74190]:   <devices>
Oct 18 12:14:12 user nova-compute[74190]:     <disk type="file" device="disk">
Oct 18 12:14:12 user nova-compute[74190]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 12:14:12 user nova-compute[74190]:       <source file="/opt/stack/data/nova/instances/0309a457-dae8-4a13-ac5c-53e2320930ff/disk"/>
Oct 18 12:14:12 user nova-compute[74190]:       <target dev="vda" bus="virtio"/>
Oct 18 12:14:12 user nova-compute[74190]:     </disk>
Oct 18 12:14:12 user nova-compute[74190]:     <interface type="ethernet">
Oct 18 12:14:12 user nova-compute[74190]:       <mac address="fa:16:3e:4e:a5:f5"/>
Oct 18 12:14:12 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 12:14:12 user nova-compute[74190]:       <mtu size="1442"/>
Oct 18 12:14:12 user nova-compute[74190]:       <target dev="tap15fe1d6a-f1"/>
Oct 18 12:14:12 user nova-compute[74190]:     </interface>
Oct 18 12:14:12 user nova-compute[74190]:     <serial type="pty">
Oct 18 12:14:12 user nova-compute[74190]:       <log file="/opt/stack/data/nova/instances/0309a457-dae8-4a13-ac5c-53e2320930ff/console.log" append="off"/>
Oct 18 12:14:12 user nova-compute[74190]:     </serial>
Oct 18 12:14:12 user nova-compute[74190]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 12:14:12 user nova-compute[74190]:     <video>
Oct 18 12:14:12 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 12:14:12 user nova-compute[74190]:     </video>
Oct 18 12:14:12 user nova-compute[74190]:     <rng model="virtio">
Oct 18 12:14:12 user nova-compute[74190]:       <backend model="random">/dev/urandom</backend>
Oct 18 12:14:12 user nova-compute[74190]:     </rng>
Oct 18 12:14:12 user nova-compute[74190]:     <controller type="usb" index="0" model="none"/>
Oct 18 12:14:12 user nova-compute[74190]:     <memballoon model="virtio">
Oct 18 12:14:12 user nova-compute[74190]:       <stats period="10"/>
Oct 18 12:14:12 user nova-compute[74190]:     </memballoon>
Oct 18 12:14:12 user nova-compute[74190]:   </devices>
Oct 18 12:14:12 user nova-compute[74190]: </domain>
Oct 18 12:14:12 user nova-compute[74190]:  {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 12:14:12 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-58914763-22d5-4849-8d1b-8c6834c538e7 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T12:14:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1714449262',display_name='tempest-VolumesSnapshotTestJSON-instance-1714449262',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1714449262',id=45,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBiA49OJsuTWpE/DbESifyn+qStGa0vhIL4qhhpAEiqzuGfmJDChDk6GXu5nVuuAHndGg+J0dA8AgQIAFVMUezVLZIx+SG1F7Cc6T+wgoqacHtEReduCnynVjEVf5WuHtA==',key_name='tempest-keypair-1902603522',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e49c9e381b0457faa31d0f5bdfa3f18',ramdisk_id='',reservation_id='r-gfal3ica',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-252328076',owner_user_name='tempest-VolumesSnapshotTestJSON-252328076-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T12:14:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f2c022bbeb1941fe89964cd372f651f2',uuid=0309a457-dae8-4a13-ac5c-53e2320930ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15fe1d6a-f1b1-4ba7-baa8-7c9c2a0f8643", "address": "fa:16:3e:4e:a5:f5", "network": {"id": "1afc08fa-4518-4ccf-97a1-22f04820b31c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-687660220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e49c9e381b0457faa31d0f5bdfa3f18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15fe1d6a-f1", "ovs_interfaceid": "15fe1d6a-f1b1-4ba7-baa8-7c9c2a0f8643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 12:14:12 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-58914763-22d5-4849-8d1b-8c6834c538e7 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Converting VIF {"id": "15fe1d6a-f1b1-4ba7-baa8-7c9c2a0f8643", "address": "fa:16:3e:4e:a5:f5", "network": {"id": "1afc08fa-4518-4ccf-97a1-22f04820b31c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-687660220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e49c9e381b0457faa31d0f5bdfa3f18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15fe1d6a-f1", "ovs_interfaceid": "15fe1d6a-f1b1-4ba7-baa8-7c9c2a0f8643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 12:14:12 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-58914763-22d5-4849-8d1b-8c6834c538e7 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:a5:f5,bridge_name='br-int',has_traffic_filtering=True,id=15fe1d6a-f1b1-4ba7-baa8-7c9c2a0f8643,network=Network(1afc08fa-4518-4ccf-97a1-22f04820b31c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15fe1d6a-f1') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 12:14:12 user nova-compute[74190]: DEBUG os_vif [None req-58914763-22d5-4849-8d1b-8c6834c538e7 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:a5:f5,bridge_name='br-int',has_traffic_filtering=True,id=15fe1d6a-f1b1-4ba7-baa8-7c9c2a0f8643,network=Network(1afc08fa-4518-4ccf-97a1-22f04820b31c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15fe1d6a-f1') {{(pid=74190) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 12:14:12 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:14:12 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:14:12 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 12:14:12 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:14:12 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8d178d78-f645-526b-a842-5b4ff71e5e9a', '_type': 'linux-noop'}}, row=False) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:14:12 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:14:12 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:14:12 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:14:12 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap15fe1d6a-f1, may_exist=True, interface_attrs={}) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:14:12 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap15fe1d6a-f1, col_values=(('qos', UUID('13a26ac4-725b-4cde-961f-839b4fd9cecd')),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:14:12 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap15fe1d6a-f1, col_values=(('external_ids', {'iface-id': '15fe1d6a-f1b1-4ba7-baa8-7c9c2a0f8643', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4e:a5:f5', 'vm-uuid': '0309a457-dae8-4a13-ac5c-53e2320930ff'}),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:14:12 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:14:12 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:14:12 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:14:12 user nova-compute[74190]: INFO os_vif [None req-58914763-22d5-4849-8d1b-8c6834c538e7 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:a5:f5,bridge_name='br-int',has_traffic_filtering=True,id=15fe1d6a-f1b1-4ba7-baa8-7c9c2a0f8643,network=Network(1afc08fa-4518-4ccf-97a1-22f04820b31c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15fe1d6a-f1')
Oct 18 12:14:13 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-58914763-22d5-4849-8d1b-8c6834c538e7 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] No BDM found with device name vda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 12:14:13 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-58914763-22d5-4849-8d1b-8c6834c538e7 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] No VIF found with MAC fa:16:3e:4e:a5:f5, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 12:14:13 user nova-compute[74190]: DEBUG nova.network.neutron [req-e807ddd1-f1cd-4eb2-a1d5-2f5374ba06e6 req-b46e0094-4a16-4177-8806-ec40f3ef9405 service nova] [instance: 0309a457-dae8-4a13-ac5c-53e2320930ff] Updated VIF entry in instance network info cache for port 15fe1d6a-f1b1-4ba7-baa8-7c9c2a0f8643. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 12:14:13 user nova-compute[74190]: DEBUG nova.network.neutron [req-e807ddd1-f1cd-4eb2-a1d5-2f5374ba06e6 req-b46e0094-4a16-4177-8806-ec40f3ef9405 service nova] [instance: 0309a457-dae8-4a13-ac5c-53e2320930ff] Updating instance_info_cache with network_info: [{"id": "15fe1d6a-f1b1-4ba7-baa8-7c9c2a0f8643", "address": "fa:16:3e:4e:a5:f5", "network": {"id": "1afc08fa-4518-4ccf-97a1-22f04820b31c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-687660220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e49c9e381b0457faa31d0f5bdfa3f18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15fe1d6a-f1", "ovs_interfaceid": "15fe1d6a-f1b1-4ba7-baa8-7c9c2a0f8643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:14:13 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-e807ddd1-f1cd-4eb2-a1d5-2f5374ba06e6 req-b46e0094-4a16-4177-8806-ec40f3ef9405 service nova] Releasing lock "refresh_cache-0309a457-dae8-4a13-ac5c-53e2320930ff" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:14:14 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:14:14 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:14:14 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:14:14 user nova-compute[74190]: DEBUG nova.compute.manager [req-5f51f8f2-3e24-475c-93fa-ce86be845995 req-79cd9341-7f5e-4d92-80e4-ac531fe8a952 service nova] [instance: 0309a457-dae8-4a13-ac5c-53e2320930ff] Received event network-vif-plugged-15fe1d6a-f1b1-4ba7-baa8-7c9c2a0f8643 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:14:14 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-5f51f8f2-3e24-475c-93fa-ce86be845995 req-79cd9341-7f5e-4d92-80e4-ac531fe8a952 service nova] Acquiring lock "0309a457-dae8-4a13-ac5c-53e2320930ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:14:14 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-5f51f8f2-3e24-475c-93fa-ce86be845995 req-79cd9341-7f5e-4d92-80e4-ac531fe8a952 service nova] Lock "0309a457-dae8-4a13-ac5c-53e2320930ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:14:14 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-5f51f8f2-3e24-475c-93fa-ce86be845995 req-79cd9341-7f5e-4d92-80e4-ac531fe8a952 service nova] Lock "0309a457-dae8-4a13-ac5c-53e2320930ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:14:14 user nova-compute[74190]: DEBUG nova.compute.manager [req-5f51f8f2-3e24-475c-93fa-ce86be845995 req-79cd9341-7f5e-4d92-80e4-ac531fe8a952 service nova] [instance: 0309a457-dae8-4a13-ac5c-53e2320930ff] No waiting events found dispatching network-vif-plugged-15fe1d6a-f1b1-4ba7-baa8-7c9c2a0f8643 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:14:14 user nova-compute[74190]: WARNING nova.compute.manager [req-5f51f8f2-3e24-475c-93fa-ce86be845995 req-79cd9341-7f5e-4d92-80e4-ac531fe8a952 service nova] [instance: 0309a457-dae8-4a13-ac5c-53e2320930ff] Received unexpected event network-vif-plugged-15fe1d6a-f1b1-4ba7-baa8-7c9c2a0f8643 for instance with vm_state building and task_state spawning.
Oct 18 12:14:14 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:14:14 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:14:14 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:14:15 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:14:15 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:14:15 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:14:16 user nova-compute[74190]: DEBUG nova.compute.manager [None req-58914763-22d5-4849-8d1b-8c6834c538e7 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: 0309a457-dae8-4a13-ac5c-53e2320930ff] Instance event wait completed in 0 seconds for  {{(pid=74190) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 12:14:16 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-58914763-22d5-4849-8d1b-8c6834c538e7 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: 0309a457-dae8-4a13-ac5c-53e2320930ff] Guest created on hypervisor {{(pid=74190) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 12:14:16 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 0309a457-dae8-4a13-ac5c-53e2320930ff] Instance spawned successfully.
Oct 18 12:14:16 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-58914763-22d5-4849-8d1b-8c6834c538e7 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: 0309a457-dae8-4a13-ac5c-53e2320930ff] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 12:14:16 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-58914763-22d5-4849-8d1b-8c6834c538e7 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: 0309a457-dae8-4a13-ac5c-53e2320930ff] Found default for hw_cdrom_bus of ide {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:14:16 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-58914763-22d5-4849-8d1b-8c6834c538e7 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: 0309a457-dae8-4a13-ac5c-53e2320930ff] Found default for hw_disk_bus of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:14:16 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-58914763-22d5-4849-8d1b-8c6834c538e7 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: 0309a457-dae8-4a13-ac5c-53e2320930ff] Found default for hw_input_bus of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:14:16 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-58914763-22d5-4849-8d1b-8c6834c538e7 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: 0309a457-dae8-4a13-ac5c-53e2320930ff] Found default for hw_pointer_model of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:14:16 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-58914763-22d5-4849-8d1b-8c6834c538e7 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: 0309a457-dae8-4a13-ac5c-53e2320930ff] Found default for hw_video_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:14:16 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-58914763-22d5-4849-8d1b-8c6834c538e7 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: 0309a457-dae8-4a13-ac5c-53e2320930ff] Found default for hw_vif_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:14:16 user nova-compute[74190]: INFO nova.compute.manager [None req-58914763-22d5-4849-8d1b-8c6834c538e7 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: 0309a457-dae8-4a13-ac5c-53e2320930ff] Took 5.46 seconds to spawn the instance on the hypervisor.
Oct 18 12:14:16 user nova-compute[74190]: DEBUG nova.compute.manager [None req-58914763-22d5-4849-8d1b-8c6834c538e7 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: 0309a457-dae8-4a13-ac5c-53e2320930ff] Checking state {{(pid=74190) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 12:14:16 user nova-compute[74190]: DEBUG nova.compute.manager [req-bfacfe9e-0b3d-4481-bd3e-c45133ccd26e req-8ae3c255-7dc2-48fb-94d5-c53b6bb6b5ea service nova] [instance: 0309a457-dae8-4a13-ac5c-53e2320930ff] Received event network-vif-plugged-15fe1d6a-f1b1-4ba7-baa8-7c9c2a0f8643 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:14:16 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-bfacfe9e-0b3d-4481-bd3e-c45133ccd26e req-8ae3c255-7dc2-48fb-94d5-c53b6bb6b5ea service nova] Acquiring lock "0309a457-dae8-4a13-ac5c-53e2320930ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:14:16 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-bfacfe9e-0b3d-4481-bd3e-c45133ccd26e req-8ae3c255-7dc2-48fb-94d5-c53b6bb6b5ea service nova] Lock "0309a457-dae8-4a13-ac5c-53e2320930ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:14:16 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-bfacfe9e-0b3d-4481-bd3e-c45133ccd26e req-8ae3c255-7dc2-48fb-94d5-c53b6bb6b5ea service nova] Lock "0309a457-dae8-4a13-ac5c-53e2320930ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:14:16 user nova-compute[74190]: DEBUG nova.compute.manager [req-bfacfe9e-0b3d-4481-bd3e-c45133ccd26e req-8ae3c255-7dc2-48fb-94d5-c53b6bb6b5ea service nova] [instance: 0309a457-dae8-4a13-ac5c-53e2320930ff] No waiting events found dispatching network-vif-plugged-15fe1d6a-f1b1-4ba7-baa8-7c9c2a0f8643 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:14:16 user nova-compute[74190]: WARNING nova.compute.manager [req-bfacfe9e-0b3d-4481-bd3e-c45133ccd26e req-8ae3c255-7dc2-48fb-94d5-c53b6bb6b5ea service nova] [instance: 0309a457-dae8-4a13-ac5c-53e2320930ff] Received unexpected event network-vif-plugged-15fe1d6a-f1b1-4ba7-baa8-7c9c2a0f8643 for instance with vm_state building and task_state spawning.
Oct 18 12:14:16 user nova-compute[74190]: INFO nova.compute.manager [None req-58914763-22d5-4849-8d1b-8c6834c538e7 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: 0309a457-dae8-4a13-ac5c-53e2320930ff] Took 6.13 seconds to build instance.
Oct 18 12:14:16 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-58914763-22d5-4849-8d1b-8c6834c538e7 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Lock "0309a457-dae8-4a13-ac5c-53e2320930ff" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.212s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:14:17 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:14:19 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:14:20 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-888cc9df-f6cf-4c2e-b19c-1aa114c6b5a2 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Acquiring lock "800d5074-2de1-44ce-8f4a-9a7f5ed110c0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:14:20 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-888cc9df-f6cf-4c2e-b19c-1aa114c6b5a2 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Lock "800d5074-2de1-44ce-8f4a-9a7f5ed110c0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:14:20 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-888cc9df-f6cf-4c2e-b19c-1aa114c6b5a2 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Acquiring lock "800d5074-2de1-44ce-8f4a-9a7f5ed110c0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:14:20 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-888cc9df-f6cf-4c2e-b19c-1aa114c6b5a2 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Lock "800d5074-2de1-44ce-8f4a-9a7f5ed110c0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:14:20 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-888cc9df-f6cf-4c2e-b19c-1aa114c6b5a2 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Lock "800d5074-2de1-44ce-8f4a-9a7f5ed110c0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:14:20 user nova-compute[74190]: INFO nova.compute.manager [None req-888cc9df-f6cf-4c2e-b19c-1aa114c6b5a2 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] [instance: 800d5074-2de1-44ce-8f4a-9a7f5ed110c0] Terminating instance
Oct 18 12:14:20 user nova-compute[74190]: DEBUG nova.compute.manager [None req-888cc9df-f6cf-4c2e-b19c-1aa114c6b5a2 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] [instance: 800d5074-2de1-44ce-8f4a-9a7f5ed110c0] Start destroying the instance on the hypervisor. {{(pid=74190) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 12:14:20 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:14:20 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:14:20 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:14:20 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:14:20 user nova-compute[74190]: DEBUG nova.compute.manager [req-a39a9353-e1ba-456e-945b-51797c9234db req-690598ac-9dc1-4838-8968-3e88b2495e6f service nova] [instance: 800d5074-2de1-44ce-8f4a-9a7f5ed110c0] Received event network-vif-unplugged-05810ade-2f7b-4af2-9ed7-f6a70d3842ac {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:14:20 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-a39a9353-e1ba-456e-945b-51797c9234db req-690598ac-9dc1-4838-8968-3e88b2495e6f service nova] Acquiring lock "800d5074-2de1-44ce-8f4a-9a7f5ed110c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:14:20 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-a39a9353-e1ba-456e-945b-51797c9234db req-690598ac-9dc1-4838-8968-3e88b2495e6f service nova] Lock "800d5074-2de1-44ce-8f4a-9a7f5ed110c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:14:20 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-a39a9353-e1ba-456e-945b-51797c9234db req-690598ac-9dc1-4838-8968-3e88b2495e6f service nova] Lock "800d5074-2de1-44ce-8f4a-9a7f5ed110c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:14:20 user nova-compute[74190]: DEBUG nova.compute.manager [req-a39a9353-e1ba-456e-945b-51797c9234db req-690598ac-9dc1-4838-8968-3e88b2495e6f service nova] [instance: 800d5074-2de1-44ce-8f4a-9a7f5ed110c0] No waiting events found dispatching network-vif-unplugged-05810ade-2f7b-4af2-9ed7-f6a70d3842ac {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:14:20 user nova-compute[74190]: DEBUG nova.compute.manager [req-a39a9353-e1ba-456e-945b-51797c9234db req-690598ac-9dc1-4838-8968-3e88b2495e6f service nova] [instance: 800d5074-2de1-44ce-8f4a-9a7f5ed110c0] Received event network-vif-unplugged-05810ade-2f7b-4af2-9ed7-f6a70d3842ac for instance with task_state deleting. {{(pid=74190) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 12:14:20 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:14:20 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 800d5074-2de1-44ce-8f4a-9a7f5ed110c0] Instance destroyed successfully.
Oct 18 12:14:20 user nova-compute[74190]: DEBUG nova.objects.instance [None req-888cc9df-f6cf-4c2e-b19c-1aa114c6b5a2 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Lazy-loading 'resources' on Instance uuid 800d5074-2de1-44ce-8f4a-9a7f5ed110c0 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:14:20 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-888cc9df-f6cf-4c2e-b19c-1aa114c6b5a2 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T12:09:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-488948398',display_name='tempest-TestServerVolumeAttachmentScenario-server-488948398',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-488948398',id=42,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKS1zaqL935TtTqqky40Ad+6j26+weLWwyOJke+ftMfydYsRRcJGudAJbmUNi28rudKX2ymDr1Ml9XC4lse+Tka60c45+YQpwYUWd0KkKzTYB+jZmTWMlxlNQA8+X6Da4Q==',key_name='tempest-keypair-747651893',keypairs=<?>,launch_index=0,launched_at=2023-10-18T12:09:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b56d8b29004d4bf5b0e67efba6520cbd',ramdisk_id='',reservation_id='r-k2uqj2ty',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-29120776',owner_user_name='tempest-TestServerVolumeAttachmentScenario-29120776-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T12:09:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90dc927061594985a654a4a504c59c03',uuid=800d5074-2de1-44ce-8f4a-9a7f5ed110c0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "05810ade-2f7b-4af2-9ed7-f6a70d3842ac", "address": "fa:16:3e:36:22:ee", "network": {"id": "3514ef75-5cb7-47ea-a384-9cae2c8347a9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2048313931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b56d8b29004d4bf5b0e67efba6520cbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05810ade-2f", "ovs_interfaceid": "05810ade-2f7b-4af2-9ed7-f6a70d3842ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 12:14:20 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-888cc9df-f6cf-4c2e-b19c-1aa114c6b5a2 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Converting VIF {"id": "05810ade-2f7b-4af2-9ed7-f6a70d3842ac", "address": "fa:16:3e:36:22:ee", "network": {"id": "3514ef75-5cb7-47ea-a384-9cae2c8347a9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2048313931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b56d8b29004d4bf5b0e67efba6520cbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05810ade-2f", "ovs_interfaceid": "05810ade-2f7b-4af2-9ed7-f6a70d3842ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 12:14:20 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-888cc9df-f6cf-4c2e-b19c-1aa114c6b5a2 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:36:22:ee,bridge_name='br-int',has_traffic_filtering=True,id=05810ade-2f7b-4af2-9ed7-f6a70d3842ac,network=Network(3514ef75-5cb7-47ea-a384-9cae2c8347a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05810ade-2f') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 12:14:20 user nova-compute[74190]: DEBUG os_vif [None req-888cc9df-f6cf-4c2e-b19c-1aa114c6b5a2 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:22:ee,bridge_name='br-int',has_traffic_filtering=True,id=05810ade-2f7b-4af2-9ed7-f6a70d3842ac,network=Network(3514ef75-5cb7-47ea-a384-9cae2c8347a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05810ade-2f') {{(pid=74190) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 12:14:20 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:14:20 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap05810ade-2f, bridge=br-int, if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:14:20 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:14:20 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:14:20 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0fa0d312-0179-4a68-9c2c-4578acbac05c) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:14:20 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:14:20 user nova-compute[74190]: INFO os_vif [None req-888cc9df-f6cf-4c2e-b19c-1aa114c6b5a2 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:22:ee,bridge_name='br-int',has_traffic_filtering=True,id=05810ade-2f7b-4af2-9ed7-f6a70d3842ac,network=Network(3514ef75-5cb7-47ea-a384-9cae2c8347a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05810ade-2f')
Oct 18 12:14:20 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-888cc9df-f6cf-4c2e-b19c-1aa114c6b5a2 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] [instance: 800d5074-2de1-44ce-8f4a-9a7f5ed110c0] Deleting instance files /opt/stack/data/nova/instances/800d5074-2de1-44ce-8f4a-9a7f5ed110c0_del
Oct 18 12:14:20 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-888cc9df-f6cf-4c2e-b19c-1aa114c6b5a2 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] [instance: 800d5074-2de1-44ce-8f4a-9a7f5ed110c0] Deletion of /opt/stack/data/nova/instances/800d5074-2de1-44ce-8f4a-9a7f5ed110c0_del complete
Oct 18 12:14:20 user nova-compute[74190]: INFO nova.compute.manager [None req-888cc9df-f6cf-4c2e-b19c-1aa114c6b5a2 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] [instance: 800d5074-2de1-44ce-8f4a-9a7f5ed110c0] Took 0.88 seconds to destroy the instance on the hypervisor.
Oct 18 12:14:20 user nova-compute[74190]: DEBUG oslo.service.loopingcall [None req-888cc9df-f6cf-4c2e-b19c-1aa114c6b5a2 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74190) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 12:14:20 user nova-compute[74190]: DEBUG nova.compute.manager [-] [instance: 800d5074-2de1-44ce-8f4a-9a7f5ed110c0] Deallocating network for instance {{(pid=74190) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 12:14:20 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: 800d5074-2de1-44ce-8f4a-9a7f5ed110c0] deallocate_for_instance() {{(pid=74190) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 12:14:21 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: 800d5074-2de1-44ce-8f4a-9a7f5ed110c0] Updating instance_info_cache with network_info: [] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:14:21 user nova-compute[74190]: INFO nova.compute.manager [-] [instance: 800d5074-2de1-44ce-8f4a-9a7f5ed110c0] Took 0.82 seconds to deallocate network for instance.
Oct 18 12:14:21 user nova-compute[74190]: DEBUG nova.compute.manager [req-c2619da1-c5d6-4fca-9db8-485148fba7dd req-a2a6ef73-9ec2-4d39-bc16-88405d09aa94 service nova] [instance: 800d5074-2de1-44ce-8f4a-9a7f5ed110c0] Received event network-vif-deleted-05810ade-2f7b-4af2-9ed7-f6a70d3842ac {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:14:21 user nova-compute[74190]: INFO nova.compute.manager [req-c2619da1-c5d6-4fca-9db8-485148fba7dd req-a2a6ef73-9ec2-4d39-bc16-88405d09aa94 service nova] [instance: 800d5074-2de1-44ce-8f4a-9a7f5ed110c0] Neutron deleted interface 05810ade-2f7b-4af2-9ed7-f6a70d3842ac; detaching it from the instance and deleting it from the info cache
Oct 18 12:14:21 user nova-compute[74190]: DEBUG nova.network.neutron [req-c2619da1-c5d6-4fca-9db8-485148fba7dd req-a2a6ef73-9ec2-4d39-bc16-88405d09aa94 service nova] [instance: 800d5074-2de1-44ce-8f4a-9a7f5ed110c0] Updating instance_info_cache with network_info: [] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:14:21 user nova-compute[74190]: DEBUG nova.compute.manager [req-c2619da1-c5d6-4fca-9db8-485148fba7dd req-a2a6ef73-9ec2-4d39-bc16-88405d09aa94 service nova] [instance: 800d5074-2de1-44ce-8f4a-9a7f5ed110c0] Detach interface failed, port_id=05810ade-2f7b-4af2-9ed7-f6a70d3842ac, reason: Instance 800d5074-2de1-44ce-8f4a-9a7f5ed110c0 could not be found. {{(pid=74190) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 18 12:14:21 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-888cc9df-f6cf-4c2e-b19c-1aa114c6b5a2 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:14:21 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-888cc9df-f6cf-4c2e-b19c-1aa114c6b5a2 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:14:22 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:14:22 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-888cc9df-f6cf-4c2e-b19c-1aa114c6b5a2 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 12:14:22 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-888cc9df-f6cf-4c2e-b19c-1aa114c6b5a2 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 12:14:22 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-888cc9df-f6cf-4c2e-b19c-1aa114c6b5a2 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.257s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:14:22 user nova-compute[74190]: INFO nova.scheduler.client.report [None req-888cc9df-f6cf-4c2e-b19c-1aa114c6b5a2 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Deleted allocations for instance 800d5074-2de1-44ce-8f4a-9a7f5ed110c0
Oct 18 12:14:22 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-888cc9df-f6cf-4c2e-b19c-1aa114c6b5a2 tempest-TestServerVolumeAttachmentScenario-29120776 tempest-TestServerVolumeAttachmentScenario-29120776-project-member] Lock "800d5074-2de1-44ce-8f4a-9a7f5ed110c0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.191s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:14:22 user nova-compute[74190]: DEBUG nova.compute.manager [req-cb4d03f0-afa7-43af-b82c-9c4e70205258 req-b379e468-caae-427b-9734-f29139518ff3 service nova] [instance: 800d5074-2de1-44ce-8f4a-9a7f5ed110c0] Received event network-vif-plugged-05810ade-2f7b-4af2-9ed7-f6a70d3842ac {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:14:22 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-cb4d03f0-afa7-43af-b82c-9c4e70205258 req-b379e468-caae-427b-9734-f29139518ff3 service nova] Acquiring lock "800d5074-2de1-44ce-8f4a-9a7f5ed110c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:14:22 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-cb4d03f0-afa7-43af-b82c-9c4e70205258 req-b379e468-caae-427b-9734-f29139518ff3 service nova] Lock "800d5074-2de1-44ce-8f4a-9a7f5ed110c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:14:22 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-cb4d03f0-afa7-43af-b82c-9c4e70205258 req-b379e468-caae-427b-9734-f29139518ff3 service nova] Lock "800d5074-2de1-44ce-8f4a-9a7f5ed110c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:14:22 user nova-compute[74190]: DEBUG nova.compute.manager [req-cb4d03f0-afa7-43af-b82c-9c4e70205258 req-b379e468-caae-427b-9734-f29139518ff3 service nova] [instance: 800d5074-2de1-44ce-8f4a-9a7f5ed110c0] No waiting events found dispatching network-vif-plugged-05810ade-2f7b-4af2-9ed7-f6a70d3842ac {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:14:22 user nova-compute[74190]: WARNING nova.compute.manager [req-cb4d03f0-afa7-43af-b82c-9c4e70205258 req-b379e468-caae-427b-9734-f29139518ff3 service nova] [instance: 800d5074-2de1-44ce-8f4a-9a7f5ed110c0] Received unexpected event network-vif-plugged-05810ade-2f7b-4af2-9ed7-f6a70d3842ac for instance with vm_state deleted and task_state None.
Oct 18 12:14:24 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:14:24 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Starting heal instance info cache {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 12:14:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "refresh_cache-b1e27a16-43e4-4e80-9c0a-5c2dce06daae" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:14:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquired lock "refresh_cache-b1e27a16-43e4-4e80-9c0a-5c2dce06daae" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:14:24 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: b1e27a16-43e4-4e80-9c0a-5c2dce06daae] Forcefully refreshing network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 18 12:14:24 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: b1e27a16-43e4-4e80-9c0a-5c2dce06daae] Updating instance_info_cache with network_info: [{"id": "3d3e9708-ec6a-4fd9-853a-2f492a488a32", "address": "fa:16:3e:3d:c4:83", "network": {"id": "c2dbbd24-f1d2-47a2-835f-0f9b24b585f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-920140900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d994366010142519ff367fa7ca77e61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d3e9708-ec", "ovs_interfaceid": "3d3e9708-ec6a-4fd9-853a-2f492a488a32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:14:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Releasing lock "refresh_cache-b1e27a16-43e4-4e80-9c0a-5c2dce06daae" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:14:24 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: b1e27a16-43e4-4e80-9c0a-5c2dce06daae] Updated the network info_cache for instance {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 18 12:14:24 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:14:24 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:14:24 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:14:24 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74190) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 12:14:24 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:14:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-22bb69d7-a13b-4750-8386-865385a9415d tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Acquiring lock "f4f9eac7-b9ed-42a7-890b-79da3afe46a1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:14:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-22bb69d7-a13b-4750-8386-865385a9415d tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Lock "f4f9eac7-b9ed-42a7-890b-79da3afe46a1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:14:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:14:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:14:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:14:24 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Auditing locally available compute resources for user (node: user) {{(pid=74190) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 12:14:24 user nova-compute[74190]: DEBUG nova.compute.manager [None req-22bb69d7-a13b-4750-8386-865385a9415d tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] [instance: f4f9eac7-b9ed-42a7-890b-79da3afe46a1] Starting instance... {{(pid=74190) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 12:14:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-22bb69d7-a13b-4750-8386-865385a9415d tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:14:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-22bb69d7-a13b-4750-8386-865385a9415d tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:14:24 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-22bb69d7-a13b-4750-8386-865385a9415d tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74190) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 12:14:24 user nova-compute[74190]: INFO nova.compute.claims [None req-22bb69d7-a13b-4750-8386-865385a9415d tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] [instance: f4f9eac7-b9ed-42a7-890b-79da3afe46a1] Claim successful on node user
Oct 18 12:14:24 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1e27a16-43e4-4e80-9c0a-5c2dce06daae/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:14:24 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1e27a16-43e4-4e80-9c0a-5c2dce06daae/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:14:24 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1e27a16-43e4-4e80-9c0a-5c2dce06daae/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:14:25 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-22bb69d7-a13b-4750-8386-865385a9415d tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 12:14:25 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-22bb69d7-a13b-4750-8386-865385a9415d tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 12:14:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1e27a16-43e4-4e80-9c0a-5c2dce06daae/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:14:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:14:25 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-22bb69d7-a13b-4750-8386-865385a9415d tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.550s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:14:25 user nova-compute[74190]: DEBUG nova.compute.manager [None req-22bb69d7-a13b-4750-8386-865385a9415d tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] [instance: f4f9eac7-b9ed-42a7-890b-79da3afe46a1] Start building networks asynchronously for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 12:14:25 user nova-compute[74190]: DEBUG nova.compute.manager [None req-22bb69d7-a13b-4750-8386-865385a9415d tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] [instance: f4f9eac7-b9ed-42a7-890b-79da3afe46a1] Allocating IP information in the background. {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 12:14:25 user nova-compute[74190]: DEBUG nova.network.neutron [None req-22bb69d7-a13b-4750-8386-865385a9415d tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] [instance: f4f9eac7-b9ed-42a7-890b-79da3afe46a1] allocate_for_instance() {{(pid=74190) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 12:14:25 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-22bb69d7-a13b-4750-8386-865385a9415d tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] [instance: f4f9eac7-b9ed-42a7-890b-79da3afe46a1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 12:14:25 user nova-compute[74190]: DEBUG nova.compute.manager [None req-22bb69d7-a13b-4750-8386-865385a9415d tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] [instance: f4f9eac7-b9ed-42a7-890b-79da3afe46a1] Start building block device mappings for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 12:14:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:14:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:14:25 user nova-compute[74190]: DEBUG nova.policy [None req-22bb69d7-a13b-4750-8386-865385a9415d tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'abbdcac234ac48acbc56abf3fda115e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84b62d410cc448486b792e094464815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74190) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 12:14:25 user nova-compute[74190]: DEBUG nova.compute.manager [None req-22bb69d7-a13b-4750-8386-865385a9415d tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] [instance: f4f9eac7-b9ed-42a7-890b-79da3afe46a1] Start spawning the instance on the hypervisor. {{(pid=74190) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 12:14:25 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-22bb69d7-a13b-4750-8386-865385a9415d tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] [instance: f4f9eac7-b9ed-42a7-890b-79da3afe46a1] Creating instance directory {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 12:14:25 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-22bb69d7-a13b-4750-8386-865385a9415d tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] [instance: f4f9eac7-b9ed-42a7-890b-79da3afe46a1] Creating image(s)
Oct 18 12:14:25 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-22bb69d7-a13b-4750-8386-865385a9415d tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Acquiring lock "/opt/stack/data/nova/instances/f4f9eac7-b9ed-42a7-890b-79da3afe46a1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:14:25 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-22bb69d7-a13b-4750-8386-865385a9415d tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Lock "/opt/stack/data/nova/instances/f4f9eac7-b9ed-42a7-890b-79da3afe46a1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:14:25 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-22bb69d7-a13b-4750-8386-865385a9415d tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Lock "/opt/stack/data/nova/instances/f4f9eac7-b9ed-42a7-890b-79da3afe46a1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:14:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-22bb69d7-a13b-4750-8386-865385a9415d tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:14:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:14:25 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 12:14:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0309a457-dae8-4a13-ac5c-53e2320930ff/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:14:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-22bb69d7-a13b-4750-8386-865385a9415d tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.179s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:14:25 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-22bb69d7-a13b-4750-8386-865385a9415d tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Acquiring lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:14:25 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-22bb69d7-a13b-4750-8386-865385a9415d tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:14:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-22bb69d7-a13b-4750-8386-865385a9415d tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:14:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0309a457-dae8-4a13-ac5c-53e2320930ff/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:14:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0309a457-dae8-4a13-ac5c-53e2320930ff/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:14:25 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:14:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-22bb69d7-a13b-4750-8386-865385a9415d tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.173s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:14:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-22bb69d7-a13b-4750-8386-865385a9415d tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f,backing_fmt=raw /opt/stack/data/nova/instances/f4f9eac7-b9ed-42a7-890b-79da3afe46a1/disk 1073741824 {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:14:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0309a457-dae8-4a13-ac5c-53e2320930ff/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:14:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-22bb69d7-a13b-4750-8386-865385a9415d tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f,backing_fmt=raw /opt/stack/data/nova/instances/f4f9eac7-b9ed-42a7-890b-79da3afe46a1/disk 1073741824" returned: 0 in 0.053s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:14:26 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-22bb69d7-a13b-4750-8386-865385a9415d tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:14:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-22bb69d7-a13b-4750-8386-865385a9415d tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:14:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7983ceaf-8ed3-4321-a242-2e44218f4d0b/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:14:26 user nova-compute[74190]: DEBUG nova.network.neutron [None req-22bb69d7-a13b-4750-8386-865385a9415d tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] [instance: f4f9eac7-b9ed-42a7-890b-79da3afe46a1] Successfully created port: 84228aca-9249-4ed5-8774-629e3b1b82d8 {{(pid=74190) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 12:14:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-22bb69d7-a13b-4750-8386-865385a9415d tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.184s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:14:26 user nova-compute[74190]: DEBUG nova.virt.disk.api [None req-22bb69d7-a13b-4750-8386-865385a9415d tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f4f9eac7-b9ed-42a7-890b-79da3afe46a1/disk. size=1073741824 {{(pid=74190) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 18 12:14:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-22bb69d7-a13b-4750-8386-865385a9415d tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f9eac7-b9ed-42a7-890b-79da3afe46a1/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:14:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7983ceaf-8ed3-4321-a242-2e44218f4d0b/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:14:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7983ceaf-8ed3-4321-a242-2e44218f4d0b/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:14:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-22bb69d7-a13b-4750-8386-865385a9415d tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f9eac7-b9ed-42a7-890b-79da3afe46a1/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:14:26 user nova-compute[74190]: DEBUG nova.virt.disk.api [None req-22bb69d7-a13b-4750-8386-865385a9415d tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Cannot resize image /opt/stack/data/nova/instances/f4f9eac7-b9ed-42a7-890b-79da3afe46a1/disk to a smaller size. {{(pid=74190) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 18 12:14:26 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-22bb69d7-a13b-4750-8386-865385a9415d tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] [instance: f4f9eac7-b9ed-42a7-890b-79da3afe46a1] Created local disks {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 12:14:26 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-22bb69d7-a13b-4750-8386-865385a9415d tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] [instance: f4f9eac7-b9ed-42a7-890b-79da3afe46a1] Ensure instance console log exists: /opt/stack/data/nova/instances/f4f9eac7-b9ed-42a7-890b-79da3afe46a1/console.log {{(pid=74190) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 12:14:26 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-22bb69d7-a13b-4750-8386-865385a9415d tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:14:26 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-22bb69d7-a13b-4750-8386-865385a9415d tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:14:26 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-22bb69d7-a13b-4750-8386-865385a9415d tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:14:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7983ceaf-8ed3-4321-a242-2e44218f4d0b/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:14:26 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 12:14:26 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:14:26 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:14:26 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Hypervisor/Node resource view: name=user free_ram=8303MB free_disk=24.999446868896484GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74190) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 12:14:26 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:14:26 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:14:26 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 772b126c-2148-4ca8-90f2-69d6eb4b7db7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:14:26 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 0382820d-a678-4593-85df-168f42fc4ce4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:14:26 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance b1e27a16-43e4-4e80-9c0a-5c2dce06daae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:14:26 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 7c539213-358a-48fd-9abd-1f017ba5b54a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:14:26 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 7983ceaf-8ed3-4321-a242-2e44218f4d0b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:14:26 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 0309a457-dae8-4a13-ac5c-53e2320930ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:14:26 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance f4f9eac7-b9ed-42a7-890b-79da3afe46a1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:14:26 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 12:14:26 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 12:14:27 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 12:14:27 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 12:14:27 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Compute_service record updated for user:user {{(pid=74190) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 12:14:27 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.373s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:14:27 user nova-compute[74190]: DEBUG nova.network.neutron [None req-22bb69d7-a13b-4750-8386-865385a9415d tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] [instance: f4f9eac7-b9ed-42a7-890b-79da3afe46a1] Successfully updated port: 84228aca-9249-4ed5-8774-629e3b1b82d8 {{(pid=74190) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 12:14:27 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-22bb69d7-a13b-4750-8386-865385a9415d tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Acquiring lock "refresh_cache-f4f9eac7-b9ed-42a7-890b-79da3afe46a1" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:14:27 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-22bb69d7-a13b-4750-8386-865385a9415d tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Acquired lock "refresh_cache-f4f9eac7-b9ed-42a7-890b-79da3afe46a1" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:14:27 user nova-compute[74190]: DEBUG nova.network.neutron [None req-22bb69d7-a13b-4750-8386-865385a9415d tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] [instance: f4f9eac7-b9ed-42a7-890b-79da3afe46a1] Building network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 12:14:27 user nova-compute[74190]: DEBUG nova.network.neutron [None req-22bb69d7-a13b-4750-8386-865385a9415d tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] [instance: f4f9eac7-b9ed-42a7-890b-79da3afe46a1] Instance cache missing network info. {{(pid=74190) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 12:14:27 user nova-compute[74190]: DEBUG nova.compute.manager [req-f3b85810-0dce-4a40-95d4-b11e36f702d2 req-a4cbee44-6656-4d7f-bc21-e37300f878bf service nova] [instance: f4f9eac7-b9ed-42a7-890b-79da3afe46a1] Received event network-changed-84228aca-9249-4ed5-8774-629e3b1b82d8 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:14:27 user nova-compute[74190]: DEBUG nova.compute.manager [req-f3b85810-0dce-4a40-95d4-b11e36f702d2 req-a4cbee44-6656-4d7f-bc21-e37300f878bf service nova] [instance: f4f9eac7-b9ed-42a7-890b-79da3afe46a1] Refreshing instance network info cache due to event network-changed-84228aca-9249-4ed5-8774-629e3b1b82d8. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 12:14:27 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-f3b85810-0dce-4a40-95d4-b11e36f702d2 req-a4cbee44-6656-4d7f-bc21-e37300f878bf service nova] Acquiring lock "refresh_cache-f4f9eac7-b9ed-42a7-890b-79da3afe46a1" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:14:27 user nova-compute[74190]: DEBUG nova.network.neutron [None req-22bb69d7-a13b-4750-8386-865385a9415d tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] [instance: f4f9eac7-b9ed-42a7-890b-79da3afe46a1] Updating instance_info_cache with network_info: [{"id": "84228aca-9249-4ed5-8774-629e3b1b82d8", "address": "fa:16:3e:6e:6b:55", "network": {"id": "31e59f3e-dc25-4b00-9d87-4b4f695425b8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-220402675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f84b62d410cc448486b792e094464815", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84228aca-92", "ovs_interfaceid": "84228aca-9249-4ed5-8774-629e3b1b82d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:14:27 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-22bb69d7-a13b-4750-8386-865385a9415d tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Releasing lock "refresh_cache-f4f9eac7-b9ed-42a7-890b-79da3afe46a1" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:14:27 user nova-compute[74190]: DEBUG nova.compute.manager [None req-22bb69d7-a13b-4750-8386-865385a9415d tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] [instance: f4f9eac7-b9ed-42a7-890b-79da3afe46a1] Instance network_info: |[{"id": "84228aca-9249-4ed5-8774-629e3b1b82d8", "address": "fa:16:3e:6e:6b:55", "network": {"id": "31e59f3e-dc25-4b00-9d87-4b4f695425b8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-220402675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f84b62d410cc448486b792e094464815", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84228aca-92", "ovs_interfaceid": "84228aca-9249-4ed5-8774-629e3b1b82d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 12:14:27 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-f3b85810-0dce-4a40-95d4-b11e36f702d2 req-a4cbee44-6656-4d7f-bc21-e37300f878bf service nova] Acquired lock "refresh_cache-f4f9eac7-b9ed-42a7-890b-79da3afe46a1" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:14:27 user nova-compute[74190]: DEBUG nova.network.neutron [req-f3b85810-0dce-4a40-95d4-b11e36f702d2 req-a4cbee44-6656-4d7f-bc21-e37300f878bf service nova] [instance: f4f9eac7-b9ed-42a7-890b-79da3afe46a1] Refreshing network info cache for port 84228aca-9249-4ed5-8774-629e3b1b82d8 {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 12:14:27 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-22bb69d7-a13b-4750-8386-865385a9415d tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] [instance: f4f9eac7-b9ed-42a7-890b-79da3afe46a1] Start _get_guest_xml network_info=[{"id": "84228aca-9249-4ed5-8774-629e3b1b82d8", "address": "fa:16:3e:6e:6b:55", "network": {"id": "31e59f3e-dc25-4b00-9d87-4b4f695425b8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-220402675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f84b62d410cc448486b792e094464815", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84228aca-92", "ovs_interfaceid": "84228aca-9249-4ed5-8774-629e3b1b82d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'image_id': '6e88bbf0-6e78-49a8-b3c5-9453d22a89df'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 12:14:27 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-22bb69d7-a13b-4750-8386-865385a9415d tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:14:27 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-22bb69d7-a13b-4750-8386-865385a9415d tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:14:27 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-22bb69d7-a13b-4750-8386-865385a9415d tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 12:14:27 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-22bb69d7-a13b-4750-8386-865385a9415d tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] CPU controller missing on host. {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 12:14:27 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-22bb69d7-a13b-4750-8386-865385a9415d tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 12:14:27 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-22bb69d7-a13b-4750-8386-865385a9415d tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] CPU controller found on host. {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 12:14:27 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-22bb69d7-a13b-4750-8386-865385a9415d tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74190) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 12:14:27 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-22bb69d7-a13b-4750-8386-865385a9415d tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T11:37:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 12:14:27 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-22bb69d7-a13b-4750-8386-865385a9415d tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Flavor limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 12:14:27 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-22bb69d7-a13b-4750-8386-865385a9415d tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Image limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 12:14:27 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-22bb69d7-a13b-4750-8386-865385a9415d tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Flavor pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 12:14:27 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-22bb69d7-a13b-4750-8386-865385a9415d tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Image pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 12:14:27 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-22bb69d7-a13b-4750-8386-865385a9415d tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 12:14:27 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-22bb69d7-a13b-4750-8386-865385a9415d tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 12:14:27 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-22bb69d7-a13b-4750-8386-865385a9415d tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 12:14:27 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-22bb69d7-a13b-4750-8386-865385a9415d tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Got 1 possible topologies {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 12:14:27 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-22bb69d7-a13b-4750-8386-865385a9415d tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 12:14:27 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-22bb69d7-a13b-4750-8386-865385a9415d tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 12:14:27 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-22bb69d7-a13b-4750-8386-865385a9415d tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T12:14:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1043341434',display_name='tempest-ServersNegativeTestJSON-server-1043341434',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1043341434',id=46,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f84b62d410cc448486b792e094464815',ramdisk_id='',reservation_id='r-666gnm5e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1845899853',owner_user_name='tempest-ServersNegativeTestJSON-1845899853-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T12:14:25Z,user_data=None,user_id='abbdcac234ac48acbc56abf3fda115e5',uuid=f4f9eac7-b9ed-42a7-890b-79da3afe46a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84228aca-9249-4ed5-8774-629e3b1b82d8", "address": "fa:16:3e:6e:6b:55", "network": {"id": "31e59f3e-dc25-4b00-9d87-4b4f695425b8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-220402675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f84b62d410cc448486b792e094464815", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84228aca-92", "ovs_interfaceid": "84228aca-9249-4ed5-8774-629e3b1b82d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74190) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 12:14:27 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-22bb69d7-a13b-4750-8386-865385a9415d tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Converting VIF {"id": "84228aca-9249-4ed5-8774-629e3b1b82d8", "address": "fa:16:3e:6e:6b:55", "network": {"id": "31e59f3e-dc25-4b00-9d87-4b4f695425b8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-220402675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f84b62d410cc448486b792e094464815", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84228aca-92", "ovs_interfaceid": "84228aca-9249-4ed5-8774-629e3b1b82d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 12:14:27 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-22bb69d7-a13b-4750-8386-865385a9415d tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:6b:55,bridge_name='br-int',has_traffic_filtering=True,id=84228aca-9249-4ed5-8774-629e3b1b82d8,network=Network(31e59f3e-dc25-4b00-9d87-4b4f695425b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84228aca-92') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 12:14:27 user nova-compute[74190]: DEBUG nova.objects.instance [None req-22bb69d7-a13b-4750-8386-865385a9415d tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Lazy-loading 'pci_devices' on Instance uuid f4f9eac7-b9ed-42a7-890b-79da3afe46a1 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:14:27 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-22bb69d7-a13b-4750-8386-865385a9415d tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] [instance: f4f9eac7-b9ed-42a7-890b-79da3afe46a1] End _get_guest_xml xml=<domain type="kvm">
Oct 18 12:14:27 user nova-compute[74190]:   <uuid>f4f9eac7-b9ed-42a7-890b-79da3afe46a1</uuid>
Oct 18 12:14:27 user nova-compute[74190]:   <name>instance-0000002e</name>
Oct 18 12:14:27 user nova-compute[74190]:   <memory>524288</memory>
Oct 18 12:14:27 user nova-compute[74190]:   <vcpu>1</vcpu>
Oct 18 12:14:27 user nova-compute[74190]:   <metadata>
Oct 18 12:14:27 user nova-compute[74190]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 12:14:27 user nova-compute[74190]:       <nova:package version="0.0.0"/>
Oct 18 12:14:27 user nova-compute[74190]:       <nova:name>tempest-ServersNegativeTestJSON-server-1043341434</nova:name>
Oct 18 12:14:27 user nova-compute[74190]:       <nova:creationTime>2023-10-18 12:14:27</nova:creationTime>
Oct 18 12:14:27 user nova-compute[74190]:       <nova:flavor name="m1.tiny">
Oct 18 12:14:27 user nova-compute[74190]:         <nova:memory>512</nova:memory>
Oct 18 12:14:27 user nova-compute[74190]:         <nova:disk>1</nova:disk>
Oct 18 12:14:27 user nova-compute[74190]:         <nova:swap>0</nova:swap>
Oct 18 12:14:27 user nova-compute[74190]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 12:14:27 user nova-compute[74190]:         <nova:vcpus>1</nova:vcpus>
Oct 18 12:14:27 user nova-compute[74190]:       </nova:flavor>
Oct 18 12:14:27 user nova-compute[74190]:       <nova:owner>
Oct 18 12:14:27 user nova-compute[74190]:         <nova:user uuid="abbdcac234ac48acbc56abf3fda115e5">tempest-ServersNegativeTestJSON-1845899853-project-member</nova:user>
Oct 18 12:14:27 user nova-compute[74190]:         <nova:project uuid="f84b62d410cc448486b792e094464815">tempest-ServersNegativeTestJSON-1845899853</nova:project>
Oct 18 12:14:27 user nova-compute[74190]:       </nova:owner>
Oct 18 12:14:27 user nova-compute[74190]:       <nova:root type="image" uuid="6e88bbf0-6e78-49a8-b3c5-9453d22a89df"/>
Oct 18 12:14:27 user nova-compute[74190]:       <nova:ports>
Oct 18 12:14:27 user nova-compute[74190]:         <nova:port uuid="84228aca-9249-4ed5-8774-629e3b1b82d8">
Oct 18 12:14:27 user nova-compute[74190]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 18 12:14:27 user nova-compute[74190]:         </nova:port>
Oct 18 12:14:27 user nova-compute[74190]:       </nova:ports>
Oct 18 12:14:27 user nova-compute[74190]:     </nova:instance>
Oct 18 12:14:27 user nova-compute[74190]:   </metadata>
Oct 18 12:14:27 user nova-compute[74190]:   <sysinfo type="smbios">
Oct 18 12:14:27 user nova-compute[74190]:     <system>
Oct 18 12:14:27 user nova-compute[74190]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 12:14:27 user nova-compute[74190]:       <entry name="product">OpenStack Nova</entry>
Oct 18 12:14:27 user nova-compute[74190]:       <entry name="version">0.0.0</entry>
Oct 18 12:14:27 user nova-compute[74190]:       <entry name="serial">f4f9eac7-b9ed-42a7-890b-79da3afe46a1</entry>
Oct 18 12:14:27 user nova-compute[74190]:       <entry name="uuid">f4f9eac7-b9ed-42a7-890b-79da3afe46a1</entry>
Oct 18 12:14:27 user nova-compute[74190]:       <entry name="family">Virtual Machine</entry>
Oct 18 12:14:27 user nova-compute[74190]:     </system>
Oct 18 12:14:27 user nova-compute[74190]:   </sysinfo>
Oct 18 12:14:27 user nova-compute[74190]:   <os>
Oct 18 12:14:27 user nova-compute[74190]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 12:14:27 user nova-compute[74190]:     <boot dev="hd"/>
Oct 18 12:14:27 user nova-compute[74190]:     <smbios mode="sysinfo"/>
Oct 18 12:14:27 user nova-compute[74190]:   </os>
Oct 18 12:14:27 user nova-compute[74190]:   <features>
Oct 18 12:14:27 user nova-compute[74190]:     <acpi/>
Oct 18 12:14:27 user nova-compute[74190]:     <apic/>
Oct 18 12:14:27 user nova-compute[74190]:     <vmcoreinfo/>
Oct 18 12:14:27 user nova-compute[74190]:   </features>
Oct 18 12:14:27 user nova-compute[74190]:   <clock offset="utc">
Oct 18 12:14:27 user nova-compute[74190]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 12:14:27 user nova-compute[74190]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 12:14:27 user nova-compute[74190]:     <timer name="hpet" present="no"/>
Oct 18 12:14:27 user nova-compute[74190]:   </clock>
Oct 18 12:14:27 user nova-compute[74190]:   <cpu mode="custom" match="exact">
Oct 18 12:14:27 user nova-compute[74190]:     <model>Nehalem</model>
Oct 18 12:14:27 user nova-compute[74190]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 12:14:27 user nova-compute[74190]:   </cpu>
Oct 18 12:14:27 user nova-compute[74190]:   <devices>
Oct 18 12:14:27 user nova-compute[74190]:     <disk type="file" device="disk">
Oct 18 12:14:27 user nova-compute[74190]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 12:14:27 user nova-compute[74190]:       <source file="/opt/stack/data/nova/instances/f4f9eac7-b9ed-42a7-890b-79da3afe46a1/disk"/>
Oct 18 12:14:27 user nova-compute[74190]:       <target dev="vda" bus="virtio"/>
Oct 18 12:14:27 user nova-compute[74190]:     </disk>
Oct 18 12:14:27 user nova-compute[74190]:     <interface type="ethernet">
Oct 18 12:14:27 user nova-compute[74190]:       <mac address="fa:16:3e:6e:6b:55"/>
Oct 18 12:14:27 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 12:14:27 user nova-compute[74190]:       <mtu size="1442"/>
Oct 18 12:14:27 user nova-compute[74190]:       <target dev="tap84228aca-92"/>
Oct 18 12:14:27 user nova-compute[74190]:     </interface>
Oct 18 12:14:27 user nova-compute[74190]:     <serial type="pty">
Oct 18 12:14:27 user nova-compute[74190]:       <log file="/opt/stack/data/nova/instances/f4f9eac7-b9ed-42a7-890b-79da3afe46a1/console.log" append="off"/>
Oct 18 12:14:27 user nova-compute[74190]:     </serial>
Oct 18 12:14:27 user nova-compute[74190]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 12:14:27 user nova-compute[74190]:     <video>
Oct 18 12:14:27 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 12:14:27 user nova-compute[74190]:     </video>
Oct 18 12:14:27 user nova-compute[74190]:     <rng model="virtio">
Oct 18 12:14:27 user nova-compute[74190]:       <backend model="random">/dev/urandom</backend>
Oct 18 12:14:27 user nova-compute[74190]:     </rng>
Oct 18 12:14:27 user nova-compute[74190]:     <controller type="usb" index="0" model="none"/>
Oct 18 12:14:27 user nova-compute[74190]:     <memballoon model="virtio">
Oct 18 12:14:27 user nova-compute[74190]:       <stats period="10"/>
Oct 18 12:14:27 user nova-compute[74190]:     </memballoon>
Oct 18 12:14:27 user nova-compute[74190]:   </devices>
Oct 18 12:14:27 user nova-compute[74190]: </domain>
Oct 18 12:14:27 user nova-compute[74190]:  {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 12:14:27 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-22bb69d7-a13b-4750-8386-865385a9415d tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T12:14:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1043341434',display_name='tempest-ServersNegativeTestJSON-server-1043341434',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1043341434',id=46,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f84b62d410cc448486b792e094464815',ramdisk_id='',reservation_id='r-666gnm5e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1845899853',owner_user_name='tempest-ServersNegativeTestJSON-1845899853-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T12:14:25Z,user_data=None,user_id='abbdcac234ac48acbc56abf3fda115e5',uuid=f4f9eac7-b9ed-42a7-890b-79da3afe46a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84228aca-9249-4ed5-8774-629e3b1b82d8", "address": "fa:16:3e:6e:6b:55", "network": {"id": "31e59f3e-dc25-4b00-9d87-4b4f695425b8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-220402675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f84b62d410cc448486b792e094464815", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84228aca-92", "ovs_interfaceid": "84228aca-9249-4ed5-8774-629e3b1b82d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 12:14:27 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-22bb69d7-a13b-4750-8386-865385a9415d tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Converting VIF {"id": "84228aca-9249-4ed5-8774-629e3b1b82d8", "address": "fa:16:3e:6e:6b:55", "network": {"id": "31e59f3e-dc25-4b00-9d87-4b4f695425b8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-220402675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f84b62d410cc448486b792e094464815", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84228aca-92", "ovs_interfaceid": "84228aca-9249-4ed5-8774-629e3b1b82d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 12:14:27 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-22bb69d7-a13b-4750-8386-865385a9415d tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:6b:55,bridge_name='br-int',has_traffic_filtering=True,id=84228aca-9249-4ed5-8774-629e3b1b82d8,network=Network(31e59f3e-dc25-4b00-9d87-4b4f695425b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84228aca-92') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 12:14:27 user nova-compute[74190]: DEBUG os_vif [None req-22bb69d7-a13b-4750-8386-865385a9415d tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:6b:55,bridge_name='br-int',has_traffic_filtering=True,id=84228aca-9249-4ed5-8774-629e3b1b82d8,network=Network(31e59f3e-dc25-4b00-9d87-4b4f695425b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84228aca-92') {{(pid=74190) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 12:14:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:14:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:14:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 12:14:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:14:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6331c3ef-d821-5a33-b1f0-ae1b3c4c6bd2', '_type': 'linux-noop'}}, row=False) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:14:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:14:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:14:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap84228aca-92, may_exist=True, interface_attrs={}) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:14:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap84228aca-92, col_values=(('qos', UUID('cbea367b-c3f1-46b8-aa80-c64069771520')),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:14:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap84228aca-92, col_values=(('external_ids', {'iface-id': '84228aca-9249-4ed5-8774-629e3b1b82d8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:6b:55', 'vm-uuid': 'f4f9eac7-b9ed-42a7-890b-79da3afe46a1'}),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:14:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:14:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:14:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:14:27 user nova-compute[74190]: INFO os_vif [None req-22bb69d7-a13b-4750-8386-865385a9415d tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:6b:55,bridge_name='br-int',has_traffic_filtering=True,id=84228aca-9249-4ed5-8774-629e3b1b82d8,network=Network(31e59f3e-dc25-4b00-9d87-4b4f695425b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84228aca-92')
Oct 18 12:14:27 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-22bb69d7-a13b-4750-8386-865385a9415d tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] No BDM found with device name vda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 12:14:27 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-22bb69d7-a13b-4750-8386-865385a9415d tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] No VIF found with MAC fa:16:3e:6e:6b:55, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 12:14:27 user nova-compute[74190]: DEBUG nova.network.neutron [req-f3b85810-0dce-4a40-95d4-b11e36f702d2 req-a4cbee44-6656-4d7f-bc21-e37300f878bf service nova] [instance: f4f9eac7-b9ed-42a7-890b-79da3afe46a1] Updated VIF entry in instance network info cache for port 84228aca-9249-4ed5-8774-629e3b1b82d8. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 12:14:27 user nova-compute[74190]: DEBUG nova.network.neutron [req-f3b85810-0dce-4a40-95d4-b11e36f702d2 req-a4cbee44-6656-4d7f-bc21-e37300f878bf service nova] [instance: f4f9eac7-b9ed-42a7-890b-79da3afe46a1] Updating instance_info_cache with network_info: [{"id": "84228aca-9249-4ed5-8774-629e3b1b82d8", "address": "fa:16:3e:6e:6b:55", "network": {"id": "31e59f3e-dc25-4b00-9d87-4b4f695425b8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-220402675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f84b62d410cc448486b792e094464815", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84228aca-92", "ovs_interfaceid": "84228aca-9249-4ed5-8774-629e3b1b82d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:14:27 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-f3b85810-0dce-4a40-95d4-b11e36f702d2 req-a4cbee44-6656-4d7f-bc21-e37300f878bf service nova] Releasing lock "refresh_cache-f4f9eac7-b9ed-42a7-890b-79da3afe46a1" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:14:28 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-33b66301-a5e6-4c50-a17d-880e0feb07ca tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Acquiring lock "7c539213-358a-48fd-9abd-1f017ba5b54a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:14:28 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-33b66301-a5e6-4c50-a17d-880e0feb07ca tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "7c539213-358a-48fd-9abd-1f017ba5b54a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:14:28 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-33b66301-a5e6-4c50-a17d-880e0feb07ca tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Acquiring lock "7c539213-358a-48fd-9abd-1f017ba5b54a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:14:28 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-33b66301-a5e6-4c50-a17d-880e0feb07ca tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "7c539213-358a-48fd-9abd-1f017ba5b54a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:14:28 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-33b66301-a5e6-4c50-a17d-880e0feb07ca tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "7c539213-358a-48fd-9abd-1f017ba5b54a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:14:28 user nova-compute[74190]: INFO nova.compute.manager [None req-33b66301-a5e6-4c50-a17d-880e0feb07ca tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 7c539213-358a-48fd-9abd-1f017ba5b54a] Terminating instance
Oct 18 12:14:28 user nova-compute[74190]: DEBUG nova.compute.manager [None req-33b66301-a5e6-4c50-a17d-880e0feb07ca tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 7c539213-358a-48fd-9abd-1f017ba5b54a] Start destroying the instance on the hypervisor. {{(pid=74190) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 12:14:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:14:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:14:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:14:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:14:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:14:28 user nova-compute[74190]: DEBUG nova.compute.manager [req-a785d25d-acf5-40c3-beb5-b1064644fc91 req-21cb4cdd-c477-44db-93e8-9e043f5b28e8 service nova] [instance: 7c539213-358a-48fd-9abd-1f017ba5b54a] Received event network-vif-unplugged-ecc36cc2-dc28-452e-82f2-0d347537cd36 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:14:28 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-a785d25d-acf5-40c3-beb5-b1064644fc91 req-21cb4cdd-c477-44db-93e8-9e043f5b28e8 service nova] Acquiring lock "7c539213-358a-48fd-9abd-1f017ba5b54a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:14:28 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-a785d25d-acf5-40c3-beb5-b1064644fc91 req-21cb4cdd-c477-44db-93e8-9e043f5b28e8 service nova] Lock "7c539213-358a-48fd-9abd-1f017ba5b54a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:14:28 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-a785d25d-acf5-40c3-beb5-b1064644fc91 req-21cb4cdd-c477-44db-93e8-9e043f5b28e8 service nova] Lock "7c539213-358a-48fd-9abd-1f017ba5b54a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:14:28 user nova-compute[74190]: DEBUG nova.compute.manager [req-a785d25d-acf5-40c3-beb5-b1064644fc91 req-21cb4cdd-c477-44db-93e8-9e043f5b28e8 service nova] [instance: 7c539213-358a-48fd-9abd-1f017ba5b54a] No waiting events found dispatching network-vif-unplugged-ecc36cc2-dc28-452e-82f2-0d347537cd36 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:14:28 user nova-compute[74190]: DEBUG nova.compute.manager [req-a785d25d-acf5-40c3-beb5-b1064644fc91 req-21cb4cdd-c477-44db-93e8-9e043f5b28e8 service nova] [instance: 7c539213-358a-48fd-9abd-1f017ba5b54a] Received event network-vif-unplugged-ecc36cc2-dc28-452e-82f2-0d347537cd36 for instance with task_state deleting. {{(pid=74190) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 12:14:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:14:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:14:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:14:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:14:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:14:29 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 7c539213-358a-48fd-9abd-1f017ba5b54a] Instance destroyed successfully.
Oct 18 12:14:29 user nova-compute[74190]: DEBUG nova.objects.instance [None req-33b66301-a5e6-4c50-a17d-880e0feb07ca tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lazy-loading 'resources' on Instance uuid 7c539213-358a-48fd-9abd-1f017ba5b54a {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:14:29 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-33b66301-a5e6-4c50-a17d-880e0feb07ca tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T12:09:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-627462786',display_name='tempest-TestVolumeBootPattern-volume-backed-server-627462786',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-627462786',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPD7pXmKC8CaPvdQURpfispC+7lrwlqD3/AQ9Y/l0OGwVY4Nz3VBe+js4lCm6r46i3FFzO5vt2JfwVgowtSz1SDn1ikSOBLoccMhZQVaaym3thC2l7DccV5ffWtnfH0wqw==',key_name='tempest-keypair-1486277413',keypairs=<?>,launch_index=0,launched_at=2023-10-18T12:09:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1e375153f6f24827811c5825fc2a2c6a',ramdisk_id='',reservation_id='r-n1o0md0d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1157442382',owner_user_name='tempest-TestVolumeBootPattern-1157442382-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T12:09:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27d9fc244d0f4e10a43b7df4dc8e30ad',uuid=7c539213-358a-48fd-9abd-1f017ba5b54a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ecc36cc2-dc28-452e-82f2-0d347537cd36", "address": "fa:16:3e:0e:31:0c", "network": {"id": "aa827f81-b165-444f-89cc-f21c42a9f772", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1659902586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e375153f6f24827811c5825fc2a2c6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc36cc2-dc", "ovs_interfaceid": "ecc36cc2-dc28-452e-82f2-0d347537cd36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 12:14:29 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-33b66301-a5e6-4c50-a17d-880e0feb07ca tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Converting VIF {"id": "ecc36cc2-dc28-452e-82f2-0d347537cd36", "address": "fa:16:3e:0e:31:0c", "network": {"id": "aa827f81-b165-444f-89cc-f21c42a9f772", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1659902586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e375153f6f24827811c5825fc2a2c6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc36cc2-dc", "ovs_interfaceid": "ecc36cc2-dc28-452e-82f2-0d347537cd36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 12:14:29 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-33b66301-a5e6-4c50-a17d-880e0feb07ca tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0e:31:0c,bridge_name='br-int',has_traffic_filtering=True,id=ecc36cc2-dc28-452e-82f2-0d347537cd36,network=Network(aa827f81-b165-444f-89cc-f21c42a9f772),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecc36cc2-dc') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 12:14:29 user nova-compute[74190]: DEBUG os_vif [None req-33b66301-a5e6-4c50-a17d-880e0feb07ca tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:31:0c,bridge_name='br-int',has_traffic_filtering=True,id=ecc36cc2-dc28-452e-82f2-0d347537cd36,network=Network(aa827f81-b165-444f-89cc-f21c42a9f772),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecc36cc2-dc') {{(pid=74190) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 12:14:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:14:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapecc36cc2-dc, bridge=br-int, if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:14:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:14:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:14:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:14:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:14:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a1661cb0-91aa-4754-b8d0-541c6b6f7a5e) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:14:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:14:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:14:29 user nova-compute[74190]: INFO os_vif [None req-33b66301-a5e6-4c50-a17d-880e0feb07ca tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:31:0c,bridge_name='br-int',has_traffic_filtering=True,id=ecc36cc2-dc28-452e-82f2-0d347537cd36,network=Network(aa827f81-b165-444f-89cc-f21c42a9f772),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecc36cc2-dc')
Oct 18 12:14:29 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33b66301-a5e6-4c50-a17d-880e0feb07ca tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 7c539213-358a-48fd-9abd-1f017ba5b54a] calling os-brick to detach iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 12:14:29 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-33b66301-a5e6-4c50-a17d-880e0feb07ca tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, {'target_iqn': 'iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wKMYEdFo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 12:14:29 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-33b66301-a5e6-4c50-a17d-880e0feb07ca tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 12:14:29 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-33b66301-a5e6-4c50-a17d-880e0feb07ca tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 12:14:29 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-33b66301-a5e6-4c50-a17d-880e0feb07ca tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 12:14:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:14:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:14:29 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a46225d-9800-4ad1-ab55-4bac20502f2a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:14:29 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-33b66301-a5e6-4c50-a17d-880e0feb07ca tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 12:14:29 user nova-compute[74190]: No targets found.
Oct 18 12:14:29 user nova-compute[74190]: iSNS:
Oct 18 12:14:29 user nova-compute[74190]: No targets found.
Oct 18 12:14:29 user nova-compute[74190]: STATIC:
Oct 18 12:14:29 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf
Oct 18 12:14:29 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 12:14:29 user nova-compute[74190]:                 Iface Name: default
Oct 18 12:14:29 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f
Oct 18 12:14:29 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 12:14:29 user nova-compute[74190]:                 Iface Name: default
Oct 18 12:14:29 user nova-compute[74190]: FIRMWARE:
Oct 18 12:14:29 user nova-compute[74190]: No targets found.
Oct 18 12:14:29 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 12:14:29 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-33b66301-a5e6-4c50-a17d-880e0feb07ca tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 12:14:29 user nova-compute[74190]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 12:14:29 user nova-compute[74190]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74190) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 12:14:29 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-33b66301-a5e6-4c50-a17d-880e0feb07ca tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf', 0)] {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 12:14:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:14:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:14:29 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fe34c9e-0aa1-40f4-90ff-6778c2f3da48]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:14:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:14:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:14:29 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa0aaaa-77d6-4bfd-8572-84bd8e5c8e39]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:14:29 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-33b66301-a5e6-4c50-a17d-880e0feb07ca tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)
Oct 18 12:14:29 user nova-compute[74190]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf (non-flash)
Oct 18 12:14:29 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 12:14:29 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-33b66301-a5e6-4c50-a17d-880e0feb07ca tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)
Oct 18 12:14:29 user nova-compute[74190]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf (non-flash)
Oct 18 12:14:29 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 12:14:29 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-33b66301-a5e6-4c50-a17d-880e0feb07ca tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1f44278af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf'): ({'sdd'}, set())}) {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 12:14:29 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-33b66301-a5e6-4c50-a17d-880e0feb07ca tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Removing single pathed devices sdd {{(pid=74190) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 12:14:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:14:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.080s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:14:29 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c87974-0b57-4c74-907e-1e88ac6e1ad1]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:14:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:14:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:14:29 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa48ecb7-612d-4506-b800-0e36d8389653]: (4, ('ok\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:14:29 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-33b66301-a5e6-4c50-a17d-880e0feb07ca tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Flushing IO for device /dev/sdd {{(pid=74190) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 12:14:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:14:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:14:29 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[9057f8fe-df7d-409e-b879-9d41bbef5b58]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:14:29 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-33b66301-a5e6-4c50-a17d-880e0feb07ca tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74190) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 12:14:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:14:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:14:29 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dbfcbdb-5854-4f38-a8fa-df8819e77fa0]: (4, ('1', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:14:29 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-33b66301-a5e6-4c50-a17d-880e0feb07ca tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 12:14:29 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-33b66301-a5e6-4c50-a17d-880e0feb07ca tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] SCSI volumes sdd have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 12:14:29 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-33b66301-a5e6-4c50-a17d-880e0feb07ca tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf')] {{(pid=74190) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 12:14:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:14:30 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:14:30 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[615619ab-cd8b-40c1-974f-1f5664cd8778]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:14:30 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-33b66301-a5e6-4c50-a17d-880e0feb07ca tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:14:30 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf -p 172.16.0.220:3260 --logout {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:14:30 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:14:30 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[f175ecef-f5df-4061-b2ff-22b55181665e]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:14:30 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-33b66301-a5e6-4c50-a17d-880e0feb07ca tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf, portal: 172.16.0.220,3260]
Oct 18 12:14:30 user nova-compute[74190]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf, portal: 172.16.0.220,3260] successful.
Oct 18 12:14:30 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:14:30 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf -p 172.16.0.220:3260 --op delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:14:30 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:14:30 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bf0d354-75a6-4ee9-a02e-d77149fa0d28]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:14:30 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-33b66301-a5e6-4c50-a17d-880e0feb07ca tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:14:30 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-33b66301-a5e6-4c50-a17d-880e0feb07ca tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.361s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 12:14:30 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-33b66301-a5e6-4c50-a17d-880e0feb07ca tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] <== disconnect_volume: return (363ms) None {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 12:14:30 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33b66301-a5e6-4c50-a17d-880e0feb07ca tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 7c539213-358a-48fd-9abd-1f017ba5b54a] Disconnected iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 12:14:30 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-33b66301-a5e6-4c50-a17d-880e0feb07ca tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 7c539213-358a-48fd-9abd-1f017ba5b54a] Deleting instance files /opt/stack/data/nova/instances/7c539213-358a-48fd-9abd-1f017ba5b54a_del
Oct 18 12:14:30 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-33b66301-a5e6-4c50-a17d-880e0feb07ca tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 7c539213-358a-48fd-9abd-1f017ba5b54a] Deletion of /opt/stack/data/nova/instances/7c539213-358a-48fd-9abd-1f017ba5b54a_del complete
Oct 18 12:14:30 user nova-compute[74190]: INFO nova.compute.manager [None req-33b66301-a5e6-4c50-a17d-880e0feb07ca tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 7c539213-358a-48fd-9abd-1f017ba5b54a] Took 1.78 seconds to destroy the instance on the hypervisor.
Oct 18 12:14:30 user nova-compute[74190]: DEBUG oslo.service.loopingcall [None req-33b66301-a5e6-4c50-a17d-880e0feb07ca tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74190) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 12:14:30 user nova-compute[74190]: DEBUG nova.compute.manager [-] [instance: 7c539213-358a-48fd-9abd-1f017ba5b54a] Deallocating network for instance {{(pid=74190) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 12:14:30 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: 7c539213-358a-48fd-9abd-1f017ba5b54a] deallocate_for_instance() {{(pid=74190) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 12:14:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:14:30 user nova-compute[74190]: DEBUG nova.compute.manager [req-25ef832c-344a-40dd-9884-67e9985d39f3 req-05a9b637-feb6-4509-aee0-2541bd2c578b service nova] [instance: 7c539213-358a-48fd-9abd-1f017ba5b54a] Received event network-vif-plugged-ecc36cc2-dc28-452e-82f2-0d347537cd36 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:14:30 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-25ef832c-344a-40dd-9884-67e9985d39f3 req-05a9b637-feb6-4509-aee0-2541bd2c578b service nova] Acquiring lock "7c539213-358a-48fd-9abd-1f017ba5b54a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:14:30 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-25ef832c-344a-40dd-9884-67e9985d39f3 req-05a9b637-feb6-4509-aee0-2541bd2c578b service nova] Lock "7c539213-358a-48fd-9abd-1f017ba5b54a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:14:30 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-25ef832c-344a-40dd-9884-67e9985d39f3 req-05a9b637-feb6-4509-aee0-2541bd2c578b service nova] Lock "7c539213-358a-48fd-9abd-1f017ba5b54a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:14:30 user nova-compute[74190]: DEBUG nova.compute.manager [req-25ef832c-344a-40dd-9884-67e9985d39f3 req-05a9b637-feb6-4509-aee0-2541bd2c578b service nova] [instance: 7c539213-358a-48fd-9abd-1f017ba5b54a] No waiting events found dispatching network-vif-plugged-ecc36cc2-dc28-452e-82f2-0d347537cd36 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:14:30 user nova-compute[74190]: WARNING nova.compute.manager [req-25ef832c-344a-40dd-9884-67e9985d39f3 req-05a9b637-feb6-4509-aee0-2541bd2c578b service nova] [instance: 7c539213-358a-48fd-9abd-1f017ba5b54a] Received unexpected event network-vif-plugged-ecc36cc2-dc28-452e-82f2-0d347537cd36 for instance with vm_state active and task_state deleting.
Oct 18 12:14:30 user nova-compute[74190]: DEBUG nova.compute.manager [req-25ef832c-344a-40dd-9884-67e9985d39f3 req-05a9b637-feb6-4509-aee0-2541bd2c578b service nova] [instance: f4f9eac7-b9ed-42a7-890b-79da3afe46a1] Received event network-vif-plugged-84228aca-9249-4ed5-8774-629e3b1b82d8 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:14:30 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-25ef832c-344a-40dd-9884-67e9985d39f3 req-05a9b637-feb6-4509-aee0-2541bd2c578b service nova] Acquiring lock "f4f9eac7-b9ed-42a7-890b-79da3afe46a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:14:30 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-25ef832c-344a-40dd-9884-67e9985d39f3 req-05a9b637-feb6-4509-aee0-2541bd2c578b service nova] Lock "f4f9eac7-b9ed-42a7-890b-79da3afe46a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:14:30 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-25ef832c-344a-40dd-9884-67e9985d39f3 req-05a9b637-feb6-4509-aee0-2541bd2c578b service nova] Lock "f4f9eac7-b9ed-42a7-890b-79da3afe46a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:14:30 user nova-compute[74190]: DEBUG nova.compute.manager [req-25ef832c-344a-40dd-9884-67e9985d39f3 req-05a9b637-feb6-4509-aee0-2541bd2c578b service nova] [instance: f4f9eac7-b9ed-42a7-890b-79da3afe46a1] No waiting events found dispatching network-vif-plugged-84228aca-9249-4ed5-8774-629e3b1b82d8 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:14:30 user nova-compute[74190]: WARNING nova.compute.manager [req-25ef832c-344a-40dd-9884-67e9985d39f3 req-05a9b637-feb6-4509-aee0-2541bd2c578b service nova] [instance: f4f9eac7-b9ed-42a7-890b-79da3afe46a1] Received unexpected event network-vif-plugged-84228aca-9249-4ed5-8774-629e3b1b82d8 for instance with vm_state building and task_state spawning.
Oct 18 12:14:30 user nova-compute[74190]: DEBUG nova.compute.manager [req-25ef832c-344a-40dd-9884-67e9985d39f3 req-05a9b637-feb6-4509-aee0-2541bd2c578b service nova] [instance: f4f9eac7-b9ed-42a7-890b-79da3afe46a1] Received event network-vif-plugged-84228aca-9249-4ed5-8774-629e3b1b82d8 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:14:30 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-25ef832c-344a-40dd-9884-67e9985d39f3 req-05a9b637-feb6-4509-aee0-2541bd2c578b service nova] Acquiring lock "f4f9eac7-b9ed-42a7-890b-79da3afe46a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:14:30 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-25ef832c-344a-40dd-9884-67e9985d39f3 req-05a9b637-feb6-4509-aee0-2541bd2c578b service nova] Lock "f4f9eac7-b9ed-42a7-890b-79da3afe46a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:14:30 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-25ef832c-344a-40dd-9884-67e9985d39f3 req-05a9b637-feb6-4509-aee0-2541bd2c578b service nova] Lock "f4f9eac7-b9ed-42a7-890b-79da3afe46a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:14:30 user nova-compute[74190]: DEBUG nova.compute.manager [req-25ef832c-344a-40dd-9884-67e9985d39f3 req-05a9b637-feb6-4509-aee0-2541bd2c578b service nova] [instance: f4f9eac7-b9ed-42a7-890b-79da3afe46a1] No waiting events found dispatching network-vif-plugged-84228aca-9249-4ed5-8774-629e3b1b82d8 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:14:30 user nova-compute[74190]: WARNING nova.compute.manager [req-25ef832c-344a-40dd-9884-67e9985d39f3 req-05a9b637-feb6-4509-aee0-2541bd2c578b service nova] [instance: f4f9eac7-b9ed-42a7-890b-79da3afe46a1] Received unexpected event network-vif-plugged-84228aca-9249-4ed5-8774-629e3b1b82d8 for instance with vm_state building and task_state spawning.
Oct 18 12:14:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:14:30 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: 7c539213-358a-48fd-9abd-1f017ba5b54a] Updating instance_info_cache with network_info: [] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:14:30 user nova-compute[74190]: INFO nova.compute.manager [-] [instance: 7c539213-358a-48fd-9abd-1f017ba5b54a] Took 0.80 seconds to deallocate network for instance.
Oct 18 12:14:30 user nova-compute[74190]: DEBUG nova.compute.manager [req-4b42adcc-bcf7-4fe0-8902-39425ee1820c req-db47e34f-561e-40c5-9aac-90598b138918 service nova] [instance: 7c539213-358a-48fd-9abd-1f017ba5b54a] Received event network-vif-deleted-ecc36cc2-dc28-452e-82f2-0d347537cd36 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:14:31 user nova-compute[74190]: DEBUG nova.compute.manager [None req-22bb69d7-a13b-4750-8386-865385a9415d tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] [instance: f4f9eac7-b9ed-42a7-890b-79da3afe46a1] Instance event wait completed in 0 seconds for  {{(pid=74190) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 12:14:31 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-22bb69d7-a13b-4750-8386-865385a9415d tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] [instance: f4f9eac7-b9ed-42a7-890b-79da3afe46a1] Guest created on hypervisor {{(pid=74190) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 12:14:31 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: f4f9eac7-b9ed-42a7-890b-79da3afe46a1] Instance spawned successfully.
Oct 18 12:14:31 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-22bb69d7-a13b-4750-8386-865385a9415d tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] [instance: f4f9eac7-b9ed-42a7-890b-79da3afe46a1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 12:14:31 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-22bb69d7-a13b-4750-8386-865385a9415d tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] [instance: f4f9eac7-b9ed-42a7-890b-79da3afe46a1] Found default for hw_cdrom_bus of ide {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:14:31 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-22bb69d7-a13b-4750-8386-865385a9415d tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] [instance: f4f9eac7-b9ed-42a7-890b-79da3afe46a1] Found default for hw_disk_bus of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:14:31 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-22bb69d7-a13b-4750-8386-865385a9415d tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] [instance: f4f9eac7-b9ed-42a7-890b-79da3afe46a1] Found default for hw_input_bus of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:14:31 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-22bb69d7-a13b-4750-8386-865385a9415d tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] [instance: f4f9eac7-b9ed-42a7-890b-79da3afe46a1] Found default for hw_pointer_model of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:14:31 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-22bb69d7-a13b-4750-8386-865385a9415d tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] [instance: f4f9eac7-b9ed-42a7-890b-79da3afe46a1] Found default for hw_video_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:14:31 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-22bb69d7-a13b-4750-8386-865385a9415d tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] [instance: f4f9eac7-b9ed-42a7-890b-79da3afe46a1] Found default for hw_vif_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:14:31 user nova-compute[74190]: INFO nova.compute.manager [None req-22bb69d7-a13b-4750-8386-865385a9415d tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] [instance: f4f9eac7-b9ed-42a7-890b-79da3afe46a1] Took 6.10 seconds to spawn the instance on the hypervisor.
Oct 18 12:14:31 user nova-compute[74190]: DEBUG nova.compute.manager [None req-22bb69d7-a13b-4750-8386-865385a9415d tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] [instance: f4f9eac7-b9ed-42a7-890b-79da3afe46a1] Checking state {{(pid=74190) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 12:14:31 user nova-compute[74190]: INFO nova.compute.manager [None req-22bb69d7-a13b-4750-8386-865385a9415d tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] [instance: f4f9eac7-b9ed-42a7-890b-79da3afe46a1] Took 7.05 seconds to build instance.
Oct 18 12:14:31 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-22bb69d7-a13b-4750-8386-865385a9415d tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Lock "f4f9eac7-b9ed-42a7-890b-79da3afe46a1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.147s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:14:31 user nova-compute[74190]: INFO nova.compute.manager [None req-33b66301-a5e6-4c50-a17d-880e0feb07ca tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 7c539213-358a-48fd-9abd-1f017ba5b54a] Took 0.88 seconds to detach 1 volumes for instance.
Oct 18 12:14:31 user nova-compute[74190]: DEBUG nova.compute.manager [None req-33b66301-a5e6-4c50-a17d-880e0feb07ca tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 7c539213-358a-48fd-9abd-1f017ba5b54a] Deleting volume: 6a4378ff-14bb-4d38-aa3f-b928fbc6e3cf {{(pid=74190) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 18 12:14:31 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-33b66301-a5e6-4c50-a17d-880e0feb07ca tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:14:31 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-33b66301-a5e6-4c50-a17d-880e0feb07ca tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:14:32 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-33b66301-a5e6-4c50-a17d-880e0feb07ca tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 12:14:32 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-33b66301-a5e6-4c50-a17d-880e0feb07ca tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 12:14:32 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-33b66301-a5e6-4c50-a17d-880e0feb07ca tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.250s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:14:32 user nova-compute[74190]: INFO nova.scheduler.client.report [None req-33b66301-a5e6-4c50-a17d-880e0feb07ca tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Deleted allocations for instance 7c539213-358a-48fd-9abd-1f017ba5b54a
Oct 18 12:14:32 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-33b66301-a5e6-4c50-a17d-880e0feb07ca tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "7c539213-358a-48fd-9abd-1f017ba5b54a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.985s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:14:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:14:35 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:14:39 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:14:40 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:14:44 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:14:45 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:14:49 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:14:50 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:14:54 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:14:55 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-c0550133-66d2-46a7-9906-d26ba82328bd tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Acquiring lock "b1e27a16-43e4-4e80-9c0a-5c2dce06daae" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:14:55 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-c0550133-66d2-46a7-9906-d26ba82328bd tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lock "b1e27a16-43e4-4e80-9c0a-5c2dce06daae" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:14:55 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-c0550133-66d2-46a7-9906-d26ba82328bd tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Acquiring lock "b1e27a16-43e4-4e80-9c0a-5c2dce06daae-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:14:55 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-c0550133-66d2-46a7-9906-d26ba82328bd tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lock "b1e27a16-43e4-4e80-9c0a-5c2dce06daae-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:14:55 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-c0550133-66d2-46a7-9906-d26ba82328bd tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lock "b1e27a16-43e4-4e80-9c0a-5c2dce06daae-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:14:55 user nova-compute[74190]: INFO nova.compute.manager [None req-c0550133-66d2-46a7-9906-d26ba82328bd tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: b1e27a16-43e4-4e80-9c0a-5c2dce06daae] Terminating instance
Oct 18 12:14:55 user nova-compute[74190]: DEBUG nova.compute.manager [None req-c0550133-66d2-46a7-9906-d26ba82328bd tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: b1e27a16-43e4-4e80-9c0a-5c2dce06daae] Start destroying the instance on the hypervisor. {{(pid=74190) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 12:14:55 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:14:55 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:14:55 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:14:55 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:14:55 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:14:55 user nova-compute[74190]: DEBUG nova.compute.manager [req-95f0d355-ad5e-49a2-a59f-eb8b48d30808 req-90d49f2e-7d94-4323-a176-d4d9fcefde88 service nova] [instance: b1e27a16-43e4-4e80-9c0a-5c2dce06daae] Received event network-vif-unplugged-3d3e9708-ec6a-4fd9-853a-2f492a488a32 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:14:55 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-95f0d355-ad5e-49a2-a59f-eb8b48d30808 req-90d49f2e-7d94-4323-a176-d4d9fcefde88 service nova] Acquiring lock "b1e27a16-43e4-4e80-9c0a-5c2dce06daae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:14:55 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-95f0d355-ad5e-49a2-a59f-eb8b48d30808 req-90d49f2e-7d94-4323-a176-d4d9fcefde88 service nova] Lock "b1e27a16-43e4-4e80-9c0a-5c2dce06daae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:14:55 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-95f0d355-ad5e-49a2-a59f-eb8b48d30808 req-90d49f2e-7d94-4323-a176-d4d9fcefde88 service nova] Lock "b1e27a16-43e4-4e80-9c0a-5c2dce06daae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:14:55 user nova-compute[74190]: DEBUG nova.compute.manager [req-95f0d355-ad5e-49a2-a59f-eb8b48d30808 req-90d49f2e-7d94-4323-a176-d4d9fcefde88 service nova] [instance: b1e27a16-43e4-4e80-9c0a-5c2dce06daae] No waiting events found dispatching network-vif-unplugged-3d3e9708-ec6a-4fd9-853a-2f492a488a32 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:14:55 user nova-compute[74190]: DEBUG nova.compute.manager [req-95f0d355-ad5e-49a2-a59f-eb8b48d30808 req-90d49f2e-7d94-4323-a176-d4d9fcefde88 service nova] [instance: b1e27a16-43e4-4e80-9c0a-5c2dce06daae] Received event network-vif-unplugged-3d3e9708-ec6a-4fd9-853a-2f492a488a32 for instance with task_state deleting. {{(pid=74190) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 12:14:56 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:14:56 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:14:56 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: b1e27a16-43e4-4e80-9c0a-5c2dce06daae] Instance destroyed successfully.
Oct 18 12:14:56 user nova-compute[74190]: DEBUG nova.objects.instance [None req-c0550133-66d2-46a7-9906-d26ba82328bd tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lazy-loading 'resources' on Instance uuid b1e27a16-43e4-4e80-9c0a-5c2dce06daae {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:14:56 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-c0550133-66d2-46a7-9906-d26ba82328bd tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T12:04:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1068206669',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1068206669',id=38,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-18T12:04:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6d994366010142519ff367fa7ca77e61',ramdisk_id='',reservation_id='r-s7lfky0d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1815510380',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T12:06:39Z,user_data=None,user_id='7fa675b6803f4e21b090295b51fb9ceb',uuid=b1e27a16-43e4-4e80-9c0a-5c2dce06daae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3d3e9708-ec6a-4fd9-853a-2f492a488a32", "address": "fa:16:3e:3d:c4:83", "network": {"id": "c2dbbd24-f1d2-47a2-835f-0f9b24b585f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-920140900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d994366010142519ff367fa7ca77e61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d3e9708-ec", "ovs_interfaceid": "3d3e9708-ec6a-4fd9-853a-2f492a488a32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 12:14:56 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-c0550133-66d2-46a7-9906-d26ba82328bd tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Converting VIF {"id": "3d3e9708-ec6a-4fd9-853a-2f492a488a32", "address": "fa:16:3e:3d:c4:83", "network": {"id": "c2dbbd24-f1d2-47a2-835f-0f9b24b585f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-920140900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d994366010142519ff367fa7ca77e61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d3e9708-ec", "ovs_interfaceid": "3d3e9708-ec6a-4fd9-853a-2f492a488a32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 12:14:56 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-c0550133-66d2-46a7-9906-d26ba82328bd tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3d:c4:83,bridge_name='br-int',has_traffic_filtering=True,id=3d3e9708-ec6a-4fd9-853a-2f492a488a32,network=Network(c2dbbd24-f1d2-47a2-835f-0f9b24b585f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d3e9708-ec') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 12:14:56 user nova-compute[74190]: DEBUG os_vif [None req-c0550133-66d2-46a7-9906-d26ba82328bd tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:c4:83,bridge_name='br-int',has_traffic_filtering=True,id=3d3e9708-ec6a-4fd9-853a-2f492a488a32,network=Network(c2dbbd24-f1d2-47a2-835f-0f9b24b585f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d3e9708-ec') {{(pid=74190) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 12:14:56 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:14:56 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3d3e9708-ec, bridge=br-int, if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:14:56 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:14:56 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:14:56 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:14:56 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3a12c730-541a-456e-9090-0cd611985f78) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:14:56 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:14:56 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:14:56 user nova-compute[74190]: INFO os_vif [None req-c0550133-66d2-46a7-9906-d26ba82328bd tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:c4:83,bridge_name='br-int',has_traffic_filtering=True,id=3d3e9708-ec6a-4fd9-853a-2f492a488a32,network=Network(c2dbbd24-f1d2-47a2-835f-0f9b24b585f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d3e9708-ec')
Oct 18 12:14:56 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-c0550133-66d2-46a7-9906-d26ba82328bd tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: b1e27a16-43e4-4e80-9c0a-5c2dce06daae] Deleting instance files /opt/stack/data/nova/instances/b1e27a16-43e4-4e80-9c0a-5c2dce06daae_del
Oct 18 12:14:56 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-c0550133-66d2-46a7-9906-d26ba82328bd tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: b1e27a16-43e4-4e80-9c0a-5c2dce06daae] Deletion of /opt/stack/data/nova/instances/b1e27a16-43e4-4e80-9c0a-5c2dce06daae_del complete
Oct 18 12:14:56 user nova-compute[74190]: INFO nova.compute.manager [None req-c0550133-66d2-46a7-9906-d26ba82328bd tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: b1e27a16-43e4-4e80-9c0a-5c2dce06daae] Took 1.00 seconds to destroy the instance on the hypervisor.
Oct 18 12:14:56 user nova-compute[74190]: DEBUG oslo.service.loopingcall [None req-c0550133-66d2-46a7-9906-d26ba82328bd tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74190) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 12:14:56 user nova-compute[74190]: DEBUG nova.compute.manager [-] [instance: b1e27a16-43e4-4e80-9c0a-5c2dce06daae] Deallocating network for instance {{(pid=74190) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 12:14:56 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: b1e27a16-43e4-4e80-9c0a-5c2dce06daae] deallocate_for_instance() {{(pid=74190) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 12:14:57 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: b1e27a16-43e4-4e80-9c0a-5c2dce06daae] Updating instance_info_cache with network_info: [] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:14:57 user nova-compute[74190]: INFO nova.compute.manager [-] [instance: b1e27a16-43e4-4e80-9c0a-5c2dce06daae] Took 0.58 seconds to deallocate network for instance.
Oct 18 12:14:57 user nova-compute[74190]: DEBUG nova.compute.manager [req-877f5f0d-bd1e-4bce-a36f-ed8ef1d6d803 req-bbf31eab-3c27-4f98-b727-92cc2e2204cd service nova] [instance: b1e27a16-43e4-4e80-9c0a-5c2dce06daae] Received event network-vif-deleted-3d3e9708-ec6a-4fd9-853a-2f492a488a32 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:14:57 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-c0550133-66d2-46a7-9906-d26ba82328bd tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:14:57 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-c0550133-66d2-46a7-9906-d26ba82328bd tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:14:57 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-c0550133-66d2-46a7-9906-d26ba82328bd tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 12:14:57 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-c0550133-66d2-46a7-9906-d26ba82328bd tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 12:14:57 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-c0550133-66d2-46a7-9906-d26ba82328bd tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.224s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:14:57 user nova-compute[74190]: INFO nova.scheduler.client.report [None req-c0550133-66d2-46a7-9906-d26ba82328bd tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Deleted allocations for instance b1e27a16-43e4-4e80-9c0a-5c2dce06daae
Oct 18 12:14:57 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-c0550133-66d2-46a7-9906-d26ba82328bd tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lock "b1e27a16-43e4-4e80-9c0a-5c2dce06daae" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.980s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:14:57 user nova-compute[74190]: DEBUG nova.compute.manager [req-c69d872c-44a1-4e1e-8532-4fc3358e7faf req-4bc32952-7bb8-4fb0-a17a-4c5f1386119e service nova] [instance: b1e27a16-43e4-4e80-9c0a-5c2dce06daae] Received event network-vif-plugged-3d3e9708-ec6a-4fd9-853a-2f492a488a32 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:14:57 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-c69d872c-44a1-4e1e-8532-4fc3358e7faf req-4bc32952-7bb8-4fb0-a17a-4c5f1386119e service nova] Acquiring lock "b1e27a16-43e4-4e80-9c0a-5c2dce06daae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:14:57 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-c69d872c-44a1-4e1e-8532-4fc3358e7faf req-4bc32952-7bb8-4fb0-a17a-4c5f1386119e service nova] Lock "b1e27a16-43e4-4e80-9c0a-5c2dce06daae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:14:57 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-c69d872c-44a1-4e1e-8532-4fc3358e7faf req-4bc32952-7bb8-4fb0-a17a-4c5f1386119e service nova] Lock "b1e27a16-43e4-4e80-9c0a-5c2dce06daae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:14:57 user nova-compute[74190]: DEBUG nova.compute.manager [req-c69d872c-44a1-4e1e-8532-4fc3358e7faf req-4bc32952-7bb8-4fb0-a17a-4c5f1386119e service nova] [instance: b1e27a16-43e4-4e80-9c0a-5c2dce06daae] No waiting events found dispatching network-vif-plugged-3d3e9708-ec6a-4fd9-853a-2f492a488a32 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:14:57 user nova-compute[74190]: WARNING nova.compute.manager [req-c69d872c-44a1-4e1e-8532-4fc3358e7faf req-4bc32952-7bb8-4fb0-a17a-4c5f1386119e service nova] [instance: b1e27a16-43e4-4e80-9c0a-5c2dce06daae] Received unexpected event network-vif-plugged-3d3e9708-ec6a-4fd9-853a-2f492a488a32 for instance with vm_state deleted and task_state None.
Oct 18 12:15:00 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:15:01 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:15:05 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:15:06 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:15:11 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:15:16 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:15:18 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:15:18 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:15:19 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:15:20 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:15:21 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:15:22 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:15:24 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:15:24 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Starting heal instance info cache {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 12:15:24 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Didn't find any instances for network info cache update. {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 18 12:15:24 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:15:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:15:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:15:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:15:24 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Auditing locally available compute resources for user (node: user) {{(pid=74190) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 12:15:24 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f9eac7-b9ed-42a7-890b-79da3afe46a1/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:15:24 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f9eac7-b9ed-42a7-890b-79da3afe46a1/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:15:24 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f9eac7-b9ed-42a7-890b-79da3afe46a1/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:15:24 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f9eac7-b9ed-42a7-890b-79da3afe46a1/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:15:24 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:15:24 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:15:24 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:15:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:15:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0309a457-dae8-4a13-ac5c-53e2320930ff/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:15:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0309a457-dae8-4a13-ac5c-53e2320930ff/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:15:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0309a457-dae8-4a13-ac5c-53e2320930ff/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:15:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0309a457-dae8-4a13-ac5c-53e2320930ff/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:15:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7983ceaf-8ed3-4321-a242-2e44218f4d0b/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:15:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7983ceaf-8ed3-4321-a242-2e44218f4d0b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:15:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7983ceaf-8ed3-4321-a242-2e44218f4d0b/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:15:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7983ceaf-8ed3-4321-a242-2e44218f4d0b/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:15:25 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 12:15:26 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:15:26 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:15:26 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Hypervisor/Node resource view: name=user free_ram=8416MB free_disk=25.066532135009766GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74190) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 12:15:26 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:15:26 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:15:26 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 772b126c-2148-4ca8-90f2-69d6eb4b7db7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:15:26 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 0382820d-a678-4593-85df-168f42fc4ce4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:15:26 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 7983ceaf-8ed3-4321-a242-2e44218f4d0b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:15:26 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 0309a457-dae8-4a13-ac5c-53e2320930ff actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:15:26 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance f4f9eac7-b9ed-42a7-890b-79da3afe46a1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:15:26 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 12:15:26 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 12:15:26 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:15:26 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 12:15:26 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 12:15:26 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Compute_service record updated for user:user {{(pid=74190) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 12:15:26 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.371s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:15:27 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:15:27 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:15:27 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:15:27 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:15:27 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74190) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 12:15:31 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:15:33 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:15:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:15:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:15:38 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Acquiring lock "15172ec7-bdaa-478f-93ac-d4dbba6a3a0d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:15:38 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "15172ec7-bdaa-478f-93ac-d4dbba6a3a0d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:15:38 user nova-compute[74190]: DEBUG nova.compute.manager [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 15172ec7-bdaa-478f-93ac-d4dbba6a3a0d] Starting instance... {{(pid=74190) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 12:15:38 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:15:38 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:15:38 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74190) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 12:15:38 user nova-compute[74190]: INFO nova.compute.claims [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 15172ec7-bdaa-478f-93ac-d4dbba6a3a0d] Claim successful on node user
Oct 18 12:15:38 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 12:15:38 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 12:15:38 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.321s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:15:38 user nova-compute[74190]: DEBUG nova.compute.manager [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 15172ec7-bdaa-478f-93ac-d4dbba6a3a0d] Start building networks asynchronously for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 12:15:38 user nova-compute[74190]: DEBUG nova.compute.manager [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 15172ec7-bdaa-478f-93ac-d4dbba6a3a0d] Allocating IP information in the background. {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 12:15:38 user nova-compute[74190]: DEBUG nova.network.neutron [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 15172ec7-bdaa-478f-93ac-d4dbba6a3a0d] allocate_for_instance() {{(pid=74190) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 12:15:38 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 15172ec7-bdaa-478f-93ac-d4dbba6a3a0d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 12:15:38 user nova-compute[74190]: DEBUG nova.compute.manager [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 15172ec7-bdaa-478f-93ac-d4dbba6a3a0d] Start building block device mappings for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 12:15:38 user nova-compute[74190]: INFO nova.virt.block_device [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 15172ec7-bdaa-478f-93ac-d4dbba6a3a0d] Booting with volume 83ff0b09-1a99-460d-94d4-df24e2880d18 at /dev/vda
Oct 18 12:15:38 user nova-compute[74190]: DEBUG nova.policy [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '27d9fc244d0f4e10a43b7df4dc8e30ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e375153f6f24827811c5825fc2a2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74190) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 12:15:38 user nova-compute[74190]: DEBUG os_brick.utils [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 12:15:38 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:15:38 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:15:38 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[009f7fb1-0dd0-411c-9d1a-95841be683d3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cff158e257e1\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:15:38 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:15:38 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:15:38 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d0af17-9235-48fd-a27f-169b964dd4a9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:15:38 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:15:38 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:15:38 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dde8c3a-81d1-4214-bf2a-7613e96b0540]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:15:38 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b284dbd-f804-425c-babd-7936f8214a52]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:15:38 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Running cmd (subprocess): nvme version {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:15:38 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] 'nvme version' failed. Not Retrying. {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 12:15:38 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] nvme not present on system {{(pid=74190) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 12:15:38 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:15:38 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 12:15:38 user nova-compute[74190]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 12:15:38 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c5468e-9598-43c8-b028-60c4baa4b739]: (4, '') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:15:38 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74190) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 12:15:38 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 12:15:38 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] LIGHTOS: no hostnqn found. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 12:15:38 user nova-compute[74190]: DEBUG os_brick.utils [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cff158e257e1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 12:15:38 user nova-compute[74190]: DEBUG nova.virt.block_device [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 15172ec7-bdaa-478f-93ac-d4dbba6a3a0d] Updating existing volume attachment record: 341721e7-1e06-4fda-88c3-0063d71f4297 {{(pid=74190) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 12:15:39 user nova-compute[74190]: DEBUG nova.network.neutron [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 15172ec7-bdaa-478f-93ac-d4dbba6a3a0d] Successfully created port: 3ce5d2e1-0587-486f-9184-5026ff7a941a {{(pid=74190) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 12:15:40 user nova-compute[74190]: DEBUG nova.network.neutron [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 15172ec7-bdaa-478f-93ac-d4dbba6a3a0d] Successfully updated port: 3ce5d2e1-0587-486f-9184-5026ff7a941a {{(pid=74190) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 12:15:40 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Acquiring lock "refresh_cache-15172ec7-bdaa-478f-93ac-d4dbba6a3a0d" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:15:40 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Acquired lock "refresh_cache-15172ec7-bdaa-478f-93ac-d4dbba6a3a0d" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:15:40 user nova-compute[74190]: DEBUG nova.network.neutron [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 15172ec7-bdaa-478f-93ac-d4dbba6a3a0d] Building network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 12:15:40 user nova-compute[74190]: DEBUG nova.compute.manager [req-faab9f51-24b9-43b6-9bb9-5796430314c6 req-c8fd9081-c2b6-4659-876f-ebc81e04d21f service nova] [instance: 15172ec7-bdaa-478f-93ac-d4dbba6a3a0d] Received event network-changed-3ce5d2e1-0587-486f-9184-5026ff7a941a {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:15:40 user nova-compute[74190]: DEBUG nova.compute.manager [req-faab9f51-24b9-43b6-9bb9-5796430314c6 req-c8fd9081-c2b6-4659-876f-ebc81e04d21f service nova] [instance: 15172ec7-bdaa-478f-93ac-d4dbba6a3a0d] Refreshing instance network info cache due to event network-changed-3ce5d2e1-0587-486f-9184-5026ff7a941a. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 12:15:40 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-faab9f51-24b9-43b6-9bb9-5796430314c6 req-c8fd9081-c2b6-4659-876f-ebc81e04d21f service nova] Acquiring lock "refresh_cache-15172ec7-bdaa-478f-93ac-d4dbba6a3a0d" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:15:40 user nova-compute[74190]: DEBUG nova.network.neutron [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 15172ec7-bdaa-478f-93ac-d4dbba6a3a0d] Instance cache missing network info. {{(pid=74190) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 12:15:40 user nova-compute[74190]: DEBUG nova.network.neutron [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 15172ec7-bdaa-478f-93ac-d4dbba6a3a0d] Updating instance_info_cache with network_info: [{"id": "3ce5d2e1-0587-486f-9184-5026ff7a941a", "address": "fa:16:3e:d3:87:c8", "network": {"id": "aa827f81-b165-444f-89cc-f21c42a9f772", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1659902586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e375153f6f24827811c5825fc2a2c6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce5d2e1-05", "ovs_interfaceid": "3ce5d2e1-0587-486f-9184-5026ff7a941a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:15:40 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Releasing lock "refresh_cache-15172ec7-bdaa-478f-93ac-d4dbba6a3a0d" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:15:40 user nova-compute[74190]: DEBUG nova.compute.manager [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 15172ec7-bdaa-478f-93ac-d4dbba6a3a0d] Instance network_info: |[{"id": "3ce5d2e1-0587-486f-9184-5026ff7a941a", "address": "fa:16:3e:d3:87:c8", "network": {"id": "aa827f81-b165-444f-89cc-f21c42a9f772", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1659902586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e375153f6f24827811c5825fc2a2c6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce5d2e1-05", "ovs_interfaceid": "3ce5d2e1-0587-486f-9184-5026ff7a941a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 12:15:40 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-faab9f51-24b9-43b6-9bb9-5796430314c6 req-c8fd9081-c2b6-4659-876f-ebc81e04d21f service nova] Acquired lock "refresh_cache-15172ec7-bdaa-478f-93ac-d4dbba6a3a0d" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:15:40 user nova-compute[74190]: DEBUG nova.network.neutron [req-faab9f51-24b9-43b6-9bb9-5796430314c6 req-c8fd9081-c2b6-4659-876f-ebc81e04d21f service nova] [instance: 15172ec7-bdaa-478f-93ac-d4dbba6a3a0d] Refreshing network info cache for port 3ce5d2e1-0587-486f-9184-5026ff7a941a {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 12:15:40 user nova-compute[74190]: DEBUG nova.network.neutron [req-faab9f51-24b9-43b6-9bb9-5796430314c6 req-c8fd9081-c2b6-4659-876f-ebc81e04d21f service nova] [instance: 15172ec7-bdaa-478f-93ac-d4dbba6a3a0d] Updated VIF entry in instance network info cache for port 3ce5d2e1-0587-486f-9184-5026ff7a941a. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 12:15:40 user nova-compute[74190]: DEBUG nova.network.neutron [req-faab9f51-24b9-43b6-9bb9-5796430314c6 req-c8fd9081-c2b6-4659-876f-ebc81e04d21f service nova] [instance: 15172ec7-bdaa-478f-93ac-d4dbba6a3a0d] Updating instance_info_cache with network_info: [{"id": "3ce5d2e1-0587-486f-9184-5026ff7a941a", "address": "fa:16:3e:d3:87:c8", "network": {"id": "aa827f81-b165-444f-89cc-f21c42a9f772", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1659902586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e375153f6f24827811c5825fc2a2c6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce5d2e1-05", "ovs_interfaceid": "3ce5d2e1-0587-486f-9184-5026ff7a941a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:15:40 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-faab9f51-24b9-43b6-9bb9-5796430314c6 req-c8fd9081-c2b6-4659-876f-ebc81e04d21f service nova] Releasing lock "refresh_cache-15172ec7-bdaa-478f-93ac-d4dbba6a3a0d" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:15:41 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:15:46 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-ca5d8a0e-b2ca-49f1-88b6-375d93155071 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Acquiring lock "0382820d-a678-4593-85df-168f42fc4ce4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:15:46 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-ca5d8a0e-b2ca-49f1-88b6-375d93155071 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lock "0382820d-a678-4593-85df-168f42fc4ce4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:15:46 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-ca5d8a0e-b2ca-49f1-88b6-375d93155071 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Acquiring lock "0382820d-a678-4593-85df-168f42fc4ce4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:15:46 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-ca5d8a0e-b2ca-49f1-88b6-375d93155071 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lock "0382820d-a678-4593-85df-168f42fc4ce4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:15:46 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-ca5d8a0e-b2ca-49f1-88b6-375d93155071 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lock "0382820d-a678-4593-85df-168f42fc4ce4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:15:46 user nova-compute[74190]: INFO nova.compute.manager [None req-ca5d8a0e-b2ca-49f1-88b6-375d93155071 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Terminating instance
Oct 18 12:15:46 user nova-compute[74190]: DEBUG nova.compute.manager [None req-ca5d8a0e-b2ca-49f1-88b6-375d93155071 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Start destroying the instance on the hypervisor. {{(pid=74190) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 12:15:46 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:15:46 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:15:46 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:15:46 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:15:46 user nova-compute[74190]: DEBUG nova.compute.manager [req-a1b311c5-b879-40d0-a5ec-8c3f91dc0ba0 req-f8411e7d-094a-4d4b-b002-8cf9fb7b032c service nova] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Received event network-vif-unplugged-a32b81a2-7b02-48ed-9550-d392be5e221e {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:15:46 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-a1b311c5-b879-40d0-a5ec-8c3f91dc0ba0 req-f8411e7d-094a-4d4b-b002-8cf9fb7b032c service nova] Acquiring lock "0382820d-a678-4593-85df-168f42fc4ce4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:15:46 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-a1b311c5-b879-40d0-a5ec-8c3f91dc0ba0 req-f8411e7d-094a-4d4b-b002-8cf9fb7b032c service nova] Lock "0382820d-a678-4593-85df-168f42fc4ce4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:15:46 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-a1b311c5-b879-40d0-a5ec-8c3f91dc0ba0 req-f8411e7d-094a-4d4b-b002-8cf9fb7b032c service nova] Lock "0382820d-a678-4593-85df-168f42fc4ce4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:15:46 user nova-compute[74190]: DEBUG nova.compute.manager [req-a1b311c5-b879-40d0-a5ec-8c3f91dc0ba0 req-f8411e7d-094a-4d4b-b002-8cf9fb7b032c service nova] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] No waiting events found dispatching network-vif-unplugged-a32b81a2-7b02-48ed-9550-d392be5e221e {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:15:46 user nova-compute[74190]: DEBUG nova.compute.manager [req-a1b311c5-b879-40d0-a5ec-8c3f91dc0ba0 req-f8411e7d-094a-4d4b-b002-8cf9fb7b032c service nova] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Received event network-vif-unplugged-a32b81a2-7b02-48ed-9550-d392be5e221e for instance with task_state deleting. {{(pid=74190) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 12:15:46 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:15:46 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Instance destroyed successfully.
Oct 18 12:15:46 user nova-compute[74190]: DEBUG nova.objects.instance [None req-ca5d8a0e-b2ca-49f1-88b6-375d93155071 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lazy-loading 'resources' on Instance uuid 0382820d-a678-4593-85df-168f42fc4ce4 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:15:46 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-ca5d8a0e-b2ca-49f1-88b6-375d93155071 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:59:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1554082096',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1554082096',id=31,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-18T12:01:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6d994366010142519ff367fa7ca77e61',ramdisk_id='',reservation_id='r-2rfy2zbm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1815510380',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T12:02:55Z,user_data=None,user_id='7fa675b6803f4e21b090295b51fb9ceb',uuid=0382820d-a678-4593-85df-168f42fc4ce4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a32b81a2-7b02-48ed-9550-d392be5e221e", "address": "fa:16:3e:e7:d8:e5", "network": {"id": "c2dbbd24-f1d2-47a2-835f-0f9b24b585f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-920140900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d994366010142519ff367fa7ca77e61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa32b81a2-7b", "ovs_interfaceid": "a32b81a2-7b02-48ed-9550-d392be5e221e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 12:15:46 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-ca5d8a0e-b2ca-49f1-88b6-375d93155071 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Converting VIF {"id": "a32b81a2-7b02-48ed-9550-d392be5e221e", "address": "fa:16:3e:e7:d8:e5", "network": {"id": "c2dbbd24-f1d2-47a2-835f-0f9b24b585f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-920140900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d994366010142519ff367fa7ca77e61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa32b81a2-7b", "ovs_interfaceid": "a32b81a2-7b02-48ed-9550-d392be5e221e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 12:15:46 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-ca5d8a0e-b2ca-49f1-88b6-375d93155071 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e7:d8:e5,bridge_name='br-int',has_traffic_filtering=True,id=a32b81a2-7b02-48ed-9550-d392be5e221e,network=Network(c2dbbd24-f1d2-47a2-835f-0f9b24b585f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa32b81a2-7b') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 12:15:46 user nova-compute[74190]: DEBUG os_vif [None req-ca5d8a0e-b2ca-49f1-88b6-375d93155071 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:d8:e5,bridge_name='br-int',has_traffic_filtering=True,id=a32b81a2-7b02-48ed-9550-d392be5e221e,network=Network(c2dbbd24-f1d2-47a2-835f-0f9b24b585f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa32b81a2-7b') {{(pid=74190) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 12:15:46 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:15:46 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa32b81a2-7b, bridge=br-int, if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:15:46 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:15:46 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:15:46 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:15:46 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=be8e79b7-d808-45df-b49e-261a3a3ccc25) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:15:46 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:15:46 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:15:46 user nova-compute[74190]: INFO os_vif [None req-ca5d8a0e-b2ca-49f1-88b6-375d93155071 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:d8:e5,bridge_name='br-int',has_traffic_filtering=True,id=a32b81a2-7b02-48ed-9550-d392be5e221e,network=Network(c2dbbd24-f1d2-47a2-835f-0f9b24b585f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa32b81a2-7b')
Oct 18 12:15:46 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca5d8a0e-b2ca-49f1-88b6-375d93155071 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] calling os-brick to detach iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 12:15:46 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca5d8a0e-b2ca-49f1-88b6-375d93155071 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, {'target_iqn': 'iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OucnFekJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 12:15:46 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-ca5d8a0e-b2ca-49f1-88b6-375d93155071 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 12:15:46 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-ca5d8a0e-b2ca-49f1-88b6-375d93155071 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 12:15:46 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-ca5d8a0e-b2ca-49f1-88b6-375d93155071 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 12:15:46 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:15:46 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:15:46 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[03fb0ca7-13ac-49cc-b577-07be05a72913]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:15:46 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca5d8a0e-b2ca-49f1-88b6-375d93155071 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 12:15:46 user nova-compute[74190]: No targets found.
Oct 18 12:15:46 user nova-compute[74190]: iSNS:
Oct 18 12:15:46 user nova-compute[74190]: No targets found.
Oct 18 12:15:46 user nova-compute[74190]: STATIC:
Oct 18 12:15:46 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f
Oct 18 12:15:46 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 12:15:46 user nova-compute[74190]:                 Iface Name: default
Oct 18 12:15:46 user nova-compute[74190]: FIRMWARE:
Oct 18 12:15:46 user nova-compute[74190]: No targets found.
Oct 18 12:15:46 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 12:15:46 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca5d8a0e-b2ca-49f1-88b6-375d93155071 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 12:15:46 user nova-compute[74190]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 12:15:46 user nova-compute[74190]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74190) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 12:15:46 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca5d8a0e-b2ca-49f1-88b6-375d93155071 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f', 0)] {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 12:15:46 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:15:46 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:15:46 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d333831-609b-4ded-84f1-5e142b25fe72]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:15:46 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:15:46 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:15:46 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[a93913a0-b52f-49ad-bb76-a0d50fd98f42]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:15:46 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca5d8a0e-b2ca-49f1-88b6-375d93155071 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)
Oct 18 12:15:46 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 12:15:46 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca5d8a0e-b2ca-49f1-88b6-375d93155071 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f (non-flash)
Oct 18 12:15:46 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 12:15:46 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca5d8a0e-b2ca-49f1-88b6-375d93155071 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1f44690550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f'): ({'sdb'}, set())}) {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 12:15:46 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-ca5d8a0e-b2ca-49f1-88b6-375d93155071 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Removing single pathed devices sdb {{(pid=74190) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 12:15:46 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:15:46 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:15:46 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf91d34-60e5-491b-b321-01bf6187f46c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:15:46 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:15:46 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:15:46 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[26eefd67-f49e-4558-9668-a8f7d5dab3d6]: (4, ('ok\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:15:46 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-ca5d8a0e-b2ca-49f1-88b6-375d93155071 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Flushing IO for device /dev/sdb {{(pid=74190) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 12:15:46 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:15:46 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:15:46 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[388ee1e0-b23e-492d-b68d-10c67881e6fd]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:15:46 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-ca5d8a0e-b2ca-49f1-88b6-375d93155071 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74190) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 12:15:46 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:15:47 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:15:47 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5637f71-e5d3-42bb-818b-7b3136d3011c]: (4, ('1', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:15:47 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-ca5d8a0e-b2ca-49f1-88b6-375d93155071 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 12:15:47 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-ca5d8a0e-b2ca-49f1-88b6-375d93155071 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] SCSI volumes sdb have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 12:15:47 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca5d8a0e-b2ca-49f1-88b6-375d93155071 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f')] {{(pid=74190) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 12:15:47 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:15:47 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:15:47 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ebdbc1-3711-41ba-ba6c-933328f9620e]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:15:47 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca5d8a0e-b2ca-49f1-88b6-375d93155071 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:15:47 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f -p 172.16.0.220:3260 --logout {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:15:47 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:15:47 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a0b015-12ed-4319-9ab9-67f56d390b63]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:15:47 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca5d8a0e-b2ca-49f1-88b6-375d93155071 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f, portal: 172.16.0.220,3260]
Oct 18 12:15:47 user nova-compute[74190]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f, portal: 172.16.0.220,3260] successful.
Oct 18 12:15:47 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:15:47 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f -p 172.16.0.220:3260 --op delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:15:47 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e27e2099-8328-4194-b582-65ca0cdad07f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:15:47 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b43c939-92d2-4c8d-ab70-19895147c395]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:15:47 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca5d8a0e-b2ca-49f1-88b6-375d93155071 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:15:47 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-ca5d8a0e-b2ca-49f1-88b6-375d93155071 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 12:15:47 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca5d8a0e-b2ca-49f1-88b6-375d93155071 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] <== disconnect_volume: return (293ms) None {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 12:15:47 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca5d8a0e-b2ca-49f1-88b6-375d93155071 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Disconnected iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 12:15:47 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-ca5d8a0e-b2ca-49f1-88b6-375d93155071 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Deleting instance files /opt/stack/data/nova/instances/0382820d-a678-4593-85df-168f42fc4ce4_del
Oct 18 12:15:47 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-ca5d8a0e-b2ca-49f1-88b6-375d93155071 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Deletion of /opt/stack/data/nova/instances/0382820d-a678-4593-85df-168f42fc4ce4_del complete
Oct 18 12:15:47 user nova-compute[74190]: INFO nova.compute.manager [None req-ca5d8a0e-b2ca-49f1-88b6-375d93155071 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Took 1.16 seconds to destroy the instance on the hypervisor.
Oct 18 12:15:47 user nova-compute[74190]: DEBUG oslo.service.loopingcall [None req-ca5d8a0e-b2ca-49f1-88b6-375d93155071 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74190) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 12:15:47 user nova-compute[74190]: DEBUG nova.compute.manager [-] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Deallocating network for instance {{(pid=74190) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 12:15:47 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] deallocate_for_instance() {{(pid=74190) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 12:15:47 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Updating instance_info_cache with network_info: [] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:15:47 user nova-compute[74190]: INFO nova.compute.manager [-] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Took 0.50 seconds to deallocate network for instance.
Oct 18 12:15:47 user nova-compute[74190]: DEBUG nova.compute.manager [req-c55f363a-849e-4443-94b8-0886749a8548 req-cddcf26c-2b87-42a9-8a38-c4b280310e24 service nova] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Received event network-vif-deleted-a32b81a2-7b02-48ed-9550-d392be5e221e {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:15:48 user nova-compute[74190]: DEBUG nova.compute.manager [req-d0d593d9-00f1-41d6-98c1-ddeb3b7438f2 req-f7ff6942-1145-47f7-8a69-a7ca960e88ba service nova] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Received event network-vif-plugged-a32b81a2-7b02-48ed-9550-d392be5e221e {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:15:48 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d0d593d9-00f1-41d6-98c1-ddeb3b7438f2 req-f7ff6942-1145-47f7-8a69-a7ca960e88ba service nova] Acquiring lock "0382820d-a678-4593-85df-168f42fc4ce4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:15:48 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d0d593d9-00f1-41d6-98c1-ddeb3b7438f2 req-f7ff6942-1145-47f7-8a69-a7ca960e88ba service nova] Lock "0382820d-a678-4593-85df-168f42fc4ce4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:15:48 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d0d593d9-00f1-41d6-98c1-ddeb3b7438f2 req-f7ff6942-1145-47f7-8a69-a7ca960e88ba service nova] Lock "0382820d-a678-4593-85df-168f42fc4ce4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:15:48 user nova-compute[74190]: DEBUG nova.compute.manager [req-d0d593d9-00f1-41d6-98c1-ddeb3b7438f2 req-f7ff6942-1145-47f7-8a69-a7ca960e88ba service nova] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] No waiting events found dispatching network-vif-plugged-a32b81a2-7b02-48ed-9550-d392be5e221e {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:15:48 user nova-compute[74190]: WARNING nova.compute.manager [req-d0d593d9-00f1-41d6-98c1-ddeb3b7438f2 req-f7ff6942-1145-47f7-8a69-a7ca960e88ba service nova] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Received unexpected event network-vif-plugged-a32b81a2-7b02-48ed-9550-d392be5e221e for instance with vm_state active and task_state deleting.
Oct 18 12:15:48 user nova-compute[74190]: INFO nova.compute.manager [None req-ca5d8a0e-b2ca-49f1-88b6-375d93155071 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 0382820d-a678-4593-85df-168f42fc4ce4] Took 0.92 seconds to detach 1 volumes for instance.
Oct 18 12:15:48 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-ca5d8a0e-b2ca-49f1-88b6-375d93155071 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:15:48 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-ca5d8a0e-b2ca-49f1-88b6-375d93155071 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:15:48 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-ca5d8a0e-b2ca-49f1-88b6-375d93155071 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 12:15:48 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-ca5d8a0e-b2ca-49f1-88b6-375d93155071 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 12:15:48 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-ca5d8a0e-b2ca-49f1-88b6-375d93155071 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.231s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:15:48 user nova-compute[74190]: INFO nova.scheduler.client.report [None req-ca5d8a0e-b2ca-49f1-88b6-375d93155071 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Deleted allocations for instance 0382820d-a678-4593-85df-168f42fc4ce4
Oct 18 12:15:49 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-ca5d8a0e-b2ca-49f1-88b6-375d93155071 tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lock "0382820d-a678-4593-85df-168f42fc4ce4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.023s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:15:51 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:15:55 user nova-compute[74190]: DEBUG nova.compute.manager [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 15172ec7-bdaa-478f-93ac-d4dbba6a3a0d] Start spawning the instance on the hypervisor. {{(pid=74190) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 12:15:55 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 15172ec7-bdaa-478f-93ac-d4dbba6a3a0d] Creating instance directory {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 12:15:55 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 15172ec7-bdaa-478f-93ac-d4dbba6a3a0d] Creating image(s)
Oct 18 12:15:55 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 15172ec7-bdaa-478f-93ac-d4dbba6a3a0d] Did not create local disks {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 18 12:15:55 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 15172ec7-bdaa-478f-93ac-d4dbba6a3a0d] Ensure instance console log exists: /opt/stack/data/nova/instances/15172ec7-bdaa-478f-93ac-d4dbba6a3a0d/console.log {{(pid=74190) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 12:15:55 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:15:55 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:15:55 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:15:55 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 15172ec7-bdaa-478f-93ac-d4dbba6a3a0d] Start _get_guest_xml network_info=[{"id": "3ce5d2e1-0587-486f-9184-5026ff7a941a", "address": "fa:16:3e:d3:87:c8", "network": {"id": "aa827f81-b165-444f-89cc-f21c42a9f772", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1659902586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e375153f6f24827811c5825fc2a2c6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce5d2e1-05", "ovs_interfaceid": "3ce5d2e1-0587-486f-9184-5026ff7a941a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eDJgkSRx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '15172ec7-bdaa-478f-93ac-d4dbba6a3a0d', 'attached_at': '', 'detached_at': '', 'volume_id': '83ff0b09-1a99-460d-94d4-df24e2880d18', 'serial': '83ff0b09-1a99-460d-94d4-df24e2880d18'}, 'delete_on_termination': False, 'guest_format': None, 'attachment_id': '341721e7-1e06-4fda-88c3-0063d71f4297', 'volume_type': None} {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 12:15:55 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:15:55 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:15:55 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 12:15:55 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] CPU controller missing on host. {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 12:15:55 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 12:15:55 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] CPU controller found on host. {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 12:15:55 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74190) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 12:15:55 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T11:37:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 12:15:55 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Flavor limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 12:15:55 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Image limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 12:15:55 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Flavor pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 12:15:55 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Image pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 12:15:55 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 12:15:55 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 12:15:55 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 12:15:55 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Got 1 possible topologies {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 12:15:55 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 12:15:55 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 12:15:55 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 15172ec7-bdaa-478f-93ac-d4dbba6a3a0d] Calling os-brick to attach iSCSI Volume {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 12:15:55 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eDJgkSRx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 12:15:55 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 12:15:55 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 12:15:55 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 12:15:55 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 12:15:55 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 12:15:55 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 12:15:55 user nova-compute[74190]: INFO os_brick.initiator.connectors.iscsi [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 12:15:55 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18 -p 172.16.0.220:3260 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:15:55 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:15:55 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a72cbf8-85c0-4fc7-8f18-32e87391efb2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:15:55 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 12:15:55 user nova-compute[74190]:  {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:15:55 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18 -p 172.16.0.220:3260 --interface default --op new {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:15:55 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:15:55 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[095117d6-27fe-44a1-acf4-0ade44f5ea30]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18] added\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:15:55 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18] added
Oct 18 12:15:55 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:15:55 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:15:55 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:15:55 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[496b0614-74e5-495d-ac92-a476bfcea16e]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:15:55 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:15:55 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:15:55 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:15:55 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[5407fc56-ba70-4c14-9011-570d89462c59]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:15:55 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:15:55 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eDJgkSRx {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:15:55 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eDJgkSRx" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:15:55 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea29422-a865-45fd-9258-04a6c69b4bbb]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:15:55 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eDJgkSRx'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:15:55 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:15:55 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:15:55 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a1c86e-2a18-4393-82f7-f186e08b4784]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:15:55 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:15:55 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:15:55 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:15:55 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[9795d574-017b-483b-b38e-d49f66cffb0c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:15:55 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 18 12:15:55 user nova-compute[74190]:  {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 12:15:55 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 18 12:15:55 user nova-compute[74190]:  {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 12:15:55 user nova-compute[74190]: WARNING os_brick.initiator.connectors.iscsi [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 18 12:15:55 user nova-compute[74190]: 
Oct 18 12:15:55 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18 -p 172.16.0.220:3260 --login {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:15:55 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:15:55 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[797f6a49-6645-4362-815f-f042bbd3ffb7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:15:55 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18, portal: 172.16.0.220,3260]
Oct 18 12:15:55 user nova-compute[74190]: Login to [iface: default, target: iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18, portal: 172.16.0.220,3260] successful.
Oct 18 12:15:55 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:15:55 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:15:55 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:15:55 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[3793cb48-e35b-4c0e-91da-f22fde5d43df]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:15:55 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:15:55 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:15:55 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:15:55 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb17315-6e1b-443a-9049-a113159d33e7]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18 (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:15:55 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18 (non-flash)
Oct 18 12:15:55 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 12:15:55 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18 (non-flash)
Oct 18 12:15:55 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 12:15:55 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 12:15:55 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Connected to 172.16.0.220:3260 {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 12:15:55 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=74190) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 12:15:55 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74190) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 12:15:55 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:15:55 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:15:55 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ed2830-ba53-4cc8-80ea-d58acdc5f6f1]: (4, ('- - 0', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:15:55 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: None {{(pid=74190) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 12:15:56 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:15:56 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:15:56 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74190) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 12:15:56 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:15:56 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:15:56 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:15:56 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74190) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 12:15:56 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eDJgkSRx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 12:15:56 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 12:15:56 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '23034663733663537', 'path': '/dev/sdb'} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 12:15:56 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 15172ec7-bdaa-478f-93ac-d4dbba6a3a0d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23034663733663537', 'path': '/dev/sdb'} {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 12:15:56 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T12:15:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1763989655',display_name='tempest-TestVolumeBootPattern-server-1763989655',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1763989655',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFImDkcHIZVVsD1gB2Yh4JGNE0pEbAN8TUjpItUrbhxdmYRzrbNlPip8qPxIcvk8OJEen8xQaAGxdqzAZ1w6kqPbscsnuFtwOBrKfpec5lSOkFKoHZaLFZ1ci5kqBfXOJw==',key_name='tempest-TestVolumeBootPattern-131084726',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e375153f6f24827811c5825fc2a2c6a',ramdisk_id='',reservation_id='r-82spc8nz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1157442382',owner_user_name='tempest-TestVolumeBootPattern-1157442382-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T12:15:39Z,user_data=None,user_id='27d9fc244d0f4e10a43b7df4dc8e30ad',uuid=15172ec7-bdaa-478f-93ac-d4dbba6a3a0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ce5d2e1-0587-486f-9184-5026ff7a941a", "address": "fa:16:3e:d3:87:c8", "network": {"id": "aa827f81-b165-444f-89cc-f21c42a9f772", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1659902586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e375153f6f24827811c5825fc2a2c6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce5d2e1-05", "ovs_interfaceid": "3ce5d2e1-0587-486f-9184-5026ff7a941a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74190) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 12:15:56 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Converting VIF {"id": "3ce5d2e1-0587-486f-9184-5026ff7a941a", "address": "fa:16:3e:d3:87:c8", "network": {"id": "aa827f81-b165-444f-89cc-f21c42a9f772", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1659902586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e375153f6f24827811c5825fc2a2c6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce5d2e1-05", "ovs_interfaceid": "3ce5d2e1-0587-486f-9184-5026ff7a941a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 12:15:56 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:87:c8,bridge_name='br-int',has_traffic_filtering=True,id=3ce5d2e1-0587-486f-9184-5026ff7a941a,network=Network(aa827f81-b165-444f-89cc-f21c42a9f772),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ce5d2e1-05') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 12:15:56 user nova-compute[74190]: DEBUG nova.objects.instance [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lazy-loading 'pci_devices' on Instance uuid 15172ec7-bdaa-478f-93ac-d4dbba6a3a0d {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:15:56 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 15172ec7-bdaa-478f-93ac-d4dbba6a3a0d] End _get_guest_xml xml=<domain type="kvm">
Oct 18 12:15:56 user nova-compute[74190]:   <uuid>15172ec7-bdaa-478f-93ac-d4dbba6a3a0d</uuid>
Oct 18 12:15:56 user nova-compute[74190]:   <name>instance-0000002f</name>
Oct 18 12:15:56 user nova-compute[74190]:   <memory>524288</memory>
Oct 18 12:15:56 user nova-compute[74190]:   <vcpu>1</vcpu>
Oct 18 12:15:56 user nova-compute[74190]:   <metadata>
Oct 18 12:15:56 user nova-compute[74190]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 12:15:56 user nova-compute[74190]:       <nova:package version="0.0.0"/>
Oct 18 12:15:56 user nova-compute[74190]:       <nova:name>tempest-TestVolumeBootPattern-server-1763989655</nova:name>
Oct 18 12:15:56 user nova-compute[74190]:       <nova:creationTime>2023-10-18 12:15:55</nova:creationTime>
Oct 18 12:15:56 user nova-compute[74190]:       <nova:flavor name="m1.tiny">
Oct 18 12:15:56 user nova-compute[74190]:         <nova:memory>512</nova:memory>
Oct 18 12:15:56 user nova-compute[74190]:         <nova:disk>1</nova:disk>
Oct 18 12:15:56 user nova-compute[74190]:         <nova:swap>0</nova:swap>
Oct 18 12:15:56 user nova-compute[74190]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 12:15:56 user nova-compute[74190]:         <nova:vcpus>1</nova:vcpus>
Oct 18 12:15:56 user nova-compute[74190]:       </nova:flavor>
Oct 18 12:15:56 user nova-compute[74190]:       <nova:owner>
Oct 18 12:15:56 user nova-compute[74190]:         <nova:user uuid="27d9fc244d0f4e10a43b7df4dc8e30ad">tempest-TestVolumeBootPattern-1157442382-project-member</nova:user>
Oct 18 12:15:56 user nova-compute[74190]:         <nova:project uuid="1e375153f6f24827811c5825fc2a2c6a">tempest-TestVolumeBootPattern-1157442382</nova:project>
Oct 18 12:15:56 user nova-compute[74190]:       </nova:owner>
Oct 18 12:15:56 user nova-compute[74190]:       <nova:ports>
Oct 18 12:15:56 user nova-compute[74190]:         <nova:port uuid="3ce5d2e1-0587-486f-9184-5026ff7a941a">
Oct 18 12:15:56 user nova-compute[74190]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 18 12:15:56 user nova-compute[74190]:         </nova:port>
Oct 18 12:15:56 user nova-compute[74190]:       </nova:ports>
Oct 18 12:15:56 user nova-compute[74190]:     </nova:instance>
Oct 18 12:15:56 user nova-compute[74190]:   </metadata>
Oct 18 12:15:56 user nova-compute[74190]:   <sysinfo type="smbios">
Oct 18 12:15:56 user nova-compute[74190]:     <system>
Oct 18 12:15:56 user nova-compute[74190]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 12:15:56 user nova-compute[74190]:       <entry name="product">OpenStack Nova</entry>
Oct 18 12:15:56 user nova-compute[74190]:       <entry name="version">0.0.0</entry>
Oct 18 12:15:56 user nova-compute[74190]:       <entry name="serial">15172ec7-bdaa-478f-93ac-d4dbba6a3a0d</entry>
Oct 18 12:15:56 user nova-compute[74190]:       <entry name="uuid">15172ec7-bdaa-478f-93ac-d4dbba6a3a0d</entry>
Oct 18 12:15:56 user nova-compute[74190]:       <entry name="family">Virtual Machine</entry>
Oct 18 12:15:56 user nova-compute[74190]:     </system>
Oct 18 12:15:56 user nova-compute[74190]:   </sysinfo>
Oct 18 12:15:56 user nova-compute[74190]:   <os>
Oct 18 12:15:56 user nova-compute[74190]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 12:15:56 user nova-compute[74190]:     <boot dev="hd"/>
Oct 18 12:15:56 user nova-compute[74190]:     <smbios mode="sysinfo"/>
Oct 18 12:15:56 user nova-compute[74190]:   </os>
Oct 18 12:15:56 user nova-compute[74190]:   <features>
Oct 18 12:15:56 user nova-compute[74190]:     <acpi/>
Oct 18 12:15:56 user nova-compute[74190]:     <apic/>
Oct 18 12:15:56 user nova-compute[74190]:     <vmcoreinfo/>
Oct 18 12:15:56 user nova-compute[74190]:   </features>
Oct 18 12:15:56 user nova-compute[74190]:   <clock offset="utc">
Oct 18 12:15:56 user nova-compute[74190]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 12:15:56 user nova-compute[74190]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 12:15:56 user nova-compute[74190]:     <timer name="hpet" present="no"/>
Oct 18 12:15:56 user nova-compute[74190]:   </clock>
Oct 18 12:15:56 user nova-compute[74190]:   <cpu mode="custom" match="exact">
Oct 18 12:15:56 user nova-compute[74190]:     <model>Nehalem</model>
Oct 18 12:15:56 user nova-compute[74190]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 12:15:56 user nova-compute[74190]:   </cpu>
Oct 18 12:15:56 user nova-compute[74190]:   <devices>
Oct 18 12:15:56 user nova-compute[74190]:     <disk type="block" device="disk">
Oct 18 12:15:56 user nova-compute[74190]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 12:15:56 user nova-compute[74190]:       <source dev="/dev/sdb"/>
Oct 18 12:15:56 user nova-compute[74190]:       <target dev="vda" bus="virtio"/>
Oct 18 12:15:56 user nova-compute[74190]:       <serial>83ff0b09-1a99-460d-94d4-df24e2880d18</serial>
Oct 18 12:15:56 user nova-compute[74190]:     </disk>
Oct 18 12:15:56 user nova-compute[74190]:     <interface type="ethernet">
Oct 18 12:15:56 user nova-compute[74190]:       <mac address="fa:16:3e:d3:87:c8"/>
Oct 18 12:15:56 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 12:15:56 user nova-compute[74190]:       <mtu size="1442"/>
Oct 18 12:15:56 user nova-compute[74190]:       <target dev="tap3ce5d2e1-05"/>
Oct 18 12:15:56 user nova-compute[74190]:     </interface>
Oct 18 12:15:56 user nova-compute[74190]:     <serial type="pty">
Oct 18 12:15:56 user nova-compute[74190]:       <log file="/opt/stack/data/nova/instances/15172ec7-bdaa-478f-93ac-d4dbba6a3a0d/console.log" append="off"/>
Oct 18 12:15:56 user nova-compute[74190]:     </serial>
Oct 18 12:15:56 user nova-compute[74190]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 12:15:56 user nova-compute[74190]:     <video>
Oct 18 12:15:56 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 12:15:56 user nova-compute[74190]:     </video>
Oct 18 12:15:56 user nova-compute[74190]:     <rng model="virtio">
Oct 18 12:15:56 user nova-compute[74190]:       <backend model="random">/dev/urandom</backend>
Oct 18 12:15:56 user nova-compute[74190]:     </rng>
Oct 18 12:15:56 user nova-compute[74190]:     <controller type="usb" index="0" model="none"/>
Oct 18 12:15:56 user nova-compute[74190]:     <memballoon model="virtio">
Oct 18 12:15:56 user nova-compute[74190]:       <stats period="10"/>
Oct 18 12:15:56 user nova-compute[74190]:     </memballoon>
Oct 18 12:15:56 user nova-compute[74190]:   </devices>
Oct 18 12:15:56 user nova-compute[74190]: </domain>
Oct 18 12:15:56 user nova-compute[74190]:  {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 12:15:56 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T12:15:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1763989655',display_name='tempest-TestVolumeBootPattern-server-1763989655',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1763989655',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFImDkcHIZVVsD1gB2Yh4JGNE0pEbAN8TUjpItUrbhxdmYRzrbNlPip8qPxIcvk8OJEen8xQaAGxdqzAZ1w6kqPbscsnuFtwOBrKfpec5lSOkFKoHZaLFZ1ci5kqBfXOJw==',key_name='tempest-TestVolumeBootPattern-131084726',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e375153f6f24827811c5825fc2a2c6a',ramdisk_id='',reservation_id='r-82spc8nz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1157442382',owner_user_name='tempest-TestVolumeBootPattern-1157442382-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T12:15:39Z,user_data=None,user_id='27d9fc244d0f4e10a43b7df4dc8e30ad',uuid=15172ec7-bdaa-478f-93ac-d4dbba6a3a0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ce5d2e1-0587-486f-9184-5026ff7a941a", "address": "fa:16:3e:d3:87:c8", "network": {"id": "aa827f81-b165-444f-89cc-f21c42a9f772", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1659902586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e375153f6f24827811c5825fc2a2c6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce5d2e1-05", "ovs_interfaceid": "3ce5d2e1-0587-486f-9184-5026ff7a941a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 12:15:56 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Converting VIF {"id": "3ce5d2e1-0587-486f-9184-5026ff7a941a", "address": "fa:16:3e:d3:87:c8", "network": {"id": "aa827f81-b165-444f-89cc-f21c42a9f772", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1659902586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e375153f6f24827811c5825fc2a2c6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce5d2e1-05", "ovs_interfaceid": "3ce5d2e1-0587-486f-9184-5026ff7a941a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 12:15:56 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:87:c8,bridge_name='br-int',has_traffic_filtering=True,id=3ce5d2e1-0587-486f-9184-5026ff7a941a,network=Network(aa827f81-b165-444f-89cc-f21c42a9f772),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ce5d2e1-05') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 12:15:56 user nova-compute[74190]: DEBUG os_vif [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:87:c8,bridge_name='br-int',has_traffic_filtering=True,id=3ce5d2e1-0587-486f-9184-5026ff7a941a,network=Network(aa827f81-b165-444f-89cc-f21c42a9f772),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ce5d2e1-05') {{(pid=74190) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 12:15:56 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:15:56 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:15:56 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 12:15:56 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:15:56 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f3bd705f-ef9c-5ef9-a691-eba0445d9889', '_type': 'linux-noop'}}, row=False) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:15:56 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:15:56 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:15:56 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:15:56 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3ce5d2e1-05, may_exist=True, interface_attrs={}) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:15:56 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3ce5d2e1-05, col_values=(('qos', UUID('f5d549f3-0a9d-417f-99e4-20bb5c704dbc')),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:15:56 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3ce5d2e1-05, col_values=(('external_ids', {'iface-id': '3ce5d2e1-0587-486f-9184-5026ff7a941a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:87:c8', 'vm-uuid': '15172ec7-bdaa-478f-93ac-d4dbba6a3a0d'}),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:15:56 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:15:56 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:15:56 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:15:56 user nova-compute[74190]: INFO os_vif [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:87:c8,bridge_name='br-int',has_traffic_filtering=True,id=3ce5d2e1-0587-486f-9184-5026ff7a941a,network=Network(aa827f81-b165-444f-89cc-f21c42a9f772),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ce5d2e1-05')
Oct 18 12:15:57 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] No BDM found with device name vda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 12:15:57 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] No VIF found with MAC fa:16:3e:d3:87:c8, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 12:15:58 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:15:58 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:15:58 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:15:58 user nova-compute[74190]: DEBUG nova.compute.manager [req-2cab818c-0c6a-4cd7-9aca-e5998afe0730 req-40ebae00-5e8f-4818-88b9-9f8015001880 service nova] [instance: 15172ec7-bdaa-478f-93ac-d4dbba6a3a0d] Received event network-vif-plugged-3ce5d2e1-0587-486f-9184-5026ff7a941a {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:15:58 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-2cab818c-0c6a-4cd7-9aca-e5998afe0730 req-40ebae00-5e8f-4818-88b9-9f8015001880 service nova] Acquiring lock "15172ec7-bdaa-478f-93ac-d4dbba6a3a0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:15:58 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-2cab818c-0c6a-4cd7-9aca-e5998afe0730 req-40ebae00-5e8f-4818-88b9-9f8015001880 service nova] Lock "15172ec7-bdaa-478f-93ac-d4dbba6a3a0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:15:58 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-2cab818c-0c6a-4cd7-9aca-e5998afe0730 req-40ebae00-5e8f-4818-88b9-9f8015001880 service nova] Lock "15172ec7-bdaa-478f-93ac-d4dbba6a3a0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:15:58 user nova-compute[74190]: DEBUG nova.compute.manager [req-2cab818c-0c6a-4cd7-9aca-e5998afe0730 req-40ebae00-5e8f-4818-88b9-9f8015001880 service nova] [instance: 15172ec7-bdaa-478f-93ac-d4dbba6a3a0d] No waiting events found dispatching network-vif-plugged-3ce5d2e1-0587-486f-9184-5026ff7a941a {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:15:58 user nova-compute[74190]: WARNING nova.compute.manager [req-2cab818c-0c6a-4cd7-9aca-e5998afe0730 req-40ebae00-5e8f-4818-88b9-9f8015001880 service nova] [instance: 15172ec7-bdaa-478f-93ac-d4dbba6a3a0d] Received unexpected event network-vif-plugged-3ce5d2e1-0587-486f-9184-5026ff7a941a for instance with vm_state building and task_state spawning.
Oct 18 12:15:58 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:15:58 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:15:58 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:15:58 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:16:00 user nova-compute[74190]: DEBUG nova.compute.manager [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 15172ec7-bdaa-478f-93ac-d4dbba6a3a0d] Instance event wait completed in 0 seconds for  {{(pid=74190) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 12:16:00 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 15172ec7-bdaa-478f-93ac-d4dbba6a3a0d] Guest created on hypervisor {{(pid=74190) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 12:16:00 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 15172ec7-bdaa-478f-93ac-d4dbba6a3a0d] Instance spawned successfully.
Oct 18 12:16:00 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 15172ec7-bdaa-478f-93ac-d4dbba6a3a0d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 12:16:00 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 15172ec7-bdaa-478f-93ac-d4dbba6a3a0d] Found default for hw_cdrom_bus of ide {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:16:00 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 15172ec7-bdaa-478f-93ac-d4dbba6a3a0d] Found default for hw_disk_bus of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:16:00 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 15172ec7-bdaa-478f-93ac-d4dbba6a3a0d] Found default for hw_input_bus of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:16:00 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 15172ec7-bdaa-478f-93ac-d4dbba6a3a0d] Found default for hw_pointer_model of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:16:00 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 15172ec7-bdaa-478f-93ac-d4dbba6a3a0d] Found default for hw_video_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:16:00 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 15172ec7-bdaa-478f-93ac-d4dbba6a3a0d] Found default for hw_vif_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:16:00 user nova-compute[74190]: INFO nova.compute.manager [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 15172ec7-bdaa-478f-93ac-d4dbba6a3a0d] Took 4.91 seconds to spawn the instance on the hypervisor.
Oct 18 12:16:00 user nova-compute[74190]: DEBUG nova.compute.manager [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 15172ec7-bdaa-478f-93ac-d4dbba6a3a0d] Checking state {{(pid=74190) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 12:16:00 user nova-compute[74190]: INFO nova.compute.manager [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 15172ec7-bdaa-478f-93ac-d4dbba6a3a0d] Took 22.33 seconds to build instance.
Oct 18 12:16:00 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-4a5e71a7-c60e-4ee9-8f2d-b57175af6aa0 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "15172ec7-bdaa-478f-93ac-d4dbba6a3a0d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.479s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:16:00 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:16:00 user nova-compute[74190]: DEBUG nova.compute.manager [req-abd15b40-ca53-431f-9046-093a4e42f7a5 req-11e1de86-19eb-46be-8caa-ac37de7be6d3 service nova] [instance: 15172ec7-bdaa-478f-93ac-d4dbba6a3a0d] Received event network-vif-plugged-3ce5d2e1-0587-486f-9184-5026ff7a941a {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:16:00 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-abd15b40-ca53-431f-9046-093a4e42f7a5 req-11e1de86-19eb-46be-8caa-ac37de7be6d3 service nova] Acquiring lock "15172ec7-bdaa-478f-93ac-d4dbba6a3a0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:16:00 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-abd15b40-ca53-431f-9046-093a4e42f7a5 req-11e1de86-19eb-46be-8caa-ac37de7be6d3 service nova] Lock "15172ec7-bdaa-478f-93ac-d4dbba6a3a0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:16:00 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-abd15b40-ca53-431f-9046-093a4e42f7a5 req-11e1de86-19eb-46be-8caa-ac37de7be6d3 service nova] Lock "15172ec7-bdaa-478f-93ac-d4dbba6a3a0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:16:00 user nova-compute[74190]: DEBUG nova.compute.manager [req-abd15b40-ca53-431f-9046-093a4e42f7a5 req-11e1de86-19eb-46be-8caa-ac37de7be6d3 service nova] [instance: 15172ec7-bdaa-478f-93ac-d4dbba6a3a0d] No waiting events found dispatching network-vif-plugged-3ce5d2e1-0587-486f-9184-5026ff7a941a {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:16:00 user nova-compute[74190]: WARNING nova.compute.manager [req-abd15b40-ca53-431f-9046-093a4e42f7a5 req-11e1de86-19eb-46be-8caa-ac37de7be6d3 service nova] [instance: 15172ec7-bdaa-478f-93ac-d4dbba6a3a0d] Received unexpected event network-vif-plugged-3ce5d2e1-0587-486f-9184-5026ff7a941a for instance with vm_state active and task_state None.
Oct 18 12:16:01 user nova-compute[74190]: DEBUG nova.compute.manager [req-3df124c6-3350-4d5d-9c47-11e650bb6512 req-90d1e350-9131-45b6-a1c2-d22d0840a411 service nova] [instance: 0309a457-dae8-4a13-ac5c-53e2320930ff] Received event network-changed-15fe1d6a-f1b1-4ba7-baa8-7c9c2a0f8643 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:16:01 user nova-compute[74190]: DEBUG nova.compute.manager [req-3df124c6-3350-4d5d-9c47-11e650bb6512 req-90d1e350-9131-45b6-a1c2-d22d0840a411 service nova] [instance: 0309a457-dae8-4a13-ac5c-53e2320930ff] Refreshing instance network info cache due to event network-changed-15fe1d6a-f1b1-4ba7-baa8-7c9c2a0f8643. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 12:16:01 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-3df124c6-3350-4d5d-9c47-11e650bb6512 req-90d1e350-9131-45b6-a1c2-d22d0840a411 service nova] Acquiring lock "refresh_cache-0309a457-dae8-4a13-ac5c-53e2320930ff" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:16:01 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-3df124c6-3350-4d5d-9c47-11e650bb6512 req-90d1e350-9131-45b6-a1c2-d22d0840a411 service nova] Acquired lock "refresh_cache-0309a457-dae8-4a13-ac5c-53e2320930ff" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:16:01 user nova-compute[74190]: DEBUG nova.network.neutron [req-3df124c6-3350-4d5d-9c47-11e650bb6512 req-90d1e350-9131-45b6-a1c2-d22d0840a411 service nova] [instance: 0309a457-dae8-4a13-ac5c-53e2320930ff] Refreshing network info cache for port 15fe1d6a-f1b1-4ba7-baa8-7c9c2a0f8643 {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 12:16:01 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-2bd8ed4e-6524-433f-b566-9bd84969c908 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Acquiring lock "0309a457-dae8-4a13-ac5c-53e2320930ff" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:16:01 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-2bd8ed4e-6524-433f-b566-9bd84969c908 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Lock "0309a457-dae8-4a13-ac5c-53e2320930ff" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:16:01 user nova-compute[74190]: DEBUG nova.objects.instance [None req-2bd8ed4e-6524-433f-b566-9bd84969c908 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Lazy-loading 'flavor' on Instance uuid 0309a457-dae8-4a13-ac5c-53e2320930ff {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:16:01 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-2bd8ed4e-6524-433f-b566-9bd84969c908 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: 0309a457-dae8-4a13-ac5c-53e2320930ff] Ignoring supplied device name: /dev/vdb
Oct 18 12:16:01 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-2bd8ed4e-6524-433f-b566-9bd84969c908 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Lock "0309a457-dae8-4a13-ac5c-53e2320930ff" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:16:01 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-2bd8ed4e-6524-433f-b566-9bd84969c908 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Acquiring lock "0309a457-dae8-4a13-ac5c-53e2320930ff" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:16:01 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-2bd8ed4e-6524-433f-b566-9bd84969c908 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Lock "0309a457-dae8-4a13-ac5c-53e2320930ff" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:16:01 user nova-compute[74190]: INFO nova.compute.manager [None req-2bd8ed4e-6524-433f-b566-9bd84969c908 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: 0309a457-dae8-4a13-ac5c-53e2320930ff] Attaching volume ac80cf2c-4cd2-4380-b464-4b546c08bc21 to /dev/vdb
Oct 18 12:16:01 user nova-compute[74190]: DEBUG nova.network.neutron [req-3df124c6-3350-4d5d-9c47-11e650bb6512 req-90d1e350-9131-45b6-a1c2-d22d0840a411 service nova] [instance: 0309a457-dae8-4a13-ac5c-53e2320930ff] Updated VIF entry in instance network info cache for port 15fe1d6a-f1b1-4ba7-baa8-7c9c2a0f8643. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 12:16:01 user nova-compute[74190]: DEBUG nova.network.neutron [req-3df124c6-3350-4d5d-9c47-11e650bb6512 req-90d1e350-9131-45b6-a1c2-d22d0840a411 service nova] [instance: 0309a457-dae8-4a13-ac5c-53e2320930ff] Updating instance_info_cache with network_info: [{"id": "15fe1d6a-f1b1-4ba7-baa8-7c9c2a0f8643", "address": "fa:16:3e:4e:a5:f5", "network": {"id": "1afc08fa-4518-4ccf-97a1-22f04820b31c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-687660220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e49c9e381b0457faa31d0f5bdfa3f18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15fe1d6a-f1", "ovs_interfaceid": "15fe1d6a-f1b1-4ba7-baa8-7c9c2a0f8643", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:16:01 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-3df124c6-3350-4d5d-9c47-11e650bb6512 req-90d1e350-9131-45b6-a1c2-d22d0840a411 service nova] Releasing lock "refresh_cache-0309a457-dae8-4a13-ac5c-53e2320930ff" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:16:01 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:16:02 user nova-compute[74190]: DEBUG os_brick.utils [None req-2bd8ed4e-6524-433f-b566-9bd84969c908 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 12:16:02 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:16:02 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:16:02 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff2e2c4-2a2d-40a6-af42-39885f80d8dd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cff158e257e1\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:16:02 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:16:02 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:16:02 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[530b80d8-3329-4c52-b4db-6f812ce4aa19]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:16:02 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:16:02 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:16:02 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[74415432-91b8-4780-9aef-0fa4befb1b36]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:16:02 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf043277-1538-4b9b-877b-a5450759aede]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:16:02 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-2bd8ed4e-6524-433f-b566-9bd84969c908 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Running cmd (subprocess): nvme version {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:16:02 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-2bd8ed4e-6524-433f-b566-9bd84969c908 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] 'nvme version' failed. Not Retrying. {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 12:16:02 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2bd8ed4e-6524-433f-b566-9bd84969c908 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] nvme not present on system {{(pid=74190) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 12:16:02 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:16:02 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 12:16:02 user nova-compute[74190]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 12:16:02 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce5c602-80fe-47f1-a0c7-7aa855bf9bd8]: (4, '') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:16:02 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-2bd8ed4e-6524-433f-b566-9bd84969c908 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74190) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 12:16:02 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-2bd8ed4e-6524-433f-b566-9bd84969c908 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 12:16:02 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-2bd8ed4e-6524-433f-b566-9bd84969c908 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] LIGHTOS: no hostnqn found. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 12:16:02 user nova-compute[74190]: DEBUG os_brick.utils [None req-2bd8ed4e-6524-433f-b566-9bd84969c908 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cff158e257e1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 12:16:02 user nova-compute[74190]: DEBUG nova.virt.block_device [None req-2bd8ed4e-6524-433f-b566-9bd84969c908 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: 0309a457-dae8-4a13-ac5c-53e2320930ff] Updating existing volume attachment record: 2e43bbac-699f-49fb-b5d2-e4743e295412 {{(pid=74190) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 12:16:05 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:16:06 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:16:10 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:16:11 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:16:14 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-54796e16-f85a-42a0-a4e5-4da9281aed97 tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Acquiring lock "f4f9eac7-b9ed-42a7-890b-79da3afe46a1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:16:14 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-54796e16-f85a-42a0-a4e5-4da9281aed97 tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Lock "f4f9eac7-b9ed-42a7-890b-79da3afe46a1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:16:14 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-54796e16-f85a-42a0-a4e5-4da9281aed97 tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Acquiring lock "f4f9eac7-b9ed-42a7-890b-79da3afe46a1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:16:14 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-54796e16-f85a-42a0-a4e5-4da9281aed97 tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Lock "f4f9eac7-b9ed-42a7-890b-79da3afe46a1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:16:14 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-54796e16-f85a-42a0-a4e5-4da9281aed97 tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Lock "f4f9eac7-b9ed-42a7-890b-79da3afe46a1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:16:14 user nova-compute[74190]: INFO nova.compute.manager [None req-54796e16-f85a-42a0-a4e5-4da9281aed97 tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] [instance: f4f9eac7-b9ed-42a7-890b-79da3afe46a1] Terminating instance
Oct 18 12:16:14 user nova-compute[74190]: DEBUG nova.compute.manager [None req-54796e16-f85a-42a0-a4e5-4da9281aed97 tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] [instance: f4f9eac7-b9ed-42a7-890b-79da3afe46a1] Start destroying the instance on the hypervisor. {{(pid=74190) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 12:16:14 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:16:14 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:16:15 user nova-compute[74190]: DEBUG nova.compute.manager [req-54d7aed1-15df-4239-99d3-f1ddc8dfa379 req-8f2920aa-9de7-47b7-8cb5-8827415a86e3 service nova] [instance: f4f9eac7-b9ed-42a7-890b-79da3afe46a1] Received event network-vif-unplugged-84228aca-9249-4ed5-8774-629e3b1b82d8 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:16:15 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-54d7aed1-15df-4239-99d3-f1ddc8dfa379 req-8f2920aa-9de7-47b7-8cb5-8827415a86e3 service nova] Acquiring lock "f4f9eac7-b9ed-42a7-890b-79da3afe46a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:16:15 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-54d7aed1-15df-4239-99d3-f1ddc8dfa379 req-8f2920aa-9de7-47b7-8cb5-8827415a86e3 service nova] Lock "f4f9eac7-b9ed-42a7-890b-79da3afe46a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:16:15 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-54d7aed1-15df-4239-99d3-f1ddc8dfa379 req-8f2920aa-9de7-47b7-8cb5-8827415a86e3 service nova] Lock "f4f9eac7-b9ed-42a7-890b-79da3afe46a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:16:15 user nova-compute[74190]: DEBUG nova.compute.manager [req-54d7aed1-15df-4239-99d3-f1ddc8dfa379 req-8f2920aa-9de7-47b7-8cb5-8827415a86e3 service nova] [instance: f4f9eac7-b9ed-42a7-890b-79da3afe46a1] No waiting events found dispatching network-vif-unplugged-84228aca-9249-4ed5-8774-629e3b1b82d8 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:16:15 user nova-compute[74190]: DEBUG nova.compute.manager [req-54d7aed1-15df-4239-99d3-f1ddc8dfa379 req-8f2920aa-9de7-47b7-8cb5-8827415a86e3 service nova] [instance: f4f9eac7-b9ed-42a7-890b-79da3afe46a1] Received event network-vif-unplugged-84228aca-9249-4ed5-8774-629e3b1b82d8 for instance with task_state deleting. {{(pid=74190) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 12:16:15 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:16:15 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:16:15 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:16:15 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: f4f9eac7-b9ed-42a7-890b-79da3afe46a1] Instance destroyed successfully.
Oct 18 12:16:15 user nova-compute[74190]: DEBUG nova.objects.instance [None req-54796e16-f85a-42a0-a4e5-4da9281aed97 tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Lazy-loading 'resources' on Instance uuid f4f9eac7-b9ed-42a7-890b-79da3afe46a1 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:16:15 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-54796e16-f85a-42a0-a4e5-4da9281aed97 tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T12:14:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1043341434',display_name='tempest-ServersNegativeTestJSON-server-1043341434',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1043341434',id=46,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-18T12:14:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f84b62d410cc448486b792e094464815',ramdisk_id='',reservation_id='r-666gnm5e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1845899853',owner_user_name='tempest-ServersNegativeTestJSON-1845899853-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T12:14:32Z,user_data=None,user_id='abbdcac234ac48acbc56abf3fda115e5',uuid=f4f9eac7-b9ed-42a7-890b-79da3afe46a1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "84228aca-9249-4ed5-8774-629e3b1b82d8", "address": "fa:16:3e:6e:6b:55", "network": {"id": "31e59f3e-dc25-4b00-9d87-4b4f695425b8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-220402675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f84b62d410cc448486b792e094464815", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84228aca-92", "ovs_interfaceid": "84228aca-9249-4ed5-8774-629e3b1b82d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 12:16:15 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-54796e16-f85a-42a0-a4e5-4da9281aed97 tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Converting VIF {"id": "84228aca-9249-4ed5-8774-629e3b1b82d8", "address": "fa:16:3e:6e:6b:55", "network": {"id": "31e59f3e-dc25-4b00-9d87-4b4f695425b8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-220402675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f84b62d410cc448486b792e094464815", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84228aca-92", "ovs_interfaceid": "84228aca-9249-4ed5-8774-629e3b1b82d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 12:16:15 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-54796e16-f85a-42a0-a4e5-4da9281aed97 tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:6b:55,bridge_name='br-int',has_traffic_filtering=True,id=84228aca-9249-4ed5-8774-629e3b1b82d8,network=Network(31e59f3e-dc25-4b00-9d87-4b4f695425b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84228aca-92') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 12:16:15 user nova-compute[74190]: DEBUG os_vif [None req-54796e16-f85a-42a0-a4e5-4da9281aed97 tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:6b:55,bridge_name='br-int',has_traffic_filtering=True,id=84228aca-9249-4ed5-8774-629e3b1b82d8,network=Network(31e59f3e-dc25-4b00-9d87-4b4f695425b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84228aca-92') {{(pid=74190) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 12:16:15 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:16:15 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap84228aca-92, bridge=br-int, if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:16:15 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:16:15 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:16:15 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:16:15 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cbea367b-c3f1-46b8-aa80-c64069771520) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:16:15 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:16:15 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:16:15 user nova-compute[74190]: INFO os_vif [None req-54796e16-f85a-42a0-a4e5-4da9281aed97 tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:6b:55,bridge_name='br-int',has_traffic_filtering=True,id=84228aca-9249-4ed5-8774-629e3b1b82d8,network=Network(31e59f3e-dc25-4b00-9d87-4b4f695425b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84228aca-92')
Oct 18 12:16:15 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-54796e16-f85a-42a0-a4e5-4da9281aed97 tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] [instance: f4f9eac7-b9ed-42a7-890b-79da3afe46a1] Deleting instance files /opt/stack/data/nova/instances/f4f9eac7-b9ed-42a7-890b-79da3afe46a1_del
Oct 18 12:16:15 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-54796e16-f85a-42a0-a4e5-4da9281aed97 tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] [instance: f4f9eac7-b9ed-42a7-890b-79da3afe46a1] Deletion of /opt/stack/data/nova/instances/f4f9eac7-b9ed-42a7-890b-79da3afe46a1_del complete
Oct 18 12:16:15 user nova-compute[74190]: INFO nova.compute.manager [None req-54796e16-f85a-42a0-a4e5-4da9281aed97 tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] [instance: f4f9eac7-b9ed-42a7-890b-79da3afe46a1] Took 0.71 seconds to destroy the instance on the hypervisor.
Oct 18 12:16:15 user nova-compute[74190]: DEBUG oslo.service.loopingcall [None req-54796e16-f85a-42a0-a4e5-4da9281aed97 tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74190) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 12:16:15 user nova-compute[74190]: DEBUG nova.compute.manager [-] [instance: f4f9eac7-b9ed-42a7-890b-79da3afe46a1] Deallocating network for instance {{(pid=74190) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 12:16:15 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: f4f9eac7-b9ed-42a7-890b-79da3afe46a1] deallocate_for_instance() {{(pid=74190) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 12:16:15 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:16:16 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: f4f9eac7-b9ed-42a7-890b-79da3afe46a1] Updating instance_info_cache with network_info: [] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:16:16 user nova-compute[74190]: INFO nova.compute.manager [-] [instance: f4f9eac7-b9ed-42a7-890b-79da3afe46a1] Took 0.50 seconds to deallocate network for instance.
Oct 18 12:16:16 user nova-compute[74190]: DEBUG nova.compute.manager [req-e3c86e6f-c641-49b9-aa8b-5000b6d05e9f req-518048e7-9587-418d-b23c-fadb8b993166 service nova] [instance: f4f9eac7-b9ed-42a7-890b-79da3afe46a1] Received event network-vif-deleted-84228aca-9249-4ed5-8774-629e3b1b82d8 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:16:16 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-54796e16-f85a-42a0-a4e5-4da9281aed97 tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:16:16 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-54796e16-f85a-42a0-a4e5-4da9281aed97 tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:16:16 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-54796e16-f85a-42a0-a4e5-4da9281aed97 tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 12:16:16 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-54796e16-f85a-42a0-a4e5-4da9281aed97 tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 12:16:16 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-54796e16-f85a-42a0-a4e5-4da9281aed97 tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.283s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:16:16 user nova-compute[74190]: INFO nova.scheduler.client.report [None req-54796e16-f85a-42a0-a4e5-4da9281aed97 tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Deleted allocations for instance f4f9eac7-b9ed-42a7-890b-79da3afe46a1
Oct 18 12:16:16 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-54796e16-f85a-42a0-a4e5-4da9281aed97 tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Lock "f4f9eac7-b9ed-42a7-890b-79da3afe46a1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.703s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:16:17 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:16:17 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:16:17 user nova-compute[74190]: DEBUG nova.compute.manager [req-d3202233-85b2-46f8-8962-e2e1337e9687 req-8f0dad50-5669-47ef-a449-61acf9773f40 service nova] [instance: f4f9eac7-b9ed-42a7-890b-79da3afe46a1] Received event network-vif-plugged-84228aca-9249-4ed5-8774-629e3b1b82d8 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:16:17 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d3202233-85b2-46f8-8962-e2e1337e9687 req-8f0dad50-5669-47ef-a449-61acf9773f40 service nova] Acquiring lock "f4f9eac7-b9ed-42a7-890b-79da3afe46a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:16:17 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d3202233-85b2-46f8-8962-e2e1337e9687 req-8f0dad50-5669-47ef-a449-61acf9773f40 service nova] Lock "f4f9eac7-b9ed-42a7-890b-79da3afe46a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:16:17 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d3202233-85b2-46f8-8962-e2e1337e9687 req-8f0dad50-5669-47ef-a449-61acf9773f40 service nova] Lock "f4f9eac7-b9ed-42a7-890b-79da3afe46a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:16:17 user nova-compute[74190]: DEBUG nova.compute.manager [req-d3202233-85b2-46f8-8962-e2e1337e9687 req-8f0dad50-5669-47ef-a449-61acf9773f40 service nova] [instance: f4f9eac7-b9ed-42a7-890b-79da3afe46a1] No waiting events found dispatching network-vif-plugged-84228aca-9249-4ed5-8774-629e3b1b82d8 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:16:17 user nova-compute[74190]: WARNING nova.compute.manager [req-d3202233-85b2-46f8-8962-e2e1337e9687 req-8f0dad50-5669-47ef-a449-61acf9773f40 service nova] [instance: f4f9eac7-b9ed-42a7-890b-79da3afe46a1] Received unexpected event network-vif-plugged-84228aca-9249-4ed5-8774-629e3b1b82d8 for instance with vm_state deleted and task_state None.
Oct 18 12:16:19 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2bd8ed4e-6524-433f-b566-9bd84969c908 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: 0309a457-dae8-4a13-ac5c-53e2320930ff] Calling os-brick to attach iSCSI Volume {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 12:16:19 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd8ed4e-6524-433f-b566-9bd84969c908 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ac80cf2c-4cd2-4380-b464-4b546c08bc21', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wCRpqogO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 12:16:19 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-2bd8ed4e-6524-433f-b566-9bd84969c908 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 12:16:19 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-2bd8ed4e-6524-433f-b566-9bd84969c908 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 12:16:19 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-2bd8ed4e-6524-433f-b566-9bd84969c908 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 12:16:19 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-2bd8ed4e-6524-433f-b566-9bd84969c908 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 12:16:19 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-2bd8ed4e-6524-433f-b566-9bd84969c908 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac80cf2c-4cd2-4380-b464-4b546c08bc21" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 12:16:19 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-2bd8ed4e-6524-433f-b566-9bd84969c908 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac80cf2c-4cd2-4380-b464-4b546c08bc21" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 12:16:19 user nova-compute[74190]: INFO os_brick.initiator.connectors.iscsi [None req-2bd8ed4e-6524-433f-b566-9bd84969c908 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 12:16:19 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac80cf2c-4cd2-4380-b464-4b546c08bc21 -p 172.16.0.220:3260 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:16:19 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac80cf2c-4cd2-4380-b464-4b546c08bc21 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:16:19 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f99f958-695e-416c-a571-9a69d8975dd5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:16:19 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd8ed4e-6524-433f-b566-9bd84969c908 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 12:16:19 user nova-compute[74190]:  {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:16:19 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac80cf2c-4cd2-4380-b464-4b546c08bc21 -p 172.16.0.220:3260 --interface default --op new {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:16:19 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac80cf2c-4cd2-4380-b464-4b546c08bc21 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:16:19 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a242e3d-53e0-4e51-a0c2-06069651af57]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ac80cf2c-4cd2-4380-b464-4b546c08bc21] added\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:16:19 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd8ed4e-6524-433f-b566-9bd84969c908 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ac80cf2c-4cd2-4380-b464-4b546c08bc21] added
Oct 18 12:16:19 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:16:19 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac80cf2c-4cd2-4380-b464-4b546c08bc21 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:16:19 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac80cf2c-4cd2-4380-b464-4b546c08bc21 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:16:19 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[716dd338-d9a1-4e75-a880-8b13fe2de85d]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:16:19 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd8ed4e-6524-433f-b566-9bd84969c908 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:16:19 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac80cf2c-4cd2-4380-b464-4b546c08bc21 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:16:19 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac80cf2c-4cd2-4380-b464-4b546c08bc21 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:16:19 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4342600-0cfd-41b7-9073-cf41ca5798f8]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:16:19 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd8ed4e-6524-433f-b566-9bd84969c908 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:16:19 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac80cf2c-4cd2-4380-b464-4b546c08bc21 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wCRpqogO {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:16:19 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac80cf2c-4cd2-4380-b464-4b546c08bc21 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wCRpqogO" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:16:19 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f752aef-4cde-436c-9422-095e3d59f955]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:16:19 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd8ed4e-6524-433f-b566-9bd84969c908 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wCRpqogO'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:16:19 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac80cf2c-4cd2-4380-b464-4b546c08bc21 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:16:19 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac80cf2c-4cd2-4380-b464-4b546c08bc21 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:16:19 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e95d2ff-514f-4778-921a-5ba488d23635]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:16:19 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd8ed4e-6524-433f-b566-9bd84969c908 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:16:19 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:16:19 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:16:19 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e302735-0b10-4b95-a923-bcd3c2b56fa6]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18 (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:16:19 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd8ed4e-6524-433f-b566-9bd84969c908 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18 (non-flash)
Oct 18 12:16:19 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 12:16:19 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd8ed4e-6524-433f-b566-9bd84969c908 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18 (non-flash)
Oct 18 12:16:19 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 12:16:19 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac80cf2c-4cd2-4380-b464-4b546c08bc21 -p 172.16.0.220:3260 --login {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:16:19 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac80cf2c-4cd2-4380-b464-4b546c08bc21 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:16:19 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf6b99e5-32d7-419c-9f54-67337c1f0059]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ac80cf2c-4cd2-4380-b464-4b546c08bc21, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ac80cf2c-4cd2-4380-b464-4b546c08bc21, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:16:19 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd8ed4e-6524-433f-b566-9bd84969c908 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ac80cf2c-4cd2-4380-b464-4b546c08bc21, portal: 172.16.0.220,3260]
Oct 18 12:16:19 user nova-compute[74190]: Login to [iface: default, target: iqn.2010-10.org.openstack:ac80cf2c-4cd2-4380-b464-4b546c08bc21, portal: 172.16.0.220,3260] successful.
Oct 18 12:16:19 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:16:19 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac80cf2c-4cd2-4380-b464-4b546c08bc21 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:16:19 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac80cf2c-4cd2-4380-b464-4b546c08bc21 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:16:19 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[d496ac75-74e3-42f3-90f1-bffdcbb366ba]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:16:19 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd8ed4e-6524-433f-b566-9bd84969c908 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:16:19 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:16:19 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:16:19 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5767ace-1758-4341-9193-8d56111abafc]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac80cf2c-4cd2-4380-b464-4b546c08bc21 (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:16:19 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd8ed4e-6524-433f-b566-9bd84969c908 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18 (non-flash)
Oct 18 12:16:19 user nova-compute[74190]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac80cf2c-4cd2-4380-b464-4b546c08bc21 (non-flash)
Oct 18 12:16:19 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 12:16:19 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd8ed4e-6524-433f-b566-9bd84969c908 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18 (non-flash)
Oct 18 12:16:19 user nova-compute[74190]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac80cf2c-4cd2-4380-b464-4b546c08bc21 (non-flash)
Oct 18 12:16:19 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 12:16:19 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-2bd8ed4e-6524-433f-b566-9bd84969c908 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac80cf2c-4cd2-4380-b464-4b546c08bc21" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 12:16:19 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd8ed4e-6524-433f-b566-9bd84969c908 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Connected to 172.16.0.220:3260 {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 12:16:19 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-2bd8ed4e-6524-433f-b566-9bd84969c908 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] HCTL ('34', '-', '-', 0) found on session 53 with lun 0 {{(pid=74190) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 12:16:19 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-2bd8ed4e-6524-433f-b566-9bd84969c908 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74190) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 12:16:19 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:16:19 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:16:19 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[89d98fb4-5c3f-4d20-a412-fcf6e4575504]: (4, ('- - 0', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:16:19 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-2bd8ed4e-6524-433f-b566-9bd84969c908 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74190) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 12:16:19 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd8ed4e-6524-433f-b566-9bd84969c908 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ac80cf2c-4cd2-4380-b464-4b546c08bc21', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wCRpqogO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 12:16:20 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-2bd8ed4e-6524-433f-b566-9bd84969c908 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 12:16:20 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd8ed4e-6524-433f-b566-9bd84969c908 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '23033633830653233', 'path': '/dev/sdc'} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 12:16:20 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2bd8ed4e-6524-433f-b566-9bd84969c908 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: 0309a457-dae8-4a13-ac5c-53e2320930ff] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23033633830653233', 'path': '/dev/sdc'} {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 12:16:20 user nova-compute[74190]: DEBUG nova.objects.instance [None req-2bd8ed4e-6524-433f-b566-9bd84969c908 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Lazy-loading 'flavor' on Instance uuid 0309a457-dae8-4a13-ac5c-53e2320930ff {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:16:20 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-2bd8ed4e-6524-433f-b566-9bd84969c908 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] attach device xml: <disk type="block" device="disk">
Oct 18 12:16:20 user nova-compute[74190]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 12:16:20 user nova-compute[74190]:   <source dev="/dev/sdc"/>
Oct 18 12:16:20 user nova-compute[74190]:   <target dev="vdb" bus="virtio"/>
Oct 18 12:16:20 user nova-compute[74190]:   <serial>ac80cf2c-4cd2-4380-b464-4b546c08bc21</serial>
Oct 18 12:16:20 user nova-compute[74190]: </disk>
Oct 18 12:16:20 user nova-compute[74190]:  {{(pid=74190) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 18 12:16:20 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:16:20 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:16:20 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-2bd8ed4e-6524-433f-b566-9bd84969c908 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] No BDM found with device name vda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 12:16:20 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-2bd8ed4e-6524-433f-b566-9bd84969c908 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 12:16:20 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-2bd8ed4e-6524-433f-b566-9bd84969c908 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] No VIF found with MAC fa:16:3e:4e:a5:f5, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 12:16:20 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-2bd8ed4e-6524-433f-b566-9bd84969c908 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Lock "0309a457-dae8-4a13-ac5c-53e2320930ff" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:16:21 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:16:23 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:16:25 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:16:25 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Starting heal instance info cache {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 12:16:25 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Rebuilding the list of instances to heal {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 18 12:16:25 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "refresh_cache-772b126c-2148-4ca8-90f2-69d6eb4b7db7" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:16:25 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquired lock "refresh_cache-772b126c-2148-4ca8-90f2-69d6eb4b7db7" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:16:25 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 772b126c-2148-4ca8-90f2-69d6eb4b7db7] Forcefully refreshing network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 18 12:16:25 user nova-compute[74190]: DEBUG nova.objects.instance [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lazy-loading 'info_cache' on Instance uuid 772b126c-2148-4ca8-90f2-69d6eb4b7db7 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:16:25 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:16:25 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 772b126c-2148-4ca8-90f2-69d6eb4b7db7] Updating instance_info_cache with network_info: [{"id": "5470a91d-fa0f-4018-afa9-8e0a604cfca3", "address": "fa:16:3e:aa:5e:3e", "network": {"id": "c2dbbd24-f1d2-47a2-835f-0f9b24b585f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-920140900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d994366010142519ff367fa7ca77e61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5470a91d-fa", "ovs_interfaceid": "5470a91d-fa0f-4018-afa9-8e0a604cfca3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:16:25 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Releasing lock "refresh_cache-772b126c-2148-4ca8-90f2-69d6eb4b7db7" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:16:25 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 772b126c-2148-4ca8-90f2-69d6eb4b7db7] Updated the network info_cache for instance {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 18 12:16:25 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:16:26 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:16:26 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:16:26 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:16:26 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:16:26 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Auditing locally available compute resources for user (node: user) {{(pid=74190) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 12:16:26 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 12:16:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:16:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:16:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:16:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:16:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0309a457-dae8-4a13-ac5c-53e2320930ff/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:16:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0309a457-dae8-4a13-ac5c-53e2320930ff/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:16:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0309a457-dae8-4a13-ac5c-53e2320930ff/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:16:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0309a457-dae8-4a13-ac5c-53e2320930ff/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:16:26 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 12:16:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7983ceaf-8ed3-4321-a242-2e44218f4d0b/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:16:27 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7983ceaf-8ed3-4321-a242-2e44218f4d0b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:16:27 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7983ceaf-8ed3-4321-a242-2e44218f4d0b/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:16:27 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7983ceaf-8ed3-4321-a242-2e44218f4d0b/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:16:27 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:16:27 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:16:27 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Hypervisor/Node resource view: name=user free_ram=8383MB free_disk=25.082889556884766GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74190) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 12:16:27 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:16:27 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:16:27 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 772b126c-2148-4ca8-90f2-69d6eb4b7db7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:16:27 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 7983ceaf-8ed3-4321-a242-2e44218f4d0b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:16:27 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 0309a457-dae8-4a13-ac5c-53e2320930ff actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:16:27 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 15172ec7-bdaa-478f-93ac-d4dbba6a3a0d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:16:27 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 12:16:27 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 12:16:28 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 12:16:28 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 12:16:28 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Compute_service record updated for user:user {{(pid=74190) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 12:16:28 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.341s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:16:29 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:16:29 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:16:29 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:16:29 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74190) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 12:16:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:16:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:16:35 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:16:35 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:16:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-d36a0ae5-0e2b-461f-bdca-6d5c4425596a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Acquiring lock "772b126c-2148-4ca8-90f2-69d6eb4b7db7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:16:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-d36a0ae5-0e2b-461f-bdca-6d5c4425596a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lock "772b126c-2148-4ca8-90f2-69d6eb4b7db7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:16:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-d36a0ae5-0e2b-461f-bdca-6d5c4425596a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Acquiring lock "772b126c-2148-4ca8-90f2-69d6eb4b7db7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:16:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-d36a0ae5-0e2b-461f-bdca-6d5c4425596a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lock "772b126c-2148-4ca8-90f2-69d6eb4b7db7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:16:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-d36a0ae5-0e2b-461f-bdca-6d5c4425596a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lock "772b126c-2148-4ca8-90f2-69d6eb4b7db7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:16:36 user nova-compute[74190]: INFO nova.compute.manager [None req-d36a0ae5-0e2b-461f-bdca-6d5c4425596a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 772b126c-2148-4ca8-90f2-69d6eb4b7db7] Terminating instance
Oct 18 12:16:36 user nova-compute[74190]: DEBUG nova.compute.manager [None req-d36a0ae5-0e2b-461f-bdca-6d5c4425596a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 772b126c-2148-4ca8-90f2-69d6eb4b7db7] Start destroying the instance on the hypervisor. {{(pid=74190) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 12:16:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:16:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:16:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:16:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:16:37 user nova-compute[74190]: DEBUG nova.compute.manager [req-10d816bc-8e01-460c-97cd-11ab20c5c584 req-e1c23a82-f70a-419e-ae33-416b89cc3226 service nova] [instance: 772b126c-2148-4ca8-90f2-69d6eb4b7db7] Received event network-vif-unplugged-5470a91d-fa0f-4018-afa9-8e0a604cfca3 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:16:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-10d816bc-8e01-460c-97cd-11ab20c5c584 req-e1c23a82-f70a-419e-ae33-416b89cc3226 service nova] Acquiring lock "772b126c-2148-4ca8-90f2-69d6eb4b7db7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:16:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-10d816bc-8e01-460c-97cd-11ab20c5c584 req-e1c23a82-f70a-419e-ae33-416b89cc3226 service nova] Lock "772b126c-2148-4ca8-90f2-69d6eb4b7db7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:16:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-10d816bc-8e01-460c-97cd-11ab20c5c584 req-e1c23a82-f70a-419e-ae33-416b89cc3226 service nova] Lock "772b126c-2148-4ca8-90f2-69d6eb4b7db7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:16:37 user nova-compute[74190]: DEBUG nova.compute.manager [req-10d816bc-8e01-460c-97cd-11ab20c5c584 req-e1c23a82-f70a-419e-ae33-416b89cc3226 service nova] [instance: 772b126c-2148-4ca8-90f2-69d6eb4b7db7] No waiting events found dispatching network-vif-unplugged-5470a91d-fa0f-4018-afa9-8e0a604cfca3 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:16:37 user nova-compute[74190]: DEBUG nova.compute.manager [req-10d816bc-8e01-460c-97cd-11ab20c5c584 req-e1c23a82-f70a-419e-ae33-416b89cc3226 service nova] [instance: 772b126c-2148-4ca8-90f2-69d6eb4b7db7] Received event network-vif-unplugged-5470a91d-fa0f-4018-afa9-8e0a604cfca3 for instance with task_state deleting. {{(pid=74190) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 12:16:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:16:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:16:37 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 772b126c-2148-4ca8-90f2-69d6eb4b7db7] Instance destroyed successfully.
Oct 18 12:16:37 user nova-compute[74190]: DEBUG nova.objects.instance [None req-d36a0ae5-0e2b-461f-bdca-6d5c4425596a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lazy-loading 'resources' on Instance uuid 772b126c-2148-4ca8-90f2-69d6eb4b7db7 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:16:37 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-d36a0ae5-0e2b-461f-bdca-6d5c4425596a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T11:56:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-836086720',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-836086720',id=29,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-18T11:56:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6d994366010142519ff367fa7ca77e61',ramdisk_id='',reservation_id='r-zepk67v0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1815510380',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T11:58:07Z,user_data=None,user_id='7fa675b6803f4e21b090295b51fb9ceb',uuid=772b126c-2148-4ca8-90f2-69d6eb4b7db7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5470a91d-fa0f-4018-afa9-8e0a604cfca3", "address": "fa:16:3e:aa:5e:3e", "network": {"id": "c2dbbd24-f1d2-47a2-835f-0f9b24b585f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-920140900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d994366010142519ff367fa7ca77e61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5470a91d-fa", "ovs_interfaceid": "5470a91d-fa0f-4018-afa9-8e0a604cfca3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 12:16:37 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-d36a0ae5-0e2b-461f-bdca-6d5c4425596a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Converting VIF {"id": "5470a91d-fa0f-4018-afa9-8e0a604cfca3", "address": "fa:16:3e:aa:5e:3e", "network": {"id": "c2dbbd24-f1d2-47a2-835f-0f9b24b585f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-920140900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d994366010142519ff367fa7ca77e61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5470a91d-fa", "ovs_interfaceid": "5470a91d-fa0f-4018-afa9-8e0a604cfca3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 12:16:37 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-d36a0ae5-0e2b-461f-bdca-6d5c4425596a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:aa:5e:3e,bridge_name='br-int',has_traffic_filtering=True,id=5470a91d-fa0f-4018-afa9-8e0a604cfca3,network=Network(c2dbbd24-f1d2-47a2-835f-0f9b24b585f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5470a91d-fa') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 12:16:37 user nova-compute[74190]: DEBUG os_vif [None req-d36a0ae5-0e2b-461f-bdca-6d5c4425596a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:5e:3e,bridge_name='br-int',has_traffic_filtering=True,id=5470a91d-fa0f-4018-afa9-8e0a604cfca3,network=Network(c2dbbd24-f1d2-47a2-835f-0f9b24b585f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5470a91d-fa') {{(pid=74190) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 12:16:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:16:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5470a91d-fa, bridge=br-int, if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:16:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:16:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:16:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:16:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=76023a74-879f-488c-9b81-e0cdd877a707) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:16:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:16:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:16:37 user nova-compute[74190]: INFO os_vif [None req-d36a0ae5-0e2b-461f-bdca-6d5c4425596a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:5e:3e,bridge_name='br-int',has_traffic_filtering=True,id=5470a91d-fa0f-4018-afa9-8e0a604cfca3,network=Network(c2dbbd24-f1d2-47a2-835f-0f9b24b585f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5470a91d-fa')
Oct 18 12:16:37 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-d36a0ae5-0e2b-461f-bdca-6d5c4425596a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 772b126c-2148-4ca8-90f2-69d6eb4b7db7] Deleting instance files /opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7_del
Oct 18 12:16:37 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-d36a0ae5-0e2b-461f-bdca-6d5c4425596a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 772b126c-2148-4ca8-90f2-69d6eb4b7db7] Deletion of /opt/stack/data/nova/instances/772b126c-2148-4ca8-90f2-69d6eb4b7db7_del complete
Oct 18 12:16:37 user nova-compute[74190]: INFO nova.compute.manager [None req-d36a0ae5-0e2b-461f-bdca-6d5c4425596a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] [instance: 772b126c-2148-4ca8-90f2-69d6eb4b7db7] Took 0.68 seconds to destroy the instance on the hypervisor.
Oct 18 12:16:37 user nova-compute[74190]: DEBUG oslo.service.loopingcall [None req-d36a0ae5-0e2b-461f-bdca-6d5c4425596a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74190) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 12:16:37 user nova-compute[74190]: DEBUG nova.compute.manager [-] [instance: 772b126c-2148-4ca8-90f2-69d6eb4b7db7] Deallocating network for instance {{(pid=74190) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 12:16:37 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: 772b126c-2148-4ca8-90f2-69d6eb4b7db7] deallocate_for_instance() {{(pid=74190) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 12:16:37 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: 772b126c-2148-4ca8-90f2-69d6eb4b7db7] Updating instance_info_cache with network_info: [] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:16:38 user nova-compute[74190]: INFO nova.compute.manager [-] [instance: 772b126c-2148-4ca8-90f2-69d6eb4b7db7] Took 0.47 seconds to deallocate network for instance.
Oct 18 12:16:38 user nova-compute[74190]: DEBUG nova.compute.manager [req-c6f294fb-e740-47b5-8e3c-ab2aa8fac36a req-da5f73e8-3c60-4631-8bfa-383f3486b269 service nova] [instance: 772b126c-2148-4ca8-90f2-69d6eb4b7db7] Received event network-vif-deleted-5470a91d-fa0f-4018-afa9-8e0a604cfca3 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:16:38 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-d36a0ae5-0e2b-461f-bdca-6d5c4425596a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:16:38 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-d36a0ae5-0e2b-461f-bdca-6d5c4425596a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:16:38 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-d36a0ae5-0e2b-461f-bdca-6d5c4425596a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 12:16:38 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-d36a0ae5-0e2b-461f-bdca-6d5c4425596a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 12:16:38 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-d36a0ae5-0e2b-461f-bdca-6d5c4425596a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.219s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:16:38 user nova-compute[74190]: INFO nova.scheduler.client.report [None req-d36a0ae5-0e2b-461f-bdca-6d5c4425596a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Deleted allocations for instance 772b126c-2148-4ca8-90f2-69d6eb4b7db7
Oct 18 12:16:38 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-d36a0ae5-0e2b-461f-bdca-6d5c4425596a tempest-ServerBootFromVolumeStableRescueTest-1815510380 tempest-ServerBootFromVolumeStableRescueTest-1815510380-project-member] Lock "772b126c-2148-4ca8-90f2-69d6eb4b7db7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.556s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:16:39 user nova-compute[74190]: DEBUG nova.compute.manager [req-69a2f9bf-4585-4031-9dc8-030b53af0992 req-b5d331da-a47c-4202-91e4-0c8a213dd527 service nova] [instance: 772b126c-2148-4ca8-90f2-69d6eb4b7db7] Received event network-vif-plugged-5470a91d-fa0f-4018-afa9-8e0a604cfca3 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:16:39 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-69a2f9bf-4585-4031-9dc8-030b53af0992 req-b5d331da-a47c-4202-91e4-0c8a213dd527 service nova] Acquiring lock "772b126c-2148-4ca8-90f2-69d6eb4b7db7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:16:39 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-69a2f9bf-4585-4031-9dc8-030b53af0992 req-b5d331da-a47c-4202-91e4-0c8a213dd527 service nova] Lock "772b126c-2148-4ca8-90f2-69d6eb4b7db7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:16:39 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-69a2f9bf-4585-4031-9dc8-030b53af0992 req-b5d331da-a47c-4202-91e4-0c8a213dd527 service nova] Lock "772b126c-2148-4ca8-90f2-69d6eb4b7db7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:16:39 user nova-compute[74190]: DEBUG nova.compute.manager [req-69a2f9bf-4585-4031-9dc8-030b53af0992 req-b5d331da-a47c-4202-91e4-0c8a213dd527 service nova] [instance: 772b126c-2148-4ca8-90f2-69d6eb4b7db7] No waiting events found dispatching network-vif-plugged-5470a91d-fa0f-4018-afa9-8e0a604cfca3 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:16:39 user nova-compute[74190]: WARNING nova.compute.manager [req-69a2f9bf-4585-4031-9dc8-030b53af0992 req-b5d331da-a47c-4202-91e4-0c8a213dd527 service nova] [instance: 772b126c-2148-4ca8-90f2-69d6eb4b7db7] Received unexpected event network-vif-plugged-5470a91d-fa0f-4018-afa9-8e0a604cfca3 for instance with vm_state deleted and task_state None.
Oct 18 12:16:42 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:16:44 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:16:44 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:16:44 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:16:44 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:16:44 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:16:44 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:16:44 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:16:44 user nova-compute[74190]: DEBUG nova.virt.libvirt.imagecache [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Verify base images {{(pid=74190) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Oct 18 12:16:44 user nova-compute[74190]: DEBUG nova.virt.libvirt.imagecache [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=74190) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Oct 18 12:16:44 user nova-compute[74190]: DEBUG nova.virt.libvirt.imagecache [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Image id 6e88bbf0-6e78-49a8-b3c5-9453d22a89df yields fingerprint b36d8c17bcdbd6d774c823d09c55aff727a41c5f {{(pid=74190) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Oct 18 12:16:44 user nova-compute[74190]: INFO nova.virt.libvirt.imagecache [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] image 6e88bbf0-6e78-49a8-b3c5-9453d22a89df at (/opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f): checking
Oct 18 12:16:44 user nova-compute[74190]: DEBUG nova.virt.libvirt.imagecache [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] image 6e88bbf0-6e78-49a8-b3c5-9453d22a89df at (/opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f): image is in use {{(pid=74190) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Oct 18 12:16:44 user nova-compute[74190]: DEBUG nova.virt.libvirt.imagecache [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] 15172ec7-bdaa-478f-93ac-d4dbba6a3a0d is a valid instance name {{(pid=74190) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 18 12:16:44 user nova-compute[74190]: DEBUG nova.virt.libvirt.imagecache [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] 0309a457-dae8-4a13-ac5c-53e2320930ff is a valid instance name {{(pid=74190) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 18 12:16:44 user nova-compute[74190]: DEBUG nova.virt.libvirt.imagecache [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] 0309a457-dae8-4a13-ac5c-53e2320930ff has a disk file {{(pid=74190) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Oct 18 12:16:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0309a457-dae8-4a13-ac5c-53e2320930ff/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:16:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0309a457-dae8-4a13-ac5c-53e2320930ff/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:16:44 user nova-compute[74190]: DEBUG nova.virt.libvirt.imagecache [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 0309a457-dae8-4a13-ac5c-53e2320930ff is backed by b36d8c17bcdbd6d774c823d09c55aff727a41c5f {{(pid=74190) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Oct 18 12:16:44 user nova-compute[74190]: DEBUG nova.virt.libvirt.imagecache [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] 7983ceaf-8ed3-4321-a242-2e44218f4d0b is a valid instance name {{(pid=74190) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 18 12:16:44 user nova-compute[74190]: DEBUG nova.virt.libvirt.imagecache [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] 7983ceaf-8ed3-4321-a242-2e44218f4d0b has a disk file {{(pid=74190) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Oct 18 12:16:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7983ceaf-8ed3-4321-a242-2e44218f4d0b/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:16:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7983ceaf-8ed3-4321-a242-2e44218f4d0b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:16:44 user nova-compute[74190]: DEBUG nova.virt.libvirt.imagecache [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 7983ceaf-8ed3-4321-a242-2e44218f4d0b is backed by b36d8c17bcdbd6d774c823d09c55aff727a41c5f {{(pid=74190) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Oct 18 12:16:44 user nova-compute[74190]: WARNING nova.virt.libvirt.imagecache [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Unknown base file: /opt/stack/data/nova/instances/_base/0e79c1037d0d32946cb46779e632ecf3472e53b3
Oct 18 12:16:44 user nova-compute[74190]: WARNING nova.virt.libvirt.imagecache [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Unknown base file: /opt/stack/data/nova/instances/_base/938199af668ae7cf2361688e6fe7cbbbeb8ee8ad
Oct 18 12:16:44 user nova-compute[74190]: WARNING nova.virt.libvirt.imagecache [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Unknown base file: /opt/stack/data/nova/instances/_base/859c6b5109633be0afdd51cf534f3d71508ce763
Oct 18 12:16:44 user nova-compute[74190]: WARNING nova.virt.libvirt.imagecache [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Unknown base file: /opt/stack/data/nova/instances/_base/82d720dd03e4ba5cc15ec2f05bb837cc27aa8ee4
Oct 18 12:16:44 user nova-compute[74190]: WARNING nova.virt.libvirt.imagecache [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Unknown base file: /opt/stack/data/nova/instances/_base/bd096a95ad7e331db33287cc1ee231bf06e94a62
Oct 18 12:16:44 user nova-compute[74190]: WARNING nova.virt.libvirt.imagecache [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Unknown base file: /opt/stack/data/nova/instances/_base/2dfb4bff716bd0492befc710d472376b168a613c
Oct 18 12:16:44 user nova-compute[74190]: WARNING nova.virt.libvirt.imagecache [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Unknown base file: /opt/stack/data/nova/instances/_base/fe028cd67e08f279d123d1d01d37054950fb230a
Oct 18 12:16:44 user nova-compute[74190]: INFO nova.virt.libvirt.imagecache [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Active base files: /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f
Oct 18 12:16:44 user nova-compute[74190]: INFO nova.virt.libvirt.imagecache [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Removable base files: /opt/stack/data/nova/instances/_base/0e79c1037d0d32946cb46779e632ecf3472e53b3 /opt/stack/data/nova/instances/_base/938199af668ae7cf2361688e6fe7cbbbeb8ee8ad /opt/stack/data/nova/instances/_base/859c6b5109633be0afdd51cf534f3d71508ce763 /opt/stack/data/nova/instances/_base/82d720dd03e4ba5cc15ec2f05bb837cc27aa8ee4 /opt/stack/data/nova/instances/_base/bd096a95ad7e331db33287cc1ee231bf06e94a62 /opt/stack/data/nova/instances/_base/2dfb4bff716bd0492befc710d472376b168a613c /opt/stack/data/nova/instances/_base/fe028cd67e08f279d123d1d01d37054950fb230a
Oct 18 12:16:44 user nova-compute[74190]: INFO nova.virt.libvirt.imagecache [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/0e79c1037d0d32946cb46779e632ecf3472e53b3
Oct 18 12:16:44 user nova-compute[74190]: INFO nova.virt.libvirt.imagecache [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/938199af668ae7cf2361688e6fe7cbbbeb8ee8ad
Oct 18 12:16:44 user nova-compute[74190]: INFO nova.virt.libvirt.imagecache [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/859c6b5109633be0afdd51cf534f3d71508ce763
Oct 18 12:16:44 user nova-compute[74190]: INFO nova.virt.libvirt.imagecache [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/82d720dd03e4ba5cc15ec2f05bb837cc27aa8ee4
Oct 18 12:16:44 user nova-compute[74190]: INFO nova.virt.libvirt.imagecache [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/bd096a95ad7e331db33287cc1ee231bf06e94a62
Oct 18 12:16:44 user nova-compute[74190]: INFO nova.virt.libvirt.imagecache [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/2dfb4bff716bd0492befc710d472376b168a613c
Oct 18 12:16:44 user nova-compute[74190]: INFO nova.virt.libvirt.imagecache [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/fe028cd67e08f279d123d1d01d37054950fb230a
Oct 18 12:16:44 user nova-compute[74190]: DEBUG nova.virt.libvirt.imagecache [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Verification complete {{(pid=74190) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Oct 18 12:16:44 user nova-compute[74190]: DEBUG nova.virt.libvirt.imagecache [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Verify swap images {{(pid=74190) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Oct 18 12:16:44 user nova-compute[74190]: DEBUG nova.virt.libvirt.imagecache [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Verify ephemeral images {{(pid=74190) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Oct 18 12:16:47 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:16:52 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:16:57 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:16:57 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:16:57 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74190) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 12:16:57 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:16:57 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:16:57 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:17:02 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:17:07 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:17:12 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:17:17 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:17:17 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:17:17 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74190) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 12:17:17 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:17:17 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:17:17 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:17:17 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:17:18 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-aec2fca2-e9d2-48bb-b77f-ca74fa89b671 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Acquiring lock "0309a457-dae8-4a13-ac5c-53e2320930ff" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:17:18 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-aec2fca2-e9d2-48bb-b77f-ca74fa89b671 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Lock "0309a457-dae8-4a13-ac5c-53e2320930ff" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:17:18 user nova-compute[74190]: INFO nova.compute.manager [None req-aec2fca2-e9d2-48bb-b77f-ca74fa89b671 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: 0309a457-dae8-4a13-ac5c-53e2320930ff] Detaching volume ac80cf2c-4cd2-4380-b464-4b546c08bc21
Oct 18 12:17:18 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-3cf71f45-8931-4d95-a095-b113d21a6cbb tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Acquiring lock "0309a457-dae8-4a13-ac5c-53e2320930ff" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:17:18 user nova-compute[74190]: INFO nova.virt.block_device [None req-aec2fca2-e9d2-48bb-b77f-ca74fa89b671 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: 0309a457-dae8-4a13-ac5c-53e2320930ff] Attempting to driver detach volume ac80cf2c-4cd2-4380-b464-4b546c08bc21 from mountpoint /dev/vdb
Oct 18 12:17:18 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-aec2fca2-e9d2-48bb-b77f-ca74fa89b671 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Attempting to detach device vdb from instance 0309a457-dae8-4a13-ac5c-53e2320930ff from the persistent domain config. {{(pid=74190) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 18 12:17:18 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-aec2fca2-e9d2-48bb-b77f-ca74fa89b671 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 12:17:18 user nova-compute[74190]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 12:17:18 user nova-compute[74190]:   <source dev="/dev/sdc"/>
Oct 18 12:17:18 user nova-compute[74190]:   <target dev="vdb" bus="virtio"/>
Oct 18 12:17:18 user nova-compute[74190]:   <serial>ac80cf2c-4cd2-4380-b464-4b546c08bc21</serial>
Oct 18 12:17:18 user nova-compute[74190]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 18 12:17:18 user nova-compute[74190]: </disk>
Oct 18 12:17:18 user nova-compute[74190]:  {{(pid=74190) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 12:17:18 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-aec2fca2-e9d2-48bb-b77f-ca74fa89b671 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Successfully detached device vdb from instance 0309a457-dae8-4a13-ac5c-53e2320930ff from the persistent domain config.
Oct 18 12:17:18 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-aec2fca2-e9d2-48bb-b77f-ca74fa89b671 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0309a457-dae8-4a13-ac5c-53e2320930ff from the live domain config. {{(pid=74190) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 18 12:17:18 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-aec2fca2-e9d2-48bb-b77f-ca74fa89b671 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 12:17:18 user nova-compute[74190]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 12:17:18 user nova-compute[74190]:   <source dev="/dev/sdc"/>
Oct 18 12:17:18 user nova-compute[74190]:   <target dev="vdb" bus="virtio"/>
Oct 18 12:17:18 user nova-compute[74190]:   <serial>ac80cf2c-4cd2-4380-b464-4b546c08bc21</serial>
Oct 18 12:17:18 user nova-compute[74190]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 18 12:17:18 user nova-compute[74190]: </disk>
Oct 18 12:17:18 user nova-compute[74190]:  {{(pid=74190) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 12:17:18 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-aec2fca2-e9d2-48bb-b77f-ca74fa89b671 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0309a457-dae8-4a13-ac5c-53e2320930ff {{(pid=74190) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 18 12:17:19 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:17:22 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:17:22 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:17:22 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74190) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 12:17:22 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:17:22 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:17:22 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:17:23 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:17:23 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:17:23 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:17:23 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Cleaning up deleted instances {{(pid=74190) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 18 12:17:23 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] There are 0 instances to clean {{(pid=74190) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 18 12:17:25 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:17:25 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Starting heal instance info cache {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 12:17:25 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "refresh_cache-7983ceaf-8ed3-4321-a242-2e44218f4d0b" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:17:25 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquired lock "refresh_cache-7983ceaf-8ed3-4321-a242-2e44218f4d0b" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:17:25 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 7983ceaf-8ed3-4321-a242-2e44218f4d0b] Forcefully refreshing network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 18 12:17:25 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 7983ceaf-8ed3-4321-a242-2e44218f4d0b] Updating instance_info_cache with network_info: [{"id": "28ca935e-3c1c-47dc-8b10-d7a5cb602470", "address": "fa:16:3e:b8:5e:82", "network": {"id": "31e59f3e-dc25-4b00-9d87-4b4f695425b8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-220402675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f84b62d410cc448486b792e094464815", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28ca935e-3c", "ovs_interfaceid": "28ca935e-3c1c-47dc-8b10-d7a5cb602470", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:17:25 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Releasing lock "refresh_cache-7983ceaf-8ed3-4321-a242-2e44218f4d0b" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:17:25 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 7983ceaf-8ed3-4321-a242-2e44218f4d0b] Updated the network info_cache for instance {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 18 12:17:27 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:17:27 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:17:27 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:17:27 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:17:27 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:17:27 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Auditing locally available compute resources for user (node: user) {{(pid=74190) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 12:17:27 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0309a457-dae8-4a13-ac5c-53e2320930ff/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:17:27 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0309a457-dae8-4a13-ac5c-53e2320930ff/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:17:27 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0309a457-dae8-4a13-ac5c-53e2320930ff/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:17:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:17:27 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0309a457-dae8-4a13-ac5c-53e2320930ff/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:17:27 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7983ceaf-8ed3-4321-a242-2e44218f4d0b/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:17:27 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7983ceaf-8ed3-4321-a242-2e44218f4d0b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:17:27 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7983ceaf-8ed3-4321-a242-2e44218f4d0b/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:17:27 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7983ceaf-8ed3-4321-a242-2e44218f4d0b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:17:27 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 12:17:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:17:28 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:17:28 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:17:28 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Hypervisor/Node resource view: name=user free_ram=8552MB free_disk=25.206161499023438GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74190) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 12:17:28 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:17:28 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:17:28 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 7983ceaf-8ed3-4321-a242-2e44218f4d0b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:17:28 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 0309a457-dae8-4a13-ac5c-53e2320930ff actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:17:28 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 15172ec7-bdaa-478f-93ac-d4dbba6a3a0d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:17:28 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 12:17:28 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 12:17:28 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 12:17:28 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 12:17:28 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Compute_service record updated for user:user {{(pid=74190) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 12:17:28 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.439s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:17:29 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:17:29 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:17:29 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74190) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 12:17:30 user nova-compute[74190]: DEBUG nova.compute.manager [req-6eca6ef2-a517-4ed4-8fde-0c4c37cec305 req-a1353fbf-ee1d-46fe-9516-9e8683164b69 service nova] [instance: 15172ec7-bdaa-478f-93ac-d4dbba6a3a0d] Received event network-changed-3ce5d2e1-0587-486f-9184-5026ff7a941a {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:17:30 user nova-compute[74190]: DEBUG nova.compute.manager [req-6eca6ef2-a517-4ed4-8fde-0c4c37cec305 req-a1353fbf-ee1d-46fe-9516-9e8683164b69 service nova] [instance: 15172ec7-bdaa-478f-93ac-d4dbba6a3a0d] Refreshing instance network info cache due to event network-changed-3ce5d2e1-0587-486f-9184-5026ff7a941a. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 12:17:30 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-6eca6ef2-a517-4ed4-8fde-0c4c37cec305 req-a1353fbf-ee1d-46fe-9516-9e8683164b69 service nova] Acquiring lock "refresh_cache-15172ec7-bdaa-478f-93ac-d4dbba6a3a0d" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:17:30 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-6eca6ef2-a517-4ed4-8fde-0c4c37cec305 req-a1353fbf-ee1d-46fe-9516-9e8683164b69 service nova] Acquired lock "refresh_cache-15172ec7-bdaa-478f-93ac-d4dbba6a3a0d" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:17:30 user nova-compute[74190]: DEBUG nova.network.neutron [req-6eca6ef2-a517-4ed4-8fde-0c4c37cec305 req-a1353fbf-ee1d-46fe-9516-9e8683164b69 service nova] [instance: 15172ec7-bdaa-478f-93ac-d4dbba6a3a0d] Refreshing network info cache for port 3ce5d2e1-0587-486f-9184-5026ff7a941a {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 12:17:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:17:30 user nova-compute[74190]: DEBUG nova.network.neutron [req-6eca6ef2-a517-4ed4-8fde-0c4c37cec305 req-a1353fbf-ee1d-46fe-9516-9e8683164b69 service nova] [instance: 15172ec7-bdaa-478f-93ac-d4dbba6a3a0d] Updated VIF entry in instance network info cache for port 3ce5d2e1-0587-486f-9184-5026ff7a941a. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 12:17:30 user nova-compute[74190]: DEBUG nova.network.neutron [req-6eca6ef2-a517-4ed4-8fde-0c4c37cec305 req-a1353fbf-ee1d-46fe-9516-9e8683164b69 service nova] [instance: 15172ec7-bdaa-478f-93ac-d4dbba6a3a0d] Updating instance_info_cache with network_info: [{"id": "3ce5d2e1-0587-486f-9184-5026ff7a941a", "address": "fa:16:3e:d3:87:c8", "network": {"id": "aa827f81-b165-444f-89cc-f21c42a9f772", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1659902586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e375153f6f24827811c5825fc2a2c6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce5d2e1-05", "ovs_interfaceid": "3ce5d2e1-0587-486f-9184-5026ff7a941a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:17:30 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-6eca6ef2-a517-4ed4-8fde-0c4c37cec305 req-a1353fbf-ee1d-46fe-9516-9e8683164b69 service nova] Releasing lock "refresh_cache-15172ec7-bdaa-478f-93ac-d4dbba6a3a0d" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:17:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:17:31 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:17:31 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-766ac429-1d3e-4a1a-9293-c15afd289a17 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Acquiring lock "15172ec7-bdaa-478f-93ac-d4dbba6a3a0d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:17:31 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-766ac429-1d3e-4a1a-9293-c15afd289a17 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "15172ec7-bdaa-478f-93ac-d4dbba6a3a0d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:17:31 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-766ac429-1d3e-4a1a-9293-c15afd289a17 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Acquiring lock "15172ec7-bdaa-478f-93ac-d4dbba6a3a0d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:17:31 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-766ac429-1d3e-4a1a-9293-c15afd289a17 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "15172ec7-bdaa-478f-93ac-d4dbba6a3a0d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:17:31 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-766ac429-1d3e-4a1a-9293-c15afd289a17 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "15172ec7-bdaa-478f-93ac-d4dbba6a3a0d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:17:31 user nova-compute[74190]: INFO nova.compute.manager [None req-766ac429-1d3e-4a1a-9293-c15afd289a17 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 15172ec7-bdaa-478f-93ac-d4dbba6a3a0d] Terminating instance
Oct 18 12:17:31 user nova-compute[74190]: DEBUG nova.compute.manager [None req-766ac429-1d3e-4a1a-9293-c15afd289a17 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 15172ec7-bdaa-478f-93ac-d4dbba6a3a0d] Start destroying the instance on the hypervisor. {{(pid=74190) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 12:17:31 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:17:31 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:17:31 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:17:31 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:17:32 user nova-compute[74190]: DEBUG nova.compute.manager [req-f39dcc92-79c0-42fc-a699-530168b912fd req-d5d65531-9c6c-4c36-bd2a-f70b89935a23 service nova] [instance: 15172ec7-bdaa-478f-93ac-d4dbba6a3a0d] Received event network-vif-unplugged-3ce5d2e1-0587-486f-9184-5026ff7a941a {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:17:32 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-f39dcc92-79c0-42fc-a699-530168b912fd req-d5d65531-9c6c-4c36-bd2a-f70b89935a23 service nova] Acquiring lock "15172ec7-bdaa-478f-93ac-d4dbba6a3a0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:17:32 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-f39dcc92-79c0-42fc-a699-530168b912fd req-d5d65531-9c6c-4c36-bd2a-f70b89935a23 service nova] Lock "15172ec7-bdaa-478f-93ac-d4dbba6a3a0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:17:32 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-f39dcc92-79c0-42fc-a699-530168b912fd req-d5d65531-9c6c-4c36-bd2a-f70b89935a23 service nova] Lock "15172ec7-bdaa-478f-93ac-d4dbba6a3a0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:17:32 user nova-compute[74190]: DEBUG nova.compute.manager [req-f39dcc92-79c0-42fc-a699-530168b912fd req-d5d65531-9c6c-4c36-bd2a-f70b89935a23 service nova] [instance: 15172ec7-bdaa-478f-93ac-d4dbba6a3a0d] No waiting events found dispatching network-vif-unplugged-3ce5d2e1-0587-486f-9184-5026ff7a941a {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:17:32 user nova-compute[74190]: DEBUG nova.compute.manager [req-f39dcc92-79c0-42fc-a699-530168b912fd req-d5d65531-9c6c-4c36-bd2a-f70b89935a23 service nova] [instance: 15172ec7-bdaa-478f-93ac-d4dbba6a3a0d] Received event network-vif-unplugged-3ce5d2e1-0587-486f-9184-5026ff7a941a for instance with task_state deleting. {{(pid=74190) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 12:17:32 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:17:32 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 15172ec7-bdaa-478f-93ac-d4dbba6a3a0d] Instance destroyed successfully.
Oct 18 12:17:32 user nova-compute[74190]: DEBUG nova.objects.instance [None req-766ac429-1d3e-4a1a-9293-c15afd289a17 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lazy-loading 'resources' on Instance uuid 15172ec7-bdaa-478f-93ac-d4dbba6a3a0d {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:17:32 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-766ac429-1d3e-4a1a-9293-c15afd289a17 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T12:15:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1763989655',display_name='tempest-TestVolumeBootPattern-server-1763989655',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1763989655',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFImDkcHIZVVsD1gB2Yh4JGNE0pEbAN8TUjpItUrbhxdmYRzrbNlPip8qPxIcvk8OJEen8xQaAGxdqzAZ1w6kqPbscsnuFtwOBrKfpec5lSOkFKoHZaLFZ1ci5kqBfXOJw==',key_name='tempest-TestVolumeBootPattern-131084726',keypairs=<?>,launch_index=0,launched_at=2023-10-18T12:16:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1e375153f6f24827811c5825fc2a2c6a',ramdisk_id='',reservation_id='r-82spc8nz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1157442382',owner_user_name='tempest-TestVolumeBootPattern-1157442382-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T12:16:01Z,user_data=None,user_id='27d9fc244d0f4e10a43b7df4dc8e30ad',uuid=15172ec7-bdaa-478f-93ac-d4dbba6a3a0d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3ce5d2e1-0587-486f-9184-5026ff7a941a", "address": "fa:16:3e:d3:87:c8", "network": {"id": "aa827f81-b165-444f-89cc-f21c42a9f772", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1659902586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e375153f6f24827811c5825fc2a2c6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce5d2e1-05", "ovs_interfaceid": "3ce5d2e1-0587-486f-9184-5026ff7a941a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 12:17:32 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-766ac429-1d3e-4a1a-9293-c15afd289a17 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Converting VIF {"id": "3ce5d2e1-0587-486f-9184-5026ff7a941a", "address": "fa:16:3e:d3:87:c8", "network": {"id": "aa827f81-b165-444f-89cc-f21c42a9f772", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1659902586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e375153f6f24827811c5825fc2a2c6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce5d2e1-05", "ovs_interfaceid": "3ce5d2e1-0587-486f-9184-5026ff7a941a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 12:17:32 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-766ac429-1d3e-4a1a-9293-c15afd289a17 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d3:87:c8,bridge_name='br-int',has_traffic_filtering=True,id=3ce5d2e1-0587-486f-9184-5026ff7a941a,network=Network(aa827f81-b165-444f-89cc-f21c42a9f772),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ce5d2e1-05') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 12:17:32 user nova-compute[74190]: DEBUG os_vif [None req-766ac429-1d3e-4a1a-9293-c15afd289a17 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:87:c8,bridge_name='br-int',has_traffic_filtering=True,id=3ce5d2e1-0587-486f-9184-5026ff7a941a,network=Network(aa827f81-b165-444f-89cc-f21c42a9f772),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ce5d2e1-05') {{(pid=74190) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 12:17:32 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:17:32 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3ce5d2e1-05, bridge=br-int, if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:17:32 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:17:32 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:17:32 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:17:32 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f5d549f3-0a9d-417f-99e4-20bb5c704dbc) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:17:32 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:17:32 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:17:32 user nova-compute[74190]: INFO os_vif [None req-766ac429-1d3e-4a1a-9293-c15afd289a17 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:87:c8,bridge_name='br-int',has_traffic_filtering=True,id=3ce5d2e1-0587-486f-9184-5026ff7a941a,network=Network(aa827f81-b165-444f-89cc-f21c42a9f772),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ce5d2e1-05')
Oct 18 12:17:32 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-766ac429-1d3e-4a1a-9293-c15afd289a17 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 15172ec7-bdaa-478f-93ac-d4dbba6a3a0d] calling os-brick to detach iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 12:17:32 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-766ac429-1d3e-4a1a-9293-c15afd289a17 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, {'target_iqn': 'iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eDJgkSRx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 12:17:32 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-766ac429-1d3e-4a1a-9293-c15afd289a17 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 12:17:32 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-766ac429-1d3e-4a1a-9293-c15afd289a17 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 12:17:32 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-766ac429-1d3e-4a1a-9293-c15afd289a17 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 12:17:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:17:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:17:32 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebcd56c0-14b3-4597-965e-98d014580f98]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ac80cf2c-4cd2-4380-b464-4b546c08bc21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:17:32 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-766ac429-1d3e-4a1a-9293-c15afd289a17 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 12:17:32 user nova-compute[74190]: No targets found.
Oct 18 12:17:32 user nova-compute[74190]: iSNS:
Oct 18 12:17:32 user nova-compute[74190]: No targets found.
Oct 18 12:17:32 user nova-compute[74190]: STATIC:
Oct 18 12:17:32 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18
Oct 18 12:17:32 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 12:17:32 user nova-compute[74190]:                 Iface Name: default
Oct 18 12:17:32 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:ac80cf2c-4cd2-4380-b464-4b546c08bc21
Oct 18 12:17:32 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 12:17:32 user nova-compute[74190]:                 Iface Name: default
Oct 18 12:17:32 user nova-compute[74190]: FIRMWARE:
Oct 18 12:17:32 user nova-compute[74190]: No targets found.
Oct 18 12:17:32 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 12:17:32 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-766ac429-1d3e-4a1a-9293-c15afd289a17 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 12:17:32 user nova-compute[74190]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 12:17:32 user nova-compute[74190]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74190) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 12:17:32 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-766ac429-1d3e-4a1a-9293-c15afd289a17 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18', 0)] {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 12:17:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:17:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:17:32 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e7cb68-de58-44e9-946a-8ec387ad445c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac80cf2c-4cd2-4380-b464-4b546c08bc21\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:17:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:17:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:17:32 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c1e974b-8f8e-4c67-add1-5e820845e087]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac80cf2c-4cd2-4380-b464-4b546c08bc21 (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:17:32 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-766ac429-1d3e-4a1a-9293-c15afd289a17 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18 (non-flash)
Oct 18 12:17:32 user nova-compute[74190]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac80cf2c-4cd2-4380-b464-4b546c08bc21 (non-flash)
Oct 18 12:17:32 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 12:17:32 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-766ac429-1d3e-4a1a-9293-c15afd289a17 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18 (non-flash)
Oct 18 12:17:32 user nova-compute[74190]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac80cf2c-4cd2-4380-b464-4b546c08bc21 (non-flash)
Oct 18 12:17:32 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 12:17:32 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-766ac429-1d3e-4a1a-9293-c15afd289a17 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1f247cca60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18'): ({'sdb'}, set())}) {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 12:17:32 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-766ac429-1d3e-4a1a-9293-c15afd289a17 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Removing single pathed devices sdb {{(pid=74190) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 12:17:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:17:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:17:32 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a75f779-9c50-406f-927d-eace6952ebaa]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:17:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:17:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:17:32 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2516270-6047-44db-8ff5-50cc65d811fa]: (4, ('ok\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:17:32 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-766ac429-1d3e-4a1a-9293-c15afd289a17 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Flushing IO for device /dev/sdb {{(pid=74190) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 12:17:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:17:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:17:32 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[df4d6f93-3586-4673-a4d9-16f1c6597f66]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:17:32 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-766ac429-1d3e-4a1a-9293-c15afd289a17 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74190) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 12:17:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:17:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:17:32 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c9ebc0-b89a-484c-82d3-900abc002882]: (4, ('1', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:17:32 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-766ac429-1d3e-4a1a-9293-c15afd289a17 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 12:17:32 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-766ac429-1d3e-4a1a-9293-c15afd289a17 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] SCSI volumes sdb have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 12:17:32 user nova-compute[74190]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO658f93b8-04f73f57078e9f87', '/dev/disk/by-id/scsi-23034663733663537', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_658f93b8') {{(pid=85217) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 18 12:17:32 user nova-compute[74190]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO658f93b8-04f73f57078e9f87
Oct 18 12:17:32 user nova-compute[74190]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23034663733663537
Oct 18 12:17:32 user nova-compute[74190]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_658f93b8
Oct 18 12:17:32 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[26897375-19d1-406d-8ad1-c71aeefafff7]: (4, None) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:17:32 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-766ac429-1d3e-4a1a-9293-c15afd289a17 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18')] {{(pid=74190) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 12:17:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:17:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:17:32 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f4f8fe-cd6c-48d5-9e7e-ab9ef6adedc3]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:17:32 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-766ac429-1d3e-4a1a-9293-c15afd289a17 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:17:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18 -p 172.16.0.220:3260 --logout {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:17:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18 -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:17:32 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb6f6b73-e50f-4ad2-826d-a781ba54ee0b]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:17:32 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-766ac429-1d3e-4a1a-9293-c15afd289a17 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18, portal: 172.16.0.220,3260]
Oct 18 12:17:32 user nova-compute[74190]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18, portal: 172.16.0.220,3260] successful.
Oct 18 12:17:32 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:17:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18 -p 172.16.0.220:3260 --op delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:17:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:17:32 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9814e7d-b7bd-4355-a2d6-3fbc900b49b3]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:17:32 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-766ac429-1d3e-4a1a-9293-c15afd289a17 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:17:32 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-766ac429-1d3e-4a1a-9293-c15afd289a17 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 12:17:32 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-766ac429-1d3e-4a1a-9293-c15afd289a17 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] <== disconnect_volume: return (306ms) None {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 12:17:32 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-766ac429-1d3e-4a1a-9293-c15afd289a17 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 15172ec7-bdaa-478f-93ac-d4dbba6a3a0d] Disconnected iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 12:17:32 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-766ac429-1d3e-4a1a-9293-c15afd289a17 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 15172ec7-bdaa-478f-93ac-d4dbba6a3a0d] Deleting instance files /opt/stack/data/nova/instances/15172ec7-bdaa-478f-93ac-d4dbba6a3a0d_del
Oct 18 12:17:32 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-766ac429-1d3e-4a1a-9293-c15afd289a17 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 15172ec7-bdaa-478f-93ac-d4dbba6a3a0d] Deletion of /opt/stack/data/nova/instances/15172ec7-bdaa-478f-93ac-d4dbba6a3a0d_del complete
Oct 18 12:17:32 user nova-compute[74190]: INFO nova.compute.manager [None req-766ac429-1d3e-4a1a-9293-c15afd289a17 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 15172ec7-bdaa-478f-93ac-d4dbba6a3a0d] Took 1.16 seconds to destroy the instance on the hypervisor.
Oct 18 12:17:32 user nova-compute[74190]: DEBUG oslo.service.loopingcall [None req-766ac429-1d3e-4a1a-9293-c15afd289a17 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74190) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 12:17:32 user nova-compute[74190]: DEBUG nova.compute.manager [-] [instance: 15172ec7-bdaa-478f-93ac-d4dbba6a3a0d] Deallocating network for instance {{(pid=74190) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 12:17:32 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: 15172ec7-bdaa-478f-93ac-d4dbba6a3a0d] deallocate_for_instance() {{(pid=74190) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 12:17:33 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:17:33 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74190) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 18 12:17:33 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: 15172ec7-bdaa-478f-93ac-d4dbba6a3a0d] Updating instance_info_cache with network_info: [] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:17:33 user nova-compute[74190]: INFO nova.compute.manager [-] [instance: 15172ec7-bdaa-478f-93ac-d4dbba6a3a0d] Took 0.81 seconds to deallocate network for instance.
Oct 18 12:17:33 user nova-compute[74190]: DEBUG nova.compute.manager [req-8f0f1732-3a45-41b0-af3a-61cbb62fb0a8 req-fc6d75c3-7e6e-43e8-98bc-9a032f42d989 service nova] [instance: 15172ec7-bdaa-478f-93ac-d4dbba6a3a0d] Received event network-vif-deleted-3ce5d2e1-0587-486f-9184-5026ff7a941a {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:17:34 user nova-compute[74190]: DEBUG nova.compute.manager [req-2d609b59-4747-406d-9d53-87f11748be2a req-7f375bf3-c164-4475-bfc8-1722cd2a1a9d service nova] [instance: 15172ec7-bdaa-478f-93ac-d4dbba6a3a0d] Received event network-vif-plugged-3ce5d2e1-0587-486f-9184-5026ff7a941a {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:17:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-2d609b59-4747-406d-9d53-87f11748be2a req-7f375bf3-c164-4475-bfc8-1722cd2a1a9d service nova] Acquiring lock "15172ec7-bdaa-478f-93ac-d4dbba6a3a0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:17:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-2d609b59-4747-406d-9d53-87f11748be2a req-7f375bf3-c164-4475-bfc8-1722cd2a1a9d service nova] Lock "15172ec7-bdaa-478f-93ac-d4dbba6a3a0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:17:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-2d609b59-4747-406d-9d53-87f11748be2a req-7f375bf3-c164-4475-bfc8-1722cd2a1a9d service nova] Lock "15172ec7-bdaa-478f-93ac-d4dbba6a3a0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:17:34 user nova-compute[74190]: DEBUG nova.compute.manager [req-2d609b59-4747-406d-9d53-87f11748be2a req-7f375bf3-c164-4475-bfc8-1722cd2a1a9d service nova] [instance: 15172ec7-bdaa-478f-93ac-d4dbba6a3a0d] No waiting events found dispatching network-vif-plugged-3ce5d2e1-0587-486f-9184-5026ff7a941a {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:17:34 user nova-compute[74190]: WARNING nova.compute.manager [req-2d609b59-4747-406d-9d53-87f11748be2a req-7f375bf3-c164-4475-bfc8-1722cd2a1a9d service nova] [instance: 15172ec7-bdaa-478f-93ac-d4dbba6a3a0d] Received unexpected event network-vif-plugged-3ce5d2e1-0587-486f-9184-5026ff7a941a for instance with vm_state active and task_state deleting.
Oct 18 12:17:34 user nova-compute[74190]: INFO nova.compute.manager [None req-766ac429-1d3e-4a1a-9293-c15afd289a17 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 15172ec7-bdaa-478f-93ac-d4dbba6a3a0d] Took 0.92 seconds to detach 1 volumes for instance.
Oct 18 12:17:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-766ac429-1d3e-4a1a-9293-c15afd289a17 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:17:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-766ac429-1d3e-4a1a-9293-c15afd289a17 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:17:34 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-766ac429-1d3e-4a1a-9293-c15afd289a17 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 12:17:34 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-766ac429-1d3e-4a1a-9293-c15afd289a17 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 12:17:35 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-766ac429-1d3e-4a1a-9293-c15afd289a17 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.268s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:17:35 user nova-compute[74190]: INFO nova.scheduler.client.report [None req-766ac429-1d3e-4a1a-9293-c15afd289a17 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Deleted allocations for instance 15172ec7-bdaa-478f-93ac-d4dbba6a3a0d
Oct 18 12:17:35 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-766ac429-1d3e-4a1a-9293-c15afd289a17 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "15172ec7-bdaa-478f-93ac-d4dbba6a3a0d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.355s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:17:35 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:17:36 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:17:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:17:38 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-aec2fca2-e9d2-48bb-b77f-ca74fa89b671 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0309a457-dae8-4a13-ac5c-53e2320930ff is timed out.
Oct 18 12:17:38 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-aec2fca2-e9d2-48bb-b77f-ca74fa89b671 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Successfully detached device vdb from instance 0309a457-dae8-4a13-ac5c-53e2320930ff from the live domain config.
Oct 18 12:17:38 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aec2fca2-e9d2-48bb-b77f-ca74fa89b671 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: 0309a457-dae8-4a13-ac5c-53e2320930ff] calling os-brick to detach iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 12:17:38 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec2fca2-e9d2-48bb-b77f-ca74fa89b671 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, {'target_iqn': 'iqn.2010-10.org.openstack:ac80cf2c-4cd2-4380-b464-4b546c08bc21', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wCRpqogO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 12:17:38 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-aec2fca2-e9d2-48bb-b77f-ca74fa89b671 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 12:17:38 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-aec2fca2-e9d2-48bb-b77f-ca74fa89b671 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 12:17:38 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-aec2fca2-e9d2-48bb-b77f-ca74fa89b671 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 12:17:38 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:17:38 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:17:38 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[842ad1f3-956f-436f-a9fe-730d5becf58f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ac80cf2c-4cd2-4380-b464-4b546c08bc21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:17:38 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec2fca2-e9d2-48bb-b77f-ca74fa89b671 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 12:17:38 user nova-compute[74190]: No targets found.
Oct 18 12:17:38 user nova-compute[74190]: iSNS:
Oct 18 12:17:38 user nova-compute[74190]: No targets found.
Oct 18 12:17:38 user nova-compute[74190]: STATIC:
Oct 18 12:17:38 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:ac80cf2c-4cd2-4380-b464-4b546c08bc21
Oct 18 12:17:38 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 12:17:38 user nova-compute[74190]:                 Iface Name: default
Oct 18 12:17:38 user nova-compute[74190]: FIRMWARE:
Oct 18 12:17:38 user nova-compute[74190]: No targets found.
Oct 18 12:17:38 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 12:17:38 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec2fca2-e9d2-48bb-b77f-ca74fa89b671 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 12:17:38 user nova-compute[74190]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 12:17:38 user nova-compute[74190]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74190) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 12:17:38 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec2fca2-e9d2-48bb-b77f-ca74fa89b671 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac80cf2c-4cd2-4380-b464-4b546c08bc21', 0)] {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 12:17:38 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:17:39 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:17:39 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[db1a8010-3c32-4859-85a1-d55acdf2339d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac80cf2c-4cd2-4380-b464-4b546c08bc21\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:17:39 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:17:39 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:17:39 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc6d6bb5-6d84-4931-985c-d2f810666fc8]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac80cf2c-4cd2-4380-b464-4b546c08bc21 (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:17:39 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec2fca2-e9d2-48bb-b77f-ca74fa89b671 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac80cf2c-4cd2-4380-b464-4b546c08bc21 (non-flash)
Oct 18 12:17:39 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 12:17:39 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec2fca2-e9d2-48bb-b77f-ca74fa89b671 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac80cf2c-4cd2-4380-b464-4b546c08bc21 (non-flash)
Oct 18 12:17:39 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 12:17:39 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec2fca2-e9d2-48bb-b77f-ca74fa89b671 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1f24795c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac80cf2c-4cd2-4380-b464-4b546c08bc21'): ({'sdc'}, set())}) {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 12:17:39 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-aec2fca2-e9d2-48bb-b77f-ca74fa89b671 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Removing single pathed devices sdc {{(pid=74190) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 12:17:39 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:17:39 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:17:39 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e84c82-a5c2-4ceb-82d7-bab4403e35ef]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:17:39 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:17:39 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:17:39 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c86c9d-d1ae-4a56-9762-dc0f56b28e75]: (4, ('ok\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:17:39 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-aec2fca2-e9d2-48bb-b77f-ca74fa89b671 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Flushing IO for device /dev/sdc {{(pid=74190) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 12:17:39 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:17:39 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:17:39 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[265f68ca-c900-4a83-b86f-71b2512843e2]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:17:39 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-aec2fca2-e9d2-48bb-b77f-ca74fa89b671 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74190) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 12:17:39 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:17:39 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:17:39 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f27e64-e7cf-4829-98ab-d5cae76b9fde]: (4, ('1', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:17:39 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-aec2fca2-e9d2-48bb-b77f-ca74fa89b671 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 12:17:39 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-aec2fca2-e9d2-48bb-b77f-ca74fa89b671 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] SCSI volumes sdc have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 12:17:39 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec2fca2-e9d2-48bb-b77f-ca74fa89b671 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac80cf2c-4cd2-4380-b464-4b546c08bc21')] {{(pid=74190) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 12:17:39 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac80cf2c-4cd2-4380-b464-4b546c08bc21 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:17:39 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac80cf2c-4cd2-4380-b464-4b546c08bc21 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:17:39 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[272e143f-5843-42f3-8bf7-9414cdf01890]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:17:39 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec2fca2-e9d2-48bb-b77f-ca74fa89b671 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:17:39 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac80cf2c-4cd2-4380-b464-4b546c08bc21 -p 172.16.0.220:3260 --logout {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:17:39 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac80cf2c-4cd2-4380-b464-4b546c08bc21 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:17:39 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9582ca2-b6b8-4534-8124-5216f2e51879]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:ac80cf2c-4cd2-4380-b464-4b546c08bc21, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:ac80cf2c-4cd2-4380-b464-4b546c08bc21, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:17:39 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec2fca2-e9d2-48bb-b77f-ca74fa89b671 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:ac80cf2c-4cd2-4380-b464-4b546c08bc21, portal: 172.16.0.220,3260]
Oct 18 12:17:39 user nova-compute[74190]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:ac80cf2c-4cd2-4380-b464-4b546c08bc21, portal: 172.16.0.220,3260] successful.
Oct 18 12:17:39 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:17:39 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac80cf2c-4cd2-4380-b464-4b546c08bc21 -p 172.16.0.220:3260 --op delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:17:39 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac80cf2c-4cd2-4380-b464-4b546c08bc21 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:17:39 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dad0723-a0a7-4734-b6ee-faa13d39fce4]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:17:39 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec2fca2-e9d2-48bb-b77f-ca74fa89b671 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:17:39 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-aec2fca2-e9d2-48bb-b77f-ca74fa89b671 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 12:17:39 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec2fca2-e9d2-48bb-b77f-ca74fa89b671 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] <== disconnect_volume: return (301ms) None {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 12:17:39 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aec2fca2-e9d2-48bb-b77f-ca74fa89b671 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: 0309a457-dae8-4a13-ac5c-53e2320930ff] Disconnected iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 12:17:40 user nova-compute[74190]: DEBUG nova.objects.instance [None req-aec2fca2-e9d2-48bb-b77f-ca74fa89b671 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Lazy-loading 'flavor' on Instance uuid 0309a457-dae8-4a13-ac5c-53e2320930ff {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:17:40 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-aec2fca2-e9d2-48bb-b77f-ca74fa89b671 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Lock "0309a457-dae8-4a13-ac5c-53e2320930ff" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.921s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:17:40 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-3cf71f45-8931-4d95-a095-b113d21a6cbb tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Lock "0309a457-dae8-4a13-ac5c-53e2320930ff" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.807s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:17:40 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-3cf71f45-8931-4d95-a095-b113d21a6cbb tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Acquiring lock "0309a457-dae8-4a13-ac5c-53e2320930ff-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:17:40 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-3cf71f45-8931-4d95-a095-b113d21a6cbb tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Lock "0309a457-dae8-4a13-ac5c-53e2320930ff-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:17:40 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-3cf71f45-8931-4d95-a095-b113d21a6cbb tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Lock "0309a457-dae8-4a13-ac5c-53e2320930ff-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:17:40 user nova-compute[74190]: INFO nova.compute.manager [None req-3cf71f45-8931-4d95-a095-b113d21a6cbb tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: 0309a457-dae8-4a13-ac5c-53e2320930ff] Terminating instance
Oct 18 12:17:40 user nova-compute[74190]: DEBUG nova.compute.manager [None req-3cf71f45-8931-4d95-a095-b113d21a6cbb tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: 0309a457-dae8-4a13-ac5c-53e2320930ff] Start destroying the instance on the hypervisor. {{(pid=74190) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 12:17:40 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:17:40 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:17:40 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:17:40 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:17:40 user nova-compute[74190]: DEBUG nova.compute.manager [req-a68daeff-7654-4c41-b49a-f6fb1f364dcb req-3f75f840-ef90-41c4-9adc-0320798c2a04 service nova] [instance: 0309a457-dae8-4a13-ac5c-53e2320930ff] Received event network-vif-unplugged-15fe1d6a-f1b1-4ba7-baa8-7c9c2a0f8643 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:17:40 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-a68daeff-7654-4c41-b49a-f6fb1f364dcb req-3f75f840-ef90-41c4-9adc-0320798c2a04 service nova] Acquiring lock "0309a457-dae8-4a13-ac5c-53e2320930ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:17:40 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-a68daeff-7654-4c41-b49a-f6fb1f364dcb req-3f75f840-ef90-41c4-9adc-0320798c2a04 service nova] Lock "0309a457-dae8-4a13-ac5c-53e2320930ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:17:40 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-a68daeff-7654-4c41-b49a-f6fb1f364dcb req-3f75f840-ef90-41c4-9adc-0320798c2a04 service nova] Lock "0309a457-dae8-4a13-ac5c-53e2320930ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:17:40 user nova-compute[74190]: DEBUG nova.compute.manager [req-a68daeff-7654-4c41-b49a-f6fb1f364dcb req-3f75f840-ef90-41c4-9adc-0320798c2a04 service nova] [instance: 0309a457-dae8-4a13-ac5c-53e2320930ff] No waiting events found dispatching network-vif-unplugged-15fe1d6a-f1b1-4ba7-baa8-7c9c2a0f8643 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:17:40 user nova-compute[74190]: DEBUG nova.compute.manager [req-a68daeff-7654-4c41-b49a-f6fb1f364dcb req-3f75f840-ef90-41c4-9adc-0320798c2a04 service nova] [instance: 0309a457-dae8-4a13-ac5c-53e2320930ff] Received event network-vif-unplugged-15fe1d6a-f1b1-4ba7-baa8-7c9c2a0f8643 for instance with task_state deleting. {{(pid=74190) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 12:17:41 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 0309a457-dae8-4a13-ac5c-53e2320930ff] Instance destroyed successfully.
Oct 18 12:17:41 user nova-compute[74190]: DEBUG nova.objects.instance [None req-3cf71f45-8931-4d95-a095-b113d21a6cbb tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Lazy-loading 'resources' on Instance uuid 0309a457-dae8-4a13-ac5c-53e2320930ff {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:17:41 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-3cf71f45-8931-4d95-a095-b113d21a6cbb tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T12:14:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1714449262',display_name='tempest-VolumesSnapshotTestJSON-instance-1714449262',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1714449262',id=45,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBiA49OJsuTWpE/DbESifyn+qStGa0vhIL4qhhpAEiqzuGfmJDChDk6GXu5nVuuAHndGg+J0dA8AgQIAFVMUezVLZIx+SG1F7Cc6T+wgoqacHtEReduCnynVjEVf5WuHtA==',key_name='tempest-keypair-1902603522',keypairs=<?>,launch_index=0,launched_at=2023-10-18T12:14:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1e49c9e381b0457faa31d0f5bdfa3f18',ramdisk_id='',reservation_id='r-gfal3ica',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-252328076',owner_user_name='tempest-VolumesSnapshotTestJSON-252328076-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T12:14:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f2c022bbeb1941fe89964cd372f651f2',uuid=0309a457-dae8-4a13-ac5c-53e2320930ff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "15fe1d6a-f1b1-4ba7-baa8-7c9c2a0f8643", "address": "fa:16:3e:4e:a5:f5", "network": {"id": "1afc08fa-4518-4ccf-97a1-22f04820b31c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-687660220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e49c9e381b0457faa31d0f5bdfa3f18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15fe1d6a-f1", "ovs_interfaceid": "15fe1d6a-f1b1-4ba7-baa8-7c9c2a0f8643", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 12:17:41 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-3cf71f45-8931-4d95-a095-b113d21a6cbb tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Converting VIF {"id": "15fe1d6a-f1b1-4ba7-baa8-7c9c2a0f8643", "address": "fa:16:3e:4e:a5:f5", "network": {"id": "1afc08fa-4518-4ccf-97a1-22f04820b31c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-687660220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e49c9e381b0457faa31d0f5bdfa3f18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15fe1d6a-f1", "ovs_interfaceid": "15fe1d6a-f1b1-4ba7-baa8-7c9c2a0f8643", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 12:17:41 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-3cf71f45-8931-4d95-a095-b113d21a6cbb tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4e:a5:f5,bridge_name='br-int',has_traffic_filtering=True,id=15fe1d6a-f1b1-4ba7-baa8-7c9c2a0f8643,network=Network(1afc08fa-4518-4ccf-97a1-22f04820b31c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15fe1d6a-f1') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 12:17:41 user nova-compute[74190]: DEBUG os_vif [None req-3cf71f45-8931-4d95-a095-b113d21a6cbb tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:a5:f5,bridge_name='br-int',has_traffic_filtering=True,id=15fe1d6a-f1b1-4ba7-baa8-7c9c2a0f8643,network=Network(1afc08fa-4518-4ccf-97a1-22f04820b31c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15fe1d6a-f1') {{(pid=74190) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 12:17:41 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:17:41 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap15fe1d6a-f1, bridge=br-int, if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:17:41 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:17:41 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:17:41 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:17:41 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=13a26ac4-725b-4cde-961f-839b4fd9cecd) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:17:41 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:17:41 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:17:41 user nova-compute[74190]: INFO os_vif [None req-3cf71f45-8931-4d95-a095-b113d21a6cbb tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:a5:f5,bridge_name='br-int',has_traffic_filtering=True,id=15fe1d6a-f1b1-4ba7-baa8-7c9c2a0f8643,network=Network(1afc08fa-4518-4ccf-97a1-22f04820b31c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15fe1d6a-f1')
Oct 18 12:17:41 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3cf71f45-8931-4d95-a095-b113d21a6cbb tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: 0309a457-dae8-4a13-ac5c-53e2320930ff] calling os-brick to detach iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 12:17:41 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf71f45-8931-4d95-a095-b113d21a6cbb tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, {'target_iqn': 'iqn.2010-10.org.openstack:ac80cf2c-4cd2-4380-b464-4b546c08bc21', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wCRpqogO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 12:17:41 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-3cf71f45-8931-4d95-a095-b113d21a6cbb tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 12:17:41 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-3cf71f45-8931-4d95-a095-b113d21a6cbb tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 12:17:41 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-3cf71f45-8931-4d95-a095-b113d21a6cbb tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 12:17:41 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:17:41 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.017s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:17:41 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 12:17:41 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[165882d7-d02d-4936-85e9-3e84987cbb1a]: Unexpected error while running command.
Oct 18 12:17:41 user nova-compute[74190]: Command: iscsiadm -m discoverydb -o show -P 1
Oct 18 12:17:41 user nova-compute[74190]: Exit code: 21
Oct 18 12:17:41 user nova-compute[74190]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Oct 18 12:17:41 user nova-compute[74190]: Stderr: '' {{(pid=85217) _process_cmd /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:477}}
Oct 18 12:17:41 user nova-compute[74190]: Traceback (most recent call last):
Oct 18 12:17:41 user nova-compute[74190]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 474, in _process_cmd
Oct 18 12:17:41 user nova-compute[74190]:     ret = func(*f_args, **f_kwargs)
Oct 18 12:17:41 user nova-compute[74190]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Oct 18 12:17:41 user nova-compute[74190]:     return func(*args, **kwargs)
Oct 18 12:17:41 user nova-compute[74190]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Oct 18 12:17:41 user nova-compute[74190]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Oct 18 12:17:41 user nova-compute[74190]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Oct 18 12:17:41 user nova-compute[74190]:     return putils.execute(on_execute=on_execute,
Oct 18 12:17:41 user nova-compute[74190]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py", line 438, in execute
Oct 18 12:17:41 user nova-compute[74190]:     raise ProcessExecutionError(exit_code=_returncode,
Oct 18 12:17:41 user nova-compute[74190]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Oct 18 12:17:41 user nova-compute[74190]: Command: iscsiadm -m discoverydb -o show -P 1
Oct 18 12:17:41 user nova-compute[74190]: Exit code: 21
Oct 18 12:17:41 user nova-compute[74190]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Oct 18 12:17:41 user nova-compute[74190]: Stderr: ''
Oct 18 12:17:41 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[165882d7-d02d-4936-85e9-3e84987cbb1a]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None)) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:17:41 user nova-compute[74190]: ERROR os_brick.initiator.connectors.iscsi [None req-3cf71f45-8931-4d95-a095-b113d21a6cbb tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Oct 18 12:17:41 user nova-compute[74190]: Command: iscsiadm -m discoverydb -o show -P 1
Oct 18 12:17:41 user nova-compute[74190]: Exit code: 21
Oct 18 12:17:41 user nova-compute[74190]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Oct 18 12:17:41 user nova-compute[74190]: Stderr: ''
Oct 18 12:17:41 user nova-compute[74190]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Oct 18 12:17:41 user nova-compute[74190]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 217, in _get_ips_iqns_luns
Oct 18 12:17:41 user nova-compute[74190]: ERROR os_brick.initiator.connectors.iscsi     ips_iqns_luns = method(connection_properties)
Oct 18 12:17:41 user nova-compute[74190]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 376, in _get_discoverydb_portals
Oct 18 12:17:41 user nova-compute[74190]: ERROR os_brick.initiator.connectors.iscsi     out = self._run_iscsiadm_bare(['-m', 'discoverydb',
Oct 18 12:17:41 user nova-compute[74190]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 1188, in _run_iscsiadm_bare
Oct 18 12:17:41 user nova-compute[74190]: ERROR os_brick.initiator.connectors.iscsi     (out, err) = self._execute('iscsiadm',
Oct 18 12:17:41 user nova-compute[74190]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/executor.py", line 55, in _execute
Oct 18 12:17:41 user nova-compute[74190]: ERROR os_brick.initiator.connectors.iscsi     result = self.__execute(*args, **kwargs)
Oct 18 12:17:41 user nova-compute[74190]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Oct 18 12:17:41 user nova-compute[74190]: ERROR os_brick.initiator.connectors.iscsi     return execute_root(*cmd, **kwargs)
Oct 18 12:17:41 user nova-compute[74190]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Oct 18 12:17:41 user nova-compute[74190]: ERROR os_brick.initiator.connectors.iscsi     return self.channel.remote_call(name, args, kwargs,
Oct 18 12:17:41 user nova-compute[74190]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 215, in remote_call
Oct 18 12:17:41 user nova-compute[74190]: ERROR os_brick.initiator.connectors.iscsi     raise exc_type(*result[2])
Oct 18 12:17:41 user nova-compute[74190]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Oct 18 12:17:41 user nova-compute[74190]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1
Oct 18 12:17:41 user nova-compute[74190]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21
Oct 18 12:17:41 user nova-compute[74190]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Oct 18 12:17:41 user nova-compute[74190]: ERROR os_brick.initiator.connectors.iscsi Stderr: ''
Oct 18 12:17:41 user nova-compute[74190]: ERROR os_brick.initiator.connectors.iscsi 
Oct 18 12:17:41 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf71f45-8931-4d95-a095-b113d21a6cbb tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Skipping cleanup Unable to find target portal 172.16.0.220:3260. {{(pid=74190) _cleanup_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:934}}
Oct 18 12:17:41 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-3cf71f45-8931-4d95-a095-b113d21a6cbb tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.033s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 12:17:41 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf71f45-8931-4d95-a095-b113d21a6cbb tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] <== disconnect_volume: return (35ms) None {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 12:17:41 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3cf71f45-8931-4d95-a095-b113d21a6cbb tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: 0309a457-dae8-4a13-ac5c-53e2320930ff] Disconnected iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 12:17:41 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-3cf71f45-8931-4d95-a095-b113d21a6cbb tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: 0309a457-dae8-4a13-ac5c-53e2320930ff] Deleting instance files /opt/stack/data/nova/instances/0309a457-dae8-4a13-ac5c-53e2320930ff_del
Oct 18 12:17:41 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-3cf71f45-8931-4d95-a095-b113d21a6cbb tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: 0309a457-dae8-4a13-ac5c-53e2320930ff] Deletion of /opt/stack/data/nova/instances/0309a457-dae8-4a13-ac5c-53e2320930ff_del complete
Oct 18 12:17:41 user nova-compute[74190]: INFO nova.compute.manager [None req-3cf71f45-8931-4d95-a095-b113d21a6cbb tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: 0309a457-dae8-4a13-ac5c-53e2320930ff] Took 0.90 seconds to destroy the instance on the hypervisor.
Oct 18 12:17:41 user nova-compute[74190]: DEBUG oslo.service.loopingcall [None req-3cf71f45-8931-4d95-a095-b113d21a6cbb tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74190) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 12:17:41 user nova-compute[74190]: DEBUG nova.compute.manager [-] [instance: 0309a457-dae8-4a13-ac5c-53e2320930ff] Deallocating network for instance {{(pid=74190) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 12:17:41 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: 0309a457-dae8-4a13-ac5c-53e2320930ff] deallocate_for_instance() {{(pid=74190) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 12:17:42 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: 0309a457-dae8-4a13-ac5c-53e2320930ff] Updating instance_info_cache with network_info: [] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:17:42 user nova-compute[74190]: INFO nova.compute.manager [-] [instance: 0309a457-dae8-4a13-ac5c-53e2320930ff] Took 0.92 seconds to deallocate network for instance.
Oct 18 12:17:42 user nova-compute[74190]: DEBUG nova.compute.manager [req-728bd110-4972-4295-91e4-1a816b548178 req-75443964-688a-4610-86c7-51d91b707c37 service nova] [instance: 0309a457-dae8-4a13-ac5c-53e2320930ff] Received event network-vif-deleted-15fe1d6a-f1b1-4ba7-baa8-7c9c2a0f8643 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:17:42 user nova-compute[74190]: INFO nova.compute.manager [req-728bd110-4972-4295-91e4-1a816b548178 req-75443964-688a-4610-86c7-51d91b707c37 service nova] [instance: 0309a457-dae8-4a13-ac5c-53e2320930ff] Neutron deleted interface 15fe1d6a-f1b1-4ba7-baa8-7c9c2a0f8643; detaching it from the instance and deleting it from the info cache
Oct 18 12:17:42 user nova-compute[74190]: DEBUG nova.network.neutron [req-728bd110-4972-4295-91e4-1a816b548178 req-75443964-688a-4610-86c7-51d91b707c37 service nova] [instance: 0309a457-dae8-4a13-ac5c-53e2320930ff] Updating instance_info_cache with network_info: [] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:17:42 user nova-compute[74190]: DEBUG nova.compute.manager [req-728bd110-4972-4295-91e4-1a816b548178 req-75443964-688a-4610-86c7-51d91b707c37 service nova] [instance: 0309a457-dae8-4a13-ac5c-53e2320930ff] Detach interface failed, port_id=15fe1d6a-f1b1-4ba7-baa8-7c9c2a0f8643, reason: Instance 0309a457-dae8-4a13-ac5c-53e2320930ff could not be found. {{(pid=74190) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 18 12:17:42 user nova-compute[74190]: WARNING nova.volume.cinder [None req-3cf71f45-8931-4d95-a095-b113d21a6cbb tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Attachment 2e43bbac-699f-49fb-b5d2-e4743e295412 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 2e43bbac-699f-49fb-b5d2-e4743e295412. (HTTP 404) (Request-ID: req-0ea52343-db52-4a3c-ad4d-f06c94bf7d5a)
Oct 18 12:17:42 user nova-compute[74190]: INFO nova.compute.manager [None req-3cf71f45-8931-4d95-a095-b113d21a6cbb tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: 0309a457-dae8-4a13-ac5c-53e2320930ff] Took 0.04 seconds to detach 1 volumes for instance.
Oct 18 12:17:42 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-3cf71f45-8931-4d95-a095-b113d21a6cbb tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:17:42 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-3cf71f45-8931-4d95-a095-b113d21a6cbb tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:17:42 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-3cf71f45-8931-4d95-a095-b113d21a6cbb tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 12:17:42 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-3cf71f45-8931-4d95-a095-b113d21a6cbb tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 12:17:42 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-3cf71f45-8931-4d95-a095-b113d21a6cbb tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.243s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:17:42 user nova-compute[74190]: INFO nova.scheduler.client.report [None req-3cf71f45-8931-4d95-a095-b113d21a6cbb tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Deleted allocations for instance 0309a457-dae8-4a13-ac5c-53e2320930ff
Oct 18 12:17:42 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-3cf71f45-8931-4d95-a095-b113d21a6cbb tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Lock "0309a457-dae8-4a13-ac5c-53e2320930ff" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.356s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:17:42 user nova-compute[74190]: DEBUG nova.compute.manager [req-a83d18d0-d8be-4d8a-8971-7ff04b694101 req-c9b28c61-032d-4c16-8d91-e408019c62cf service nova] [instance: 0309a457-dae8-4a13-ac5c-53e2320930ff] Received event network-vif-plugged-15fe1d6a-f1b1-4ba7-baa8-7c9c2a0f8643 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:17:42 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-a83d18d0-d8be-4d8a-8971-7ff04b694101 req-c9b28c61-032d-4c16-8d91-e408019c62cf service nova] Acquiring lock "0309a457-dae8-4a13-ac5c-53e2320930ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:17:42 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-a83d18d0-d8be-4d8a-8971-7ff04b694101 req-c9b28c61-032d-4c16-8d91-e408019c62cf service nova] Lock "0309a457-dae8-4a13-ac5c-53e2320930ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:17:42 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-a83d18d0-d8be-4d8a-8971-7ff04b694101 req-c9b28c61-032d-4c16-8d91-e408019c62cf service nova] Lock "0309a457-dae8-4a13-ac5c-53e2320930ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:17:42 user nova-compute[74190]: DEBUG nova.compute.manager [req-a83d18d0-d8be-4d8a-8971-7ff04b694101 req-c9b28c61-032d-4c16-8d91-e408019c62cf service nova] [instance: 0309a457-dae8-4a13-ac5c-53e2320930ff] No waiting events found dispatching network-vif-plugged-15fe1d6a-f1b1-4ba7-baa8-7c9c2a0f8643 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:17:42 user nova-compute[74190]: WARNING nova.compute.manager [req-a83d18d0-d8be-4d8a-8971-7ff04b694101 req-c9b28c61-032d-4c16-8d91-e408019c62cf service nova] [instance: 0309a457-dae8-4a13-ac5c-53e2320930ff] Received unexpected event network-vif-plugged-15fe1d6a-f1b1-4ba7-baa8-7c9c2a0f8643 for instance with vm_state deleted and task_state None.
Oct 18 12:17:46 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:17:51 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:17:53 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:17:53 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Triggering sync for uuid 7983ceaf-8ed3-4321-a242-2e44218f4d0b {{(pid=74190) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 18 12:17:53 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "7983ceaf-8ed3-4321-a242-2e44218f4d0b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:17:53 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "7983ceaf-8ed3-4321-a242-2e44218f4d0b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:17:53 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "7983ceaf-8ed3-4321-a242-2e44218f4d0b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:17:56 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:18:01 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:18:06 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:18:11 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:18:16 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:18:17 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:18:21 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:18:21 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:18:23 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:18:23 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Acquiring lock "254d3af1-7a43-43d6-b0fa-ddb7fc3dac74" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:18:23 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "254d3af1-7a43-43d6-b0fa-ddb7fc3dac74" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:18:23 user nova-compute[74190]: DEBUG nova.compute.manager [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74] Starting instance... {{(pid=74190) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 12:18:23 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:18:23 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:18:23 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74190) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 12:18:23 user nova-compute[74190]: INFO nova.compute.claims [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74] Claim successful on node user
Oct 18 12:18:24 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 12:18:24 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 12:18:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.248s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:18:24 user nova-compute[74190]: DEBUG nova.compute.manager [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74] Start building networks asynchronously for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 12:18:24 user nova-compute[74190]: DEBUG nova.compute.manager [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74] Allocating IP information in the background. {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 12:18:24 user nova-compute[74190]: DEBUG nova.network.neutron [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74] allocate_for_instance() {{(pid=74190) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 12:18:24 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 12:18:24 user nova-compute[74190]: DEBUG nova.compute.manager [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74] Start building block device mappings for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 12:18:24 user nova-compute[74190]: INFO nova.virt.block_device [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74] Booting with volume 83ff0b09-1a99-460d-94d4-df24e2880d18 at /dev/vda
Oct 18 12:18:24 user nova-compute[74190]: DEBUG nova.policy [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '27d9fc244d0f4e10a43b7df4dc8e30ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e375153f6f24827811c5825fc2a2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74190) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 12:18:24 user nova-compute[74190]: DEBUG os_brick.utils [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 12:18:24 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:18:24 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:18:24 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[f342870f-4ebb-49ad-9c04-90db66c1a480]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cff158e257e1\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:18:24 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:18:24 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:18:24 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca65fd8d-19f5-4ab1-bdf0-9c73ab52f940]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:18:24 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:18:24 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:18:24 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf4201d-e244-42d6-9958-94c713ad9e83]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:18:24 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[415cf590-a647-4756-8441-734e4de0d840]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:18:24 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Running cmd (subprocess): nvme version {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:18:24 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] 'nvme version' failed. Not Retrying. {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 12:18:24 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.nvmeof [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] nvme not present on system {{(pid=74190) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 12:18:24 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:18:24 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 12:18:24 user nova-compute[74190]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 12:18:24 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[93616fb0-61ff-4986-a436-6f7d92538a1c]: (4, '') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:18:24 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74190) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 12:18:24 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 12:18:24 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] LIGHTOS: no hostnqn found. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 12:18:24 user nova-compute[74190]: DEBUG os_brick.utils [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cff158e257e1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 12:18:24 user nova-compute[74190]: DEBUG nova.virt.block_device [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74] Updating existing volume attachment record: ab8a2048-4f5a-40be-a022-d4a198da5fb9 {{(pid=74190) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 12:18:25 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:18:25 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:18:25 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Starting heal instance info cache {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 12:18:25 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Didn't find any instances for network info cache update. {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 18 12:18:25 user nova-compute[74190]: DEBUG nova.network.neutron [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74] Successfully created port: 82848227-6c16-405c-a0ba-348c210787ef {{(pid=74190) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 12:18:26 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:18:26 user nova-compute[74190]: DEBUG nova.network.neutron [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74] Successfully updated port: 82848227-6c16-405c-a0ba-348c210787ef {{(pid=74190) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 12:18:26 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Acquiring lock "refresh_cache-254d3af1-7a43-43d6-b0fa-ddb7fc3dac74" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:18:26 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Acquired lock "refresh_cache-254d3af1-7a43-43d6-b0fa-ddb7fc3dac74" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:18:26 user nova-compute[74190]: DEBUG nova.network.neutron [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74] Building network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 12:18:26 user nova-compute[74190]: DEBUG nova.compute.manager [req-b1fd3842-d6a5-4a0a-a3f7-ca1a495c3a52 req-396e9c43-36f2-4465-b1c5-04c88fbf0991 service nova] [instance: 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74] Received event network-changed-82848227-6c16-405c-a0ba-348c210787ef {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:18:26 user nova-compute[74190]: DEBUG nova.compute.manager [req-b1fd3842-d6a5-4a0a-a3f7-ca1a495c3a52 req-396e9c43-36f2-4465-b1c5-04c88fbf0991 service nova] [instance: 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74] Refreshing instance network info cache due to event network-changed-82848227-6c16-405c-a0ba-348c210787ef. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 12:18:26 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-b1fd3842-d6a5-4a0a-a3f7-ca1a495c3a52 req-396e9c43-36f2-4465-b1c5-04c88fbf0991 service nova] Acquiring lock "refresh_cache-254d3af1-7a43-43d6-b0fa-ddb7fc3dac74" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:18:26 user nova-compute[74190]: DEBUG nova.network.neutron [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74] Instance cache missing network info. {{(pid=74190) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 12:18:27 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:18:27 user nova-compute[74190]: DEBUG nova.network.neutron [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74] Updating instance_info_cache with network_info: [{"id": "82848227-6c16-405c-a0ba-348c210787ef", "address": "fa:16:3e:41:dd:5a", "network": {"id": "aa827f81-b165-444f-89cc-f21c42a9f772", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1659902586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e375153f6f24827811c5825fc2a2c6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82848227-6c", "ovs_interfaceid": "82848227-6c16-405c-a0ba-348c210787ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:18:27 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:18:27 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:18:27 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:18:27 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Auditing locally available compute resources for user (node: user) {{(pid=74190) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 12:18:27 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Releasing lock "refresh_cache-254d3af1-7a43-43d6-b0fa-ddb7fc3dac74" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:18:27 user nova-compute[74190]: DEBUG nova.compute.manager [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74] Instance network_info: |[{"id": "82848227-6c16-405c-a0ba-348c210787ef", "address": "fa:16:3e:41:dd:5a", "network": {"id": "aa827f81-b165-444f-89cc-f21c42a9f772", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1659902586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e375153f6f24827811c5825fc2a2c6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82848227-6c", "ovs_interfaceid": "82848227-6c16-405c-a0ba-348c210787ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 12:18:27 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-b1fd3842-d6a5-4a0a-a3f7-ca1a495c3a52 req-396e9c43-36f2-4465-b1c5-04c88fbf0991 service nova] Acquired lock "refresh_cache-254d3af1-7a43-43d6-b0fa-ddb7fc3dac74" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:18:27 user nova-compute[74190]: DEBUG nova.network.neutron [req-b1fd3842-d6a5-4a0a-a3f7-ca1a495c3a52 req-396e9c43-36f2-4465-b1c5-04c88fbf0991 service nova] [instance: 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74] Refreshing network info cache for port 82848227-6c16-405c-a0ba-348c210787ef {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 12:18:27 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7983ceaf-8ed3-4321-a242-2e44218f4d0b/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:18:27 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7983ceaf-8ed3-4321-a242-2e44218f4d0b/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:18:27 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7983ceaf-8ed3-4321-a242-2e44218f4d0b/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:18:27 user nova-compute[74190]: DEBUG nova.network.neutron [req-b1fd3842-d6a5-4a0a-a3f7-ca1a495c3a52 req-396e9c43-36f2-4465-b1c5-04c88fbf0991 service nova] [instance: 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74] Updated VIF entry in instance network info cache for port 82848227-6c16-405c-a0ba-348c210787ef. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 12:18:27 user nova-compute[74190]: DEBUG nova.network.neutron [req-b1fd3842-d6a5-4a0a-a3f7-ca1a495c3a52 req-396e9c43-36f2-4465-b1c5-04c88fbf0991 service nova] [instance: 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74] Updating instance_info_cache with network_info: [{"id": "82848227-6c16-405c-a0ba-348c210787ef", "address": "fa:16:3e:41:dd:5a", "network": {"id": "aa827f81-b165-444f-89cc-f21c42a9f772", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1659902586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e375153f6f24827811c5825fc2a2c6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82848227-6c", "ovs_interfaceid": "82848227-6c16-405c-a0ba-348c210787ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:18:27 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-b1fd3842-d6a5-4a0a-a3f7-ca1a495c3a52 req-396e9c43-36f2-4465-b1c5-04c88fbf0991 service nova] Releasing lock "refresh_cache-254d3af1-7a43-43d6-b0fa-ddb7fc3dac74" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:18:27 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7983ceaf-8ed3-4321-a242-2e44218f4d0b/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:18:27 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:18:27 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:18:27 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Hypervisor/Node resource view: name=user free_ram=8755MB free_disk=25.22243881225586GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74190) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 12:18:27 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:18:27 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:18:28 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 7983ceaf-8ed3-4321-a242-2e44218f4d0b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:18:28 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:18:28 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 12:18:28 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 12:18:28 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Refreshing inventories for resource provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 18 12:18:28 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Updating ProviderTree inventory for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 18 12:18:28 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Updating inventory in ProviderTree for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 18 12:18:28 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Refreshing aggregate associations for resource provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66, aggregates: None {{(pid=74190) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 18 12:18:28 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Refreshing trait associations for resource provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66, traits: COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE42,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_ACCELERATORS,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=74190) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 18 12:18:28 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 12:18:28 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 12:18:28 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Compute_service record updated for user:user {{(pid=74190) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 12:18:28 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.388s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:18:30 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:18:30 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:18:30 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:18:30 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74190) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 12:18:31 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:18:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:18:41 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:18:41 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:18:41 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74190) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 12:18:41 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:18:41 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:18:41 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:18:41 user nova-compute[74190]: DEBUG nova.compute.manager [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74] Start spawning the instance on the hypervisor. {{(pid=74190) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 12:18:41 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74] Creating instance directory {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 12:18:41 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74] Creating image(s)
Oct 18 12:18:41 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74] Did not create local disks {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 18 12:18:41 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74] Ensure instance console log exists: /opt/stack/data/nova/instances/254d3af1-7a43-43d6-b0fa-ddb7fc3dac74/console.log {{(pid=74190) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 12:18:41 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:18:41 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:18:41 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:18:41 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74] Start _get_guest_xml network_info=[{"id": "82848227-6c16-405c-a0ba-348c210787ef", "address": "fa:16:3e:41:dd:5a", "network": {"id": "aa827f81-b165-444f-89cc-f21c42a9f772", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1659902586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e375153f6f24827811c5825fc2a2c6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82848227-6c", "ovs_interfaceid": "82848227-6c16-405c-a0ba-348c210787ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eDJgkSRx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '254d3af1-7a43-43d6-b0fa-ddb7fc3dac74', 'attached_at': '', 'detached_at': '', 'volume_id': '83ff0b09-1a99-460d-94d4-df24e2880d18', 'serial': '83ff0b09-1a99-460d-94d4-df24e2880d18'}, 'delete_on_termination': False, 'guest_format': None, 'attachment_id': 'ab8a2048-4f5a-40be-a022-d4a198da5fb9', 'volume_type': None} {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 12:18:41 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:18:41 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:18:41 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 12:18:41 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] CPU controller missing on host. {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 12:18:41 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 12:18:41 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] CPU controller found on host. {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 12:18:41 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74190) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 12:18:41 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T11:37:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 12:18:41 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Flavor limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 12:18:41 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Image limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 12:18:41 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Flavor pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 12:18:41 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Image pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 12:18:41 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 12:18:41 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 12:18:41 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 12:18:41 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Got 1 possible topologies {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 12:18:41 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 12:18:41 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 12:18:41 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74] Calling os-brick to attach iSCSI Volume {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 12:18:41 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eDJgkSRx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 12:18:41 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 12:18:41 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 12:18:41 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 12:18:41 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 12:18:41 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 12:18:41 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 12:18:41 user nova-compute[74190]: INFO os_brick.initiator.connectors.iscsi [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 12:18:41 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18 -p 172.16.0.220:3260 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:18:41 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:18:41 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda598b6-eb1e-446a-a278-12eb1f3bf518]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:18:41 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 12:18:41 user nova-compute[74190]:  {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:18:41 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18 -p 172.16.0.220:3260 --interface default --op new {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:18:41 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:18:41 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea971f26-0431-4eb7-9e0b-29c7f1c957c6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18] added\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:18:41 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18] added
Oct 18 12:18:41 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:18:41 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:18:41 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:18:41 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fbda71e-f354-4e15-aee0-2eda47ca7bc9]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:18:41 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:18:41 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:18:41 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.036s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:18:41 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[98415a68-0684-4010-8b38-feee540a6eb3]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:18:41 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:18:41 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eDJgkSRx {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:18:41 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eDJgkSRx" returned: 0 in 0.025s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:18:41 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[914276c1-41db-4df4-ac70-d1b15de4fe9c]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:18:41 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eDJgkSRx'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:18:41 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:18:41 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:18:41 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[f48c98a9-8f38-4b9e-aa29-ba99f4bdbff0]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:18:41 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:18:41 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:18:41 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:18:41 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cad9f14-bfe8-4fd4-b78f-79ba7917f80a]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:18:41 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 18 12:18:41 user nova-compute[74190]:  {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 12:18:41 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 18 12:18:41 user nova-compute[74190]:  {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 12:18:41 user nova-compute[74190]: WARNING os_brick.initiator.connectors.iscsi [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 18 12:18:41 user nova-compute[74190]: 
Oct 18 12:18:41 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18 -p 172.16.0.220:3260 --login {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:18:41 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:18:41 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2601b90-0e13-401a-8578-f1c46c0c26ba]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:18:41 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18, portal: 172.16.0.220,3260]
Oct 18 12:18:41 user nova-compute[74190]: Login to [iface: default, target: iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18, portal: 172.16.0.220,3260] successful.
Oct 18 12:18:41 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:18:41 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:18:41 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:18:41 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c9de93d-f734-4010-a096-1352c6095611]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:18:41 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:18:41 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:18:41 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:18:41 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee76e321-5f8c-49ab-90fd-af41bea36860]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18 (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:18:41 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18 (non-flash)
Oct 18 12:18:41 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 12:18:41 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18 (non-flash)
Oct 18 12:18:41 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 12:18:41 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 12:18:41 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Connected to 172.16.0.220:3260 {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 12:18:41 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=74190) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 12:18:41 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74190) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 12:18:41 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:18:41 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:18:41 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[f91c8d1d-5fbd-4860-894d-ebcd1de37a5c]: (4, ('- - 0', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:18:41 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74190) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 12:18:41 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eDJgkSRx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 12:18:42 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 12:18:42 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23034663733663537', 'path': '/dev/sdb'} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 12:18:42 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23034663733663537', 'path': '/dev/sdb'} {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 12:18:42 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T12:18:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1596601119',display_name='tempest-TestVolumeBootPattern-server-1596601119',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1596601119',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFImDkcHIZVVsD1gB2Yh4JGNE0pEbAN8TUjpItUrbhxdmYRzrbNlPip8qPxIcvk8OJEen8xQaAGxdqzAZ1w6kqPbscsnuFtwOBrKfpec5lSOkFKoHZaLFZ1ci5kqBfXOJw==',key_name='tempest-TestVolumeBootPattern-131084726',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e375153f6f24827811c5825fc2a2c6a',ramdisk_id='',reservation_id='r-raxamz8u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1157442382',owner_user_name='tempest-TestVolumeBootPattern-1157442382-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T12:18:24Z,user_data=None,user_id='27d9fc244d0f4e10a43b7df4dc8e30ad',uuid=254d3af1-7a43-43d6-b0fa-ddb7fc3dac74,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "82848227-6c16-405c-a0ba-348c210787ef", "address": "fa:16:3e:41:dd:5a", "network": {"id": "aa827f81-b165-444f-89cc-f21c42a9f772", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1659902586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e375153f6f24827811c5825fc2a2c6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82848227-6c", "ovs_interfaceid": "82848227-6c16-405c-a0ba-348c210787ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74190) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 12:18:42 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Converting VIF {"id": "82848227-6c16-405c-a0ba-348c210787ef", "address": "fa:16:3e:41:dd:5a", "network": {"id": "aa827f81-b165-444f-89cc-f21c42a9f772", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1659902586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e375153f6f24827811c5825fc2a2c6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82848227-6c", "ovs_interfaceid": "82848227-6c16-405c-a0ba-348c210787ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 12:18:42 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:dd:5a,bridge_name='br-int',has_traffic_filtering=True,id=82848227-6c16-405c-a0ba-348c210787ef,network=Network(aa827f81-b165-444f-89cc-f21c42a9f772),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82848227-6c') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 12:18:42 user nova-compute[74190]: DEBUG nova.objects.instance [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lazy-loading 'pci_devices' on Instance uuid 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:18:42 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74] End _get_guest_xml xml=<domain type="kvm">
Oct 18 12:18:42 user nova-compute[74190]:   <uuid>254d3af1-7a43-43d6-b0fa-ddb7fc3dac74</uuid>
Oct 18 12:18:42 user nova-compute[74190]:   <name>instance-00000030</name>
Oct 18 12:18:42 user nova-compute[74190]:   <memory>524288</memory>
Oct 18 12:18:42 user nova-compute[74190]:   <vcpu>1</vcpu>
Oct 18 12:18:42 user nova-compute[74190]:   <metadata>
Oct 18 12:18:42 user nova-compute[74190]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 12:18:42 user nova-compute[74190]:       <nova:package version="0.0.0"/>
Oct 18 12:18:42 user nova-compute[74190]:       <nova:name>tempest-TestVolumeBootPattern-server-1596601119</nova:name>
Oct 18 12:18:42 user nova-compute[74190]:       <nova:creationTime>2023-10-18 12:18:41</nova:creationTime>
Oct 18 12:18:42 user nova-compute[74190]:       <nova:flavor name="m1.tiny">
Oct 18 12:18:42 user nova-compute[74190]:         <nova:memory>512</nova:memory>
Oct 18 12:18:42 user nova-compute[74190]:         <nova:disk>1</nova:disk>
Oct 18 12:18:42 user nova-compute[74190]:         <nova:swap>0</nova:swap>
Oct 18 12:18:42 user nova-compute[74190]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 12:18:42 user nova-compute[74190]:         <nova:vcpus>1</nova:vcpus>
Oct 18 12:18:42 user nova-compute[74190]:       </nova:flavor>
Oct 18 12:18:42 user nova-compute[74190]:       <nova:owner>
Oct 18 12:18:42 user nova-compute[74190]:         <nova:user uuid="27d9fc244d0f4e10a43b7df4dc8e30ad">tempest-TestVolumeBootPattern-1157442382-project-member</nova:user>
Oct 18 12:18:42 user nova-compute[74190]:         <nova:project uuid="1e375153f6f24827811c5825fc2a2c6a">tempest-TestVolumeBootPattern-1157442382</nova:project>
Oct 18 12:18:42 user nova-compute[74190]:       </nova:owner>
Oct 18 12:18:42 user nova-compute[74190]:       <nova:ports>
Oct 18 12:18:42 user nova-compute[74190]:         <nova:port uuid="82848227-6c16-405c-a0ba-348c210787ef">
Oct 18 12:18:42 user nova-compute[74190]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 18 12:18:42 user nova-compute[74190]:         </nova:port>
Oct 18 12:18:42 user nova-compute[74190]:       </nova:ports>
Oct 18 12:18:42 user nova-compute[74190]:     </nova:instance>
Oct 18 12:18:42 user nova-compute[74190]:   </metadata>
Oct 18 12:18:42 user nova-compute[74190]:   <sysinfo type="smbios">
Oct 18 12:18:42 user nova-compute[74190]:     <system>
Oct 18 12:18:42 user nova-compute[74190]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 12:18:42 user nova-compute[74190]:       <entry name="product">OpenStack Nova</entry>
Oct 18 12:18:42 user nova-compute[74190]:       <entry name="version">0.0.0</entry>
Oct 18 12:18:42 user nova-compute[74190]:       <entry name="serial">254d3af1-7a43-43d6-b0fa-ddb7fc3dac74</entry>
Oct 18 12:18:42 user nova-compute[74190]:       <entry name="uuid">254d3af1-7a43-43d6-b0fa-ddb7fc3dac74</entry>
Oct 18 12:18:42 user nova-compute[74190]:       <entry name="family">Virtual Machine</entry>
Oct 18 12:18:42 user nova-compute[74190]:     </system>
Oct 18 12:18:42 user nova-compute[74190]:   </sysinfo>
Oct 18 12:18:42 user nova-compute[74190]:   <os>
Oct 18 12:18:42 user nova-compute[74190]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 12:18:42 user nova-compute[74190]:     <boot dev="hd"/>
Oct 18 12:18:42 user nova-compute[74190]:     <smbios mode="sysinfo"/>
Oct 18 12:18:42 user nova-compute[74190]:   </os>
Oct 18 12:18:42 user nova-compute[74190]:   <features>
Oct 18 12:18:42 user nova-compute[74190]:     <acpi/>
Oct 18 12:18:42 user nova-compute[74190]:     <apic/>
Oct 18 12:18:42 user nova-compute[74190]:     <vmcoreinfo/>
Oct 18 12:18:42 user nova-compute[74190]:   </features>
Oct 18 12:18:42 user nova-compute[74190]:   <clock offset="utc">
Oct 18 12:18:42 user nova-compute[74190]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 12:18:42 user nova-compute[74190]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 12:18:42 user nova-compute[74190]:     <timer name="hpet" present="no"/>
Oct 18 12:18:42 user nova-compute[74190]:   </clock>
Oct 18 12:18:42 user nova-compute[74190]:   <cpu mode="custom" match="exact">
Oct 18 12:18:42 user nova-compute[74190]:     <model>Nehalem</model>
Oct 18 12:18:42 user nova-compute[74190]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 12:18:42 user nova-compute[74190]:   </cpu>
Oct 18 12:18:42 user nova-compute[74190]:   <devices>
Oct 18 12:18:42 user nova-compute[74190]:     <disk type="block" device="disk">
Oct 18 12:18:42 user nova-compute[74190]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 12:18:42 user nova-compute[74190]:       <source dev="/dev/sdb"/>
Oct 18 12:18:42 user nova-compute[74190]:       <target dev="vda" bus="virtio"/>
Oct 18 12:18:42 user nova-compute[74190]:       <serial>83ff0b09-1a99-460d-94d4-df24e2880d18</serial>
Oct 18 12:18:42 user nova-compute[74190]:     </disk>
Oct 18 12:18:42 user nova-compute[74190]:     <interface type="ethernet">
Oct 18 12:18:42 user nova-compute[74190]:       <mac address="fa:16:3e:41:dd:5a"/>
Oct 18 12:18:42 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 12:18:42 user nova-compute[74190]:       <mtu size="1442"/>
Oct 18 12:18:42 user nova-compute[74190]:       <target dev="tap82848227-6c"/>
Oct 18 12:18:42 user nova-compute[74190]:     </interface>
Oct 18 12:18:42 user nova-compute[74190]:     <serial type="pty">
Oct 18 12:18:42 user nova-compute[74190]:       <log file="/opt/stack/data/nova/instances/254d3af1-7a43-43d6-b0fa-ddb7fc3dac74/console.log" append="off"/>
Oct 18 12:18:42 user nova-compute[74190]:     </serial>
Oct 18 12:18:42 user nova-compute[74190]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 12:18:42 user nova-compute[74190]:     <video>
Oct 18 12:18:42 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 12:18:42 user nova-compute[74190]:     </video>
Oct 18 12:18:42 user nova-compute[74190]:     <rng model="virtio">
Oct 18 12:18:42 user nova-compute[74190]:       <backend model="random">/dev/urandom</backend>
Oct 18 12:18:42 user nova-compute[74190]:     </rng>
Oct 18 12:18:42 user nova-compute[74190]:     <controller type="usb" index="0" model="none"/>
Oct 18 12:18:42 user nova-compute[74190]:     <memballoon model="virtio">
Oct 18 12:18:42 user nova-compute[74190]:       <stats period="10"/>
Oct 18 12:18:42 user nova-compute[74190]:     </memballoon>
Oct 18 12:18:42 user nova-compute[74190]:   </devices>
Oct 18 12:18:42 user nova-compute[74190]: </domain>
Oct 18 12:18:42 user nova-compute[74190]:  {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 12:18:42 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T12:18:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1596601119',display_name='tempest-TestVolumeBootPattern-server-1596601119',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1596601119',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFImDkcHIZVVsD1gB2Yh4JGNE0pEbAN8TUjpItUrbhxdmYRzrbNlPip8qPxIcvk8OJEen8xQaAGxdqzAZ1w6kqPbscsnuFtwOBrKfpec5lSOkFKoHZaLFZ1ci5kqBfXOJw==',key_name='tempest-TestVolumeBootPattern-131084726',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e375153f6f24827811c5825fc2a2c6a',ramdisk_id='',reservation_id='r-raxamz8u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1157442382',owner_user_name='tempest-TestVolumeBootPattern-1157442382-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T12:18:24Z,user_data=None,user_id='27d9fc244d0f4e10a43b7df4dc8e30ad',uuid=254d3af1-7a43-43d6-b0fa-ddb7fc3dac74,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "82848227-6c16-405c-a0ba-348c210787ef", "address": "fa:16:3e:41:dd:5a", "network": {"id": "aa827f81-b165-444f-89cc-f21c42a9f772", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1659902586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e375153f6f24827811c5825fc2a2c6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82848227-6c", "ovs_interfaceid": "82848227-6c16-405c-a0ba-348c210787ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 12:18:42 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Converting VIF {"id": "82848227-6c16-405c-a0ba-348c210787ef", "address": "fa:16:3e:41:dd:5a", "network": {"id": "aa827f81-b165-444f-89cc-f21c42a9f772", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1659902586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e375153f6f24827811c5825fc2a2c6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82848227-6c", "ovs_interfaceid": "82848227-6c16-405c-a0ba-348c210787ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 12:18:42 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:dd:5a,bridge_name='br-int',has_traffic_filtering=True,id=82848227-6c16-405c-a0ba-348c210787ef,network=Network(aa827f81-b165-444f-89cc-f21c42a9f772),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82848227-6c') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 12:18:42 user nova-compute[74190]: DEBUG os_vif [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:dd:5a,bridge_name='br-int',has_traffic_filtering=True,id=82848227-6c16-405c-a0ba-348c210787ef,network=Network(aa827f81-b165-444f-89cc-f21c42a9f772),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82848227-6c') {{(pid=74190) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 12:18:42 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:18:42 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:18:42 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 12:18:42 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:18:42 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c26db1b1-8750-5949-b3bf-53f89dbbe473', '_type': 'linux-noop'}}, row=False) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:18:42 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:18:42 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:18:42 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:18:42 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap82848227-6c, may_exist=True, interface_attrs={}) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:18:42 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap82848227-6c, col_values=(('qos', UUID('1d8477de-9fcb-4127-b094-ce698568f6db')),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:18:42 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap82848227-6c, col_values=(('external_ids', {'iface-id': '82848227-6c16-405c-a0ba-348c210787ef', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:dd:5a', 'vm-uuid': '254d3af1-7a43-43d6-b0fa-ddb7fc3dac74'}),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:18:42 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:18:42 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:18:42 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:18:42 user nova-compute[74190]: INFO os_vif [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:dd:5a,bridge_name='br-int',has_traffic_filtering=True,id=82848227-6c16-405c-a0ba-348c210787ef,network=Network(aa827f81-b165-444f-89cc-f21c42a9f772),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82848227-6c')
Oct 18 12:18:42 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] No BDM found with device name vda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 12:18:42 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] No VIF found with MAC fa:16:3e:41:dd:5a, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 12:18:43 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:18:44 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:18:44 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:18:44 user nova-compute[74190]: DEBUG nova.compute.manager [req-06756d19-9dce-4211-ae03-32ee32fa08e1 req-de2fdf48-96d7-4686-b3b7-14b8afb313c7 service nova] [instance: 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74] Received event network-vif-plugged-82848227-6c16-405c-a0ba-348c210787ef {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:18:44 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-06756d19-9dce-4211-ae03-32ee32fa08e1 req-de2fdf48-96d7-4686-b3b7-14b8afb313c7 service nova] Acquiring lock "254d3af1-7a43-43d6-b0fa-ddb7fc3dac74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:18:44 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-06756d19-9dce-4211-ae03-32ee32fa08e1 req-de2fdf48-96d7-4686-b3b7-14b8afb313c7 service nova] Lock "254d3af1-7a43-43d6-b0fa-ddb7fc3dac74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:18:44 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-06756d19-9dce-4211-ae03-32ee32fa08e1 req-de2fdf48-96d7-4686-b3b7-14b8afb313c7 service nova] Lock "254d3af1-7a43-43d6-b0fa-ddb7fc3dac74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:18:44 user nova-compute[74190]: DEBUG nova.compute.manager [req-06756d19-9dce-4211-ae03-32ee32fa08e1 req-de2fdf48-96d7-4686-b3b7-14b8afb313c7 service nova] [instance: 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74] No waiting events found dispatching network-vif-plugged-82848227-6c16-405c-a0ba-348c210787ef {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:18:44 user nova-compute[74190]: WARNING nova.compute.manager [req-06756d19-9dce-4211-ae03-32ee32fa08e1 req-de2fdf48-96d7-4686-b3b7-14b8afb313c7 service nova] [instance: 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74] Received unexpected event network-vif-plugged-82848227-6c16-405c-a0ba-348c210787ef for instance with vm_state building and task_state spawning.
Oct 18 12:18:44 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:18:44 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:18:44 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:18:44 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:18:44 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:18:45 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:18:46 user nova-compute[74190]: DEBUG nova.compute.manager [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74] Instance event wait completed in 0 seconds for  {{(pid=74190) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 12:18:46 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74] Guest created on hypervisor {{(pid=74190) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 12:18:46 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74] Instance spawned successfully.
Oct 18 12:18:46 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 12:18:46 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74] Found default for hw_cdrom_bus of ide {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:18:46 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74] Found default for hw_disk_bus of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:18:46 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74] Found default for hw_input_bus of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:18:46 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74] Found default for hw_pointer_model of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:18:46 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74] Found default for hw_video_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:18:46 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74] Found default for hw_vif_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:18:46 user nova-compute[74190]: DEBUG nova.compute.manager [req-33ae969d-356c-4eec-a26b-de2fb9311ee4 req-5a3f8a74-579d-4a00-bca0-7e4587aca330 service nova] [instance: 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74] Received event network-vif-plugged-82848227-6c16-405c-a0ba-348c210787ef {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:18:46 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-33ae969d-356c-4eec-a26b-de2fb9311ee4 req-5a3f8a74-579d-4a00-bca0-7e4587aca330 service nova] Acquiring lock "254d3af1-7a43-43d6-b0fa-ddb7fc3dac74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:18:46 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-33ae969d-356c-4eec-a26b-de2fb9311ee4 req-5a3f8a74-579d-4a00-bca0-7e4587aca330 service nova] Lock "254d3af1-7a43-43d6-b0fa-ddb7fc3dac74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:18:46 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-33ae969d-356c-4eec-a26b-de2fb9311ee4 req-5a3f8a74-579d-4a00-bca0-7e4587aca330 service nova] Lock "254d3af1-7a43-43d6-b0fa-ddb7fc3dac74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:18:46 user nova-compute[74190]: DEBUG nova.compute.manager [req-33ae969d-356c-4eec-a26b-de2fb9311ee4 req-5a3f8a74-579d-4a00-bca0-7e4587aca330 service nova] [instance: 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74] No waiting events found dispatching network-vif-plugged-82848227-6c16-405c-a0ba-348c210787ef {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:18:46 user nova-compute[74190]: WARNING nova.compute.manager [req-33ae969d-356c-4eec-a26b-de2fb9311ee4 req-5a3f8a74-579d-4a00-bca0-7e4587aca330 service nova] [instance: 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74] Received unexpected event network-vif-plugged-82848227-6c16-405c-a0ba-348c210787ef for instance with vm_state building and task_state spawning.
Oct 18 12:18:46 user nova-compute[74190]: INFO nova.compute.manager [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74] Took 5.31 seconds to spawn the instance on the hypervisor.
Oct 18 12:18:46 user nova-compute[74190]: DEBUG nova.compute.manager [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74] Checking state {{(pid=74190) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 12:18:46 user nova-compute[74190]: INFO nova.compute.manager [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74] Took 22.75 seconds to build instance.
Oct 18 12:18:46 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-343fb0c5-7f29-4c05-bc34-bca1bd27cbc6 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "254d3af1-7a43-43d6-b0fa-ddb7fc3dac74" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.913s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:18:47 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:18:50 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:18:51 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-2c9c96ed-f1d1-437a-92b5-fbdd33f20111 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Acquiring lock "ebe4e4fe-9614-4065-b84e-a08a50f638b1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:18:51 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-2c9c96ed-f1d1-437a-92b5-fbdd33f20111 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Lock "ebe4e4fe-9614-4065-b84e-a08a50f638b1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:18:51 user nova-compute[74190]: DEBUG nova.compute.manager [None req-2c9c96ed-f1d1-437a-92b5-fbdd33f20111 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: ebe4e4fe-9614-4065-b84e-a08a50f638b1] Starting instance... {{(pid=74190) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 12:18:51 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-2c9c96ed-f1d1-437a-92b5-fbdd33f20111 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:18:51 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-2c9c96ed-f1d1-437a-92b5-fbdd33f20111 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:18:51 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-2c9c96ed-f1d1-437a-92b5-fbdd33f20111 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74190) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 12:18:51 user nova-compute[74190]: INFO nova.compute.claims [None req-2c9c96ed-f1d1-437a-92b5-fbdd33f20111 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: ebe4e4fe-9614-4065-b84e-a08a50f638b1] Claim successful on node user
Oct 18 12:18:51 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-2c9c96ed-f1d1-437a-92b5-fbdd33f20111 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 12:18:51 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-2c9c96ed-f1d1-437a-92b5-fbdd33f20111 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 12:18:51 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-2c9c96ed-f1d1-437a-92b5-fbdd33f20111 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.244s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:18:51 user nova-compute[74190]: DEBUG nova.compute.manager [None req-2c9c96ed-f1d1-437a-92b5-fbdd33f20111 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: ebe4e4fe-9614-4065-b84e-a08a50f638b1] Start building networks asynchronously for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 12:18:51 user nova-compute[74190]: DEBUG nova.compute.manager [None req-2c9c96ed-f1d1-437a-92b5-fbdd33f20111 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: ebe4e4fe-9614-4065-b84e-a08a50f638b1] Allocating IP information in the background. {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 12:18:51 user nova-compute[74190]: DEBUG nova.network.neutron [None req-2c9c96ed-f1d1-437a-92b5-fbdd33f20111 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: ebe4e4fe-9614-4065-b84e-a08a50f638b1] allocate_for_instance() {{(pid=74190) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 12:18:51 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-2c9c96ed-f1d1-437a-92b5-fbdd33f20111 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: ebe4e4fe-9614-4065-b84e-a08a50f638b1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 12:18:51 user nova-compute[74190]: DEBUG nova.compute.manager [None req-2c9c96ed-f1d1-437a-92b5-fbdd33f20111 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: ebe4e4fe-9614-4065-b84e-a08a50f638b1] Start building block device mappings for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 12:18:51 user nova-compute[74190]: DEBUG nova.compute.manager [None req-2c9c96ed-f1d1-437a-92b5-fbdd33f20111 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: ebe4e4fe-9614-4065-b84e-a08a50f638b1] Start spawning the instance on the hypervisor. {{(pid=74190) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 12:18:51 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-2c9c96ed-f1d1-437a-92b5-fbdd33f20111 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: ebe4e4fe-9614-4065-b84e-a08a50f638b1] Creating instance directory {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 12:18:51 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-2c9c96ed-f1d1-437a-92b5-fbdd33f20111 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: ebe4e4fe-9614-4065-b84e-a08a50f638b1] Creating image(s)
Oct 18 12:18:51 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-2c9c96ed-f1d1-437a-92b5-fbdd33f20111 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Acquiring lock "/opt/stack/data/nova/instances/ebe4e4fe-9614-4065-b84e-a08a50f638b1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:18:51 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-2c9c96ed-f1d1-437a-92b5-fbdd33f20111 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Lock "/opt/stack/data/nova/instances/ebe4e4fe-9614-4065-b84e-a08a50f638b1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:18:51 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-2c9c96ed-f1d1-437a-92b5-fbdd33f20111 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Lock "/opt/stack/data/nova/instances/ebe4e4fe-9614-4065-b84e-a08a50f638b1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:18:51 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-2c9c96ed-f1d1-437a-92b5-fbdd33f20111 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:18:51 user nova-compute[74190]: DEBUG nova.policy [None req-2c9c96ed-f1d1-437a-92b5-fbdd33f20111 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f2c022bbeb1941fe89964cd372f651f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e49c9e381b0457faa31d0f5bdfa3f18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74190) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 12:18:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-2c9c96ed-f1d1-437a-92b5-fbdd33f20111 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.178s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:18:52 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-2c9c96ed-f1d1-437a-92b5-fbdd33f20111 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Acquiring lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:18:52 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-2c9c96ed-f1d1-437a-92b5-fbdd33f20111 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:18:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-2c9c96ed-f1d1-437a-92b5-fbdd33f20111 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:18:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-2c9c96ed-f1d1-437a-92b5-fbdd33f20111 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.207s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:18:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-2c9c96ed-f1d1-437a-92b5-fbdd33f20111 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f,backing_fmt=raw /opt/stack/data/nova/instances/ebe4e4fe-9614-4065-b84e-a08a50f638b1/disk 1073741824 {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:18:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-2c9c96ed-f1d1-437a-92b5-fbdd33f20111 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f,backing_fmt=raw /opt/stack/data/nova/instances/ebe4e4fe-9614-4065-b84e-a08a50f638b1/disk 1073741824" returned: 0 in 0.074s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:18:52 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-2c9c96ed-f1d1-437a-92b5-fbdd33f20111 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Lock "b36d8c17bcdbd6d774c823d09c55aff727a41c5f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.288s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:18:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-2c9c96ed-f1d1-437a-92b5-fbdd33f20111 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:18:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-2c9c96ed-f1d1-437a-92b5-fbdd33f20111 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b36d8c17bcdbd6d774c823d09c55aff727a41c5f --force-share --output=json" returned: 0 in 0.187s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:18:52 user nova-compute[74190]: DEBUG nova.virt.disk.api [None req-2c9c96ed-f1d1-437a-92b5-fbdd33f20111 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ebe4e4fe-9614-4065-b84e-a08a50f638b1/disk. size=1073741824 {{(pid=74190) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 18 12:18:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-2c9c96ed-f1d1-437a-92b5-fbdd33f20111 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebe4e4fe-9614-4065-b84e-a08a50f638b1/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:18:52 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:18:52 user nova-compute[74190]: DEBUG nova.network.neutron [None req-2c9c96ed-f1d1-437a-92b5-fbdd33f20111 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: ebe4e4fe-9614-4065-b84e-a08a50f638b1] Successfully created port: b764c6cd-7473-45e0-acac-9c20fc355d2e {{(pid=74190) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 12:18:52 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-2c9c96ed-f1d1-437a-92b5-fbdd33f20111 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebe4e4fe-9614-4065-b84e-a08a50f638b1/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:18:52 user nova-compute[74190]: DEBUG nova.virt.disk.api [None req-2c9c96ed-f1d1-437a-92b5-fbdd33f20111 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Cannot resize image /opt/stack/data/nova/instances/ebe4e4fe-9614-4065-b84e-a08a50f638b1/disk to a smaller size. {{(pid=74190) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 18 12:18:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-2c9c96ed-f1d1-437a-92b5-fbdd33f20111 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: ebe4e4fe-9614-4065-b84e-a08a50f638b1] Created local disks {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 12:18:52 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-2c9c96ed-f1d1-437a-92b5-fbdd33f20111 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: ebe4e4fe-9614-4065-b84e-a08a50f638b1] Ensure instance console log exists: /opt/stack/data/nova/instances/ebe4e4fe-9614-4065-b84e-a08a50f638b1/console.log {{(pid=74190) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 12:18:52 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-2c9c96ed-f1d1-437a-92b5-fbdd33f20111 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:18:52 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-2c9c96ed-f1d1-437a-92b5-fbdd33f20111 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:18:52 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-2c9c96ed-f1d1-437a-92b5-fbdd33f20111 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:18:53 user nova-compute[74190]: DEBUG nova.network.neutron [None req-2c9c96ed-f1d1-437a-92b5-fbdd33f20111 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: ebe4e4fe-9614-4065-b84e-a08a50f638b1] Successfully updated port: b764c6cd-7473-45e0-acac-9c20fc355d2e {{(pid=74190) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 12:18:53 user nova-compute[74190]: DEBUG nova.compute.manager [req-f4682327-6090-429f-8c82-6026ee5e6c4c req-7893a37c-5b91-4b32-a5a4-5f9501aab3ee service nova] [instance: ebe4e4fe-9614-4065-b84e-a08a50f638b1] Received event network-changed-b764c6cd-7473-45e0-acac-9c20fc355d2e {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:18:53 user nova-compute[74190]: DEBUG nova.compute.manager [req-f4682327-6090-429f-8c82-6026ee5e6c4c req-7893a37c-5b91-4b32-a5a4-5f9501aab3ee service nova] [instance: ebe4e4fe-9614-4065-b84e-a08a50f638b1] Refreshing instance network info cache due to event network-changed-b764c6cd-7473-45e0-acac-9c20fc355d2e. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 12:18:53 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-f4682327-6090-429f-8c82-6026ee5e6c4c req-7893a37c-5b91-4b32-a5a4-5f9501aab3ee service nova] Acquiring lock "refresh_cache-ebe4e4fe-9614-4065-b84e-a08a50f638b1" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:18:53 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-f4682327-6090-429f-8c82-6026ee5e6c4c req-7893a37c-5b91-4b32-a5a4-5f9501aab3ee service nova] Acquired lock "refresh_cache-ebe4e4fe-9614-4065-b84e-a08a50f638b1" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:18:53 user nova-compute[74190]: DEBUG nova.network.neutron [req-f4682327-6090-429f-8c82-6026ee5e6c4c req-7893a37c-5b91-4b32-a5a4-5f9501aab3ee service nova] [instance: ebe4e4fe-9614-4065-b84e-a08a50f638b1] Refreshing network info cache for port b764c6cd-7473-45e0-acac-9c20fc355d2e {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 12:18:53 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-2c9c96ed-f1d1-437a-92b5-fbdd33f20111 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Acquiring lock "refresh_cache-ebe4e4fe-9614-4065-b84e-a08a50f638b1" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:18:53 user nova-compute[74190]: DEBUG nova.network.neutron [req-f4682327-6090-429f-8c82-6026ee5e6c4c req-7893a37c-5b91-4b32-a5a4-5f9501aab3ee service nova] [instance: ebe4e4fe-9614-4065-b84e-a08a50f638b1] Instance cache missing network info. {{(pid=74190) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 12:18:53 user nova-compute[74190]: DEBUG nova.network.neutron [req-f4682327-6090-429f-8c82-6026ee5e6c4c req-7893a37c-5b91-4b32-a5a4-5f9501aab3ee service nova] [instance: ebe4e4fe-9614-4065-b84e-a08a50f638b1] Updating instance_info_cache with network_info: [] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:18:53 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-f4682327-6090-429f-8c82-6026ee5e6c4c req-7893a37c-5b91-4b32-a5a4-5f9501aab3ee service nova] Releasing lock "refresh_cache-ebe4e4fe-9614-4065-b84e-a08a50f638b1" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:18:53 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-2c9c96ed-f1d1-437a-92b5-fbdd33f20111 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Acquired lock "refresh_cache-ebe4e4fe-9614-4065-b84e-a08a50f638b1" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:18:53 user nova-compute[74190]: DEBUG nova.network.neutron [None req-2c9c96ed-f1d1-437a-92b5-fbdd33f20111 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: ebe4e4fe-9614-4065-b84e-a08a50f638b1] Building network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 12:18:53 user nova-compute[74190]: DEBUG nova.network.neutron [None req-2c9c96ed-f1d1-437a-92b5-fbdd33f20111 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: ebe4e4fe-9614-4065-b84e-a08a50f638b1] Instance cache missing network info. {{(pid=74190) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 12:18:53 user nova-compute[74190]: DEBUG nova.network.neutron [None req-2c9c96ed-f1d1-437a-92b5-fbdd33f20111 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: ebe4e4fe-9614-4065-b84e-a08a50f638b1] Updating instance_info_cache with network_info: [{"id": "b764c6cd-7473-45e0-acac-9c20fc355d2e", "address": "fa:16:3e:2e:61:70", "network": {"id": "1afc08fa-4518-4ccf-97a1-22f04820b31c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-687660220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e49c9e381b0457faa31d0f5bdfa3f18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb764c6cd-74", "ovs_interfaceid": "b764c6cd-7473-45e0-acac-9c20fc355d2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:18:53 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-2c9c96ed-f1d1-437a-92b5-fbdd33f20111 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Releasing lock "refresh_cache-ebe4e4fe-9614-4065-b84e-a08a50f638b1" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:18:53 user nova-compute[74190]: DEBUG nova.compute.manager [None req-2c9c96ed-f1d1-437a-92b5-fbdd33f20111 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: ebe4e4fe-9614-4065-b84e-a08a50f638b1] Instance network_info: |[{"id": "b764c6cd-7473-45e0-acac-9c20fc355d2e", "address": "fa:16:3e:2e:61:70", "network": {"id": "1afc08fa-4518-4ccf-97a1-22f04820b31c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-687660220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e49c9e381b0457faa31d0f5bdfa3f18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb764c6cd-74", "ovs_interfaceid": "b764c6cd-7473-45e0-acac-9c20fc355d2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 12:18:53 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-2c9c96ed-f1d1-437a-92b5-fbdd33f20111 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: ebe4e4fe-9614-4065-b84e-a08a50f638b1] Start _get_guest_xml network_info=[{"id": "b764c6cd-7473-45e0-acac-9c20fc355d2e", "address": "fa:16:3e:2e:61:70", "network": {"id": "1afc08fa-4518-4ccf-97a1-22f04820b31c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-687660220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e49c9e381b0457faa31d0f5bdfa3f18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb764c6cd-74", "ovs_interfaceid": "b764c6cd-7473-45e0-acac-9c20fc355d2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'image_id': '6e88bbf0-6e78-49a8-b3c5-9453d22a89df'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 12:18:53 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-2c9c96ed-f1d1-437a-92b5-fbdd33f20111 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:18:53 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-2c9c96ed-f1d1-437a-92b5-fbdd33f20111 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:18:53 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-2c9c96ed-f1d1-437a-92b5-fbdd33f20111 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 12:18:53 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-2c9c96ed-f1d1-437a-92b5-fbdd33f20111 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] CPU controller missing on host. {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 12:18:53 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-2c9c96ed-f1d1-437a-92b5-fbdd33f20111 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 12:18:53 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-2c9c96ed-f1d1-437a-92b5-fbdd33f20111 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] CPU controller found on host. {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 12:18:53 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-2c9c96ed-f1d1-437a-92b5-fbdd33f20111 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74190) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 12:18:53 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-2c9c96ed-f1d1-437a-92b5-fbdd33f20111 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T11:37:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T11:37:13Z,direct_url=<?>,disk_format='qcow2',id=6e88bbf0-6e78-49a8-b3c5-9453d22a89df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5b47e79bab9143e5acee2b7862cf2c49',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T11:37:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 12:18:53 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-2c9c96ed-f1d1-437a-92b5-fbdd33f20111 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Flavor limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 12:18:53 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-2c9c96ed-f1d1-437a-92b5-fbdd33f20111 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Image limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 12:18:53 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-2c9c96ed-f1d1-437a-92b5-fbdd33f20111 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Flavor pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 12:18:53 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-2c9c96ed-f1d1-437a-92b5-fbdd33f20111 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Image pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 12:18:53 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-2c9c96ed-f1d1-437a-92b5-fbdd33f20111 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 12:18:53 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-2c9c96ed-f1d1-437a-92b5-fbdd33f20111 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 12:18:53 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-2c9c96ed-f1d1-437a-92b5-fbdd33f20111 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 12:18:53 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-2c9c96ed-f1d1-437a-92b5-fbdd33f20111 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Got 1 possible topologies {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 12:18:53 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-2c9c96ed-f1d1-437a-92b5-fbdd33f20111 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 12:18:53 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-2c9c96ed-f1d1-437a-92b5-fbdd33f20111 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 12:18:53 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-2c9c96ed-f1d1-437a-92b5-fbdd33f20111 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T12:18:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1811332868',display_name='tempest-VolumesSnapshotTestJSON-instance-1811332868',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1811332868',id=49,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF9oc+bwOhZaWPzwzw2MSqa58dx+V8y/8IE25tznmLDmKbwWin7Qmx10naTsDHVWlybEUzFEdjOvAJdbI0TdeVxEDcTRIx41RZa2hFwgzKXPEPcyTlR4Xr22YnmmzE9L3g==',key_name='tempest-keypair-1543681740',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e49c9e381b0457faa31d0f5bdfa3f18',ramdisk_id='',reservation_id='r-124e5z6h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-252328076',owner_user_name='tempest-VolumesSnapshotTestJSON-252328076-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T12:18:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f2c022bbeb1941fe89964cd372f651f2',uuid=ebe4e4fe-9614-4065-b84e-a08a50f638b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b764c6cd-7473-45e0-acac-9c20fc355d2e", "address": "fa:16:3e:2e:61:70", "network": {"id": "1afc08fa-4518-4ccf-97a1-22f04820b31c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-687660220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e49c9e381b0457faa31d0f5bdfa3f18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb764c6cd-74", "ovs_interfaceid": "b764c6cd-7473-45e0-acac-9c20fc355d2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74190) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 12:18:53 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-2c9c96ed-f1d1-437a-92b5-fbdd33f20111 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Converting VIF {"id": "b764c6cd-7473-45e0-acac-9c20fc355d2e", "address": "fa:16:3e:2e:61:70", "network": {"id": "1afc08fa-4518-4ccf-97a1-22f04820b31c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-687660220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e49c9e381b0457faa31d0f5bdfa3f18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb764c6cd-74", "ovs_interfaceid": "b764c6cd-7473-45e0-acac-9c20fc355d2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 12:18:53 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-2c9c96ed-f1d1-437a-92b5-fbdd33f20111 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:61:70,bridge_name='br-int',has_traffic_filtering=True,id=b764c6cd-7473-45e0-acac-9c20fc355d2e,network=Network(1afc08fa-4518-4ccf-97a1-22f04820b31c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb764c6cd-74') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 12:18:53 user nova-compute[74190]: DEBUG nova.objects.instance [None req-2c9c96ed-f1d1-437a-92b5-fbdd33f20111 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Lazy-loading 'pci_devices' on Instance uuid ebe4e4fe-9614-4065-b84e-a08a50f638b1 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:18:53 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-2c9c96ed-f1d1-437a-92b5-fbdd33f20111 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: ebe4e4fe-9614-4065-b84e-a08a50f638b1] End _get_guest_xml xml=<domain type="kvm">
Oct 18 12:18:53 user nova-compute[74190]:   <uuid>ebe4e4fe-9614-4065-b84e-a08a50f638b1</uuid>
Oct 18 12:18:53 user nova-compute[74190]:   <name>instance-00000031</name>
Oct 18 12:18:53 user nova-compute[74190]:   <memory>524288</memory>
Oct 18 12:18:53 user nova-compute[74190]:   <vcpu>1</vcpu>
Oct 18 12:18:53 user nova-compute[74190]:   <metadata>
Oct 18 12:18:53 user nova-compute[74190]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 12:18:53 user nova-compute[74190]:       <nova:package version="0.0.0"/>
Oct 18 12:18:53 user nova-compute[74190]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1811332868</nova:name>
Oct 18 12:18:53 user nova-compute[74190]:       <nova:creationTime>2023-10-18 12:18:53</nova:creationTime>
Oct 18 12:18:53 user nova-compute[74190]:       <nova:flavor name="m1.tiny">
Oct 18 12:18:53 user nova-compute[74190]:         <nova:memory>512</nova:memory>
Oct 18 12:18:53 user nova-compute[74190]:         <nova:disk>1</nova:disk>
Oct 18 12:18:53 user nova-compute[74190]:         <nova:swap>0</nova:swap>
Oct 18 12:18:53 user nova-compute[74190]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 12:18:53 user nova-compute[74190]:         <nova:vcpus>1</nova:vcpus>
Oct 18 12:18:53 user nova-compute[74190]:       </nova:flavor>
Oct 18 12:18:53 user nova-compute[74190]:       <nova:owner>
Oct 18 12:18:53 user nova-compute[74190]:         <nova:user uuid="f2c022bbeb1941fe89964cd372f651f2">tempest-VolumesSnapshotTestJSON-252328076-project-member</nova:user>
Oct 18 12:18:53 user nova-compute[74190]:         <nova:project uuid="1e49c9e381b0457faa31d0f5bdfa3f18">tempest-VolumesSnapshotTestJSON-252328076</nova:project>
Oct 18 12:18:53 user nova-compute[74190]:       </nova:owner>
Oct 18 12:18:53 user nova-compute[74190]:       <nova:root type="image" uuid="6e88bbf0-6e78-49a8-b3c5-9453d22a89df"/>
Oct 18 12:18:53 user nova-compute[74190]:       <nova:ports>
Oct 18 12:18:53 user nova-compute[74190]:         <nova:port uuid="b764c6cd-7473-45e0-acac-9c20fc355d2e">
Oct 18 12:18:53 user nova-compute[74190]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 18 12:18:53 user nova-compute[74190]:         </nova:port>
Oct 18 12:18:53 user nova-compute[74190]:       </nova:ports>
Oct 18 12:18:53 user nova-compute[74190]:     </nova:instance>
Oct 18 12:18:53 user nova-compute[74190]:   </metadata>
Oct 18 12:18:53 user nova-compute[74190]:   <sysinfo type="smbios">
Oct 18 12:18:53 user nova-compute[74190]:     <system>
Oct 18 12:18:53 user nova-compute[74190]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 12:18:53 user nova-compute[74190]:       <entry name="product">OpenStack Nova</entry>
Oct 18 12:18:53 user nova-compute[74190]:       <entry name="version">0.0.0</entry>
Oct 18 12:18:53 user nova-compute[74190]:       <entry name="serial">ebe4e4fe-9614-4065-b84e-a08a50f638b1</entry>
Oct 18 12:18:53 user nova-compute[74190]:       <entry name="uuid">ebe4e4fe-9614-4065-b84e-a08a50f638b1</entry>
Oct 18 12:18:53 user nova-compute[74190]:       <entry name="family">Virtual Machine</entry>
Oct 18 12:18:53 user nova-compute[74190]:     </system>
Oct 18 12:18:53 user nova-compute[74190]:   </sysinfo>
Oct 18 12:18:53 user nova-compute[74190]:   <os>
Oct 18 12:18:53 user nova-compute[74190]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 12:18:53 user nova-compute[74190]:     <boot dev="hd"/>
Oct 18 12:18:53 user nova-compute[74190]:     <smbios mode="sysinfo"/>
Oct 18 12:18:53 user nova-compute[74190]:   </os>
Oct 18 12:18:53 user nova-compute[74190]:   <features>
Oct 18 12:18:53 user nova-compute[74190]:     <acpi/>
Oct 18 12:18:53 user nova-compute[74190]:     <apic/>
Oct 18 12:18:53 user nova-compute[74190]:     <vmcoreinfo/>
Oct 18 12:18:53 user nova-compute[74190]:   </features>
Oct 18 12:18:53 user nova-compute[74190]:   <clock offset="utc">
Oct 18 12:18:53 user nova-compute[74190]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 12:18:53 user nova-compute[74190]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 12:18:53 user nova-compute[74190]:     <timer name="hpet" present="no"/>
Oct 18 12:18:53 user nova-compute[74190]:   </clock>
Oct 18 12:18:53 user nova-compute[74190]:   <cpu mode="custom" match="exact">
Oct 18 12:18:53 user nova-compute[74190]:     <model>Nehalem</model>
Oct 18 12:18:53 user nova-compute[74190]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 12:18:53 user nova-compute[74190]:   </cpu>
Oct 18 12:18:53 user nova-compute[74190]:   <devices>
Oct 18 12:18:53 user nova-compute[74190]:     <disk type="file" device="disk">
Oct 18 12:18:53 user nova-compute[74190]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 12:18:53 user nova-compute[74190]:       <source file="/opt/stack/data/nova/instances/ebe4e4fe-9614-4065-b84e-a08a50f638b1/disk"/>
Oct 18 12:18:53 user nova-compute[74190]:       <target dev="vda" bus="virtio"/>
Oct 18 12:18:53 user nova-compute[74190]:     </disk>
Oct 18 12:18:53 user nova-compute[74190]:     <interface type="ethernet">
Oct 18 12:18:53 user nova-compute[74190]:       <mac address="fa:16:3e:2e:61:70"/>
Oct 18 12:18:53 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 12:18:53 user nova-compute[74190]:       <mtu size="1442"/>
Oct 18 12:18:53 user nova-compute[74190]:       <target dev="tapb764c6cd-74"/>
Oct 18 12:18:53 user nova-compute[74190]:     </interface>
Oct 18 12:18:53 user nova-compute[74190]:     <serial type="pty">
Oct 18 12:18:53 user nova-compute[74190]:       <log file="/opt/stack/data/nova/instances/ebe4e4fe-9614-4065-b84e-a08a50f638b1/console.log" append="off"/>
Oct 18 12:18:53 user nova-compute[74190]:     </serial>
Oct 18 12:18:53 user nova-compute[74190]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 12:18:53 user nova-compute[74190]:     <video>
Oct 18 12:18:53 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 12:18:53 user nova-compute[74190]:     </video>
Oct 18 12:18:53 user nova-compute[74190]:     <rng model="virtio">
Oct 18 12:18:53 user nova-compute[74190]:       <backend model="random">/dev/urandom</backend>
Oct 18 12:18:53 user nova-compute[74190]:     </rng>
Oct 18 12:18:53 user nova-compute[74190]:     <controller type="usb" index="0" model="none"/>
Oct 18 12:18:53 user nova-compute[74190]:     <memballoon model="virtio">
Oct 18 12:18:53 user nova-compute[74190]:       <stats period="10"/>
Oct 18 12:18:53 user nova-compute[74190]:     </memballoon>
Oct 18 12:18:53 user nova-compute[74190]:   </devices>
Oct 18 12:18:53 user nova-compute[74190]: </domain>
Oct 18 12:18:53 user nova-compute[74190]:  {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 12:18:53 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-2c9c96ed-f1d1-437a-92b5-fbdd33f20111 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T12:18:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1811332868',display_name='tempest-VolumesSnapshotTestJSON-instance-1811332868',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1811332868',id=49,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF9oc+bwOhZaWPzwzw2MSqa58dx+V8y/8IE25tznmLDmKbwWin7Qmx10naTsDHVWlybEUzFEdjOvAJdbI0TdeVxEDcTRIx41RZa2hFwgzKXPEPcyTlR4Xr22YnmmzE9L3g==',key_name='tempest-keypair-1543681740',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e49c9e381b0457faa31d0f5bdfa3f18',ramdisk_id='',reservation_id='r-124e5z6h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-252328076',owner_user_name='tempest-VolumesSnapshotTestJSON-252328076-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T12:18:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f2c022bbeb1941fe89964cd372f651f2',uuid=ebe4e4fe-9614-4065-b84e-a08a50f638b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b764c6cd-7473-45e0-acac-9c20fc355d2e", "address": "fa:16:3e:2e:61:70", "network": {"id": "1afc08fa-4518-4ccf-97a1-22f04820b31c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-687660220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e49c9e381b0457faa31d0f5bdfa3f18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb764c6cd-74", "ovs_interfaceid": "b764c6cd-7473-45e0-acac-9c20fc355d2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 12:18:53 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-2c9c96ed-f1d1-437a-92b5-fbdd33f20111 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Converting VIF {"id": "b764c6cd-7473-45e0-acac-9c20fc355d2e", "address": "fa:16:3e:2e:61:70", "network": {"id": "1afc08fa-4518-4ccf-97a1-22f04820b31c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-687660220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e49c9e381b0457faa31d0f5bdfa3f18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb764c6cd-74", "ovs_interfaceid": "b764c6cd-7473-45e0-acac-9c20fc355d2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 12:18:53 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-2c9c96ed-f1d1-437a-92b5-fbdd33f20111 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:61:70,bridge_name='br-int',has_traffic_filtering=True,id=b764c6cd-7473-45e0-acac-9c20fc355d2e,network=Network(1afc08fa-4518-4ccf-97a1-22f04820b31c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb764c6cd-74') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 12:18:53 user nova-compute[74190]: DEBUG os_vif [None req-2c9c96ed-f1d1-437a-92b5-fbdd33f20111 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:61:70,bridge_name='br-int',has_traffic_filtering=True,id=b764c6cd-7473-45e0-acac-9c20fc355d2e,network=Network(1afc08fa-4518-4ccf-97a1-22f04820b31c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb764c6cd-74') {{(pid=74190) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 12:18:53 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:18:53 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:18:53 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 12:18:53 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:18:53 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9be2fab5-0f51-5457-b6c0-86bd1e86e783', '_type': 'linux-noop'}}, row=False) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:18:53 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:18:53 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:18:53 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb764c6cd-74, may_exist=True, interface_attrs={}) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:18:53 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb764c6cd-74, col_values=(('qos', UUID('2704833a-0a92-4b6e-a1bb-748a46af9e03')),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:18:53 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb764c6cd-74, col_values=(('external_ids', {'iface-id': 'b764c6cd-7473-45e0-acac-9c20fc355d2e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:61:70', 'vm-uuid': 'ebe4e4fe-9614-4065-b84e-a08a50f638b1'}),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:18:53 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:18:53 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:18:53 user nova-compute[74190]: INFO os_vif [None req-2c9c96ed-f1d1-437a-92b5-fbdd33f20111 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:61:70,bridge_name='br-int',has_traffic_filtering=True,id=b764c6cd-7473-45e0-acac-9c20fc355d2e,network=Network(1afc08fa-4518-4ccf-97a1-22f04820b31c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb764c6cd-74')
Oct 18 12:18:53 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-2c9c96ed-f1d1-437a-92b5-fbdd33f20111 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] No BDM found with device name vda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 12:18:53 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-2c9c96ed-f1d1-437a-92b5-fbdd33f20111 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] No VIF found with MAC fa:16:3e:2e:61:70, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 12:18:55 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:18:55 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:18:55 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:18:55 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:18:55 user nova-compute[74190]: DEBUG nova.compute.manager [req-d3892536-3da2-46c8-a431-ef9aabfa4f1e req-a9454168-6aef-4d84-86a3-9ab959f8db52 service nova] [instance: ebe4e4fe-9614-4065-b84e-a08a50f638b1] Received event network-vif-plugged-b764c6cd-7473-45e0-acac-9c20fc355d2e {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:18:55 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d3892536-3da2-46c8-a431-ef9aabfa4f1e req-a9454168-6aef-4d84-86a3-9ab959f8db52 service nova] Acquiring lock "ebe4e4fe-9614-4065-b84e-a08a50f638b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:18:55 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d3892536-3da2-46c8-a431-ef9aabfa4f1e req-a9454168-6aef-4d84-86a3-9ab959f8db52 service nova] Lock "ebe4e4fe-9614-4065-b84e-a08a50f638b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:18:55 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d3892536-3da2-46c8-a431-ef9aabfa4f1e req-a9454168-6aef-4d84-86a3-9ab959f8db52 service nova] Lock "ebe4e4fe-9614-4065-b84e-a08a50f638b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:18:55 user nova-compute[74190]: DEBUG nova.compute.manager [req-d3892536-3da2-46c8-a431-ef9aabfa4f1e req-a9454168-6aef-4d84-86a3-9ab959f8db52 service nova] [instance: ebe4e4fe-9614-4065-b84e-a08a50f638b1] No waiting events found dispatching network-vif-plugged-b764c6cd-7473-45e0-acac-9c20fc355d2e {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:18:55 user nova-compute[74190]: WARNING nova.compute.manager [req-d3892536-3da2-46c8-a431-ef9aabfa4f1e req-a9454168-6aef-4d84-86a3-9ab959f8db52 service nova] [instance: ebe4e4fe-9614-4065-b84e-a08a50f638b1] Received unexpected event network-vif-plugged-b764c6cd-7473-45e0-acac-9c20fc355d2e for instance with vm_state building and task_state spawning.
Oct 18 12:18:55 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:18:55 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:18:55 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:18:55 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:18:57 user nova-compute[74190]: DEBUG nova.compute.manager [None req-2c9c96ed-f1d1-437a-92b5-fbdd33f20111 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: ebe4e4fe-9614-4065-b84e-a08a50f638b1] Instance event wait completed in 0 seconds for  {{(pid=74190) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 12:18:57 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-2c9c96ed-f1d1-437a-92b5-fbdd33f20111 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: ebe4e4fe-9614-4065-b84e-a08a50f638b1] Guest created on hypervisor {{(pid=74190) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 12:18:57 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: ebe4e4fe-9614-4065-b84e-a08a50f638b1] Instance spawned successfully.
Oct 18 12:18:57 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-2c9c96ed-f1d1-437a-92b5-fbdd33f20111 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: ebe4e4fe-9614-4065-b84e-a08a50f638b1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 12:18:57 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-2c9c96ed-f1d1-437a-92b5-fbdd33f20111 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: ebe4e4fe-9614-4065-b84e-a08a50f638b1] Found default for hw_cdrom_bus of ide {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:18:57 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-2c9c96ed-f1d1-437a-92b5-fbdd33f20111 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: ebe4e4fe-9614-4065-b84e-a08a50f638b1] Found default for hw_disk_bus of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:18:57 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-2c9c96ed-f1d1-437a-92b5-fbdd33f20111 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: ebe4e4fe-9614-4065-b84e-a08a50f638b1] Found default for hw_input_bus of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:18:57 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-2c9c96ed-f1d1-437a-92b5-fbdd33f20111 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: ebe4e4fe-9614-4065-b84e-a08a50f638b1] Found default for hw_pointer_model of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:18:57 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-2c9c96ed-f1d1-437a-92b5-fbdd33f20111 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: ebe4e4fe-9614-4065-b84e-a08a50f638b1] Found default for hw_video_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:18:57 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-2c9c96ed-f1d1-437a-92b5-fbdd33f20111 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: ebe4e4fe-9614-4065-b84e-a08a50f638b1] Found default for hw_vif_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:18:57 user nova-compute[74190]: INFO nova.compute.manager [None req-2c9c96ed-f1d1-437a-92b5-fbdd33f20111 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: ebe4e4fe-9614-4065-b84e-a08a50f638b1] Took 5.81 seconds to spawn the instance on the hypervisor.
Oct 18 12:18:57 user nova-compute[74190]: DEBUG nova.compute.manager [None req-2c9c96ed-f1d1-437a-92b5-fbdd33f20111 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: ebe4e4fe-9614-4065-b84e-a08a50f638b1] Checking state {{(pid=74190) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 12:18:57 user nova-compute[74190]: INFO nova.compute.manager [None req-2c9c96ed-f1d1-437a-92b5-fbdd33f20111 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: ebe4e4fe-9614-4065-b84e-a08a50f638b1] Took 6.40 seconds to build instance.
Oct 18 12:18:57 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-2c9c96ed-f1d1-437a-92b5-fbdd33f20111 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Lock "ebe4e4fe-9614-4065-b84e-a08a50f638b1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.628s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:18:57 user nova-compute[74190]: DEBUG nova.compute.manager [req-696ca2fa-00dd-4073-b39c-5d0400a873f7 req-fadf243b-46e3-40c9-b3cf-9bd8f1e983e3 service nova] [instance: ebe4e4fe-9614-4065-b84e-a08a50f638b1] Received event network-vif-plugged-b764c6cd-7473-45e0-acac-9c20fc355d2e {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:18:57 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-696ca2fa-00dd-4073-b39c-5d0400a873f7 req-fadf243b-46e3-40c9-b3cf-9bd8f1e983e3 service nova] Acquiring lock "ebe4e4fe-9614-4065-b84e-a08a50f638b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:18:57 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-696ca2fa-00dd-4073-b39c-5d0400a873f7 req-fadf243b-46e3-40c9-b3cf-9bd8f1e983e3 service nova] Lock "ebe4e4fe-9614-4065-b84e-a08a50f638b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:18:57 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-696ca2fa-00dd-4073-b39c-5d0400a873f7 req-fadf243b-46e3-40c9-b3cf-9bd8f1e983e3 service nova] Lock "ebe4e4fe-9614-4065-b84e-a08a50f638b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:18:57 user nova-compute[74190]: DEBUG nova.compute.manager [req-696ca2fa-00dd-4073-b39c-5d0400a873f7 req-fadf243b-46e3-40c9-b3cf-9bd8f1e983e3 service nova] [instance: ebe4e4fe-9614-4065-b84e-a08a50f638b1] No waiting events found dispatching network-vif-plugged-b764c6cd-7473-45e0-acac-9c20fc355d2e {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:18:57 user nova-compute[74190]: WARNING nova.compute.manager [req-696ca2fa-00dd-4073-b39c-5d0400a873f7 req-fadf243b-46e3-40c9-b3cf-9bd8f1e983e3 service nova] [instance: ebe4e4fe-9614-4065-b84e-a08a50f638b1] Received unexpected event network-vif-plugged-b764c6cd-7473-45e0-acac-9c20fc355d2e for instance with vm_state active and task_state None.
Oct 18 12:18:58 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:19:00 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:19:03 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:19:05 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:19:08 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:19:10 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:19:13 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:19:15 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:19:18 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:19:19 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:19:20 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:19:23 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:19:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:19:24 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:19:25 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:19:27 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:19:27 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:19:27 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Starting heal instance info cache {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 12:19:27 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Rebuilding the list of instances to heal {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 18 12:19:27 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "refresh_cache-7983ceaf-8ed3-4321-a242-2e44218f4d0b" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:19:27 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquired lock "refresh_cache-7983ceaf-8ed3-4321-a242-2e44218f4d0b" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:19:27 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 7983ceaf-8ed3-4321-a242-2e44218f4d0b] Forcefully refreshing network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 18 12:19:27 user nova-compute[74190]: DEBUG nova.objects.instance [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lazy-loading 'info_cache' on Instance uuid 7983ceaf-8ed3-4321-a242-2e44218f4d0b {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:19:27 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 7983ceaf-8ed3-4321-a242-2e44218f4d0b] Updating instance_info_cache with network_info: [{"id": "28ca935e-3c1c-47dc-8b10-d7a5cb602470", "address": "fa:16:3e:b8:5e:82", "network": {"id": "31e59f3e-dc25-4b00-9d87-4b4f695425b8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-220402675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f84b62d410cc448486b792e094464815", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28ca935e-3c", "ovs_interfaceid": "28ca935e-3c1c-47dc-8b10-d7a5cb602470", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:19:27 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Releasing lock "refresh_cache-7983ceaf-8ed3-4321-a242-2e44218f4d0b" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:19:27 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 7983ceaf-8ed3-4321-a242-2e44218f4d0b] Updated the network info_cache for instance {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 18 12:19:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:19:29 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:19:29 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:19:29 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:19:29 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:19:29 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:19:29 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Auditing locally available compute resources for user (node: user) {{(pid=74190) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 12:19:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7983ceaf-8ed3-4321-a242-2e44218f4d0b/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:19:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7983ceaf-8ed3-4321-a242-2e44218f4d0b/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:19:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7983ceaf-8ed3-4321-a242-2e44218f4d0b/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:19:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7983ceaf-8ed3-4321-a242-2e44218f4d0b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:19:29 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 12:19:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebe4e4fe-9614-4065-b84e-a08a50f638b1/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:19:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebe4e4fe-9614-4065-b84e-a08a50f638b1/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:19:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebe4e4fe-9614-4065-b84e-a08a50f638b1/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:19:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebe4e4fe-9614-4065-b84e-a08a50f638b1/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:19:30 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:19:30 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:19:30 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Hypervisor/Node resource view: name=user free_ram=8530MB free_disk=25.19104766845703GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74190) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 12:19:30 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:19:30 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:19:30 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 7983ceaf-8ed3-4321-a242-2e44218f4d0b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:19:30 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:19:30 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance ebe4e4fe-9614-4065-b84e-a08a50f638b1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:19:30 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 12:19:30 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 12:19:30 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 12:19:30 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 12:19:30 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Compute_service record updated for user:user {{(pid=74190) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 12:19:30 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.257s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:19:31 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:19:31 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:19:31 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74190) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 12:19:33 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:19:36 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:19:38 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:19:43 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:19:43 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:19:43 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74190) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 12:19:43 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:19:43 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:19:43 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:19:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:19:53 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:19:53 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:19:53 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74190) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 12:19:53 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:19:53 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:19:53 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:19:58 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:20:03 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:20:08 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:20:13 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:20:13 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:20:13 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74190) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 12:20:13 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:20:13 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:20:13 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:20:14 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:20:15 user nova-compute[74190]: DEBUG nova.compute.manager [req-0a80ce43-c82e-4133-822b-b66073bd0097 req-545f1070-d2ff-4d04-986f-5f54cba7e6a7 service nova] [instance: 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74] Received event network-changed-82848227-6c16-405c-a0ba-348c210787ef {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:20:15 user nova-compute[74190]: DEBUG nova.compute.manager [req-0a80ce43-c82e-4133-822b-b66073bd0097 req-545f1070-d2ff-4d04-986f-5f54cba7e6a7 service nova] [instance: 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74] Refreshing instance network info cache due to event network-changed-82848227-6c16-405c-a0ba-348c210787ef. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 12:20:15 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-0a80ce43-c82e-4133-822b-b66073bd0097 req-545f1070-d2ff-4d04-986f-5f54cba7e6a7 service nova] Acquiring lock "refresh_cache-254d3af1-7a43-43d6-b0fa-ddb7fc3dac74" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:20:15 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-0a80ce43-c82e-4133-822b-b66073bd0097 req-545f1070-d2ff-4d04-986f-5f54cba7e6a7 service nova] Acquired lock "refresh_cache-254d3af1-7a43-43d6-b0fa-ddb7fc3dac74" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:20:15 user nova-compute[74190]: DEBUG nova.network.neutron [req-0a80ce43-c82e-4133-822b-b66073bd0097 req-545f1070-d2ff-4d04-986f-5f54cba7e6a7 service nova] [instance: 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74] Refreshing network info cache for port 82848227-6c16-405c-a0ba-348c210787ef {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 12:20:15 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:20:16 user nova-compute[74190]: DEBUG nova.network.neutron [req-0a80ce43-c82e-4133-822b-b66073bd0097 req-545f1070-d2ff-4d04-986f-5f54cba7e6a7 service nova] [instance: 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74] Updated VIF entry in instance network info cache for port 82848227-6c16-405c-a0ba-348c210787ef. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 12:20:16 user nova-compute[74190]: DEBUG nova.network.neutron [req-0a80ce43-c82e-4133-822b-b66073bd0097 req-545f1070-d2ff-4d04-986f-5f54cba7e6a7 service nova] [instance: 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74] Updating instance_info_cache with network_info: [{"id": "82848227-6c16-405c-a0ba-348c210787ef", "address": "fa:16:3e:41:dd:5a", "network": {"id": "aa827f81-b165-444f-89cc-f21c42a9f772", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1659902586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e375153f6f24827811c5825fc2a2c6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82848227-6c", "ovs_interfaceid": "82848227-6c16-405c-a0ba-348c210787ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:20:16 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-0a80ce43-c82e-4133-822b-b66073bd0097 req-545f1070-d2ff-4d04-986f-5f54cba7e6a7 service nova] Releasing lock "refresh_cache-254d3af1-7a43-43d6-b0fa-ddb7fc3dac74" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:20:18 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:20:19 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:20:20 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:20:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:20:24 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:20:25 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:20:25 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:20:28 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:20:28 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Starting heal instance info cache {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 12:20:28 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "refresh_cache-254d3af1-7a43-43d6-b0fa-ddb7fc3dac74" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:20:28 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquired lock "refresh_cache-254d3af1-7a43-43d6-b0fa-ddb7fc3dac74" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:20:28 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74] Forcefully refreshing network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 18 12:20:28 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74] Updating instance_info_cache with network_info: [{"id": "82848227-6c16-405c-a0ba-348c210787ef", "address": "fa:16:3e:41:dd:5a", "network": {"id": "aa827f81-b165-444f-89cc-f21c42a9f772", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1659902586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e375153f6f24827811c5825fc2a2c6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82848227-6c", "ovs_interfaceid": "82848227-6c16-405c-a0ba-348c210787ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:20:28 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Releasing lock "refresh_cache-254d3af1-7a43-43d6-b0fa-ddb7fc3dac74" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:20:28 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74] Updated the network info_cache for instance {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 18 12:20:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:20:29 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:20:29 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:20:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:20:31 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:20:31 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74190) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 12:20:31 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:20:31 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:20:31 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:20:31 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:20:31 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Auditing locally available compute resources for user (node: user) {{(pid=74190) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 12:20:31 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7983ceaf-8ed3-4321-a242-2e44218f4d0b/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:20:31 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Acquiring lock "3930e04a-3d64-407c-90c2-f9b14269c27c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:20:31 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "3930e04a-3d64-407c-90c2-f9b14269c27c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:20:31 user nova-compute[74190]: DEBUG nova.compute.manager [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 3930e04a-3d64-407c-90c2-f9b14269c27c] Starting instance... {{(pid=74190) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 12:20:31 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7983ceaf-8ed3-4321-a242-2e44218f4d0b/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:20:31 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7983ceaf-8ed3-4321-a242-2e44218f4d0b/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:20:31 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:20:31 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:20:31 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74190) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 12:20:31 user nova-compute[74190]: INFO nova.compute.claims [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 3930e04a-3d64-407c-90c2-f9b14269c27c] Claim successful on node user
Oct 18 12:20:31 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7983ceaf-8ed3-4321-a242-2e44218f4d0b/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:20:31 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 12:20:31 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebe4e4fe-9614-4065-b84e-a08a50f638b1/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:20:31 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 12:20:31 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 12:20:31 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebe4e4fe-9614-4065-b84e-a08a50f638b1/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:20:31 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebe4e4fe-9614-4065-b84e-a08a50f638b1/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:20:31 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.358s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:20:31 user nova-compute[74190]: DEBUG nova.compute.manager [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 3930e04a-3d64-407c-90c2-f9b14269c27c] Start building networks asynchronously for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 12:20:31 user nova-compute[74190]: DEBUG nova.compute.manager [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 3930e04a-3d64-407c-90c2-f9b14269c27c] Allocating IP information in the background. {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 12:20:31 user nova-compute[74190]: DEBUG nova.network.neutron [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 3930e04a-3d64-407c-90c2-f9b14269c27c] allocate_for_instance() {{(pid=74190) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 12:20:31 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 3930e04a-3d64-407c-90c2-f9b14269c27c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 12:20:31 user nova-compute[74190]: DEBUG nova.compute.manager [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 3930e04a-3d64-407c-90c2-f9b14269c27c] Start building block device mappings for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 12:20:31 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebe4e4fe-9614-4065-b84e-a08a50f638b1/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:20:31 user nova-compute[74190]: DEBUG nova.policy [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '27d9fc244d0f4e10a43b7df4dc8e30ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e375153f6f24827811c5825fc2a2c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74190) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 12:20:32 user nova-compute[74190]: INFO nova.virt.block_device [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 3930e04a-3d64-407c-90c2-f9b14269c27c] Booting with volume d5754ff3-a98f-456d-a996-b69cfc9a458e at /dev/vda
Oct 18 12:20:32 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:20:32 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:20:32 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Hypervisor/Node resource view: name=user free_ram=8645MB free_disk=25.181476593017578GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74190) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 12:20:32 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:20:32 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:20:32 user nova-compute[74190]: DEBUG os_brick.utils [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 12:20:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:20:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:20:32 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c293c1a-47cf-40e1-8d1b-7016dc0d2018]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cff158e257e1\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:20:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:20:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:20:32 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a0bab8-5959-4ed9-8698-92b3979a56a4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:20:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:20:32 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 7983ceaf-8ed3-4321-a242-2e44218f4d0b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:20:32 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:20:32 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance ebe4e4fe-9614-4065-b84e-a08a50f638b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:20:32 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 3930e04a-3d64-407c-90c2-f9b14269c27c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:20:32 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 12:20:32 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 12:20:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:20:32 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f44c9f0-34be-40de-923f-e65437b8ea13]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:20:32 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[471b6364-b0fb-4a6a-9c7e-c5a2bf9d7ec8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:20:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Running cmd (subprocess): nvme version {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:20:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] 'nvme version' failed. Not Retrying. {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 12:20:32 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] nvme not present on system {{(pid=74190) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 12:20:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:20:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 12:20:32 user nova-compute[74190]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 12:20:32 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3b73d7b-2035-4be3-b114-b71c30501fb8]: (4, '') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:20:32 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74190) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 12:20:32 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 12:20:32 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] LIGHTOS: no hostnqn found. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 12:20:32 user nova-compute[74190]: DEBUG os_brick.utils [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cff158e257e1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 12:20:32 user nova-compute[74190]: DEBUG nova.virt.block_device [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 3930e04a-3d64-407c-90c2-f9b14269c27c] Updating existing volume attachment record: b2ab2e08-d7c3-40fc-a1c0-b43fb936498f {{(pid=74190) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 12:20:32 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 12:20:32 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 12:20:32 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Compute_service record updated for user:user {{(pid=74190) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 12:20:32 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.353s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:20:33 user nova-compute[74190]: DEBUG nova.network.neutron [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 3930e04a-3d64-407c-90c2-f9b14269c27c] Successfully created port: f5a6b75c-7bcb-4a37-96aa-c30430598ecd {{(pid=74190) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 12:20:33 user nova-compute[74190]: DEBUG nova.network.neutron [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 3930e04a-3d64-407c-90c2-f9b14269c27c] Successfully updated port: f5a6b75c-7bcb-4a37-96aa-c30430598ecd {{(pid=74190) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 12:20:33 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Acquiring lock "refresh_cache-3930e04a-3d64-407c-90c2-f9b14269c27c" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:20:33 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Acquired lock "refresh_cache-3930e04a-3d64-407c-90c2-f9b14269c27c" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:20:33 user nova-compute[74190]: DEBUG nova.network.neutron [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 3930e04a-3d64-407c-90c2-f9b14269c27c] Building network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 12:20:33 user nova-compute[74190]: DEBUG nova.network.neutron [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 3930e04a-3d64-407c-90c2-f9b14269c27c] Instance cache missing network info. {{(pid=74190) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 12:20:33 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:20:33 user nova-compute[74190]: DEBUG nova.compute.manager [req-17704cbb-834f-4a82-b9ae-3386175bd8aa req-d58b510b-7063-4e91-9d44-29878e92c11e service nova] [instance: 3930e04a-3d64-407c-90c2-f9b14269c27c] Received event network-changed-f5a6b75c-7bcb-4a37-96aa-c30430598ecd {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:20:33 user nova-compute[74190]: DEBUG nova.compute.manager [req-17704cbb-834f-4a82-b9ae-3386175bd8aa req-d58b510b-7063-4e91-9d44-29878e92c11e service nova] [instance: 3930e04a-3d64-407c-90c2-f9b14269c27c] Refreshing instance network info cache due to event network-changed-f5a6b75c-7bcb-4a37-96aa-c30430598ecd. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 12:20:33 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-17704cbb-834f-4a82-b9ae-3386175bd8aa req-d58b510b-7063-4e91-9d44-29878e92c11e service nova] Acquiring lock "refresh_cache-3930e04a-3d64-407c-90c2-f9b14269c27c" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:20:34 user nova-compute[74190]: DEBUG nova.network.neutron [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 3930e04a-3d64-407c-90c2-f9b14269c27c] Updating instance_info_cache with network_info: [{"id": "f5a6b75c-7bcb-4a37-96aa-c30430598ecd", "address": "fa:16:3e:2e:bb:8f", "network": {"id": "aa827f81-b165-444f-89cc-f21c42a9f772", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1659902586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e375153f6f24827811c5825fc2a2c6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a6b75c-7b", "ovs_interfaceid": "f5a6b75c-7bcb-4a37-96aa-c30430598ecd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:20:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Releasing lock "refresh_cache-3930e04a-3d64-407c-90c2-f9b14269c27c" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:20:34 user nova-compute[74190]: DEBUG nova.compute.manager [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 3930e04a-3d64-407c-90c2-f9b14269c27c] Instance network_info: |[{"id": "f5a6b75c-7bcb-4a37-96aa-c30430598ecd", "address": "fa:16:3e:2e:bb:8f", "network": {"id": "aa827f81-b165-444f-89cc-f21c42a9f772", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1659902586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e375153f6f24827811c5825fc2a2c6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a6b75c-7b", "ovs_interfaceid": "f5a6b75c-7bcb-4a37-96aa-c30430598ecd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 12:20:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-17704cbb-834f-4a82-b9ae-3386175bd8aa req-d58b510b-7063-4e91-9d44-29878e92c11e service nova] Acquired lock "refresh_cache-3930e04a-3d64-407c-90c2-f9b14269c27c" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:20:34 user nova-compute[74190]: DEBUG nova.network.neutron [req-17704cbb-834f-4a82-b9ae-3386175bd8aa req-d58b510b-7063-4e91-9d44-29878e92c11e service nova] [instance: 3930e04a-3d64-407c-90c2-f9b14269c27c] Refreshing network info cache for port f5a6b75c-7bcb-4a37-96aa-c30430598ecd {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 12:20:34 user nova-compute[74190]: DEBUG nova.network.neutron [req-17704cbb-834f-4a82-b9ae-3386175bd8aa req-d58b510b-7063-4e91-9d44-29878e92c11e service nova] [instance: 3930e04a-3d64-407c-90c2-f9b14269c27c] Updated VIF entry in instance network info cache for port f5a6b75c-7bcb-4a37-96aa-c30430598ecd. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 12:20:34 user nova-compute[74190]: DEBUG nova.network.neutron [req-17704cbb-834f-4a82-b9ae-3386175bd8aa req-d58b510b-7063-4e91-9d44-29878e92c11e service nova] [instance: 3930e04a-3d64-407c-90c2-f9b14269c27c] Updating instance_info_cache with network_info: [{"id": "f5a6b75c-7bcb-4a37-96aa-c30430598ecd", "address": "fa:16:3e:2e:bb:8f", "network": {"id": "aa827f81-b165-444f-89cc-f21c42a9f772", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1659902586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e375153f6f24827811c5825fc2a2c6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a6b75c-7b", "ovs_interfaceid": "f5a6b75c-7bcb-4a37-96aa-c30430598ecd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:20:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-17704cbb-834f-4a82-b9ae-3386175bd8aa req-d58b510b-7063-4e91-9d44-29878e92c11e service nova] Releasing lock "refresh_cache-3930e04a-3d64-407c-90c2-f9b14269c27c" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:20:34 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:20:38 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:20:42 user nova-compute[74190]: DEBUG nova.compute.manager [req-53cb8d3f-b25a-4672-a6d8-2abbd8c7eebd req-8258bb5f-6657-46a9-adf2-a388e1d1c849 service nova] [instance: ebe4e4fe-9614-4065-b84e-a08a50f638b1] Received event network-changed-b764c6cd-7473-45e0-acac-9c20fc355d2e {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:20:42 user nova-compute[74190]: DEBUG nova.compute.manager [req-53cb8d3f-b25a-4672-a6d8-2abbd8c7eebd req-8258bb5f-6657-46a9-adf2-a388e1d1c849 service nova] [instance: ebe4e4fe-9614-4065-b84e-a08a50f638b1] Refreshing instance network info cache due to event network-changed-b764c6cd-7473-45e0-acac-9c20fc355d2e. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 12:20:42 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-53cb8d3f-b25a-4672-a6d8-2abbd8c7eebd req-8258bb5f-6657-46a9-adf2-a388e1d1c849 service nova] Acquiring lock "refresh_cache-ebe4e4fe-9614-4065-b84e-a08a50f638b1" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:20:42 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-53cb8d3f-b25a-4672-a6d8-2abbd8c7eebd req-8258bb5f-6657-46a9-adf2-a388e1d1c849 service nova] Acquired lock "refresh_cache-ebe4e4fe-9614-4065-b84e-a08a50f638b1" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:20:42 user nova-compute[74190]: DEBUG nova.network.neutron [req-53cb8d3f-b25a-4672-a6d8-2abbd8c7eebd req-8258bb5f-6657-46a9-adf2-a388e1d1c849 service nova] [instance: ebe4e4fe-9614-4065-b84e-a08a50f638b1] Refreshing network info cache for port b764c6cd-7473-45e0-acac-9c20fc355d2e {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 12:20:42 user nova-compute[74190]: DEBUG nova.network.neutron [req-53cb8d3f-b25a-4672-a6d8-2abbd8c7eebd req-8258bb5f-6657-46a9-adf2-a388e1d1c849 service nova] [instance: ebe4e4fe-9614-4065-b84e-a08a50f638b1] Updated VIF entry in instance network info cache for port b764c6cd-7473-45e0-acac-9c20fc355d2e. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 12:20:42 user nova-compute[74190]: DEBUG nova.network.neutron [req-53cb8d3f-b25a-4672-a6d8-2abbd8c7eebd req-8258bb5f-6657-46a9-adf2-a388e1d1c849 service nova] [instance: ebe4e4fe-9614-4065-b84e-a08a50f638b1] Updating instance_info_cache with network_info: [{"id": "b764c6cd-7473-45e0-acac-9c20fc355d2e", "address": "fa:16:3e:2e:61:70", "network": {"id": "1afc08fa-4518-4ccf-97a1-22f04820b31c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-687660220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e49c9e381b0457faa31d0f5bdfa3f18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb764c6cd-74", "ovs_interfaceid": "b764c6cd-7473-45e0-acac-9c20fc355d2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:20:42 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-53cb8d3f-b25a-4672-a6d8-2abbd8c7eebd req-8258bb5f-6657-46a9-adf2-a388e1d1c849 service nova] Releasing lock "refresh_cache-ebe4e4fe-9614-4065-b84e-a08a50f638b1" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:20:43 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-7daa163d-cf8c-4618-9283-6508986db6ea tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Acquiring lock "ebe4e4fe-9614-4065-b84e-a08a50f638b1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:20:43 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-7daa163d-cf8c-4618-9283-6508986db6ea tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Lock "ebe4e4fe-9614-4065-b84e-a08a50f638b1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:20:43 user nova-compute[74190]: DEBUG nova.objects.instance [None req-7daa163d-cf8c-4618-9283-6508986db6ea tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Lazy-loading 'flavor' on Instance uuid ebe4e4fe-9614-4065-b84e-a08a50f638b1 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:20:43 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-7daa163d-cf8c-4618-9283-6508986db6ea tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: ebe4e4fe-9614-4065-b84e-a08a50f638b1] Ignoring supplied device name: /dev/vdb
Oct 18 12:20:43 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-7daa163d-cf8c-4618-9283-6508986db6ea tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Lock "ebe4e4fe-9614-4065-b84e-a08a50f638b1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:20:43 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-7daa163d-cf8c-4618-9283-6508986db6ea tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Acquiring lock "ebe4e4fe-9614-4065-b84e-a08a50f638b1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:20:43 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-7daa163d-cf8c-4618-9283-6508986db6ea tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Lock "ebe4e4fe-9614-4065-b84e-a08a50f638b1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:20:43 user nova-compute[74190]: INFO nova.compute.manager [None req-7daa163d-cf8c-4618-9283-6508986db6ea tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: ebe4e4fe-9614-4065-b84e-a08a50f638b1] Attaching volume 9990667f-585b-42e7-961b-d60be92f2887 to /dev/vdb
Oct 18 12:20:43 user nova-compute[74190]: DEBUG os_brick.utils [None req-7daa163d-cf8c-4618-9283-6508986db6ea tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 12:20:43 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:20:43 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:20:43 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ff0ac9-0fb1-4716-9460-a94b1599c1a9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cff158e257e1\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:20:43 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:20:43 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:20:43 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cf6a589-85cd-4689-9946-85479be62f6e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:20:43 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:20:43 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:20:43 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee3d2b61-d66a-4e31-adf4-df46bcfbac53]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:20:43 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e05c72b-bd33-4f3d-9e68-14486d3cb058]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:20:43 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-7daa163d-cf8c-4618-9283-6508986db6ea tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Running cmd (subprocess): nvme version {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:20:43 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-7daa163d-cf8c-4618-9283-6508986db6ea tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] 'nvme version' failed. Not Retrying. {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 12:20:43 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7daa163d-cf8c-4618-9283-6508986db6ea tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] nvme not present on system {{(pid=74190) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 12:20:43 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:20:43 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 12:20:43 user nova-compute[74190]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 12:20:43 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e15d99-6214-46a6-8b49-8e10ce7f5f30]: (4, '') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:20:43 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-7daa163d-cf8c-4618-9283-6508986db6ea tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74190) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 12:20:43 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-7daa163d-cf8c-4618-9283-6508986db6ea tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 12:20:43 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-7daa163d-cf8c-4618-9283-6508986db6ea tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] LIGHTOS: no hostnqn found. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 12:20:43 user nova-compute[74190]: DEBUG os_brick.utils [None req-7daa163d-cf8c-4618-9283-6508986db6ea tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cff158e257e1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 12:20:43 user nova-compute[74190]: DEBUG nova.virt.block_device [None req-7daa163d-cf8c-4618-9283-6508986db6ea tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: ebe4e4fe-9614-4065-b84e-a08a50f638b1] Updating existing volume attachment record: 77f7732f-a3b7-430f-a250-db21f760d01c {{(pid=74190) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 12:20:43 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:20:45 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:20:48 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:20:49 user nova-compute[74190]: DEBUG nova.compute.manager [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 3930e04a-3d64-407c-90c2-f9b14269c27c] Start spawning the instance on the hypervisor. {{(pid=74190) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 12:20:49 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 3930e04a-3d64-407c-90c2-f9b14269c27c] Creating instance directory {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 12:20:49 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 3930e04a-3d64-407c-90c2-f9b14269c27c] Creating image(s)
Oct 18 12:20:49 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 3930e04a-3d64-407c-90c2-f9b14269c27c] Did not create local disks {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 18 12:20:49 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 3930e04a-3d64-407c-90c2-f9b14269c27c] Ensure instance console log exists: /opt/stack/data/nova/instances/3930e04a-3d64-407c-90c2-f9b14269c27c/console.log {{(pid=74190) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 12:20:49 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:20:49 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:20:49 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:20:49 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 3930e04a-3d64-407c-90c2-f9b14269c27c] Start _get_guest_xml network_info=[{"id": "f5a6b75c-7bcb-4a37-96aa-c30430598ecd", "address": "fa:16:3e:2e:bb:8f", "network": {"id": "aa827f81-b165-444f-89cc-f21c42a9f772", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1659902586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e375153f6f24827811c5825fc2a2c6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a6b75c-7b", "ovs_interfaceid": "f5a6b75c-7bcb-4a37-96aa-c30430598ecd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d5754ff3-a98f-456d-a996-b69cfc9a458e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QDbkvwUf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3930e04a-3d64-407c-90c2-f9b14269c27c', 'attached_at': '', 'detached_at': '', 'volume_id': 'd5754ff3-a98f-456d-a996-b69cfc9a458e', 'serial': 'd5754ff3-a98f-456d-a996-b69cfc9a458e'}, 'delete_on_termination': False, 'guest_format': None, 'attachment_id': 'b2ab2e08-d7c3-40fc-a1c0-b43fb936498f', 'volume_type': None} {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 12:20:49 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:20:49 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:20:49 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 12:20:49 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] CPU controller missing on host. {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 12:20:49 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 12:20:49 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] CPU controller found on host. {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 12:20:49 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74190) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 12:20:49 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T11:37:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 12:20:49 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Flavor limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 12:20:49 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Image limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 12:20:49 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Flavor pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 12:20:49 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Image pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 12:20:49 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 12:20:49 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 12:20:49 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 12:20:49 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Got 1 possible topologies {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 12:20:49 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 12:20:49 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 12:20:49 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 3930e04a-3d64-407c-90c2-f9b14269c27c] Calling os-brick to attach iSCSI Volume {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 12:20:49 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d5754ff3-a98f-456d-a996-b69cfc9a458e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QDbkvwUf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 12:20:49 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 12:20:49 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 12:20:49 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 12:20:49 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 12:20:49 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5754ff3-a98f-456d-a996-b69cfc9a458e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 12:20:49 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5754ff3-a98f-456d-a996-b69cfc9a458e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 12:20:49 user nova-compute[74190]: INFO os_brick.initiator.connectors.iscsi [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 12:20:49 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5754ff3-a98f-456d-a996-b69cfc9a458e -p 172.16.0.220:3260 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:20:49 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5754ff3-a98f-456d-a996-b69cfc9a458e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:20:49 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf5dcdbf-6273-44fd-a152-a888f91ebcf4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:20:49 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 12:20:49 user nova-compute[74190]:  {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:20:49 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5754ff3-a98f-456d-a996-b69cfc9a458e -p 172.16.0.220:3260 --interface default --op new {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:20:49 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5754ff3-a98f-456d-a996-b69cfc9a458e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:20:49 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[e05ba783-8943-4bbe-a2ff-98036ed1092c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d5754ff3-a98f-456d-a996-b69cfc9a458e] added\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:20:49 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d5754ff3-a98f-456d-a996-b69cfc9a458e] added
Oct 18 12:20:49 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:20:49 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5754ff3-a98f-456d-a996-b69cfc9a458e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:20:49 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5754ff3-a98f-456d-a996-b69cfc9a458e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:20:49 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[568d6931-f2fd-44ab-8457-41d2f29e01b0]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:20:49 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:20:49 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5754ff3-a98f-456d-a996-b69cfc9a458e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:20:49 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5754ff3-a98f-456d-a996-b69cfc9a458e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:20:49 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[575a35d3-f397-4dfb-9cf8-6df7bc6afcda]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:20:49 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:20:49 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5754ff3-a98f-456d-a996-b69cfc9a458e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QDbkvwUf {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:20:49 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5754ff3-a98f-456d-a996-b69cfc9a458e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QDbkvwUf" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:20:49 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[6265e7d5-200e-4386-acc0-708e75ebf8b7]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:20:49 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QDbkvwUf'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:20:49 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5754ff3-a98f-456d-a996-b69cfc9a458e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:20:49 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5754ff3-a98f-456d-a996-b69cfc9a458e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:20:49 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[647eb578-e42e-4cbd-a6c7-f726aa05f0da]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:20:49 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:20:49 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:20:49 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:20:49 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b2804c-7fb2-4c76-afe8-1fee5b6db3b0]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18 (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:20:49 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18 (non-flash)
Oct 18 12:20:49 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 12:20:49 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18 (non-flash)
Oct 18 12:20:49 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 12:20:49 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5754ff3-a98f-456d-a996-b69cfc9a458e -p 172.16.0.220:3260 --login {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:20:49 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5754ff3-a98f-456d-a996-b69cfc9a458e -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:20:49 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad1f4cc-c41a-4578-9862-19747c3d7c9e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d5754ff3-a98f-456d-a996-b69cfc9a458e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d5754ff3-a98f-456d-a996-b69cfc9a458e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:20:49 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d5754ff3-a98f-456d-a996-b69cfc9a458e, portal: 172.16.0.220,3260]
Oct 18 12:20:49 user nova-compute[74190]: Login to [iface: default, target: iqn.2010-10.org.openstack:d5754ff3-a98f-456d-a996-b69cfc9a458e, portal: 172.16.0.220,3260] successful.
Oct 18 12:20:49 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:20:49 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5754ff3-a98f-456d-a996-b69cfc9a458e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:20:49 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5754ff3-a98f-456d-a996-b69cfc9a458e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:20:49 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[82aac364-e98d-404c-ac39-ea21ab39d79c]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:20:49 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:20:49 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:20:49 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:20:49 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdfe2349-6c6a-4e12-aa36-6663d8eaf6ef]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5754ff3-a98f-456d-a996-b69cfc9a458e (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:20:49 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18 (non-flash)
Oct 18 12:20:49 user nova-compute[74190]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5754ff3-a98f-456d-a996-b69cfc9a458e (non-flash)
Oct 18 12:20:49 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 12:20:49 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18 (non-flash)
Oct 18 12:20:49 user nova-compute[74190]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5754ff3-a98f-456d-a996-b69cfc9a458e (non-flash)
Oct 18 12:20:49 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 12:20:49 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5754ff3-a98f-456d-a996-b69cfc9a458e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 12:20:49 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Connected to 172.16.0.220:3260 {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 12:20:49 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] HCTL ('34', '-', '-', 0) found on session 57 with lun 0 {{(pid=74190) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 12:20:49 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74190) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 12:20:49 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:20:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.038s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:20:50 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53b3d41-7454-405b-924f-91233f88507d]: (4, ('- - 0', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:20:50 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Searching for a device in session 57 and hctl ['34', '*', '*', 0] yield: None {{(pid=74190) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 12:20:50 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:20:51 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Searching for a device in session 57 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74190) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 12:20:51 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d5754ff3-a98f-456d-a996-b69cfc9a458e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QDbkvwUf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 12:20:51 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 12:20:51 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '26438326137636137', 'path': '/dev/sdc'} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 12:20:51 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 3930e04a-3d64-407c-90c2-f9b14269c27c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26438326137636137', 'path': '/dev/sdc'} {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 12:20:51 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T12:20:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-683322485',display_name='tempest-TestVolumeBootPattern-server-683322485',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-683322485',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFImDkcHIZVVsD1gB2Yh4JGNE0pEbAN8TUjpItUrbhxdmYRzrbNlPip8qPxIcvk8OJEen8xQaAGxdqzAZ1w6kqPbscsnuFtwOBrKfpec5lSOkFKoHZaLFZ1ci5kqBfXOJw==',key_name='tempest-TestVolumeBootPattern-131084726',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e375153f6f24827811c5825fc2a2c6a',ramdisk_id='',reservation_id='r-uk111vii',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1157442382',owner_user_name='tempest-TestVolumeBootPattern-1157442382-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T12:20:32Z,user_data=None,user_id='27d9fc244d0f4e10a43b7df4dc8e30ad',uuid=3930e04a-3d64-407c-90c2-f9b14269c27c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f5a6b75c-7bcb-4a37-96aa-c30430598ecd", "address": "fa:16:3e:2e:bb:8f", "network": {"id": "aa827f81-b165-444f-89cc-f21c42a9f772", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1659902586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e375153f6f24827811c5825fc2a2c6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a6b75c-7b", "ovs_interfaceid": "f5a6b75c-7bcb-4a37-96aa-c30430598ecd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74190) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 12:20:51 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Converting VIF {"id": "f5a6b75c-7bcb-4a37-96aa-c30430598ecd", "address": "fa:16:3e:2e:bb:8f", "network": {"id": "aa827f81-b165-444f-89cc-f21c42a9f772", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1659902586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e375153f6f24827811c5825fc2a2c6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a6b75c-7b", "ovs_interfaceid": "f5a6b75c-7bcb-4a37-96aa-c30430598ecd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 12:20:51 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:bb:8f,bridge_name='br-int',has_traffic_filtering=True,id=f5a6b75c-7bcb-4a37-96aa-c30430598ecd,network=Network(aa827f81-b165-444f-89cc-f21c42a9f772),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5a6b75c-7b') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 12:20:51 user nova-compute[74190]: DEBUG nova.objects.instance [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lazy-loading 'pci_devices' on Instance uuid 3930e04a-3d64-407c-90c2-f9b14269c27c {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:20:51 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 3930e04a-3d64-407c-90c2-f9b14269c27c] End _get_guest_xml xml=<domain type="kvm">
Oct 18 12:20:51 user nova-compute[74190]:   <uuid>3930e04a-3d64-407c-90c2-f9b14269c27c</uuid>
Oct 18 12:20:51 user nova-compute[74190]:   <name>instance-00000032</name>
Oct 18 12:20:51 user nova-compute[74190]:   <memory>524288</memory>
Oct 18 12:20:51 user nova-compute[74190]:   <vcpu>1</vcpu>
Oct 18 12:20:51 user nova-compute[74190]:   <metadata>
Oct 18 12:20:51 user nova-compute[74190]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 12:20:51 user nova-compute[74190]:       <nova:package version="0.0.0"/>
Oct 18 12:20:51 user nova-compute[74190]:       <nova:name>tempest-TestVolumeBootPattern-server-683322485</nova:name>
Oct 18 12:20:51 user nova-compute[74190]:       <nova:creationTime>2023-10-18 12:20:49</nova:creationTime>
Oct 18 12:20:51 user nova-compute[74190]:       <nova:flavor name="m1.tiny">
Oct 18 12:20:51 user nova-compute[74190]:         <nova:memory>512</nova:memory>
Oct 18 12:20:51 user nova-compute[74190]:         <nova:disk>1</nova:disk>
Oct 18 12:20:51 user nova-compute[74190]:         <nova:swap>0</nova:swap>
Oct 18 12:20:51 user nova-compute[74190]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 12:20:51 user nova-compute[74190]:         <nova:vcpus>1</nova:vcpus>
Oct 18 12:20:51 user nova-compute[74190]:       </nova:flavor>
Oct 18 12:20:51 user nova-compute[74190]:       <nova:owner>
Oct 18 12:20:51 user nova-compute[74190]:         <nova:user uuid="27d9fc244d0f4e10a43b7df4dc8e30ad">tempest-TestVolumeBootPattern-1157442382-project-member</nova:user>
Oct 18 12:20:51 user nova-compute[74190]:         <nova:project uuid="1e375153f6f24827811c5825fc2a2c6a">tempest-TestVolumeBootPattern-1157442382</nova:project>
Oct 18 12:20:51 user nova-compute[74190]:       </nova:owner>
Oct 18 12:20:51 user nova-compute[74190]:       <nova:ports>
Oct 18 12:20:51 user nova-compute[74190]:         <nova:port uuid="f5a6b75c-7bcb-4a37-96aa-c30430598ecd">
Oct 18 12:20:51 user nova-compute[74190]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 18 12:20:51 user nova-compute[74190]:         </nova:port>
Oct 18 12:20:51 user nova-compute[74190]:       </nova:ports>
Oct 18 12:20:51 user nova-compute[74190]:     </nova:instance>
Oct 18 12:20:51 user nova-compute[74190]:   </metadata>
Oct 18 12:20:51 user nova-compute[74190]:   <sysinfo type="smbios">
Oct 18 12:20:51 user nova-compute[74190]:     <system>
Oct 18 12:20:51 user nova-compute[74190]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 12:20:51 user nova-compute[74190]:       <entry name="product">OpenStack Nova</entry>
Oct 18 12:20:51 user nova-compute[74190]:       <entry name="version">0.0.0</entry>
Oct 18 12:20:51 user nova-compute[74190]:       <entry name="serial">3930e04a-3d64-407c-90c2-f9b14269c27c</entry>
Oct 18 12:20:51 user nova-compute[74190]:       <entry name="uuid">3930e04a-3d64-407c-90c2-f9b14269c27c</entry>
Oct 18 12:20:51 user nova-compute[74190]:       <entry name="family">Virtual Machine</entry>
Oct 18 12:20:51 user nova-compute[74190]:     </system>
Oct 18 12:20:51 user nova-compute[74190]:   </sysinfo>
Oct 18 12:20:51 user nova-compute[74190]:   <os>
Oct 18 12:20:51 user nova-compute[74190]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 12:20:51 user nova-compute[74190]:     <boot dev="hd"/>
Oct 18 12:20:51 user nova-compute[74190]:     <smbios mode="sysinfo"/>
Oct 18 12:20:51 user nova-compute[74190]:   </os>
Oct 18 12:20:51 user nova-compute[74190]:   <features>
Oct 18 12:20:51 user nova-compute[74190]:     <acpi/>
Oct 18 12:20:51 user nova-compute[74190]:     <apic/>
Oct 18 12:20:51 user nova-compute[74190]:     <vmcoreinfo/>
Oct 18 12:20:51 user nova-compute[74190]:   </features>
Oct 18 12:20:51 user nova-compute[74190]:   <clock offset="utc">
Oct 18 12:20:51 user nova-compute[74190]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 12:20:51 user nova-compute[74190]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 12:20:51 user nova-compute[74190]:     <timer name="hpet" present="no"/>
Oct 18 12:20:51 user nova-compute[74190]:   </clock>
Oct 18 12:20:51 user nova-compute[74190]:   <cpu mode="custom" match="exact">
Oct 18 12:20:51 user nova-compute[74190]:     <model>Nehalem</model>
Oct 18 12:20:51 user nova-compute[74190]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 12:20:51 user nova-compute[74190]:   </cpu>
Oct 18 12:20:51 user nova-compute[74190]:   <devices>
Oct 18 12:20:51 user nova-compute[74190]:     <disk type="block" device="disk">
Oct 18 12:20:51 user nova-compute[74190]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 12:20:51 user nova-compute[74190]:       <source dev="/dev/sdc"/>
Oct 18 12:20:51 user nova-compute[74190]:       <target dev="vda" bus="virtio"/>
Oct 18 12:20:51 user nova-compute[74190]:       <serial>d5754ff3-a98f-456d-a996-b69cfc9a458e</serial>
Oct 18 12:20:51 user nova-compute[74190]:     </disk>
Oct 18 12:20:51 user nova-compute[74190]:     <interface type="ethernet">
Oct 18 12:20:51 user nova-compute[74190]:       <mac address="fa:16:3e:2e:bb:8f"/>
Oct 18 12:20:51 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 12:20:51 user nova-compute[74190]:       <mtu size="1442"/>
Oct 18 12:20:51 user nova-compute[74190]:       <target dev="tapf5a6b75c-7b"/>
Oct 18 12:20:51 user nova-compute[74190]:     </interface>
Oct 18 12:20:51 user nova-compute[74190]:     <serial type="pty">
Oct 18 12:20:51 user nova-compute[74190]:       <log file="/opt/stack/data/nova/instances/3930e04a-3d64-407c-90c2-f9b14269c27c/console.log" append="off"/>
Oct 18 12:20:51 user nova-compute[74190]:     </serial>
Oct 18 12:20:51 user nova-compute[74190]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 12:20:51 user nova-compute[74190]:     <video>
Oct 18 12:20:51 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 12:20:51 user nova-compute[74190]:     </video>
Oct 18 12:20:51 user nova-compute[74190]:     <rng model="virtio">
Oct 18 12:20:51 user nova-compute[74190]:       <backend model="random">/dev/urandom</backend>
Oct 18 12:20:51 user nova-compute[74190]:     </rng>
Oct 18 12:20:51 user nova-compute[74190]:     <controller type="usb" index="0" model="none"/>
Oct 18 12:20:51 user nova-compute[74190]:     <memballoon model="virtio">
Oct 18 12:20:51 user nova-compute[74190]:       <stats period="10"/>
Oct 18 12:20:51 user nova-compute[74190]:     </memballoon>
Oct 18 12:20:51 user nova-compute[74190]:   </devices>
Oct 18 12:20:51 user nova-compute[74190]: </domain>
Oct 18 12:20:51 user nova-compute[74190]:  {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 12:20:51 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T12:20:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-683322485',display_name='tempest-TestVolumeBootPattern-server-683322485',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-683322485',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFImDkcHIZVVsD1gB2Yh4JGNE0pEbAN8TUjpItUrbhxdmYRzrbNlPip8qPxIcvk8OJEen8xQaAGxdqzAZ1w6kqPbscsnuFtwOBrKfpec5lSOkFKoHZaLFZ1ci5kqBfXOJw==',key_name='tempest-TestVolumeBootPattern-131084726',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e375153f6f24827811c5825fc2a2c6a',ramdisk_id='',reservation_id='r-uk111vii',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1157442382',owner_user_name='tempest-TestVolumeBootPattern-1157442382-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T12:20:32Z,user_data=None,user_id='27d9fc244d0f4e10a43b7df4dc8e30ad',uuid=3930e04a-3d64-407c-90c2-f9b14269c27c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f5a6b75c-7bcb-4a37-96aa-c30430598ecd", "address": "fa:16:3e:2e:bb:8f", "network": {"id": "aa827f81-b165-444f-89cc-f21c42a9f772", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1659902586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e375153f6f24827811c5825fc2a2c6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a6b75c-7b", "ovs_interfaceid": "f5a6b75c-7bcb-4a37-96aa-c30430598ecd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 12:20:51 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Converting VIF {"id": "f5a6b75c-7bcb-4a37-96aa-c30430598ecd", "address": "fa:16:3e:2e:bb:8f", "network": {"id": "aa827f81-b165-444f-89cc-f21c42a9f772", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1659902586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e375153f6f24827811c5825fc2a2c6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a6b75c-7b", "ovs_interfaceid": "f5a6b75c-7bcb-4a37-96aa-c30430598ecd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 12:20:51 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:bb:8f,bridge_name='br-int',has_traffic_filtering=True,id=f5a6b75c-7bcb-4a37-96aa-c30430598ecd,network=Network(aa827f81-b165-444f-89cc-f21c42a9f772),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5a6b75c-7b') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 12:20:51 user nova-compute[74190]: DEBUG os_vif [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:bb:8f,bridge_name='br-int',has_traffic_filtering=True,id=f5a6b75c-7bcb-4a37-96aa-c30430598ecd,network=Network(aa827f81-b165-444f-89cc-f21c42a9f772),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5a6b75c-7b') {{(pid=74190) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 12:20:51 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:20:51 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:20:51 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 12:20:51 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:20:51 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7fb89cf4-c2c6-5d51-a35a-57b68ff82700', '_type': 'linux-noop'}}, row=False) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:20:51 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:20:51 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:20:51 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:20:51 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf5a6b75c-7b, may_exist=True, interface_attrs={}) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:20:51 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf5a6b75c-7b, col_values=(('qos', UUID('df1fdd84-87a7-42be-8ddd-ebdf0b86ab0d')),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:20:51 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf5a6b75c-7b, col_values=(('external_ids', {'iface-id': 'f5a6b75c-7bcb-4a37-96aa-c30430598ecd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:bb:8f', 'vm-uuid': '3930e04a-3d64-407c-90c2-f9b14269c27c'}),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:20:51 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:20:51 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:20:51 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:20:51 user nova-compute[74190]: INFO os_vif [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:bb:8f,bridge_name='br-int',has_traffic_filtering=True,id=f5a6b75c-7bcb-4a37-96aa-c30430598ecd,network=Network(aa827f81-b165-444f-89cc-f21c42a9f772),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5a6b75c-7b')
Oct 18 12:20:51 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] No BDM found with device name vda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 12:20:51 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] No VIF found with MAC fa:16:3e:2e:bb:8f, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 12:20:52 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:20:52 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:20:52 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:20:52 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:20:52 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:20:52 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:20:52 user nova-compute[74190]: DEBUG nova.compute.manager [req-6016b9ef-e92c-4e01-a2fd-06264e034473 req-1d21e7a8-79a6-42c8-a035-f9a4dc89fc5b service nova] [instance: 3930e04a-3d64-407c-90c2-f9b14269c27c] Received event network-vif-plugged-f5a6b75c-7bcb-4a37-96aa-c30430598ecd {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:20:52 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-6016b9ef-e92c-4e01-a2fd-06264e034473 req-1d21e7a8-79a6-42c8-a035-f9a4dc89fc5b service nova] Acquiring lock "3930e04a-3d64-407c-90c2-f9b14269c27c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:20:52 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-6016b9ef-e92c-4e01-a2fd-06264e034473 req-1d21e7a8-79a6-42c8-a035-f9a4dc89fc5b service nova] Lock "3930e04a-3d64-407c-90c2-f9b14269c27c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:20:52 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-6016b9ef-e92c-4e01-a2fd-06264e034473 req-1d21e7a8-79a6-42c8-a035-f9a4dc89fc5b service nova] Lock "3930e04a-3d64-407c-90c2-f9b14269c27c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:20:52 user nova-compute[74190]: DEBUG nova.compute.manager [req-6016b9ef-e92c-4e01-a2fd-06264e034473 req-1d21e7a8-79a6-42c8-a035-f9a4dc89fc5b service nova] [instance: 3930e04a-3d64-407c-90c2-f9b14269c27c] No waiting events found dispatching network-vif-plugged-f5a6b75c-7bcb-4a37-96aa-c30430598ecd {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:20:52 user nova-compute[74190]: WARNING nova.compute.manager [req-6016b9ef-e92c-4e01-a2fd-06264e034473 req-1d21e7a8-79a6-42c8-a035-f9a4dc89fc5b service nova] [instance: 3930e04a-3d64-407c-90c2-f9b14269c27c] Received unexpected event network-vif-plugged-f5a6b75c-7bcb-4a37-96aa-c30430598ecd for instance with vm_state building and task_state spawning.
Oct 18 12:20:54 user nova-compute[74190]: DEBUG nova.compute.manager [req-39842cdf-34a7-4784-8e73-e5e00f35b91a req-05951905-8d67-4f01-8624-b8559dc1d23d service nova] [instance: 3930e04a-3d64-407c-90c2-f9b14269c27c] Received event network-vif-plugged-f5a6b75c-7bcb-4a37-96aa-c30430598ecd {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:20:54 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-39842cdf-34a7-4784-8e73-e5e00f35b91a req-05951905-8d67-4f01-8624-b8559dc1d23d service nova] Acquiring lock "3930e04a-3d64-407c-90c2-f9b14269c27c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:20:54 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-39842cdf-34a7-4784-8e73-e5e00f35b91a req-05951905-8d67-4f01-8624-b8559dc1d23d service nova] Lock "3930e04a-3d64-407c-90c2-f9b14269c27c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:20:54 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-39842cdf-34a7-4784-8e73-e5e00f35b91a req-05951905-8d67-4f01-8624-b8559dc1d23d service nova] Lock "3930e04a-3d64-407c-90c2-f9b14269c27c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:20:54 user nova-compute[74190]: DEBUG nova.compute.manager [req-39842cdf-34a7-4784-8e73-e5e00f35b91a req-05951905-8d67-4f01-8624-b8559dc1d23d service nova] [instance: 3930e04a-3d64-407c-90c2-f9b14269c27c] No waiting events found dispatching network-vif-plugged-f5a6b75c-7bcb-4a37-96aa-c30430598ecd {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:20:54 user nova-compute[74190]: WARNING nova.compute.manager [req-39842cdf-34a7-4784-8e73-e5e00f35b91a req-05951905-8d67-4f01-8624-b8559dc1d23d service nova] [instance: 3930e04a-3d64-407c-90c2-f9b14269c27c] Received unexpected event network-vif-plugged-f5a6b75c-7bcb-4a37-96aa-c30430598ecd for instance with vm_state building and task_state spawning.
Oct 18 12:20:54 user nova-compute[74190]: DEBUG nova.compute.manager [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 3930e04a-3d64-407c-90c2-f9b14269c27c] Instance event wait completed in 0 seconds for  {{(pid=74190) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 12:20:54 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 3930e04a-3d64-407c-90c2-f9b14269c27c] Guest created on hypervisor {{(pid=74190) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 12:20:54 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 3930e04a-3d64-407c-90c2-f9b14269c27c] Instance spawned successfully.
Oct 18 12:20:54 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 3930e04a-3d64-407c-90c2-f9b14269c27c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 12:20:54 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 3930e04a-3d64-407c-90c2-f9b14269c27c] Found default for hw_cdrom_bus of ide {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:20:54 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 3930e04a-3d64-407c-90c2-f9b14269c27c] Found default for hw_disk_bus of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:20:54 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 3930e04a-3d64-407c-90c2-f9b14269c27c] Found default for hw_input_bus of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:20:54 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 3930e04a-3d64-407c-90c2-f9b14269c27c] Found default for hw_pointer_model of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:20:54 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 3930e04a-3d64-407c-90c2-f9b14269c27c] Found default for hw_video_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:20:54 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 3930e04a-3d64-407c-90c2-f9b14269c27c] Found default for hw_vif_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:20:54 user nova-compute[74190]: INFO nova.compute.manager [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 3930e04a-3d64-407c-90c2-f9b14269c27c] Took 5.23 seconds to spawn the instance on the hypervisor.
Oct 18 12:20:54 user nova-compute[74190]: DEBUG nova.compute.manager [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 3930e04a-3d64-407c-90c2-f9b14269c27c] Checking state {{(pid=74190) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 12:20:55 user nova-compute[74190]: INFO nova.compute.manager [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 3930e04a-3d64-407c-90c2-f9b14269c27c] Took 23.60 seconds to build instance.
Oct 18 12:20:55 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-1116f805-fff3-4521-a207-aa4b0cad8cd8 tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "3930e04a-3d64-407c-90c2-f9b14269c27c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.754s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:20:55 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:20:56 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:21:00 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:21:00 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7daa163d-cf8c-4618-9283-6508986db6ea tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: ebe4e4fe-9614-4065-b84e-a08a50f638b1] Calling os-brick to attach iSCSI Volume {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 12:21:00 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-7daa163d-cf8c-4618-9283-6508986db6ea tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9990667f-585b-42e7-961b-d60be92f2887', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dBbijenm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 12:21:00 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-7daa163d-cf8c-4618-9283-6508986db6ea tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 12:21:00 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-7daa163d-cf8c-4618-9283-6508986db6ea tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 12:21:00 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-7daa163d-cf8c-4618-9283-6508986db6ea tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 12:21:00 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-7daa163d-cf8c-4618-9283-6508986db6ea tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 12:21:00 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-7daa163d-cf8c-4618-9283-6508986db6ea tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9990667f-585b-42e7-961b-d60be92f2887" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 12:21:00 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-7daa163d-cf8c-4618-9283-6508986db6ea tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9990667f-585b-42e7-961b-d60be92f2887" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 12:21:00 user nova-compute[74190]: INFO os_brick.initiator.connectors.iscsi [None req-7daa163d-cf8c-4618-9283-6508986db6ea tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 12:21:00 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9990667f-585b-42e7-961b-d60be92f2887 -p 172.16.0.220:3260 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:21:00 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9990667f-585b-42e7-961b-d60be92f2887 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:21:00 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c89d0bd-fecb-4325-9ee1-7404c2f43221]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:21:00 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-7daa163d-cf8c-4618-9283-6508986db6ea tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 12:21:00 user nova-compute[74190]:  {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:21:00 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9990667f-585b-42e7-961b-d60be92f2887 -p 172.16.0.220:3260 --interface default --op new {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:21:00 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9990667f-585b-42e7-961b-d60be92f2887 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:21:00 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae04e8de-caac-4049-9772-48987712d244]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9990667f-585b-42e7-961b-d60be92f2887] added\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:21:00 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-7daa163d-cf8c-4618-9283-6508986db6ea tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9990667f-585b-42e7-961b-d60be92f2887] added
Oct 18 12:21:00 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:21:00 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9990667f-585b-42e7-961b-d60be92f2887 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:21:00 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9990667f-585b-42e7-961b-d60be92f2887 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:21:00 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[318a757c-7d60-43d4-ba14-5ca99624091d]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:21:00 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-7daa163d-cf8c-4618-9283-6508986db6ea tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:21:00 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9990667f-585b-42e7-961b-d60be92f2887 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:21:00 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9990667f-585b-42e7-961b-d60be92f2887 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:21:00 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[92799c20-e760-4224-86a3-5449e546a61a]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:21:00 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-7daa163d-cf8c-4618-9283-6508986db6ea tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:21:00 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9990667f-585b-42e7-961b-d60be92f2887 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dBbijenm {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:21:00 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9990667f-585b-42e7-961b-d60be92f2887 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dBbijenm" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:21:00 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[a33d0e36-1572-4cb0-9f37-728cf0a79d8f]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:21:00 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-7daa163d-cf8c-4618-9283-6508986db6ea tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dBbijenm'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:21:00 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9990667f-585b-42e7-961b-d60be92f2887 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:21:00 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9990667f-585b-42e7-961b-d60be92f2887 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:21:00 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ed03a9-4e82-4005-a8da-e1b7d37417c8]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:21:00 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-7daa163d-cf8c-4618-9283-6508986db6ea tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:21:00 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:21:00 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:21:00 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b8366fc-bb74-46f5-a4e3-f56bb115896b]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5754ff3-a98f-456d-a996-b69cfc9a458e (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:21:00 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-7daa163d-cf8c-4618-9283-6508986db6ea tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18 (non-flash)
Oct 18 12:21:00 user nova-compute[74190]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5754ff3-a98f-456d-a996-b69cfc9a458e (non-flash)
Oct 18 12:21:00 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 12:21:00 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-7daa163d-cf8c-4618-9283-6508986db6ea tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18 (non-flash)
Oct 18 12:21:00 user nova-compute[74190]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5754ff3-a98f-456d-a996-b69cfc9a458e (non-flash)
Oct 18 12:21:00 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 12:21:00 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9990667f-585b-42e7-961b-d60be92f2887 -p 172.16.0.220:3260 --login {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:21:01 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9990667f-585b-42e7-961b-d60be92f2887 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:21:01 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf6a3c4-8fe1-4c36-87b3-60d0d5dade2c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9990667f-585b-42e7-961b-d60be92f2887, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9990667f-585b-42e7-961b-d60be92f2887, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:21:01 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-7daa163d-cf8c-4618-9283-6508986db6ea tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9990667f-585b-42e7-961b-d60be92f2887, portal: 172.16.0.220,3260]
Oct 18 12:21:01 user nova-compute[74190]: Login to [iface: default, target: iqn.2010-10.org.openstack:9990667f-585b-42e7-961b-d60be92f2887, portal: 172.16.0.220,3260] successful.
Oct 18 12:21:01 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:21:01 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9990667f-585b-42e7-961b-d60be92f2887 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:21:01 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9990667f-585b-42e7-961b-d60be92f2887 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:21:01 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7919db4-4aef-47bf-a86e-69dd0b328f91]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:21:01 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-7daa163d-cf8c-4618-9283-6508986db6ea tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:21:01 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:21:01 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:21:01 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeabc9d7-6e55-400a-96a4-c119a1b8b143]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5754ff3-a98f-456d-a996-b69cfc9a458e (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9990667f-585b-42e7-961b-d60be92f2887 (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:21:01 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-7daa163d-cf8c-4618-9283-6508986db6ea tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18 (non-flash)
Oct 18 12:21:01 user nova-compute[74190]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5754ff3-a98f-456d-a996-b69cfc9a458e (non-flash)
Oct 18 12:21:01 user nova-compute[74190]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9990667f-585b-42e7-961b-d60be92f2887 (non-flash)
Oct 18 12:21:01 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 12:21:01 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-7daa163d-cf8c-4618-9283-6508986db6ea tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18 (non-flash)
Oct 18 12:21:01 user nova-compute[74190]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5754ff3-a98f-456d-a996-b69cfc9a458e (non-flash)
Oct 18 12:21:01 user nova-compute[74190]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9990667f-585b-42e7-961b-d60be92f2887 (non-flash)
Oct 18 12:21:01 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 12:21:01 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-7daa163d-cf8c-4618-9283-6508986db6ea tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9990667f-585b-42e7-961b-d60be92f2887" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 12:21:01 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-7daa163d-cf8c-4618-9283-6508986db6ea tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Connected to 172.16.0.220:3260 {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 12:21:01 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-7daa163d-cf8c-4618-9283-6508986db6ea tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] HCTL ('35', '-', '-', 0) found on session 58 with lun 0 {{(pid=74190) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 12:21:01 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-7daa163d-cf8c-4618-9283-6508986db6ea tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74190) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 12:21:01 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:21:01 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:21:01 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:21:01 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ed1001-f12c-46a1-bf6d-3846d12489ca]: (4, ('- - 0', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:21:01 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-7daa163d-cf8c-4618-9283-6508986db6ea tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Searching for a device in session 58 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74190) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 12:21:01 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-7daa163d-cf8c-4618-9283-6508986db6ea tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:9990667f-585b-42e7-961b-d60be92f2887', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dBbijenm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 12:21:02 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-7daa163d-cf8c-4618-9283-6508986db6ea tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 12:21:02 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-7daa163d-cf8c-4618-9283-6508986db6ea tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '23030613563363466', 'path': '/dev/sdd'} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 12:21:02 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7daa163d-cf8c-4618-9283-6508986db6ea tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: ebe4e4fe-9614-4065-b84e-a08a50f638b1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23030613563363466', 'path': '/dev/sdd'} {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 12:21:02 user nova-compute[74190]: DEBUG nova.objects.instance [None req-7daa163d-cf8c-4618-9283-6508986db6ea tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Lazy-loading 'flavor' on Instance uuid ebe4e4fe-9614-4065-b84e-a08a50f638b1 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:21:02 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-7daa163d-cf8c-4618-9283-6508986db6ea tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] attach device xml: <disk type="block" device="disk">
Oct 18 12:21:02 user nova-compute[74190]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 12:21:02 user nova-compute[74190]:   <source dev="/dev/sdd"/>
Oct 18 12:21:02 user nova-compute[74190]:   <target dev="vdb" bus="virtio"/>
Oct 18 12:21:02 user nova-compute[74190]:   <serial>9990667f-585b-42e7-961b-d60be92f2887</serial>
Oct 18 12:21:02 user nova-compute[74190]: </disk>
Oct 18 12:21:02 user nova-compute[74190]:  {{(pid=74190) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 18 12:21:02 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-7daa163d-cf8c-4618-9283-6508986db6ea tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] No BDM found with device name vda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 12:21:02 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-7daa163d-cf8c-4618-9283-6508986db6ea tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 12:21:02 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-7daa163d-cf8c-4618-9283-6508986db6ea tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] No VIF found with MAC fa:16:3e:2e:61:70, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 12:21:02 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-7daa163d-cf8c-4618-9283-6508986db6ea tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Lock "ebe4e4fe-9614-4065-b84e-a08a50f638b1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.233s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:21:06 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:21:06 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:21:06 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74190) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 12:21:06 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:21:06 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:21:06 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:21:10 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:21:11 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:21:15 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:21:16 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:21:19 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:21:20 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:21:21 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:21:25 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:21:26 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:21:26 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:21:26 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:21:29 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:21:29 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Starting heal instance info cache {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 12:21:29 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "refresh_cache-ebe4e4fe-9614-4065-b84e-a08a50f638b1" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:21:29 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquired lock "refresh_cache-ebe4e4fe-9614-4065-b84e-a08a50f638b1" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:21:29 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: ebe4e4fe-9614-4065-b84e-a08a50f638b1] Forcefully refreshing network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 18 12:21:29 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: ebe4e4fe-9614-4065-b84e-a08a50f638b1] Updating instance_info_cache with network_info: [{"id": "b764c6cd-7473-45e0-acac-9c20fc355d2e", "address": "fa:16:3e:2e:61:70", "network": {"id": "1afc08fa-4518-4ccf-97a1-22f04820b31c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-687660220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e49c9e381b0457faa31d0f5bdfa3f18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb764c6cd-74", "ovs_interfaceid": "b764c6cd-7473-45e0-acac-9c20fc355d2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:21:29 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Releasing lock "refresh_cache-ebe4e4fe-9614-4065-b84e-a08a50f638b1" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:21:29 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: ebe4e4fe-9614-4065-b84e-a08a50f638b1] Updated the network info_cache for instance {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 18 12:21:30 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:21:30 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:21:31 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:21:31 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74190) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 12:21:31 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:21:31 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:21:31 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74190) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 12:21:31 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:21:31 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:21:31 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:21:32 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:21:32 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:21:32 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:21:32 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:21:32 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Auditing locally available compute resources for user (node: user) {{(pid=74190) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 12:21:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7983ceaf-8ed3-4321-a242-2e44218f4d0b/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:21:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7983ceaf-8ed3-4321-a242-2e44218f4d0b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:21:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7983ceaf-8ed3-4321-a242-2e44218f4d0b/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:21:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7983ceaf-8ed3-4321-a242-2e44218f4d0b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:21:32 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 12:21:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebe4e4fe-9614-4065-b84e-a08a50f638b1/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:21:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebe4e4fe-9614-4065-b84e-a08a50f638b1/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:21:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebe4e4fe-9614-4065-b84e-a08a50f638b1/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:21:32 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebe4e4fe-9614-4065-b84e-a08a50f638b1/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:21:32 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 12:21:32 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 12:21:33 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:21:33 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:21:33 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Hypervisor/Node resource view: name=user free_ram=8494MB free_disk=25.17790985107422GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74190) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 12:21:33 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:21:33 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:21:33 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 7983ceaf-8ed3-4321-a242-2e44218f4d0b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:21:33 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:21:33 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance ebe4e4fe-9614-4065-b84e-a08a50f638b1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:21:33 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 3930e04a-3d64-407c-90c2-f9b14269c27c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:21:33 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 12:21:33 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 12:21:33 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 12:21:33 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 12:21:33 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Compute_service record updated for user:user {{(pid=74190) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 12:21:33 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.290s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:21:34 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:21:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:21:38 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-090b11ed-b639-4d1b-948e-4987a088400e tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Acquiring lock "7983ceaf-8ed3-4321-a242-2e44218f4d0b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:21:38 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-090b11ed-b639-4d1b-948e-4987a088400e tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Lock "7983ceaf-8ed3-4321-a242-2e44218f4d0b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:21:38 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-090b11ed-b639-4d1b-948e-4987a088400e tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Acquiring lock "7983ceaf-8ed3-4321-a242-2e44218f4d0b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:21:38 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-090b11ed-b639-4d1b-948e-4987a088400e tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Lock "7983ceaf-8ed3-4321-a242-2e44218f4d0b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:21:38 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-090b11ed-b639-4d1b-948e-4987a088400e tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Lock "7983ceaf-8ed3-4321-a242-2e44218f4d0b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:21:38 user nova-compute[74190]: INFO nova.compute.manager [None req-090b11ed-b639-4d1b-948e-4987a088400e tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] [instance: 7983ceaf-8ed3-4321-a242-2e44218f4d0b] Terminating instance
Oct 18 12:21:38 user nova-compute[74190]: DEBUG nova.compute.manager [None req-090b11ed-b639-4d1b-948e-4987a088400e tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] [instance: 7983ceaf-8ed3-4321-a242-2e44218f4d0b] Start destroying the instance on the hypervisor. {{(pid=74190) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 12:21:38 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:21:38 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:21:38 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:21:38 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:21:38 user nova-compute[74190]: DEBUG nova.compute.manager [req-c4bfdebe-1e18-499f-9534-8ea10be5cc3f req-5433540c-4c8a-4c1a-892e-564a9dd6a000 service nova] [instance: 7983ceaf-8ed3-4321-a242-2e44218f4d0b] Received event network-vif-unplugged-28ca935e-3c1c-47dc-8b10-d7a5cb602470 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:21:38 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-c4bfdebe-1e18-499f-9534-8ea10be5cc3f req-5433540c-4c8a-4c1a-892e-564a9dd6a000 service nova] Acquiring lock "7983ceaf-8ed3-4321-a242-2e44218f4d0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:21:38 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-c4bfdebe-1e18-499f-9534-8ea10be5cc3f req-5433540c-4c8a-4c1a-892e-564a9dd6a000 service nova] Lock "7983ceaf-8ed3-4321-a242-2e44218f4d0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:21:38 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-c4bfdebe-1e18-499f-9534-8ea10be5cc3f req-5433540c-4c8a-4c1a-892e-564a9dd6a000 service nova] Lock "7983ceaf-8ed3-4321-a242-2e44218f4d0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:21:38 user nova-compute[74190]: DEBUG nova.compute.manager [req-c4bfdebe-1e18-499f-9534-8ea10be5cc3f req-5433540c-4c8a-4c1a-892e-564a9dd6a000 service nova] [instance: 7983ceaf-8ed3-4321-a242-2e44218f4d0b] No waiting events found dispatching network-vif-unplugged-28ca935e-3c1c-47dc-8b10-d7a5cb602470 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:21:38 user nova-compute[74190]: DEBUG nova.compute.manager [req-c4bfdebe-1e18-499f-9534-8ea10be5cc3f req-5433540c-4c8a-4c1a-892e-564a9dd6a000 service nova] [instance: 7983ceaf-8ed3-4321-a242-2e44218f4d0b] Received event network-vif-unplugged-28ca935e-3c1c-47dc-8b10-d7a5cb602470 for instance with task_state deleting. {{(pid=74190) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 12:21:38 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:21:39 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:21:39 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 7983ceaf-8ed3-4321-a242-2e44218f4d0b] Instance destroyed successfully.
Oct 18 12:21:39 user nova-compute[74190]: DEBUG nova.objects.instance [None req-090b11ed-b639-4d1b-948e-4987a088400e tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Lazy-loading 'resources' on Instance uuid 7983ceaf-8ed3-4321-a242-2e44218f4d0b {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:21:39 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-090b11ed-b639-4d1b-948e-4987a088400e tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T12:12:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-567421608',display_name='tempest-ServersNegativeTestJSON-server-567421608',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-567421608',id=44,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-18T12:12:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f84b62d410cc448486b792e094464815',ramdisk_id='',reservation_id='r-u3e0vfui',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1845899853',owner_user_name='tempest-ServersNegativeTestJSON-1845899853-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T12:12:40Z,user_data=None,user_id='abbdcac234ac48acbc56abf3fda115e5',uuid=7983ceaf-8ed3-4321-a242-2e44218f4d0b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "28ca935e-3c1c-47dc-8b10-d7a5cb602470", "address": "fa:16:3e:b8:5e:82", "network": {"id": "31e59f3e-dc25-4b00-9d87-4b4f695425b8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-220402675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f84b62d410cc448486b792e094464815", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28ca935e-3c", "ovs_interfaceid": "28ca935e-3c1c-47dc-8b10-d7a5cb602470", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 12:21:39 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-090b11ed-b639-4d1b-948e-4987a088400e tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Converting VIF {"id": "28ca935e-3c1c-47dc-8b10-d7a5cb602470", "address": "fa:16:3e:b8:5e:82", "network": {"id": "31e59f3e-dc25-4b00-9d87-4b4f695425b8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-220402675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f84b62d410cc448486b792e094464815", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28ca935e-3c", "ovs_interfaceid": "28ca935e-3c1c-47dc-8b10-d7a5cb602470", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 12:21:39 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-090b11ed-b639-4d1b-948e-4987a088400e tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b8:5e:82,bridge_name='br-int',has_traffic_filtering=True,id=28ca935e-3c1c-47dc-8b10-d7a5cb602470,network=Network(31e59f3e-dc25-4b00-9d87-4b4f695425b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28ca935e-3c') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 12:21:39 user nova-compute[74190]: DEBUG os_vif [None req-090b11ed-b639-4d1b-948e-4987a088400e tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:5e:82,bridge_name='br-int',has_traffic_filtering=True,id=28ca935e-3c1c-47dc-8b10-d7a5cb602470,network=Network(31e59f3e-dc25-4b00-9d87-4b4f695425b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28ca935e-3c') {{(pid=74190) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 12:21:39 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:21:39 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap28ca935e-3c, bridge=br-int, if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:21:39 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:21:39 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:21:39 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:21:39 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0ee6cbcd-4019-4e0e-970c-8207dc0acc13) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:21:39 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:21:39 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:21:39 user nova-compute[74190]: INFO os_vif [None req-090b11ed-b639-4d1b-948e-4987a088400e tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:5e:82,bridge_name='br-int',has_traffic_filtering=True,id=28ca935e-3c1c-47dc-8b10-d7a5cb602470,network=Network(31e59f3e-dc25-4b00-9d87-4b4f695425b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28ca935e-3c')
Oct 18 12:21:39 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-090b11ed-b639-4d1b-948e-4987a088400e tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] [instance: 7983ceaf-8ed3-4321-a242-2e44218f4d0b] Deleting instance files /opt/stack/data/nova/instances/7983ceaf-8ed3-4321-a242-2e44218f4d0b_del
Oct 18 12:21:39 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-090b11ed-b639-4d1b-948e-4987a088400e tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] [instance: 7983ceaf-8ed3-4321-a242-2e44218f4d0b] Deletion of /opt/stack/data/nova/instances/7983ceaf-8ed3-4321-a242-2e44218f4d0b_del complete
Oct 18 12:21:39 user nova-compute[74190]: INFO nova.compute.manager [None req-090b11ed-b639-4d1b-948e-4987a088400e tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] [instance: 7983ceaf-8ed3-4321-a242-2e44218f4d0b] Took 0.94 seconds to destroy the instance on the hypervisor.
Oct 18 12:21:39 user nova-compute[74190]: DEBUG oslo.service.loopingcall [None req-090b11ed-b639-4d1b-948e-4987a088400e tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74190) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 12:21:39 user nova-compute[74190]: DEBUG nova.compute.manager [-] [instance: 7983ceaf-8ed3-4321-a242-2e44218f4d0b] Deallocating network for instance {{(pid=74190) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 12:21:39 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: 7983ceaf-8ed3-4321-a242-2e44218f4d0b] deallocate_for_instance() {{(pid=74190) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 12:21:39 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: 7983ceaf-8ed3-4321-a242-2e44218f4d0b] Updating instance_info_cache with network_info: [] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:21:39 user nova-compute[74190]: INFO nova.compute.manager [-] [instance: 7983ceaf-8ed3-4321-a242-2e44218f4d0b] Took 0.69 seconds to deallocate network for instance.
Oct 18 12:21:40 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-090b11ed-b639-4d1b-948e-4987a088400e tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:21:40 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-090b11ed-b639-4d1b-948e-4987a088400e tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:21:40 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-090b11ed-b639-4d1b-948e-4987a088400e tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 12:21:40 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-090b11ed-b639-4d1b-948e-4987a088400e tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 12:21:40 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-090b11ed-b639-4d1b-948e-4987a088400e tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.240s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:21:40 user nova-compute[74190]: INFO nova.scheduler.client.report [None req-090b11ed-b639-4d1b-948e-4987a088400e tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Deleted allocations for instance 7983ceaf-8ed3-4321-a242-2e44218f4d0b
Oct 18 12:21:40 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-090b11ed-b639-4d1b-948e-4987a088400e tempest-ServersNegativeTestJSON-1845899853 tempest-ServersNegativeTestJSON-1845899853-project-member] Lock "7983ceaf-8ed3-4321-a242-2e44218f4d0b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.164s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:21:40 user nova-compute[74190]: DEBUG nova.compute.manager [req-8ce8098b-5252-4a40-af15-ceec9eae1d05 req-744cd75c-0ca7-403e-8a65-0bb2bf0ef6c2 service nova] [instance: 7983ceaf-8ed3-4321-a242-2e44218f4d0b] Received event network-vif-plugged-28ca935e-3c1c-47dc-8b10-d7a5cb602470 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:21:40 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-8ce8098b-5252-4a40-af15-ceec9eae1d05 req-744cd75c-0ca7-403e-8a65-0bb2bf0ef6c2 service nova] Acquiring lock "7983ceaf-8ed3-4321-a242-2e44218f4d0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:21:40 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-8ce8098b-5252-4a40-af15-ceec9eae1d05 req-744cd75c-0ca7-403e-8a65-0bb2bf0ef6c2 service nova] Lock "7983ceaf-8ed3-4321-a242-2e44218f4d0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:21:40 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-8ce8098b-5252-4a40-af15-ceec9eae1d05 req-744cd75c-0ca7-403e-8a65-0bb2bf0ef6c2 service nova] Lock "7983ceaf-8ed3-4321-a242-2e44218f4d0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:21:40 user nova-compute[74190]: DEBUG nova.compute.manager [req-8ce8098b-5252-4a40-af15-ceec9eae1d05 req-744cd75c-0ca7-403e-8a65-0bb2bf0ef6c2 service nova] [instance: 7983ceaf-8ed3-4321-a242-2e44218f4d0b] No waiting events found dispatching network-vif-plugged-28ca935e-3c1c-47dc-8b10-d7a5cb602470 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:21:40 user nova-compute[74190]: WARNING nova.compute.manager [req-8ce8098b-5252-4a40-af15-ceec9eae1d05 req-744cd75c-0ca7-403e-8a65-0bb2bf0ef6c2 service nova] [instance: 7983ceaf-8ed3-4321-a242-2e44218f4d0b] Received unexpected event network-vif-plugged-28ca935e-3c1c-47dc-8b10-d7a5cb602470 for instance with vm_state deleted and task_state None.
Oct 18 12:21:40 user nova-compute[74190]: DEBUG nova.compute.manager [req-8ce8098b-5252-4a40-af15-ceec9eae1d05 req-744cd75c-0ca7-403e-8a65-0bb2bf0ef6c2 service nova] [instance: 7983ceaf-8ed3-4321-a242-2e44218f4d0b] Received event network-vif-deleted-28ca935e-3c1c-47dc-8b10-d7a5cb602470 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:21:44 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:21:49 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:21:50 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-96b0f0a9-7442-40ea-9747-a85471946a0c tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Acquiring lock "ebe4e4fe-9614-4065-b84e-a08a50f638b1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:21:50 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-96b0f0a9-7442-40ea-9747-a85471946a0c tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Lock "ebe4e4fe-9614-4065-b84e-a08a50f638b1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:21:50 user nova-compute[74190]: INFO nova.compute.manager [None req-96b0f0a9-7442-40ea-9747-a85471946a0c tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: ebe4e4fe-9614-4065-b84e-a08a50f638b1] Detaching volume 9990667f-585b-42e7-961b-d60be92f2887
Oct 18 12:21:50 user nova-compute[74190]: INFO nova.virt.block_device [None req-96b0f0a9-7442-40ea-9747-a85471946a0c tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: ebe4e4fe-9614-4065-b84e-a08a50f638b1] Attempting to driver detach volume 9990667f-585b-42e7-961b-d60be92f2887 from mountpoint /dev/vdb
Oct 18 12:21:50 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-96b0f0a9-7442-40ea-9747-a85471946a0c tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Attempting to detach device vdb from instance ebe4e4fe-9614-4065-b84e-a08a50f638b1 from the persistent domain config. {{(pid=74190) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 18 12:21:50 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-96b0f0a9-7442-40ea-9747-a85471946a0c tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 12:21:50 user nova-compute[74190]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 12:21:50 user nova-compute[74190]:   <source dev="/dev/sdd"/>
Oct 18 12:21:50 user nova-compute[74190]:   <target dev="vdb" bus="virtio"/>
Oct 18 12:21:50 user nova-compute[74190]:   <serial>9990667f-585b-42e7-961b-d60be92f2887</serial>
Oct 18 12:21:50 user nova-compute[74190]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 18 12:21:50 user nova-compute[74190]: </disk>
Oct 18 12:21:50 user nova-compute[74190]:  {{(pid=74190) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 12:21:50 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-96b0f0a9-7442-40ea-9747-a85471946a0c tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Successfully detached device vdb from instance ebe4e4fe-9614-4065-b84e-a08a50f638b1 from the persistent domain config.
Oct 18 12:21:50 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-96b0f0a9-7442-40ea-9747-a85471946a0c tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ebe4e4fe-9614-4065-b84e-a08a50f638b1 from the live domain config. {{(pid=74190) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 18 12:21:50 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-96b0f0a9-7442-40ea-9747-a85471946a0c tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 12:21:50 user nova-compute[74190]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 12:21:50 user nova-compute[74190]:   <source dev="/dev/sdd"/>
Oct 18 12:21:50 user nova-compute[74190]:   <target dev="vdb" bus="virtio"/>
Oct 18 12:21:50 user nova-compute[74190]:   <serial>9990667f-585b-42e7-961b-d60be92f2887</serial>
Oct 18 12:21:50 user nova-compute[74190]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 18 12:21:50 user nova-compute[74190]: </disk>
Oct 18 12:21:50 user nova-compute[74190]:  {{(pid=74190) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 12:21:50 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-0f8929c2-60b9-4fe1-9dcb-2dc73179c711 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Acquiring lock "ebe4e4fe-9614-4065-b84e-a08a50f638b1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:21:50 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-96b0f0a9-7442-40ea-9747-a85471946a0c tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ebe4e4fe-9614-4065-b84e-a08a50f638b1 {{(pid=74190) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 18 12:21:54 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:21:54 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:21:54 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74190) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 12:21:54 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:21:54 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:21:54 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:21:59 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:22:04 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:22:09 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:22:10 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-96b0f0a9-7442-40ea-9747-a85471946a0c tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ebe4e4fe-9614-4065-b84e-a08a50f638b1 is timed out.
Oct 18 12:22:10 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-96b0f0a9-7442-40ea-9747-a85471946a0c tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Successfully detached device vdb from instance ebe4e4fe-9614-4065-b84e-a08a50f638b1 from the live domain config.
Oct 18 12:22:10 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96b0f0a9-7442-40ea-9747-a85471946a0c tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: ebe4e4fe-9614-4065-b84e-a08a50f638b1] calling os-brick to detach iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 12:22:10 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-96b0f0a9-7442-40ea-9747-a85471946a0c tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, {'target_iqn': 'iqn.2010-10.org.openstack:9990667f-585b-42e7-961b-d60be92f2887', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dBbijenm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 12:22:10 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-96b0f0a9-7442-40ea-9747-a85471946a0c tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 12:22:10 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-96b0f0a9-7442-40ea-9747-a85471946a0c tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 12:22:10 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-96b0f0a9-7442-40ea-9747-a85471946a0c tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 12:22:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:22:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:22:10 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c163c8-db1b-4b35-9b6a-39cfd8d0bccc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9990667f-585b-42e7-961b-d60be92f2887\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d5754ff3-a98f-456d-a996-b69cfc9a458e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:22:10 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-96b0f0a9-7442-40ea-9747-a85471946a0c tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 12:22:10 user nova-compute[74190]: No targets found.
Oct 18 12:22:10 user nova-compute[74190]: iSNS:
Oct 18 12:22:10 user nova-compute[74190]: No targets found.
Oct 18 12:22:10 user nova-compute[74190]: STATIC:
Oct 18 12:22:10 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:9990667f-585b-42e7-961b-d60be92f2887
Oct 18 12:22:10 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 12:22:10 user nova-compute[74190]:                 Iface Name: default
Oct 18 12:22:10 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18
Oct 18 12:22:10 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 12:22:10 user nova-compute[74190]:                 Iface Name: default
Oct 18 12:22:10 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:d5754ff3-a98f-456d-a996-b69cfc9a458e
Oct 18 12:22:10 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 12:22:10 user nova-compute[74190]:                 Iface Name: default
Oct 18 12:22:10 user nova-compute[74190]: FIRMWARE:
Oct 18 12:22:10 user nova-compute[74190]: No targets found.
Oct 18 12:22:10 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 12:22:10 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-96b0f0a9-7442-40ea-9747-a85471946a0c tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 12:22:10 user nova-compute[74190]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 12:22:10 user nova-compute[74190]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74190) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 12:22:10 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-96b0f0a9-7442-40ea-9747-a85471946a0c tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9990667f-585b-42e7-961b-d60be92f2887', 0)] {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 12:22:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:22:10 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:22:10 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[234ae2a5-89be-4a04-b122-98e90dcb5ca9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9990667f-585b-42e7-961b-d60be92f2887\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5754ff3-a98f-456d-a996-b69cfc9a458e\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:22:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:22:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:22:11 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c475005-0aec-4f66-a1e5-bdf8046310f6]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5754ff3-a98f-456d-a996-b69cfc9a458e (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9990667f-585b-42e7-961b-d60be92f2887 (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:22:11 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-96b0f0a9-7442-40ea-9747-a85471946a0c tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18 (non-flash)
Oct 18 12:22:11 user nova-compute[74190]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5754ff3-a98f-456d-a996-b69cfc9a458e (non-flash)
Oct 18 12:22:11 user nova-compute[74190]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9990667f-585b-42e7-961b-d60be92f2887 (non-flash)
Oct 18 12:22:11 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 12:22:11 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-96b0f0a9-7442-40ea-9747-a85471946a0c tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18 (non-flash)
Oct 18 12:22:11 user nova-compute[74190]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5754ff3-a98f-456d-a996-b69cfc9a458e (non-flash)
Oct 18 12:22:11 user nova-compute[74190]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9990667f-585b-42e7-961b-d60be92f2887 (non-flash)
Oct 18 12:22:11 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 12:22:11 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-96b0f0a9-7442-40ea-9747-a85471946a0c tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1f442785e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9990667f-585b-42e7-961b-d60be92f2887'): ({'sdd'}, set())}) {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 12:22:11 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-96b0f0a9-7442-40ea-9747-a85471946a0c tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Removing single pathed devices sdd {{(pid=74190) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 12:22:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:22:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:22:11 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aac2622-baf3-471f-927e-1d11658df7cd]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:22:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:22:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:22:11 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e1fb22c-32a8-453c-811f-3769154fbeeb]: (4, ('ok\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:22:11 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-96b0f0a9-7442-40ea-9747-a85471946a0c tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Flushing IO for device /dev/sdd {{(pid=74190) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 12:22:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:22:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:22:11 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a00677e-3f0c-481a-8133-280aef961bf2]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:22:11 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-96b0f0a9-7442-40ea-9747-a85471946a0c tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74190) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 12:22:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:22:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:22:11 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e1a39bc-bf2f-4270-94b2-b366490f8081]: (4, ('1', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:22:11 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-96b0f0a9-7442-40ea-9747-a85471946a0c tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 12:22:11 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-96b0f0a9-7442-40ea-9747-a85471946a0c tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] SCSI volumes sdd have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 12:22:11 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-96b0f0a9-7442-40ea-9747-a85471946a0c tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9990667f-585b-42e7-961b-d60be92f2887')] {{(pid=74190) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 12:22:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9990667f-585b-42e7-961b-d60be92f2887 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:22:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9990667f-585b-42e7-961b-d60be92f2887 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.039s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:22:11 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[c45502aa-9c5a-4167-963c-61dc3149e523]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:22:11 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-96b0f0a9-7442-40ea-9747-a85471946a0c tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:22:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9990667f-585b-42e7-961b-d60be92f2887 -p 172.16.0.220:3260 --logout {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:22:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9990667f-585b-42e7-961b-d60be92f2887 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:22:11 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b0731d9-504b-4232-9bc9-e50c17aa1e33]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:9990667f-585b-42e7-961b-d60be92f2887, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:9990667f-585b-42e7-961b-d60be92f2887, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:22:11 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-96b0f0a9-7442-40ea-9747-a85471946a0c tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:9990667f-585b-42e7-961b-d60be92f2887, portal: 172.16.0.220,3260]
Oct 18 12:22:11 user nova-compute[74190]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:9990667f-585b-42e7-961b-d60be92f2887, portal: 172.16.0.220,3260] successful.
Oct 18 12:22:11 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:22:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9990667f-585b-42e7-961b-d60be92f2887 -p 172.16.0.220:3260 --op delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:22:11 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9990667f-585b-42e7-961b-d60be92f2887 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:22:11 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4efdfea-c9a0-4ae5-8778-dea184e91e0d]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:22:11 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-96b0f0a9-7442-40ea-9747-a85471946a0c tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:22:11 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-96b0f0a9-7442-40ea-9747-a85471946a0c tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 12:22:11 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-96b0f0a9-7442-40ea-9747-a85471946a0c tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] <== disconnect_volume: return (331ms) None {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 12:22:11 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96b0f0a9-7442-40ea-9747-a85471946a0c tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: ebe4e4fe-9614-4065-b84e-a08a50f638b1] Disconnected iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 12:22:12 user nova-compute[74190]: DEBUG nova.objects.instance [None req-96b0f0a9-7442-40ea-9747-a85471946a0c tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Lazy-loading 'flavor' on Instance uuid ebe4e4fe-9614-4065-b84e-a08a50f638b1 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:22:12 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-96b0f0a9-7442-40ea-9747-a85471946a0c tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Lock "ebe4e4fe-9614-4065-b84e-a08a50f638b1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.968s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:22:12 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-0f8929c2-60b9-4fe1-9dcb-2dc73179c711 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Lock "ebe4e4fe-9614-4065-b84e-a08a50f638b1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.831s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:22:12 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-0f8929c2-60b9-4fe1-9dcb-2dc73179c711 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Acquiring lock "ebe4e4fe-9614-4065-b84e-a08a50f638b1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:22:12 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-0f8929c2-60b9-4fe1-9dcb-2dc73179c711 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Lock "ebe4e4fe-9614-4065-b84e-a08a50f638b1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:22:12 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-0f8929c2-60b9-4fe1-9dcb-2dc73179c711 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Lock "ebe4e4fe-9614-4065-b84e-a08a50f638b1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:22:12 user nova-compute[74190]: INFO nova.compute.manager [None req-0f8929c2-60b9-4fe1-9dcb-2dc73179c711 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: ebe4e4fe-9614-4065-b84e-a08a50f638b1] Terminating instance
Oct 18 12:22:12 user nova-compute[74190]: DEBUG nova.compute.manager [None req-0f8929c2-60b9-4fe1-9dcb-2dc73179c711 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: ebe4e4fe-9614-4065-b84e-a08a50f638b1] Start destroying the instance on the hypervisor. {{(pid=74190) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 12:22:12 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:22:12 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:22:12 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:22:12 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:22:12 user nova-compute[74190]: DEBUG nova.compute.manager [req-d59fdae7-9aae-4e04-a02f-cc6dd8befd95 req-a3a4a285-0d0b-4af0-a0d8-3d5f9c0992c3 service nova] [instance: ebe4e4fe-9614-4065-b84e-a08a50f638b1] Received event network-vif-unplugged-b764c6cd-7473-45e0-acac-9c20fc355d2e {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:22:12 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d59fdae7-9aae-4e04-a02f-cc6dd8befd95 req-a3a4a285-0d0b-4af0-a0d8-3d5f9c0992c3 service nova] Acquiring lock "ebe4e4fe-9614-4065-b84e-a08a50f638b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:22:12 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d59fdae7-9aae-4e04-a02f-cc6dd8befd95 req-a3a4a285-0d0b-4af0-a0d8-3d5f9c0992c3 service nova] Lock "ebe4e4fe-9614-4065-b84e-a08a50f638b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:22:12 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d59fdae7-9aae-4e04-a02f-cc6dd8befd95 req-a3a4a285-0d0b-4af0-a0d8-3d5f9c0992c3 service nova] Lock "ebe4e4fe-9614-4065-b84e-a08a50f638b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:22:12 user nova-compute[74190]: DEBUG nova.compute.manager [req-d59fdae7-9aae-4e04-a02f-cc6dd8befd95 req-a3a4a285-0d0b-4af0-a0d8-3d5f9c0992c3 service nova] [instance: ebe4e4fe-9614-4065-b84e-a08a50f638b1] No waiting events found dispatching network-vif-unplugged-b764c6cd-7473-45e0-acac-9c20fc355d2e {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:22:12 user nova-compute[74190]: DEBUG nova.compute.manager [req-d59fdae7-9aae-4e04-a02f-cc6dd8befd95 req-a3a4a285-0d0b-4af0-a0d8-3d5f9c0992c3 service nova] [instance: ebe4e4fe-9614-4065-b84e-a08a50f638b1] Received event network-vif-unplugged-b764c6cd-7473-45e0-acac-9c20fc355d2e for instance with task_state deleting. {{(pid=74190) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 12:22:13 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:22:13 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:22:13 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:22:13 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: ebe4e4fe-9614-4065-b84e-a08a50f638b1] Instance destroyed successfully.
Oct 18 12:22:13 user nova-compute[74190]: DEBUG nova.objects.instance [None req-0f8929c2-60b9-4fe1-9dcb-2dc73179c711 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Lazy-loading 'resources' on Instance uuid ebe4e4fe-9614-4065-b84e-a08a50f638b1 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:22:13 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-0f8929c2-60b9-4fe1-9dcb-2dc73179c711 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T12:18:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1811332868',display_name='tempest-VolumesSnapshotTestJSON-instance-1811332868',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1811332868',id=49,image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF9oc+bwOhZaWPzwzw2MSqa58dx+V8y/8IE25tznmLDmKbwWin7Qmx10naTsDHVWlybEUzFEdjOvAJdbI0TdeVxEDcTRIx41RZa2hFwgzKXPEPcyTlR4Xr22YnmmzE9L3g==',key_name='tempest-keypair-1543681740',keypairs=<?>,launch_index=0,launched_at=2023-10-18T12:18:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1e49c9e381b0457faa31d0f5bdfa3f18',ramdisk_id='',reservation_id='r-124e5z6h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e88bbf0-6e78-49a8-b3c5-9453d22a89df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-252328076',owner_user_name='tempest-VolumesSnapshotTestJSON-252328076-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T12:18:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f2c022bbeb1941fe89964cd372f651f2',uuid=ebe4e4fe-9614-4065-b84e-a08a50f638b1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b764c6cd-7473-45e0-acac-9c20fc355d2e", "address": "fa:16:3e:2e:61:70", "network": {"id": "1afc08fa-4518-4ccf-97a1-22f04820b31c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-687660220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e49c9e381b0457faa31d0f5bdfa3f18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb764c6cd-74", "ovs_interfaceid": "b764c6cd-7473-45e0-acac-9c20fc355d2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 12:22:13 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-0f8929c2-60b9-4fe1-9dcb-2dc73179c711 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Converting VIF {"id": "b764c6cd-7473-45e0-acac-9c20fc355d2e", "address": "fa:16:3e:2e:61:70", "network": {"id": "1afc08fa-4518-4ccf-97a1-22f04820b31c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-687660220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e49c9e381b0457faa31d0f5bdfa3f18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb764c6cd-74", "ovs_interfaceid": "b764c6cd-7473-45e0-acac-9c20fc355d2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 12:22:13 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-0f8929c2-60b9-4fe1-9dcb-2dc73179c711 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2e:61:70,bridge_name='br-int',has_traffic_filtering=True,id=b764c6cd-7473-45e0-acac-9c20fc355d2e,network=Network(1afc08fa-4518-4ccf-97a1-22f04820b31c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb764c6cd-74') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 12:22:13 user nova-compute[74190]: DEBUG os_vif [None req-0f8929c2-60b9-4fe1-9dcb-2dc73179c711 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:61:70,bridge_name='br-int',has_traffic_filtering=True,id=b764c6cd-7473-45e0-acac-9c20fc355d2e,network=Network(1afc08fa-4518-4ccf-97a1-22f04820b31c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb764c6cd-74') {{(pid=74190) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 12:22:13 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:22:13 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:22:13 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb764c6cd-74, bridge=br-int, if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:22:13 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:22:13 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:22:13 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:22:13 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2704833a-0a92-4b6e-a1bb-748a46af9e03) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:22:13 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:22:13 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:22:13 user nova-compute[74190]: INFO os_vif [None req-0f8929c2-60b9-4fe1-9dcb-2dc73179c711 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:61:70,bridge_name='br-int',has_traffic_filtering=True,id=b764c6cd-7473-45e0-acac-9c20fc355d2e,network=Network(1afc08fa-4518-4ccf-97a1-22f04820b31c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb764c6cd-74')
Oct 18 12:22:13 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f8929c2-60b9-4fe1-9dcb-2dc73179c711 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: ebe4e4fe-9614-4065-b84e-a08a50f638b1] calling os-brick to detach iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 12:22:13 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f8929c2-60b9-4fe1-9dcb-2dc73179c711 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, {'target_iqn': 'iqn.2010-10.org.openstack:9990667f-585b-42e7-961b-d60be92f2887', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dBbijenm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 12:22:13 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-0f8929c2-60b9-4fe1-9dcb-2dc73179c711 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 12:22:13 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-0f8929c2-60b9-4fe1-9dcb-2dc73179c711 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 12:22:13 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-0f8929c2-60b9-4fe1-9dcb-2dc73179c711 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 12:22:13 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:22:13 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:22:13 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[07814168-9ef9-4f86-8810-97afeaf5fdc0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d5754ff3-a98f-456d-a996-b69cfc9a458e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:22:13 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f8929c2-60b9-4fe1-9dcb-2dc73179c711 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 12:22:13 user nova-compute[74190]: No targets found.
Oct 18 12:22:13 user nova-compute[74190]: iSNS:
Oct 18 12:22:13 user nova-compute[74190]: No targets found.
Oct 18 12:22:13 user nova-compute[74190]: STATIC:
Oct 18 12:22:13 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18
Oct 18 12:22:13 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 12:22:13 user nova-compute[74190]:                 Iface Name: default
Oct 18 12:22:13 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:d5754ff3-a98f-456d-a996-b69cfc9a458e
Oct 18 12:22:13 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 12:22:13 user nova-compute[74190]:                 Iface Name: default
Oct 18 12:22:13 user nova-compute[74190]: FIRMWARE:
Oct 18 12:22:13 user nova-compute[74190]: No targets found.
Oct 18 12:22:13 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 12:22:13 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f8929c2-60b9-4fe1-9dcb-2dc73179c711 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 12:22:13 user nova-compute[74190]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 12:22:13 user nova-compute[74190]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74190) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 12:22:13 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f8929c2-60b9-4fe1-9dcb-2dc73179c711 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9990667f-585b-42e7-961b-d60be92f2887', 0)] {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 12:22:13 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:22:13 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:22:13 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[7deffcfc-c1c6-4731-87da-2951787cf8a0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5754ff3-a98f-456d-a996-b69cfc9a458e\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:22:13 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:22:13 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:22:13 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d70e4dd-054a-487d-a04c-ff33ad0a2b14]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5754ff3-a98f-456d-a996-b69cfc9a458e (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:22:13 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f8929c2-60b9-4fe1-9dcb-2dc73179c711 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18 (non-flash)
Oct 18 12:22:13 user nova-compute[74190]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5754ff3-a98f-456d-a996-b69cfc9a458e (non-flash)
Oct 18 12:22:13 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 12:22:13 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f8929c2-60b9-4fe1-9dcb-2dc73179c711 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18 (non-flash)
Oct 18 12:22:13 user nova-compute[74190]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5754ff3-a98f-456d-a996-b69cfc9a458e (non-flash)
Oct 18 12:22:13 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 12:22:13 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f8929c2-60b9-4fe1-9dcb-2dc73179c711 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1f55d09630>, {}) {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 12:22:13 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f8929c2-60b9-4fe1-9dcb-2dc73179c711 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Disconnecting from: [] {{(pid=74190) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 12:22:13 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-0f8929c2-60b9-4fe1-9dcb-2dc73179c711 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.077s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 12:22:13 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f8929c2-60b9-4fe1-9dcb-2dc73179c711 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] <== disconnect_volume: return (79ms) None {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 12:22:13 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f8929c2-60b9-4fe1-9dcb-2dc73179c711 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: ebe4e4fe-9614-4065-b84e-a08a50f638b1] Disconnected iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 12:22:13 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-0f8929c2-60b9-4fe1-9dcb-2dc73179c711 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: ebe4e4fe-9614-4065-b84e-a08a50f638b1] Deleting instance files /opt/stack/data/nova/instances/ebe4e4fe-9614-4065-b84e-a08a50f638b1_del
Oct 18 12:22:13 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-0f8929c2-60b9-4fe1-9dcb-2dc73179c711 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: ebe4e4fe-9614-4065-b84e-a08a50f638b1] Deletion of /opt/stack/data/nova/instances/ebe4e4fe-9614-4065-b84e-a08a50f638b1_del complete
Oct 18 12:22:13 user nova-compute[74190]: INFO nova.compute.manager [None req-0f8929c2-60b9-4fe1-9dcb-2dc73179c711 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: ebe4e4fe-9614-4065-b84e-a08a50f638b1] Took 0.98 seconds to destroy the instance on the hypervisor.
Oct 18 12:22:13 user nova-compute[74190]: DEBUG oslo.service.loopingcall [None req-0f8929c2-60b9-4fe1-9dcb-2dc73179c711 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74190) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 12:22:13 user nova-compute[74190]: DEBUG nova.compute.manager [-] [instance: ebe4e4fe-9614-4065-b84e-a08a50f638b1] Deallocating network for instance {{(pid=74190) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 12:22:13 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: ebe4e4fe-9614-4065-b84e-a08a50f638b1] deallocate_for_instance() {{(pid=74190) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 12:22:13 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:22:13 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:22:13 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:22:13 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:22:13 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:22:13 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:22:14 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: ebe4e4fe-9614-4065-b84e-a08a50f638b1] Updating instance_info_cache with network_info: [] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:22:14 user nova-compute[74190]: INFO nova.compute.manager [-] [instance: ebe4e4fe-9614-4065-b84e-a08a50f638b1] Took 0.86 seconds to deallocate network for instance.
Oct 18 12:22:14 user nova-compute[74190]: DEBUG nova.compute.manager [req-053253e0-dc64-44d3-ad4c-e38b333654e7 req-a76677a1-ffb4-4d9c-be60-d1285e0d21ad service nova] [instance: ebe4e4fe-9614-4065-b84e-a08a50f638b1] Received event network-vif-deleted-b764c6cd-7473-45e0-acac-9c20fc355d2e {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:22:14 user nova-compute[74190]: WARNING nova.volume.cinder [None req-0f8929c2-60b9-4fe1-9dcb-2dc73179c711 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Attachment 77f7732f-a3b7-430f-a250-db21f760d01c does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 77f7732f-a3b7-430f-a250-db21f760d01c. (HTTP 404) (Request-ID: req-09d75811-3cb9-47ad-8d51-ae273917ca58)
Oct 18 12:22:14 user nova-compute[74190]: INFO nova.compute.manager [None req-0f8929c2-60b9-4fe1-9dcb-2dc73179c711 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] [instance: ebe4e4fe-9614-4065-b84e-a08a50f638b1] Took 0.02 seconds to detach 1 volumes for instance.
Oct 18 12:22:14 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-0f8929c2-60b9-4fe1-9dcb-2dc73179c711 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:22:14 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-0f8929c2-60b9-4fe1-9dcb-2dc73179c711 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:22:14 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-0f8929c2-60b9-4fe1-9dcb-2dc73179c711 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 12:22:14 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-0f8929c2-60b9-4fe1-9dcb-2dc73179c711 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 12:22:14 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-0f8929c2-60b9-4fe1-9dcb-2dc73179c711 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.229s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:22:14 user nova-compute[74190]: INFO nova.scheduler.client.report [None req-0f8929c2-60b9-4fe1-9dcb-2dc73179c711 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Deleted allocations for instance ebe4e4fe-9614-4065-b84e-a08a50f638b1
Oct 18 12:22:14 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-0f8929c2-60b9-4fe1-9dcb-2dc73179c711 tempest-VolumesSnapshotTestJSON-252328076 tempest-VolumesSnapshotTestJSON-252328076-project-member] Lock "ebe4e4fe-9614-4065-b84e-a08a50f638b1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.306s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:22:14 user nova-compute[74190]: DEBUG nova.compute.manager [req-4e4785a9-6eb1-46fe-9152-910d1f577c91 req-2f3e785d-b870-4507-be22-6c34f13b2e11 service nova] [instance: ebe4e4fe-9614-4065-b84e-a08a50f638b1] Received event network-vif-plugged-b764c6cd-7473-45e0-acac-9c20fc355d2e {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:22:14 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-4e4785a9-6eb1-46fe-9152-910d1f577c91 req-2f3e785d-b870-4507-be22-6c34f13b2e11 service nova] Acquiring lock "ebe4e4fe-9614-4065-b84e-a08a50f638b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:22:14 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-4e4785a9-6eb1-46fe-9152-910d1f577c91 req-2f3e785d-b870-4507-be22-6c34f13b2e11 service nova] Lock "ebe4e4fe-9614-4065-b84e-a08a50f638b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:22:14 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-4e4785a9-6eb1-46fe-9152-910d1f577c91 req-2f3e785d-b870-4507-be22-6c34f13b2e11 service nova] Lock "ebe4e4fe-9614-4065-b84e-a08a50f638b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:22:14 user nova-compute[74190]: DEBUG nova.compute.manager [req-4e4785a9-6eb1-46fe-9152-910d1f577c91 req-2f3e785d-b870-4507-be22-6c34f13b2e11 service nova] [instance: ebe4e4fe-9614-4065-b84e-a08a50f638b1] No waiting events found dispatching network-vif-plugged-b764c6cd-7473-45e0-acac-9c20fc355d2e {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:22:14 user nova-compute[74190]: WARNING nova.compute.manager [req-4e4785a9-6eb1-46fe-9152-910d1f577c91 req-2f3e785d-b870-4507-be22-6c34f13b2e11 service nova] [instance: ebe4e4fe-9614-4065-b84e-a08a50f638b1] Received unexpected event network-vif-plugged-b764c6cd-7473-45e0-acac-9c20fc355d2e for instance with vm_state deleted and task_state None.
Oct 18 12:22:14 user nova-compute[74190]: DEBUG nova.compute.manager [req-4e4785a9-6eb1-46fe-9152-910d1f577c91 req-2f3e785d-b870-4507-be22-6c34f13b2e11 service nova] [instance: ebe4e4fe-9614-4065-b84e-a08a50f638b1] Received event network-vif-plugged-b764c6cd-7473-45e0-acac-9c20fc355d2e {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:22:14 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-4e4785a9-6eb1-46fe-9152-910d1f577c91 req-2f3e785d-b870-4507-be22-6c34f13b2e11 service nova] Acquiring lock "ebe4e4fe-9614-4065-b84e-a08a50f638b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:22:14 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-4e4785a9-6eb1-46fe-9152-910d1f577c91 req-2f3e785d-b870-4507-be22-6c34f13b2e11 service nova] Lock "ebe4e4fe-9614-4065-b84e-a08a50f638b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:22:14 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-4e4785a9-6eb1-46fe-9152-910d1f577c91 req-2f3e785d-b870-4507-be22-6c34f13b2e11 service nova] Lock "ebe4e4fe-9614-4065-b84e-a08a50f638b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:22:14 user nova-compute[74190]: DEBUG nova.compute.manager [req-4e4785a9-6eb1-46fe-9152-910d1f577c91 req-2f3e785d-b870-4507-be22-6c34f13b2e11 service nova] [instance: ebe4e4fe-9614-4065-b84e-a08a50f638b1] No waiting events found dispatching network-vif-plugged-b764c6cd-7473-45e0-acac-9c20fc355d2e {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:22:14 user nova-compute[74190]: WARNING nova.compute.manager [req-4e4785a9-6eb1-46fe-9152-910d1f577c91 req-2f3e785d-b870-4507-be22-6c34f13b2e11 service nova] [instance: ebe4e4fe-9614-4065-b84e-a08a50f638b1] Received unexpected event network-vif-plugged-b764c6cd-7473-45e0-acac-9c20fc355d2e for instance with vm_state deleted and task_state None.
Oct 18 12:22:14 user nova-compute[74190]: DEBUG nova.compute.manager [req-4e4785a9-6eb1-46fe-9152-910d1f577c91 req-2f3e785d-b870-4507-be22-6c34f13b2e11 service nova] [instance: ebe4e4fe-9614-4065-b84e-a08a50f638b1] Received event network-vif-plugged-b764c6cd-7473-45e0-acac-9c20fc355d2e {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:22:14 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-4e4785a9-6eb1-46fe-9152-910d1f577c91 req-2f3e785d-b870-4507-be22-6c34f13b2e11 service nova] Acquiring lock "ebe4e4fe-9614-4065-b84e-a08a50f638b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:22:14 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-4e4785a9-6eb1-46fe-9152-910d1f577c91 req-2f3e785d-b870-4507-be22-6c34f13b2e11 service nova] Lock "ebe4e4fe-9614-4065-b84e-a08a50f638b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:22:14 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-4e4785a9-6eb1-46fe-9152-910d1f577c91 req-2f3e785d-b870-4507-be22-6c34f13b2e11 service nova] Lock "ebe4e4fe-9614-4065-b84e-a08a50f638b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:22:14 user nova-compute[74190]: DEBUG nova.compute.manager [req-4e4785a9-6eb1-46fe-9152-910d1f577c91 req-2f3e785d-b870-4507-be22-6c34f13b2e11 service nova] [instance: ebe4e4fe-9614-4065-b84e-a08a50f638b1] No waiting events found dispatching network-vif-plugged-b764c6cd-7473-45e0-acac-9c20fc355d2e {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:22:14 user nova-compute[74190]: WARNING nova.compute.manager [req-4e4785a9-6eb1-46fe-9152-910d1f577c91 req-2f3e785d-b870-4507-be22-6c34f13b2e11 service nova] [instance: ebe4e4fe-9614-4065-b84e-a08a50f638b1] Received unexpected event network-vif-plugged-b764c6cd-7473-45e0-acac-9c20fc355d2e for instance with vm_state deleted and task_state None.
Oct 18 12:22:14 user nova-compute[74190]: DEBUG nova.compute.manager [req-4e4785a9-6eb1-46fe-9152-910d1f577c91 req-2f3e785d-b870-4507-be22-6c34f13b2e11 service nova] [instance: ebe4e4fe-9614-4065-b84e-a08a50f638b1] Received event network-vif-unplugged-b764c6cd-7473-45e0-acac-9c20fc355d2e {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:22:14 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-4e4785a9-6eb1-46fe-9152-910d1f577c91 req-2f3e785d-b870-4507-be22-6c34f13b2e11 service nova] Acquiring lock "ebe4e4fe-9614-4065-b84e-a08a50f638b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:22:14 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-4e4785a9-6eb1-46fe-9152-910d1f577c91 req-2f3e785d-b870-4507-be22-6c34f13b2e11 service nova] Lock "ebe4e4fe-9614-4065-b84e-a08a50f638b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:22:14 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-4e4785a9-6eb1-46fe-9152-910d1f577c91 req-2f3e785d-b870-4507-be22-6c34f13b2e11 service nova] Lock "ebe4e4fe-9614-4065-b84e-a08a50f638b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:22:14 user nova-compute[74190]: DEBUG nova.compute.manager [req-4e4785a9-6eb1-46fe-9152-910d1f577c91 req-2f3e785d-b870-4507-be22-6c34f13b2e11 service nova] [instance: ebe4e4fe-9614-4065-b84e-a08a50f638b1] No waiting events found dispatching network-vif-unplugged-b764c6cd-7473-45e0-acac-9c20fc355d2e {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:22:14 user nova-compute[74190]: WARNING nova.compute.manager [req-4e4785a9-6eb1-46fe-9152-910d1f577c91 req-2f3e785d-b870-4507-be22-6c34f13b2e11 service nova] [instance: ebe4e4fe-9614-4065-b84e-a08a50f638b1] Received unexpected event network-vif-unplugged-b764c6cd-7473-45e0-acac-9c20fc355d2e for instance with vm_state deleted and task_state None.
Oct 18 12:22:14 user nova-compute[74190]: DEBUG nova.compute.manager [req-4e4785a9-6eb1-46fe-9152-910d1f577c91 req-2f3e785d-b870-4507-be22-6c34f13b2e11 service nova] [instance: ebe4e4fe-9614-4065-b84e-a08a50f638b1] Received event network-vif-plugged-b764c6cd-7473-45e0-acac-9c20fc355d2e {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:22:14 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-4e4785a9-6eb1-46fe-9152-910d1f577c91 req-2f3e785d-b870-4507-be22-6c34f13b2e11 service nova] Acquiring lock "ebe4e4fe-9614-4065-b84e-a08a50f638b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:22:14 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-4e4785a9-6eb1-46fe-9152-910d1f577c91 req-2f3e785d-b870-4507-be22-6c34f13b2e11 service nova] Lock "ebe4e4fe-9614-4065-b84e-a08a50f638b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:22:14 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-4e4785a9-6eb1-46fe-9152-910d1f577c91 req-2f3e785d-b870-4507-be22-6c34f13b2e11 service nova] Lock "ebe4e4fe-9614-4065-b84e-a08a50f638b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:22:14 user nova-compute[74190]: DEBUG nova.compute.manager [req-4e4785a9-6eb1-46fe-9152-910d1f577c91 req-2f3e785d-b870-4507-be22-6c34f13b2e11 service nova] [instance: ebe4e4fe-9614-4065-b84e-a08a50f638b1] No waiting events found dispatching network-vif-plugged-b764c6cd-7473-45e0-acac-9c20fc355d2e {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:22:14 user nova-compute[74190]: WARNING nova.compute.manager [req-4e4785a9-6eb1-46fe-9152-910d1f577c91 req-2f3e785d-b870-4507-be22-6c34f13b2e11 service nova] [instance: ebe4e4fe-9614-4065-b84e-a08a50f638b1] Received unexpected event network-vif-plugged-b764c6cd-7473-45e0-acac-9c20fc355d2e for instance with vm_state deleted and task_state None.
Oct 18 12:22:18 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:22:20 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:22:22 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:22:23 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:22:23 user nova-compute[74190]: DEBUG nova.compute.manager [req-a54667ab-dbf0-40d7-9763-0e7905b8ee21 req-c83bd10d-d7b5-4519-a2ab-119bba8467bc service nova] [instance: 3930e04a-3d64-407c-90c2-f9b14269c27c] Received event network-changed-f5a6b75c-7bcb-4a37-96aa-c30430598ecd {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:22:23 user nova-compute[74190]: DEBUG nova.compute.manager [req-a54667ab-dbf0-40d7-9763-0e7905b8ee21 req-c83bd10d-d7b5-4519-a2ab-119bba8467bc service nova] [instance: 3930e04a-3d64-407c-90c2-f9b14269c27c] Refreshing instance network info cache due to event network-changed-f5a6b75c-7bcb-4a37-96aa-c30430598ecd. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 12:22:23 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-a54667ab-dbf0-40d7-9763-0e7905b8ee21 req-c83bd10d-d7b5-4519-a2ab-119bba8467bc service nova] Acquiring lock "refresh_cache-3930e04a-3d64-407c-90c2-f9b14269c27c" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:22:23 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-a54667ab-dbf0-40d7-9763-0e7905b8ee21 req-c83bd10d-d7b5-4519-a2ab-119bba8467bc service nova] Acquired lock "refresh_cache-3930e04a-3d64-407c-90c2-f9b14269c27c" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:22:23 user nova-compute[74190]: DEBUG nova.network.neutron [req-a54667ab-dbf0-40d7-9763-0e7905b8ee21 req-c83bd10d-d7b5-4519-a2ab-119bba8467bc service nova] [instance: 3930e04a-3d64-407c-90c2-f9b14269c27c] Refreshing network info cache for port f5a6b75c-7bcb-4a37-96aa-c30430598ecd {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 12:22:24 user nova-compute[74190]: DEBUG nova.network.neutron [req-a54667ab-dbf0-40d7-9763-0e7905b8ee21 req-c83bd10d-d7b5-4519-a2ab-119bba8467bc service nova] [instance: 3930e04a-3d64-407c-90c2-f9b14269c27c] Updated VIF entry in instance network info cache for port f5a6b75c-7bcb-4a37-96aa-c30430598ecd. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 12:22:24 user nova-compute[74190]: DEBUG nova.network.neutron [req-a54667ab-dbf0-40d7-9763-0e7905b8ee21 req-c83bd10d-d7b5-4519-a2ab-119bba8467bc service nova] [instance: 3930e04a-3d64-407c-90c2-f9b14269c27c] Updating instance_info_cache with network_info: [{"id": "f5a6b75c-7bcb-4a37-96aa-c30430598ecd", "address": "fa:16:3e:2e:bb:8f", "network": {"id": "aa827f81-b165-444f-89cc-f21c42a9f772", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1659902586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e375153f6f24827811c5825fc2a2c6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a6b75c-7b", "ovs_interfaceid": "f5a6b75c-7bcb-4a37-96aa-c30430598ecd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:22:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-a54667ab-dbf0-40d7-9763-0e7905b8ee21 req-c83bd10d-d7b5-4519-a2ab-119bba8467bc service nova] Releasing lock "refresh_cache-3930e04a-3d64-407c-90c2-f9b14269c27c" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:22:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-2973a410-e297-44d3-a3d3-fbbad1c3221e tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Acquiring lock "3930e04a-3d64-407c-90c2-f9b14269c27c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:22:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-2973a410-e297-44d3-a3d3-fbbad1c3221e tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "3930e04a-3d64-407c-90c2-f9b14269c27c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:22:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-2973a410-e297-44d3-a3d3-fbbad1c3221e tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Acquiring lock "3930e04a-3d64-407c-90c2-f9b14269c27c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:22:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-2973a410-e297-44d3-a3d3-fbbad1c3221e tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "3930e04a-3d64-407c-90c2-f9b14269c27c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:22:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-2973a410-e297-44d3-a3d3-fbbad1c3221e tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "3930e04a-3d64-407c-90c2-f9b14269c27c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:22:24 user nova-compute[74190]: INFO nova.compute.manager [None req-2973a410-e297-44d3-a3d3-fbbad1c3221e tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 3930e04a-3d64-407c-90c2-f9b14269c27c] Terminating instance
Oct 18 12:22:24 user nova-compute[74190]: DEBUG nova.compute.manager [None req-2973a410-e297-44d3-a3d3-fbbad1c3221e tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 3930e04a-3d64-407c-90c2-f9b14269c27c] Start destroying the instance on the hypervisor. {{(pid=74190) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 12:22:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:22:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:22:24 user nova-compute[74190]: DEBUG nova.compute.manager [req-d0c4a5bb-5456-4b47-bf29-1763ce748de7 req-cc18a0e7-ece3-4d76-b320-440d17754556 service nova] [instance: 3930e04a-3d64-407c-90c2-f9b14269c27c] Received event network-vif-unplugged-f5a6b75c-7bcb-4a37-96aa-c30430598ecd {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:22:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d0c4a5bb-5456-4b47-bf29-1763ce748de7 req-cc18a0e7-ece3-4d76-b320-440d17754556 service nova] Acquiring lock "3930e04a-3d64-407c-90c2-f9b14269c27c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:22:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d0c4a5bb-5456-4b47-bf29-1763ce748de7 req-cc18a0e7-ece3-4d76-b320-440d17754556 service nova] Lock "3930e04a-3d64-407c-90c2-f9b14269c27c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:22:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d0c4a5bb-5456-4b47-bf29-1763ce748de7 req-cc18a0e7-ece3-4d76-b320-440d17754556 service nova] Lock "3930e04a-3d64-407c-90c2-f9b14269c27c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:22:24 user nova-compute[74190]: DEBUG nova.compute.manager [req-d0c4a5bb-5456-4b47-bf29-1763ce748de7 req-cc18a0e7-ece3-4d76-b320-440d17754556 service nova] [instance: 3930e04a-3d64-407c-90c2-f9b14269c27c] No waiting events found dispatching network-vif-unplugged-f5a6b75c-7bcb-4a37-96aa-c30430598ecd {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:22:24 user nova-compute[74190]: DEBUG nova.compute.manager [req-d0c4a5bb-5456-4b47-bf29-1763ce748de7 req-cc18a0e7-ece3-4d76-b320-440d17754556 service nova] [instance: 3930e04a-3d64-407c-90c2-f9b14269c27c] Received event network-vif-unplugged-f5a6b75c-7bcb-4a37-96aa-c30430598ecd for instance with task_state deleting. {{(pid=74190) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 12:22:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:22:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:22:25 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 3930e04a-3d64-407c-90c2-f9b14269c27c] Instance destroyed successfully.
Oct 18 12:22:25 user nova-compute[74190]: DEBUG nova.objects.instance [None req-2973a410-e297-44d3-a3d3-fbbad1c3221e tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lazy-loading 'resources' on Instance uuid 3930e04a-3d64-407c-90c2-f9b14269c27c {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:22:25 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-2973a410-e297-44d3-a3d3-fbbad1c3221e tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T12:20:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-683322485',display_name='tempest-TestVolumeBootPattern-server-683322485',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-683322485',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFImDkcHIZVVsD1gB2Yh4JGNE0pEbAN8TUjpItUrbhxdmYRzrbNlPip8qPxIcvk8OJEen8xQaAGxdqzAZ1w6kqPbscsnuFtwOBrKfpec5lSOkFKoHZaLFZ1ci5kqBfXOJw==',key_name='tempest-TestVolumeBootPattern-131084726',keypairs=<?>,launch_index=0,launched_at=2023-10-18T12:20:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1e375153f6f24827811c5825fc2a2c6a',ramdisk_id='',reservation_id='r-uk111vii',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1157442382',owner_user_name='tempest-TestVolumeBootPattern-1157442382-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T12:20:55Z,user_data=None,user_id='27d9fc244d0f4e10a43b7df4dc8e30ad',uuid=3930e04a-3d64-407c-90c2-f9b14269c27c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f5a6b75c-7bcb-4a37-96aa-c30430598ecd", "address": "fa:16:3e:2e:bb:8f", "network": {"id": "aa827f81-b165-444f-89cc-f21c42a9f772", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1659902586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e375153f6f24827811c5825fc2a2c6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a6b75c-7b", "ovs_interfaceid": "f5a6b75c-7bcb-4a37-96aa-c30430598ecd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 12:22:25 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-2973a410-e297-44d3-a3d3-fbbad1c3221e tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Converting VIF {"id": "f5a6b75c-7bcb-4a37-96aa-c30430598ecd", "address": "fa:16:3e:2e:bb:8f", "network": {"id": "aa827f81-b165-444f-89cc-f21c42a9f772", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1659902586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e375153f6f24827811c5825fc2a2c6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a6b75c-7b", "ovs_interfaceid": "f5a6b75c-7bcb-4a37-96aa-c30430598ecd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 12:22:25 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-2973a410-e297-44d3-a3d3-fbbad1c3221e tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2e:bb:8f,bridge_name='br-int',has_traffic_filtering=True,id=f5a6b75c-7bcb-4a37-96aa-c30430598ecd,network=Network(aa827f81-b165-444f-89cc-f21c42a9f772),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5a6b75c-7b') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 12:22:25 user nova-compute[74190]: DEBUG os_vif [None req-2973a410-e297-44d3-a3d3-fbbad1c3221e tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:bb:8f,bridge_name='br-int',has_traffic_filtering=True,id=f5a6b75c-7bcb-4a37-96aa-c30430598ecd,network=Network(aa827f81-b165-444f-89cc-f21c42a9f772),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5a6b75c-7b') {{(pid=74190) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 12:22:25 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:22:25 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf5a6b75c-7b, bridge=br-int, if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:22:25 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:22:25 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:22:25 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=df1fdd84-87a7-42be-8ddd-ebdf0b86ab0d) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:22:25 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:22:25 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:22:25 user nova-compute[74190]: INFO os_vif [None req-2973a410-e297-44d3-a3d3-fbbad1c3221e tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:bb:8f,bridge_name='br-int',has_traffic_filtering=True,id=f5a6b75c-7bcb-4a37-96aa-c30430598ecd,network=Network(aa827f81-b165-444f-89cc-f21c42a9f772),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5a6b75c-7b')
Oct 18 12:22:25 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2973a410-e297-44d3-a3d3-fbbad1c3221e tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 3930e04a-3d64-407c-90c2-f9b14269c27c] calling os-brick to detach iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 12:22:25 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-2973a410-e297-44d3-a3d3-fbbad1c3221e tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, {'target_iqn': 'iqn.2010-10.org.openstack:d5754ff3-a98f-456d-a996-b69cfc9a458e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QDbkvwUf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 12:22:25 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-2973a410-e297-44d3-a3d3-fbbad1c3221e tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 12:22:25 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-2973a410-e297-44d3-a3d3-fbbad1c3221e tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 12:22:25 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-2973a410-e297-44d3-a3d3-fbbad1c3221e tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 12:22:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:22:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:22:25 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd1d265e-5414-43c4-a45b-dc2633510ae3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d5754ff3-a98f-456d-a996-b69cfc9a458e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:22:25 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-2973a410-e297-44d3-a3d3-fbbad1c3221e tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 12:22:25 user nova-compute[74190]: No targets found.
Oct 18 12:22:25 user nova-compute[74190]: iSNS:
Oct 18 12:22:25 user nova-compute[74190]: No targets found.
Oct 18 12:22:25 user nova-compute[74190]: STATIC:
Oct 18 12:22:25 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18
Oct 18 12:22:25 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 12:22:25 user nova-compute[74190]:                 Iface Name: default
Oct 18 12:22:25 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:d5754ff3-a98f-456d-a996-b69cfc9a458e
Oct 18 12:22:25 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 12:22:25 user nova-compute[74190]:                 Iface Name: default
Oct 18 12:22:25 user nova-compute[74190]: FIRMWARE:
Oct 18 12:22:25 user nova-compute[74190]: No targets found.
Oct 18 12:22:25 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 12:22:25 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-2973a410-e297-44d3-a3d3-fbbad1c3221e tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 12:22:25 user nova-compute[74190]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 12:22:25 user nova-compute[74190]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74190) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 12:22:25 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-2973a410-e297-44d3-a3d3-fbbad1c3221e tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5754ff3-a98f-456d-a996-b69cfc9a458e', 0)] {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 12:22:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:22:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:22:25 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[084d8b69-fd3c-4bbc-b8c0-ca2d0dad29a7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5754ff3-a98f-456d-a996-b69cfc9a458e\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:22:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:22:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:22:25 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a9f2691-5a75-4883-b681-405703d7640e]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5754ff3-a98f-456d-a996-b69cfc9a458e (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:22:25 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-2973a410-e297-44d3-a3d3-fbbad1c3221e tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18 (non-flash)
Oct 18 12:22:25 user nova-compute[74190]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5754ff3-a98f-456d-a996-b69cfc9a458e (non-flash)
Oct 18 12:22:25 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 12:22:25 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-2973a410-e297-44d3-a3d3-fbbad1c3221e tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18 (non-flash)
Oct 18 12:22:25 user nova-compute[74190]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5754ff3-a98f-456d-a996-b69cfc9a458e (non-flash)
Oct 18 12:22:25 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 12:22:25 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-2973a410-e297-44d3-a3d3-fbbad1c3221e tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1f2476f1c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5754ff3-a98f-456d-a996-b69cfc9a458e'): ({'sdc'}, set())}) {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 12:22:25 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-2973a410-e297-44d3-a3d3-fbbad1c3221e tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Removing single pathed devices sdc {{(pid=74190) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 12:22:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:22:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:22:25 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[de088029-92e7-4d27-a88b-6a900316f3c7]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:22:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:22:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:22:25 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb94506f-d499-4411-9841-2b073ceb0703]: (4, ('ok\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:22:25 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-2973a410-e297-44d3-a3d3-fbbad1c3221e tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Flushing IO for device /dev/sdc {{(pid=74190) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 12:22:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:22:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:22:25 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d3a8250-2318-4011-913c-56843354d672]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:22:25 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-2973a410-e297-44d3-a3d3-fbbad1c3221e tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74190) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 12:22:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:22:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.086s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:22:25 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[338aeff4-3ac9-4af5-8b5f-5ddd238a46b8]: (4, ('1', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:22:25 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-2973a410-e297-44d3-a3d3-fbbad1c3221e tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 12:22:25 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-2973a410-e297-44d3-a3d3-fbbad1c3221e tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] SCSI volumes sdc have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 12:22:25 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-2973a410-e297-44d3-a3d3-fbbad1c3221e tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5754ff3-a98f-456d-a996-b69cfc9a458e')] {{(pid=74190) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 12:22:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5754ff3-a98f-456d-a996-b69cfc9a458e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:22:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5754ff3-a98f-456d-a996-b69cfc9a458e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:22:25 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e41a865-a5f9-4bbf-a749-3a60ad62b6f4]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:22:25 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-2973a410-e297-44d3-a3d3-fbbad1c3221e tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:22:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5754ff3-a98f-456d-a996-b69cfc9a458e -p 172.16.0.220:3260 --logout {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:22:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5754ff3-a98f-456d-a996-b69cfc9a458e -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:22:25 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[99543196-24c8-42f0-a73f-198d0af55224]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:d5754ff3-a98f-456d-a996-b69cfc9a458e, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:d5754ff3-a98f-456d-a996-b69cfc9a458e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:22:25 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-2973a410-e297-44d3-a3d3-fbbad1c3221e tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:d5754ff3-a98f-456d-a996-b69cfc9a458e, portal: 172.16.0.220,3260]
Oct 18 12:22:25 user nova-compute[74190]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:d5754ff3-a98f-456d-a996-b69cfc9a458e, portal: 172.16.0.220,3260] successful.
Oct 18 12:22:25 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:22:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5754ff3-a98f-456d-a996-b69cfc9a458e -p 172.16.0.220:3260 --op delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:22:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5754ff3-a98f-456d-a996-b69cfc9a458e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:22:25 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[6867e910-68aa-4faf-b395-b5475c62a457]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:22:25 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-2973a410-e297-44d3-a3d3-fbbad1c3221e tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:22:25 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-2973a410-e297-44d3-a3d3-fbbad1c3221e tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.369s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 12:22:25 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-2973a410-e297-44d3-a3d3-fbbad1c3221e tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] <== disconnect_volume: return (371ms) None {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 12:22:25 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2973a410-e297-44d3-a3d3-fbbad1c3221e tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 3930e04a-3d64-407c-90c2-f9b14269c27c] Disconnected iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 12:22:25 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-2973a410-e297-44d3-a3d3-fbbad1c3221e tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 3930e04a-3d64-407c-90c2-f9b14269c27c] Deleting instance files /opt/stack/data/nova/instances/3930e04a-3d64-407c-90c2-f9b14269c27c_del
Oct 18 12:22:25 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-2973a410-e297-44d3-a3d3-fbbad1c3221e tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 3930e04a-3d64-407c-90c2-f9b14269c27c] Deletion of /opt/stack/data/nova/instances/3930e04a-3d64-407c-90c2-f9b14269c27c_del complete
Oct 18 12:22:25 user nova-compute[74190]: INFO nova.compute.manager [None req-2973a410-e297-44d3-a3d3-fbbad1c3221e tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 3930e04a-3d64-407c-90c2-f9b14269c27c] Took 1.23 seconds to destroy the instance on the hypervisor.
Oct 18 12:22:25 user nova-compute[74190]: DEBUG oslo.service.loopingcall [None req-2973a410-e297-44d3-a3d3-fbbad1c3221e tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74190) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 12:22:25 user nova-compute[74190]: DEBUG nova.compute.manager [-] [instance: 3930e04a-3d64-407c-90c2-f9b14269c27c] Deallocating network for instance {{(pid=74190) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 12:22:25 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: 3930e04a-3d64-407c-90c2-f9b14269c27c] deallocate_for_instance() {{(pid=74190) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 12:22:25 user nova-compute[74190]: DEBUG nova.compute.manager [req-7aa1b6e6-da69-4c64-892f-dcfb74ad47e6 req-9fa7116a-6a4a-44bc-b2ea-770300e0893c service nova] [instance: 3930e04a-3d64-407c-90c2-f9b14269c27c] Received event network-changed-f5a6b75c-7bcb-4a37-96aa-c30430598ecd {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:22:25 user nova-compute[74190]: DEBUG nova.compute.manager [req-7aa1b6e6-da69-4c64-892f-dcfb74ad47e6 req-9fa7116a-6a4a-44bc-b2ea-770300e0893c service nova] [instance: 3930e04a-3d64-407c-90c2-f9b14269c27c] Refreshing instance network info cache due to event network-changed-f5a6b75c-7bcb-4a37-96aa-c30430598ecd. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 12:22:25 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-7aa1b6e6-da69-4c64-892f-dcfb74ad47e6 req-9fa7116a-6a4a-44bc-b2ea-770300e0893c service nova] Acquiring lock "refresh_cache-3930e04a-3d64-407c-90c2-f9b14269c27c" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:22:25 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-7aa1b6e6-da69-4c64-892f-dcfb74ad47e6 req-9fa7116a-6a4a-44bc-b2ea-770300e0893c service nova] Acquired lock "refresh_cache-3930e04a-3d64-407c-90c2-f9b14269c27c" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:22:25 user nova-compute[74190]: DEBUG nova.network.neutron [req-7aa1b6e6-da69-4c64-892f-dcfb74ad47e6 req-9fa7116a-6a4a-44bc-b2ea-770300e0893c service nova] [instance: 3930e04a-3d64-407c-90c2-f9b14269c27c] Refreshing network info cache for port f5a6b75c-7bcb-4a37-96aa-c30430598ecd {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 12:22:25 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:22:25 user nova-compute[74190]: DEBUG nova.network.neutron [req-7aa1b6e6-da69-4c64-892f-dcfb74ad47e6 req-9fa7116a-6a4a-44bc-b2ea-770300e0893c service nova] [instance: 3930e04a-3d64-407c-90c2-f9b14269c27c] Updated VIF entry in instance network info cache for port f5a6b75c-7bcb-4a37-96aa-c30430598ecd. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 12:22:25 user nova-compute[74190]: DEBUG nova.network.neutron [req-7aa1b6e6-da69-4c64-892f-dcfb74ad47e6 req-9fa7116a-6a4a-44bc-b2ea-770300e0893c service nova] [instance: 3930e04a-3d64-407c-90c2-f9b14269c27c] Updating instance_info_cache with network_info: [{"id": "f5a6b75c-7bcb-4a37-96aa-c30430598ecd", "address": "fa:16:3e:2e:bb:8f", "network": {"id": "aa827f81-b165-444f-89cc-f21c42a9f772", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1659902586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e375153f6f24827811c5825fc2a2c6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a6b75c-7b", "ovs_interfaceid": "f5a6b75c-7bcb-4a37-96aa-c30430598ecd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:22:26 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-7aa1b6e6-da69-4c64-892f-dcfb74ad47e6 req-9fa7116a-6a4a-44bc-b2ea-770300e0893c service nova] Releasing lock "refresh_cache-3930e04a-3d64-407c-90c2-f9b14269c27c" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:22:26 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:22:26 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: 3930e04a-3d64-407c-90c2-f9b14269c27c] Updating instance_info_cache with network_info: [] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:22:26 user nova-compute[74190]: INFO nova.compute.manager [-] [instance: 3930e04a-3d64-407c-90c2-f9b14269c27c] Took 0.64 seconds to deallocate network for instance.
Oct 18 12:22:26 user nova-compute[74190]: DEBUG nova.compute.manager [req-1bb183df-0dfb-4a3f-8d34-9663ec2d3294 req-87edd328-6e0c-4265-90f9-954d2ccc3a01 service nova] [instance: 3930e04a-3d64-407c-90c2-f9b14269c27c] Received event network-vif-deleted-f5a6b75c-7bcb-4a37-96aa-c30430598ecd {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:22:26 user nova-compute[74190]: INFO nova.compute.manager [req-1bb183df-0dfb-4a3f-8d34-9663ec2d3294 req-87edd328-6e0c-4265-90f9-954d2ccc3a01 service nova] [instance: 3930e04a-3d64-407c-90c2-f9b14269c27c] Neutron deleted interface f5a6b75c-7bcb-4a37-96aa-c30430598ecd; detaching it from the instance and deleting it from the info cache
Oct 18 12:22:26 user nova-compute[74190]: DEBUG nova.network.neutron [req-1bb183df-0dfb-4a3f-8d34-9663ec2d3294 req-87edd328-6e0c-4265-90f9-954d2ccc3a01 service nova] [instance: 3930e04a-3d64-407c-90c2-f9b14269c27c] Updating instance_info_cache with network_info: [] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:22:26 user nova-compute[74190]: DEBUG nova.compute.manager [req-1bb183df-0dfb-4a3f-8d34-9663ec2d3294 req-87edd328-6e0c-4265-90f9-954d2ccc3a01 service nova] [instance: 3930e04a-3d64-407c-90c2-f9b14269c27c] Detach interface failed, port_id=f5a6b75c-7bcb-4a37-96aa-c30430598ecd, reason: Instance 3930e04a-3d64-407c-90c2-f9b14269c27c could not be found. {{(pid=74190) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 18 12:22:26 user nova-compute[74190]: DEBUG nova.compute.manager [req-4643599a-618e-413d-a578-9d896f5cbe7d req-1330d41e-8a03-4e85-ba67-75db6c92a04f service nova] [instance: 3930e04a-3d64-407c-90c2-f9b14269c27c] Received event network-vif-plugged-f5a6b75c-7bcb-4a37-96aa-c30430598ecd {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:22:26 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-4643599a-618e-413d-a578-9d896f5cbe7d req-1330d41e-8a03-4e85-ba67-75db6c92a04f service nova] Acquiring lock "3930e04a-3d64-407c-90c2-f9b14269c27c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:22:26 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-4643599a-618e-413d-a578-9d896f5cbe7d req-1330d41e-8a03-4e85-ba67-75db6c92a04f service nova] Lock "3930e04a-3d64-407c-90c2-f9b14269c27c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:22:26 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-4643599a-618e-413d-a578-9d896f5cbe7d req-1330d41e-8a03-4e85-ba67-75db6c92a04f service nova] Lock "3930e04a-3d64-407c-90c2-f9b14269c27c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:22:26 user nova-compute[74190]: DEBUG nova.compute.manager [req-4643599a-618e-413d-a578-9d896f5cbe7d req-1330d41e-8a03-4e85-ba67-75db6c92a04f service nova] [instance: 3930e04a-3d64-407c-90c2-f9b14269c27c] No waiting events found dispatching network-vif-plugged-f5a6b75c-7bcb-4a37-96aa-c30430598ecd {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:22:26 user nova-compute[74190]: WARNING nova.compute.manager [req-4643599a-618e-413d-a578-9d896f5cbe7d req-1330d41e-8a03-4e85-ba67-75db6c92a04f service nova] [instance: 3930e04a-3d64-407c-90c2-f9b14269c27c] Received unexpected event network-vif-plugged-f5a6b75c-7bcb-4a37-96aa-c30430598ecd for instance with vm_state active and task_state deleting.
Oct 18 12:22:27 user nova-compute[74190]: INFO nova.compute.manager [None req-2973a410-e297-44d3-a3d3-fbbad1c3221e tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 3930e04a-3d64-407c-90c2-f9b14269c27c] Took 0.81 seconds to detach 1 volumes for instance.
Oct 18 12:22:27 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-2973a410-e297-44d3-a3d3-fbbad1c3221e tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:22:27 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-2973a410-e297-44d3-a3d3-fbbad1c3221e tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:22:27 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-2973a410-e297-44d3-a3d3-fbbad1c3221e tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 12:22:27 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-2973a410-e297-44d3-a3d3-fbbad1c3221e tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 12:22:27 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-2973a410-e297-44d3-a3d3-fbbad1c3221e tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.159s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:22:27 user nova-compute[74190]: INFO nova.scheduler.client.report [None req-2973a410-e297-44d3-a3d3-fbbad1c3221e tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Deleted allocations for instance 3930e04a-3d64-407c-90c2-f9b14269c27c
Oct 18 12:22:27 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-2973a410-e297-44d3-a3d3-fbbad1c3221e tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "3930e04a-3d64-407c-90c2-f9b14269c27c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.145s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:22:28 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:22:29 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:22:29 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Cleaning up deleted instances {{(pid=74190) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 18 12:22:29 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] There are 0 instances to clean {{(pid=74190) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 18 12:22:30 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:22:30 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Starting heal instance info cache {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 12:22:30 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Rebuilding the list of instances to heal {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 18 12:22:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:22:30 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "refresh_cache-254d3af1-7a43-43d6-b0fa-ddb7fc3dac74" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:22:30 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquired lock "refresh_cache-254d3af1-7a43-43d6-b0fa-ddb7fc3dac74" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:22:30 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74] Forcefully refreshing network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 18 12:22:30 user nova-compute[74190]: DEBUG nova.objects.instance [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lazy-loading 'info_cache' on Instance uuid 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:22:30 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74] Updating instance_info_cache with network_info: [{"id": "82848227-6c16-405c-a0ba-348c210787ef", "address": "fa:16:3e:41:dd:5a", "network": {"id": "aa827f81-b165-444f-89cc-f21c42a9f772", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1659902586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e375153f6f24827811c5825fc2a2c6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82848227-6c", "ovs_interfaceid": "82848227-6c16-405c-a0ba-348c210787ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:22:30 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Releasing lock "refresh_cache-254d3af1-7a43-43d6-b0fa-ddb7fc3dac74" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:22:30 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74] Updated the network info_cache for instance {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 18 12:22:30 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:22:31 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:22:31 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:22:32 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:22:32 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74190) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 12:22:33 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:22:33 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:22:33 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74190) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 18 12:22:34 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:22:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:22:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:22:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:22:34 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Auditing locally available compute resources for user (node: user) {{(pid=74190) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 12:22:34 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 12:22:34 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:22:34 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:22:34 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Hypervisor/Node resource view: name=user free_ram=8787MB free_disk=25.2310791015625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74190) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 12:22:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:22:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:22:35 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:22:35 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 12:22:35 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 12:22:35 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 12:22:35 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 12:22:35 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:22:35 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Compute_service record updated for user:user {{(pid=74190) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 12:22:35 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.440s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:22:40 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:22:41 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:22:45 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:22:50 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:22:55 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:23:00 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:23:05 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:23:10 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:23:15 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:23:20 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:23:20 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:23:20 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74190) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 12:23:20 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:23:20 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:23:20 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:23:21 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:23:25 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:23:27 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:23:28 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:23:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:23:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:23:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74190) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 12:23:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:23:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:23:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:23:31 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:23:31 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Starting heal instance info cache {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 12:23:31 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Rebuilding the list of instances to heal {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 18 12:23:31 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "refresh_cache-254d3af1-7a43-43d6-b0fa-ddb7fc3dac74" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:23:31 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquired lock "refresh_cache-254d3af1-7a43-43d6-b0fa-ddb7fc3dac74" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:23:31 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74] Forcefully refreshing network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 18 12:23:31 user nova-compute[74190]: DEBUG nova.objects.instance [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lazy-loading 'info_cache' on Instance uuid 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:23:31 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74] Updating instance_info_cache with network_info: [{"id": "82848227-6c16-405c-a0ba-348c210787ef", "address": "fa:16:3e:41:dd:5a", "network": {"id": "aa827f81-b165-444f-89cc-f21c42a9f772", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1659902586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e375153f6f24827811c5825fc2a2c6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82848227-6c", "ovs_interfaceid": "82848227-6c16-405c-a0ba-348c210787ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:23:31 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Releasing lock "refresh_cache-254d3af1-7a43-43d6-b0fa-ddb7fc3dac74" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:23:31 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74] Updated the network info_cache for instance {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 18 12:23:32 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:23:33 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:23:33 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:23:34 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:23:34 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74190) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 12:23:34 user nova-compute[74190]: DEBUG nova.compute.manager [req-915a2d52-bd6a-456c-b0e3-469be4952807 req-6655ab40-b375-4832-a4a8-a705105c4d34 service nova] [instance: 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74] Received event network-changed-82848227-6c16-405c-a0ba-348c210787ef {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:23:34 user nova-compute[74190]: DEBUG nova.compute.manager [req-915a2d52-bd6a-456c-b0e3-469be4952807 req-6655ab40-b375-4832-a4a8-a705105c4d34 service nova] [instance: 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74] Refreshing instance network info cache due to event network-changed-82848227-6c16-405c-a0ba-348c210787ef. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 12:23:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-915a2d52-bd6a-456c-b0e3-469be4952807 req-6655ab40-b375-4832-a4a8-a705105c4d34 service nova] Acquiring lock "refresh_cache-254d3af1-7a43-43d6-b0fa-ddb7fc3dac74" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:23:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-915a2d52-bd6a-456c-b0e3-469be4952807 req-6655ab40-b375-4832-a4a8-a705105c4d34 service nova] Acquired lock "refresh_cache-254d3af1-7a43-43d6-b0fa-ddb7fc3dac74" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:23:34 user nova-compute[74190]: DEBUG nova.network.neutron [req-915a2d52-bd6a-456c-b0e3-469be4952807 req-6655ab40-b375-4832-a4a8-a705105c4d34 service nova] [instance: 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74] Refreshing network info cache for port 82848227-6c16-405c-a0ba-348c210787ef {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 12:23:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-399676b9-1ff5-4ef6-ac0c-3bd81d735afc tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Acquiring lock "254d3af1-7a43-43d6-b0fa-ddb7fc3dac74" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:23:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-399676b9-1ff5-4ef6-ac0c-3bd81d735afc tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "254d3af1-7a43-43d6-b0fa-ddb7fc3dac74" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:23:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-399676b9-1ff5-4ef6-ac0c-3bd81d735afc tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Acquiring lock "254d3af1-7a43-43d6-b0fa-ddb7fc3dac74-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:23:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-399676b9-1ff5-4ef6-ac0c-3bd81d735afc tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "254d3af1-7a43-43d6-b0fa-ddb7fc3dac74-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:23:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-399676b9-1ff5-4ef6-ac0c-3bd81d735afc tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "254d3af1-7a43-43d6-b0fa-ddb7fc3dac74-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:23:34 user nova-compute[74190]: INFO nova.compute.manager [None req-399676b9-1ff5-4ef6-ac0c-3bd81d735afc tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74] Terminating instance
Oct 18 12:23:34 user nova-compute[74190]: DEBUG nova.compute.manager [None req-399676b9-1ff5-4ef6-ac0c-3bd81d735afc tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74] Start destroying the instance on the hypervisor. {{(pid=74190) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 12:23:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:23:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:23:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:23:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:23:34 user nova-compute[74190]: DEBUG nova.network.neutron [req-915a2d52-bd6a-456c-b0e3-469be4952807 req-6655ab40-b375-4832-a4a8-a705105c4d34 service nova] [instance: 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74] Updated VIF entry in instance network info cache for port 82848227-6c16-405c-a0ba-348c210787ef. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 12:23:34 user nova-compute[74190]: DEBUG nova.network.neutron [req-915a2d52-bd6a-456c-b0e3-469be4952807 req-6655ab40-b375-4832-a4a8-a705105c4d34 service nova] [instance: 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74] Updating instance_info_cache with network_info: [{"id": "82848227-6c16-405c-a0ba-348c210787ef", "address": "fa:16:3e:41:dd:5a", "network": {"id": "aa827f81-b165-444f-89cc-f21c42a9f772", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1659902586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e375153f6f24827811c5825fc2a2c6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82848227-6c", "ovs_interfaceid": "82848227-6c16-405c-a0ba-348c210787ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:23:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-915a2d52-bd6a-456c-b0e3-469be4952807 req-6655ab40-b375-4832-a4a8-a705105c4d34 service nova] Releasing lock "refresh_cache-254d3af1-7a43-43d6-b0fa-ddb7fc3dac74" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:23:34 user nova-compute[74190]: DEBUG nova.compute.manager [req-00bc0d2d-34cc-40bc-9ab5-c3d83d558ee4 req-1530f143-343c-4635-acb0-e1ff7528079a service nova] [instance: 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74] Received event network-vif-unplugged-82848227-6c16-405c-a0ba-348c210787ef {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:23:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-00bc0d2d-34cc-40bc-9ab5-c3d83d558ee4 req-1530f143-343c-4635-acb0-e1ff7528079a service nova] Acquiring lock "254d3af1-7a43-43d6-b0fa-ddb7fc3dac74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:23:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-00bc0d2d-34cc-40bc-9ab5-c3d83d558ee4 req-1530f143-343c-4635-acb0-e1ff7528079a service nova] Lock "254d3af1-7a43-43d6-b0fa-ddb7fc3dac74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:23:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-00bc0d2d-34cc-40bc-9ab5-c3d83d558ee4 req-1530f143-343c-4635-acb0-e1ff7528079a service nova] Lock "254d3af1-7a43-43d6-b0fa-ddb7fc3dac74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:23:34 user nova-compute[74190]: DEBUG nova.compute.manager [req-00bc0d2d-34cc-40bc-9ab5-c3d83d558ee4 req-1530f143-343c-4635-acb0-e1ff7528079a service nova] [instance: 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74] No waiting events found dispatching network-vif-unplugged-82848227-6c16-405c-a0ba-348c210787ef {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:23:34 user nova-compute[74190]: DEBUG nova.compute.manager [req-00bc0d2d-34cc-40bc-9ab5-c3d83d558ee4 req-1530f143-343c-4635-acb0-e1ff7528079a service nova] [instance: 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74] Received event network-vif-unplugged-82848227-6c16-405c-a0ba-348c210787ef for instance with task_state deleting. {{(pid=74190) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 12:23:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:23:35 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:23:35 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:23:35 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:23:35 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:23:35 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Auditing locally available compute resources for user (node: user) {{(pid=74190) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 12:23:35 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:23:35 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:23:35 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:23:35 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74] Instance destroyed successfully.
Oct 18 12:23:35 user nova-compute[74190]: DEBUG nova.objects.instance [None req-399676b9-1ff5-4ef6-ac0c-3bd81d735afc tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lazy-loading 'resources' on Instance uuid 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:23:35 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-399676b9-1ff5-4ef6-ac0c-3bd81d735afc tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T12:18:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1596601119',display_name='tempest-TestVolumeBootPattern-server-1596601119',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1596601119',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFImDkcHIZVVsD1gB2Yh4JGNE0pEbAN8TUjpItUrbhxdmYRzrbNlPip8qPxIcvk8OJEen8xQaAGxdqzAZ1w6kqPbscsnuFtwOBrKfpec5lSOkFKoHZaLFZ1ci5kqBfXOJw==',key_name='tempest-TestVolumeBootPattern-131084726',keypairs=<?>,launch_index=0,launched_at=2023-10-18T12:18:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1e375153f6f24827811c5825fc2a2c6a',ramdisk_id='',reservation_id='r-raxamz8u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1157442382',owner_user_name='tempest-TestVolumeBootPattern-1157442382-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T12:18:47Z,user_data=None,user_id='27d9fc244d0f4e10a43b7df4dc8e30ad',uuid=254d3af1-7a43-43d6-b0fa-ddb7fc3dac74,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "82848227-6c16-405c-a0ba-348c210787ef", "address": "fa:16:3e:41:dd:5a", "network": {"id": "aa827f81-b165-444f-89cc-f21c42a9f772", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1659902586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e375153f6f24827811c5825fc2a2c6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82848227-6c", "ovs_interfaceid": "82848227-6c16-405c-a0ba-348c210787ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 12:23:35 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-399676b9-1ff5-4ef6-ac0c-3bd81d735afc tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Converting VIF {"id": "82848227-6c16-405c-a0ba-348c210787ef", "address": "fa:16:3e:41:dd:5a", "network": {"id": "aa827f81-b165-444f-89cc-f21c42a9f772", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1659902586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e375153f6f24827811c5825fc2a2c6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82848227-6c", "ovs_interfaceid": "82848227-6c16-405c-a0ba-348c210787ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 12:23:35 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-399676b9-1ff5-4ef6-ac0c-3bd81d735afc tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:41:dd:5a,bridge_name='br-int',has_traffic_filtering=True,id=82848227-6c16-405c-a0ba-348c210787ef,network=Network(aa827f81-b165-444f-89cc-f21c42a9f772),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82848227-6c') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 12:23:35 user nova-compute[74190]: DEBUG os_vif [None req-399676b9-1ff5-4ef6-ac0c-3bd81d735afc tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:dd:5a,bridge_name='br-int',has_traffic_filtering=True,id=82848227-6c16-405c-a0ba-348c210787ef,network=Network(aa827f81-b165-444f-89cc-f21c42a9f772),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82848227-6c') {{(pid=74190) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 12:23:35 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:23:35 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap82848227-6c, bridge=br-int, if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:23:35 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:23:35 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:23:35 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:23:35 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1d8477de-9fcb-4127-b094-ce698568f6db) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:23:35 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:23:35 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:23:35 user nova-compute[74190]: INFO os_vif [None req-399676b9-1ff5-4ef6-ac0c-3bd81d735afc tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:dd:5a,bridge_name='br-int',has_traffic_filtering=True,id=82848227-6c16-405c-a0ba-348c210787ef,network=Network(aa827f81-b165-444f-89cc-f21c42a9f772),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82848227-6c')
Oct 18 12:23:35 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-399676b9-1ff5-4ef6-ac0c-3bd81d735afc tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74] calling os-brick to detach iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 12:23:35 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-399676b9-1ff5-4ef6-ac0c-3bd81d735afc tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, {'target_iqn': 'iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eDJgkSRx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 12:23:35 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-399676b9-1ff5-4ef6-ac0c-3bd81d735afc tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 12:23:35 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-399676b9-1ff5-4ef6-ac0c-3bd81d735afc tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 12:23:35 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-399676b9-1ff5-4ef6-ac0c-3bd81d735afc tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 12:23:35 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:23:35 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:23:35 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbddd1b1-9829-47ff-9478-5a0392c4be79]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:23:35 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-399676b9-1ff5-4ef6-ac0c-3bd81d735afc tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 12:23:35 user nova-compute[74190]: No targets found.
Oct 18 12:23:35 user nova-compute[74190]: iSNS:
Oct 18 12:23:35 user nova-compute[74190]: No targets found.
Oct 18 12:23:35 user nova-compute[74190]: STATIC:
Oct 18 12:23:35 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18
Oct 18 12:23:35 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 12:23:35 user nova-compute[74190]:                 Iface Name: default
Oct 18 12:23:35 user nova-compute[74190]: FIRMWARE:
Oct 18 12:23:35 user nova-compute[74190]: No targets found.
Oct 18 12:23:35 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 12:23:35 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-399676b9-1ff5-4ef6-ac0c-3bd81d735afc tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 12:23:35 user nova-compute[74190]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 12:23:35 user nova-compute[74190]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74190) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 12:23:35 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-399676b9-1ff5-4ef6-ac0c-3bd81d735afc tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18', 0)] {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 12:23:35 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:23:35 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 12:23:35 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:23:35 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[759ed5bc-d30f-46df-aaa0-2e5f9495bebe]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:23:35 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:23:35 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:23:35 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[d28457ce-25a7-43a7-9312-d8b12b11c492]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18 (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:23:35 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-399676b9-1ff5-4ef6-ac0c-3bd81d735afc tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18 (non-flash)
Oct 18 12:23:35 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 12:23:35 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-399676b9-1ff5-4ef6-ac0c-3bd81d735afc tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18 (non-flash)
Oct 18 12:23:35 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 12:23:35 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-399676b9-1ff5-4ef6-ac0c-3bd81d735afc tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1f247cf490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18'): ({'sdb'}, set())}) {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 12:23:35 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-399676b9-1ff5-4ef6-ac0c-3bd81d735afc tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Removing single pathed devices sdb {{(pid=74190) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 12:23:35 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:23:35 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:23:35 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:23:35 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Hypervisor/Node resource view: name=user free_ram=9040MB free_disk=25.220699310302734GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74190) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 12:23:35 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:23:35 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:23:35 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:23:35 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c7e0524-97ec-49e9-92cb-01893b092af3]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:23:35 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:23:35 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:23:35 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef0acd4-7cb0-484f-a2b0-c954018ffdac]: (4, ('ok\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:23:35 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-399676b9-1ff5-4ef6-ac0c-3bd81d735afc tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Flushing IO for device /dev/sdb {{(pid=74190) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 12:23:35 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:23:35 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:23:35 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a5e69fc-e8c9-4ee1-8eae-c971cd2463e0]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:23:35 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-399676b9-1ff5-4ef6-ac0c-3bd81d735afc tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74190) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 12:23:35 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:23:35 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:23:35 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 12:23:35 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 12:23:35 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:23:35 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[c87779ba-c5ab-4d7a-a4dd-7fb749d66dd8]: (4, ('1', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:23:35 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-399676b9-1ff5-4ef6-ac0c-3bd81d735afc tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 12:23:35 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-399676b9-1ff5-4ef6-ac0c-3bd81d735afc tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] SCSI volumes sdb have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 12:23:35 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-399676b9-1ff5-4ef6-ac0c-3bd81d735afc tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18')] {{(pid=74190) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 12:23:35 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:23:35 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Refreshing inventories for resource provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 18 12:23:35 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:23:35 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[da084950-682e-4a0a-b119-323ba0cc4e34]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:23:35 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-399676b9-1ff5-4ef6-ac0c-3bd81d735afc tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:23:35 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18 -p 172.16.0.220:3260 --logout {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:23:35 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Updating ProviderTree inventory for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 18 12:23:35 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Updating inventory in ProviderTree for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 18 12:23:35 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Refreshing aggregate associations for resource provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66, aggregates: None {{(pid=74190) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 18 12:23:35 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:23:35 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7938fe9-82f4-4f0a-ac1e-8394bcf63fbf]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:23:35 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-399676b9-1ff5-4ef6-ac0c-3bd81d735afc tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18, portal: 172.16.0.220,3260]
Oct 18 12:23:35 user nova-compute[74190]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18, portal: 172.16.0.220,3260] successful.
Oct 18 12:23:35 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:23:35 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18 -p 172.16.0.220:3260 --op delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:23:35 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83ff0b09-1a99-460d-94d4-df24e2880d18 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:23:35 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6513e43-6e89-402f-bf33-40fa4eb413a7]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:23:35 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-399676b9-1ff5-4ef6-ac0c-3bd81d735afc tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:23:35 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-399676b9-1ff5-4ef6-ac0c-3bd81d735afc tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.725s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 12:23:35 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-399676b9-1ff5-4ef6-ac0c-3bd81d735afc tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] <== disconnect_volume: return (727ms) None {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 12:23:35 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-399676b9-1ff5-4ef6-ac0c-3bd81d735afc tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74] Disconnected iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 12:23:35 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-399676b9-1ff5-4ef6-ac0c-3bd81d735afc tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74] Deleting instance files /opt/stack/data/nova/instances/254d3af1-7a43-43d6-b0fa-ddb7fc3dac74_del
Oct 18 12:23:35 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-399676b9-1ff5-4ef6-ac0c-3bd81d735afc tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74] Deletion of /opt/stack/data/nova/instances/254d3af1-7a43-43d6-b0fa-ddb7fc3dac74_del complete
Oct 18 12:23:35 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Refreshing trait associations for resource provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66, traits: COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE42,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_ACCELERATORS,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=74190) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 18 12:23:36 user nova-compute[74190]: INFO nova.compute.manager [None req-399676b9-1ff5-4ef6-ac0c-3bd81d735afc tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74] Took 1.67 seconds to destroy the instance on the hypervisor.
Oct 18 12:23:36 user nova-compute[74190]: DEBUG oslo.service.loopingcall [None req-399676b9-1ff5-4ef6-ac0c-3bd81d735afc tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74190) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 12:23:36 user nova-compute[74190]: DEBUG nova.compute.manager [-] [instance: 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74] Deallocating network for instance {{(pid=74190) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 12:23:36 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74] deallocate_for_instance() {{(pid=74190) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 12:23:36 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 12:23:36 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 12:23:36 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Compute_service record updated for user:user {{(pid=74190) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 12:23:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.371s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:23:36 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74] Updating instance_info_cache with network_info: [] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:23:36 user nova-compute[74190]: INFO nova.compute.manager [-] [instance: 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74] Took 0.49 seconds to deallocate network for instance.
Oct 18 12:23:36 user nova-compute[74190]: DEBUG nova.compute.manager [req-06ed0d51-56a8-4d54-a953-37793ee26727 req-6e953091-1d87-4918-b32b-2d993d0edca8 service nova] [instance: 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74] Received event network-vif-deleted-82848227-6c16-405c-a0ba-348c210787ef {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:23:36 user nova-compute[74190]: INFO nova.compute.manager [req-06ed0d51-56a8-4d54-a953-37793ee26727 req-6e953091-1d87-4918-b32b-2d993d0edca8 service nova] [instance: 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74] Neutron deleted interface 82848227-6c16-405c-a0ba-348c210787ef; detaching it from the instance and deleting it from the info cache
Oct 18 12:23:36 user nova-compute[74190]: DEBUG nova.network.neutron [req-06ed0d51-56a8-4d54-a953-37793ee26727 req-6e953091-1d87-4918-b32b-2d993d0edca8 service nova] [instance: 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74] Updating instance_info_cache with network_info: [] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:23:36 user nova-compute[74190]: DEBUG nova.compute.manager [req-06ed0d51-56a8-4d54-a953-37793ee26727 req-6e953091-1d87-4918-b32b-2d993d0edca8 service nova] [instance: 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74] Detach interface failed, port_id=82848227-6c16-405c-a0ba-348c210787ef, reason: Instance 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74 could not be found. {{(pid=74190) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 18 12:23:36 user nova-compute[74190]: DEBUG nova.compute.manager [req-adea6170-52cb-4fdb-9cad-721fa8e37a1a req-9734c34f-bb1c-448a-a097-b23420ff6480 service nova] [instance: 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74] Received event network-vif-plugged-82848227-6c16-405c-a0ba-348c210787ef {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:23:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-adea6170-52cb-4fdb-9cad-721fa8e37a1a req-9734c34f-bb1c-448a-a097-b23420ff6480 service nova] Acquiring lock "254d3af1-7a43-43d6-b0fa-ddb7fc3dac74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:23:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-adea6170-52cb-4fdb-9cad-721fa8e37a1a req-9734c34f-bb1c-448a-a097-b23420ff6480 service nova] Lock "254d3af1-7a43-43d6-b0fa-ddb7fc3dac74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:23:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-adea6170-52cb-4fdb-9cad-721fa8e37a1a req-9734c34f-bb1c-448a-a097-b23420ff6480 service nova] Lock "254d3af1-7a43-43d6-b0fa-ddb7fc3dac74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:23:36 user nova-compute[74190]: DEBUG nova.compute.manager [req-adea6170-52cb-4fdb-9cad-721fa8e37a1a req-9734c34f-bb1c-448a-a097-b23420ff6480 service nova] [instance: 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74] No waiting events found dispatching network-vif-plugged-82848227-6c16-405c-a0ba-348c210787ef {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:23:36 user nova-compute[74190]: WARNING nova.compute.manager [req-adea6170-52cb-4fdb-9cad-721fa8e37a1a req-9734c34f-bb1c-448a-a097-b23420ff6480 service nova] [instance: 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74] Received unexpected event network-vif-plugged-82848227-6c16-405c-a0ba-348c210787ef for instance with vm_state active and task_state deleting.
Oct 18 12:23:37 user nova-compute[74190]: INFO nova.compute.manager [None req-399676b9-1ff5-4ef6-ac0c-3bd81d735afc tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] [instance: 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74] Took 0.81 seconds to detach 1 volumes for instance.
Oct 18 12:23:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-399676b9-1ff5-4ef6-ac0c-3bd81d735afc tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:23:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-399676b9-1ff5-4ef6-ac0c-3bd81d735afc tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:23:37 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-399676b9-1ff5-4ef6-ac0c-3bd81d735afc tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 12:23:37 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-399676b9-1ff5-4ef6-ac0c-3bd81d735afc tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 12:23:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-399676b9-1ff5-4ef6-ac0c-3bd81d735afc tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.110s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:23:37 user nova-compute[74190]: INFO nova.scheduler.client.report [None req-399676b9-1ff5-4ef6-ac0c-3bd81d735afc tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Deleted allocations for instance 254d3af1-7a43-43d6-b0fa-ddb7fc3dac74
Oct 18 12:23:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-399676b9-1ff5-4ef6-ac0c-3bd81d735afc tempest-TestVolumeBootPattern-1157442382 tempest-TestVolumeBootPattern-1157442382-project-member] Lock "254d3af1-7a43-43d6-b0fa-ddb7fc3dac74" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.289s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:23:40 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:23:40 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:23:45 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:23:50 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:23:50 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:23:50 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74190) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 12:23:50 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:23:50 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:23:50 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:23:55 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:24:00 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:24:05 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:24:10 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:24:15 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:24:20 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:24:21 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:24:25 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:24:25 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:24:25 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74190) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 12:24:25 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:24:25 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:24:25 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:24:25 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:24:27 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:24:29 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:24:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:24:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:24:32 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:24:32 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Starting heal instance info cache {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 12:24:32 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Rebuilding the list of instances to heal {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 18 12:24:32 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Didn't find any instances for network info cache update. {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 18 12:24:34 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:24:34 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:24:34 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:24:35 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:24:35 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:24:36 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:24:36 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74190) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 12:24:36 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:24:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:24:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:24:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:24:36 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Auditing locally available compute resources for user (node: user) {{(pid=74190) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 12:24:36 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:24:36 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:24:36 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Hypervisor/Node resource view: name=user free_ram=9048MB free_disk=25.218563079833984GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74190) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 12:24:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:24:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:24:36 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 12:24:36 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 12:24:36 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 12:24:36 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 12:24:36 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Compute_service record updated for user:user {{(pid=74190) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 12:24:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.179s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:24:36 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:24:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:24:40 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:24:40 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:24:40 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:24:41 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:24:43 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:24:45 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:24:45 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:24:47 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Acquiring lock "42f93716-a9ca-4615-bd2c-f49bd15355d0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:24:47 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Lock "42f93716-a9ca-4615-bd2c-f49bd15355d0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:24:47 user nova-compute[74190]: DEBUG nova.compute.manager [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Starting instance... {{(pid=74190) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 12:24:47 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:24:47 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:24:47 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74190) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 12:24:47 user nova-compute[74190]: INFO nova.compute.claims [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Claim successful on node user
Oct 18 12:24:47 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 12:24:47 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 12:24:47 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.249s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:24:47 user nova-compute[74190]: DEBUG nova.compute.manager [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Start building networks asynchronously for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 12:24:47 user nova-compute[74190]: DEBUG nova.compute.manager [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Allocating IP information in the background. {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 12:24:47 user nova-compute[74190]: DEBUG nova.network.neutron [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] allocate_for_instance() {{(pid=74190) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 12:24:47 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 12:24:47 user nova-compute[74190]: DEBUG nova.compute.manager [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Start building block device mappings for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 12:24:47 user nova-compute[74190]: DEBUG nova.policy [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '308413c6fcfa4ac1b73916bc81e46851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b49249509b24a1bb7c97536ab9f1bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74190) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 12:24:47 user nova-compute[74190]: DEBUG nova.compute.manager [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Start spawning the instance on the hypervisor. {{(pid=74190) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 12:24:47 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Creating instance directory {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 12:24:47 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Creating image(s)
Oct 18 12:24:47 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Acquiring lock "/opt/stack/data/nova/instances/42f93716-a9ca-4615-bd2c-f49bd15355d0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:24:47 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Lock "/opt/stack/data/nova/instances/42f93716-a9ca-4615-bd2c-f49bd15355d0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:24:47 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Lock "/opt/stack/data/nova/instances/42f93716-a9ca-4615-bd2c-f49bd15355d0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:24:47 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Acquiring lock "3ae2894f06b5dd05b86764be64149ab2486f1262" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:24:47 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Lock "3ae2894f06b5dd05b86764be64149ab2486f1262" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:24:48 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3ae2894f06b5dd05b86764be64149ab2486f1262.part --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:24:48 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3ae2894f06b5dd05b86764be64149ab2486f1262.part --force-share --output=json" returned: 0 in 0.183s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:24:48 user nova-compute[74190]: DEBUG nova.virt.images [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] 693a8c10-488c-4cd9-a0c7-8de2f1c61cc3 was qcow2, converting to raw {{(pid=74190) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 18 12:24:48 user nova-compute[74190]: DEBUG nova.privsep.utils [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74190) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 18 12:24:48 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3ae2894f06b5dd05b86764be64149ab2486f1262.part /opt/stack/data/nova/instances/_base/3ae2894f06b5dd05b86764be64149ab2486f1262.converted {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:24:48 user nova-compute[74190]: DEBUG nova.network.neutron [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Successfully created port: 2c24e9ba-c6f7-4f33-b460-fd8cae737828 {{(pid=74190) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 12:24:48 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3ae2894f06b5dd05b86764be64149ab2486f1262.part /opt/stack/data/nova/instances/_base/3ae2894f06b5dd05b86764be64149ab2486f1262.converted" returned: 0 in 0.436s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:24:48 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3ae2894f06b5dd05b86764be64149ab2486f1262.converted --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:24:49 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3ae2894f06b5dd05b86764be64149ab2486f1262.converted --force-share --output=json" returned: 0 in 0.172s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:24:49 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Lock "3ae2894f06b5dd05b86764be64149ab2486f1262" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.279s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:24:49 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3ae2894f06b5dd05b86764be64149ab2486f1262 --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:24:49 user nova-compute[74190]: DEBUG nova.network.neutron [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Successfully updated port: 2c24e9ba-c6f7-4f33-b460-fd8cae737828 {{(pid=74190) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 12:24:49 user nova-compute[74190]: DEBUG nova.compute.manager [req-f69469e5-7d2f-4d84-a672-7be62f00cf6d req-8f195a4c-e2c4-4207-bc19-3ca35d2744d7 service nova] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Received event network-changed-2c24e9ba-c6f7-4f33-b460-fd8cae737828 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:24:49 user nova-compute[74190]: DEBUG nova.compute.manager [req-f69469e5-7d2f-4d84-a672-7be62f00cf6d req-8f195a4c-e2c4-4207-bc19-3ca35d2744d7 service nova] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Refreshing instance network info cache due to event network-changed-2c24e9ba-c6f7-4f33-b460-fd8cae737828. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 12:24:49 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-f69469e5-7d2f-4d84-a672-7be62f00cf6d req-8f195a4c-e2c4-4207-bc19-3ca35d2744d7 service nova] Acquiring lock "refresh_cache-42f93716-a9ca-4615-bd2c-f49bd15355d0" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:24:49 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-f69469e5-7d2f-4d84-a672-7be62f00cf6d req-8f195a4c-e2c4-4207-bc19-3ca35d2744d7 service nova] Acquired lock "refresh_cache-42f93716-a9ca-4615-bd2c-f49bd15355d0" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:24:49 user nova-compute[74190]: DEBUG nova.network.neutron [req-f69469e5-7d2f-4d84-a672-7be62f00cf6d req-8f195a4c-e2c4-4207-bc19-3ca35d2744d7 service nova] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Refreshing network info cache for port 2c24e9ba-c6f7-4f33-b460-fd8cae737828 {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 12:24:49 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Acquiring lock "refresh_cache-42f93716-a9ca-4615-bd2c-f49bd15355d0" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:24:49 user nova-compute[74190]: DEBUG nova.network.neutron [req-f69469e5-7d2f-4d84-a672-7be62f00cf6d req-8f195a4c-e2c4-4207-bc19-3ca35d2744d7 service nova] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Instance cache missing network info. {{(pid=74190) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 12:24:49 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3ae2894f06b5dd05b86764be64149ab2486f1262 --force-share --output=json" returned: 0 in 0.184s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:24:49 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Acquiring lock "3ae2894f06b5dd05b86764be64149ab2486f1262" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:24:49 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Lock "3ae2894f06b5dd05b86764be64149ab2486f1262" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:24:49 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3ae2894f06b5dd05b86764be64149ab2486f1262 --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:24:49 user nova-compute[74190]: DEBUG nova.network.neutron [req-f69469e5-7d2f-4d84-a672-7be62f00cf6d req-8f195a4c-e2c4-4207-bc19-3ca35d2744d7 service nova] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Updating instance_info_cache with network_info: [] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:24:49 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-f69469e5-7d2f-4d84-a672-7be62f00cf6d req-8f195a4c-e2c4-4207-bc19-3ca35d2744d7 service nova] Releasing lock "refresh_cache-42f93716-a9ca-4615-bd2c-f49bd15355d0" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:24:49 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Acquired lock "refresh_cache-42f93716-a9ca-4615-bd2c-f49bd15355d0" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:24:49 user nova-compute[74190]: DEBUG nova.network.neutron [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Building network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 12:24:49 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3ae2894f06b5dd05b86764be64149ab2486f1262 --force-share --output=json" returned: 0 in 0.175s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:24:49 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3ae2894f06b5dd05b86764be64149ab2486f1262,backing_fmt=raw /opt/stack/data/nova/instances/42f93716-a9ca-4615-bd2c-f49bd15355d0/disk 1073741824 {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:24:49 user nova-compute[74190]: DEBUG nova.network.neutron [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Instance cache missing network info. {{(pid=74190) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 12:24:49 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3ae2894f06b5dd05b86764be64149ab2486f1262,backing_fmt=raw /opt/stack/data/nova/instances/42f93716-a9ca-4615-bd2c-f49bd15355d0/disk 1073741824" returned: 0 in 0.047s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:24:49 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Lock "3ae2894f06b5dd05b86764be64149ab2486f1262" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:24:49 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3ae2894f06b5dd05b86764be64149ab2486f1262 --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:24:49 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3ae2894f06b5dd05b86764be64149ab2486f1262 --force-share --output=json" returned: 0 in 0.173s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:24:49 user nova-compute[74190]: DEBUG nova.virt.disk.api [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Checking if we can resize image /opt/stack/data/nova/instances/42f93716-a9ca-4615-bd2c-f49bd15355d0/disk. size=1073741824 {{(pid=74190) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 18 12:24:49 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f93716-a9ca-4615-bd2c-f49bd15355d0/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:24:49 user nova-compute[74190]: DEBUG nova.network.neutron [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Updating instance_info_cache with network_info: [{"id": "2c24e9ba-c6f7-4f33-b460-fd8cae737828", "address": "fa:16:3e:35:db:4f", "network": {"id": "f3af1635-bf8e-449d-baa0-fa3c2b96e435", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1573451770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b49249509b24a1bb7c97536ab9f1bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c24e9ba-c6", "ovs_interfaceid": "2c24e9ba-c6f7-4f33-b460-fd8cae737828", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:24:49 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Releasing lock "refresh_cache-42f93716-a9ca-4615-bd2c-f49bd15355d0" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:24:49 user nova-compute[74190]: DEBUG nova.compute.manager [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Instance network_info: |[{"id": "2c24e9ba-c6f7-4f33-b460-fd8cae737828", "address": "fa:16:3e:35:db:4f", "network": {"id": "f3af1635-bf8e-449d-baa0-fa3c2b96e435", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1573451770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b49249509b24a1bb7c97536ab9f1bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c24e9ba-c6", "ovs_interfaceid": "2c24e9ba-c6f7-4f33-b460-fd8cae737828", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 12:24:49 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f93716-a9ca-4615-bd2c-f49bd15355d0/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:24:49 user nova-compute[74190]: DEBUG nova.virt.disk.api [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Cannot resize image /opt/stack/data/nova/instances/42f93716-a9ca-4615-bd2c-f49bd15355d0/disk to a smaller size. {{(pid=74190) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 18 12:24:49 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Created local disks {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 12:24:49 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Ensure instance console log exists: /opt/stack/data/nova/instances/42f93716-a9ca-4615-bd2c-f49bd15355d0/console.log {{(pid=74190) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 12:24:49 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:24:49 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:24:49 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:24:49 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Start _get_guest_xml network_info=[{"id": "2c24e9ba-c6f7-4f33-b460-fd8cae737828", "address": "fa:16:3e:35:db:4f", "network": {"id": "f3af1635-bf8e-449d-baa0-fa3c2b96e435", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1573451770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b49249509b24a1bb7c97536ab9f1bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c24e9ba-c6", "ovs_interfaceid": "2c24e9ba-c6f7-4f33-b460-fd8cae737828", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T12:24:44Z,direct_url=<?>,disk_format='qcow2',id=693a8c10-488c-4cd9-a0c7-8de2f1c61cc3,min_disk=0,min_ram=0,name='tempest-scenario-img--1208908246',owner='0b49249509b24a1bb7c97536ab9f1bfe',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T12:24:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'image_id': '693a8c10-488c-4cd9-a0c7-8de2f1c61cc3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 12:24:49 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:24:49 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:24:49 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 12:24:49 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] CPU controller missing on host. {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 12:24:49 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 12:24:49 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] CPU controller found on host. {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 12:24:49 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74190) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 12:24:49 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T11:37:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T12:24:44Z,direct_url=<?>,disk_format='qcow2',id=693a8c10-488c-4cd9-a0c7-8de2f1c61cc3,min_disk=0,min_ram=0,name='tempest-scenario-img--1208908246',owner='0b49249509b24a1bb7c97536ab9f1bfe',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T12:24:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 12:24:49 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Flavor limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 12:24:49 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Image limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 12:24:49 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Flavor pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 12:24:49 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Image pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 12:24:49 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 12:24:49 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 12:24:49 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 12:24:49 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Got 1 possible topologies {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 12:24:49 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 12:24:49 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 12:24:49 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T12:24:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2013688416',display_name='tempest-TestMinimumBasicScenario-server-2013688416',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2013688416',id=51,image_ref='693a8c10-488c-4cd9-a0c7-8de2f1c61cc3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOCZwMpVFiAadyOJRFJSfp61V7G8+JJMzysqdVUUHmZsoRHcS+z4FN7O+/O2PGqEddXqvj2MjPNr7KtjpRQ6iyZ7vBg4jH2t5xe4Z3s9w0RYGFs8r5hwI9smaT/VK+6WA==',key_name='tempest-TestMinimumBasicScenario-1500157790',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b49249509b24a1bb7c97536ab9f1bfe',ramdisk_id='',reservation_id='r-yj6b2vga',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='693a8c10-488c-4cd9-a0c7-8de2f1c61cc3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-285966464',owner_user_name='tempest-TestMinimumBasicScenario-285966464-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T12:24:48Z,user_data=None,user_id='308413c6fcfa4ac1b73916bc81e46851',uuid=42f93716-a9ca-4615-bd2c-f49bd15355d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2c24e9ba-c6f7-4f33-b460-fd8cae737828", "address": "fa:16:3e:35:db:4f", "network": {"id": "f3af1635-bf8e-449d-baa0-fa3c2b96e435", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1573451770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b49249509b24a1bb7c97536ab9f1bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c24e9ba-c6", "ovs_interfaceid": "2c24e9ba-c6f7-4f33-b460-fd8cae737828", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74190) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 12:24:49 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Converting VIF {"id": "2c24e9ba-c6f7-4f33-b460-fd8cae737828", "address": "fa:16:3e:35:db:4f", "network": {"id": "f3af1635-bf8e-449d-baa0-fa3c2b96e435", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1573451770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b49249509b24a1bb7c97536ab9f1bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c24e9ba-c6", "ovs_interfaceid": "2c24e9ba-c6f7-4f33-b460-fd8cae737828", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 12:24:49 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:db:4f,bridge_name='br-int',has_traffic_filtering=True,id=2c24e9ba-c6f7-4f33-b460-fd8cae737828,network=Network(f3af1635-bf8e-449d-baa0-fa3c2b96e435),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c24e9ba-c6') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 12:24:49 user nova-compute[74190]: DEBUG nova.objects.instance [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Lazy-loading 'pci_devices' on Instance uuid 42f93716-a9ca-4615-bd2c-f49bd15355d0 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:24:49 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] End _get_guest_xml xml=<domain type="kvm">
Oct 18 12:24:49 user nova-compute[74190]:   <uuid>42f93716-a9ca-4615-bd2c-f49bd15355d0</uuid>
Oct 18 12:24:49 user nova-compute[74190]:   <name>instance-00000033</name>
Oct 18 12:24:49 user nova-compute[74190]:   <memory>524288</memory>
Oct 18 12:24:49 user nova-compute[74190]:   <vcpu>1</vcpu>
Oct 18 12:24:49 user nova-compute[74190]:   <metadata>
Oct 18 12:24:49 user nova-compute[74190]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 12:24:49 user nova-compute[74190]:       <nova:package version="0.0.0"/>
Oct 18 12:24:49 user nova-compute[74190]:       <nova:name>tempest-TestMinimumBasicScenario-server-2013688416</nova:name>
Oct 18 12:24:49 user nova-compute[74190]:       <nova:creationTime>2023-10-18 12:24:49</nova:creationTime>
Oct 18 12:24:49 user nova-compute[74190]:       <nova:flavor name="m1.tiny">
Oct 18 12:24:49 user nova-compute[74190]:         <nova:memory>512</nova:memory>
Oct 18 12:24:49 user nova-compute[74190]:         <nova:disk>1</nova:disk>
Oct 18 12:24:49 user nova-compute[74190]:         <nova:swap>0</nova:swap>
Oct 18 12:24:49 user nova-compute[74190]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 12:24:49 user nova-compute[74190]:         <nova:vcpus>1</nova:vcpus>
Oct 18 12:24:49 user nova-compute[74190]:       </nova:flavor>
Oct 18 12:24:49 user nova-compute[74190]:       <nova:owner>
Oct 18 12:24:49 user nova-compute[74190]:         <nova:user uuid="308413c6fcfa4ac1b73916bc81e46851">tempest-TestMinimumBasicScenario-285966464-project-member</nova:user>
Oct 18 12:24:49 user nova-compute[74190]:         <nova:project uuid="0b49249509b24a1bb7c97536ab9f1bfe">tempest-TestMinimumBasicScenario-285966464</nova:project>
Oct 18 12:24:49 user nova-compute[74190]:       </nova:owner>
Oct 18 12:24:49 user nova-compute[74190]:       <nova:root type="image" uuid="693a8c10-488c-4cd9-a0c7-8de2f1c61cc3"/>
Oct 18 12:24:49 user nova-compute[74190]:       <nova:ports>
Oct 18 12:24:49 user nova-compute[74190]:         <nova:port uuid="2c24e9ba-c6f7-4f33-b460-fd8cae737828">
Oct 18 12:24:49 user nova-compute[74190]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 18 12:24:49 user nova-compute[74190]:         </nova:port>
Oct 18 12:24:49 user nova-compute[74190]:       </nova:ports>
Oct 18 12:24:49 user nova-compute[74190]:     </nova:instance>
Oct 18 12:24:49 user nova-compute[74190]:   </metadata>
Oct 18 12:24:49 user nova-compute[74190]:   <sysinfo type="smbios">
Oct 18 12:24:49 user nova-compute[74190]:     <system>
Oct 18 12:24:49 user nova-compute[74190]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 12:24:49 user nova-compute[74190]:       <entry name="product">OpenStack Nova</entry>
Oct 18 12:24:49 user nova-compute[74190]:       <entry name="version">0.0.0</entry>
Oct 18 12:24:49 user nova-compute[74190]:       <entry name="serial">42f93716-a9ca-4615-bd2c-f49bd15355d0</entry>
Oct 18 12:24:49 user nova-compute[74190]:       <entry name="uuid">42f93716-a9ca-4615-bd2c-f49bd15355d0</entry>
Oct 18 12:24:49 user nova-compute[74190]:       <entry name="family">Virtual Machine</entry>
Oct 18 12:24:49 user nova-compute[74190]:     </system>
Oct 18 12:24:49 user nova-compute[74190]:   </sysinfo>
Oct 18 12:24:49 user nova-compute[74190]:   <os>
Oct 18 12:24:49 user nova-compute[74190]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 12:24:49 user nova-compute[74190]:     <boot dev="hd"/>
Oct 18 12:24:49 user nova-compute[74190]:     <smbios mode="sysinfo"/>
Oct 18 12:24:49 user nova-compute[74190]:   </os>
Oct 18 12:24:49 user nova-compute[74190]:   <features>
Oct 18 12:24:49 user nova-compute[74190]:     <acpi/>
Oct 18 12:24:49 user nova-compute[74190]:     <apic/>
Oct 18 12:24:49 user nova-compute[74190]:     <vmcoreinfo/>
Oct 18 12:24:49 user nova-compute[74190]:   </features>
Oct 18 12:24:49 user nova-compute[74190]:   <clock offset="utc">
Oct 18 12:24:49 user nova-compute[74190]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 12:24:49 user nova-compute[74190]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 12:24:49 user nova-compute[74190]:     <timer name="hpet" present="no"/>
Oct 18 12:24:49 user nova-compute[74190]:   </clock>
Oct 18 12:24:49 user nova-compute[74190]:   <cpu mode="custom" match="exact">
Oct 18 12:24:49 user nova-compute[74190]:     <model>Nehalem</model>
Oct 18 12:24:49 user nova-compute[74190]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 12:24:49 user nova-compute[74190]:   </cpu>
Oct 18 12:24:49 user nova-compute[74190]:   <devices>
Oct 18 12:24:49 user nova-compute[74190]:     <disk type="file" device="disk">
Oct 18 12:24:49 user nova-compute[74190]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 12:24:49 user nova-compute[74190]:       <source file="/opt/stack/data/nova/instances/42f93716-a9ca-4615-bd2c-f49bd15355d0/disk"/>
Oct 18 12:24:49 user nova-compute[74190]:       <target dev="vda" bus="virtio"/>
Oct 18 12:24:49 user nova-compute[74190]:     </disk>
Oct 18 12:24:49 user nova-compute[74190]:     <interface type="ethernet">
Oct 18 12:24:49 user nova-compute[74190]:       <mac address="fa:16:3e:35:db:4f"/>
Oct 18 12:24:49 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 12:24:49 user nova-compute[74190]:       <mtu size="1442"/>
Oct 18 12:24:49 user nova-compute[74190]:       <target dev="tap2c24e9ba-c6"/>
Oct 18 12:24:49 user nova-compute[74190]:     </interface>
Oct 18 12:24:49 user nova-compute[74190]:     <serial type="pty">
Oct 18 12:24:49 user nova-compute[74190]:       <log file="/opt/stack/data/nova/instances/42f93716-a9ca-4615-bd2c-f49bd15355d0/console.log" append="off"/>
Oct 18 12:24:49 user nova-compute[74190]:     </serial>
Oct 18 12:24:49 user nova-compute[74190]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 12:24:49 user nova-compute[74190]:     <video>
Oct 18 12:24:49 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 12:24:49 user nova-compute[74190]:     </video>
Oct 18 12:24:49 user nova-compute[74190]:     <rng model="virtio">
Oct 18 12:24:49 user nova-compute[74190]:       <backend model="random">/dev/urandom</backend>
Oct 18 12:24:49 user nova-compute[74190]:     </rng>
Oct 18 12:24:49 user nova-compute[74190]:     <controller type="usb" index="0" model="none"/>
Oct 18 12:24:49 user nova-compute[74190]:     <memballoon model="virtio">
Oct 18 12:24:49 user nova-compute[74190]:       <stats period="10"/>
Oct 18 12:24:49 user nova-compute[74190]:     </memballoon>
Oct 18 12:24:49 user nova-compute[74190]:   </devices>
Oct 18 12:24:49 user nova-compute[74190]: </domain>
Oct 18 12:24:49 user nova-compute[74190]:  {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 12:24:49 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T12:24:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2013688416',display_name='tempest-TestMinimumBasicScenario-server-2013688416',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2013688416',id=51,image_ref='693a8c10-488c-4cd9-a0c7-8de2f1c61cc3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOCZwMpVFiAadyOJRFJSfp61V7G8+JJMzysqdVUUHmZsoRHcS+z4FN7O+/O2PGqEddXqvj2MjPNr7KtjpRQ6iyZ7vBg4jH2t5xe4Z3s9w0RYGFs8r5hwI9smaT/VK+6WA==',key_name='tempest-TestMinimumBasicScenario-1500157790',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b49249509b24a1bb7c97536ab9f1bfe',ramdisk_id='',reservation_id='r-yj6b2vga',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='693a8c10-488c-4cd9-a0c7-8de2f1c61cc3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-285966464',owner_user_name='tempest-TestMinimumBasicScenario-285966464-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T12:24:48Z,user_data=None,user_id='308413c6fcfa4ac1b73916bc81e46851',uuid=42f93716-a9ca-4615-bd2c-f49bd15355d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2c24e9ba-c6f7-4f33-b460-fd8cae737828", "address": "fa:16:3e:35:db:4f", "network": {"id": "f3af1635-bf8e-449d-baa0-fa3c2b96e435", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1573451770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b49249509b24a1bb7c97536ab9f1bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c24e9ba-c6", "ovs_interfaceid": "2c24e9ba-c6f7-4f33-b460-fd8cae737828", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 12:24:49 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Converting VIF {"id": "2c24e9ba-c6f7-4f33-b460-fd8cae737828", "address": "fa:16:3e:35:db:4f", "network": {"id": "f3af1635-bf8e-449d-baa0-fa3c2b96e435", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1573451770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b49249509b24a1bb7c97536ab9f1bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c24e9ba-c6", "ovs_interfaceid": "2c24e9ba-c6f7-4f33-b460-fd8cae737828", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 12:24:49 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:db:4f,bridge_name='br-int',has_traffic_filtering=True,id=2c24e9ba-c6f7-4f33-b460-fd8cae737828,network=Network(f3af1635-bf8e-449d-baa0-fa3c2b96e435),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c24e9ba-c6') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 12:24:49 user nova-compute[74190]: DEBUG os_vif [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:db:4f,bridge_name='br-int',has_traffic_filtering=True,id=2c24e9ba-c6f7-4f33-b460-fd8cae737828,network=Network(f3af1635-bf8e-449d-baa0-fa3c2b96e435),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c24e9ba-c6') {{(pid=74190) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 12:24:49 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:24:49 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:24:49 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 12:24:49 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:24:49 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ecdc0c1b-0c64-5424-9441-0cc791d34e32', '_type': 'linux-noop'}}, row=False) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:24:49 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:24:49 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:24:49 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:24:49 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2c24e9ba-c6, may_exist=True, interface_attrs={}) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:24:49 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2c24e9ba-c6, col_values=(('qos', UUID('67854efd-491a-4742-9738-4ae7cc95b492')),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:24:49 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2c24e9ba-c6, col_values=(('external_ids', {'iface-id': '2c24e9ba-c6f7-4f33-b460-fd8cae737828', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:db:4f', 'vm-uuid': '42f93716-a9ca-4615-bd2c-f49bd15355d0'}),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:24:49 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:24:49 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:24:49 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:24:49 user nova-compute[74190]: INFO os_vif [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:db:4f,bridge_name='br-int',has_traffic_filtering=True,id=2c24e9ba-c6f7-4f33-b460-fd8cae737828,network=Network(f3af1635-bf8e-449d-baa0-fa3c2b96e435),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c24e9ba-c6')
Oct 18 12:24:49 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] No BDM found with device name vda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 12:24:49 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] No VIF found with MAC fa:16:3e:35:db:4f, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 12:24:50 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:24:51 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:24:51 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:24:51 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:24:51 user nova-compute[74190]: DEBUG nova.compute.manager [req-e454df3d-8444-4c44-9a1c-b4a67893d707 req-c569bd0b-484f-43d6-a5c8-aa80b41d7aba service nova] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Received event network-vif-plugged-2c24e9ba-c6f7-4f33-b460-fd8cae737828 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:24:51 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-e454df3d-8444-4c44-9a1c-b4a67893d707 req-c569bd0b-484f-43d6-a5c8-aa80b41d7aba service nova] Acquiring lock "42f93716-a9ca-4615-bd2c-f49bd15355d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:24:51 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-e454df3d-8444-4c44-9a1c-b4a67893d707 req-c569bd0b-484f-43d6-a5c8-aa80b41d7aba service nova] Lock "42f93716-a9ca-4615-bd2c-f49bd15355d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:24:51 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-e454df3d-8444-4c44-9a1c-b4a67893d707 req-c569bd0b-484f-43d6-a5c8-aa80b41d7aba service nova] Lock "42f93716-a9ca-4615-bd2c-f49bd15355d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:24:51 user nova-compute[74190]: DEBUG nova.compute.manager [req-e454df3d-8444-4c44-9a1c-b4a67893d707 req-c569bd0b-484f-43d6-a5c8-aa80b41d7aba service nova] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] No waiting events found dispatching network-vif-plugged-2c24e9ba-c6f7-4f33-b460-fd8cae737828 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:24:51 user nova-compute[74190]: WARNING nova.compute.manager [req-e454df3d-8444-4c44-9a1c-b4a67893d707 req-c569bd0b-484f-43d6-a5c8-aa80b41d7aba service nova] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Received unexpected event network-vif-plugged-2c24e9ba-c6f7-4f33-b460-fd8cae737828 for instance with vm_state building and task_state spawning.
Oct 18 12:24:51 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:24:51 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:24:51 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:24:51 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:24:53 user nova-compute[74190]: DEBUG nova.compute.manager [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Instance event wait completed in 0 seconds for  {{(pid=74190) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 12:24:53 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Guest created on hypervisor {{(pid=74190) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 12:24:53 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Instance spawned successfully.
Oct 18 12:24:53 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 12:24:53 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Found default for hw_cdrom_bus of ide {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:24:53 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Found default for hw_disk_bus of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:24:53 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Found default for hw_input_bus of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:24:53 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Found default for hw_pointer_model of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:24:53 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Found default for hw_video_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:24:53 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Found default for hw_vif_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:24:53 user nova-compute[74190]: INFO nova.compute.manager [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Took 5.73 seconds to spawn the instance on the hypervisor.
Oct 18 12:24:53 user nova-compute[74190]: DEBUG nova.compute.manager [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Checking state {{(pid=74190) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 12:24:53 user nova-compute[74190]: DEBUG nova.compute.manager [req-2aa3f880-39e7-4078-bf85-86d272365c6e req-7655da87-82cb-4f87-a4d1-6f073d7e23bf service nova] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Received event network-vif-plugged-2c24e9ba-c6f7-4f33-b460-fd8cae737828 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:24:53 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-2aa3f880-39e7-4078-bf85-86d272365c6e req-7655da87-82cb-4f87-a4d1-6f073d7e23bf service nova] Acquiring lock "42f93716-a9ca-4615-bd2c-f49bd15355d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:24:53 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-2aa3f880-39e7-4078-bf85-86d272365c6e req-7655da87-82cb-4f87-a4d1-6f073d7e23bf service nova] Lock "42f93716-a9ca-4615-bd2c-f49bd15355d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:24:53 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-2aa3f880-39e7-4078-bf85-86d272365c6e req-7655da87-82cb-4f87-a4d1-6f073d7e23bf service nova] Lock "42f93716-a9ca-4615-bd2c-f49bd15355d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:24:53 user nova-compute[74190]: DEBUG nova.compute.manager [req-2aa3f880-39e7-4078-bf85-86d272365c6e req-7655da87-82cb-4f87-a4d1-6f073d7e23bf service nova] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] No waiting events found dispatching network-vif-plugged-2c24e9ba-c6f7-4f33-b460-fd8cae737828 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:24:53 user nova-compute[74190]: WARNING nova.compute.manager [req-2aa3f880-39e7-4078-bf85-86d272365c6e req-7655da87-82cb-4f87-a4d1-6f073d7e23bf service nova] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Received unexpected event network-vif-plugged-2c24e9ba-c6f7-4f33-b460-fd8cae737828 for instance with vm_state building and task_state spawning.
Oct 18 12:24:53 user nova-compute[74190]: INFO nova.compute.manager [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Took 6.28 seconds to build instance.
Oct 18 12:24:53 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-fa0f98ac-31d8-463d-a468-6846cf03048f tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Lock "42f93716-a9ca-4615-bd2c-f49bd15355d0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.377s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:24:54 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:24:55 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:24:59 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:25:00 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:25:04 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:25:09 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:25:10 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:25:14 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:25:15 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:25:19 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:25:20 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:25:22 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:25:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:25:25 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:25:27 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:25:29 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:25:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:25:34 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:25:34 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:25:34 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Starting heal instance info cache {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 12:25:34 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Rebuilding the list of instances to heal {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 18 12:25:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "refresh_cache-42f93716-a9ca-4615-bd2c-f49bd15355d0" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:25:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquired lock "refresh_cache-42f93716-a9ca-4615-bd2c-f49bd15355d0" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:25:34 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Forcefully refreshing network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 18 12:25:34 user nova-compute[74190]: DEBUG nova.objects.instance [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lazy-loading 'info_cache' on Instance uuid 42f93716-a9ca-4615-bd2c-f49bd15355d0 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:25:34 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Updating instance_info_cache with network_info: [{"id": "2c24e9ba-c6f7-4f33-b460-fd8cae737828", "address": "fa:16:3e:35:db:4f", "network": {"id": "f3af1635-bf8e-449d-baa0-fa3c2b96e435", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1573451770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b49249509b24a1bb7c97536ab9f1bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c24e9ba-c6", "ovs_interfaceid": "2c24e9ba-c6f7-4f33-b460-fd8cae737828", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:25:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Releasing lock "refresh_cache-42f93716-a9ca-4615-bd2c-f49bd15355d0" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:25:34 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Updated the network info_cache for instance {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 18 12:25:34 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:25:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:25:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:25:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74190) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 12:25:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:25:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:25:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:25:35 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:25:38 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:25:38 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74190) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 12:25:38 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:25:38 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:25:38 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:25:38 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:25:38 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Auditing locally available compute resources for user (node: user) {{(pid=74190) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 12:25:38 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f93716-a9ca-4615-bd2c-f49bd15355d0/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:25:38 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f93716-a9ca-4615-bd2c-f49bd15355d0/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:25:38 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f93716-a9ca-4615-bd2c-f49bd15355d0/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:25:38 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f93716-a9ca-4615-bd2c-f49bd15355d0/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:25:38 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:25:38 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:25:38 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Hypervisor/Node resource view: name=user free_ram=8973MB free_disk=25.127559661865234GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74190) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 12:25:38 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:25:38 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:25:38 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 42f93716-a9ca-4615-bd2c-f49bd15355d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:25:38 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 12:25:38 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 12:25:39 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 12:25:39 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 12:25:39 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Compute_service record updated for user:user {{(pid=74190) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 12:25:39 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.187s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:25:39 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:25:41 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:25:44 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:25:44 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:25:44 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74190) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 12:25:44 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:25:44 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:25:44 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:25:49 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:25:54 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:25:59 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:26:04 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:26:09 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:26:14 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:26:19 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:26:19 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:26:19 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74190) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 12:26:19 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:26:19 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:26:19 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:26:23 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:26:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:26:27 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:26:29 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:26:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:26:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:26:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74190) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 12:26:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:26:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:26:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:26:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:26:35 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:26:35 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:26:36 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:26:36 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Starting heal instance info cache {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 12:26:36 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Rebuilding the list of instances to heal {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 18 12:26:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "refresh_cache-42f93716-a9ca-4615-bd2c-f49bd15355d0" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:26:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquired lock "refresh_cache-42f93716-a9ca-4615-bd2c-f49bd15355d0" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:26:36 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Forcefully refreshing network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 18 12:26:36 user nova-compute[74190]: DEBUG nova.objects.instance [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lazy-loading 'info_cache' on Instance uuid 42f93716-a9ca-4615-bd2c-f49bd15355d0 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:26:36 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Updating instance_info_cache with network_info: [{"id": "2c24e9ba-c6f7-4f33-b460-fd8cae737828", "address": "fa:16:3e:35:db:4f", "network": {"id": "f3af1635-bf8e-449d-baa0-fa3c2b96e435", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1573451770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b49249509b24a1bb7c97536ab9f1bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c24e9ba-c6", "ovs_interfaceid": "2c24e9ba-c6f7-4f33-b460-fd8cae737828", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:26:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Releasing lock "refresh_cache-42f93716-a9ca-4615-bd2c-f49bd15355d0" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:26:36 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Updated the network info_cache for instance {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 18 12:26:37 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:26:38 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:26:38 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74190) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 12:26:39 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:26:39 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:26:39 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:26:39 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:26:39 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Auditing locally available compute resources for user (node: user) {{(pid=74190) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 12:26:39 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f93716-a9ca-4615-bd2c-f49bd15355d0/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:26:39 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f93716-a9ca-4615-bd2c-f49bd15355d0/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:26:39 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f93716-a9ca-4615-bd2c-f49bd15355d0/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:26:39 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f93716-a9ca-4615-bd2c-f49bd15355d0/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:26:39 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:26:39 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:26:39 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Hypervisor/Node resource view: name=user free_ram=8995MB free_disk=25.126869201660156GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74190) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 12:26:39 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:26:39 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:26:39 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 42f93716-a9ca-4615-bd2c-f49bd15355d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:26:39 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 12:26:39 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 12:26:39 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:26:40 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 12:26:40 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 12:26:40 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Compute_service record updated for user:user {{(pid=74190) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 12:26:40 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.175s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:26:42 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-aedbf17c-11c3-4da0-80cd-3a83dcc0819d tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Acquiring lock "42f93716-a9ca-4615-bd2c-f49bd15355d0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:26:42 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-aedbf17c-11c3-4da0-80cd-3a83dcc0819d tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Lock "42f93716-a9ca-4615-bd2c-f49bd15355d0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:26:42 user nova-compute[74190]: DEBUG nova.objects.instance [None req-aedbf17c-11c3-4da0-80cd-3a83dcc0819d tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Lazy-loading 'flavor' on Instance uuid 42f93716-a9ca-4615-bd2c-f49bd15355d0 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:26:42 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-aedbf17c-11c3-4da0-80cd-3a83dcc0819d tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Lock "42f93716-a9ca-4615-bd2c-f49bd15355d0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:26:42 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-aedbf17c-11c3-4da0-80cd-3a83dcc0819d tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Acquiring lock "42f93716-a9ca-4615-bd2c-f49bd15355d0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:26:42 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-aedbf17c-11c3-4da0-80cd-3a83dcc0819d tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Lock "42f93716-a9ca-4615-bd2c-f49bd15355d0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:26:42 user nova-compute[74190]: INFO nova.compute.manager [None req-aedbf17c-11c3-4da0-80cd-3a83dcc0819d tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Attaching volume 0a9bd76f-9e66-4d7a-abf3-007035a547bc to /dev/vdb
Oct 18 12:26:42 user nova-compute[74190]: DEBUG os_brick.utils [None req-aedbf17c-11c3-4da0-80cd-3a83dcc0819d tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 12:26:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:26:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:26:42 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c0cf74a-5228-436f-976b-e1423395a425]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cff158e257e1\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:26:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:26:43 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:26:43 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[4271437e-b163-4d81-aafb-ed83d6f9ed8d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:26:43 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:26:43 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:26:43 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c1156db-3ece-45d1-a8f4-2ac5d44de6c2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:26:43 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[8743d423-b163-42bd-8ac3-193daaa1c25e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:26:43 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-aedbf17c-11c3-4da0-80cd-3a83dcc0819d tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Running cmd (subprocess): nvme version {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:26:43 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-aedbf17c-11c3-4da0-80cd-3a83dcc0819d tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] 'nvme version' failed. Not Retrying. {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 12:26:43 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aedbf17c-11c3-4da0-80cd-3a83dcc0819d tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] nvme not present on system {{(pid=74190) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 12:26:43 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:26:43 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 12:26:43 user nova-compute[74190]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 12:26:43 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a8f210b-51e3-4154-a4e3-24c9f1636e78]: (4, '') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:26:43 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-aedbf17c-11c3-4da0-80cd-3a83dcc0819d tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74190) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 12:26:43 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-aedbf17c-11c3-4da0-80cd-3a83dcc0819d tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 12:26:43 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-aedbf17c-11c3-4da0-80cd-3a83dcc0819d tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] LIGHTOS: no hostnqn found. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 12:26:43 user nova-compute[74190]: DEBUG os_brick.utils [None req-aedbf17c-11c3-4da0-80cd-3a83dcc0819d tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cff158e257e1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 12:26:43 user nova-compute[74190]: DEBUG nova.virt.block_device [None req-aedbf17c-11c3-4da0-80cd-3a83dcc0819d tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Updating existing volume attachment record: f4e26a4f-e97b-4312-9f6f-065b09b432c3 {{(pid=74190) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 12:26:44 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:26:49 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:26:49 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:26:49 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74190) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 12:26:49 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:26:49 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:26:49 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:26:54 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:26:58 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aedbf17c-11c3-4da0-80cd-3a83dcc0819d tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Calling os-brick to attach iSCSI Volume {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 12:26:58 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-aedbf17c-11c3-4da0-80cd-3a83dcc0819d tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PBmQJXef', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 12:26:58 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-aedbf17c-11c3-4da0-80cd-3a83dcc0819d tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 12:26:58 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-aedbf17c-11c3-4da0-80cd-3a83dcc0819d tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 12:26:58 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-aedbf17c-11c3-4da0-80cd-3a83dcc0819d tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 12:26:58 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-aedbf17c-11c3-4da0-80cd-3a83dcc0819d tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 12:26:58 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-aedbf17c-11c3-4da0-80cd-3a83dcc0819d tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 12:26:58 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-aedbf17c-11c3-4da0-80cd-3a83dcc0819d tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 12:26:58 user nova-compute[74190]: INFO os_brick.initiator.connectors.iscsi [None req-aedbf17c-11c3-4da0-80cd-3a83dcc0819d tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 12:26:58 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc -p 172.16.0.220:3260 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:26:58 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:26:58 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[d44904ef-1692-44ef-b218-62425a78af2a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:26:58 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-aedbf17c-11c3-4da0-80cd-3a83dcc0819d tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 12:26:58 user nova-compute[74190]:  {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:26:58 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc -p 172.16.0.220:3260 --interface default --op new {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:26:58 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:26:58 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[24605761-46ee-4f51-ace5-af728e4e8327]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc] added\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:26:58 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-aedbf17c-11c3-4da0-80cd-3a83dcc0819d tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc] added
Oct 18 12:26:58 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:26:58 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:26:58 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:26:58 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[472d9a44-cca7-45d2-8476-e9c1dd5a5f6c]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:26:58 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-aedbf17c-11c3-4da0-80cd-3a83dcc0819d tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:26:58 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:26:58 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:26:58 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4479404-344d-472d-9ed4-c84d59202cad]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:26:58 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-aedbf17c-11c3-4da0-80cd-3a83dcc0819d tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:26:58 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PBmQJXef {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:26:58 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PBmQJXef" returned: 0 in 0.017s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:26:58 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[e85c0554-fa62-4bb1-a153-f4a161c6744b]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:26:58 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-aedbf17c-11c3-4da0-80cd-3a83dcc0819d tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PBmQJXef'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:26:58 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:26:58 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:26:58 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c076803-675f-4db2-82b4-1f4411b169df]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:26:58 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-aedbf17c-11c3-4da0-80cd-3a83dcc0819d tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:26:58 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:26:58 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:26:58 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec68ab9-b35d-49f6-8a47-7c8fd2ca03f0]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:26:58 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-aedbf17c-11c3-4da0-80cd-3a83dcc0819d tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 18 12:26:58 user nova-compute[74190]:  {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 12:26:58 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-aedbf17c-11c3-4da0-80cd-3a83dcc0819d tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 18 12:26:58 user nova-compute[74190]:  {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 12:26:58 user nova-compute[74190]: WARNING os_brick.initiator.connectors.iscsi [None req-aedbf17c-11c3-4da0-80cd-3a83dcc0819d tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 18 12:26:58 user nova-compute[74190]: 
Oct 18 12:26:58 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc -p 172.16.0.220:3260 --login {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:26:58 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:26:58 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[0764667c-e8c4-4dc5-a28f-881cc991436e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:26:58 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-aedbf17c-11c3-4da0-80cd-3a83dcc0819d tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc, portal: 172.16.0.220,3260]
Oct 18 12:26:58 user nova-compute[74190]: Login to [iface: default, target: iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc, portal: 172.16.0.220,3260] successful.
Oct 18 12:26:58 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:26:58 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:26:58 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:26:58 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d6751ee-9215-4574-a480-7b696c8c89d4]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:26:58 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-aedbf17c-11c3-4da0-80cd-3a83dcc0819d tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:26:58 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:26:58 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:26:58 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1da9044-6c18-4217-8aca-b71e6d981a46]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:26:58 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-aedbf17c-11c3-4da0-80cd-3a83dcc0819d tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc (non-flash)
Oct 18 12:26:58 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 12:26:58 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-aedbf17c-11c3-4da0-80cd-3a83dcc0819d tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc (non-flash)
Oct 18 12:26:58 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 12:26:58 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-aedbf17c-11c3-4da0-80cd-3a83dcc0819d tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 12:26:58 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-aedbf17c-11c3-4da0-80cd-3a83dcc0819d tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Connected to 172.16.0.220:3260 {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 12:26:58 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-aedbf17c-11c3-4da0-80cd-3a83dcc0819d tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=74190) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 12:26:58 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-aedbf17c-11c3-4da0-80cd-3a83dcc0819d tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74190) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 12:26:58 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:26:58 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:26:58 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d92886-19ff-4223-b6ed-077eab425ae6]: (4, ('- - 0', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:26:58 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-aedbf17c-11c3-4da0-80cd-3a83dcc0819d tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74190) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 12:26:58 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-aedbf17c-11c3-4da0-80cd-3a83dcc0819d tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PBmQJXef', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 12:26:59 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-aedbf17c-11c3-4da0-80cd-3a83dcc0819d tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.285s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 12:26:59 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-aedbf17c-11c3-4da0-80cd-3a83dcc0819d tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] <== connect_volume: return (1286ms) {'type': 'block', 'scsi_wwn': '23533336235623432', 'path': '/dev/sdb'} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 12:26:59 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aedbf17c-11c3-4da0-80cd-3a83dcc0819d tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23533336235623432', 'path': '/dev/sdb'} {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 12:26:59 user nova-compute[74190]: DEBUG nova.objects.instance [None req-aedbf17c-11c3-4da0-80cd-3a83dcc0819d tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Lazy-loading 'flavor' on Instance uuid 42f93716-a9ca-4615-bd2c-f49bd15355d0 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:26:59 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-aedbf17c-11c3-4da0-80cd-3a83dcc0819d tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] attach device xml: <disk type="block" device="disk">
Oct 18 12:26:59 user nova-compute[74190]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 12:26:59 user nova-compute[74190]:   <source dev="/dev/sdb"/>
Oct 18 12:26:59 user nova-compute[74190]:   <target dev="vdb" bus="virtio"/>
Oct 18 12:26:59 user nova-compute[74190]:   <serial>0a9bd76f-9e66-4d7a-abf3-007035a547bc</serial>
Oct 18 12:26:59 user nova-compute[74190]: </disk>
Oct 18 12:26:59 user nova-compute[74190]:  {{(pid=74190) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 18 12:26:59 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:26:59 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:26:59 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74190) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 12:26:59 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:27:00 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:27:00 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:27:00 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-aedbf17c-11c3-4da0-80cd-3a83dcc0819d tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] No BDM found with device name vda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 12:27:00 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-aedbf17c-11c3-4da0-80cd-3a83dcc0819d tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 12:27:00 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-aedbf17c-11c3-4da0-80cd-3a83dcc0819d tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] No VIF found with MAC fa:16:3e:35:db:4f, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 12:27:00 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-aedbf17c-11c3-4da0-80cd-3a83dcc0819d tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Lock "42f93716-a9ca-4615-bd2c-f49bd15355d0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.751s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:27:05 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:27:05 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:27:05 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74190) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 12:27:05 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:27:05 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:27:05 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:27:10 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:27:10 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:27:11 user nova-compute[74190]: DEBUG nova.compute.manager [req-f93ab8a8-3668-4727-8d85-d381855de610 req-fc6a647e-aff6-454b-8c8a-b7fe0c11e035 service nova] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Received event network-changed-2c24e9ba-c6f7-4f33-b460-fd8cae737828 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:27:11 user nova-compute[74190]: DEBUG nova.compute.manager [req-f93ab8a8-3668-4727-8d85-d381855de610 req-fc6a647e-aff6-454b-8c8a-b7fe0c11e035 service nova] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Refreshing instance network info cache due to event network-changed-2c24e9ba-c6f7-4f33-b460-fd8cae737828. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 12:27:11 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-f93ab8a8-3668-4727-8d85-d381855de610 req-fc6a647e-aff6-454b-8c8a-b7fe0c11e035 service nova] Acquiring lock "refresh_cache-42f93716-a9ca-4615-bd2c-f49bd15355d0" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:27:11 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-f93ab8a8-3668-4727-8d85-d381855de610 req-fc6a647e-aff6-454b-8c8a-b7fe0c11e035 service nova] Acquired lock "refresh_cache-42f93716-a9ca-4615-bd2c-f49bd15355d0" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:27:11 user nova-compute[74190]: DEBUG nova.network.neutron [req-f93ab8a8-3668-4727-8d85-d381855de610 req-fc6a647e-aff6-454b-8c8a-b7fe0c11e035 service nova] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Refreshing network info cache for port 2c24e9ba-c6f7-4f33-b460-fd8cae737828 {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 12:27:12 user nova-compute[74190]: DEBUG nova.network.neutron [req-f93ab8a8-3668-4727-8d85-d381855de610 req-fc6a647e-aff6-454b-8c8a-b7fe0c11e035 service nova] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Updated VIF entry in instance network info cache for port 2c24e9ba-c6f7-4f33-b460-fd8cae737828. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 12:27:12 user nova-compute[74190]: DEBUG nova.network.neutron [req-f93ab8a8-3668-4727-8d85-d381855de610 req-fc6a647e-aff6-454b-8c8a-b7fe0c11e035 service nova] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Updating instance_info_cache with network_info: [{"id": "2c24e9ba-c6f7-4f33-b460-fd8cae737828", "address": "fa:16:3e:35:db:4f", "network": {"id": "f3af1635-bf8e-449d-baa0-fa3c2b96e435", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1573451770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b49249509b24a1bb7c97536ab9f1bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c24e9ba-c6", "ovs_interfaceid": "2c24e9ba-c6f7-4f33-b460-fd8cae737828", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:27:12 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-f93ab8a8-3668-4727-8d85-d381855de610 req-fc6a647e-aff6-454b-8c8a-b7fe0c11e035 service nova] Releasing lock "refresh_cache-42f93716-a9ca-4615-bd2c-f49bd15355d0" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:27:14 user nova-compute[74190]: DEBUG nova.compute.manager [req-7680c9ec-ed40-432b-8efa-f7a2c43bb473 req-7a0c39b6-8a5a-4cbc-9c9b-d3d0609ef73e service nova] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Received event network-changed-2c24e9ba-c6f7-4f33-b460-fd8cae737828 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:27:14 user nova-compute[74190]: DEBUG nova.compute.manager [req-7680c9ec-ed40-432b-8efa-f7a2c43bb473 req-7a0c39b6-8a5a-4cbc-9c9b-d3d0609ef73e service nova] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Refreshing instance network info cache due to event network-changed-2c24e9ba-c6f7-4f33-b460-fd8cae737828. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 12:27:14 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-7680c9ec-ed40-432b-8efa-f7a2c43bb473 req-7a0c39b6-8a5a-4cbc-9c9b-d3d0609ef73e service nova] Acquiring lock "refresh_cache-42f93716-a9ca-4615-bd2c-f49bd15355d0" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:27:14 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-7680c9ec-ed40-432b-8efa-f7a2c43bb473 req-7a0c39b6-8a5a-4cbc-9c9b-d3d0609ef73e service nova] Acquired lock "refresh_cache-42f93716-a9ca-4615-bd2c-f49bd15355d0" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:27:14 user nova-compute[74190]: DEBUG nova.network.neutron [req-7680c9ec-ed40-432b-8efa-f7a2c43bb473 req-7a0c39b6-8a5a-4cbc-9c9b-d3d0609ef73e service nova] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Refreshing network info cache for port 2c24e9ba-c6f7-4f33-b460-fd8cae737828 {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 12:27:14 user nova-compute[74190]: DEBUG nova.network.neutron [req-7680c9ec-ed40-432b-8efa-f7a2c43bb473 req-7a0c39b6-8a5a-4cbc-9c9b-d3d0609ef73e service nova] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Updated VIF entry in instance network info cache for port 2c24e9ba-c6f7-4f33-b460-fd8cae737828. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 12:27:14 user nova-compute[74190]: DEBUG nova.network.neutron [req-7680c9ec-ed40-432b-8efa-f7a2c43bb473 req-7a0c39b6-8a5a-4cbc-9c9b-d3d0609ef73e service nova] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Updating instance_info_cache with network_info: [{"id": "2c24e9ba-c6f7-4f33-b460-fd8cae737828", "address": "fa:16:3e:35:db:4f", "network": {"id": "f3af1635-bf8e-449d-baa0-fa3c2b96e435", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1573451770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b49249509b24a1bb7c97536ab9f1bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c24e9ba-c6", "ovs_interfaceid": "2c24e9ba-c6f7-4f33-b460-fd8cae737828", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:27:14 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-7680c9ec-ed40-432b-8efa-f7a2c43bb473 req-7a0c39b6-8a5a-4cbc-9c9b-d3d0609ef73e service nova] Releasing lock "refresh_cache-42f93716-a9ca-4615-bd2c-f49bd15355d0" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:27:15 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:27:15 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:27:20 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:27:20 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:27:23 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Acquiring lock "42f93716-a9ca-4615-bd2c-f49bd15355d0" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:27:23 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Lock "42f93716-a9ca-4615-bd2c-f49bd15355d0" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:27:23 user nova-compute[74190]: INFO nova.compute.manager [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Rebooting instance
Oct 18 12:27:23 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Acquiring lock "refresh_cache-42f93716-a9ca-4615-bd2c-f49bd15355d0" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:27:23 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Acquired lock "refresh_cache-42f93716-a9ca-4615-bd2c-f49bd15355d0" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:27:23 user nova-compute[74190]: DEBUG nova.network.neutron [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Building network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 12:27:24 user nova-compute[74190]: DEBUG nova.network.neutron [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Updating instance_info_cache with network_info: [{"id": "2c24e9ba-c6f7-4f33-b460-fd8cae737828", "address": "fa:16:3e:35:db:4f", "network": {"id": "f3af1635-bf8e-449d-baa0-fa3c2b96e435", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1573451770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b49249509b24a1bb7c97536ab9f1bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c24e9ba-c6", "ovs_interfaceid": "2c24e9ba-c6f7-4f33-b460-fd8cae737828", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:27:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Releasing lock "refresh_cache-42f93716-a9ca-4615-bd2c-f49bd15355d0" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:27:24 user nova-compute[74190]: DEBUG nova.compute.manager [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Checking state {{(pid=74190) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 12:27:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:27:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:27:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:27:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:27:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:27:24 user nova-compute[74190]: DEBUG nova.compute.manager [req-f6b7f25a-f079-43b4-b766-d15781ecd1bc req-273040cd-e1f0-4104-80e3-8175edf18d27 service nova] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Received event network-vif-unplugged-2c24e9ba-c6f7-4f33-b460-fd8cae737828 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:27:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-f6b7f25a-f079-43b4-b766-d15781ecd1bc req-273040cd-e1f0-4104-80e3-8175edf18d27 service nova] Acquiring lock "42f93716-a9ca-4615-bd2c-f49bd15355d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:27:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-f6b7f25a-f079-43b4-b766-d15781ecd1bc req-273040cd-e1f0-4104-80e3-8175edf18d27 service nova] Lock "42f93716-a9ca-4615-bd2c-f49bd15355d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:27:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-f6b7f25a-f079-43b4-b766-d15781ecd1bc req-273040cd-e1f0-4104-80e3-8175edf18d27 service nova] Lock "42f93716-a9ca-4615-bd2c-f49bd15355d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:27:24 user nova-compute[74190]: DEBUG nova.compute.manager [req-f6b7f25a-f079-43b4-b766-d15781ecd1bc req-273040cd-e1f0-4104-80e3-8175edf18d27 service nova] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] No waiting events found dispatching network-vif-unplugged-2c24e9ba-c6f7-4f33-b460-fd8cae737828 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:27:24 user nova-compute[74190]: WARNING nova.compute.manager [req-f6b7f25a-f079-43b4-b766-d15781ecd1bc req-273040cd-e1f0-4104-80e3-8175edf18d27 service nova] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Received unexpected event network-vif-unplugged-2c24e9ba-c6f7-4f33-b460-fd8cae737828 for instance with vm_state active and task_state reboot_started_hard.
Oct 18 12:27:24 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Instance destroyed successfully.
Oct 18 12:27:24 user nova-compute[74190]: DEBUG nova.objects.instance [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Lazy-loading 'resources' on Instance uuid 42f93716-a9ca-4615-bd2c-f49bd15355d0 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:27:24 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T12:24:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2013688416',display_name='tempest-TestMinimumBasicScenario-server-2013688416',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2013688416',id=51,image_ref='693a8c10-488c-4cd9-a0c7-8de2f1c61cc3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOCZwMpVFiAadyOJRFJSfp61V7G8+JJMzysqdVUUHmZsoRHcS+z4FN7O+/O2PGqEddXqvj2MjPNr7KtjpRQ6iyZ7vBg4jH2t5xe4Z3s9w0RYGFs8r5hwI9smaT/VK+6WA==',key_name='tempest-TestMinimumBasicScenario-1500157790',keypairs=<?>,launch_index=0,launched_at=2023-10-18T12:24:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0b49249509b24a1bb7c97536ab9f1bfe',ramdisk_id='',reservation_id='r-yj6b2vga',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='693a8c10-488c-4cd9-a0c7-8de2f1c61cc3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-285966464',owner_user_name='tempest-TestMinimumBasicScenario-285966464-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T12:27:24Z,user_data=None,user_id='308413c6fcfa4ac1b73916bc81e46851',uuid=42f93716-a9ca-4615-bd2c-f49bd15355d0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2c24e9ba-c6f7-4f33-b460-fd8cae737828", "address": "fa:16:3e:35:db:4f", "network": {"id": "f3af1635-bf8e-449d-baa0-fa3c2b96e435", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1573451770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b49249509b24a1bb7c97536ab9f1bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c24e9ba-c6", "ovs_interfaceid": "2c24e9ba-c6f7-4f33-b460-fd8cae737828", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 12:27:24 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Converting VIF {"id": "2c24e9ba-c6f7-4f33-b460-fd8cae737828", "address": "fa:16:3e:35:db:4f", "network": {"id": "f3af1635-bf8e-449d-baa0-fa3c2b96e435", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1573451770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b49249509b24a1bb7c97536ab9f1bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c24e9ba-c6", "ovs_interfaceid": "2c24e9ba-c6f7-4f33-b460-fd8cae737828", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 12:27:24 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:35:db:4f,bridge_name='br-int',has_traffic_filtering=True,id=2c24e9ba-c6f7-4f33-b460-fd8cae737828,network=Network(f3af1635-bf8e-449d-baa0-fa3c2b96e435),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c24e9ba-c6') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 12:27:24 user nova-compute[74190]: DEBUG os_vif [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:db:4f,bridge_name='br-int',has_traffic_filtering=True,id=2c24e9ba-c6f7-4f33-b460-fd8cae737828,network=Network(f3af1635-bf8e-449d-baa0-fa3c2b96e435),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c24e9ba-c6') {{(pid=74190) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 12:27:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:27:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2c24e9ba-c6, bridge=br-int, if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:27:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:27:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:27:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=67854efd-491a-4742-9738-4ae7cc95b492) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:27:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:27:25 user nova-compute[74190]: INFO os_vif [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:db:4f,bridge_name='br-int',has_traffic_filtering=True,id=2c24e9ba-c6f7-4f33-b460-fd8cae737828,network=Network(f3af1635-bf8e-449d-baa0-fa3c2b96e435),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c24e9ba-c6')
Oct 18 12:27:25 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] calling os-brick to detach iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, {'target_iqn': 'iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PBmQJXef', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 12:27:25 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 12:27:25 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb04e17-903a-48fb-a0ee-e685fdc0ce38]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 12:27:25 user nova-compute[74190]: No targets found.
Oct 18 12:27:25 user nova-compute[74190]: iSNS:
Oct 18 12:27:25 user nova-compute[74190]: No targets found.
Oct 18 12:27:25 user nova-compute[74190]: STATIC:
Oct 18 12:27:25 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc
Oct 18 12:27:25 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 12:27:25 user nova-compute[74190]:                 Iface Name: default
Oct 18 12:27:25 user nova-compute[74190]: FIRMWARE:
Oct 18 12:27:25 user nova-compute[74190]: No targets found.
Oct 18 12:27:25 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 12:27:25 user nova-compute[74190]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 12:27:25 user nova-compute[74190]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74190) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc', 0)] {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a40734-c993-4874-b008-91f8c2266491]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b129c10-1614-4317-b40f-4f9253f28a38]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc (non-flash)
Oct 18 12:27:25 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc (non-flash)
Oct 18 12:27:25 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1f44405b40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc'): ({'sdb'}, set())}) {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Removing single pathed devices sdb {{(pid=74190) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[1481cc51-9c0c-4f9e-b8e2-1fb63d06cde6]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b4074ab-0442-4fde-9ffd-bd282d193403]: (4, ('ok\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Flushing IO for device /dev/sdb {{(pid=74190) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[8784b4d3-0264-481f-85b9-2c4ff4f9d6d1]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74190) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad45934d-20fb-4cc2-b0b2-224d85f7e20d]: (4, ('1', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] SCSI volumes sdb have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc')] {{(pid=74190) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[19a0c7e6-65c2-42b4-add4-93dd926d86b8]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc -p 172.16.0.220:3260 --logout {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[b08115b1-700a-4085-86f1-b91795b2d5dd]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc, portal: 172.16.0.220,3260]
Oct 18 12:27:25 user nova-compute[74190]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc, portal: 172.16.0.220,3260] successful.
Oct 18 12:27:25 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc -p 172.16.0.220:3260 --op delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[583469fb-79c8-4e92-ad42-154d26601fc5]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.264s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] <== disconnect_volume: return (265ms) None {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Disconnected iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Start _get_guest_xml network_info=[{"id": "2c24e9ba-c6f7-4f33-b460-fd8cae737828", "address": "fa:16:3e:35:db:4f", "network": {"id": "f3af1635-bf8e-449d-baa0-fa3c2b96e435", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1573451770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b49249509b24a1bb7c97536ab9f1bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c24e9ba-c6", "ovs_interfaceid": "2c24e9ba-c6f7-4f33-b460-fd8cae737828", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=693a8c10-488c-4cd9-a0c7-8de2f1c61cc3,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'image_id': '693a8c10-488c-4cd9-a0c7-8de2f1c61cc3'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PBmQJXef', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '42f93716-a9ca-4615-bd2c-f49bd15355d0', 'attached_at': '', 'detached_at': '', 'volume_id': '0a9bd76f-9e66-4d7a-abf3-007035a547bc', 'serial': '0a9bd76f-9e66-4d7a-abf3-007035a547bc'}, 'delete_on_termination': False, 'guest_format': None, 'attachment_id': 'f4e26a4f-e97b-4312-9f6f-065b09b432c3', 'volume_type': None} {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 12:27:25 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:27:25 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:27:25 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] CPU controller missing on host. {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] CPU controller found on host. {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74190) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T11:37:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=693a8c10-488c-4cd9-a0c7-8de2f1c61cc3,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Flavor limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Image limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Flavor pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Image pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Got 1 possible topologies {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG nova.objects.instance [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Lazy-loading 'vcpu_model' on Instance uuid 42f93716-a9ca-4615-bd2c-f49bd15355d0 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG nova.objects.base [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Object Instance<42f93716-a9ca-4615-bd2c-f49bd15355d0> lazy-loaded attributes: resources,vcpu_model {{(pid=74190) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Calling os-brick to attach iSCSI Volume {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PBmQJXef', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 12:27:25 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 12:27:25 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 12:27:25 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 12:27:25 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 12:27:25 user nova-compute[74190]: INFO os_brick.initiator.connectors.iscsi [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 12:27:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc -p 172.16.0.220:3260 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[79dabcdb-54c8-4d67-ab4e-47f7c516005d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 12:27:25 user nova-compute[74190]:  {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc -p 172.16.0.220:3260 --interface default --op new {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[af7d01ff-ef4e-4b80-930c-85bb3f560a16]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc] added\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc] added
Oct 18 12:27:25 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c8f2f2-f4e4-4f81-9f58-dff22f03fa5e]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd7cfdb-1020-4b04-bcf0-860d1fd05a2d]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PBmQJXef {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PBmQJXef" returned: 0 in 0.034s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5377cca-d7a7-448c-b791-e86c49a89729]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PBmQJXef'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b17187-a20f-4c49-9931-8e8be58d303a]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[16013c21-6ad1-4f33-97d1-2e0be5db9015]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 18 12:27:25 user nova-compute[74190]:  {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 18 12:27:25 user nova-compute[74190]:  {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 12:27:25 user nova-compute[74190]: WARNING os_brick.initiator.connectors.iscsi [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 18 12:27:25 user nova-compute[74190]: 
Oct 18 12:27:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc -p 172.16.0.220:3260 --login {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a35c9a-cfec-4899-875b-40ec0c68ae8b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc, portal: 172.16.0.220,3260]
Oct 18 12:27:25 user nova-compute[74190]: Login to [iface: default, target: iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc, portal: 172.16.0.220,3260] successful.
Oct 18 12:27:25 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1d5bb15-9e9d-43ec-ba2c-355bf83a92b4]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcff30fc-53f9-4b41-a969-9f3b39bfe25f]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc (non-flash)
Oct 18 12:27:25 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc (non-flash)
Oct 18 12:27:25 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Connected to 172.16.0.220:3260 {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=74190) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74190) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9db9caa-de0d-4757-a538-5b3f9ddd590c]: (4, ('- - 0', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74190) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 12:27:25 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PBmQJXef', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 12:27:26 user nova-compute[74190]: DEBUG nova.compute.manager [req-889ea7a4-fb32-46df-81de-9bb1506d693f req-3f3f3264-171f-466e-bbaa-df21b27d3653 service nova] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Received event network-vif-plugged-2c24e9ba-c6f7-4f33-b460-fd8cae737828 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:27:26 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-889ea7a4-fb32-46df-81de-9bb1506d693f req-3f3f3264-171f-466e-bbaa-df21b27d3653 service nova] Acquiring lock "42f93716-a9ca-4615-bd2c-f49bd15355d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:27:26 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-889ea7a4-fb32-46df-81de-9bb1506d693f req-3f3f3264-171f-466e-bbaa-df21b27d3653 service nova] Lock "42f93716-a9ca-4615-bd2c-f49bd15355d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:27:26 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-889ea7a4-fb32-46df-81de-9bb1506d693f req-3f3f3264-171f-466e-bbaa-df21b27d3653 service nova] Lock "42f93716-a9ca-4615-bd2c-f49bd15355d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:27:26 user nova-compute[74190]: DEBUG nova.compute.manager [req-889ea7a4-fb32-46df-81de-9bb1506d693f req-3f3f3264-171f-466e-bbaa-df21b27d3653 service nova] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] No waiting events found dispatching network-vif-plugged-2c24e9ba-c6f7-4f33-b460-fd8cae737828 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:27:26 user nova-compute[74190]: WARNING nova.compute.manager [req-889ea7a4-fb32-46df-81de-9bb1506d693f req-3f3f3264-171f-466e-bbaa-df21b27d3653 service nova] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Received unexpected event network-vif-plugged-2c24e9ba-c6f7-4f33-b460-fd8cae737828 for instance with vm_state active and task_state reboot_started_hard.
Oct 18 12:27:26 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 12:27:26 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '23533336235623432', 'path': '/dev/sdb'} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 12:27:26 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23533336235623432', 'path': '/dev/sdb'} {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 12:27:26 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T12:24:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2013688416',display_name='tempest-TestMinimumBasicScenario-server-2013688416',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2013688416',id=51,image_ref='693a8c10-488c-4cd9-a0c7-8de2f1c61cc3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOCZwMpVFiAadyOJRFJSfp61V7G8+JJMzysqdVUUHmZsoRHcS+z4FN7O+/O2PGqEddXqvj2MjPNr7KtjpRQ6iyZ7vBg4jH2t5xe4Z3s9w0RYGFs8r5hwI9smaT/VK+6WA==',key_name='tempest-TestMinimumBasicScenario-1500157790',keypairs=<?>,launch_index=0,launched_at=2023-10-18T12:24:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0b49249509b24a1bb7c97536ab9f1bfe',ramdisk_id='',reservation_id='r-yj6b2vga',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='693a8c10-488c-4cd9-a0c7-8de2f1c61cc3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-285966464',owner_user_name='tempest-TestMinimumBasicScenario-285966464-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T12:27:24Z,user_data=None,user_id='308413c6fcfa4ac1b73916bc81e46851',uuid=42f93716-a9ca-4615-bd2c-f49bd15355d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2c24e9ba-c6f7-4f33-b460-fd8cae737828", "address": "fa:16:3e:35:db:4f", "network": {"id": "f3af1635-bf8e-449d-baa0-fa3c2b96e435", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1573451770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b49249509b24a1bb7c97536ab9f1bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c24e9ba-c6", "ovs_interfaceid": "2c24e9ba-c6f7-4f33-b460-fd8cae737828", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74190) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 12:27:26 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Converting VIF {"id": "2c24e9ba-c6f7-4f33-b460-fd8cae737828", "address": "fa:16:3e:35:db:4f", "network": {"id": "f3af1635-bf8e-449d-baa0-fa3c2b96e435", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1573451770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b49249509b24a1bb7c97536ab9f1bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c24e9ba-c6", "ovs_interfaceid": "2c24e9ba-c6f7-4f33-b460-fd8cae737828", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 12:27:26 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:35:db:4f,bridge_name='br-int',has_traffic_filtering=True,id=2c24e9ba-c6f7-4f33-b460-fd8cae737828,network=Network(f3af1635-bf8e-449d-baa0-fa3c2b96e435),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c24e9ba-c6') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 12:27:26 user nova-compute[74190]: DEBUG nova.objects.instance [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Lazy-loading 'pci_devices' on Instance uuid 42f93716-a9ca-4615-bd2c-f49bd15355d0 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:27:26 user nova-compute[74190]: DEBUG nova.objects.base [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Object Instance<42f93716-a9ca-4615-bd2c-f49bd15355d0> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=74190) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 12:27:26 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] End _get_guest_xml xml=<domain type="kvm">
Oct 18 12:27:26 user nova-compute[74190]:   <uuid>42f93716-a9ca-4615-bd2c-f49bd15355d0</uuid>
Oct 18 12:27:26 user nova-compute[74190]:   <name>instance-00000033</name>
Oct 18 12:27:26 user nova-compute[74190]:   <memory>524288</memory>
Oct 18 12:27:26 user nova-compute[74190]:   <vcpu>1</vcpu>
Oct 18 12:27:26 user nova-compute[74190]:   <metadata>
Oct 18 12:27:26 user nova-compute[74190]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 12:27:26 user nova-compute[74190]:       <nova:package version="0.0.0"/>
Oct 18 12:27:26 user nova-compute[74190]:       <nova:name>tempest-TestMinimumBasicScenario-server-2013688416</nova:name>
Oct 18 12:27:26 user nova-compute[74190]:       <nova:creationTime>2023-10-18 12:27:25</nova:creationTime>
Oct 18 12:27:26 user nova-compute[74190]:       <nova:flavor name="m1.tiny">
Oct 18 12:27:26 user nova-compute[74190]:         <nova:memory>512</nova:memory>
Oct 18 12:27:26 user nova-compute[74190]:         <nova:disk>1</nova:disk>
Oct 18 12:27:26 user nova-compute[74190]:         <nova:swap>0</nova:swap>
Oct 18 12:27:26 user nova-compute[74190]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 12:27:26 user nova-compute[74190]:         <nova:vcpus>1</nova:vcpus>
Oct 18 12:27:26 user nova-compute[74190]:       </nova:flavor>
Oct 18 12:27:26 user nova-compute[74190]:       <nova:owner>
Oct 18 12:27:26 user nova-compute[74190]:         <nova:user uuid="308413c6fcfa4ac1b73916bc81e46851">tempest-TestMinimumBasicScenario-285966464-project-member</nova:user>
Oct 18 12:27:26 user nova-compute[74190]:         <nova:project uuid="0b49249509b24a1bb7c97536ab9f1bfe">tempest-TestMinimumBasicScenario-285966464</nova:project>
Oct 18 12:27:26 user nova-compute[74190]:       </nova:owner>
Oct 18 12:27:26 user nova-compute[74190]:       <nova:root type="image" uuid="693a8c10-488c-4cd9-a0c7-8de2f1c61cc3"/>
Oct 18 12:27:26 user nova-compute[74190]:       <nova:ports>
Oct 18 12:27:26 user nova-compute[74190]:         <nova:port uuid="2c24e9ba-c6f7-4f33-b460-fd8cae737828">
Oct 18 12:27:26 user nova-compute[74190]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 18 12:27:26 user nova-compute[74190]:         </nova:port>
Oct 18 12:27:26 user nova-compute[74190]:       </nova:ports>
Oct 18 12:27:26 user nova-compute[74190]:     </nova:instance>
Oct 18 12:27:26 user nova-compute[74190]:   </metadata>
Oct 18 12:27:26 user nova-compute[74190]:   <sysinfo type="smbios">
Oct 18 12:27:26 user nova-compute[74190]:     <system>
Oct 18 12:27:26 user nova-compute[74190]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 12:27:26 user nova-compute[74190]:       <entry name="product">OpenStack Nova</entry>
Oct 18 12:27:26 user nova-compute[74190]:       <entry name="version">0.0.0</entry>
Oct 18 12:27:26 user nova-compute[74190]:       <entry name="serial">42f93716-a9ca-4615-bd2c-f49bd15355d0</entry>
Oct 18 12:27:26 user nova-compute[74190]:       <entry name="uuid">42f93716-a9ca-4615-bd2c-f49bd15355d0</entry>
Oct 18 12:27:26 user nova-compute[74190]:       <entry name="family">Virtual Machine</entry>
Oct 18 12:27:26 user nova-compute[74190]:     </system>
Oct 18 12:27:26 user nova-compute[74190]:   </sysinfo>
Oct 18 12:27:26 user nova-compute[74190]:   <os>
Oct 18 12:27:26 user nova-compute[74190]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 12:27:26 user nova-compute[74190]:     <boot dev="hd"/>
Oct 18 12:27:26 user nova-compute[74190]:     <smbios mode="sysinfo"/>
Oct 18 12:27:26 user nova-compute[74190]:   </os>
Oct 18 12:27:26 user nova-compute[74190]:   <features>
Oct 18 12:27:26 user nova-compute[74190]:     <acpi/>
Oct 18 12:27:26 user nova-compute[74190]:     <apic/>
Oct 18 12:27:26 user nova-compute[74190]:     <vmcoreinfo/>
Oct 18 12:27:26 user nova-compute[74190]:   </features>
Oct 18 12:27:26 user nova-compute[74190]:   <clock offset="utc">
Oct 18 12:27:26 user nova-compute[74190]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 12:27:26 user nova-compute[74190]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 12:27:26 user nova-compute[74190]:     <timer name="hpet" present="no"/>
Oct 18 12:27:26 user nova-compute[74190]:   </clock>
Oct 18 12:27:26 user nova-compute[74190]:   <cpu mode="custom" match="exact">
Oct 18 12:27:26 user nova-compute[74190]:     <model>Nehalem</model>
Oct 18 12:27:26 user nova-compute[74190]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 12:27:26 user nova-compute[74190]:   </cpu>
Oct 18 12:27:26 user nova-compute[74190]:   <devices>
Oct 18 12:27:26 user nova-compute[74190]:     <disk type="file" device="disk">
Oct 18 12:27:26 user nova-compute[74190]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 12:27:26 user nova-compute[74190]:       <source file="/opt/stack/data/nova/instances/42f93716-a9ca-4615-bd2c-f49bd15355d0/disk"/>
Oct 18 12:27:26 user nova-compute[74190]:       <target dev="vda" bus="virtio"/>
Oct 18 12:27:26 user nova-compute[74190]:     </disk>
Oct 18 12:27:26 user nova-compute[74190]:     <disk type="block" device="disk">
Oct 18 12:27:26 user nova-compute[74190]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 12:27:26 user nova-compute[74190]:       <source dev="/dev/sdb"/>
Oct 18 12:27:26 user nova-compute[74190]:       <target dev="vdb" bus="virtio"/>
Oct 18 12:27:26 user nova-compute[74190]:       <serial>0a9bd76f-9e66-4d7a-abf3-007035a547bc</serial>
Oct 18 12:27:26 user nova-compute[74190]:     </disk>
Oct 18 12:27:26 user nova-compute[74190]:     <interface type="ethernet">
Oct 18 12:27:26 user nova-compute[74190]:       <mac address="fa:16:3e:35:db:4f"/>
Oct 18 12:27:26 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 12:27:26 user nova-compute[74190]:       <mtu size="1442"/>
Oct 18 12:27:26 user nova-compute[74190]:       <target dev="tap2c24e9ba-c6"/>
Oct 18 12:27:26 user nova-compute[74190]:     </interface>
Oct 18 12:27:26 user nova-compute[74190]:     <serial type="pty">
Oct 18 12:27:26 user nova-compute[74190]:       <log file="/opt/stack/data/nova/instances/42f93716-a9ca-4615-bd2c-f49bd15355d0/console.log" append="off"/>
Oct 18 12:27:26 user nova-compute[74190]:     </serial>
Oct 18 12:27:26 user nova-compute[74190]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 12:27:26 user nova-compute[74190]:     <video>
Oct 18 12:27:26 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 12:27:26 user nova-compute[74190]:     </video>
Oct 18 12:27:26 user nova-compute[74190]:     <rng model="virtio">
Oct 18 12:27:26 user nova-compute[74190]:       <backend model="random">/dev/urandom</backend>
Oct 18 12:27:26 user nova-compute[74190]:     </rng>
Oct 18 12:27:26 user nova-compute[74190]:     <controller type="usb" index="0" model="none"/>
Oct 18 12:27:26 user nova-compute[74190]:     <memballoon model="virtio">
Oct 18 12:27:26 user nova-compute[74190]:       <stats period="10"/>
Oct 18 12:27:26 user nova-compute[74190]:     </memballoon>
Oct 18 12:27:26 user nova-compute[74190]:   </devices>
Oct 18 12:27:26 user nova-compute[74190]: </domain>
Oct 18 12:27:26 user nova-compute[74190]:  {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 12:27:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f93716-a9ca-4615-bd2c-f49bd15355d0/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:27:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f93716-a9ca-4615-bd2c-f49bd15355d0/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:27:26 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f93716-a9ca-4615-bd2c-f49bd15355d0/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:27:27 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f93716-a9ca-4615-bd2c-f49bd15355d0/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:27:27 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 12:27:27 user nova-compute[74190]: DEBUG nova.objects.instance [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Lazy-loading 'trusted_certs' on Instance uuid 42f93716-a9ca-4615-bd2c-f49bd15355d0 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:27:27 user nova-compute[74190]: DEBUG nova.objects.base [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Object Instance<42f93716-a9ca-4615-bd2c-f49bd15355d0> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=74190) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 12:27:27 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3ae2894f06b5dd05b86764be64149ab2486f1262 --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:27:27 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3ae2894f06b5dd05b86764be64149ab2486f1262 --force-share --output=json" returned: 0 in 0.174s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:27:27 user nova-compute[74190]: DEBUG nova.virt.disk.api [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Checking if we can resize image /opt/stack/data/nova/instances/42f93716-a9ca-4615-bd2c-f49bd15355d0/disk. size=1073741824 {{(pid=74190) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 18 12:27:27 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f93716-a9ca-4615-bd2c-f49bd15355d0/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:27:27 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f93716-a9ca-4615-bd2c-f49bd15355d0/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:27:27 user nova-compute[74190]: DEBUG nova.virt.disk.api [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Cannot resize image /opt/stack/data/nova/instances/42f93716-a9ca-4615-bd2c-f49bd15355d0/disk to a smaller size. {{(pid=74190) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 18 12:27:27 user nova-compute[74190]: DEBUG nova.objects.instance [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Lazy-loading 'migration_context' on Instance uuid 42f93716-a9ca-4615-bd2c-f49bd15355d0 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:27:27 user nova-compute[74190]: DEBUG nova.objects.base [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Object Instance<42f93716-a9ca-4615-bd2c-f49bd15355d0> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74190) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 18 12:27:27 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T12:24:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2013688416',display_name='tempest-TestMinimumBasicScenario-server-2013688416',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2013688416',id=51,image_ref='693a8c10-488c-4cd9-a0c7-8de2f1c61cc3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOCZwMpVFiAadyOJRFJSfp61V7G8+JJMzysqdVUUHmZsoRHcS+z4FN7O+/O2PGqEddXqvj2MjPNr7KtjpRQ6iyZ7vBg4jH2t5xe4Z3s9w0RYGFs8r5hwI9smaT/VK+6WA==',key_name='tempest-TestMinimumBasicScenario-1500157790',keypairs=<?>,launch_index=0,launched_at=2023-10-18T12:24:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='0b49249509b24a1bb7c97536ab9f1bfe',ramdisk_id='',reservation_id='r-yj6b2vga',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='693a8c10-488c-4cd9-a0c7-8de2f1c61cc3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-285966464',owner_user_name='tempest-TestMinimumBasicScenario-285966464-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T12:27:24Z,user_data=None,user_id='308413c6fcfa4ac1b73916bc81e46851',uuid=42f93716-a9ca-4615-bd2c-f49bd15355d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2c24e9ba-c6f7-4f33-b460-fd8cae737828", "address": "fa:16:3e:35:db:4f", "network": {"id": "f3af1635-bf8e-449d-baa0-fa3c2b96e435", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1573451770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b49249509b24a1bb7c97536ab9f1bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c24e9ba-c6", "ovs_interfaceid": "2c24e9ba-c6f7-4f33-b460-fd8cae737828", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 12:27:27 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Converting VIF {"id": "2c24e9ba-c6f7-4f33-b460-fd8cae737828", "address": "fa:16:3e:35:db:4f", "network": {"id": "f3af1635-bf8e-449d-baa0-fa3c2b96e435", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1573451770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b49249509b24a1bb7c97536ab9f1bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c24e9ba-c6", "ovs_interfaceid": "2c24e9ba-c6f7-4f33-b460-fd8cae737828", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 12:27:27 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:35:db:4f,bridge_name='br-int',has_traffic_filtering=True,id=2c24e9ba-c6f7-4f33-b460-fd8cae737828,network=Network(f3af1635-bf8e-449d-baa0-fa3c2b96e435),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c24e9ba-c6') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 12:27:27 user nova-compute[74190]: DEBUG os_vif [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:db:4f,bridge_name='br-int',has_traffic_filtering=True,id=2c24e9ba-c6f7-4f33-b460-fd8cae737828,network=Network(f3af1635-bf8e-449d-baa0-fa3c2b96e435),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c24e9ba-c6') {{(pid=74190) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 12:27:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:27:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:27:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 12:27:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:27:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ecdc0c1b-0c64-5424-9441-0cc791d34e32', '_type': 'linux-noop'}}, row=False) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:27:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:27:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:27:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2c24e9ba-c6, may_exist=True, interface_attrs={}) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:27:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2c24e9ba-c6, col_values=(('qos', UUID('522de70d-5955-403e-939c-a993034b758a')),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:27:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2c24e9ba-c6, col_values=(('external_ids', {'iface-id': '2c24e9ba-c6f7-4f33-b460-fd8cae737828', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:db:4f', 'vm-uuid': '42f93716-a9ca-4615-bd2c-f49bd15355d0'}),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:27:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:27:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:27:27 user nova-compute[74190]: INFO os_vif [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:db:4f,bridge_name='br-int',has_traffic_filtering=True,id=2c24e9ba-c6f7-4f33-b460-fd8cae737828,network=Network(f3af1635-bf8e-449d-baa0-fa3c2b96e435),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c24e9ba-c6')
Oct 18 12:27:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:27:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:27:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:27:28 user nova-compute[74190]: DEBUG nova.compute.manager [req-bd956bfb-e1a9-479d-8761-637513be5608 req-e8f5be13-d0f0-4650-b211-71aea60975ea service nova] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Received event network-vif-plugged-2c24e9ba-c6f7-4f33-b460-fd8cae737828 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:27:28 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-bd956bfb-e1a9-479d-8761-637513be5608 req-e8f5be13-d0f0-4650-b211-71aea60975ea service nova] Acquiring lock "42f93716-a9ca-4615-bd2c-f49bd15355d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:27:28 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-bd956bfb-e1a9-479d-8761-637513be5608 req-e8f5be13-d0f0-4650-b211-71aea60975ea service nova] Lock "42f93716-a9ca-4615-bd2c-f49bd15355d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:27:28 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-bd956bfb-e1a9-479d-8761-637513be5608 req-e8f5be13-d0f0-4650-b211-71aea60975ea service nova] Lock "42f93716-a9ca-4615-bd2c-f49bd15355d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:27:28 user nova-compute[74190]: DEBUG nova.compute.manager [req-bd956bfb-e1a9-479d-8761-637513be5608 req-e8f5be13-d0f0-4650-b211-71aea60975ea service nova] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] No waiting events found dispatching network-vif-plugged-2c24e9ba-c6f7-4f33-b460-fd8cae737828 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:27:28 user nova-compute[74190]: WARNING nova.compute.manager [req-bd956bfb-e1a9-479d-8761-637513be5608 req-e8f5be13-d0f0-4650-b211-71aea60975ea service nova] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Received unexpected event network-vif-plugged-2c24e9ba-c6f7-4f33-b460-fd8cae737828 for instance with vm_state active and task_state reboot_started_hard.
Oct 18 12:27:29 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:27:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:27:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:27:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:27:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:27:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:27:30 user nova-compute[74190]: DEBUG nova.compute.manager [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Instance event wait completed in 0 seconds for  {{(pid=74190) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 12:27:30 user nova-compute[74190]: DEBUG nova.compute.manager [req-25dd107a-4b03-45fc-b233-1a6d5432e153 req-490051f2-df8b-4f51-a6c2-cb9392a213be service nova] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Received event network-vif-plugged-2c24e9ba-c6f7-4f33-b460-fd8cae737828 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:27:30 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-25dd107a-4b03-45fc-b233-1a6d5432e153 req-490051f2-df8b-4f51-a6c2-cb9392a213be service nova] Acquiring lock "42f93716-a9ca-4615-bd2c-f49bd15355d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:27:30 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-25dd107a-4b03-45fc-b233-1a6d5432e153 req-490051f2-df8b-4f51-a6c2-cb9392a213be service nova] Lock "42f93716-a9ca-4615-bd2c-f49bd15355d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:27:30 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-25dd107a-4b03-45fc-b233-1a6d5432e153 req-490051f2-df8b-4f51-a6c2-cb9392a213be service nova] Lock "42f93716-a9ca-4615-bd2c-f49bd15355d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:27:30 user nova-compute[74190]: DEBUG nova.compute.manager [req-25dd107a-4b03-45fc-b233-1a6d5432e153 req-490051f2-df8b-4f51-a6c2-cb9392a213be service nova] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] No waiting events found dispatching network-vif-plugged-2c24e9ba-c6f7-4f33-b460-fd8cae737828 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:27:30 user nova-compute[74190]: WARNING nova.compute.manager [req-25dd107a-4b03-45fc-b233-1a6d5432e153 req-490051f2-df8b-4f51-a6c2-cb9392a213be service nova] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Received unexpected event network-vif-plugged-2c24e9ba-c6f7-4f33-b460-fd8cae737828 for instance with vm_state active and task_state reboot_started_hard.
Oct 18 12:27:30 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Instance rebooted successfully.
Oct 18 12:27:30 user nova-compute[74190]: DEBUG nova.compute.manager [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Checking state {{(pid=74190) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 12:27:31 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-76cbfab5-74ed-477c-9936-bde5608efafb tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Lock "42f93716-a9ca-4615-bd2c-f49bd15355d0" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.688s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:27:31 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:27:32 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:27:33 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:27:33 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Cleaning up deleted instances {{(pid=74190) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 18 12:27:33 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] There are 0 instances to clean {{(pid=74190) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 18 12:27:35 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:27:35 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:27:37 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:27:37 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Starting heal instance info cache {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 12:27:37 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Rebuilding the list of instances to heal {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 18 12:27:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "refresh_cache-42f93716-a9ca-4615-bd2c-f49bd15355d0" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:27:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquired lock "refresh_cache-42f93716-a9ca-4615-bd2c-f49bd15355d0" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:27:37 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Forcefully refreshing network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 18 12:27:37 user nova-compute[74190]: DEBUG nova.objects.instance [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lazy-loading 'info_cache' on Instance uuid 42f93716-a9ca-4615-bd2c-f49bd15355d0 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:27:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:27:37 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Updating instance_info_cache with network_info: [{"id": "2c24e9ba-c6f7-4f33-b460-fd8cae737828", "address": "fa:16:3e:35:db:4f", "network": {"id": "f3af1635-bf8e-449d-baa0-fa3c2b96e435", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1573451770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b49249509b24a1bb7c97536ab9f1bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c24e9ba-c6", "ovs_interfaceid": "2c24e9ba-c6f7-4f33-b460-fd8cae737828", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:27:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Releasing lock "refresh_cache-42f93716-a9ca-4615-bd2c-f49bd15355d0" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:27:37 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Updated the network info_cache for instance {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 18 12:27:37 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:27:39 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:27:39 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:27:39 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74190) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 12:27:39 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:27:39 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74190) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 18 12:27:40 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:27:40 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:27:40 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:27:40 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:27:40 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Auditing locally available compute resources for user (node: user) {{(pid=74190) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 12:27:40 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f93716-a9ca-4615-bd2c-f49bd15355d0/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:27:40 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f93716-a9ca-4615-bd2c-f49bd15355d0/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:27:40 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f93716-a9ca-4615-bd2c-f49bd15355d0/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:27:40 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f93716-a9ca-4615-bd2c-f49bd15355d0/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:27:40 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 12:27:40 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:27:40 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:27:40 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Hypervisor/Node resource view: name=user free_ram=8949MB free_disk=25.124717712402344GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74190) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 12:27:40 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:27:40 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:27:41 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 42f93716-a9ca-4615-bd2c-f49bd15355d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:27:41 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 12:27:41 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 12:27:41 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 12:27:41 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 12:27:41 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Compute_service record updated for user:user {{(pid=74190) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 12:27:41 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.234s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:27:42 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:27:43 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:27:45 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:27:45 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:27:47 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:27:50 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:27:52 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:27:55 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:27:57 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:27:58 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:27:58 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Triggering sync for uuid 42f93716-a9ca-4615-bd2c-f49bd15355d0 {{(pid=74190) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 18 12:27:58 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "42f93716-a9ca-4615-bd2c-f49bd15355d0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:27:58 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "42f93716-a9ca-4615-bd2c-f49bd15355d0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:27:58 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "42f93716-a9ca-4615-bd2c-f49bd15355d0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.023s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:28:00 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:28:02 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:28:07 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:28:12 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:28:17 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:28:22 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:28:24 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:28:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:28:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:28:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74190) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 12:28:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:28:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:28:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:28:29 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:28:32 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:28:32 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:28:36 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:28:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:28:38 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:28:39 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:28:39 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Starting heal instance info cache {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 12:28:39 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Rebuilding the list of instances to heal {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 18 12:28:39 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "refresh_cache-42f93716-a9ca-4615-bd2c-f49bd15355d0" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:28:39 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquired lock "refresh_cache-42f93716-a9ca-4615-bd2c-f49bd15355d0" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:28:39 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Forcefully refreshing network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 18 12:28:39 user nova-compute[74190]: DEBUG nova.objects.instance [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lazy-loading 'info_cache' on Instance uuid 42f93716-a9ca-4615-bd2c-f49bd15355d0 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:28:39 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Updating instance_info_cache with network_info: [{"id": "2c24e9ba-c6f7-4f33-b460-fd8cae737828", "address": "fa:16:3e:35:db:4f", "network": {"id": "f3af1635-bf8e-449d-baa0-fa3c2b96e435", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1573451770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b49249509b24a1bb7c97536ab9f1bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c24e9ba-c6", "ovs_interfaceid": "2c24e9ba-c6f7-4f33-b460-fd8cae737828", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:28:39 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Releasing lock "refresh_cache-42f93716-a9ca-4615-bd2c-f49bd15355d0" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:28:39 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Updated the network info_cache for instance {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 18 12:28:40 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:28:40 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:28:40 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:28:40 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:28:40 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:28:40 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Auditing locally available compute resources for user (node: user) {{(pid=74190) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 12:28:40 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f93716-a9ca-4615-bd2c-f49bd15355d0/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:28:40 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f93716-a9ca-4615-bd2c-f49bd15355d0/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:28:40 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f93716-a9ca-4615-bd2c-f49bd15355d0/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:28:40 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f93716-a9ca-4615-bd2c-f49bd15355d0/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:28:40 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 12:28:40 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:28:40 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:28:40 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Hypervisor/Node resource view: name=user free_ram=8987MB free_disk=25.123973846435547GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74190) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 12:28:40 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:28:40 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:28:40 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 42f93716-a9ca-4615-bd2c-f49bd15355d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:28:40 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 12:28:40 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 12:28:40 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Refreshing inventories for resource provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 18 12:28:40 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Updating ProviderTree inventory for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 18 12:28:40 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Updating inventory in ProviderTree for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 18 12:28:40 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Refreshing aggregate associations for resource provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66, aggregates: None {{(pid=74190) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 18 12:28:41 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Refreshing trait associations for resource provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66, traits: COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE42,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_ACCELERATORS,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=74190) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 18 12:28:41 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 12:28:41 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 12:28:41 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Compute_service record updated for user:user {{(pid=74190) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 12:28:41 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.267s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:28:42 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:28:42 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74190) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 12:28:42 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:28:47 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:28:52 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:28:57 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:28:57 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:28:57 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74190) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 12:28:57 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:28:57 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:28:57 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:29:02 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:29:07 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:29:12 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:29:15 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:29:15 user nova-compute[74190]: DEBUG nova.compute.manager [req-d75532e1-05fa-40d0-842a-860e82c52ea2 req-2e07b693-4a28-41a4-9bc8-36135395c2fe service nova] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Received event network-changed-2c24e9ba-c6f7-4f33-b460-fd8cae737828 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:29:15 user nova-compute[74190]: DEBUG nova.compute.manager [req-d75532e1-05fa-40d0-842a-860e82c52ea2 req-2e07b693-4a28-41a4-9bc8-36135395c2fe service nova] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Refreshing instance network info cache due to event network-changed-2c24e9ba-c6f7-4f33-b460-fd8cae737828. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 12:29:15 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d75532e1-05fa-40d0-842a-860e82c52ea2 req-2e07b693-4a28-41a4-9bc8-36135395c2fe service nova] Acquiring lock "refresh_cache-42f93716-a9ca-4615-bd2c-f49bd15355d0" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:29:15 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d75532e1-05fa-40d0-842a-860e82c52ea2 req-2e07b693-4a28-41a4-9bc8-36135395c2fe service nova] Acquired lock "refresh_cache-42f93716-a9ca-4615-bd2c-f49bd15355d0" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:29:15 user nova-compute[74190]: DEBUG nova.network.neutron [req-d75532e1-05fa-40d0-842a-860e82c52ea2 req-2e07b693-4a28-41a4-9bc8-36135395c2fe service nova] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Refreshing network info cache for port 2c24e9ba-c6f7-4f33-b460-fd8cae737828 {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 12:29:15 user nova-compute[74190]: DEBUG nova.network.neutron [req-d75532e1-05fa-40d0-842a-860e82c52ea2 req-2e07b693-4a28-41a4-9bc8-36135395c2fe service nova] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Updated VIF entry in instance network info cache for port 2c24e9ba-c6f7-4f33-b460-fd8cae737828. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 12:29:15 user nova-compute[74190]: DEBUG nova.network.neutron [req-d75532e1-05fa-40d0-842a-860e82c52ea2 req-2e07b693-4a28-41a4-9bc8-36135395c2fe service nova] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Updating instance_info_cache with network_info: [{"id": "2c24e9ba-c6f7-4f33-b460-fd8cae737828", "address": "fa:16:3e:35:db:4f", "network": {"id": "f3af1635-bf8e-449d-baa0-fa3c2b96e435", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1573451770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b49249509b24a1bb7c97536ab9f1bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c24e9ba-c6", "ovs_interfaceid": "2c24e9ba-c6f7-4f33-b460-fd8cae737828", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:29:15 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d75532e1-05fa-40d0-842a-860e82c52ea2 req-2e07b693-4a28-41a4-9bc8-36135395c2fe service nova] Releasing lock "refresh_cache-42f93716-a9ca-4615-bd2c-f49bd15355d0" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:29:15 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:29:16 user nova-compute[74190]: DEBUG nova.compute.manager [req-3c3db7c9-d4b8-42ff-86f0-49d71eeae10c req-f17474a8-3e44-497f-8a21-6a393b90ac0b service nova] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Received event network-changed-2c24e9ba-c6f7-4f33-b460-fd8cae737828 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:29:16 user nova-compute[74190]: DEBUG nova.compute.manager [req-3c3db7c9-d4b8-42ff-86f0-49d71eeae10c req-f17474a8-3e44-497f-8a21-6a393b90ac0b service nova] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Refreshing instance network info cache due to event network-changed-2c24e9ba-c6f7-4f33-b460-fd8cae737828. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 12:29:16 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-3c3db7c9-d4b8-42ff-86f0-49d71eeae10c req-f17474a8-3e44-497f-8a21-6a393b90ac0b service nova] Acquiring lock "refresh_cache-42f93716-a9ca-4615-bd2c-f49bd15355d0" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:29:16 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-3c3db7c9-d4b8-42ff-86f0-49d71eeae10c req-f17474a8-3e44-497f-8a21-6a393b90ac0b service nova] Acquired lock "refresh_cache-42f93716-a9ca-4615-bd2c-f49bd15355d0" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:29:16 user nova-compute[74190]: DEBUG nova.network.neutron [req-3c3db7c9-d4b8-42ff-86f0-49d71eeae10c req-f17474a8-3e44-497f-8a21-6a393b90ac0b service nova] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Refreshing network info cache for port 2c24e9ba-c6f7-4f33-b460-fd8cae737828 {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 12:29:16 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-d39e7856-9c18-429c-8be9-f69c86f39d55 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Acquiring lock "42f93716-a9ca-4615-bd2c-f49bd15355d0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:29:16 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-d39e7856-9c18-429c-8be9-f69c86f39d55 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Lock "42f93716-a9ca-4615-bd2c-f49bd15355d0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:29:16 user nova-compute[74190]: INFO nova.compute.manager [None req-d39e7856-9c18-429c-8be9-f69c86f39d55 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Detaching volume 0a9bd76f-9e66-4d7a-abf3-007035a547bc
Oct 18 12:29:16 user nova-compute[74190]: INFO nova.virt.block_device [None req-d39e7856-9c18-429c-8be9-f69c86f39d55 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Attempting to driver detach volume 0a9bd76f-9e66-4d7a-abf3-007035a547bc from mountpoint /dev/vdb
Oct 18 12:29:16 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-d39e7856-9c18-429c-8be9-f69c86f39d55 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Attempting to detach device vdb from instance 42f93716-a9ca-4615-bd2c-f49bd15355d0 from the persistent domain config. {{(pid=74190) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 18 12:29:16 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-d39e7856-9c18-429c-8be9-f69c86f39d55 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 12:29:16 user nova-compute[74190]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 12:29:16 user nova-compute[74190]:   <source dev="/dev/sdb"/>
Oct 18 12:29:16 user nova-compute[74190]:   <target dev="vdb" bus="virtio"/>
Oct 18 12:29:16 user nova-compute[74190]:   <serial>0a9bd76f-9e66-4d7a-abf3-007035a547bc</serial>
Oct 18 12:29:16 user nova-compute[74190]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 18 12:29:16 user nova-compute[74190]: </disk>
Oct 18 12:29:16 user nova-compute[74190]:  {{(pid=74190) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 12:29:16 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-d39e7856-9c18-429c-8be9-f69c86f39d55 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Successfully detached device vdb from instance 42f93716-a9ca-4615-bd2c-f49bd15355d0 from the persistent domain config.
Oct 18 12:29:16 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-d39e7856-9c18-429c-8be9-f69c86f39d55 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 42f93716-a9ca-4615-bd2c-f49bd15355d0 from the live domain config. {{(pid=74190) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 18 12:29:16 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-d39e7856-9c18-429c-8be9-f69c86f39d55 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 12:29:16 user nova-compute[74190]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 12:29:16 user nova-compute[74190]:   <source dev="/dev/sdb"/>
Oct 18 12:29:16 user nova-compute[74190]:   <target dev="vdb" bus="virtio"/>
Oct 18 12:29:16 user nova-compute[74190]:   <serial>0a9bd76f-9e66-4d7a-abf3-007035a547bc</serial>
Oct 18 12:29:16 user nova-compute[74190]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 18 12:29:16 user nova-compute[74190]: </disk>
Oct 18 12:29:16 user nova-compute[74190]:  {{(pid=74190) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 12:29:16 user nova-compute[74190]: DEBUG nova.network.neutron [req-3c3db7c9-d4b8-42ff-86f0-49d71eeae10c req-f17474a8-3e44-497f-8a21-6a393b90ac0b service nova] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Updated VIF entry in instance network info cache for port 2c24e9ba-c6f7-4f33-b460-fd8cae737828. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 12:29:16 user nova-compute[74190]: DEBUG nova.network.neutron [req-3c3db7c9-d4b8-42ff-86f0-49d71eeae10c req-f17474a8-3e44-497f-8a21-6a393b90ac0b service nova] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Updating instance_info_cache with network_info: [{"id": "2c24e9ba-c6f7-4f33-b460-fd8cae737828", "address": "fa:16:3e:35:db:4f", "network": {"id": "f3af1635-bf8e-449d-baa0-fa3c2b96e435", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1573451770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b49249509b24a1bb7c97536ab9f1bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c24e9ba-c6", "ovs_interfaceid": "2c24e9ba-c6f7-4f33-b460-fd8cae737828", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:29:16 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-3c3db7c9-d4b8-42ff-86f0-49d71eeae10c req-f17474a8-3e44-497f-8a21-6a393b90ac0b service nova] Releasing lock "refresh_cache-42f93716-a9ca-4615-bd2c-f49bd15355d0" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:29:17 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-d39e7856-9c18-429c-8be9-f69c86f39d55 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 42f93716-a9ca-4615-bd2c-f49bd15355d0 {{(pid=74190) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 18 12:29:17 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:29:22 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:29:24 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:29:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:29:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:29:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74190) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 12:29:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:29:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:29:27 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:29:31 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:29:32 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:29:32 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:29:37 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-d39e7856-9c18-429c-8be9-f69c86f39d55 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 42f93716-a9ca-4615-bd2c-f49bd15355d0 is timed out.
Oct 18 12:29:37 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-d39e7856-9c18-429c-8be9-f69c86f39d55 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Successfully detached device vdb from instance 42f93716-a9ca-4615-bd2c-f49bd15355d0 from the live domain config.
Oct 18 12:29:37 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d39e7856-9c18-429c-8be9-f69c86f39d55 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] calling os-brick to detach iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 12:29:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-d39e7856-9c18-429c-8be9-f69c86f39d55 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, {'target_iqn': 'iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PBmQJXef', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 12:29:37 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-d39e7856-9c18-429c-8be9-f69c86f39d55 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 12:29:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-d39e7856-9c18-429c-8be9-f69c86f39d55 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 12:29:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-d39e7856-9c18-429c-8be9-f69c86f39d55 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 12:29:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:29:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:29:37 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[753e3bf7-6f8b-4a6a-954b-83a52f7a30a2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:29:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-d39e7856-9c18-429c-8be9-f69c86f39d55 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 12:29:37 user nova-compute[74190]: No targets found.
Oct 18 12:29:37 user nova-compute[74190]: iSNS:
Oct 18 12:29:37 user nova-compute[74190]: No targets found.
Oct 18 12:29:37 user nova-compute[74190]: STATIC:
Oct 18 12:29:37 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc
Oct 18 12:29:37 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 12:29:37 user nova-compute[74190]:                 Iface Name: default
Oct 18 12:29:37 user nova-compute[74190]: FIRMWARE:
Oct 18 12:29:37 user nova-compute[74190]: No targets found.
Oct 18 12:29:37 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 12:29:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-d39e7856-9c18-429c-8be9-f69c86f39d55 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 12:29:37 user nova-compute[74190]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 12:29:37 user nova-compute[74190]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74190) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 12:29:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-d39e7856-9c18-429c-8be9-f69c86f39d55 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc', 0)] {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 12:29:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:29:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:29:37 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb9559a-97db-43cb-8636-ece78b0f27e8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:29:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:29:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:29:37 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[991ad36c-8b97-4463-ae9a-7b214b87f640]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:29:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-d39e7856-9c18-429c-8be9-f69c86f39d55 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc (non-flash)
Oct 18 12:29:37 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 12:29:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-d39e7856-9c18-429c-8be9-f69c86f39d55 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc (non-flash)
Oct 18 12:29:37 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 12:29:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-d39e7856-9c18-429c-8be9-f69c86f39d55 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1f2476e950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc'): ({'sdb'}, set())}) {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 12:29:37 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-d39e7856-9c18-429c-8be9-f69c86f39d55 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Removing single pathed devices sdb {{(pid=74190) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 12:29:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:29:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:29:37 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf7e886-9e98-4834-8e74-a1368befdd82]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:29:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:29:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:29:37 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[753f1137-d83c-482b-a2a7-ece8657c1c66]: (4, ('ok\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:29:37 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-d39e7856-9c18-429c-8be9-f69c86f39d55 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Flushing IO for device /dev/sdb {{(pid=74190) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 12:29:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:29:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:29:37 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[653138c5-4088-4908-9fd9-32801b7d53c1]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:29:37 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-d39e7856-9c18-429c-8be9-f69c86f39d55 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74190) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 12:29:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:29:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:29:37 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c9e44d-d81a-46e5-a3da-1af365a814d5]: (4, ('1', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:29:37 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-d39e7856-9c18-429c-8be9-f69c86f39d55 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 12:29:37 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-d39e7856-9c18-429c-8be9-f69c86f39d55 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] SCSI volumes sdb have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 12:29:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-d39e7856-9c18-429c-8be9-f69c86f39d55 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc')] {{(pid=74190) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 12:29:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:29:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:29:37 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad73db9d-fe08-492e-b204-866acc20647e]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:29:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-d39e7856-9c18-429c-8be9-f69c86f39d55 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:29:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc -p 172.16.0.220:3260 --logout {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:29:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:29:37 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[873a49cd-f91a-4635-a04d-c7d755ffe2b0]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:29:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-d39e7856-9c18-429c-8be9-f69c86f39d55 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc, portal: 172.16.0.220,3260]
Oct 18 12:29:37 user nova-compute[74190]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc, portal: 172.16.0.220,3260] successful.
Oct 18 12:29:37 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:29:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc -p 172.16.0.220:3260 --op delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:29:37 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a9bd76f-9e66-4d7a-abf3-007035a547bc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:29:37 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[7640fb6d-55ad-4998-baa0-9765f6161b0a]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:29:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-d39e7856-9c18-429c-8be9-f69c86f39d55 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:29:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-d39e7856-9c18-429c-8be9-f69c86f39d55 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 12:29:37 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-d39e7856-9c18-429c-8be9-f69c86f39d55 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] <== disconnect_volume: return (301ms) None {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 12:29:37 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d39e7856-9c18-429c-8be9-f69c86f39d55 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Disconnected iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 12:29:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:29:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:29:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74190) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 12:29:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:29:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:29:37 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:29:38 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:29:38 user nova-compute[74190]: DEBUG nova.objects.instance [None req-d39e7856-9c18-429c-8be9-f69c86f39d55 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Lazy-loading 'flavor' on Instance uuid 42f93716-a9ca-4615-bd2c-f49bd15355d0 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:29:38 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-d39e7856-9c18-429c-8be9-f69c86f39d55 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Lock "42f93716-a9ca-4615-bd2c-f49bd15355d0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.728s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:29:39 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:29:40 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:29:40 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:29:40 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:29:40 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:29:40 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:29:40 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Auditing locally available compute resources for user (node: user) {{(pid=74190) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 12:29:40 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f93716-a9ca-4615-bd2c-f49bd15355d0/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:29:40 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f93716-a9ca-4615-bd2c-f49bd15355d0/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:29:40 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f93716-a9ca-4615-bd2c-f49bd15355d0/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:29:40 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42f93716-a9ca-4615-bd2c-f49bd15355d0/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:29:40 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:29:40 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:29:40 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Hypervisor/Node resource view: name=user free_ram=8967MB free_disk=25.12320327758789GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74190) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 12:29:40 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:29:40 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:29:40 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 42f93716-a9ca-4615-bd2c-f49bd15355d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:29:40 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 12:29:40 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 12:29:41 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 12:29:41 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 12:29:41 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Compute_service record updated for user:user {{(pid=74190) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 12:29:41 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.165s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:29:42 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:29:42 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Starting heal instance info cache {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 12:29:42 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Rebuilding the list of instances to heal {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 18 12:29:42 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "refresh_cache-42f93716-a9ca-4615-bd2c-f49bd15355d0" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:29:42 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquired lock "refresh_cache-42f93716-a9ca-4615-bd2c-f49bd15355d0" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:29:42 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Forcefully refreshing network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 18 12:29:42 user nova-compute[74190]: DEBUG nova.objects.instance [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lazy-loading 'info_cache' on Instance uuid 42f93716-a9ca-4615-bd2c-f49bd15355d0 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:29:42 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Updating instance_info_cache with network_info: [{"id": "2c24e9ba-c6f7-4f33-b460-fd8cae737828", "address": "fa:16:3e:35:db:4f", "network": {"id": "f3af1635-bf8e-449d-baa0-fa3c2b96e435", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1573451770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b49249509b24a1bb7c97536ab9f1bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c24e9ba-c6", "ovs_interfaceid": "2c24e9ba-c6f7-4f33-b460-fd8cae737828", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:29:42 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:29:42 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Releasing lock "refresh_cache-42f93716-a9ca-4615-bd2c-f49bd15355d0" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:29:42 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Updated the network info_cache for instance {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 18 12:29:42 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:29:42 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74190) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 12:29:47 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:29:47 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:29:47 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74190) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 12:29:47 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:29:47 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:29:47 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:29:50 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:29:52 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:29:57 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:30:02 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:30:07 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:30:12 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:30:17 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:30:17 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:30:17 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74190) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 12:30:17 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:30:17 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:30:17 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:30:22 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:30:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-0f43a8d7-e23d-4633-a5af-822d684a31d0 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Acquiring lock "42f93716-a9ca-4615-bd2c-f49bd15355d0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:30:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-0f43a8d7-e23d-4633-a5af-822d684a31d0 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Lock "42f93716-a9ca-4615-bd2c-f49bd15355d0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:30:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-0f43a8d7-e23d-4633-a5af-822d684a31d0 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Acquiring lock "42f93716-a9ca-4615-bd2c-f49bd15355d0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:30:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-0f43a8d7-e23d-4633-a5af-822d684a31d0 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Lock "42f93716-a9ca-4615-bd2c-f49bd15355d0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:30:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-0f43a8d7-e23d-4633-a5af-822d684a31d0 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Lock "42f93716-a9ca-4615-bd2c-f49bd15355d0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:30:24 user nova-compute[74190]: INFO nova.compute.manager [None req-0f43a8d7-e23d-4633-a5af-822d684a31d0 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Terminating instance
Oct 18 12:30:24 user nova-compute[74190]: DEBUG nova.compute.manager [None req-0f43a8d7-e23d-4633-a5af-822d684a31d0 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Start destroying the instance on the hypervisor. {{(pid=74190) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 12:30:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:30:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:30:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:30:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:30:24 user nova-compute[74190]: DEBUG nova.compute.manager [req-21c5e4c6-fb08-4e34-9617-e79ac999d8ec req-e1b0404a-ff92-4b3c-8df8-76e00ee0a3f5 service nova] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Received event network-vif-unplugged-2c24e9ba-c6f7-4f33-b460-fd8cae737828 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:30:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-21c5e4c6-fb08-4e34-9617-e79ac999d8ec req-e1b0404a-ff92-4b3c-8df8-76e00ee0a3f5 service nova] Acquiring lock "42f93716-a9ca-4615-bd2c-f49bd15355d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:30:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-21c5e4c6-fb08-4e34-9617-e79ac999d8ec req-e1b0404a-ff92-4b3c-8df8-76e00ee0a3f5 service nova] Lock "42f93716-a9ca-4615-bd2c-f49bd15355d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:30:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-21c5e4c6-fb08-4e34-9617-e79ac999d8ec req-e1b0404a-ff92-4b3c-8df8-76e00ee0a3f5 service nova] Lock "42f93716-a9ca-4615-bd2c-f49bd15355d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:30:24 user nova-compute[74190]: DEBUG nova.compute.manager [req-21c5e4c6-fb08-4e34-9617-e79ac999d8ec req-e1b0404a-ff92-4b3c-8df8-76e00ee0a3f5 service nova] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] No waiting events found dispatching network-vif-unplugged-2c24e9ba-c6f7-4f33-b460-fd8cae737828 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:30:24 user nova-compute[74190]: DEBUG nova.compute.manager [req-21c5e4c6-fb08-4e34-9617-e79ac999d8ec req-e1b0404a-ff92-4b3c-8df8-76e00ee0a3f5 service nova] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Received event network-vif-unplugged-2c24e9ba-c6f7-4f33-b460-fd8cae737828 for instance with task_state deleting. {{(pid=74190) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 12:30:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:30:24 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Instance destroyed successfully.
Oct 18 12:30:24 user nova-compute[74190]: DEBUG nova.objects.instance [None req-0f43a8d7-e23d-4633-a5af-822d684a31d0 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Lazy-loading 'resources' on Instance uuid 42f93716-a9ca-4615-bd2c-f49bd15355d0 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:30:24 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-0f43a8d7-e23d-4633-a5af-822d684a31d0 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T12:24:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2013688416',display_name='tempest-TestMinimumBasicScenario-server-2013688416',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2013688416',id=51,image_ref='693a8c10-488c-4cd9-a0c7-8de2f1c61cc3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOCZwMpVFiAadyOJRFJSfp61V7G8+JJMzysqdVUUHmZsoRHcS+z4FN7O+/O2PGqEddXqvj2MjPNr7KtjpRQ6iyZ7vBg4jH2t5xe4Z3s9w0RYGFs8r5hwI9smaT/VK+6WA==',key_name='tempest-TestMinimumBasicScenario-1500157790',keypairs=<?>,launch_index=0,launched_at=2023-10-18T12:24:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0b49249509b24a1bb7c97536ab9f1bfe',ramdisk_id='',reservation_id='r-yj6b2vga',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='693a8c10-488c-4cd9-a0c7-8de2f1c61cc3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-285966464',owner_user_name='tempest-TestMinimumBasicScenario-285966464-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T12:27:31Z,user_data=None,user_id='308413c6fcfa4ac1b73916bc81e46851',uuid=42f93716-a9ca-4615-bd2c-f49bd15355d0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2c24e9ba-c6f7-4f33-b460-fd8cae737828", "address": "fa:16:3e:35:db:4f", "network": {"id": "f3af1635-bf8e-449d-baa0-fa3c2b96e435", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1573451770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b49249509b24a1bb7c97536ab9f1bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c24e9ba-c6", "ovs_interfaceid": "2c24e9ba-c6f7-4f33-b460-fd8cae737828", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 12:30:24 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-0f43a8d7-e23d-4633-a5af-822d684a31d0 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Converting VIF {"id": "2c24e9ba-c6f7-4f33-b460-fd8cae737828", "address": "fa:16:3e:35:db:4f", "network": {"id": "f3af1635-bf8e-449d-baa0-fa3c2b96e435", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1573451770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b49249509b24a1bb7c97536ab9f1bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c24e9ba-c6", "ovs_interfaceid": "2c24e9ba-c6f7-4f33-b460-fd8cae737828", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 12:30:24 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-0f43a8d7-e23d-4633-a5af-822d684a31d0 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:35:db:4f,bridge_name='br-int',has_traffic_filtering=True,id=2c24e9ba-c6f7-4f33-b460-fd8cae737828,network=Network(f3af1635-bf8e-449d-baa0-fa3c2b96e435),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c24e9ba-c6') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 12:30:24 user nova-compute[74190]: DEBUG os_vif [None req-0f43a8d7-e23d-4633-a5af-822d684a31d0 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:db:4f,bridge_name='br-int',has_traffic_filtering=True,id=2c24e9ba-c6f7-4f33-b460-fd8cae737828,network=Network(f3af1635-bf8e-449d-baa0-fa3c2b96e435),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c24e9ba-c6') {{(pid=74190) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 12:30:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:30:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2c24e9ba-c6, bridge=br-int, if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:30:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:30:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:30:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:30:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=522de70d-5955-403e-939c-a993034b758a) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:30:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:30:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:30:24 user nova-compute[74190]: INFO os_vif [None req-0f43a8d7-e23d-4633-a5af-822d684a31d0 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:db:4f,bridge_name='br-int',has_traffic_filtering=True,id=2c24e9ba-c6f7-4f33-b460-fd8cae737828,network=Network(f3af1635-bf8e-449d-baa0-fa3c2b96e435),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c24e9ba-c6')
Oct 18 12:30:24 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-0f43a8d7-e23d-4633-a5af-822d684a31d0 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Deleting instance files /opt/stack/data/nova/instances/42f93716-a9ca-4615-bd2c-f49bd15355d0_del
Oct 18 12:30:24 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-0f43a8d7-e23d-4633-a5af-822d684a31d0 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Deletion of /opt/stack/data/nova/instances/42f93716-a9ca-4615-bd2c-f49bd15355d0_del complete
Oct 18 12:30:24 user nova-compute[74190]: INFO nova.compute.manager [None req-0f43a8d7-e23d-4633-a5af-822d684a31d0 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Took 0.84 seconds to destroy the instance on the hypervisor.
Oct 18 12:30:24 user nova-compute[74190]: DEBUG oslo.service.loopingcall [None req-0f43a8d7-e23d-4633-a5af-822d684a31d0 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74190) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 12:30:24 user nova-compute[74190]: DEBUG nova.compute.manager [-] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Deallocating network for instance {{(pid=74190) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 12:30:24 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] deallocate_for_instance() {{(pid=74190) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 12:30:25 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:30:25 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Updating instance_info_cache with network_info: [] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:30:25 user nova-compute[74190]: INFO nova.compute.manager [-] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Took 0.52 seconds to deallocate network for instance.
Oct 18 12:30:25 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-0f43a8d7-e23d-4633-a5af-822d684a31d0 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:30:25 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-0f43a8d7-e23d-4633-a5af-822d684a31d0 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:30:25 user nova-compute[74190]: DEBUG nova.compute.manager [req-2c52f2c2-fb39-4ea2-b834-ef7a6a42ef41 req-28937e3a-92df-4d11-a222-b7a3e8f134d5 service nova] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Received event network-vif-deleted-2c24e9ba-c6f7-4f33-b460-fd8cae737828 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:30:25 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-0f43a8d7-e23d-4633-a5af-822d684a31d0 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 12:30:25 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-0f43a8d7-e23d-4633-a5af-822d684a31d0 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 12:30:25 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-0f43a8d7-e23d-4633-a5af-822d684a31d0 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.116s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:30:25 user nova-compute[74190]: INFO nova.scheduler.client.report [None req-0f43a8d7-e23d-4633-a5af-822d684a31d0 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Deleted allocations for instance 42f93716-a9ca-4615-bd2c-f49bd15355d0
Oct 18 12:30:25 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-0f43a8d7-e23d-4633-a5af-822d684a31d0 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Lock "42f93716-a9ca-4615-bd2c-f49bd15355d0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.673s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:30:26 user nova-compute[74190]: DEBUG nova.compute.manager [req-3a90b8fd-a0fc-4237-91e8-870074619fcf req-f58e3262-917f-4177-93d5-c0ec0bc0d517 service nova] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Received event network-vif-plugged-2c24e9ba-c6f7-4f33-b460-fd8cae737828 {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:30:26 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-3a90b8fd-a0fc-4237-91e8-870074619fcf req-f58e3262-917f-4177-93d5-c0ec0bc0d517 service nova] Acquiring lock "42f93716-a9ca-4615-bd2c-f49bd15355d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:30:26 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-3a90b8fd-a0fc-4237-91e8-870074619fcf req-f58e3262-917f-4177-93d5-c0ec0bc0d517 service nova] Lock "42f93716-a9ca-4615-bd2c-f49bd15355d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:30:26 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-3a90b8fd-a0fc-4237-91e8-870074619fcf req-f58e3262-917f-4177-93d5-c0ec0bc0d517 service nova] Lock "42f93716-a9ca-4615-bd2c-f49bd15355d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:30:26 user nova-compute[74190]: DEBUG nova.compute.manager [req-3a90b8fd-a0fc-4237-91e8-870074619fcf req-f58e3262-917f-4177-93d5-c0ec0bc0d517 service nova] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] No waiting events found dispatching network-vif-plugged-2c24e9ba-c6f7-4f33-b460-fd8cae737828 {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:30:26 user nova-compute[74190]: WARNING nova.compute.manager [req-3a90b8fd-a0fc-4237-91e8-870074619fcf req-f58e3262-917f-4177-93d5-c0ec0bc0d517 service nova] [instance: 42f93716-a9ca-4615-bd2c-f49bd15355d0] Received unexpected event network-vif-plugged-2c24e9ba-c6f7-4f33-b460-fd8cae737828 for instance with vm_state deleted and task_state None.
Oct 18 12:30:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:30:31 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:30:33 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:30:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:30:38 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:30:39 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:30:40 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:30:40 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:30:40 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:30:40 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:30:40 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Auditing locally available compute resources for user (node: user) {{(pid=74190) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 12:30:40 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:30:40 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:30:40 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Hypervisor/Node resource view: name=user free_ram=9104MB free_disk=25.15052032470703GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74190) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 12:30:40 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:30:40 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:30:40 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 12:30:40 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 12:30:40 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 12:30:40 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 12:30:40 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Compute_service record updated for user:user {{(pid=74190) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 12:30:40 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.144s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:30:41 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:30:41 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Starting heal instance info cache {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 12:30:41 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Rebuilding the list of instances to heal {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 18 12:30:41 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Didn't find any instances for network info cache update. {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 18 12:30:41 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:30:41 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:30:44 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:30:44 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74190) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 12:30:44 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:30:49 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:30:54 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:30:59 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:31:04 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:31:09 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:31:09 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:31:09 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74190) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 12:31:09 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:31:09 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:31:09 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:31:14 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:31:17 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Acquiring lock "1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:31:17 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Lock "1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:31:17 user nova-compute[74190]: DEBUG nova.compute.manager [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Starting instance... {{(pid=74190) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 18 12:31:17 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:31:17 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:31:18 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74190) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 18 12:31:18 user nova-compute[74190]: INFO nova.compute.claims [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Claim successful on node user
Oct 18 12:31:18 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 12:31:18 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 12:31:18 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.206s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:31:18 user nova-compute[74190]: DEBUG nova.compute.manager [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Start building networks asynchronously for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 18 12:31:18 user nova-compute[74190]: DEBUG nova.compute.manager [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Allocating IP information in the background. {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 18 12:31:18 user nova-compute[74190]: DEBUG nova.network.neutron [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] allocate_for_instance() {{(pid=74190) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 18 12:31:18 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 18 12:31:18 user nova-compute[74190]: DEBUG nova.compute.manager [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Start building block device mappings for instance. {{(pid=74190) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 18 12:31:18 user nova-compute[74190]: DEBUG nova.policy [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '308413c6fcfa4ac1b73916bc81e46851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b49249509b24a1bb7c97536ab9f1bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74190) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 18 12:31:18 user nova-compute[74190]: DEBUG nova.compute.manager [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Start spawning the instance on the hypervisor. {{(pid=74190) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 18 12:31:18 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Creating instance directory {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 18 12:31:18 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Creating image(s)
Oct 18 12:31:18 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Acquiring lock "/opt/stack/data/nova/instances/1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:31:18 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Lock "/opt/stack/data/nova/instances/1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:31:18 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Lock "/opt/stack/data/nova/instances/1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:31:18 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Acquiring lock "0b7ae1d3d87f2f90ab533330e8b67aaabfafa077" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:31:18 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Lock "0b7ae1d3d87f2f90ab533330e8b67aaabfafa077" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:31:18 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0b7ae1d3d87f2f90ab533330e8b67aaabfafa077.part --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:31:19 user nova-compute[74190]: DEBUG nova.network.neutron [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Successfully created port: e1de485e-b105-42fd-a9f5-2467bf5404ce {{(pid=74190) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 18 12:31:19 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0b7ae1d3d87f2f90ab533330e8b67aaabfafa077.part --force-share --output=json" returned: 0 in 0.181s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:31:19 user nova-compute[74190]: DEBUG nova.virt.images [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] 0174a52f-5fe9-4a6e-91d4-2a5ef6f7d9b6 was qcow2, converting to raw {{(pid=74190) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 18 12:31:19 user nova-compute[74190]: DEBUG nova.privsep.utils [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74190) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 18 12:31:19 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0b7ae1d3d87f2f90ab533330e8b67aaabfafa077.part /opt/stack/data/nova/instances/_base/0b7ae1d3d87f2f90ab533330e8b67aaabfafa077.converted {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:31:19 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0b7ae1d3d87f2f90ab533330e8b67aaabfafa077.part /opt/stack/data/nova/instances/_base/0b7ae1d3d87f2f90ab533330e8b67aaabfafa077.converted" returned: 0 in 0.283s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:31:19 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0b7ae1d3d87f2f90ab533330e8b67aaabfafa077.converted --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:31:19 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0b7ae1d3d87f2f90ab533330e8b67aaabfafa077.converted --force-share --output=json" returned: 0 in 0.175s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:31:19 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Lock "0b7ae1d3d87f2f90ab533330e8b67aaabfafa077" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.170s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:31:19 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0b7ae1d3d87f2f90ab533330e8b67aaabfafa077 --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:31:19 user nova-compute[74190]: DEBUG nova.network.neutron [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Successfully updated port: e1de485e-b105-42fd-a9f5-2467bf5404ce {{(pid=74190) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 18 12:31:19 user nova-compute[74190]: DEBUG nova.compute.manager [req-bbfc92fa-7561-4062-8130-b0222ec2ebbc req-0b35c13b-8e3f-4cfd-a8af-b423b69108fd service nova] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Received event network-changed-e1de485e-b105-42fd-a9f5-2467bf5404ce {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:31:19 user nova-compute[74190]: DEBUG nova.compute.manager [req-bbfc92fa-7561-4062-8130-b0222ec2ebbc req-0b35c13b-8e3f-4cfd-a8af-b423b69108fd service nova] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Refreshing instance network info cache due to event network-changed-e1de485e-b105-42fd-a9f5-2467bf5404ce. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 12:31:19 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-bbfc92fa-7561-4062-8130-b0222ec2ebbc req-0b35c13b-8e3f-4cfd-a8af-b423b69108fd service nova] Acquiring lock "refresh_cache-1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:31:19 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-bbfc92fa-7561-4062-8130-b0222ec2ebbc req-0b35c13b-8e3f-4cfd-a8af-b423b69108fd service nova] Acquired lock "refresh_cache-1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:31:19 user nova-compute[74190]: DEBUG nova.network.neutron [req-bbfc92fa-7561-4062-8130-b0222ec2ebbc req-0b35c13b-8e3f-4cfd-a8af-b423b69108fd service nova] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Refreshing network info cache for port e1de485e-b105-42fd-a9f5-2467bf5404ce {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 12:31:19 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Acquiring lock "refresh_cache-1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:31:19 user nova-compute[74190]: DEBUG nova.network.neutron [req-bbfc92fa-7561-4062-8130-b0222ec2ebbc req-0b35c13b-8e3f-4cfd-a8af-b423b69108fd service nova] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Instance cache missing network info. {{(pid=74190) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 12:31:19 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:31:19 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0b7ae1d3d87f2f90ab533330e8b67aaabfafa077 --force-share --output=json" returned: 0 in 0.296s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:31:19 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Acquiring lock "0b7ae1d3d87f2f90ab533330e8b67aaabfafa077" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:31:19 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Lock "0b7ae1d3d87f2f90ab533330e8b67aaabfafa077" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:31:19 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0b7ae1d3d87f2f90ab533330e8b67aaabfafa077 --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:31:20 user nova-compute[74190]: DEBUG nova.network.neutron [req-bbfc92fa-7561-4062-8130-b0222ec2ebbc req-0b35c13b-8e3f-4cfd-a8af-b423b69108fd service nova] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Updating instance_info_cache with network_info: [] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:31:20 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-bbfc92fa-7561-4062-8130-b0222ec2ebbc req-0b35c13b-8e3f-4cfd-a8af-b423b69108fd service nova] Releasing lock "refresh_cache-1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:31:20 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Acquired lock "refresh_cache-1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:31:20 user nova-compute[74190]: DEBUG nova.network.neutron [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Building network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 12:31:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0b7ae1d3d87f2f90ab533330e8b67aaabfafa077 --force-share --output=json" returned: 0 in 0.172s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:31:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0b7ae1d3d87f2f90ab533330e8b67aaabfafa077,backing_fmt=raw /opt/stack/data/nova/instances/1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8/disk 1073741824 {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:31:20 user nova-compute[74190]: DEBUG nova.network.neutron [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Instance cache missing network info. {{(pid=74190) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 18 12:31:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0b7ae1d3d87f2f90ab533330e8b67aaabfafa077,backing_fmt=raw /opt/stack/data/nova/instances/1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8/disk 1073741824" returned: 0 in 0.056s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:31:20 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Lock "0b7ae1d3d87f2f90ab533330e8b67aaabfafa077" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:31:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0b7ae1d3d87f2f90ab533330e8b67aaabfafa077 --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:31:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0b7ae1d3d87f2f90ab533330e8b67aaabfafa077 --force-share --output=json" returned: 0 in 0.171s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:31:20 user nova-compute[74190]: DEBUG nova.virt.disk.api [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8/disk. size=1073741824 {{(pid=74190) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 18 12:31:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:31:20 user nova-compute[74190]: DEBUG nova.network.neutron [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Updating instance_info_cache with network_info: [{"id": "e1de485e-b105-42fd-a9f5-2467bf5404ce", "address": "fa:16:3e:33:c0:1e", "network": {"id": "f3af1635-bf8e-449d-baa0-fa3c2b96e435", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1573451770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b49249509b24a1bb7c97536ab9f1bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1de485e-b1", "ovs_interfaceid": "e1de485e-b105-42fd-a9f5-2467bf5404ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:31:20 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Releasing lock "refresh_cache-1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:31:20 user nova-compute[74190]: DEBUG nova.compute.manager [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Instance network_info: |[{"id": "e1de485e-b105-42fd-a9f5-2467bf5404ce", "address": "fa:16:3e:33:c0:1e", "network": {"id": "f3af1635-bf8e-449d-baa0-fa3c2b96e435", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1573451770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b49249509b24a1bb7c97536ab9f1bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1de485e-b1", "ovs_interfaceid": "e1de485e-b105-42fd-a9f5-2467bf5404ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74190) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 18 12:31:20 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:31:20 user nova-compute[74190]: DEBUG nova.virt.disk.api [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Cannot resize image /opt/stack/data/nova/instances/1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8/disk to a smaller size. {{(pid=74190) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 18 12:31:20 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Created local disks {{(pid=74190) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 18 12:31:20 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Ensure instance console log exists: /opt/stack/data/nova/instances/1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8/console.log {{(pid=74190) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 18 12:31:20 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:31:20 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:31:20 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:31:20 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Start _get_guest_xml network_info=[{"id": "e1de485e-b105-42fd-a9f5-2467bf5404ce", "address": "fa:16:3e:33:c0:1e", "network": {"id": "f3af1635-bf8e-449d-baa0-fa3c2b96e435", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1573451770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b49249509b24a1bb7c97536ab9f1bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1de485e-b1", "ovs_interfaceid": "e1de485e-b105-42fd-a9f5-2467bf5404ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T12:31:15Z,direct_url=<?>,disk_format='qcow2',id=0174a52f-5fe9-4a6e-91d4-2a5ef6f7d9b6,min_disk=0,min_ram=0,name='tempest-scenario-img--818654699',owner='0b49249509b24a1bb7c97536ab9f1bfe',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T12:31:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'device_name': '/dev/vda', 'image_id': '0174a52f-5fe9-4a6e-91d4-2a5ef6f7d9b6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 18 12:31:20 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:31:20 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:31:20 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 18 12:31:20 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] CPU controller missing on host. {{(pid=74190) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 18 12:31:20 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 18 12:31:20 user nova-compute[74190]: DEBUG nova.virt.libvirt.host [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] CPU controller found on host. {{(pid=74190) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 18 12:31:20 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74190) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 18 12:31:20 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-18T11:37:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-18T12:31:15Z,direct_url=<?>,disk_format='qcow2',id=0174a52f-5fe9-4a6e-91d4-2a5ef6f7d9b6,min_disk=0,min_ram=0,name='tempest-scenario-img--818654699',owner='0b49249509b24a1bb7c97536ab9f1bfe',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-18T12:31:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 18 12:31:20 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Flavor limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 18 12:31:20 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Image limits 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 18 12:31:20 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Flavor pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 18 12:31:20 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Image pref 0:0:0 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 18 12:31:20 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74190) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 18 12:31:20 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 18 12:31:20 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 18 12:31:20 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Got 1 possible topologies {{(pid=74190) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 18 12:31:20 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 18 12:31:20 user nova-compute[74190]: DEBUG nova.virt.hardware [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74190) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 18 12:31:20 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T12:31:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-411330141',display_name='tempest-TestMinimumBasicScenario-server-411330141',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-411330141',id=52,image_ref='0174a52f-5fe9-4a6e-91d4-2a5ef6f7d9b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBDkEwHbutvSIMj64xprni6Zt3kZAQO6t9skxUSOAqLQGwPiuGauu95K7v8O+XTSAauWWftIdBKPXXVbC62Rgbug0SEnVQGojhPr5vv/kRiZswkRnkf3tL9exZeLKd/5rg==',key_name='tempest-TestMinimumBasicScenario-98070653',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b49249509b24a1bb7c97536ab9f1bfe',ramdisk_id='',reservation_id='r-d8ajhthf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0174a52f-5fe9-4a6e-91d4-2a5ef6f7d9b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-285966464',owner_user_name='tempest-TestMinimumBasicScenario-285966464-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T12:31:18Z,user_data=None,user_id='308413c6fcfa4ac1b73916bc81e46851',uuid=1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e1de485e-b105-42fd-a9f5-2467bf5404ce", "address": "fa:16:3e:33:c0:1e", "network": {"id": "f3af1635-bf8e-449d-baa0-fa3c2b96e435", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1573451770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b49249509b24a1bb7c97536ab9f1bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1de485e-b1", "ovs_interfaceid": "e1de485e-b105-42fd-a9f5-2467bf5404ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74190) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 18 12:31:20 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Converting VIF {"id": "e1de485e-b105-42fd-a9f5-2467bf5404ce", "address": "fa:16:3e:33:c0:1e", "network": {"id": "f3af1635-bf8e-449d-baa0-fa3c2b96e435", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1573451770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b49249509b24a1bb7c97536ab9f1bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1de485e-b1", "ovs_interfaceid": "e1de485e-b105-42fd-a9f5-2467bf5404ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 12:31:20 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:c0:1e,bridge_name='br-int',has_traffic_filtering=True,id=e1de485e-b105-42fd-a9f5-2467bf5404ce,network=Network(f3af1635-bf8e-449d-baa0-fa3c2b96e435),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1de485e-b1') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 12:31:20 user nova-compute[74190]: DEBUG nova.objects.instance [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Lazy-loading 'pci_devices' on Instance uuid 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:31:20 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] End _get_guest_xml xml=<domain type="kvm">
Oct 18 12:31:20 user nova-compute[74190]:   <uuid>1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8</uuid>
Oct 18 12:31:20 user nova-compute[74190]:   <name>instance-00000034</name>
Oct 18 12:31:20 user nova-compute[74190]:   <memory>524288</memory>
Oct 18 12:31:20 user nova-compute[74190]:   <vcpu>1</vcpu>
Oct 18 12:31:20 user nova-compute[74190]:   <metadata>
Oct 18 12:31:20 user nova-compute[74190]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 18 12:31:20 user nova-compute[74190]:       <nova:package version="0.0.0"/>
Oct 18 12:31:20 user nova-compute[74190]:       <nova:name>tempest-TestMinimumBasicScenario-server-411330141</nova:name>
Oct 18 12:31:20 user nova-compute[74190]:       <nova:creationTime>2023-10-18 12:31:20</nova:creationTime>
Oct 18 12:31:20 user nova-compute[74190]:       <nova:flavor name="m1.tiny">
Oct 18 12:31:20 user nova-compute[74190]:         <nova:memory>512</nova:memory>
Oct 18 12:31:20 user nova-compute[74190]:         <nova:disk>1</nova:disk>
Oct 18 12:31:20 user nova-compute[74190]:         <nova:swap>0</nova:swap>
Oct 18 12:31:20 user nova-compute[74190]:         <nova:ephemeral>0</nova:ephemeral>
Oct 18 12:31:20 user nova-compute[74190]:         <nova:vcpus>1</nova:vcpus>
Oct 18 12:31:20 user nova-compute[74190]:       </nova:flavor>
Oct 18 12:31:20 user nova-compute[74190]:       <nova:owner>
Oct 18 12:31:20 user nova-compute[74190]:         <nova:user uuid="308413c6fcfa4ac1b73916bc81e46851">tempest-TestMinimumBasicScenario-285966464-project-member</nova:user>
Oct 18 12:31:20 user nova-compute[74190]:         <nova:project uuid="0b49249509b24a1bb7c97536ab9f1bfe">tempest-TestMinimumBasicScenario-285966464</nova:project>
Oct 18 12:31:20 user nova-compute[74190]:       </nova:owner>
Oct 18 12:31:20 user nova-compute[74190]:       <nova:root type="image" uuid="0174a52f-5fe9-4a6e-91d4-2a5ef6f7d9b6"/>
Oct 18 12:31:20 user nova-compute[74190]:       <nova:ports>
Oct 18 12:31:20 user nova-compute[74190]:         <nova:port uuid="e1de485e-b105-42fd-a9f5-2467bf5404ce">
Oct 18 12:31:20 user nova-compute[74190]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 18 12:31:20 user nova-compute[74190]:         </nova:port>
Oct 18 12:31:20 user nova-compute[74190]:       </nova:ports>
Oct 18 12:31:20 user nova-compute[74190]:     </nova:instance>
Oct 18 12:31:20 user nova-compute[74190]:   </metadata>
Oct 18 12:31:20 user nova-compute[74190]:   <sysinfo type="smbios">
Oct 18 12:31:20 user nova-compute[74190]:     <system>
Oct 18 12:31:20 user nova-compute[74190]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 18 12:31:20 user nova-compute[74190]:       <entry name="product">OpenStack Nova</entry>
Oct 18 12:31:20 user nova-compute[74190]:       <entry name="version">0.0.0</entry>
Oct 18 12:31:20 user nova-compute[74190]:       <entry name="serial">1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8</entry>
Oct 18 12:31:20 user nova-compute[74190]:       <entry name="uuid">1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8</entry>
Oct 18 12:31:20 user nova-compute[74190]:       <entry name="family">Virtual Machine</entry>
Oct 18 12:31:20 user nova-compute[74190]:     </system>
Oct 18 12:31:20 user nova-compute[74190]:   </sysinfo>
Oct 18 12:31:20 user nova-compute[74190]:   <os>
Oct 18 12:31:20 user nova-compute[74190]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 18 12:31:20 user nova-compute[74190]:     <boot dev="hd"/>
Oct 18 12:31:20 user nova-compute[74190]:     <smbios mode="sysinfo"/>
Oct 18 12:31:20 user nova-compute[74190]:   </os>
Oct 18 12:31:20 user nova-compute[74190]:   <features>
Oct 18 12:31:20 user nova-compute[74190]:     <acpi/>
Oct 18 12:31:20 user nova-compute[74190]:     <apic/>
Oct 18 12:31:20 user nova-compute[74190]:     <vmcoreinfo/>
Oct 18 12:31:20 user nova-compute[74190]:   </features>
Oct 18 12:31:20 user nova-compute[74190]:   <clock offset="utc">
Oct 18 12:31:20 user nova-compute[74190]:     <timer name="pit" tickpolicy="delay"/>
Oct 18 12:31:20 user nova-compute[74190]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 18 12:31:20 user nova-compute[74190]:     <timer name="hpet" present="no"/>
Oct 18 12:31:20 user nova-compute[74190]:   </clock>
Oct 18 12:31:20 user nova-compute[74190]:   <cpu mode="custom" match="exact">
Oct 18 12:31:20 user nova-compute[74190]:     <model>Nehalem</model>
Oct 18 12:31:20 user nova-compute[74190]:     <topology sockets="1" cores="1" threads="1"/>
Oct 18 12:31:20 user nova-compute[74190]:   </cpu>
Oct 18 12:31:20 user nova-compute[74190]:   <devices>
Oct 18 12:31:20 user nova-compute[74190]:     <disk type="file" device="disk">
Oct 18 12:31:20 user nova-compute[74190]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 18 12:31:20 user nova-compute[74190]:       <source file="/opt/stack/data/nova/instances/1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8/disk"/>
Oct 18 12:31:20 user nova-compute[74190]:       <target dev="vda" bus="virtio"/>
Oct 18 12:31:20 user nova-compute[74190]:     </disk>
Oct 18 12:31:20 user nova-compute[74190]:     <interface type="ethernet">
Oct 18 12:31:20 user nova-compute[74190]:       <mac address="fa:16:3e:33:c0:1e"/>
Oct 18 12:31:20 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 12:31:20 user nova-compute[74190]:       <mtu size="1442"/>
Oct 18 12:31:20 user nova-compute[74190]:       <target dev="tape1de485e-b1"/>
Oct 18 12:31:20 user nova-compute[74190]:     </interface>
Oct 18 12:31:20 user nova-compute[74190]:     <serial type="pty">
Oct 18 12:31:20 user nova-compute[74190]:       <log file="/opt/stack/data/nova/instances/1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8/console.log" append="off"/>
Oct 18 12:31:20 user nova-compute[74190]:     </serial>
Oct 18 12:31:20 user nova-compute[74190]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 18 12:31:20 user nova-compute[74190]:     <video>
Oct 18 12:31:20 user nova-compute[74190]:       <model type="virtio"/>
Oct 18 12:31:20 user nova-compute[74190]:     </video>
Oct 18 12:31:20 user nova-compute[74190]:     <rng model="virtio">
Oct 18 12:31:20 user nova-compute[74190]:       <backend model="random">/dev/urandom</backend>
Oct 18 12:31:20 user nova-compute[74190]:     </rng>
Oct 18 12:31:20 user nova-compute[74190]:     <controller type="usb" index="0" model="none"/>
Oct 18 12:31:20 user nova-compute[74190]:     <memballoon model="virtio">
Oct 18 12:31:20 user nova-compute[74190]:       <stats period="10"/>
Oct 18 12:31:20 user nova-compute[74190]:     </memballoon>
Oct 18 12:31:20 user nova-compute[74190]:   </devices>
Oct 18 12:31:20 user nova-compute[74190]: </domain>
Oct 18 12:31:20 user nova-compute[74190]:  {{(pid=74190) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 18 12:31:20 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T12:31:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-411330141',display_name='tempest-TestMinimumBasicScenario-server-411330141',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-411330141',id=52,image_ref='0174a52f-5fe9-4a6e-91d4-2a5ef6f7d9b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBDkEwHbutvSIMj64xprni6Zt3kZAQO6t9skxUSOAqLQGwPiuGauu95K7v8O+XTSAauWWftIdBKPXXVbC62Rgbug0SEnVQGojhPr5vv/kRiZswkRnkf3tL9exZeLKd/5rg==',key_name='tempest-TestMinimumBasicScenario-98070653',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b49249509b24a1bb7c97536ab9f1bfe',ramdisk_id='',reservation_id='r-d8ajhthf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0174a52f-5fe9-4a6e-91d4-2a5ef6f7d9b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-285966464',owner_user_name='tempest-TestMinimumBasicScenario-285966464-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-18T12:31:18Z,user_data=None,user_id='308413c6fcfa4ac1b73916bc81e46851',uuid=1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e1de485e-b105-42fd-a9f5-2467bf5404ce", "address": "fa:16:3e:33:c0:1e", "network": {"id": "f3af1635-bf8e-449d-baa0-fa3c2b96e435", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1573451770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b49249509b24a1bb7c97536ab9f1bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1de485e-b1", "ovs_interfaceid": "e1de485e-b105-42fd-a9f5-2467bf5404ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 18 12:31:20 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Converting VIF {"id": "e1de485e-b105-42fd-a9f5-2467bf5404ce", "address": "fa:16:3e:33:c0:1e", "network": {"id": "f3af1635-bf8e-449d-baa0-fa3c2b96e435", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1573451770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b49249509b24a1bb7c97536ab9f1bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1de485e-b1", "ovs_interfaceid": "e1de485e-b105-42fd-a9f5-2467bf5404ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 12:31:20 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:c0:1e,bridge_name='br-int',has_traffic_filtering=True,id=e1de485e-b105-42fd-a9f5-2467bf5404ce,network=Network(f3af1635-bf8e-449d-baa0-fa3c2b96e435),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1de485e-b1') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 12:31:20 user nova-compute[74190]: DEBUG os_vif [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:c0:1e,bridge_name='br-int',has_traffic_filtering=True,id=e1de485e-b105-42fd-a9f5-2467bf5404ce,network=Network(f3af1635-bf8e-449d-baa0-fa3c2b96e435),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1de485e-b1') {{(pid=74190) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 18 12:31:20 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:31:20 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:31:20 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 18 12:31:20 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:31:20 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e323767c-cef6-5840-b29d-533da438bf13', '_type': 'linux-noop'}}, row=False) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:31:20 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:31:20 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:31:20 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape1de485e-b1, may_exist=True, interface_attrs={}) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:31:20 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape1de485e-b1, col_values=(('qos', UUID('43c4e797-2645-4bc0-b895-feb98461d13c')),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:31:20 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape1de485e-b1, col_values=(('external_ids', {'iface-id': 'e1de485e-b105-42fd-a9f5-2467bf5404ce', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:33:c0:1e', 'vm-uuid': '1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8'}),), if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:31:20 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:31:20 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:31:20 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:31:20 user nova-compute[74190]: INFO os_vif [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:c0:1e,bridge_name='br-int',has_traffic_filtering=True,id=e1de485e-b105-42fd-a9f5-2467bf5404ce,network=Network(f3af1635-bf8e-449d-baa0-fa3c2b96e435),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1de485e-b1')
Oct 18 12:31:20 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] No BDM found with device name vda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 12:31:20 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] No VIF found with MAC fa:16:3e:33:c0:1e, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 12:31:21 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:31:21 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:31:21 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:31:21 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:31:22 user nova-compute[74190]: DEBUG nova.compute.manager [req-d161566f-9ce6-4a42-b1fa-6fa836d23281 req-9b55f4ed-c88b-4f57-90bf-c17c4d3c58af service nova] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Received event network-vif-plugged-e1de485e-b105-42fd-a9f5-2467bf5404ce {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:31:22 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d161566f-9ce6-4a42-b1fa-6fa836d23281 req-9b55f4ed-c88b-4f57-90bf-c17c4d3c58af service nova] Acquiring lock "1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:31:22 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d161566f-9ce6-4a42-b1fa-6fa836d23281 req-9b55f4ed-c88b-4f57-90bf-c17c4d3c58af service nova] Lock "1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:31:22 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-d161566f-9ce6-4a42-b1fa-6fa836d23281 req-9b55f4ed-c88b-4f57-90bf-c17c4d3c58af service nova] Lock "1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:31:22 user nova-compute[74190]: DEBUG nova.compute.manager [req-d161566f-9ce6-4a42-b1fa-6fa836d23281 req-9b55f4ed-c88b-4f57-90bf-c17c4d3c58af service nova] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] No waiting events found dispatching network-vif-plugged-e1de485e-b105-42fd-a9f5-2467bf5404ce {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:31:22 user nova-compute[74190]: WARNING nova.compute.manager [req-d161566f-9ce6-4a42-b1fa-6fa836d23281 req-9b55f4ed-c88b-4f57-90bf-c17c4d3c58af service nova] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Received unexpected event network-vif-plugged-e1de485e-b105-42fd-a9f5-2467bf5404ce for instance with vm_state building and task_state spawning.
Oct 18 12:31:22 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:31:22 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:31:22 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:31:22 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:31:22 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:31:23 user nova-compute[74190]: DEBUG nova.compute.manager [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Instance event wait completed in 0 seconds for  {{(pid=74190) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 18 12:31:23 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Guest created on hypervisor {{(pid=74190) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 18 12:31:23 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Instance spawned successfully.
Oct 18 12:31:23 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 18 12:31:24 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Found default for hw_cdrom_bus of ide {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:31:24 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Found default for hw_disk_bus of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:31:24 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Found default for hw_input_bus of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:31:24 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Found default for hw_pointer_model of None {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:31:24 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Found default for hw_video_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:31:24 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Found default for hw_vif_model of virtio {{(pid=74190) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 18 12:31:24 user nova-compute[74190]: INFO nova.compute.manager [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Took 5.65 seconds to spawn the instance on the hypervisor.
Oct 18 12:31:24 user nova-compute[74190]: DEBUG nova.compute.manager [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Checking state {{(pid=74190) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 12:31:24 user nova-compute[74190]: DEBUG nova.compute.manager [req-b9a2832a-0c7c-483f-a458-c28a98dad2f4 req-f1fad50b-71d8-4d4a-9424-a1b0bdbaa7a0 service nova] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Received event network-vif-plugged-e1de485e-b105-42fd-a9f5-2467bf5404ce {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:31:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-b9a2832a-0c7c-483f-a458-c28a98dad2f4 req-f1fad50b-71d8-4d4a-9424-a1b0bdbaa7a0 service nova] Acquiring lock "1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:31:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-b9a2832a-0c7c-483f-a458-c28a98dad2f4 req-f1fad50b-71d8-4d4a-9424-a1b0bdbaa7a0 service nova] Lock "1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:31:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-b9a2832a-0c7c-483f-a458-c28a98dad2f4 req-f1fad50b-71d8-4d4a-9424-a1b0bdbaa7a0 service nova] Lock "1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:31:24 user nova-compute[74190]: DEBUG nova.compute.manager [req-b9a2832a-0c7c-483f-a458-c28a98dad2f4 req-f1fad50b-71d8-4d4a-9424-a1b0bdbaa7a0 service nova] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] No waiting events found dispatching network-vif-plugged-e1de485e-b105-42fd-a9f5-2467bf5404ce {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:31:24 user nova-compute[74190]: WARNING nova.compute.manager [req-b9a2832a-0c7c-483f-a458-c28a98dad2f4 req-f1fad50b-71d8-4d4a-9424-a1b0bdbaa7a0 service nova] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Received unexpected event network-vif-plugged-e1de485e-b105-42fd-a9f5-2467bf5404ce for instance with vm_state building and task_state spawning.
Oct 18 12:31:24 user nova-compute[74190]: INFO nova.compute.manager [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Took 6.20 seconds to build instance.
Oct 18 12:31:24 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-9a4ed93c-e4fa-4cb2-9aae-157e993e8883 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Lock "1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.311s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:31:25 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:31:25 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:31:26 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:31:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:31:32 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:31:35 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:31:35 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:31:39 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:31:40 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:31:40 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:31:40 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74190) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 12:31:40 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:31:40 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:31:40 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:31:40 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:31:41 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:31:41 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Starting heal instance info cache {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 12:31:41 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Rebuilding the list of instances to heal {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 18 12:31:41 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "refresh_cache-1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:31:41 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquired lock "refresh_cache-1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:31:41 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Forcefully refreshing network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 18 12:31:41 user nova-compute[74190]: DEBUG nova.objects.instance [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lazy-loading 'info_cache' on Instance uuid 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:31:41 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Updating instance_info_cache with network_info: [{"id": "e1de485e-b105-42fd-a9f5-2467bf5404ce", "address": "fa:16:3e:33:c0:1e", "network": {"id": "f3af1635-bf8e-449d-baa0-fa3c2b96e435", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1573451770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b49249509b24a1bb7c97536ab9f1bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1de485e-b1", "ovs_interfaceid": "e1de485e-b105-42fd-a9f5-2467bf5404ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:31:41 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Releasing lock "refresh_cache-1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:31:41 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Updated the network info_cache for instance {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 18 12:31:42 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:31:42 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:31:42 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:31:42 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:31:42 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:31:42 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:31:42 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Auditing locally available compute resources for user (node: user) {{(pid=74190) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 12:31:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:31:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:31:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:31:42 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:31:42 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:31:42 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:31:42 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Hypervisor/Node resource view: name=user free_ram=8883MB free_disk=25.093875885009766GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74190) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 12:31:42 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:31:42 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:31:42 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:31:42 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 12:31:42 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 12:31:43 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 12:31:43 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 12:31:43 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Compute_service record updated for user:user {{(pid=74190) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 12:31:43 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.213s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:31:45 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:31:45 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74190) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 12:31:45 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:31:45 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:31:50 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:31:50 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:31:54 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:31:55 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:31:55 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:32:00 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:32:05 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:32:10 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:32:15 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:32:15 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:32:15 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74190) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 12:32:15 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:32:15 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:32:15 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:32:20 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:32:20 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:32:20 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74190) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 12:32:20 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:32:20 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:32:20 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:32:25 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:32:25 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:32:25 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74190) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 12:32:25 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:32:25 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:32:25 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:32:28 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:32:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:32:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:32:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74190) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 12:32:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:32:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:32:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:32:34 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:32:35 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:32:35 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:32:40 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:32:40 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:32:40 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:32:40 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74190) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 12:32:40 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:32:40 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:32:40 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:32:42 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:32:42 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Starting heal instance info cache {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 12:32:42 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Rebuilding the list of instances to heal {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 18 12:32:42 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "refresh_cache-1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:32:42 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquired lock "refresh_cache-1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:32:42 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Forcefully refreshing network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 18 12:32:42 user nova-compute[74190]: DEBUG nova.objects.instance [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lazy-loading 'info_cache' on Instance uuid 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:32:42 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Updating instance_info_cache with network_info: [{"id": "e1de485e-b105-42fd-a9f5-2467bf5404ce", "address": "fa:16:3e:33:c0:1e", "network": {"id": "f3af1635-bf8e-449d-baa0-fa3c2b96e435", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1573451770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b49249509b24a1bb7c97536ab9f1bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1de485e-b1", "ovs_interfaceid": "e1de485e-b105-42fd-a9f5-2467bf5404ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:32:42 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Releasing lock "refresh_cache-1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:32:42 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Updated the network info_cache for instance {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 18 12:32:42 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:32:43 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:32:44 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:32:44 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:32:44 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:32:44 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:32:44 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Auditing locally available compute resources for user (node: user) {{(pid=74190) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 12:32:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:32:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:32:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:32:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:32:44 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:32:44 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:32:44 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Hypervisor/Node resource view: name=user free_ram=8969MB free_disk=25.091617584228516GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74190) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 12:32:44 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:32:44 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:32:44 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:32:44 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 12:32:44 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 12:32:45 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 12:32:45 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 12:32:45 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Compute_service record updated for user:user {{(pid=74190) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 12:32:45 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.220s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:32:45 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:32:45 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74190) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 18 12:32:45 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:32:47 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:32:47 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74190) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 12:32:47 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:32:47 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Cleaning up deleted instances {{(pid=74190) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 18 12:32:47 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] There are 0 instances to clean {{(pid=74190) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 18 12:32:47 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:32:50 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:32:55 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:33:00 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:33:05 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:33:10 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:33:13 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-48cc30da-91bb-47be-aec8-0a1acc87267c tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Acquiring lock "1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:33:13 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-48cc30da-91bb-47be-aec8-0a1acc87267c tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Lock "1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:33:13 user nova-compute[74190]: DEBUG nova.objects.instance [None req-48cc30da-91bb-47be-aec8-0a1acc87267c tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Lazy-loading 'flavor' on Instance uuid 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:33:13 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-48cc30da-91bb-47be-aec8-0a1acc87267c tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Lock "1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:33:13 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-48cc30da-91bb-47be-aec8-0a1acc87267c tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Acquiring lock "1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:33:13 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-48cc30da-91bb-47be-aec8-0a1acc87267c tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Lock "1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:33:13 user nova-compute[74190]: INFO nova.compute.manager [None req-48cc30da-91bb-47be-aec8-0a1acc87267c tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Attaching volume 5bde0d97-278b-4412-a9d9-403aae577cfb to /dev/vdb
Oct 18 12:33:13 user nova-compute[74190]: DEBUG os_brick.utils [None req-48cc30da-91bb-47be-aec8-0a1acc87267c tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 12:33:13 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:33:13 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:33:13 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[516524f8-40bb-481e-b4a8-8b070158f70f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cff158e257e1\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:33:13 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:33:13 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:33:13 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd39602e-0c89-4362-9740-ef863725292f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:33:13 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:33:13 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:33:13 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[386fb6f8-8ba3-4455-90da-2dd6f7b6036b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:33:13 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[99818c7d-77b1-47fe-b7eb-84cca38c9d5d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:33:13 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-48cc30da-91bb-47be-aec8-0a1acc87267c tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Running cmd (subprocess): nvme version {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:33:13 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-48cc30da-91bb-47be-aec8-0a1acc87267c tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] 'nvme version' failed. Not Retrying. {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 12:33:13 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.nvmeof [None req-48cc30da-91bb-47be-aec8-0a1acc87267c tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] nvme not present on system {{(pid=74190) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 18 12:33:13 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:33:13 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 18 12:33:13 user nova-compute[74190]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 18 12:33:13 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fab8baa-c8e9-4c8b-82ae-f338cfc23fed]: (4, '') {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:33:14 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-48cc30da-91bb-47be-aec8-0a1acc87267c tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74190) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 18 12:33:14 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-48cc30da-91bb-47be-aec8-0a1acc87267c tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 18 12:33:14 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.lightos [None req-48cc30da-91bb-47be-aec8-0a1acc87267c tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] LIGHTOS: no hostnqn found. {{(pid=74190) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 18 12:33:14 user nova-compute[74190]: DEBUG os_brick.utils [None req-48cc30da-91bb-47be-aec8-0a1acc87267c tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cff158e257e1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 12:33:14 user nova-compute[74190]: DEBUG nova.virt.block_device [None req-48cc30da-91bb-47be-aec8-0a1acc87267c tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Updating existing volume attachment record: 37a89367-9562-441a-ab12-049c30c74841 {{(pid=74190) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 18 12:33:15 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:33:20 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:33:25 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:33:29 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:33:29 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48cc30da-91bb-47be-aec8-0a1acc87267c tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Calling os-brick to attach iSCSI Volume {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 18 12:33:29 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-48cc30da-91bb-47be-aec8-0a1acc87267c tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5bde0d97-278b-4412-a9d9-403aae577cfb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aslkYKAn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 12:33:29 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-48cc30da-91bb-47be-aec8-0a1acc87267c tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 12:33:29 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-48cc30da-91bb-47be-aec8-0a1acc87267c tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 12:33:29 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-48cc30da-91bb-47be-aec8-0a1acc87267c tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 12:33:29 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-48cc30da-91bb-47be-aec8-0a1acc87267c tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 12:33:29 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-48cc30da-91bb-47be-aec8-0a1acc87267c tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5bde0d97-278b-4412-a9d9-403aae577cfb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 12:33:29 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-48cc30da-91bb-47be-aec8-0a1acc87267c tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5bde0d97-278b-4412-a9d9-403aae577cfb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 12:33:29 user nova-compute[74190]: INFO os_brick.initiator.connectors.iscsi [None req-48cc30da-91bb-47be-aec8-0a1acc87267c tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 18 12:33:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bde0d97-278b-4412-a9d9-403aae577cfb -p 172.16.0.220:3260 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:33:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bde0d97-278b-4412-a9d9-403aae577cfb -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:33:29 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9dba6ee-d78c-49a4-bbbe-574bb4ddcdfd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:33:29 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-48cc30da-91bb-47be-aec8-0a1acc87267c tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 18 12:33:29 user nova-compute[74190]:  {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:33:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bde0d97-278b-4412-a9d9-403aae577cfb -p 172.16.0.220:3260 --interface default --op new {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:33:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bde0d97-278b-4412-a9d9-403aae577cfb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:33:29 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb0ef79-af21-4606-8335-fa484025262a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5bde0d97-278b-4412-a9d9-403aae577cfb] added\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:33:29 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-48cc30da-91bb-47be-aec8-0a1acc87267c tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5bde0d97-278b-4412-a9d9-403aae577cfb] added
Oct 18 12:33:29 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:33:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bde0d97-278b-4412-a9d9-403aae577cfb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:33:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bde0d97-278b-4412-a9d9-403aae577cfb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:33:29 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb8a33c-2a43-4263-a2cd-0cde000a03e9]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:33:29 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-48cc30da-91bb-47be-aec8-0a1acc87267c tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:33:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bde0d97-278b-4412-a9d9-403aae577cfb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:33:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bde0d97-278b-4412-a9d9-403aae577cfb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:33:29 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd66e3bb-bc67-4b55-9e41-6595f3f48cc1]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:33:29 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-48cc30da-91bb-47be-aec8-0a1acc87267c tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:33:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bde0d97-278b-4412-a9d9-403aae577cfb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aslkYKAn {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:33:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bde0d97-278b-4412-a9d9-403aae577cfb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aslkYKAn" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:33:29 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbfc9717-bcc0-4ba5-9e6a-47a7d34d1eba]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:33:29 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-48cc30da-91bb-47be-aec8-0a1acc87267c tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aslkYKAn'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:33:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bde0d97-278b-4412-a9d9-403aae577cfb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:33:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bde0d97-278b-4412-a9d9-403aae577cfb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:33:29 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ba316d-c011-48bb-acc6-6b147496dd68]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:33:29 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-48cc30da-91bb-47be-aec8-0a1acc87267c tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:33:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:33:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:33:29 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[990cf384-07cc-4918-bd07-d7c5a73776c0]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:33:29 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-48cc30da-91bb-47be-aec8-0a1acc87267c tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 18 12:33:29 user nova-compute[74190]:  {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 12:33:29 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-48cc30da-91bb-47be-aec8-0a1acc87267c tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 18 12:33:29 user nova-compute[74190]:  {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 12:33:29 user nova-compute[74190]: WARNING os_brick.initiator.connectors.iscsi [None req-48cc30da-91bb-47be-aec8-0a1acc87267c tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 18 12:33:29 user nova-compute[74190]: 
Oct 18 12:33:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bde0d97-278b-4412-a9d9-403aae577cfb -p 172.16.0.220:3260 --login {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:33:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bde0d97-278b-4412-a9d9-403aae577cfb -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:33:29 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[95226984-e48c-465a-83aa-dde7fde17254]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5bde0d97-278b-4412-a9d9-403aae577cfb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5bde0d97-278b-4412-a9d9-403aae577cfb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:33:29 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-48cc30da-91bb-47be-aec8-0a1acc87267c tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5bde0d97-278b-4412-a9d9-403aae577cfb, portal: 172.16.0.220,3260]
Oct 18 12:33:29 user nova-compute[74190]: Login to [iface: default, target: iqn.2010-10.org.openstack:5bde0d97-278b-4412-a9d9-403aae577cfb, portal: 172.16.0.220,3260] successful.
Oct 18 12:33:29 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:33:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bde0d97-278b-4412-a9d9-403aae577cfb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:33:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bde0d97-278b-4412-a9d9-403aae577cfb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:33:29 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5fe9332-2e85-4aff-8095-b79c973912f9]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:33:29 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-48cc30da-91bb-47be-aec8-0a1acc87267c tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:33:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:33:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:33:29 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f87af8-fa89-4f2b-b9d2-60a2945e9b39]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bde0d97-278b-4412-a9d9-403aae577cfb (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:33:29 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-48cc30da-91bb-47be-aec8-0a1acc87267c tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bde0d97-278b-4412-a9d9-403aae577cfb (non-flash)
Oct 18 12:33:29 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 12:33:29 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-48cc30da-91bb-47be-aec8-0a1acc87267c tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bde0d97-278b-4412-a9d9-403aae577cfb (non-flash)
Oct 18 12:33:29 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 12:33:29 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-48cc30da-91bb-47be-aec8-0a1acc87267c tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5bde0d97-278b-4412-a9d9-403aae577cfb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.247s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 12:33:29 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-48cc30da-91bb-47be-aec8-0a1acc87267c tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Connected to 172.16.0.220:3260 {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 18 12:33:29 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-48cc30da-91bb-47be-aec8-0a1acc87267c tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=74190) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 18 12:33:29 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-48cc30da-91bb-47be-aec8-0a1acc87267c tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74190) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 18 12:33:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:33:29 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:33:29 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[61aa5aac-9d14-4fc1-965b-ce744ce8e391]: (4, ('- - 0', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:33:29 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-48cc30da-91bb-47be-aec8-0a1acc87267c tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74190) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 18 12:33:29 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-48cc30da-91bb-47be-aec8-0a1acc87267c tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5bde0d97-278b-4412-a9d9-403aae577cfb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aslkYKAn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74190) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 18 12:33:30 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-48cc30da-91bb-47be-aec8-0a1acc87267c tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.279s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 12:33:30 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-48cc30da-91bb-47be-aec8-0a1acc87267c tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] <== connect_volume: return (1281ms) {'type': 'block', 'scsi_wwn': '23231383765323230', 'path': '/dev/sdb'} {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 12:33:30 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48cc30da-91bb-47be-aec8-0a1acc87267c tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23231383765323230', 'path': '/dev/sdb'} {{(pid=74190) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 18 12:33:30 user nova-compute[74190]: DEBUG nova.objects.instance [None req-48cc30da-91bb-47be-aec8-0a1acc87267c tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Lazy-loading 'flavor' on Instance uuid 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:33:30 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-48cc30da-91bb-47be-aec8-0a1acc87267c tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] attach device xml: <disk type="block" device="disk">
Oct 18 12:33:30 user nova-compute[74190]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 12:33:30 user nova-compute[74190]:   <source dev="/dev/sdb"/>
Oct 18 12:33:30 user nova-compute[74190]:   <target dev="vdb" bus="virtio"/>
Oct 18 12:33:30 user nova-compute[74190]:   <serial>5bde0d97-278b-4412-a9d9-403aae577cfb</serial>
Oct 18 12:33:30 user nova-compute[74190]: </disk>
Oct 18 12:33:30 user nova-compute[74190]:  {{(pid=74190) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 18 12:33:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:33:30 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-48cc30da-91bb-47be-aec8-0a1acc87267c tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] No BDM found with device name vda, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 12:33:30 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-48cc30da-91bb-47be-aec8-0a1acc87267c tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74190) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 18 12:33:30 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-48cc30da-91bb-47be-aec8-0a1acc87267c tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] No VIF found with MAC fa:16:3e:33:c0:1e, not building metadata {{(pid=74190) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 18 12:33:31 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-48cc30da-91bb-47be-aec8-0a1acc87267c tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Lock "1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.308s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:33:33 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:33:34 user nova-compute[74190]: DEBUG nova.compute.manager [req-1d6308cc-5042-44b7-aa2a-e07d72a3bccf req-958bb1e5-9c72-4a4b-9670-1fe47004c1e9 service nova] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Received event network-changed-e1de485e-b105-42fd-a9f5-2467bf5404ce {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:33:34 user nova-compute[74190]: DEBUG nova.compute.manager [req-1d6308cc-5042-44b7-aa2a-e07d72a3bccf req-958bb1e5-9c72-4a4b-9670-1fe47004c1e9 service nova] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Refreshing instance network info cache due to event network-changed-e1de485e-b105-42fd-a9f5-2467bf5404ce. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 12:33:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-1d6308cc-5042-44b7-aa2a-e07d72a3bccf req-958bb1e5-9c72-4a4b-9670-1fe47004c1e9 service nova] Acquiring lock "refresh_cache-1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:33:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-1d6308cc-5042-44b7-aa2a-e07d72a3bccf req-958bb1e5-9c72-4a4b-9670-1fe47004c1e9 service nova] Acquired lock "refresh_cache-1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:33:34 user nova-compute[74190]: DEBUG nova.network.neutron [req-1d6308cc-5042-44b7-aa2a-e07d72a3bccf req-958bb1e5-9c72-4a4b-9670-1fe47004c1e9 service nova] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Refreshing network info cache for port e1de485e-b105-42fd-a9f5-2467bf5404ce {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 12:33:34 user nova-compute[74190]: DEBUG nova.network.neutron [req-1d6308cc-5042-44b7-aa2a-e07d72a3bccf req-958bb1e5-9c72-4a4b-9670-1fe47004c1e9 service nova] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Updated VIF entry in instance network info cache for port e1de485e-b105-42fd-a9f5-2467bf5404ce. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 12:33:34 user nova-compute[74190]: DEBUG nova.network.neutron [req-1d6308cc-5042-44b7-aa2a-e07d72a3bccf req-958bb1e5-9c72-4a4b-9670-1fe47004c1e9 service nova] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Updating instance_info_cache with network_info: [{"id": "e1de485e-b105-42fd-a9f5-2467bf5404ce", "address": "fa:16:3e:33:c0:1e", "network": {"id": "f3af1635-bf8e-449d-baa0-fa3c2b96e435", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1573451770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b49249509b24a1bb7c97536ab9f1bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1de485e-b1", "ovs_interfaceid": "e1de485e-b105-42fd-a9f5-2467bf5404ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:33:34 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-1d6308cc-5042-44b7-aa2a-e07d72a3bccf req-958bb1e5-9c72-4a4b-9670-1fe47004c1e9 service nova] Releasing lock "refresh_cache-1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:33:35 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:33:35 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:33:35 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:33:36 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:33:36 user nova-compute[74190]: DEBUG nova.compute.manager [req-cc3bcca4-428b-49e1-b5e7-da56a045b0bb req-e86a4b86-c8c6-4f5f-91d1-70b46ef323d1 service nova] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Received event network-changed-e1de485e-b105-42fd-a9f5-2467bf5404ce {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:33:36 user nova-compute[74190]: DEBUG nova.compute.manager [req-cc3bcca4-428b-49e1-b5e7-da56a045b0bb req-e86a4b86-c8c6-4f5f-91d1-70b46ef323d1 service nova] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Refreshing instance network info cache due to event network-changed-e1de485e-b105-42fd-a9f5-2467bf5404ce. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 12:33:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-cc3bcca4-428b-49e1-b5e7-da56a045b0bb req-e86a4b86-c8c6-4f5f-91d1-70b46ef323d1 service nova] Acquiring lock "refresh_cache-1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:33:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-cc3bcca4-428b-49e1-b5e7-da56a045b0bb req-e86a4b86-c8c6-4f5f-91d1-70b46ef323d1 service nova] Acquired lock "refresh_cache-1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:33:36 user nova-compute[74190]: DEBUG nova.network.neutron [req-cc3bcca4-428b-49e1-b5e7-da56a045b0bb req-e86a4b86-c8c6-4f5f-91d1-70b46ef323d1 service nova] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Refreshing network info cache for port e1de485e-b105-42fd-a9f5-2467bf5404ce {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 12:33:36 user nova-compute[74190]: DEBUG nova.network.neutron [req-cc3bcca4-428b-49e1-b5e7-da56a045b0bb req-e86a4b86-c8c6-4f5f-91d1-70b46ef323d1 service nova] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Updated VIF entry in instance network info cache for port e1de485e-b105-42fd-a9f5-2467bf5404ce. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 12:33:36 user nova-compute[74190]: DEBUG nova.network.neutron [req-cc3bcca4-428b-49e1-b5e7-da56a045b0bb req-e86a4b86-c8c6-4f5f-91d1-70b46ef323d1 service nova] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Updating instance_info_cache with network_info: [{"id": "e1de485e-b105-42fd-a9f5-2467bf5404ce", "address": "fa:16:3e:33:c0:1e", "network": {"id": "f3af1635-bf8e-449d-baa0-fa3c2b96e435", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1573451770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b49249509b24a1bb7c97536ab9f1bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1de485e-b1", "ovs_interfaceid": "e1de485e-b105-42fd-a9f5-2467bf5404ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:33:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-cc3bcca4-428b-49e1-b5e7-da56a045b0bb req-e86a4b86-c8c6-4f5f-91d1-70b46ef323d1 service nova] Releasing lock "refresh_cache-1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:33:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-6d28dec0-db6a-4da0-902b-fc3701a1ae48 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Acquiring lock "1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:33:36 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-6d28dec0-db6a-4da0-902b-fc3701a1ae48 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Lock "1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:33:36 user nova-compute[74190]: INFO nova.compute.manager [None req-6d28dec0-db6a-4da0-902b-fc3701a1ae48 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Rebooting instance
Oct 18 12:33:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-6d28dec0-db6a-4da0-902b-fc3701a1ae48 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Acquiring lock "refresh_cache-1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:33:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-6d28dec0-db6a-4da0-902b-fc3701a1ae48 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Acquired lock "refresh_cache-1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:33:37 user nova-compute[74190]: DEBUG nova.network.neutron [None req-6d28dec0-db6a-4da0-902b-fc3701a1ae48 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Building network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 18 12:33:37 user nova-compute[74190]: DEBUG nova.network.neutron [None req-6d28dec0-db6a-4da0-902b-fc3701a1ae48 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Updating instance_info_cache with network_info: [{"id": "e1de485e-b105-42fd-a9f5-2467bf5404ce", "address": "fa:16:3e:33:c0:1e", "network": {"id": "f3af1635-bf8e-449d-baa0-fa3c2b96e435", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1573451770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b49249509b24a1bb7c97536ab9f1bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1de485e-b1", "ovs_interfaceid": "e1de485e-b105-42fd-a9f5-2467bf5404ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:33:37 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-6d28dec0-db6a-4da0-902b-fc3701a1ae48 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Releasing lock "refresh_cache-1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:33:37 user nova-compute[74190]: DEBUG nova.compute.manager [None req-6d28dec0-db6a-4da0-902b-fc3701a1ae48 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Checking state {{(pid=74190) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 12:33:39 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:33:39 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:33:39 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:33:39 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:33:39 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:33:39 user nova-compute[74190]: DEBUG nova.compute.manager [req-3b94a4ee-62b7-41ee-99cb-5a82708374cd req-cc07c7b7-4976-45f6-b31f-8fdc7cf77fd3 service nova] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Received event network-vif-unplugged-e1de485e-b105-42fd-a9f5-2467bf5404ce {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:33:39 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-3b94a4ee-62b7-41ee-99cb-5a82708374cd req-cc07c7b7-4976-45f6-b31f-8fdc7cf77fd3 service nova] Acquiring lock "1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:33:39 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-3b94a4ee-62b7-41ee-99cb-5a82708374cd req-cc07c7b7-4976-45f6-b31f-8fdc7cf77fd3 service nova] Lock "1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:33:39 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-3b94a4ee-62b7-41ee-99cb-5a82708374cd req-cc07c7b7-4976-45f6-b31f-8fdc7cf77fd3 service nova] Lock "1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:33:39 user nova-compute[74190]: DEBUG nova.compute.manager [req-3b94a4ee-62b7-41ee-99cb-5a82708374cd req-cc07c7b7-4976-45f6-b31f-8fdc7cf77fd3 service nova] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] No waiting events found dispatching network-vif-unplugged-e1de485e-b105-42fd-a9f5-2467bf5404ce {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:33:39 user nova-compute[74190]: WARNING nova.compute.manager [req-3b94a4ee-62b7-41ee-99cb-5a82708374cd req-cc07c7b7-4976-45f6-b31f-8fdc7cf77fd3 service nova] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Received unexpected event network-vif-unplugged-e1de485e-b105-42fd-a9f5-2467bf5404ce for instance with vm_state active and task_state reboot_started.
Oct 18 12:33:40 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:33:40 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-6d28dec0-db6a-4da0-902b-fc3701a1ae48 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Instance shutdown successfully.
Oct 18 12:33:40 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:33:40 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:33:41 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:33:41 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:33:41 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:33:41 user nova-compute[74190]: DEBUG nova.compute.manager [req-72264ec2-2f94-4170-88a2-fb61ff08a13b req-7bbf2880-5cd7-40d8-ba94-16a6f1211d78 service nova] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Received event network-vif-plugged-e1de485e-b105-42fd-a9f5-2467bf5404ce {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:33:41 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-72264ec2-2f94-4170-88a2-fb61ff08a13b req-7bbf2880-5cd7-40d8-ba94-16a6f1211d78 service nova] Acquiring lock "1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:33:41 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-72264ec2-2f94-4170-88a2-fb61ff08a13b req-7bbf2880-5cd7-40d8-ba94-16a6f1211d78 service nova] Lock "1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:33:41 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-72264ec2-2f94-4170-88a2-fb61ff08a13b req-7bbf2880-5cd7-40d8-ba94-16a6f1211d78 service nova] Lock "1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:33:41 user nova-compute[74190]: DEBUG nova.compute.manager [req-72264ec2-2f94-4170-88a2-fb61ff08a13b req-7bbf2880-5cd7-40d8-ba94-16a6f1211d78 service nova] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] No waiting events found dispatching network-vif-plugged-e1de485e-b105-42fd-a9f5-2467bf5404ce {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:33:41 user nova-compute[74190]: WARNING nova.compute.manager [req-72264ec2-2f94-4170-88a2-fb61ff08a13b req-7bbf2880-5cd7-40d8-ba94-16a6f1211d78 service nova] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Received unexpected event network-vif-plugged-e1de485e-b105-42fd-a9f5-2467bf5404ce for instance with vm_state active and task_state reboot_started.
Oct 18 12:33:42 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:33:42 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:33:42 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:33:42 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:33:43 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Instance running successfully.
Oct 18 12:33:43 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-6d28dec0-db6a-4da0-902b-fc3701a1ae48 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Instance soft rebooted successfully.
Oct 18 12:33:43 user nova-compute[74190]: DEBUG nova.compute.manager [None req-6d28dec0-db6a-4da0-902b-fc3701a1ae48 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Checking state {{(pid=74190) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 18 12:33:43 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-6d28dec0-db6a-4da0-902b-fc3701a1ae48 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Lock "1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.066s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:33:43 user nova-compute[74190]: DEBUG nova.compute.manager [req-6bb8cc27-d8f3-49bf-9b8a-34d12cdf3acf req-4efc8224-eb6c-4d76-8cc9-1e98995c7fcd service nova] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Received event network-vif-plugged-e1de485e-b105-42fd-a9f5-2467bf5404ce {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:33:43 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-6bb8cc27-d8f3-49bf-9b8a-34d12cdf3acf req-4efc8224-eb6c-4d76-8cc9-1e98995c7fcd service nova] Acquiring lock "1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:33:43 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-6bb8cc27-d8f3-49bf-9b8a-34d12cdf3acf req-4efc8224-eb6c-4d76-8cc9-1e98995c7fcd service nova] Lock "1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:33:43 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-6bb8cc27-d8f3-49bf-9b8a-34d12cdf3acf req-4efc8224-eb6c-4d76-8cc9-1e98995c7fcd service nova] Lock "1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:33:43 user nova-compute[74190]: DEBUG nova.compute.manager [req-6bb8cc27-d8f3-49bf-9b8a-34d12cdf3acf req-4efc8224-eb6c-4d76-8cc9-1e98995c7fcd service nova] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] No waiting events found dispatching network-vif-plugged-e1de485e-b105-42fd-a9f5-2467bf5404ce {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:33:43 user nova-compute[74190]: WARNING nova.compute.manager [req-6bb8cc27-d8f3-49bf-9b8a-34d12cdf3acf req-4efc8224-eb6c-4d76-8cc9-1e98995c7fcd service nova] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Received unexpected event network-vif-plugged-e1de485e-b105-42fd-a9f5-2467bf5404ce for instance with vm_state active and task_state None.
Oct 18 12:33:43 user nova-compute[74190]: DEBUG nova.compute.manager [req-6bb8cc27-d8f3-49bf-9b8a-34d12cdf3acf req-4efc8224-eb6c-4d76-8cc9-1e98995c7fcd service nova] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Received event network-vif-plugged-e1de485e-b105-42fd-a9f5-2467bf5404ce {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:33:43 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-6bb8cc27-d8f3-49bf-9b8a-34d12cdf3acf req-4efc8224-eb6c-4d76-8cc9-1e98995c7fcd service nova] Acquiring lock "1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:33:43 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-6bb8cc27-d8f3-49bf-9b8a-34d12cdf3acf req-4efc8224-eb6c-4d76-8cc9-1e98995c7fcd service nova] Lock "1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:33:43 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-6bb8cc27-d8f3-49bf-9b8a-34d12cdf3acf req-4efc8224-eb6c-4d76-8cc9-1e98995c7fcd service nova] Lock "1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:33:43 user nova-compute[74190]: DEBUG nova.compute.manager [req-6bb8cc27-d8f3-49bf-9b8a-34d12cdf3acf req-4efc8224-eb6c-4d76-8cc9-1e98995c7fcd service nova] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] No waiting events found dispatching network-vif-plugged-e1de485e-b105-42fd-a9f5-2467bf5404ce {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:33:43 user nova-compute[74190]: WARNING nova.compute.manager [req-6bb8cc27-d8f3-49bf-9b8a-34d12cdf3acf req-4efc8224-eb6c-4d76-8cc9-1e98995c7fcd service nova] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Received unexpected event network-vif-plugged-e1de485e-b105-42fd-a9f5-2467bf5404ce for instance with vm_state active and task_state None.
Oct 18 12:33:44 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:33:44 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Starting heal instance info cache {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 12:33:44 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Rebuilding the list of instances to heal {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 18 12:33:44 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "refresh_cache-1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:33:44 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquired lock "refresh_cache-1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:33:44 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Forcefully refreshing network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 18 12:33:44 user nova-compute[74190]: DEBUG nova.objects.instance [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lazy-loading 'info_cache' on Instance uuid 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:33:44 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Updating instance_info_cache with network_info: [{"id": "e1de485e-b105-42fd-a9f5-2467bf5404ce", "address": "fa:16:3e:33:c0:1e", "network": {"id": "f3af1635-bf8e-449d-baa0-fa3c2b96e435", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1573451770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b49249509b24a1bb7c97536ab9f1bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1de485e-b1", "ovs_interfaceid": "e1de485e-b105-42fd-a9f5-2467bf5404ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:33:44 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Releasing lock "refresh_cache-1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:33:44 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Updated the network info_cache for instance {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 18 12:33:44 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:33:44 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:33:44 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:33:44 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:33:44 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:33:44 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:33:44 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Auditing locally available compute resources for user (node: user) {{(pid=74190) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 12:33:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:33:45 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:33:45 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:33:45 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:33:45 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 12:33:45 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:33:45 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:33:45 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:33:45 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Hypervisor/Node resource view: name=user free_ram=9025MB free_disk=25.089744567871094GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74190) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 12:33:45 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:33:45 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:33:45 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:33:45 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 12:33:45 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 12:33:45 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Refreshing inventories for resource provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 18 12:33:45 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Updating ProviderTree inventory for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 18 12:33:45 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Updating inventory in ProviderTree for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 18 12:33:45 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Refreshing aggregate associations for resource provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66, aggregates: None {{(pid=74190) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 18 12:33:45 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Refreshing trait associations for resource provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66, traits: COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE42,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_ACCELERATORS,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=74190) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 18 12:33:45 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:33:46 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 12:33:46 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 12:33:46 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Compute_service record updated for user:user {{(pid=74190) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 12:33:46 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.356s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:33:48 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:33:48 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74190) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 12:33:50 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:33:50 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:33:55 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:33:56 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:34:00 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:34:00 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:34:05 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:34:05 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:34:10 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:34:10 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:34:15 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:34:15 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:34:20 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:34:25 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:34:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:34:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:34:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74190) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 12:34:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:34:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:34:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:34:31 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:34:35 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:34:35 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:34:35 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:34:35 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74190) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 12:34:35 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:34:35 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:34:35 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:34:38 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:34:40 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:34:41 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:34:44 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:34:44 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:34:44 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:34:44 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:34:44 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:34:44 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Auditing locally available compute resources for user (node: user) {{(pid=74190) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 12:34:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:34:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:34:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:34:44 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:34:44 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74190) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 18 12:34:44 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:34:44 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:34:44 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Hypervisor/Node resource view: name=user free_ram=8967MB free_disk=25.08899688720703GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74190) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 12:34:44 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:34:44 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:34:45 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:34:45 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 12:34:45 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 12:34:45 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 12:34:45 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 12:34:45 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Compute_service record updated for user:user {{(pid=74190) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 12:34:45 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.311s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:34:45 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:34:46 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:34:46 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Starting heal instance info cache {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 12:34:46 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Rebuilding the list of instances to heal {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 18 12:34:46 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "refresh_cache-1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:34:46 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquired lock "refresh_cache-1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:34:46 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Forcefully refreshing network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 18 12:34:46 user nova-compute[74190]: DEBUG nova.objects.instance [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lazy-loading 'info_cache' on Instance uuid 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:34:46 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Updating instance_info_cache with network_info: [{"id": "e1de485e-b105-42fd-a9f5-2467bf5404ce", "address": "fa:16:3e:33:c0:1e", "network": {"id": "f3af1635-bf8e-449d-baa0-fa3c2b96e435", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1573451770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b49249509b24a1bb7c97536ab9f1bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1de485e-b1", "ovs_interfaceid": "e1de485e-b105-42fd-a9f5-2467bf5404ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:34:46 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Releasing lock "refresh_cache-1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:34:46 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Updated the network info_cache for instance {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 18 12:34:46 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:34:49 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:34:49 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74190) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 12:34:50 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:34:55 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:35:00 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:35:05 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:35:10 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:35:15 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:35:20 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:35:25 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:35:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:35:29 user nova-compute[74190]: DEBUG nova.compute.manager [req-a3a8a3e9-057b-4d08-a178-dd49b8a87325 req-e433cf21-3360-42b4-bc24-cf1cdce84c92 service nova] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Received event network-changed-e1de485e-b105-42fd-a9f5-2467bf5404ce {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:35:29 user nova-compute[74190]: DEBUG nova.compute.manager [req-a3a8a3e9-057b-4d08-a178-dd49b8a87325 req-e433cf21-3360-42b4-bc24-cf1cdce84c92 service nova] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Refreshing instance network info cache due to event network-changed-e1de485e-b105-42fd-a9f5-2467bf5404ce. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 12:35:29 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-a3a8a3e9-057b-4d08-a178-dd49b8a87325 req-e433cf21-3360-42b4-bc24-cf1cdce84c92 service nova] Acquiring lock "refresh_cache-1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:35:29 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-a3a8a3e9-057b-4d08-a178-dd49b8a87325 req-e433cf21-3360-42b4-bc24-cf1cdce84c92 service nova] Acquired lock "refresh_cache-1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:35:29 user nova-compute[74190]: DEBUG nova.network.neutron [req-a3a8a3e9-057b-4d08-a178-dd49b8a87325 req-e433cf21-3360-42b4-bc24-cf1cdce84c92 service nova] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Refreshing network info cache for port e1de485e-b105-42fd-a9f5-2467bf5404ce {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 12:35:29 user nova-compute[74190]: DEBUG nova.network.neutron [req-a3a8a3e9-057b-4d08-a178-dd49b8a87325 req-e433cf21-3360-42b4-bc24-cf1cdce84c92 service nova] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Updated VIF entry in instance network info cache for port e1de485e-b105-42fd-a9f5-2467bf5404ce. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 12:35:29 user nova-compute[74190]: DEBUG nova.network.neutron [req-a3a8a3e9-057b-4d08-a178-dd49b8a87325 req-e433cf21-3360-42b4-bc24-cf1cdce84c92 service nova] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Updating instance_info_cache with network_info: [{"id": "e1de485e-b105-42fd-a9f5-2467bf5404ce", "address": "fa:16:3e:33:c0:1e", "network": {"id": "f3af1635-bf8e-449d-baa0-fa3c2b96e435", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1573451770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b49249509b24a1bb7c97536ab9f1bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1de485e-b1", "ovs_interfaceid": "e1de485e-b105-42fd-a9f5-2467bf5404ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:35:29 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-a3a8a3e9-057b-4d08-a178-dd49b8a87325 req-e433cf21-3360-42b4-bc24-cf1cdce84c92 service nova] Releasing lock "refresh_cache-1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:35:29 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-a2f10146-d623-496f-909a-25655f8c7803 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Acquiring lock "1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:35:29 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-a2f10146-d623-496f-909a-25655f8c7803 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Lock "1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:35:29 user nova-compute[74190]: INFO nova.compute.manager [None req-a2f10146-d623-496f-909a-25655f8c7803 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Detaching volume 5bde0d97-278b-4412-a9d9-403aae577cfb
Oct 18 12:35:29 user nova-compute[74190]: INFO nova.virt.block_device [None req-a2f10146-d623-496f-909a-25655f8c7803 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Attempting to driver detach volume 5bde0d97-278b-4412-a9d9-403aae577cfb from mountpoint /dev/vdb
Oct 18 12:35:29 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-a2f10146-d623-496f-909a-25655f8c7803 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Attempting to detach device vdb from instance 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8 from the persistent domain config. {{(pid=74190) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 18 12:35:29 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-a2f10146-d623-496f-909a-25655f8c7803 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 12:35:29 user nova-compute[74190]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 12:35:29 user nova-compute[74190]:   <source dev="/dev/sdb"/>
Oct 18 12:35:29 user nova-compute[74190]:   <target dev="vdb" bus="virtio"/>
Oct 18 12:35:29 user nova-compute[74190]:   <serial>5bde0d97-278b-4412-a9d9-403aae577cfb</serial>
Oct 18 12:35:29 user nova-compute[74190]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 18 12:35:29 user nova-compute[74190]: </disk>
Oct 18 12:35:29 user nova-compute[74190]:  {{(pid=74190) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 12:35:29 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-a2f10146-d623-496f-909a-25655f8c7803 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Successfully detached device vdb from instance 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8 from the persistent domain config.
Oct 18 12:35:29 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-a2f10146-d623-496f-909a-25655f8c7803 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8 from the live domain config. {{(pid=74190) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 18 12:35:29 user nova-compute[74190]: DEBUG nova.virt.libvirt.guest [None req-a2f10146-d623-496f-909a-25655f8c7803 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] detach device xml: <disk type="block" device="disk">
Oct 18 12:35:29 user nova-compute[74190]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 18 12:35:29 user nova-compute[74190]:   <source dev="/dev/sdb"/>
Oct 18 12:35:29 user nova-compute[74190]:   <target dev="vdb" bus="virtio"/>
Oct 18 12:35:29 user nova-compute[74190]:   <serial>5bde0d97-278b-4412-a9d9-403aae577cfb</serial>
Oct 18 12:35:29 user nova-compute[74190]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 18 12:35:29 user nova-compute[74190]: </disk>
Oct 18 12:35:29 user nova-compute[74190]:  {{(pid=74190) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 18 12:35:30 user nova-compute[74190]: DEBUG nova.virt.libvirt.driver [None req-a2f10146-d623-496f-909a-25655f8c7803 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8 {{(pid=74190) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 18 12:35:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:35:31 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:35:31 user nova-compute[74190]: DEBUG nova.compute.manager [req-06860542-71cf-43be-a6d3-e3c3efbb03b5 req-f3d8d707-a1b5-477f-be5e-3704d23b3102 service nova] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Received event network-changed-e1de485e-b105-42fd-a9f5-2467bf5404ce {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:35:31 user nova-compute[74190]: DEBUG nova.compute.manager [req-06860542-71cf-43be-a6d3-e3c3efbb03b5 req-f3d8d707-a1b5-477f-be5e-3704d23b3102 service nova] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Refreshing instance network info cache due to event network-changed-e1de485e-b105-42fd-a9f5-2467bf5404ce. {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 18 12:35:31 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-06860542-71cf-43be-a6d3-e3c3efbb03b5 req-f3d8d707-a1b5-477f-be5e-3704d23b3102 service nova] Acquiring lock "refresh_cache-1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:35:31 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-06860542-71cf-43be-a6d3-e3c3efbb03b5 req-f3d8d707-a1b5-477f-be5e-3704d23b3102 service nova] Acquired lock "refresh_cache-1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:35:31 user nova-compute[74190]: DEBUG nova.network.neutron [req-06860542-71cf-43be-a6d3-e3c3efbb03b5 req-f3d8d707-a1b5-477f-be5e-3704d23b3102 service nova] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Refreshing network info cache for port e1de485e-b105-42fd-a9f5-2467bf5404ce {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 18 12:35:31 user nova-compute[74190]: DEBUG nova.network.neutron [req-06860542-71cf-43be-a6d3-e3c3efbb03b5 req-f3d8d707-a1b5-477f-be5e-3704d23b3102 service nova] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Updated VIF entry in instance network info cache for port e1de485e-b105-42fd-a9f5-2467bf5404ce. {{(pid=74190) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 18 12:35:31 user nova-compute[74190]: DEBUG nova.network.neutron [req-06860542-71cf-43be-a6d3-e3c3efbb03b5 req-f3d8d707-a1b5-477f-be5e-3704d23b3102 service nova] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Updating instance_info_cache with network_info: [{"id": "e1de485e-b105-42fd-a9f5-2467bf5404ce", "address": "fa:16:3e:33:c0:1e", "network": {"id": "f3af1635-bf8e-449d-baa0-fa3c2b96e435", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1573451770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b49249509b24a1bb7c97536ab9f1bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1de485e-b1", "ovs_interfaceid": "e1de485e-b105-42fd-a9f5-2467bf5404ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:35:31 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-06860542-71cf-43be-a6d3-e3c3efbb03b5 req-f3d8d707-a1b5-477f-be5e-3704d23b3102 service nova] Releasing lock "refresh_cache-1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:35:32 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:35:35 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:35:36 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:35:40 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:35:40 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:35:43 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:35:44 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:35:45 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:35:46 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:35:46 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:35:46 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:35:46 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:35:46 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Auditing locally available compute resources for user (node: user) {{(pid=74190) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 12:35:46 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:35:46 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:35:46 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8/disk --force-share --output=json {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:35:46 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74190) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:35:46 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:35:46 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:35:46 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Hypervisor/Node resource view: name=user free_ram=8976MB free_disk=25.08826446533203GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74190) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 12:35:46 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:35:46 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:35:46 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Instance 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74190) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 18 12:35:46 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 12:35:46 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 12:35:47 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 12:35:47 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 12:35:47 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Compute_service record updated for user:user {{(pid=74190) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 12:35:47 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.174s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:35:48 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:35:48 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Starting heal instance info cache {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 12:35:48 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Rebuilding the list of instances to heal {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 18 12:35:48 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "refresh_cache-1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 18 12:35:48 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquired lock "refresh_cache-1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 18 12:35:48 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Forcefully refreshing network info cache for instance {{(pid=74190) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 18 12:35:48 user nova-compute[74190]: DEBUG nova.objects.instance [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lazy-loading 'info_cache' on Instance uuid 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:35:48 user nova-compute[74190]: DEBUG nova.network.neutron [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Updating instance_info_cache with network_info: [{"id": "e1de485e-b105-42fd-a9f5-2467bf5404ce", "address": "fa:16:3e:33:c0:1e", "network": {"id": "f3af1635-bf8e-449d-baa0-fa3c2b96e435", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1573451770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b49249509b24a1bb7c97536ab9f1bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1de485e-b1", "ovs_interfaceid": "e1de485e-b105-42fd-a9f5-2467bf5404ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:35:48 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Releasing lock "refresh_cache-1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8" {{(pid=74190) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 18 12:35:48 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Updated the network info_cache for instance {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 18 12:35:48 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:35:50 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:35:50 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74190) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 12:35:50 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-a2f10146-d623-496f-909a-25655f8c7803 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8 is timed out.
Oct 18 12:35:50 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-a2f10146-d623-496f-909a-25655f8c7803 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Successfully detached device vdb from instance 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8 from the live domain config.
Oct 18 12:35:50 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2f10146-d623-496f-909a-25655f8c7803 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] calling os-brick to detach iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 18 12:35:50 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f10146-d623-496f-909a-25655f8c7803 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1f4468ad70>, {'target_iqn': 'iqn.2010-10.org.openstack:5bde0d97-278b-4412-a9d9-403aae577cfb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aslkYKAn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 18 12:35:50 user nova-compute[74190]: WARNING os_brick.initiator.connectors.base [None req-a2f10146-d623-496f-909a-25655f8c7803 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 18 12:35:50 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-a2f10146-d623-496f-909a-25655f8c7803 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 18 12:35:50 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-a2f10146-d623-496f-909a-25655f8c7803 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 18 12:35:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:35:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:35:50 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cb3e7a7-1c22-43e6-879f-b002c387bcad]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5bde0d97-278b-4412-a9d9-403aae577cfb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:35:50 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f10146-d623-496f-909a-25655f8c7803 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 18 12:35:50 user nova-compute[74190]: No targets found.
Oct 18 12:35:50 user nova-compute[74190]: iSNS:
Oct 18 12:35:50 user nova-compute[74190]: No targets found.
Oct 18 12:35:50 user nova-compute[74190]: STATIC:
Oct 18 12:35:50 user nova-compute[74190]: Target: iqn.2010-10.org.openstack:5bde0d97-278b-4412-a9d9-403aae577cfb
Oct 18 12:35:50 user nova-compute[74190]:         Portal: 172.16.0.220:3260,-1
Oct 18 12:35:50 user nova-compute[74190]:                 Iface Name: default
Oct 18 12:35:50 user nova-compute[74190]: FIRMWARE:
Oct 18 12:35:50 user nova-compute[74190]: No targets found.
Oct 18 12:35:50 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 12:35:50 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f10146-d623-496f-909a-25655f8c7803 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 18 12:35:50 user nova-compute[74190]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 18 12:35:50 user nova-compute[74190]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74190) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 18 12:35:50 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f10146-d623-496f-909a-25655f8c7803 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5bde0d97-278b-4412-a9d9-403aae577cfb', 0)] {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 18 12:35:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:35:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:35:50 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f394709-757f-4268-aef5-07a108d1ae12]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5bde0d97-278b-4412-a9d9-403aae577cfb\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:35:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:35:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:35:50 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c6fb41a-1a57-447a-bf21-ebad5fa31a2e]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bde0d97-278b-4412-a9d9-403aae577cfb (non-flash)\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:35:50 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f10146-d623-496f-909a-25655f8c7803 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bde0d97-278b-4412-a9d9-403aae577cfb (non-flash)
Oct 18 12:35:50 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 18 12:35:50 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f10146-d623-496f-909a-25655f8c7803 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bde0d97-278b-4412-a9d9-403aae577cfb (non-flash)
Oct 18 12:35:50 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 18 12:35:50 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f10146-d623-496f-909a-25655f8c7803 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1f447863b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5bde0d97-278b-4412-a9d9-403aae577cfb'): ({'sdb'}, set())}) {{(pid=74190) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 18 12:35:50 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-a2f10146-d623-496f-909a-25655f8c7803 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Removing single pathed devices sdb {{(pid=74190) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 18 12:35:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:35:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:35:50 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[f48b0a97-c83e-4eb5-a569-d1af7ae2412f]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:35:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:35:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:35:50 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc4136fb-ddc5-4807-a620-7c091d682cd1]: (4, ('ok\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:35:50 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-a2f10146-d623-496f-909a-25655f8c7803 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Flushing IO for device /dev/sdb {{(pid=74190) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 18 12:35:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:35:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:35:50 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd61666-f414-47fe-99f7-de701817d2bd]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:35:50 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-a2f10146-d623-496f-909a-25655f8c7803 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74190) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 18 12:35:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:35:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:35:50 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[11cb9a09-e188-44fc-b354-5cfda077902d]: (4, ('1', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:35:50 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-a2f10146-d623-496f-909a-25655f8c7803 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 18 12:35:50 user nova-compute[74190]: DEBUG os_brick.initiator.linuxscsi [None req-a2f10146-d623-496f-909a-25655f8c7803 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] SCSI volumes sdb have been removed. {{(pid=74190) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 18 12:35:50 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f10146-d623-496f-909a-25655f8c7803 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5bde0d97-278b-4412-a9d9-403aae577cfb')] {{(pid=74190) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 18 12:35:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bde0d97-278b-4412-a9d9-403aae577cfb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:35:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bde0d97-278b-4412-a9d9-403aae577cfb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:35:50 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb4615b-4f57-4a38-92b0-6d15b8ef11be]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:35:50 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f10146-d623-496f-909a-25655f8c7803 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:35:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bde0d97-278b-4412-a9d9-403aae577cfb -p 172.16.0.220:3260 --logout {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:35:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bde0d97-278b-4412-a9d9-403aae577cfb -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:35:50 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[a939cca7-77ca-4c5a-a744-ca5b0d1d7965]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:5bde0d97-278b-4412-a9d9-403aae577cfb, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:5bde0d97-278b-4412-a9d9-403aae577cfb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:35:50 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f10146-d623-496f-909a-25655f8c7803 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:5bde0d97-278b-4412-a9d9-403aae577cfb, portal: 172.16.0.220,3260]
Oct 18 12:35:50 user nova-compute[74190]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:5bde0d97-278b-4412-a9d9-403aae577cfb, portal: 172.16.0.220,3260] successful.
Oct 18 12:35:50 user nova-compute[74190]:  stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:35:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bde0d97-278b-4412-a9d9-403aae577cfb -p 172.16.0.220:3260 --op delete {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 18 12:35:50 user nova-compute[74190]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bde0d97-278b-4412-a9d9-403aae577cfb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85217) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 18 12:35:50 user nova-compute[74190]: DEBUG oslo.privsep.daemon [-] privsep: reply[2384e35c-65a2-4603-8a9d-5f9269a88fb3]: (4, ('', '')) {{(pid=85217) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 18 12:35:50 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f10146-d623-496f-909a-25655f8c7803 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74190) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 18 12:35:50 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.base [None req-a2f10146-d623-496f-909a-25655f8c7803 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 18 12:35:50 user nova-compute[74190]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2f10146-d623-496f-909a-25655f8c7803 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] <== disconnect_volume: return (293ms) None {{(pid=74190) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 18 12:35:50 user nova-compute[74190]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2f10146-d623-496f-909a-25655f8c7803 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Disconnected iSCSI Volume {{(pid=74190) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 18 12:35:50 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:35:51 user nova-compute[74190]: DEBUG nova.objects.instance [None req-a2f10146-d623-496f-909a-25655f8c7803 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Lazy-loading 'flavor' on Instance uuid 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:35:51 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-a2f10146-d623-496f-909a-25655f8c7803 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Lock "1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.703s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:35:55 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:35:58 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:36:00 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:36:05 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:36:10 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:36:15 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:36:20 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:36:20 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:36:20 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74190) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 12:36:20 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:36:20 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:36:20 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:36:25 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:36:25 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:36:25 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74190) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 12:36:25 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:36:25 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:36:25 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:36:28 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-914ae955-54ee-41ab-88f4-79c9ba0b4944 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Acquiring lock "1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:36:28 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-914ae955-54ee-41ab-88f4-79c9ba0b4944 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Lock "1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:36:28 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-914ae955-54ee-41ab-88f4-79c9ba0b4944 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Acquiring lock "1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:36:28 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-914ae955-54ee-41ab-88f4-79c9ba0b4944 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Lock "1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:36:28 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-914ae955-54ee-41ab-88f4-79c9ba0b4944 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Lock "1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:36:28 user nova-compute[74190]: INFO nova.compute.manager [None req-914ae955-54ee-41ab-88f4-79c9ba0b4944 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Terminating instance
Oct 18 12:36:28 user nova-compute[74190]: DEBUG nova.compute.manager [None req-914ae955-54ee-41ab-88f4-79c9ba0b4944 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Start destroying the instance on the hypervisor. {{(pid=74190) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 18 12:36:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:36:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:36:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:36:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:36:28 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:36:28 user nova-compute[74190]: DEBUG nova.compute.manager [req-70dbda14-533f-4f13-8163-e4375066cf3e req-b27bfdff-1b2a-4a1f-bbe1-f93ca5d5c5ea service nova] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Received event network-vif-unplugged-e1de485e-b105-42fd-a9f5-2467bf5404ce {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:36:28 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-70dbda14-533f-4f13-8163-e4375066cf3e req-b27bfdff-1b2a-4a1f-bbe1-f93ca5d5c5ea service nova] Acquiring lock "1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:36:28 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-70dbda14-533f-4f13-8163-e4375066cf3e req-b27bfdff-1b2a-4a1f-bbe1-f93ca5d5c5ea service nova] Lock "1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:36:28 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-70dbda14-533f-4f13-8163-e4375066cf3e req-b27bfdff-1b2a-4a1f-bbe1-f93ca5d5c5ea service nova] Lock "1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:36:28 user nova-compute[74190]: DEBUG nova.compute.manager [req-70dbda14-533f-4f13-8163-e4375066cf3e req-b27bfdff-1b2a-4a1f-bbe1-f93ca5d5c5ea service nova] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] No waiting events found dispatching network-vif-unplugged-e1de485e-b105-42fd-a9f5-2467bf5404ce {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:36:28 user nova-compute[74190]: DEBUG nova.compute.manager [req-70dbda14-533f-4f13-8163-e4375066cf3e req-b27bfdff-1b2a-4a1f-bbe1-f93ca5d5c5ea service nova] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Received event network-vif-unplugged-e1de485e-b105-42fd-a9f5-2467bf5404ce for instance with task_state deleting. {{(pid=74190) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 18 12:36:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:36:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:36:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:36:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:36:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:36:29 user nova-compute[74190]: INFO nova.virt.libvirt.driver [-] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Instance destroyed successfully.
Oct 18 12:36:29 user nova-compute[74190]: DEBUG nova.objects.instance [None req-914ae955-54ee-41ab-88f4-79c9ba0b4944 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Lazy-loading 'resources' on Instance uuid 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8 {{(pid=74190) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 18 12:36:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:36:29 user nova-compute[74190]: DEBUG nova.virt.libvirt.vif [None req-914ae955-54ee-41ab-88f4-79c9ba0b4944 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-18T12:31:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-411330141',display_name='tempest-TestMinimumBasicScenario-server-411330141',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-411330141',id=52,image_ref='0174a52f-5fe9-4a6e-91d4-2a5ef6f7d9b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBDkEwHbutvSIMj64xprni6Zt3kZAQO6t9skxUSOAqLQGwPiuGauu95K7v8O+XTSAauWWftIdBKPXXVbC62Rgbug0SEnVQGojhPr5vv/kRiZswkRnkf3tL9exZeLKd/5rg==',key_name='tempest-TestMinimumBasicScenario-98070653',keypairs=<?>,launch_index=0,launched_at=2023-10-18T12:31:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0b49249509b24a1bb7c97536ab9f1bfe',ramdisk_id='',reservation_id='r-d8ajhthf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0174a52f-5fe9-4a6e-91d4-2a5ef6f7d9b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-285966464',owner_user_name='tempest-TestMinimumBasicScenario-285966464-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-18T12:33:44Z,user_data=None,user_id='308413c6fcfa4ac1b73916bc81e46851',uuid=1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e1de485e-b105-42fd-a9f5-2467bf5404ce", "address": "fa:16:3e:33:c0:1e", "network": {"id": "f3af1635-bf8e-449d-baa0-fa3c2b96e435", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1573451770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b49249509b24a1bb7c97536ab9f1bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1de485e-b1", "ovs_interfaceid": "e1de485e-b105-42fd-a9f5-2467bf5404ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 18 12:36:29 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-914ae955-54ee-41ab-88f4-79c9ba0b4944 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Converting VIF {"id": "e1de485e-b105-42fd-a9f5-2467bf5404ce", "address": "fa:16:3e:33:c0:1e", "network": {"id": "f3af1635-bf8e-449d-baa0-fa3c2b96e435", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1573451770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b49249509b24a1bb7c97536ab9f1bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1de485e-b1", "ovs_interfaceid": "e1de485e-b105-42fd-a9f5-2467bf5404ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 18 12:36:29 user nova-compute[74190]: DEBUG nova.network.os_vif_util [None req-914ae955-54ee-41ab-88f4-79c9ba0b4944 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:33:c0:1e,bridge_name='br-int',has_traffic_filtering=True,id=e1de485e-b105-42fd-a9f5-2467bf5404ce,network=Network(f3af1635-bf8e-449d-baa0-fa3c2b96e435),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1de485e-b1') {{(pid=74190) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 18 12:36:29 user nova-compute[74190]: DEBUG os_vif [None req-914ae955-54ee-41ab-88f4-79c9ba0b4944 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:c0:1e,bridge_name='br-int',has_traffic_filtering=True,id=e1de485e-b105-42fd-a9f5-2467bf5404ce,network=Network(f3af1635-bf8e-449d-baa0-fa3c2b96e435),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1de485e-b1') {{(pid=74190) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 18 12:36:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:36:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape1de485e-b1, bridge=br-int, if_exists=True) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:36:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:36:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:36:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=43c4e797-2645-4bc0-b895-feb98461d13c) {{(pid=74190) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 18 12:36:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:36:29 user nova-compute[74190]: INFO os_vif [None req-914ae955-54ee-41ab-88f4-79c9ba0b4944 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:c0:1e,bridge_name='br-int',has_traffic_filtering=True,id=e1de485e-b105-42fd-a9f5-2467bf5404ce,network=Network(f3af1635-bf8e-449d-baa0-fa3c2b96e435),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1de485e-b1')
Oct 18 12:36:29 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-914ae955-54ee-41ab-88f4-79c9ba0b4944 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Deleting instance files /opt/stack/data/nova/instances/1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8_del
Oct 18 12:36:29 user nova-compute[74190]: INFO nova.virt.libvirt.driver [None req-914ae955-54ee-41ab-88f4-79c9ba0b4944 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Deletion of /opt/stack/data/nova/instances/1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8_del complete
Oct 18 12:36:29 user nova-compute[74190]: INFO nova.compute.manager [None req-914ae955-54ee-41ab-88f4-79c9ba0b4944 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Took 0.86 seconds to destroy the instance on the hypervisor.
Oct 18 12:36:29 user nova-compute[74190]: DEBUG oslo.service.loopingcall [None req-914ae955-54ee-41ab-88f4-79c9ba0b4944 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74190) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 18 12:36:29 user nova-compute[74190]: DEBUG nova.compute.manager [-] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Deallocating network for instance {{(pid=74190) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 18 12:36:29 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] deallocate_for_instance() {{(pid=74190) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 18 12:36:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:36:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:36:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:36:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:36:30 user nova-compute[74190]: DEBUG nova.network.neutron [-] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Updating instance_info_cache with network_info: [] {{(pid=74190) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 18 12:36:30 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:36:30 user nova-compute[74190]: INFO nova.compute.manager [-] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Took 0.56 seconds to deallocate network for instance.
Oct 18 12:36:30 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-914ae955-54ee-41ab-88f4-79c9ba0b4944 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:36:30 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-914ae955-54ee-41ab-88f4-79c9ba0b4944 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:36:30 user nova-compute[74190]: DEBUG nova.compute.manager [req-acbb0031-cbb5-4875-81f8-ac0537d5656a req-e588e490-96fa-4172-b728-9831bf6bbb42 service nova] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Received event network-vif-deleted-e1de485e-b105-42fd-a9f5-2467bf5404ce {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:36:30 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-914ae955-54ee-41ab-88f4-79c9ba0b4944 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 12:36:30 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-914ae955-54ee-41ab-88f4-79c9ba0b4944 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 12:36:30 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-914ae955-54ee-41ab-88f4-79c9ba0b4944 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.121s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:36:30 user nova-compute[74190]: INFO nova.scheduler.client.report [None req-914ae955-54ee-41ab-88f4-79c9ba0b4944 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Deleted allocations for instance 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8
Oct 18 12:36:30 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-914ae955-54ee-41ab-88f4-79c9ba0b4944 tempest-TestMinimumBasicScenario-285966464 tempest-TestMinimumBasicScenario-285966464-project-member] Lock "1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.726s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:36:31 user nova-compute[74190]: DEBUG nova.compute.manager [req-9ca6b91b-4abb-4cfa-afb9-38a5cdb89247 req-161c1544-c13b-4fba-8ebe-760a20a181d1 service nova] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Received event network-vif-plugged-e1de485e-b105-42fd-a9f5-2467bf5404ce {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:36:31 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-9ca6b91b-4abb-4cfa-afb9-38a5cdb89247 req-161c1544-c13b-4fba-8ebe-760a20a181d1 service nova] Acquiring lock "1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:36:31 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-9ca6b91b-4abb-4cfa-afb9-38a5cdb89247 req-161c1544-c13b-4fba-8ebe-760a20a181d1 service nova] Lock "1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:36:31 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-9ca6b91b-4abb-4cfa-afb9-38a5cdb89247 req-161c1544-c13b-4fba-8ebe-760a20a181d1 service nova] Lock "1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:36:31 user nova-compute[74190]: DEBUG nova.compute.manager [req-9ca6b91b-4abb-4cfa-afb9-38a5cdb89247 req-161c1544-c13b-4fba-8ebe-760a20a181d1 service nova] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] No waiting events found dispatching network-vif-plugged-e1de485e-b105-42fd-a9f5-2467bf5404ce {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:36:31 user nova-compute[74190]: WARNING nova.compute.manager [req-9ca6b91b-4abb-4cfa-afb9-38a5cdb89247 req-161c1544-c13b-4fba-8ebe-760a20a181d1 service nova] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Received unexpected event network-vif-plugged-e1de485e-b105-42fd-a9f5-2467bf5404ce for instance with vm_state deleted and task_state None.
Oct 18 12:36:31 user nova-compute[74190]: DEBUG nova.compute.manager [req-9ca6b91b-4abb-4cfa-afb9-38a5cdb89247 req-161c1544-c13b-4fba-8ebe-760a20a181d1 service nova] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Received event network-vif-plugged-e1de485e-b105-42fd-a9f5-2467bf5404ce {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:36:31 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-9ca6b91b-4abb-4cfa-afb9-38a5cdb89247 req-161c1544-c13b-4fba-8ebe-760a20a181d1 service nova] Acquiring lock "1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:36:31 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-9ca6b91b-4abb-4cfa-afb9-38a5cdb89247 req-161c1544-c13b-4fba-8ebe-760a20a181d1 service nova] Lock "1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:36:31 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-9ca6b91b-4abb-4cfa-afb9-38a5cdb89247 req-161c1544-c13b-4fba-8ebe-760a20a181d1 service nova] Lock "1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:36:31 user nova-compute[74190]: DEBUG nova.compute.manager [req-9ca6b91b-4abb-4cfa-afb9-38a5cdb89247 req-161c1544-c13b-4fba-8ebe-760a20a181d1 service nova] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] No waiting events found dispatching network-vif-plugged-e1de485e-b105-42fd-a9f5-2467bf5404ce {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:36:31 user nova-compute[74190]: WARNING nova.compute.manager [req-9ca6b91b-4abb-4cfa-afb9-38a5cdb89247 req-161c1544-c13b-4fba-8ebe-760a20a181d1 service nova] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Received unexpected event network-vif-plugged-e1de485e-b105-42fd-a9f5-2467bf5404ce for instance with vm_state deleted and task_state None.
Oct 18 12:36:31 user nova-compute[74190]: DEBUG nova.compute.manager [req-9ca6b91b-4abb-4cfa-afb9-38a5cdb89247 req-161c1544-c13b-4fba-8ebe-760a20a181d1 service nova] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Received event network-vif-plugged-e1de485e-b105-42fd-a9f5-2467bf5404ce {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:36:31 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-9ca6b91b-4abb-4cfa-afb9-38a5cdb89247 req-161c1544-c13b-4fba-8ebe-760a20a181d1 service nova] Acquiring lock "1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:36:31 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-9ca6b91b-4abb-4cfa-afb9-38a5cdb89247 req-161c1544-c13b-4fba-8ebe-760a20a181d1 service nova] Lock "1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:36:31 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-9ca6b91b-4abb-4cfa-afb9-38a5cdb89247 req-161c1544-c13b-4fba-8ebe-760a20a181d1 service nova] Lock "1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:36:31 user nova-compute[74190]: DEBUG nova.compute.manager [req-9ca6b91b-4abb-4cfa-afb9-38a5cdb89247 req-161c1544-c13b-4fba-8ebe-760a20a181d1 service nova] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] No waiting events found dispatching network-vif-plugged-e1de485e-b105-42fd-a9f5-2467bf5404ce {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:36:31 user nova-compute[74190]: WARNING nova.compute.manager [req-9ca6b91b-4abb-4cfa-afb9-38a5cdb89247 req-161c1544-c13b-4fba-8ebe-760a20a181d1 service nova] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Received unexpected event network-vif-plugged-e1de485e-b105-42fd-a9f5-2467bf5404ce for instance with vm_state deleted and task_state None.
Oct 18 12:36:31 user nova-compute[74190]: DEBUG nova.compute.manager [req-9ca6b91b-4abb-4cfa-afb9-38a5cdb89247 req-161c1544-c13b-4fba-8ebe-760a20a181d1 service nova] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Received event network-vif-unplugged-e1de485e-b105-42fd-a9f5-2467bf5404ce {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:36:31 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-9ca6b91b-4abb-4cfa-afb9-38a5cdb89247 req-161c1544-c13b-4fba-8ebe-760a20a181d1 service nova] Acquiring lock "1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:36:31 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-9ca6b91b-4abb-4cfa-afb9-38a5cdb89247 req-161c1544-c13b-4fba-8ebe-760a20a181d1 service nova] Lock "1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:36:31 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-9ca6b91b-4abb-4cfa-afb9-38a5cdb89247 req-161c1544-c13b-4fba-8ebe-760a20a181d1 service nova] Lock "1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:36:31 user nova-compute[74190]: DEBUG nova.compute.manager [req-9ca6b91b-4abb-4cfa-afb9-38a5cdb89247 req-161c1544-c13b-4fba-8ebe-760a20a181d1 service nova] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] No waiting events found dispatching network-vif-unplugged-e1de485e-b105-42fd-a9f5-2467bf5404ce {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:36:31 user nova-compute[74190]: WARNING nova.compute.manager [req-9ca6b91b-4abb-4cfa-afb9-38a5cdb89247 req-161c1544-c13b-4fba-8ebe-760a20a181d1 service nova] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Received unexpected event network-vif-unplugged-e1de485e-b105-42fd-a9f5-2467bf5404ce for instance with vm_state deleted and task_state None.
Oct 18 12:36:31 user nova-compute[74190]: DEBUG nova.compute.manager [req-9ca6b91b-4abb-4cfa-afb9-38a5cdb89247 req-161c1544-c13b-4fba-8ebe-760a20a181d1 service nova] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Received event network-vif-plugged-e1de485e-b105-42fd-a9f5-2467bf5404ce {{(pid=74190) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 18 12:36:31 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-9ca6b91b-4abb-4cfa-afb9-38a5cdb89247 req-161c1544-c13b-4fba-8ebe-760a20a181d1 service nova] Acquiring lock "1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:36:31 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-9ca6b91b-4abb-4cfa-afb9-38a5cdb89247 req-161c1544-c13b-4fba-8ebe-760a20a181d1 service nova] Lock "1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:36:31 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [req-9ca6b91b-4abb-4cfa-afb9-38a5cdb89247 req-161c1544-c13b-4fba-8ebe-760a20a181d1 service nova] Lock "1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:36:31 user nova-compute[74190]: DEBUG nova.compute.manager [req-9ca6b91b-4abb-4cfa-afb9-38a5cdb89247 req-161c1544-c13b-4fba-8ebe-760a20a181d1 service nova] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] No waiting events found dispatching network-vif-plugged-e1de485e-b105-42fd-a9f5-2467bf5404ce {{(pid=74190) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 18 12:36:31 user nova-compute[74190]: WARNING nova.compute.manager [req-9ca6b91b-4abb-4cfa-afb9-38a5cdb89247 req-161c1544-c13b-4fba-8ebe-760a20a181d1 service nova] [instance: 1d81eb9e-01a9-41bd-88f8-ca9c1ef3a7e8] Received unexpected event network-vif-plugged-e1de485e-b105-42fd-a9f5-2467bf5404ce for instance with vm_state deleted and task_state None.
Oct 18 12:36:34 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:36:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:36:37 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:36:39 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:36:42 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:36:43 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:36:44 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:36:44 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:36:46 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:36:46 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:36:46 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:36:46 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:36:46 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:36:46 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Auditing locally available compute resources for user (node: user) {{(pid=74190) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 12:36:46 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:36:46 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:36:46 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Hypervisor/Node resource view: name=user free_ram=9099MB free_disk=25.11540985107422GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74190) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 12:36:46 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:36:46 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:36:46 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 12:36:46 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 12:36:46 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 12:36:46 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 12:36:46 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Compute_service record updated for user:user {{(pid=74190) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 12:36:46 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.140s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:36:49 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:36:49 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:36:49 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Starting heal instance info cache {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 12:36:49 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Rebuilding the list of instances to heal {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 18 12:36:49 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Didn't find any instances for network info cache update. {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 18 12:36:49 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:36:51 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:36:51 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74190) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 12:36:54 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:36:59 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:37:04 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:37:06 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:37:09 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:37:09 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:37:09 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74190) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 18 12:37:09 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:37:09 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74190) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 18 12:37:09 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:37:14 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:37:19 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:37:21 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:37:22 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:37:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:37:25 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:37:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:37:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:37:36 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:37:38 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:37:39 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:37:42 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:37:44 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:37:44 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:37:46 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:37:46 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:37:46 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:37:46 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:37:46 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Auditing locally available compute resources for user (node: user) {{(pid=74190) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 12:37:46 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:37:46 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:37:46 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Hypervisor/Node resource view: name=user free_ram=9125MB free_disk=25.153881072998047GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74190) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 12:37:46 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:37:46 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:37:46 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 12:37:46 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 12:37:46 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 12:37:46 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 12:37:46 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Compute_service record updated for user:user {{(pid=74190) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 12:37:46 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.113s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:37:47 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:37:49 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:37:49 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Starting heal instance info cache {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 12:37:49 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Rebuilding the list of instances to heal {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 18 12:37:49 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Didn't find any instances for network info cache update. {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 18 12:37:49 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:37:51 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:37:51 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:37:53 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:37:53 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74190) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 12:37:54 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:37:54 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Cleaning up deleted instances {{(pid=74190) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 18 12:37:54 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] There are 0 instances to clean {{(pid=74190) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 18 12:37:54 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:37:54 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74190) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 18 12:37:54 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:37:59 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:37:59 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:38:04 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:38:09 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:38:14 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:38:14 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:38:19 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:38:24 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:38:29 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:38:34 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:38:38 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:38:39 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:38:39 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:38:42 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:38:44 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:38:45 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:38:46 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:38:46 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:38:46 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:38:46 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:38:46 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:38:46 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Auditing locally available compute resources for user (node: user) {{(pid=74190) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 18 12:38:46 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:38:46 user nova-compute[74190]: WARNING nova.virt.libvirt.driver [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 18 12:38:46 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Hypervisor/Node resource view: name=user free_ram=9117MB free_disk=25.152660369873047GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74190) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 18 12:38:46 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 18 12:38:46 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 18 12:38:46 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 18 12:38:46 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74190) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 18 12:38:46 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Refreshing inventories for resource provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 18 12:38:46 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Updating ProviderTree inventory for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 18 12:38:46 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Updating inventory in ProviderTree for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 18 12:38:46 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Refreshing aggregate associations for resource provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66, aggregates: None {{(pid=74190) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 18 12:38:46 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Refreshing trait associations for resource provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66, traits: COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE42,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_ACCELERATORS,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=74190) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 18 12:38:46 user nova-compute[74190]: DEBUG nova.compute.provider_tree [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed in ProviderTree for provider: 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 {{(pid=74190) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 18 12:38:46 user nova-compute[74190]: DEBUG nova.scheduler.client.report [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Inventory has not changed for provider 11291cdf-1d1c-43a5-bad7-6a29a5f06f66 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74190) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 18 12:38:46 user nova-compute[74190]: DEBUG nova.compute.resource_tracker [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Compute_service record updated for user:user {{(pid=74190) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 18 12:38:46 user nova-compute[74190]: DEBUG oslo_concurrency.lockutils [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.297s {{(pid=74190) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 18 12:38:49 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:38:49 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:38:51 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:38:51 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Starting heal instance info cache {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 18 12:38:51 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Rebuilding the list of instances to heal {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 18 12:38:51 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Didn't find any instances for network info cache update. {{(pid=74190) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 18 12:38:53 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:38:53 user nova-compute[74190]: DEBUG oslo_service.periodic_task [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74190) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 18 12:38:53 user nova-compute[74190]: DEBUG nova.compute.manager [None req-b741a8f6-fed4-4f99-80d9-d9f5fe12c569 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74190) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 18 12:38:54 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:38:59 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 18 12:39:04 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 18 12:39:09 user nova-compute[74190]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74190) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}